2024-05-28T05:49:54.547 INFO:root:teuthology version: 0.0.1.dev291+ge7ae758 2024-05-28T05:49:54.547 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}} --archive /home/teuthworker/archive/rishabh-2024-05-28_05:40:25-fs:volumes-rishabh-clone-stats-testing-default-smithi/7729375 --owner scheduled_rishabh@teuthology --name rishabh-2024-05-28_05:40:25-fs:volumes-rishabh-clone-stats-testing-default-smithi --verbose -- /home/teuthworker/archive/rishabh-2024-05-28_05:40:25-fs:volumes-rishabh-clone-stats-testing-default-smithi/7729375/orig.config.yaml 2024-05-28T05:49:54.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-28T05:49:54.684 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-05-28_05:40:25-fs:volumes-rishabh-clone-stats-testing-default-smithi/7729375 branch: rishabh-clone-stats description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}} email: null first_in_suite: false job_id: '7729375' kernel: client: branch: testing flavor: default kdb: 1 sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-05-28_05:40:25-fs:volumes-rishabh-clone-stats-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: rishabh-clone-stats ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 9ed025fbf4406fb54980a0647506b15895b6d863 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 9ed025fbf4406fb54980a0647506b15895b6d863 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: mgr-vol-clone-stats sha1: 9ed025fbf4406fb54980a0647506b15895b6d863 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8528 sha1: 9ed025fbf4406fb54980a0647506b15895b6d863 sleep_before_teardown: 0 suite: fs:volumes suite_branch: mgr-vol-clone-stats suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_9ed025fbf4406fb54980a0647506b15895b6d863/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 9ed025fbf4406fb54980a0647506b15895b6d863 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi122.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLbBynBp/pDTBjGa0Y/fN4CIiFmU8fAurd+dyBbqsI7q6xsk3cBL1v3upoHWkU0wbLJp99SES3jbDL4evuExqBo= smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB4OA8sdrlF7TAhicM9dZbM2UnsKyW3yN/uyX8xEz3/V3LyqP8jnzN77ERl+h4zsXdfL3brsWwaEZkpPOkaNMt4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestCloneProgressReporter teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e7ae7580c417d6ab27fda98fecadca5d9f85d63e timestamp: 2024-05-28_05:40:25 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-05-28T05:49:54.684 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_9ed025fbf4406fb54980a0647506b15895b6d863/qa; will attempt to use it 2024-05-28T05:49:54.685 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_9ed025fbf4406fb54980a0647506b15895b6d863/qa/tasks 2024-05-28T05:49:54.685 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-28T05:49:54.687 INFO:teuthology.task.internal:Checking packages... 2024-05-28T05:49:54.707 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '9ed025fbf4406fb54980a0647506b15895b6d863' 2024-05-28T05:49:54.707 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-28T05:49:54.707 INFO:teuthology.packaging:ref: None 2024-05-28T05:49:54.707 INFO:teuthology.packaging:tag: None 2024-05-28T05:49:54.707 INFO:teuthology.packaging:branch: rishabh-clone-stats 2024-05-28T05:49:54.707 INFO:teuthology.packaging:sha1: 9ed025fbf4406fb54980a0647506b15895b6d863 2024-05-28T05:49:54.707 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=rishabh-clone-stats 2024-05-28T05:49:54.928 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3154-g9ed025fb-1jammy 2024-05-28T05:49:54.929 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-28T05:49:54.935 INFO:teuthology.task.internal:no buildpackages task found 2024-05-28T05:49:54.936 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-28T05:49:54.957 INFO:teuthology.task.internal:Saving configuration 2024-05-28T05:49:54.975 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-28T05:49:54.981 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-28T05:49:55.018 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi122.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-28_05:40:25-fs:volumes-rishabh-clone-stats-testing-default-smithi/7729375', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-28 05:44:11.670162', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDn0S/VpwA91vSQvGCKVgEhz/WmdkyNIMr88T7bOHmIO'} 2024-05-28T05:49:55.042 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-28_05:40:25-fs:volumes-rishabh-clone-stats-testing-default-smithi/7729375', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-28 05:44:11.669041', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEKG2yywVoEb+5kCcJlpj+CUa/TmF8+/3hAykbVEalP1'} 2024-05-28T05:49:55.042 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-28T05:49:55.048 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-28T05:49:55.048 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-28T05:49:55.048 INFO:teuthology.run_tasks:Running task console_log... 2024-05-28T05:49:55.113 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f875f133be0>, signals=[15]) 2024-05-28T05:49:55.113 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-28T05:49:55.119 INFO:teuthology.task.internal:Opening connections... 2024-05-28T05:49:55.119 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi122.front.sepia.ceph.com 2024-05-28T05:49:55.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-28T05:49:55.200 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2024-05-28T05:49:55.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-28T05:49:55.278 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-28T05:49:55.284 DEBUG:teuthology.orchestra.run.smithi122:> uname -m 2024-05-28T05:49:55.289 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2024-05-28T05:49:55.289 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2024-05-28T05:49:55.334 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-28T05:49:55.334 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="Ubuntu" 2024-05-28T05:49:55.334 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="22.04" 2024-05-28T05:49:55.334 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-28T05:49:55.334 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_CODENAME=jammy 2024-05-28T05:49:55.334 INFO:teuthology.orchestra.run.smithi122.stdout:ID=ubuntu 2024-05-28T05:49:55.334 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE=debian 2024-05-28T05:49:55.335 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-28T05:49:55.335 INFO:teuthology.orchestra.run.smithi122.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-28T05:49:55.335 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-28T05:49:55.335 INFO:teuthology.orchestra.run.smithi122.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-28T05:49:55.335 INFO:teuthology.orchestra.run.smithi122.stdout:UBUNTU_CODENAME=jammy 2024-05-28T05:49:55.335 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2024-05-28T05:49:55.355 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-05-28T05:49:55.360 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-05-28T05:49:55.361 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-05-28T05:49:55.407 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-28T05:49:55.407 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2024-05-28T05:49:55.407 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="22.04" 2024-05-28T05:49:55.407 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-28T05:49:55.407 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=jammy 2024-05-28T05:49:55.407 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2024-05-28T05:49:55.407 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2024-05-28T05:49:55.408 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-28T05:49:55.408 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-28T05:49:55.408 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-28T05:49:55.408 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-28T05:49:55.408 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=jammy 2024-05-28T05:49:55.408 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-05-28T05:49:55.430 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-28T05:49:55.439 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-28T05:49:55.448 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-28T05:49:55.448 DEBUG:teuthology.orchestra.run.smithi122:> test '!' -e /home/ubuntu/cephtest 2024-05-28T05:49:55.451 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2024-05-28T05:49:55.455 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-28T05:49:55.463 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-28T05:49:55.464 DEBUG:teuthology.orchestra.run.smithi122:> test -z $(ls -A /var/lib/ceph) 2024-05-28T05:49:55.496 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2024-05-28T05:49:55.510 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-28T05:49:55.557 INFO:teuthology.run_tasks:Running task kernel... 2024-05-28T05:49:55.571 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'} 2024-05-28T05:49:55.571 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-05-28T05:49:55.571 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-05-28T05:49:55.571 DEBUG:teuthology.orchestra.run.smithi122:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-28T05:49:55.572 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-28T05:49:55.576 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-28T05:49:55.577 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-05-28T05:49:55.580 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-28T05:49:55.580 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-05-28T05:49:55.777 DEBUG:teuthology.task.kernel:sha1 for client.0 is b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-28T05:49:55.777 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "b9459a26b0888785d05c47deb35abc9d0354ab93"... 2024-05-28T05:49:55.777 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-05-28T05:49:55.783 INFO:teuthology.orchestra.run.smithi122.stdout:5.15.0-56-generic 2024-05-28T05:49:55.783 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-28T05:49:55.783 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-28T05:49:55.784 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-05-28T05:49:55.784 DEBUG:teuthology.orchestra.run.smithi122:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-05-28T05:49:55.839 INFO:teuthology.orchestra.run.smithi122.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-05-28T05:49:55.876 DEBUG:teuthology.task.kernel:sha1 for client.1 is b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-28T05:49:55.876 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "b9459a26b0888785d05c47deb35abc9d0354ab93"... 2024-05-28T05:49:55.877 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-05-28T05:49:55.882 INFO:teuthology.orchestra.run.smithi153.stdout:5.15.0-56-generic 2024-05-28T05:49:55.882 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-28T05:49:55.882 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-28T05:49:55.883 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-05-28T05:49:55.883 DEBUG:teuthology.orchestra.run.smithi153:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-05-28T05:49:55.946 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-05-28T05:49:55.979 INFO:teuthology.orchestra.run.smithi122.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-05-28T05:49:55.979 INFO:teuthology.orchestra.run.smithi122.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-05-28T05:49:55.979 INFO:teuthology.orchestra.run.smithi122.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-05-28T05:49:55.979 INFO:teuthology.orchestra.run.smithi122.stderr:hint: 2024-05-28T05:49:55.979 INFO:teuthology.orchestra.run.smithi122.stderr:hint: git config --global init.defaultBranch 2024-05-28T05:49:55.979 INFO:teuthology.orchestra.run.smithi122.stderr:hint: 2024-05-28T05:49:55.979 INFO:teuthology.orchestra.run.smithi122.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-05-28T05:49:55.979 INFO:teuthology.orchestra.run.smithi122.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-05-28T05:49:55.979 INFO:teuthology.orchestra.run.smithi122.stderr:hint: 2024-05-28T05:49:55.980 INFO:teuthology.orchestra.run.smithi122.stderr:hint: git branch -m 2024-05-28T05:49:55.980 INFO:teuthology.orchestra.run.smithi122.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-05-28T05:49:55.982 DEBUG:teuthology.orchestra.run.smithi122:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-05-28T05:49:56.049 DEBUG:teuthology.orchestra.run.smithi122:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-05-28T05:49:56.078 INFO:teuthology.orchestra.run.smithi153.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-05-28T05:49:56.079 INFO:teuthology.orchestra.run.smithi153.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-05-28T05:49:56.079 INFO:teuthology.orchestra.run.smithi153.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-05-28T05:49:56.079 INFO:teuthology.orchestra.run.smithi153.stderr:hint: 2024-05-28T05:49:56.079 INFO:teuthology.orchestra.run.smithi153.stderr:hint: git config --global init.defaultBranch 2024-05-28T05:49:56.079 INFO:teuthology.orchestra.run.smithi153.stderr:hint: 2024-05-28T05:49:56.079 INFO:teuthology.orchestra.run.smithi153.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-05-28T05:49:56.079 INFO:teuthology.orchestra.run.smithi153.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-05-28T05:49:56.079 INFO:teuthology.orchestra.run.smithi153.stderr:hint: 2024-05-28T05:49:56.079 INFO:teuthology.orchestra.run.smithi153.stderr:hint: git branch -m 2024-05-28T05:49:56.080 INFO:teuthology.orchestra.run.smithi153.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-05-28T05:49:56.082 DEBUG:teuthology.orchestra.run.smithi153:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-05-28T05:49:56.108 DEBUG:teuthology.orchestra.run.smithi122:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-05-28T05:49:56.151 DEBUG:teuthology.orchestra.run.smithi153:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-05-28T05:49:56.212 DEBUG:teuthology.orchestra.run.smithi153:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-05-28T05:51:16.320 INFO:teuthology.orchestra.run.smithi153.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-05-28T05:51:16.320 INFO:teuthology.orchestra.run.smithi153.stderr: * [new branch] main -> origin/main 2024-05-28T05:51:16.354 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20190312 -> 20190312 2024-05-28T05:51:16.354 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20190416 -> 20190416 2024-05-28T05:51:16.354 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20190514 -> 20190514 2024-05-28T05:51:16.354 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20190618 -> 20190618 2024-05-28T05:51:16.354 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20190717 -> 20190717 2024-05-28T05:51:16.354 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20190815 -> 20190815 2024-05-28T05:51:16.354 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20190923 -> 20190923 2024-05-28T05:51:16.354 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20191022 -> 20191022 2024-05-28T05:51:16.355 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20191215 -> 20191215 2024-05-28T05:51:16.355 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20200122 -> 20200122 2024-05-28T05:51:16.355 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20200316 -> 20200316 2024-05-28T05:51:16.356 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20200421 -> 20200421 2024-05-28T05:51:16.357 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20200519 -> 20200519 2024-05-28T05:51:16.357 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20200619 -> 20200619 2024-05-28T05:51:16.357 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20200721 -> 20200721 2024-05-28T05:51:16.357 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20200817 -> 20200817 2024-05-28T05:51:16.357 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20200918 -> 20200918 2024-05-28T05:51:16.357 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20201022 -> 20201022 2024-05-28T05:51:16.357 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20201118 -> 20201118 2024-05-28T05:51:16.357 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20201218 -> 20201218 2024-05-28T05:51:16.357 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20210208 -> 20210208 2024-05-28T05:51:16.358 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20210315 -> 20210315 2024-05-28T05:51:16.358 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20210511 -> 20210511 2024-05-28T05:51:16.358 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20210716 -> 20210716 2024-05-28T05:51:16.358 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20210818 -> 20210818 2024-05-28T05:51:16.358 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20210919 -> 20210919 2024-05-28T05:51:16.358 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20211027 -> 20211027 2024-05-28T05:51:16.358 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20211216 -> 20211216 2024-05-28T05:51:16.358 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20220209 -> 20220209 2024-05-28T05:51:16.361 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20220310 -> 20220310 2024-05-28T05:51:16.361 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20220411 -> 20220411 2024-05-28T05:51:16.361 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20220509 -> 20220509 2024-05-28T05:51:16.361 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20220610 -> 20220610 2024-05-28T05:51:16.361 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20220708 -> 20220708 2024-05-28T05:51:16.361 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20220815 -> 20220815 2024-05-28T05:51:16.361 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20220913 -> 20220913 2024-05-28T05:51:16.361 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20221012 -> 20221012 2024-05-28T05:51:16.362 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20221109 -> 20221109 2024-05-28T05:51:16.362 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20221214 -> 20221214 2024-05-28T05:51:16.362 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20230117 -> 20230117 2024-05-28T05:51:16.362 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20230210 -> 20230210 2024-05-28T05:51:16.362 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20230310 -> 20230310 2024-05-28T05:51:16.362 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20230404 -> 20230404 2024-05-28T05:51:16.362 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20230515 -> 20230515 2024-05-28T05:51:16.362 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20230625 -> 20230625 2024-05-28T05:51:16.362 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20230804 -> 20230804 2024-05-28T05:51:16.362 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20230919 -> 20230919 2024-05-28T05:51:16.362 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20231030 -> 20231030 2024-05-28T05:51:16.362 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20231111 -> 20231111 2024-05-28T05:51:16.362 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20231211 -> 20231211 2024-05-28T05:51:16.362 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20240115 -> 20240115 2024-05-28T05:51:16.362 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20240220 -> 20240220 2024-05-28T05:51:16.363 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20240312 -> 20240312 2024-05-28T05:51:16.363 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20240410 -> 20240410 2024-05-28T05:51:16.363 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20240513 -> 20240513 2024-05-28T05:51:20.090 INFO:teuthology.orchestra.run.smithi122.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-05-28T05:51:20.090 INFO:teuthology.orchestra.run.smithi122.stderr: * [new branch] main -> origin/main 2024-05-28T05:51:20.125 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20190312 -> 20190312 2024-05-28T05:51:20.125 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20190416 -> 20190416 2024-05-28T05:51:20.125 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20190514 -> 20190514 2024-05-28T05:51:20.125 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20190618 -> 20190618 2024-05-28T05:51:20.125 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20190717 -> 20190717 2024-05-28T05:51:20.125 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20190815 -> 20190815 2024-05-28T05:51:20.125 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20190923 -> 20190923 2024-05-28T05:51:20.125 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20191022 -> 20191022 2024-05-28T05:51:20.128 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20191215 -> 20191215 2024-05-28T05:51:20.128 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20200122 -> 20200122 2024-05-28T05:51:20.128 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20200316 -> 20200316 2024-05-28T05:51:20.129 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20200421 -> 20200421 2024-05-28T05:51:20.129 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20200519 -> 20200519 2024-05-28T05:51:20.129 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20200619 -> 20200619 2024-05-28T05:51:20.129 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20200721 -> 20200721 2024-05-28T05:51:20.129 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20200817 -> 20200817 2024-05-28T05:51:20.129 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20200918 -> 20200918 2024-05-28T05:51:20.129 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20201022 -> 20201022 2024-05-28T05:51:20.129 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20201118 -> 20201118 2024-05-28T05:51:20.129 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20201218 -> 20201218 2024-05-28T05:51:20.129 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20210208 -> 20210208 2024-05-28T05:51:20.129 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20210315 -> 20210315 2024-05-28T05:51:20.129 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20210511 -> 20210511 2024-05-28T05:51:20.130 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20210716 -> 20210716 2024-05-28T05:51:20.130 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20210818 -> 20210818 2024-05-28T05:51:20.130 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20210919 -> 20210919 2024-05-28T05:51:20.130 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20211027 -> 20211027 2024-05-28T05:51:20.130 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20211216 -> 20211216 2024-05-28T05:51:20.130 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20220209 -> 20220209 2024-05-28T05:51:20.130 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20220310 -> 20220310 2024-05-28T05:51:20.130 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20220411 -> 20220411 2024-05-28T05:51:20.130 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20220509 -> 20220509 2024-05-28T05:51:20.130 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20220610 -> 20220610 2024-05-28T05:51:20.133 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20220708 -> 20220708 2024-05-28T05:51:20.133 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20220815 -> 20220815 2024-05-28T05:51:20.133 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20220913 -> 20220913 2024-05-28T05:51:20.133 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20221012 -> 20221012 2024-05-28T05:51:20.133 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20221109 -> 20221109 2024-05-28T05:51:20.133 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20221214 -> 20221214 2024-05-28T05:51:20.133 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20230117 -> 20230117 2024-05-28T05:51:20.133 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20230210 -> 20230210 2024-05-28T05:51:20.133 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20230310 -> 20230310 2024-05-28T05:51:20.133 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20230404 -> 20230404 2024-05-28T05:51:20.134 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20230515 -> 20230515 2024-05-28T05:51:20.134 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20230625 -> 20230625 2024-05-28T05:51:20.134 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20230804 -> 20230804 2024-05-28T05:51:20.134 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20230919 -> 20230919 2024-05-28T05:51:20.134 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20231030 -> 20231030 2024-05-28T05:51:20.134 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20231111 -> 20231111 2024-05-28T05:51:20.134 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20231211 -> 20231211 2024-05-28T05:51:20.134 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20240115 -> 20240115 2024-05-28T05:51:20.134 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20240220 -> 20240220 2024-05-28T05:51:20.134 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20240312 -> 20240312 2024-05-28T05:51:20.134 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20240410 -> 20240410 2024-05-28T05:51:20.134 INFO:teuthology.orchestra.run.smithi122.stderr: * [new tag] 20240513 -> 20240513 2024-05-28T05:51:20.667 INFO:teuthology.orchestra.run.smithi153.stderr:Updating files: 45% (1550/3421) Updating files: 46% (1574/3421) Updating files: 47% (1608/3421) Updating files: 48% (1643/3421) Updating files: 49% (1677/3421) Updating files: 50% (1711/3421) Updating files: 51% (1745/3421) Updating files: 52% (1779/3421) Updating files: 53% (1814/3421) Updating files: 54% (1848/3421) Updating files: 55% (1882/3421) Updating files: 56% (1916/3421) Updating files: 57% (1950/3421) Updating files: 58% (1985/3421) Updating files: 59% (2019/3421) Updating files: 59% (2043/3421) Updating files: 60% (2053/3421) Updating files: 61% (2087/3421) Updating files: 62% (2122/3421) Updating files: 63% (2156/3421) Updating files: 64% (2190/3421) Updating files: 65% (2224/3421) Updating files: 66% (2258/3421) Updating files: 67% (2293/3421) Updating files: 68% (2327/3421) Updating files: 69% (2361/3421) Updating files: 70% (2395/3421) Updating files: 70% (2402/3421) Updating files: 71% (2429/3421) Updating files: 72% (2464/3421) Updating files: 73% (2498/3421) Updating files: 74% (2532/3421) Updating files: 75% (2566/3421) Updating files: 76% (2600/3421) Updating files: 77% (2635/3421) Updating files: 78% (2669/3421) Updating files: 79% (2703/3421) Updating files: 80% (2737/3421) Updating files: 81% (2772/3421) Updating files: 82% (2806/3421) Updating files: 83% (2840/3421) Updating files: 83% (2846/3421) Updating files: 84% (2874/3421) Updating files: 85% (2908/3421) Updating files: 86% (2943/3421) Updating files: 87% (2977/3421) Updating files: 88% (3011/3421) Updating files: 89% (3045/3421) Updating files: 90% (3079/3421) Updating files: 91% (3114/3421) Updating files: 92% (3148/3421) Updating files: 93% (3182/3421) Updating files: 94% (3216/3421) Updating files: 95% (3250/3421) Updating files: 96% (3285/3421) Updating files: 97% (3319/3421) Updating files: 98% (3353/3421) Updating files: 99% (3387/3421) Updating files: 100% (3421/3421) Updating files: 100% (3421/3421), done. 2024-05-28T05:51:20.672 INFO:teuthology.orchestra.run.smithi153.stdout:HEAD is now at ec8627ef Merge branch 'amd-isp-staging' into 'main' 2024-05-28T05:51:20.694 INFO:teuthology.task.kernel:Downloading kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.1... 2024-05-28T05:51:20.695 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-28T05:51:20.941 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/ 2024-05-28T05:51:20.941 DEBUG:teuthology.orchestra.run.smithi153:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-gb9459a26b088_6.9.0-gb9459a26b088-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/ --input-file=- 2024-05-28T05:51:20.944 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi153.front.sepia.ceph.com to complete... 2024-05-28T05:51:22.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28 05:51:22 URL:https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/linux-image-6.9.0-gb9459a26b088_6.9.0-gb9459a26b088-1_amd64.deb [44988888/44988888] -> "/tmp/linux-image.deb" [1] 2024-05-28T05:51:22.716 INFO:teuthology.orchestra.run.smithi153.stderr:FINISHED --2024-05-28 05:51:22-- 2024-05-28T05:51:22.716 INFO:teuthology.orchestra.run.smithi153.stderr:Total wall clock time: 1.7s 2024-05-28T05:51:22.716 INFO:teuthology.orchestra.run.smithi153.stderr:Downloaded: 1 files, 43M in 1.6s (27.6 MB/s) 2024-05-28T05:51:22.720 INFO:teuthology.task.kernel:Installing kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.1... 2024-05-28T05:51:22.720 DEBUG:teuthology.orchestra.run.smithi153:> sudo dpkg -i /tmp/linux-image.deb 2024-05-28T05:51:23.021 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-image-6.9.0-gb9459a26b088. 2024-05-28T05:51:24.447 INFO:teuthology.orchestra.run.smithi122.stderr:Updating files: 45% (1544/3421) Updating files: 46% (1574/3421) Updating files: 47% (1608/3421) Updating files: 48% (1643/3421) Updating files: 49% (1677/3421) Updating files: 50% (1711/3421) Updating files: 51% (1745/3421) Updating files: 52% (1779/3421) Updating files: 53% (1814/3421) Updating files: 54% (1848/3421) Updating files: 55% (1882/3421) Updating files: 56% (1916/3421) Updating files: 57% (1950/3421) Updating files: 58% (1985/3421) Updating files: 59% (2019/3421) Updating files: 59% (2035/3421) Updating files: 60% (2053/3421) Updating files: 61% (2087/3421) Updating files: 62% (2122/3421) Updating files: 63% (2156/3421) Updating files: 64% (2190/3421) Updating files: 65% (2224/3421) Updating files: 66% (2258/3421) Updating files: 67% (2293/3421) Updating files: 68% (2327/3421) Updating files: 69% (2361/3421) Updating files: 70% (2395/3421) Updating files: 70% (2402/3421) Updating files: 71% (2429/3421) Updating files: 72% (2464/3421) Updating files: 73% (2498/3421) Updating files: 74% (2532/3421) Updating files: 75% (2566/3421) Updating files: 76% (2600/3421) Updating files: 77% (2635/3421) Updating files: 78% (2669/3421) Updating files: 79% (2703/3421) Updating files: 80% (2737/3421) Updating files: 81% (2772/3421) Updating files: 82% (2806/3421) Updating files: 83% (2840/3421) Updating files: 83% (2841/3421) Updating files: 84% (2874/3421) Updating files: 85% (2908/3421) Updating files: 86% (2943/3421) Updating files: 87% (2977/3421) Updating files: 88% (3011/3421) Updating files: 89% (3045/3421) Updating files: 90% (3079/3421) Updating files: 91% (3114/3421) Updating files: 92% (3148/3421) Updating files: 93% (3182/3421) Updating files: 94% (3216/3421) Updating files: 95% (3250/3421) Updating files: 96% (3285/3421) Updating files: 97% (3319/3421) Updating files: 98% (3353/3421) Updating files: 99% (3387/3421) Updating files: 100% (3421/3421) Updating files: 100% (3421/3421), done. 2024-05-28T05:51:24.452 INFO:teuthology.orchestra.run.smithi122.stdout:HEAD is now at ec8627ef Merge branch 'amd-isp-staging' into 'main' 2024-05-28T05:51:24.474 INFO:teuthology.task.kernel:Downloading kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.0... 2024-05-28T05:51:24.474 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-28T05:51:24.701 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/ 2024-05-28T05:51:24.701 DEBUG:teuthology.orchestra.run.smithi122:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-gb9459a26b088_6.9.0-gb9459a26b088-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/ --input-file=- 2024-05-28T05:51:24.704 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi122.front.sepia.ceph.com to complete... 2024-05-28T05:51:25.016 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-05-28T05:51:25.020 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-05-28T05:51:25.182 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-image-6.9.0-gb9459a26b088 (6.9.0-gb9459a26b088-1) ... 2024-05-28T05:51:26.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28 05:51:26 URL:https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/linux-image-6.9.0-gb9459a26b088_6.9.0-gb9459a26b088-1_amd64.deb [44988888/44988888] -> "/tmp/linux-image.deb" [1] 2024-05-28T05:51:26.505 INFO:teuthology.orchestra.run.smithi122.stderr:FINISHED --2024-05-28 05:51:26-- 2024-05-28T05:51:26.505 INFO:teuthology.orchestra.run.smithi122.stderr:Total wall clock time: 1.7s 2024-05-28T05:51:26.505 INFO:teuthology.orchestra.run.smithi122.stderr:Downloaded: 1 files, 43M in 1.6s (27.0 MB/s) 2024-05-28T05:51:26.509 INFO:teuthology.task.kernel:Installing kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.0... 2024-05-28T05:51:26.509 DEBUG:teuthology.orchestra.run.smithi122:> sudo dpkg -i /tmp/linux-image.deb 2024-05-28T05:51:26.811 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package linux-image-6.9.0-gb9459a26b088. 2024-05-28T05:51:28.828 INFO:teuthology.orchestra.run.smithi122.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-05-28T05:51:28.832 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-05-28T05:51:29.034 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-image-6.9.0-gb9459a26b088 (6.9.0-gb9459a26b088-1) ... 2024-05-28T05:51:29.189 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-image-6.9.0-gb9459a26b088 (6.9.0-gb9459a26b088-1) ... 2024-05-28T05:51:29.374 INFO:teuthology.orchestra.run.smithi153.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-28T05:51:32.721 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-image-6.9.0-gb9459a26b088 (6.9.0-gb9459a26b088-1) ... 2024-05-28T05:51:32.825 INFO:teuthology.orchestra.run.smithi122.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-28T05:51:52.209 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub' 2024-05-28T05:51:52.228 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-28T05:51:52.261 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2024-05-28T05:51:52.598 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-28T05:51:52.615 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-28T05:51:52.955 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-28T05:51:52.965 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-28T05:51:53.033 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-28T05:51:53.039 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-28T05:51:53.221 INFO:teuthology.orchestra.run.smithi153.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-28T05:51:53.221 INFO:teuthology.orchestra.run.smithi153.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-28T05:51:53.222 INFO:teuthology.orchestra.run.smithi153.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-28T05:51:53.265 INFO:teuthology.orchestra.run.smithi153.stderr:done 2024-05-28T05:51:53.470 DEBUG:teuthology.orchestra.run.smithi153:> dpkg-deb -c /tmp/linux-image.deb 2024-05-28T05:51:53.478 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./ 2024-05-28T05:51:53.478 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./boot/ 2024-05-28T05:51:53.478 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7004139 2024-05-23 11:07 ./boot/System.map-6.9.0-gb9459a26b088 2024-05-28T05:51:53.495 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 172251 2024-05-23 11:07 ./boot/config-6.9.0-gb9459a26b088 2024-05-28T05:51:53.496 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13136896 2024-05-23 11:07 ./boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-28T05:51:53.516 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/ 2024-05-28T05:51:53.516 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/ 2024-05-28T05:51:53.516 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/postinst.d/ 2024-05-28T05:51:53.516 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/postrm.d/ 2024-05-28T05:51:53.516 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/preinst.d/ 2024-05-28T05:51:53.516 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/prerm.d/ 2024-05-28T05:51:53.516 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/ 2024-05-28T05:51:53.516 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/ 2024-05-28T05:51:53.516 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/ 2024-05-28T05:51:53.516 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/ 2024-05-28T05:51:53.516 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/ 2024-05-28T05:51:53.517 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/ 2024-05-28T05:51:53.517 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ 2024-05-28T05:51:53.517 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 507497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/aesni-intel.ko 2024-05-28T05:51:53.519 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-28T05:51:53.519 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-28T05:51:53.520 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-28T05:51:53.520 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 97945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-28T05:51:53.520 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 109897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-28T05:51:53.520 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 155241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-28T05:51:53.520 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-28T05:51:53.520 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-28T05:51:53.520 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 87001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-28T05:51:53.520 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-28T05:51:53.520 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 50297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-28T05:51:53.520 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 50369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-28T05:51:53.520 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 54505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-28T05:51:53.520 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-28T05:51:53.521 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 48041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-28T05:51:53.521 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 62865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-28T05:51:53.521 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 53561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-28T05:51:53.521 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-28T05:51:53.521 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-28T05:51:53.521 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/ 2024-05-28T05:51:53.521 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/ 2024-05-28T05:51:53.521 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/ 2024-05-28T05:51:53.521 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 49073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-28T05:51:53.521 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpuid.ko 2024-05-28T05:51:53.521 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/msr.ko 2024-05-28T05:51:53.521 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/ 2024-05-28T05:51:53.521 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 443289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-28T05:51:53.522 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1037081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-28T05:51:53.522 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 2850153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm.ko 2024-05-28T05:51:53.538 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ 2024-05-28T05:51:53.538 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 65017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/af_alg.ko 2024-05-28T05:51:53.538 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/algif_hash.ko 2024-05-28T05:51:53.538 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/algif_skcipher.ko 2024-05-28T05:51:53.538 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ansi_cprng.ko 2024-05-28T05:51:53.538 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/anubis.ko 2024-05-28T05:51:53.538 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/arc4.ko 2024-05-28T05:51:53.538 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/asymmetric_keys/ 2024-05-28T05:51:53.539 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-05-28T05:51:53.539 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/ 2024-05-28T05:51:53.539 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_memcpy.ko 2024-05-28T05:51:53.539 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_pq.ko 2024-05-28T05:51:53.539 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-28T05:51:53.539 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_tx.ko 2024-05-28T05:51:53.539 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_xor.ko 2024-05-28T05:51:53.539 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/raid6test.ko 2024-05-28T05:51:53.539 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authenc.ko 2024-05-28T05:51:53.539 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authencesn.ko 2024-05-28T05:51:53.539 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blake2b_generic.ko 2024-05-28T05:51:53.539 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_common.ko 2024-05-28T05:51:53.539 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_generic.ko 2024-05-28T05:51:53.540 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/camellia_generic.ko 2024-05-28T05:51:53.540 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast5_generic.ko 2024-05-28T05:51:53.540 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast6_generic.ko 2024-05-28T05:51:53.540 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast_common.ko 2024-05-28T05:51:53.540 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ccm.ko 2024-05-28T05:51:53.540 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cmac.ko 2024-05-28T05:51:53.540 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crc32_generic.ko 2024-05-28T05:51:53.540 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 59121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cryptd.ko 2024-05-28T05:51:53.540 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 48105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_engine.ko 2024-05-28T05:51:53.540 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_simd.ko 2024-05-28T05:51:53.540 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_user.ko 2024-05-28T05:51:53.540 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cts.ko 2024-05-28T05:51:53.540 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/des_generic.ko 2024-05-28T05:51:53.541 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/dh_generic.ko 2024-05-28T05:51:53.541 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/echainiv.ko 2024-05-28T05:51:53.541 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/essiv.ko 2024-05-28T05:51:53.541 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/fcrypt.ko 2024-05-28T05:51:53.541 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/khazad.ko 2024-05-28T05:51:53.541 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lrw.ko 2024-05-28T05:51:53.541 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4.ko 2024-05-28T05:51:53.541 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4hc.ko 2024-05-28T05:51:53.541 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/md4.ko 2024-05-28T05:51:53.541 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/michael_mic.ko 2024-05-28T05:51:53.541 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcbc.ko 2024-05-28T05:51:53.541 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcrypt.ko 2024-05-28T05:51:53.541 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/rmd160.ko 2024-05-28T05:51:53.541 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/seed.ko 2024-05-28T05:51:53.542 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/serpent_generic.ko 2024-05-28T05:51:53.542 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 169057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tcrypt.ko 2024-05-28T05:51:53.542 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tea.ko 2024-05-28T05:51:53.542 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_common.ko 2024-05-28T05:51:53.542 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_generic.ko 2024-05-28T05:51:53.542 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/vmac.ko 2024-05-28T05:51:53.542 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/wp512.ko 2024-05-28T05:51:53.542 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xcbc.ko 2024-05-28T05:51:53.542 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xor.ko 2024-05-28T05:51:53.542 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xts.ko 2024-05-28T05:51:53.542 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xxhash_generic.ko 2024-05-28T05:51:53.542 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ 2024-05-28T05:51:53.543 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ 2024-05-28T05:51:53.543 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_extlog.ko 2024-05-28T05:51:53.543 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-28T05:51:53.543 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_pad.ko 2024-05-28T05:51:53.543 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/apei/ 2024-05-28T05:51:53.543 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/apei/einj.ko 2024-05-28T05:51:53.543 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ec_sys.ko 2024-05-28T05:51:53.543 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/platform_profile.ko 2024-05-28T05:51:53.543 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbs.ko 2024-05-28T05:51:53.543 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbshc.ko 2024-05-28T05:51:53.543 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 119017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/video.ko 2024-05-28T05:51:53.543 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ 2024-05-28T05:51:53.543 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/acard-ahci.ko 2024-05-28T05:51:53.543 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 99177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci.ko 2024-05-28T05:51:53.544 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci_platform.ko 2024-05-28T05:51:53.544 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 107729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci.ko 2024-05-28T05:51:53.544 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci_platform.ko 2024-05-28T05:51:53.544 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_acpi.ko 2024-05-28T05:51:53.544 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ali.ko 2024-05-28T05:51:53.544 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_amd.ko 2024-05-28T05:51:53.544 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_artop.ko 2024-05-28T05:51:53.544 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atiixp.ko 2024-05-28T05:51:53.544 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atp867x.ko 2024-05-28T05:51:53.544 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd640.ko 2024-05-28T05:51:53.544 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd64x.ko 2024-05-28T05:51:53.544 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cypress.ko 2024-05-28T05:51:53.544 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_efar.ko 2024-05-28T05:51:53.545 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt366.ko 2024-05-28T05:51:53.545 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt37x.ko 2024-05-28T05:51:53.545 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-28T05:51:53.545 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-28T05:51:53.545 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it8213.ko 2024-05-28T05:51:53.545 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it821x.ko 2024-05-28T05:51:53.545 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_jmicron.ko 2024-05-28T05:51:53.545 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 60249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_legacy.ko 2024-05-28T05:51:53.545 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_marvell.ko 2024-05-28T05:51:53.545 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_mpiix.ko 2024-05-28T05:51:53.545 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_netcell.ko 2024-05-28T05:51:53.545 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ninja32.ko 2024-05-28T05:51:53.545 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87410.ko 2024-05-28T05:51:53.545 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87415.ko 2024-05-28T05:51:53.546 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_oldpiix.ko 2024-05-28T05:51:53.546 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_opti.ko 2024-05-28T05:51:53.546 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_optidma.ko 2024-05-28T05:51:53.546 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pcmcia.ko 2024-05-28T05:51:53.546 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-28T05:51:53.546 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-28T05:51:53.546 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_piccolo.ko 2024-05-28T05:51:53.546 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_radisys.ko 2024-05-28T05:51:53.546 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rdc.ko 2024-05-28T05:51:53.546 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rz1000.ko 2024-05-28T05:51:53.546 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sch.ko 2024-05-28T05:51:53.546 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_serverworks.ko 2024-05-28T05:51:53.546 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sil680.ko 2024-05-28T05:51:53.547 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sl82c105.ko 2024-05-28T05:51:53.547 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_triflex.ko 2024-05-28T05:51:53.547 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_via.ko 2024-05-28T05:51:53.547 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pdc_adma.ko 2024-05-28T05:51:53.547 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_inic162x.ko 2024-05-28T05:51:53.547 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 102113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_mv.ko 2024-05-28T05:51:53.547 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 85401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_nv.ko 2024-05-28T05:51:53.547 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_promise.ko 2024-05-28T05:51:53.547 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_qstor.ko 2024-05-28T05:51:53.547 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil.ko 2024-05-28T05:51:53.547 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 45897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil24.ko 2024-05-28T05:51:53.547 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sis.ko 2024-05-28T05:51:53.548 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_svw.ko 2024-05-28T05:51:53.548 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 53345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sx4.ko 2024-05-28T05:51:53.548 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_uli.ko 2024-05-28T05:51:53.548 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_via.ko 2024-05-28T05:51:53.548 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_vsc.ko 2024-05-28T05:51:53.548 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ 2024-05-28T05:51:53.548 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ks0108.ko 2024-05-28T05:51:53.548 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/ 2024-05-28T05:51:53.548 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 163833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/bcma.ko 2024-05-28T05:51:53.548 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/ 2024-05-28T05:51:53.548 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/ 2024-05-28T05:51:53.548 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 140833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/aoe.ko 2024-05-28T05:51:53.548 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/ 2024-05-28T05:51:53.549 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1241585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/drbd.ko 2024-05-28T05:51:53.549 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 203281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/floppy.ko 2024-05-28T05:51:53.549 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/ 2024-05-28T05:51:53.549 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 115257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-28T05:51:53.549 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 143425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/nbd.ko 2024-05-28T05:51:53.549 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/ 2024-05-28T05:51:53.549 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 126609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/null_blk.ko 2024-05-28T05:51:53.549 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 119865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/pktcdvd.ko 2024-05-28T05:51:53.549 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 313209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/rbd.ko 2024-05-28T05:51:53.549 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/ 2024-05-28T05:51:53.549 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 117217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-28T05:51:53.549 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/ 2024-05-28T05:51:53.549 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 70369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/zram.ko 2024-05-28T05:51:53.549 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ 2024-05-28T05:51:53.550 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/applicom.ko 2024-05-28T05:51:53.550 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hangcheck-timer.ko 2024-05-28T05:51:53.550 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/ 2024-05-28T05:51:53.550 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-28T05:51:53.550 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-28T05:51:53.550 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-28T05:51:53.550 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/via-rng.ko 2024-05-28T05:51:53.550 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-28T05:51:53.550 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ 2024-05-28T05:51:53.550 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-28T05:51:53.550 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 186913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-28T05:51:53.550 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-28T05:51:53.550 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 179441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-28T05:51:53.606 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 85433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-28T05:51:53.606 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 65305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-28T05:51:53.606 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/lp.ko 2024-05-28T05:51:53.607 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/ 2024-05-28T05:51:53.607 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 103385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/mwave.ko 2024-05-28T05:51:53.607 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/nvram.ko 2024-05-28T05:51:53.607 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ppdev.ko 2024-05-28T05:51:53.607 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 59233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tlclk.ko 2024-05-28T05:51:53.607 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/ 2024-05-28T05:51:53.607 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-28T05:51:53.607 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-05-28T05:51:53.607 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-05-28T05:51:53.607 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 39185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-05-28T05:51:53.607 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-28T05:51:53.607 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-28T05:51:53.608 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-05-28T05:51:53.608 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/ 2024-05-28T05:51:53.608 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_class.ko 2024-05-28T05:51:53.608 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 62537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_core.ko 2024-05-28T05:51:53.608 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-05-28T05:51:53.608 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/ 2024-05-28T05:51:53.608 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-palmas.ko 2024-05-28T05:51:53.608 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 57281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-si5351.ko 2024-05-28T05:51:53.608 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-twl6040.ko 2024-05-28T05:51:53.608 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-wm831x.ko 2024-05-28T05:51:53.608 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/ 2024-05-28T05:51:53.608 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-28T05:51:53.608 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-28T05:51:53.609 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-28T05:51:53.609 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ 2024-05-28T05:51:53.609 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ 2024-05-28T05:51:53.609 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 89209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-28T05:51:53.609 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 333593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp.ko 2024-05-28T05:51:53.609 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/ 2024-05-28T05:51:53.609 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/ 2024-05-28T05:51:53.609 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/ 2024-05-28T05:51:53.609 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 751433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-28T05:51:53.609 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-05-28T05:51:53.609 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-28T05:51:53.609 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-aes.ko 2024-05-28T05:51:53.609 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-sha.ko 2024-05-28T05:51:53.610 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/ 2024-05-28T05:51:53.610 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 90465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-28T05:51:53.610 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/ 2024-05-28T05:51:53.610 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/dca.ko 2024-05-28T05:51:53.610 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ 2024-05-28T05:51:53.610 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/ 2024-05-28T05:51:53.610 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-28T05:51:53.610 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ 2024-05-28T05:51:53.610 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 146745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-28T05:51:53.610 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ 2024-05-28T05:51:53.610 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 96137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/amd64_edac.ko 2024-05-28T05:51:53.611 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/e752x_edac.ko 2024-05-28T05:51:53.611 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 51097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/edac_mce_amd.ko 2024-05-28T05:51:53.611 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3000_edac.ko 2024-05-28T05:51:53.611 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3200_edac.ko 2024-05-28T05:51:53.611 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5100_edac.ko 2024-05-28T05:51:53.611 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5400_edac.ko 2024-05-28T05:51:53.611 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7300_edac.ko 2024-05-28T05:51:53.611 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 64153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7core_edac.ko 2024-05-28T05:51:53.611 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i82975x_edac.ko 2024-05-28T05:51:53.611 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ie31200_edac.ko 2024-05-28T05:51:53.611 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 68689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/sb_edac.ko 2024-05-28T05:51:53.611 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/x38_edac.ko 2024-05-28T05:51:53.611 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/ 2024-05-28T05:51:53.612 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-gpio.ko 2024-05-28T05:51:53.612 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max14577.ko 2024-05-28T05:51:53.612 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max77693.ko 2024-05-28T05:51:53.612 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max8997.ko 2024-05-28T05:51:53.612 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-palmas.ko 2024-05-28T05:51:53.612 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-rt8973a.ko 2024-05-28T05:51:53.612 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-sm5502.ko 2024-05-28T05:51:53.612 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/ 2024-05-28T05:51:53.612 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/dmi-sysfs.ko 2024-05-28T05:51:53.612 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/efi/ 2024-05-28T05:51:53.612 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/efi/efi-pstore.ko 2024-05-28T05:51:53.612 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-28T05:51:53.612 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/ 2024-05-28T05:51:53.613 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-adp5520.ko 2024-05-28T05:51:53.613 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-amd8111.ko 2024-05-28T05:51:53.613 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-arizona.ko 2024-05-28T05:51:53.613 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-da9052.ko 2024-05-28T05:51:53.613 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-da9055.ko 2024-05-28T05:51:53.613 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-dln2.ko 2024-05-28T05:51:53.613 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 81065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-f7188x.ko 2024-05-28T05:51:53.613 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-generic.ko 2024-05-28T05:51:53.613 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ich.ko 2024-05-28T05:51:53.613 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-05-28T05:51:53.613 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-kempld.ko 2024-05-28T05:51:53.613 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-lp3943.ko 2024-05-28T05:51:53.614 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max7300.ko 2024-05-28T05:51:53.614 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max730x.ko 2024-05-28T05:51:53.614 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max732x.ko 2024-05-28T05:51:53.614 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-05-28T05:51:53.614 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 55497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-pca953x.ko 2024-05-28T05:51:53.614 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-pcf857x.ko 2024-05-28T05:51:53.614 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-rdc321x.ko 2024-05-28T05:51:53.614 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-sch.ko 2024-05-28T05:51:53.614 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-sch311x.ko 2024-05-28T05:51:53.614 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-tps65912.ko 2024-05-28T05:51:53.614 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-twl4030.ko 2024-05-28T05:51:53.614 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-twl6040.ko 2024-05-28T05:51:53.615 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-28T05:51:53.615 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-vx855.ko 2024-05-28T05:51:53.615 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm831x.ko 2024-05-28T05:51:53.615 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm8350.ko 2024-05-28T05:51:53.615 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm8994.ko 2024-05-28T05:51:53.615 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/ 2024-05-28T05:51:53.615 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-a4tech.ko 2024-05-28T05:51:53.615 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-apple.ko 2024-05-28T05:51:53.615 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-appleir.ko 2024-05-28T05:51:53.615 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-aureal.ko 2024-05-28T05:51:53.615 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-axff.ko 2024-05-28T05:51:53.615 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-belkin.ko 2024-05-28T05:51:53.615 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cherry.ko 2024-05-28T05:51:53.615 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-chicony.ko 2024-05-28T05:51:53.616 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 74385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cp2112.ko 2024-05-28T05:51:53.616 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cypress.ko 2024-05-28T05:51:53.616 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-dr.ko 2024-05-28T05:51:53.616 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elecom.ko 2024-05-28T05:51:53.616 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elo.ko 2024-05-28T05:51:53.616 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-emsff.ko 2024-05-28T05:51:53.616 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ezkey.ko 2024-05-28T05:51:53.616 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gaff.ko 2024-05-28T05:51:53.616 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-generic.ko 2024-05-28T05:51:53.616 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gt683r.ko 2024-05-28T05:51:53.616 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gyration.ko 2024-05-28T05:51:53.616 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-28T05:51:53.616 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-28T05:51:53.617 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtekff.ko 2024-05-28T05:51:53.617 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-hyperv.ko 2024-05-28T05:51:53.617 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-icade.ko 2024-05-28T05:51:53.617 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kensington.ko 2024-05-28T05:51:53.617 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-keytouch.ko 2024-05-28T05:51:53.617 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kye.ko 2024-05-28T05:51:53.617 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lcpower.ko 2024-05-28T05:51:53.617 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-led.ko 2024-05-28T05:51:53.617 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 54209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lenovo.ko 2024-05-28T05:51:53.617 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lg-g15.ko 2024-05-28T05:51:53.617 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 67961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-28T05:51:53.617 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 121361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-28T05:51:53.617 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 97929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech.ko 2024-05-28T05:51:53.618 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-magicmouse.ko 2024-05-28T05:51:53.618 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-microsoft.ko 2024-05-28T05:51:53.618 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-monterey.ko 2024-05-28T05:51:53.618 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 58993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-multitouch.ko 2024-05-28T05:51:53.618 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 39689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ntrig.ko 2024-05-28T05:51:53.618 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ortek.ko 2024-05-28T05:51:53.618 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-penmount.ko 2024-05-28T05:51:53.618 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-petalynx.ko 2024-05-28T05:51:53.618 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 91217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-picolcd.ko 2024-05-28T05:51:53.618 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-pl.ko 2024-05-28T05:51:53.618 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-plantronics.ko 2024-05-28T05:51:53.618 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-primax.ko 2024-05-28T05:51:53.619 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-rmi.ko 2024-05-28T05:51:53.619 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-28T05:51:53.619 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-common.ko 2024-05-28T05:51:53.619 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-28T05:51:53.619 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-28T05:51:53.619 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-28T05:51:53.619 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-28T05:51:53.619 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-28T05:51:53.619 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-28T05:51:53.619 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-28T05:51:53.619 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-28T05:51:53.619 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-28T05:51:53.619 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat.ko 2024-05-28T05:51:53.620 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-saitek.ko 2024-05-28T05:51:53.620 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-samsung.ko 2024-05-28T05:51:53.620 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-28T05:51:53.620 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sjoy.ko 2024-05-28T05:51:53.620 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 62121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sony.ko 2024-05-28T05:51:53.620 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-speedlink.ko 2024-05-28T05:51:53.620 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-steelseries.ko 2024-05-28T05:51:53.620 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sunplus.ko 2024-05-28T05:51:53.620 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-28T05:51:53.620 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tivo.ko 2024-05-28T05:51:53.620 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tmff.ko 2024-05-28T05:51:53.620 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-topseed.ko 2024-05-28T05:51:53.620 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-twinhan.ko 2024-05-28T05:51:53.621 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 81097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-uclogic.ko 2024-05-28T05:51:53.621 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-waltop.ko 2024-05-28T05:51:53.621 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 184729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-wiimote.ko 2024-05-28T05:51:53.621 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-xinmo.ko 2024-05-28T05:51:53.621 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zpff.ko 2024-05-28T05:51:53.621 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zydacron.ko 2024-05-28T05:51:53.621 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 319897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid.ko 2024-05-28T05:51:53.621 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 39521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/uhid.ko 2024-05-28T05:51:53.621 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/ 2024-05-28T05:51:53.621 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 153617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbhid.ko 2024-05-28T05:51:53.621 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbkbd.ko 2024-05-28T05:51:53.621 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbmouse.ko 2024-05-28T05:51:53.621 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 261929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/wacom.ko 2024-05-28T05:51:53.622 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/ 2024-05-28T05:51:53.622 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 75057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_balloon.ko 2024-05-28T05:51:53.622 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 110657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_utils.ko 2024-05-28T05:51:53.622 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 381625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_vmbus.ko 2024-05-28T05:51:53.622 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ 2024-05-28T05:51:53.622 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 77145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru.ko 2024-05-28T05:51:53.622 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 67001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru3.ko 2024-05-28T05:51:53.622 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-28T05:51:53.622 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7414.ko 2024-05-28T05:51:53.622 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7418.ko 2024-05-28T05:51:53.622 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adc128d818.ko 2024-05-28T05:51:53.622 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1025.ko 2024-05-28T05:51:53.622 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 115049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1026.ko 2024-05-28T05:51:53.622 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1029.ko 2024-05-28T05:51:53.623 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 55217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1031.ko 2024-05-28T05:51:53.623 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm9240.ko 2024-05-28T05:51:53.623 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ads7828.ko 2024-05-28T05:51:53.623 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7410.ko 2024-05-28T05:51:53.623 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7411.ko 2024-05-28T05:51:53.623 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 89017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7462.ko 2024-05-28T05:51:53.623 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 49145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7470.ko 2024-05-28T05:51:53.623 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 81465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7475.ko 2024-05-28T05:51:53.623 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7x10.ko 2024-05-28T05:51:53.623 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 48169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/amc6821.ko 2024-05-28T05:51:53.623 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 68857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/applesmc.ko 2024-05-28T05:51:53.623 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 60185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asb100.ko 2024-05-28T05:51:53.623 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 69001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asc7621.ko 2024-05-28T05:51:53.623 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 47969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-28T05:51:53.624 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/atxp1.ko 2024-05-28T05:51:53.624 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/coretemp.ko 2024-05-28T05:51:53.624 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/da9052-hwmon.ko 2024-05-28T05:51:53.624 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/da9055-hwmon.ko 2024-05-28T05:51:53.624 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 55705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-28T05:51:53.624 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 113129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dme1737.ko 2024-05-28T05:51:53.624 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds1621.ko 2024-05-28T05:51:53.624 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds620.ko 2024-05-28T05:51:53.624 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc1403.ko 2024-05-28T05:51:53.624 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc2103.ko 2024-05-28T05:51:53.624 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc6w201.ko 2024-05-28T05:51:53.624 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 78913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71805f.ko 2024-05-28T05:51:53.624 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 108953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71882fg.ko 2024-05-28T05:51:53.625 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 50689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f75375s.ko 2024-05-28T05:51:53.625 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fam15h_power.ko 2024-05-28T05:51:53.625 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 65761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fschmd.ko 2024-05-28T05:51:53.625 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g760a.ko 2024-05-28T05:51:53.625 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g762.ko 2024-05-28T05:51:53.625 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 59753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl518sm.ko 2024-05-28T05:51:53.625 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 56305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl520sm.ko 2024-05-28T05:51:53.625 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hih6130.ko 2024-05-28T05:51:53.625 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-28T05:51:53.625 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5500_temp.ko 2024-05-28T05:51:53.625 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5k_amb.ko 2024-05-28T05:51:53.625 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmaem.ko 2024-05-28T05:51:53.625 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmpex.ko 2024-05-28T05:51:53.626 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina209.ko 2024-05-28T05:51:53.626 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina2xx.ko 2024-05-28T05:51:53.626 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 156457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/it87.ko 2024-05-28T05:51:53.626 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/jc42.ko 2024-05-28T05:51:53.626 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k10temp.ko 2024-05-28T05:51:53.626 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k8temp.ko 2024-05-28T05:51:53.626 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lineage-pem.ko 2024-05-28T05:51:53.626 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 57761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm63.ko 2024-05-28T05:51:53.626 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm73.ko 2024-05-28T05:51:53.626 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm75.ko 2024-05-28T05:51:53.626 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm77.ko 2024-05-28T05:51:53.626 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm78.ko 2024-05-28T05:51:53.626 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm80.ko 2024-05-28T05:51:53.627 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm83.ko 2024-05-28T05:51:53.627 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 86489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm85.ko 2024-05-28T05:51:53.627 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 55633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm87.ko 2024-05-28T05:51:53.627 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 76481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm90.ko 2024-05-28T05:51:53.627 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm92.ko 2024-05-28T05:51:53.627 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 131497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm93.ko 2024-05-28T05:51:53.627 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95234.ko 2024-05-28T05:51:53.627 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95241.ko 2024-05-28T05:51:53.627 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95245.ko 2024-05-28T05:51:53.627 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc2945.ko 2024-05-28T05:51:53.627 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4151.ko 2024-05-28T05:51:53.627 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4215.ko 2024-05-28T05:51:53.627 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4222.ko 2024-05-28T05:51:53.628 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4245.ko 2024-05-28T05:51:53.628 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4260.ko 2024-05-28T05:51:53.628 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4261.ko 2024-05-28T05:51:53.628 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max16065.ko 2024-05-28T05:51:53.628 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1619.ko 2024-05-28T05:51:53.628 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1668.ko 2024-05-28T05:51:53.628 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max197.ko 2024-05-28T05:51:53.628 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6639.ko 2024-05-28T05:51:53.628 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6650.ko 2024-05-28T05:51:53.628 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 39721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6697.ko 2024-05-28T05:51:53.628 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mc13783-adc.ko 2024-05-28T05:51:53.628 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mcp3021.ko 2024-05-28T05:51:53.628 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-05-28T05:51:53.629 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 56497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6683.ko 2024-05-28T05:51:53.629 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 141345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775-core.ko 2024-05-28T05:51:53.629 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 72729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775.ko 2024-05-28T05:51:53.629 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 67769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct7802.ko 2024-05-28T05:51:53.629 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 97769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87360.ko 2024-05-28T05:51:53.629 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 61913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87427.ko 2024-05-28T05:51:53.629 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pcf8591.ko 2024-05-28T05:51:53.629 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ 2024-05-28T05:51:53.629 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-28T05:51:53.629 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-28T05:51:53.629 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-28T05:51:53.629 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-28T05:51:53.630 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-28T05:51:53.630 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-28T05:51:53.630 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-28T05:51:53.630 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 101225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-28T05:51:53.630 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-28T05:51:53.630 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-28T05:51:53.630 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-28T05:51:53.630 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-28T05:51:53.630 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/powr1220.ko 2024-05-28T05:51:53.630 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5627.ko 2024-05-28T05:51:53.630 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5636.ko 2024-05-28T05:51:53.630 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-28T05:51:53.630 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht15.ko 2024-05-28T05:51:53.631 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht21.ko 2024-05-28T05:51:53.631 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/shtc1.ko 2024-05-28T05:51:53.631 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 48705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sis5595.ko 2024-05-28T05:51:53.631 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47b397.ko 2024-05-28T05:51:53.631 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 46465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m1.ko 2024-05-28T05:51:53.631 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m192.ko 2024-05-28T05:51:53.631 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/thmc50.ko 2024-05-28T05:51:53.631 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp102.ko 2024-05-28T05:51:53.631 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp103.ko 2024-05-28T05:51:53.631 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp401.ko 2024-05-28T05:51:53.631 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp421.ko 2024-05-28T05:51:53.631 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via-cputemp.ko 2024-05-28T05:51:53.631 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 50209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via686a.ko 2024-05-28T05:51:53.631 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 59657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt1211.ko 2024-05-28T05:51:53.632 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 62729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt8231.ko 2024-05-28T05:51:53.632 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 71161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627ehf.ko 2024-05-28T05:51:53.632 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 96569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627hf.ko 2024-05-28T05:51:53.632 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 85905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83781d.ko 2024-05-28T05:51:53.632 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 75121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83791d.ko 2024-05-28T05:51:53.632 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 83417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83792d.ko 2024-05-28T05:51:53.632 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 116769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83793.ko 2024-05-28T05:51:53.632 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 134433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83795.ko 2024-05-28T05:51:53.632 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l785ts.ko 2024-05-28T05:51:53.632 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l786ng.ko 2024-05-28T05:51:53.632 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-05-28T05:51:53.632 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-05-28T05:51:53.632 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/ 2024-05-28T05:51:53.633 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/ 2024-05-28T05:51:53.633 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-28T05:51:53.633 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-28T05:51:53.633 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/ 2024-05-28T05:51:53.633 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-05-28T05:51:53.633 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-05-28T05:51:53.633 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-05-28T05:51:53.633 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-28T05:51:53.633 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-28T05:51:53.633 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-28T05:51:53.633 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-05-28T05:51:53.633 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-28T05:51:53.633 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-05-28T05:51:53.633 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 64217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-28T05:51:53.634 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-28T05:51:53.634 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-28T05:51:53.634 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-28T05:51:53.634 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-05-28T05:51:53.634 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-05-28T05:51:53.634 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 76961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-28T05:51:53.634 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-28T05:51:53.634 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 52929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-28T05:51:53.634 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-05-28T05:51:53.634 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-28T05:51:53.634 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-28T05:51:53.634 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-05-28T05:51:53.635 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-28T05:51:53.635 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-28T05:51:53.635 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 57209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-28T05:51:53.635 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-05-28T05:51:53.635 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-28T05:51:53.635 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-28T05:51:53.635 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-05-28T05:51:53.635 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-05-28T05:51:53.635 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-28T05:51:53.635 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-05-28T05:51:53.635 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-28T05:51:53.635 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-28T05:51:53.635 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-28T05:51:53.636 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-28T05:51:53.636 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 59121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-05-28T05:51:53.636 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-mux.ko 2024-05-28T05:51:53.636 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-smbus.ko 2024-05-28T05:51:53.636 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-stub.ko 2024-05-28T05:51:53.636 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/ 2024-05-28T05:51:53.636 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-05-28T05:51:53.636 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-05-28T05:51:53.636 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-05-28T05:51:53.636 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ 2024-05-28T05:51:53.636 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ 2024-05-28T05:51:53.636 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 329681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-28T05:51:53.636 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1119785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_core.ko 2024-05-28T05:51:53.637 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 83897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-28T05:51:53.637 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 408329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-28T05:51:53.637 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 120905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-28T05:51:53.637 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 347201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-28T05:51:53.637 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 84937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-28T05:51:53.637 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ 2024-05-28T05:51:53.637 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/ 2024-05-28T05:51:53.637 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 590873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-28T05:51:53.637 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/ 2024-05-28T05:51:53.637 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 514577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-28T05:51:53.637 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/ 2024-05-28T05:51:53.637 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 911649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-28T05:51:53.638 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ 2024-05-28T05:51:53.638 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 375449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-28T05:51:53.638 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ocrdma/ 2024-05-28T05:51:53.638 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 197097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-05-28T05:51:53.638 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/usnic/ 2024-05-28T05:51:53.638 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 212497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-05-28T05:51:53.638 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ 2024-05-28T05:51:53.638 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ 2024-05-28T05:51:53.638 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 334353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-28T05:51:53.638 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ 2024-05-28T05:51:53.638 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 120649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-28T05:51:53.638 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ 2024-05-28T05:51:53.638 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 132577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-28T05:51:53.639 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ 2024-05-28T05:51:53.639 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 157929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-28T05:51:53.639 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ 2024-05-28T05:51:53.639 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 156665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-28T05:51:53.639 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/ 2024-05-28T05:51:53.639 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/evbug.ko 2024-05-28T05:51:53.639 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/ff-memless.ko 2024-05-28T05:51:53.639 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/ 2024-05-28T05:51:53.639 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-28T05:51:53.639 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-28T05:51:53.639 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 50705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/gameport.ko 2024-05-28T05:51:53.639 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 49433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/joydev.ko 2024-05-28T05:51:53.639 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/ 2024-05-28T05:51:53.640 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-05-28T05:51:53.640 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-05-28T05:51:53.640 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-05-28T05:51:53.640 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-05-28T05:51:53.640 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 45465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-28T05:51:53.640 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-05-28T05:51:53.640 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lkkbd.ko 2024-05-28T05:51:53.640 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lm8323.ko 2024-05-28T05:51:53.640 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lm8333.ko 2024-05-28T05:51:53.640 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-05-28T05:51:53.640 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-05-28T05:51:53.640 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-05-28T05:51:53.640 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-05-28T05:51:53.641 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/newtonkbd.ko 2024-05-28T05:51:53.641 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-05-28T05:51:53.641 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/qt1070.ko 2024-05-28T05:51:53.641 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/qt2160.ko 2024-05-28T05:51:53.641 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-05-28T05:51:53.641 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/stowaway.ko 2024-05-28T05:51:53.641 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/sunkbd.ko 2024-05-28T05:51:53.641 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-05-28T05:51:53.641 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-05-28T05:51:53.641 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-05-28T05:51:53.641 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/xtkbd.ko 2024-05-28T05:51:53.641 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/matrix-keymap.ko 2024-05-28T05:51:53.641 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/ 2024-05-28T05:51:53.642 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/appletouch.ko 2024-05-28T05:51:53.642 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 39545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/bcm5974.ko 2024-05-28T05:51:53.642 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 159993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/cyapatp.ko 2024-05-28T05:51:53.642 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 114193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-28T05:51:53.642 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/gpio_mouse.ko 2024-05-28T05:51:53.642 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 428121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/psmouse.ko 2024-05-28T05:51:53.642 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/sermouse.ko 2024-05-28T05:51:53.642 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-28T05:51:53.642 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-28T05:51:53.642 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-28T05:51:53.642 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/ 2024-05-28T05:51:53.643 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 140921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-28T05:51:53.643 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ 2024-05-28T05:51:53.643 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/altera_ps2.ko 2024-05-28T05:51:53.643 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/arc_ps2.ko 2024-05-28T05:51:53.643 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ct82c710.ko 2024-05-28T05:51:53.643 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-28T05:51:53.643 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/parkbd.ko 2024-05-28T05:51:53.643 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/pcips2.ko 2024-05-28T05:51:53.643 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ps2mult.ko 2024-05-28T05:51:53.643 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serio_raw.ko 2024-05-28T05:51:53.643 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serport.ko 2024-05-28T05:51:53.643 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/sparse-keymap.ko 2024-05-28T05:51:53.643 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/ 2024-05-28T05:51:53.643 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-88pm860x.ko 2024-05-28T05:51:53.644 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-adp5520.ko 2024-05-28T05:51:53.644 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 77193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-bd2802.ko 2024-05-28T05:51:53.644 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-blinkm.ko 2024-05-28T05:51:53.644 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-da903x.ko 2024-05-28T05:51:53.644 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-da9052.ko 2024-05-28T05:51:53.644 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-gpio.ko 2024-05-28T05:51:53.644 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3530.ko 2024-05-28T05:51:53.644 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3533.ko 2024-05-28T05:51:53.644 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm355x.ko 2024-05-28T05:51:53.644 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3642.ko 2024-05-28T05:51:53.644 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp3944.ko 2024-05-28T05:51:53.645 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp8788.ko 2024-05-28T05:51:53.645 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-max8997.ko 2024-05-28T05:51:53.645 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-mc13783.ko 2024-05-28T05:51:53.645 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-menf21bmc.ko 2024-05-28T05:51:53.645 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca9532.ko 2024-05-28T05:51:53.645 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca955x.ko 2024-05-28T05:51:53.645 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca963x.ko 2024-05-28T05:51:53.645 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-ss4200.ko 2024-05-28T05:51:53.645 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-tca6507.ko 2024-05-28T05:51:53.645 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-wm831x-status.ko 2024-05-28T05:51:53.645 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-wm8350.ko 2024-05-28T05:51:53.645 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ 2024-05-28T05:51:53.645 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-28T05:51:53.645 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-28T05:51:53.646 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-28T05:51:53.646 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-28T05:51:53.646 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-28T05:51:53.646 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-28T05:51:53.646 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-28T05:51:53.646 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-28T05:51:53.646 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-28T05:51:53.646 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/ 2024-05-28T05:51:53.646 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/ 2024-05-28T05:51:53.646 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 790665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/bcache.ko 2024-05-28T05:51:53.646 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 49065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bio-prison.ko 2024-05-28T05:51:53.646 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 116817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bufio.ko 2024-05-28T05:51:53.646 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 58273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache-smq.ko 2024-05-28T05:51:53.647 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 199017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache.ko 2024-05-28T05:51:53.647 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 134937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-crypt.ko 2024-05-28T05:51:53.647 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-delay.ko 2024-05-28T05:51:53.647 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 67489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-era.ko 2024-05-28T05:51:53.647 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-flakey.ko 2024-05-28T05:51:53.647 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 50441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log-userspace.ko 2024-05-28T05:51:53.647 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log.ko 2024-05-28T05:51:53.647 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 60969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-mirror.ko 2024-05-28T05:51:53.647 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 97193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-multipath.ko 2024-05-28T05:51:53.647 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-queue-length.ko 2024-05-28T05:51:53.647 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 85681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-raid.ko 2024-05-28T05:51:53.647 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-region-hash.ko 2024-05-28T05:51:53.647 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-round-robin.ko 2024-05-28T05:51:53.648 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-service-time.ko 2024-05-28T05:51:53.648 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 139793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-snapshot.ko 2024-05-28T05:51:53.648 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-switch.ko 2024-05-28T05:51:53.648 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 234441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-thin-pool.ko 2024-05-28T05:51:53.648 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 66417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-verity.ko 2024-05-28T05:51:53.648 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-zero.ko 2024-05-28T05:51:53.648 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/ 2024-05-28T05:51:53.648 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 264273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-28T05:51:53.648 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid0.ko 2024-05-28T05:51:53.648 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 124705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid1.ko 2024-05-28T05:51:53.648 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 157673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid10.ko 2024-05-28T05:51:53.648 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 444649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid456.ko 2024-05-28T05:51:53.648 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/ 2024-05-28T05:51:53.648 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/ 2024-05-28T05:51:53.649 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 214833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptbase.ko 2024-05-28T05:51:53.649 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 77977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptctl.ko 2024-05-28T05:51:53.649 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 54777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptfc.ko 2024-05-28T05:51:53.649 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptlan.ko 2024-05-28T05:51:53.649 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 150753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptsas.ko 2024-05-28T05:51:53.649 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 97209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptscsih.ko 2024-05-28T05:51:53.649 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 63865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptspi.ko 2024-05-28T05:51:53.649 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/ 2024-05-28T05:51:53.649 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm800.ko 2024-05-28T05:51:53.649 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm805.ko 2024-05-28T05:51:53.649 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm80x.ko 2024-05-28T05:51:53.649 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/arizona-i2c.ko 2024-05-28T05:51:53.649 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 148545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/arizona.ko 2024-05-28T05:51:53.650 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/bcm590xx.ko 2024-05-28T05:51:53.650 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/cros_ec_dev.ko 2024-05-28T05:51:53.650 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/dln2.ko 2024-05-28T05:51:53.650 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/janz-cmodio.ko 2024-05-28T05:51:53.650 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 59081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/kempld-core.ko 2024-05-28T05:51:53.650 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lm3533-core.ko 2024-05-28T05:51:53.650 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-05-28T05:51:53.650 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lp3943.ko 2024-05-28T05:51:53.650 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 60489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_ich.ko 2024-05-28T05:51:53.650 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_sch.ko 2024-05-28T05:51:53.650 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/max8907.ko 2024-05-28T05:51:53.650 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mc13xxx-core.ko 2024-05-28T05:51:53.651 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-05-28T05:51:53.651 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/menf21bmc.ko 2024-05-28T05:51:53.651 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633-adc.ko 2024-05-28T05:51:53.651 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633-gpio.ko 2024-05-28T05:51:53.651 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633.ko 2024-05-28T05:51:53.651 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-05-28T05:51:53.651 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/retu-mfd.ko 2024-05-28T05:51:53.651 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 99409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/si476x-core.ko 2024-05-28T05:51:53.651 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 58049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/sm501.ko 2024-05-28T05:51:53.651 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 60673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/tps65010.ko 2024-05-28T05:51:53.651 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/tps6507x.ko 2024-05-28T05:51:53.651 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/viperboard.ko 2024-05-28T05:51:53.651 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/vx855.ko 2024-05-28T05:51:53.651 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wl1273-core.ko 2024-05-28T05:51:53.652 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 52345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wm8994.ko 2024-05-28T05:51:53.652 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ 2024-05-28T05:51:53.652 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-05-28T05:51:53.652 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 64257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ad525x_dpot.ko 2024-05-28T05:51:53.652 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/ 2024-05-28T05:51:53.652 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 57497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-28T05:51:53.652 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds9802als.ko 2024-05-28T05:51:53.652 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 47681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds990x.ko 2024-05-28T05:51:53.652 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 58625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/bh1770glc.ko 2024-05-28T05:51:53.652 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/ 2024-05-28T05:51:53.652 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-05-28T05:51:53.652 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 47441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/core.ko 2024-05-28T05:51:53.653 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/ 2024-05-28T05:51:53.653 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/cb710.ko 2024-05-28T05:51:53.653 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ds1682.ko 2024-05-28T05:51:53.653 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/dummy-irq.ko 2024-05-28T05:51:53.653 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/echo/ 2024-05-28T05:51:53.653 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/echo/echo.ko 2024-05-28T05:51:53.653 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/ 2024-05-28T05:51:53.653 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/at24.ko 2024-05-28T05:51:53.653 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-28T05:51:53.653 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/max6875.ko 2024-05-28T05:51:53.653 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/enclosure.ko 2024-05-28T05:51:53.653 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/genwqe/ 2024-05-28T05:51:53.653 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 191617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-05-28T05:51:53.653 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hmc6352.ko 2024-05-28T05:51:53.654 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hpilo.ko 2024-05-28T05:51:53.654 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ibmasm/ 2024-05-28T05:51:53.654 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 92289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-05-28T05:51:53.654 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ics932s401.ko 2024-05-28T05:51:53.654 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29003.ko 2024-05-28T05:51:53.654 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29020.ko 2024-05-28T05:51:53.654 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/ 2024-05-28T05:51:53.654 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 54857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-28T05:51:53.654 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-28T05:51:53.654 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/ 2024-05-28T05:51:53.654 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 154257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-me.ko 2024-05-28T05:51:53.654 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 69793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-txe.ko 2024-05-28T05:51:53.654 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 388977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei.ko 2024-05-28T05:51:53.654 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/phantom.ko 2024-05-28T05:51:53.655 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ti-st/ 2024-05-28T05:51:53.655 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 91129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ti-st/st_drv.ko 2024-05-28T05:51:53.655 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_7xx1.ko 2024-05-28T05:51:53.655 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_core.ko 2024-05-28T05:51:53.655 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tsl2550.ko 2024-05-28T05:51:53.655 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 55785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_balloon.ko 2024-05-28T05:51:53.655 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/ 2024-05-28T05:51:53.655 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 234849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-28T05:51:53.655 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ 2024-05-28T05:51:53.655 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/ 2024-05-28T05:51:53.655 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 620849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/bonding.ko 2024-05-28T05:51:53.655 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/ 2024-05-28T05:51:53.655 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/ 2024-05-28T05:51:53.656 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 139745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-28T05:51:53.656 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 49529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-28T05:51:53.656 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-28T05:51:53.656 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/ 2024-05-28T05:51:53.656 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 589537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-28T05:51:53.656 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dummy.ko 2024-05-28T05:51:53.656 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/eql.ko 2024-05-28T05:51:53.656 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ 2024-05-28T05:51:53.656 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/ 2024-05-28T05:51:53.656 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 53745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-28T05:51:53.656 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 49193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-28T05:51:53.656 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 158641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-28T05:51:53.656 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 85945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-28T05:51:53.656 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ 2024-05-28T05:51:53.656 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-28T05:51:53.657 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 73857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-28T05:51:53.657 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-28T05:51:53.657 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 109513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-28T05:51:53.657 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/ 2024-05-28T05:51:53.657 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 64697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-28T05:51:53.657 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/ 2024-05-28T05:51:53.657 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 84321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-28T05:51:53.657 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/ 2024-05-28T05:51:53.657 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 70729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-28T05:51:53.657 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/ 2024-05-28T05:51:53.657 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 52681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-28T05:51:53.657 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/ 2024-05-28T05:51:53.657 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 65785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-28T05:51:53.657 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 56049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-28T05:51:53.658 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 115873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-28T05:51:53.658 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/ 2024-05-28T05:51:53.658 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/ 2024-05-28T05:51:53.658 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 124481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-28T05:51:53.658 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-05-28T05:51:53.658 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 128393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-28T05:51:53.658 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-05-28T05:51:53.658 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 110321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-28T05:51:53.658 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/ 2024-05-28T05:51:53.658 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 101849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-28T05:51:53.658 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 88945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-28T05:51:53.658 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/ 2024-05-28T05:51:53.658 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 105625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-28T05:51:53.658 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 228977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-28T05:51:53.659 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-05-28T05:51:53.659 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1733297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-28T05:51:53.659 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 167177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-28T05:51:53.659 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/ 2024-05-28T05:51:53.659 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 164249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-28T05:51:53.661 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 440553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-28T05:51:53.662 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/ 2024-05-28T05:51:53.662 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/ 2024-05-28T05:51:53.662 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 432145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-28T05:51:53.662 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/ 2024-05-28T05:51:53.662 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-05-28T05:51:53.662 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 257145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-28T05:51:53.662 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-05-28T05:51:53.662 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 446057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-28T05:51:53.662 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-05-28T05:51:53.662 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1311193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-28T05:51:53.662 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-05-28T05:51:53.662 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 206673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-28T05:51:53.726 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-05-28T05:51:53.727 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-28T05:51:53.727 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/ 2024-05-28T05:51:53.727 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/ 2024-05-28T05:51:53.727 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 269249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-28T05:51:53.727 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/ 2024-05-28T05:51:53.727 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/ 2024-05-28T05:51:53.727 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 85377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-28T05:51:53.727 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 77449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-28T05:51:53.727 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 169041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-28T05:51:53.727 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 65905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-28T05:51:53.727 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 76201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-28T05:51:53.727 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-28T05:51:53.728 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/ 2024-05-28T05:51:53.728 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 75937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-28T05:51:53.728 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 78697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-28T05:51:53.728 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 52305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dnet.ko 2024-05-28T05:51:53.728 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ec_bhf.ko 2024-05-28T05:51:53.728 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/ 2024-05-28T05:51:53.728 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/ 2024-05-28T05:51:53.728 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 356353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-28T05:51:53.728 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 61729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ethoc.ko 2024-05-28T05:51:53.728 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 63177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fealnx.ko 2024-05-28T05:51:53.728 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fujitsu/ 2024-05-28T05:51:53.728 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 51505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-05-28T05:51:53.728 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ 2024-05-28T05:51:53.729 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 115561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-28T05:51:53.729 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/ 2024-05-28T05:51:53.729 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 366193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-28T05:51:53.729 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/ 2024-05-28T05:51:53.729 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 755673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-28T05:51:53.729 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/ 2024-05-28T05:51:53.729 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 324513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-28T05:51:53.729 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/ 2024-05-28T05:51:53.729 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1196201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-28T05:51:53.729 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/ 2024-05-28T05:51:53.729 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 362609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-28T05:51:53.729 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/ 2024-05-28T05:51:53.729 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 672313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-28T05:51:53.730 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/ 2024-05-28T05:51:53.730 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 121513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-28T05:51:53.730 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-05-28T05:51:53.730 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 966601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-28T05:51:53.730 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-05-28T05:51:53.730 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 193465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-28T05:51:53.730 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 108625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/jme.ko 2024-05-28T05:51:53.730 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/ 2024-05-28T05:51:53.730 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-28T05:51:53.730 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 126873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-28T05:51:53.730 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 150769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-28T05:51:53.730 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/ 2024-05-28T05:51:53.731 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-05-28T05:51:53.731 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 904929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-28T05:51:53.731 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 344089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-28T05:51:53.731 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-05-28T05:51:53.731 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-05-28T05:51:53.731 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1413529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-28T05:51:53.731 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ 2024-05-28T05:51:53.731 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 65905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-05-28T05:51:53.731 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 54217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-05-28T05:51:53.731 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-05-28T05:51:53.731 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 117345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-28T05:51:53.731 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/ 2024-05-28T05:51:53.731 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-05-28T05:51:53.731 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 131353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-28T05:51:53.732 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ 2024-05-28T05:51:53.732 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 91457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-28T05:51:53.732 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 56681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-28T05:51:53.732 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/ 2024-05-28T05:51:53.732 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 181201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-28T05:51:53.732 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/ 2024-05-28T05:51:53.732 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 171409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-28T05:51:53.732 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/ 2024-05-28T05:51:53.732 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 58241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-28T05:51:53.732 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 50113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-28T05:51:53.732 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/ 2024-05-28T05:51:53.732 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-05-28T05:51:53.733 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 300793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-28T05:51:53.733 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 105681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-28T05:51:53.733 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-05-28T05:51:53.733 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 885057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-28T05:51:53.733 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/ 2024-05-28T05:51:53.733 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 52297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-28T05:51:53.733 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/ 2024-05-28T05:51:53.733 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 81633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-28T05:51:53.733 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 100681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-28T05:51:53.733 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-28T05:51:53.733 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 264145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-28T05:51:53.733 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/ 2024-05-28T05:51:53.733 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-05-28T05:51:53.733 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 142401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-05-28T05:51:53.734 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/ 2024-05-28T05:51:53.734 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1350201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-28T05:51:53.734 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/ 2024-05-28T05:51:53.734 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 57945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-28T05:51:53.734 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/ 2024-05-28T05:51:53.734 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 66497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-28T05:51:53.734 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 80057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-28T05:51:53.734 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/ 2024-05-28T05:51:53.734 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 74281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-28T05:51:53.734 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 79449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-28T05:51:53.734 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 100777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-28T05:51:53.734 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 83433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-28T05:51:53.734 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/ 2024-05-28T05:51:53.735 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-05-28T05:51:53.735 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-05-28T05:51:53.735 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 46977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-28T05:51:53.735 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-05-28T05:51:53.735 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 644329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-28T05:51:53.735 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/ 2024-05-28T05:51:53.735 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 128489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-28T05:51:53.735 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 207985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-28T05:51:53.735 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 82625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-28T05:51:53.735 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 91345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-28T05:51:53.735 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/ 2024-05-28T05:51:53.735 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 59793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-28T05:51:53.735 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/ 2024-05-28T05:51:53.736 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 110721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-28T05:51:53.736 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/ 2024-05-28T05:51:53.736 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 98681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-28T05:51:53.736 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 102505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-28T05:51:53.736 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/ 2024-05-28T05:51:53.736 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 61489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-28T05:51:53.736 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-28T05:51:53.736 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/ 2024-05-28T05:51:53.736 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 69905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-28T05:51:53.736 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/ 2024-05-28T05:51:53.736 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 49441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/defxx.ko 2024-05-28T05:51:53.736 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/skfp/ 2024-05-28T05:51:53.736 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 275713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/skfp/skfp.ko 2024-05-28T05:51:53.736 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 91665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/geneve.ko 2024-05-28T05:51:53.737 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/ 2024-05-28T05:51:53.737 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 290441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-28T05:51:53.737 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/ 2024-05-28T05:51:53.737 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-28T05:51:53.737 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ifb.ko 2024-05-28T05:51:53.737 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ 2024-05-28T05:51:53.737 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 108313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-28T05:51:53.737 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 78057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvlan.ko 2024-05-28T05:51:53.737 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvtap.ko 2024-05-28T05:51:53.737 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/ 2024-05-28T05:51:53.737 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-28T05:51:53.737 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-28T05:51:53.737 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-gpio.ko 2024-05-28T05:51:53.737 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-28T05:51:53.738 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio.ko 2024-05-28T05:51:53.738 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mii.ko 2024-05-28T05:51:53.738 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 62673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/netconsole.ko 2024-05-28T05:51:53.738 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/nlmon.ko 2024-05-28T05:51:53.738 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/ 2024-05-28T05:51:53.738 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-28T05:51:53.738 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 48233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-28T05:51:53.738 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ 2024-05-28T05:51:53.738 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/amd.ko 2024-05-28T05:51:53.738 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 61977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-28T05:51:53.738 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 52857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-28T05:51:53.738 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm87xx.ko 2024-05-28T05:51:53.738 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 53401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/broadcom.ko 2024-05-28T05:51:53.739 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/cicada.ko 2024-05-28T05:51:53.739 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/davicom.ko 2024-05-28T05:51:53.739 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/et1011c.ko 2024-05-28T05:51:53.739 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/icplus.ko 2024-05-28T05:51:53.739 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/lxt.ko 2024-05-28T05:51:53.739 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 103369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/marvell.ko 2024-05-28T05:51:53.739 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 96017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/micrel.ko 2024-05-28T05:51:53.739 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/national.ko 2024-05-28T05:51:53.739 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 121097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/phylink.ko 2024-05-28T05:51:53.739 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/qsemi.ko 2024-05-28T05:51:53.739 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 62105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/realtek.ko 2024-05-28T05:51:53.739 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/smsc.ko 2024-05-28T05:51:53.739 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ste10Xp.ko 2024-05-28T05:51:53.739 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/vitesse.ko 2024-05-28T05:51:53.740 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/plip/ 2024-05-28T05:51:53.740 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 55345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/plip/plip.ko 2024-05-28T05:51:53.740 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ 2024-05-28T05:51:53.740 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-28T05:51:53.740 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_async.ko 2024-05-28T05:51:53.740 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-28T05:51:53.740 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-28T05:51:53.740 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-28T05:51:53.740 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 53225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppoe.ko 2024-05-28T05:51:53.740 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppox.ko 2024-05-28T05:51:53.740 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pptp.ko 2024-05-28T05:51:53.740 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sb1000.ko 2024-05-28T05:51:53.740 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/ 2024-05-28T05:51:53.741 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 52065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slip.ko 2024-05-28T05:51:53.741 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sungem_phy.ko 2024-05-28T05:51:53.741 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 80153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tap.ko 2024-05-28T05:51:53.741 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/ 2024-05-28T05:51:53.741 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 137313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team.ko 2024-05-28T05:51:53.741 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-28T05:51:53.741 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-28T05:51:53.741 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-28T05:51:53.741 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_random.ko 2024-05-28T05:51:53.741 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-28T05:51:53.741 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 108081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/veth.ko 2024-05-28T05:51:53.741 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/ 2024-05-28T05:51:53.741 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 176481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-28T05:51:53.741 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/ 2024-05-28T05:51:53.742 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 384329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/vxlan.ko 2024-05-28T05:51:53.742 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/ 2024-05-28T05:51:53.742 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 175513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-28T05:51:53.742 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ 2024-05-28T05:51:53.742 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ntb.ko 2024-05-28T05:51:53.742 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/ 2024-05-28T05:51:53.742 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/ 2024-05-28T05:51:53.742 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 335489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme-core.ko 2024-05-28T05:51:53.742 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 127497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme.ko 2024-05-28T05:51:53.742 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/ 2024-05-28T05:51:53.742 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 168113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport.ko 2024-05-28T05:51:53.742 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_cs.ko 2024-05-28T05:51:53.743 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 103881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_pc.ko 2024-05-28T05:51:53.743 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_serial.ko 2024-05-28T05:51:53.743 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/ 2024-05-28T05:51:53.743 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/ 2024-05-28T05:51:53.743 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-28T05:51:53.743 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-05-28T05:51:53.743 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-05-28T05:51:53.743 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pci-stub.ko 2024-05-28T05:51:53.743 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 55321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/xen-pcifront.ko 2024-05-28T05:51:53.743 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/ 2024-05-28T05:51:53.743 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/i82092.ko 2024-05-28T05:51:53.743 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 179937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia.ko 2024-05-28T05:51:53.743 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 78145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia_core.ko 2024-05-28T05:51:53.743 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-05-28T05:51:53.744 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pd6729.ko 2024-05-28T05:51:53.744 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 133745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-28T05:51:53.744 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/ 2024-05-28T05:51:53.744 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/broadcom/ 2024-05-28T05:51:53.744 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-05-28T05:51:53.744 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/samsung/ 2024-05-28T05:51:53.744 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-05-28T05:51:53.744 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/ 2024-05-28T05:51:53.744 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/ 2024-05-28T05:51:53.744 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 78185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-28T05:51:53.744 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/ 2024-05-28T05:51:53.744 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/ 2024-05-28T05:51:53.744 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 61025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-05-28T05:51:53.745 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec.ko 2024-05-28T05:51:53.745 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-05-28T05:51:53.745 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-05-28T05:51:53.745 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-05-28T05:51:53.745 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-05-28T05:51:53.745 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-05-28T05:51:53.745 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/ 2024-05-28T05:51:53.745 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 87929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-28T05:51:53.745 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acerhdf.ko 2024-05-28T05:51:53.745 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 48249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-28T05:51:53.745 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 73857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-28T05:51:53.745 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-28T05:51:53.745 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 164761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-28T05:51:53.746 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 46177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-28T05:51:53.746 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 62065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-28T05:51:53.746 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-28T05:51:53.746 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 51873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-28T05:51:53.746 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-28T05:51:53.746 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/hdaps.ko 2024-05-28T05:51:53.746 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/ibm_rtl.ko 2024-05-28T05:51:53.746 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/ 2024-05-28T05:51:53.746 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-28T05:51:53.746 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-05-28T05:51:53.746 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 53993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel_ips.ko 2024-05-28T05:51:53.746 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-28T05:51:53.746 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-28T05:51:53.747 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-28T05:51:53.747 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 51889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-28T05:51:53.747 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-28T05:51:53.747 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-28T05:51:53.747 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-28T05:51:53.747 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-28T05:51:53.747 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-28T05:51:53.747 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 61409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi.ko 2024-05-28T05:51:53.747 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/ 2024-05-28T05:51:53.747 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ 2024-05-28T05:51:53.747 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/88pm860x_battery.ko 2024-05-28T05:51:53.747 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/88pm860x_charger.ko 2024-05-28T05:51:53.747 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 68825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq2415x_charger.ko 2024-05-28T05:51:53.748 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 73065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq24190_charger.ko 2024-05-28T05:51:53.748 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq24735-charger.ko 2024-05-28T05:51:53.748 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-05-28T05:51:53.748 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/da9030_battery.ko 2024-05-28T05:51:53.748 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/da9052-battery.ko 2024-05-28T05:51:53.748 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2760_battery.ko 2024-05-28T05:51:53.748 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2780_battery.ko 2024-05-28T05:51:53.748 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2781_battery.ko 2024-05-28T05:51:53.748 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2782_battery.ko 2024-05-28T05:51:53.748 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/gpio-charger.ko 2024-05-28T05:51:53.748 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/isp1704_charger.ko 2024-05-28T05:51:53.748 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/lp8727_charger.ko 2024-05-28T05:51:53.748 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max14577_charger.ko 2024-05-28T05:51:53.748 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max17042_battery.ko 2024-05-28T05:51:53.749 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max8903_charger.ko 2024-05-28T05:51:53.749 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max8925_power.ko 2024-05-28T05:51:53.749 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/pcf50633-charger.ko 2024-05-28T05:51:53.749 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/sbs-battery.ko 2024-05-28T05:51:53.749 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/test_power.ko 2024-05-28T05:51:53.749 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/tps65090-charger.ko 2024-05-28T05:51:53.749 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm831x_backup.ko 2024-05-28T05:51:53.749 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm831x_power.ko 2024-05-28T05:51:53.749 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm8350_power.ko 2024-05-28T05:51:53.749 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/ 2024-05-28T05:51:53.749 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 73289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-28T05:51:53.749 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-28T05:51:53.749 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/ 2024-05-28T05:51:53.750 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/ 2024-05-28T05:51:53.750 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-28T05:51:53.750 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-28T05:51:53.750 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps_parport.ko 2024-05-28T05:51:53.750 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 49801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/pps_core.ko 2024-05-28T05:51:53.750 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ 2024-05-28T05:51:53.750 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 91369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp.ko 2024-05-28T05:51:53.750 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp_kvm.ko 2024-05-28T05:51:53.750 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/ 2024-05-28T05:51:53.750 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/ 2024-05-28T05:51:53.750 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/ 2024-05-28T05:51:53.750 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 67473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-28T05:51:53.750 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 47129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/fmpm.ko 2024-05-28T05:51:53.751 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/ 2024-05-28T05:51:53.751 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-88pm80x.ko 2024-05-28T05:51:53.751 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-88pm860x.ko 2024-05-28T05:51:53.751 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-28T05:51:53.751 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9052.ko 2024-05-28T05:51:53.751 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9055.ko 2024-05-28T05:51:53.751 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9063.ko 2024-05-28T05:51:53.751 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-28T05:51:53.751 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 82217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-28T05:51:53.751 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-28T05:51:53.751 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-28T05:51:53.751 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-28T05:51:53.751 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-28T05:51:53.752 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-28T05:51:53.752 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-28T05:51:53.752 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-28T05:51:53.752 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-em3027.ko 2024-05-28T05:51:53.752 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-28T05:51:53.752 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-28T05:51:53.752 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-28T05:51:53.752 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-lp8788.ko 2024-05-28T05:51:53.752 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 46905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-28T05:51:53.752 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-28T05:51:53.752 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-28T05:51:53.752 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t86.ko 2024-05-28T05:51:53.752 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max6900.ko 2024-05-28T05:51:53.753 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8907.ko 2024-05-28T05:51:53.753 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8925.ko 2024-05-28T05:51:53.753 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8997.ko 2024-05-28T05:51:53.753 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8998.ko 2024-05-28T05:51:53.753 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-05-28T05:51:53.753 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-28T05:51:53.753 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-palmas.ko 2024-05-28T05:51:53.753 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 56769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-28T05:51:53.753 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf50633.ko 2024-05-28T05:51:53.753 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-28T05:51:53.753 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-28T05:51:53.753 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-28T05:51:53.753 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-28T05:51:53.753 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rc5t583.ko 2024-05-28T05:51:53.754 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-28T05:51:53.754 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-28T05:51:53.754 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-28T05:51:53.754 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-28T05:51:53.754 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-28T05:51:53.754 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-s35390a.ko 2024-05-28T05:51:53.754 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-28T05:51:53.754 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-tps6586x.ko 2024-05-28T05:51:53.754 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-tps65910.ko 2024-05-28T05:51:53.754 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-wm831x.ko 2024-05-28T05:51:53.754 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-wm8350.ko 2024-05-28T05:51:53.754 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-x1205.ko 2024-05-28T05:51:53.755 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ 2024-05-28T05:51:53.755 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 90369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-9xxx.ko 2024-05-28T05:51:53.755 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 69585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-sas.ko 2024-05-28T05:51:53.755 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 65937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-xxxx.ko 2024-05-28T05:51:53.755 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 164473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/BusLogic.ko 2024-05-28T05:51:53.755 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/a100u2w.ko 2024-05-28T05:51:53.755 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/ 2024-05-28T05:51:53.755 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 340689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-28T05:51:53.755 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 120393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/advansys.ko 2024-05-28T05:51:53.755 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/ 2024-05-28T05:51:53.755 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 468049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-28T05:51:53.755 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 380633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-28T05:51:53.755 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic94xx/ 2024-05-28T05:51:53.756 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 243649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-05-28T05:51:53.756 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/am53c974.ko 2024-05-28T05:51:53.756 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/ 2024-05-28T05:51:53.756 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 135601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-28T05:51:53.756 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/atp870u.ko 2024-05-28T05:51:53.756 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/ 2024-05-28T05:51:53.756 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 304969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-28T05:51:53.756 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/ 2024-05-28T05:51:53.756 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1527017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/bfa.ko 2024-05-28T05:51:53.756 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/ 2024-05-28T05:51:53.756 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 297769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-28T05:51:53.756 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/ 2024-05-28T05:51:53.756 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 144377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-28T05:51:53.757 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 47449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ch.ko 2024-05-28T05:51:53.757 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/ 2024-05-28T05:51:53.757 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 390657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-28T05:51:53.757 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/ 2024-05-28T05:51:53.757 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-05-28T05:51:53.757 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 88873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-28T05:51:53.757 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-05-28T05:51:53.757 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 117473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-28T05:51:53.757 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 173009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-28T05:51:53.757 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 91497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dc395x.ko 2024-05-28T05:51:53.757 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 45393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dmx3191d.ko 2024-05-28T05:51:53.757 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/ 2024-05-28T05:51:53.757 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 267521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-28T05:51:53.758 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 78961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esp_scsi.ko 2024-05-28T05:51:53.758 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/ 2024-05-28T05:51:53.758 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 95321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-28T05:51:53.758 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 194001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-28T05:51:53.758 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fdomain.ko 2024-05-28T05:51:53.758 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/ 2024-05-28T05:51:53.758 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 366457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/fnic.ko 2024-05-28T05:51:53.758 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 251497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hpsa.ko 2024-05-28T05:51:53.758 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 65689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hptiop.ko 2024-05-28T05:51:53.758 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 57089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hv_storvsc.ko 2024-05-28T05:51:53.758 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/imm.ko 2024-05-28T05:51:53.758 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 55145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/initio.ko 2024-05-28T05:51:53.758 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 327833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ipr.ko 2024-05-28T05:51:53.759 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 129777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ips.ko 2024-05-28T05:51:53.759 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/ 2024-05-28T05:51:53.759 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 397657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/isci.ko 2024-05-28T05:51:53.759 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-28T05:51:53.759 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 63113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-28T05:51:53.759 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/ 2024-05-28T05:51:53.759 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 386801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/libfc.ko 2024-05-28T05:51:53.759 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 178169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi.ko 2024-05-28T05:51:53.759 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 64801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-28T05:51:53.759 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/ 2024-05-28T05:51:53.759 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 273953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/libsas.ko 2024-05-28T05:51:53.759 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/ 2024-05-28T05:51:53.759 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 2735913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-28T05:51:53.760 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/ 2024-05-28T05:51:53.760 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 88521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-28T05:51:53.760 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-28T05:51:53.760 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 389089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-28T05:51:53.760 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 104761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid.ko 2024-05-28T05:51:53.760 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/ 2024-05-28T05:51:53.760 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 836897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-28T05:51:53.760 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/ 2024-05-28T05:51:53.760 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 158705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-28T05:51:53.760 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 96529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvumi.ko 2024-05-28T05:51:53.760 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/ 2024-05-28T05:51:53.760 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 101609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-05-28T05:51:53.760 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-05-28T05:51:53.760 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-05-28T05:51:53.761 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-05-28T05:51:53.761 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/ 2024-05-28T05:51:53.761 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 443713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-28T05:51:53.761 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 152025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pmcraid.ko 2024-05-28T05:51:53.761 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ppa.ko 2024-05-28T05:51:53.761 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 66969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla1280.ko 2024-05-28T05:51:53.761 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/ 2024-05-28T05:51:53.761 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 2324713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-28T05:51:53.761 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 103593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-28T05:51:53.761 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/ 2024-05-28T05:51:53.761 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 697281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-28T05:51:53.761 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qlogicfas408.ko 2024-05-28T05:51:53.761 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/raid_class.ko 2024-05-28T05:51:53.762 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 322857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_debug.ko 2024-05-28T05:51:53.762 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 219849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-28T05:51:53.762 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 357145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-28T05:51:53.762 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 121177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-28T05:51:53.762 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 93473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-28T05:51:53.762 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 55393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-28T05:51:53.762 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ses.ko 2024-05-28T05:51:53.762 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 138113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/st.ko 2024-05-28T05:51:53.762 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 57393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/stex.ko 2024-05-28T05:51:53.762 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/ 2024-05-28T05:51:53.762 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 205001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-28T05:51:53.762 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 55465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/virtio_scsi.ko 2024-05-28T05:51:53.762 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 59113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-28T05:51:53.763 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 48769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/wd719x.ko 2024-05-28T05:51:53.763 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 59409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/xen-scsifront.ko 2024-05-28T05:51:53.763 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ 2024-05-28T05:51:53.763 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 174865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ssb.ko 2024-05-28T05:51:53.763 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/ 2024-05-28T05:51:53.763 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/ 2024-05-28T05:51:53.763 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 920073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-28T05:51:53.763 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/ 2024-05-28T05:51:53.763 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 60313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-28T05:51:53.763 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 48121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_file.ko 2024-05-28T05:51:53.763 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 54225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_iblock.ko 2024-05-28T05:51:53.763 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1170873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_mod.ko 2024-05-28T05:51:53.763 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 51889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_pscsi.ko 2024-05-28T05:51:53.764 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 149777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_user.ko 2024-05-28T05:51:53.764 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/ 2024-05-28T05:51:53.764 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 90033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-28T05:51:53.764 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/ 2024-05-28T05:51:53.764 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/ 2024-05-28T05:51:53.764 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/ 2024-05-28T05:51:53.764 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-28T05:51:53.764 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-28T05:51:53.764 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-28T05:51:53.764 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-28T05:51:53.764 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-28T05:51:53.764 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-28T05:51:53.764 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-28T05:51:53.765 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-28T05:51:53.765 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-28T05:51:53.765 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-28T05:51:53.765 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-28T05:51:53.765 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-28T05:51:53.765 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 45993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-28T05:51:53.765 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-28T05:51:53.765 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-28T05:51:53.765 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-05-28T05:51:53.765 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-28T05:51:53.765 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-28T05:51:53.765 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-28T05:51:53.765 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ 2024-05-28T05:51:53.766 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ 2024-05-28T05:51:53.766 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 99289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-28T05:51:53.766 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 69721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/moxa.ko 2024-05-28T05:51:53.766 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 61641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/mxser.ko 2024-05-28T05:51:53.766 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 134329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_gsm.ko 2024-05-28T05:51:53.766 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_hdlc.ko 2024-05-28T05:51:53.766 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 78961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/nozomi.ko 2024-05-28T05:51:53.766 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/ 2024-05-28T05:51:53.766 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/ 2024-05-28T05:51:53.766 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-05-28T05:51:53.766 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 65113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-28T05:51:53.766 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-05-28T05:51:53.766 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/altera_uart.ko 2024-05-28T05:51:53.767 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/arc_uart.ko 2024-05-28T05:51:53.767 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 91593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-05-28T05:51:53.767 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/ 2024-05-28T05:51:53.767 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 120553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-28T05:51:53.767 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/rp2.ko 2024-05-28T05:51:53.767 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 65633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/sc16is7xx.ko 2024-05-28T05:51:53.767 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/ 2024-05-28T05:51:53.767 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ 2024-05-28T05:51:53.767 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 693057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-28T05:51:53.767 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ 2024-05-28T05:51:53.767 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-28T05:51:53.767 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-05-28T05:51:53.767 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/ 2024-05-28T05:51:53.768 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 55609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio.ko 2024-05-28T05:51:53.768 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_aec.ko 2024-05-28T05:51:53.768 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_cif.ko 2024-05-28T05:51:53.768 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_dmem_genirq.ko 2024-05-28T05:51:53.768 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_mf624.ko 2024-05-28T05:51:53.768 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_netx.ko 2024-05-28T05:51:53.768 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pci_generic.ko 2024-05-28T05:51:53.768 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-05-28T05:51:53.768 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_sercos3.ko 2024-05-28T05:51:53.768 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/ 2024-05-28T05:51:53.768 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/c67x00/ 2024-05-28T05:51:53.768 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 90297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/c67x00/c67x00.ko 2024-05-28T05:51:53.768 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ 2024-05-28T05:51:53.769 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 189169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-05-28T05:51:53.769 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-05-28T05:51:53.769 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-05-28T05:51:53.769 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-05-28T05:51:53.769 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-05-28T05:51:53.769 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/ 2024-05-28T05:51:53.769 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 101537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-acm.ko 2024-05-28T05:51:53.769 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 63017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-28T05:51:53.769 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 56713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usblp.ko 2024-05-28T05:51:53.769 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 107409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usbtmc.ko 2024-05-28T05:51:53.769 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/common/ 2024-05-28T05:51:53.769 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/common/ulpi.ko 2024-05-28T05:51:53.770 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc2/ 2024-05-28T05:51:53.770 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-05-28T05:51:53.770 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/ 2024-05-28T05:51:53.770 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-05-28T05:51:53.770 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-05-28T05:51:53.770 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 575217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3.ko 2024-05-28T05:51:53.770 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/ 2024-05-28T05:51:53.770 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/ 2024-05-28T05:51:53.770 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 72241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/u_ether.ko 2024-05-28T05:51:53.770 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 61945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/u_serial.ko 2024-05-28T05:51:53.770 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-05-28T05:51:53.771 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 49729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-05-28T05:51:53.771 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-05-28T05:51:53.771 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-05-28T05:51:53.771 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 131513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-05-28T05:51:53.771 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 62313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-05-28T05:51:53.771 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 146601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-05-28T05:51:53.771 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 70569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-05-28T05:51:53.771 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-05-28T05:51:53.771 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-05-28T05:51:53.771 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 70009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-05-28T05:51:53.771 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 101233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-05-28T05:51:53.771 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-05-28T05:51:53.771 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 71241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-05-28T05:51:53.772 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 84929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-05-28T05:51:53.772 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/ 2024-05-28T05:51:53.772 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-05-28T05:51:53.772 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-05-28T05:51:53.772 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-05-28T05:51:53.772 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-05-28T05:51:53.772 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-05-28T05:51:53.772 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-05-28T05:51:53.772 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-05-28T05:51:53.772 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-05-28T05:51:53.772 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-05-28T05:51:53.772 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-05-28T05:51:53.773 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-05-28T05:51:53.773 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-05-28T05:51:53.773 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 78065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-05-28T05:51:53.773 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-05-28T05:51:53.773 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 204009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/libcomposite.ko 2024-05-28T05:51:53.773 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/ 2024-05-28T05:51:53.773 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-05-28T05:51:53.773 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/bdc/ 2024-05-28T05:51:53.773 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 182537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-05-28T05:51:53.773 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 45537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-05-28T05:51:53.773 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 66505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-05-28T05:51:53.773 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 85209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-05-28T05:51:53.773 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 69305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-05-28T05:51:53.773 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 90305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/net2272.ko 2024-05-28T05:51:53.774 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 90353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/net2280.ko 2024-05-28T05:51:53.774 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 94833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-05-28T05:51:53.774 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 80513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-05-28T05:51:53.774 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 87457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-05-28T05:51:53.774 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 95433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-05-28T05:51:53.774 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 195953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-05-28T05:51:53.774 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/ 2024-05-28T05:51:53.774 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/bcma-hcd.ko 2024-05-28T05:51:53.774 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 108313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/isp116x-hcd.ko 2024-05-28T05:51:53.774 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 104433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-05-28T05:51:53.774 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 102265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-05-28T05:51:53.774 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 60097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-28T05:51:53.774 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811_cs.ko 2024-05-28T05:51:53.775 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/ssb-hcd.ko 2024-05-28T05:51:53.775 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-05-28T05:51:53.775 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/ 2024-05-28T05:51:53.775 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/mdc800.ko 2024-05-28T05:51:53.775 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/microtek.ko 2024-05-28T05:51:53.775 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ 2024-05-28T05:51:53.775 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 47345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/adutux.ko 2024-05-28T05:51:53.775 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/appledisplay.ko 2024-05-28T05:51:53.775 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-05-28T05:51:53.775 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/cytherm.ko 2024-05-28T05:51:53.775 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ehset.ko 2024-05-28T05:51:53.775 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi26.ko 2024-05-28T05:51:53.775 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi62.ko 2024-05-28T05:51:53.775 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ezusb.ko 2024-05-28T05:51:53.776 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/idmouse.ko 2024-05-28T05:51:53.776 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/iowarrior.ko 2024-05-28T05:51:53.776 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-28T05:51:53.776 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ldusb.ko 2024-05-28T05:51:53.776 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/legousbtower.ko 2024-05-28T05:51:53.776 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/lvstest.ko 2024-05-28T05:51:53.776 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/ 2024-05-28T05:51:53.776 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 85305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-28T05:51:53.776 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-28T05:51:53.776 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usb3503.ko 2024-05-28T05:51:53.776 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usblcd.ko 2024-05-28T05:51:53.776 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-28T05:51:53.776 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 84257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbtest.ko 2024-05-28T05:51:53.776 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 52057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/uss720.ko 2024-05-28T05:51:53.776 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/yurex.ko 2024-05-28T05:51:53.777 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/mon/ 2024-05-28T05:51:53.777 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 91505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/mon/usbmon.ko 2024-05-28T05:51:53.777 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/musb/ 2024-05-28T05:51:53.777 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 396169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/musb/musb_hdrc.ko 2024-05-28T05:51:53.777 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/ 2024-05-28T05:51:53.777 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-generic.ko 2024-05-28T05:51:53.777 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-05-28T05:51:53.777 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-isp1301.ko 2024-05-28T05:51:53.777 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-tahvo.ko 2024-05-28T05:51:53.777 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ 2024-05-28T05:51:53.777 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/aircable.ko 2024-05-28T05:51:53.777 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ark3116.ko 2024-05-28T05:51:53.777 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-28T05:51:53.778 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ch341.ko 2024-05-28T05:51:53.778 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 79673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cp210x.ko 2024-05-28T05:51:53.778 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cyberjack.ko 2024-05-28T05:51:53.778 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 66865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-28T05:51:53.778 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 58321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-28T05:51:53.778 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/empeg.ko 2024-05-28T05:51:53.778 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 53001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/f81232.ko 2024-05-28T05:51:53.778 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 188601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-28T05:51:53.778 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 61481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-28T05:51:53.778 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 152297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-28T05:51:53.778 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 142825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_ti.ko 2024-05-28T05:51:53.778 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 69209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipaq.ko 2024-05-28T05:51:53.778 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipw.ko 2024-05-28T05:51:53.778 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ir-usb.ko 2024-05-28T05:51:53.779 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 66353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-28T05:51:53.779 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 122321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan.ko 2024-05-28T05:51:53.779 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-28T05:51:53.779 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-28T05:51:53.779 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-28T05:51:53.779 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mct_u232.ko 2024-05-28T05:51:53.779 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/metro-usb.ko 2024-05-28T05:51:53.779 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 79673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7720.ko 2024-05-28T05:51:53.779 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 89961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7840.ko 2024-05-28T05:51:53.779 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 65065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mxuport.ko 2024-05-28T05:51:53.779 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/navman.ko 2024-05-28T05:51:53.779 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/omninet.ko 2024-05-28T05:51:53.779 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/opticon.ko 2024-05-28T05:51:53.780 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 197201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/option.ko 2024-05-28T05:51:53.780 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 45329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/oti6858.ko 2024-05-28T05:51:53.780 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 61753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/pl2303.ko 2024-05-28T05:51:53.780 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcaux.ko 2024-05-28T05:51:53.780 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 39977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcserial.ko 2024-05-28T05:51:53.780 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/quatech2.ko 2024-05-28T05:51:53.780 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/safe_serial.ko 2024-05-28T05:51:53.780 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 59337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/sierra.ko 2024-05-28T05:51:53.780 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-28T05:51:53.780 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ssu100.ko 2024-05-28T05:51:53.780 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/symbolserial.ko 2024-05-28T05:51:53.780 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 70489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-28T05:51:53.781 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-28T05:51:53.781 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_debug.ko 2024-05-28T05:51:53.781 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 39313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-28T05:51:53.781 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 151121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usbserial.ko 2024-05-28T05:51:53.781 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/visor.ko 2024-05-28T05:51:53.781 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/whiteheat.ko 2024-05-28T05:51:53.781 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/wishbone-serial.ko 2024-05-28T05:51:53.781 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-28T05:51:53.781 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ 2024-05-28T05:51:53.781 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 64041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/uas.ko 2024-05-28T05:51:53.781 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-28T05:51:53.781 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-28T05:51:53.781 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-28T05:51:53.781 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-28T05:51:53.782 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-28T05:51:53.782 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-28T05:51:53.782 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-28T05:51:53.782 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-karma.ko 2024-05-28T05:51:53.782 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-28T05:51:53.782 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-28T05:51:53.782 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-28T05:51:53.782 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-28T05:51:53.782 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-28T05:51:53.782 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 201145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/usb-storage.ko 2024-05-28T05:51:53.782 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/ 2024-05-28T05:51:53.782 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 76025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-28T05:51:53.782 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 85233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-28T05:51:53.783 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 122233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-28T05:51:53.783 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/ 2024-05-28T05:51:53.783 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/ 2024-05-28T05:51:53.783 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 206897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-28T05:51:53.783 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-28T05:51:53.783 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 134241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio.ko 2024-05-28T05:51:53.783 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 93665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-28T05:51:53.783 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/ 2024-05-28T05:51:53.783 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 138641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost.ko 2024-05-28T05:51:53.783 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-28T05:51:53.783 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 71273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_net.ko 2024-05-28T05:51:53.783 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 107897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_scsi.ko 2024-05-28T05:51:53.783 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/ 2024-05-28T05:51:53.783 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/ 2024-05-28T05:51:53.784 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-05-28T05:51:53.784 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/aat2870_bl.ko 2024-05-28T05:51:53.784 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp5520_bl.ko 2024-05-28T05:51:53.784 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp8860_bl.ko 2024-05-28T05:51:53.784 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 51737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp8870_bl.ko 2024-05-28T05:51:53.784 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/apple_bl.ko 2024-05-28T05:51:53.784 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/as3711_bl.ko 2024-05-28T05:51:53.784 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/bd6107.ko 2024-05-28T05:51:53.784 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/da903x_bl.ko 2024-05-28T05:51:53.784 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/da9052_bl.ko 2024-05-28T05:51:53.784 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/gpio_backlight.ko 2024-05-28T05:51:53.784 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/kb3886_bl.ko 2024-05-28T05:51:53.784 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lcd.ko 2024-05-28T05:51:53.784 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lm3533_bl.ko 2024-05-28T05:51:53.785 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lm3639_bl.ko 2024-05-28T05:51:53.785 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lv5207lp.ko 2024-05-28T05:51:53.785 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/max8925_bl.ko 2024-05-28T05:51:53.785 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/pandora_bl.ko 2024-05-28T05:51:53.785 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-05-28T05:51:53.785 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-28T05:51:53.785 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/wm831x_bl.ko 2024-05-28T05:51:53.785 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/ 2024-05-28T05:51:53.785 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ 2024-05-28T05:51:53.785 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2482.ko 2024-05-28T05:51:53.785 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 46793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2490.ko 2024-05-28T05:51:53.785 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/matrox_w1.ko 2024-05-28T05:51:53.785 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/w1-gpio.ko 2024-05-28T05:51:53.786 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/ 2024-05-28T05:51:53.786 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-28T05:51:53.786 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-28T05:51:53.786 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-28T05:51:53.786 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-28T05:51:53.786 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-28T05:51:53.786 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-28T05:51:53.786 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-28T05:51:53.786 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-28T05:51:53.786 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-28T05:51:53.786 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-28T05:51:53.786 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 70361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-28T05:51:53.786 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 129409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/wire.ko 2024-05-28T05:51:53.787 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ 2024-05-28T05:51:53.787 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/acquirewdt.ko 2024-05-28T05:51:53.787 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/advantechwdt.ko 2024-05-28T05:51:53.787 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-28T05:51:53.787 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-28T05:51:53.787 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/cpu5wdt.ko 2024-05-28T05:51:53.787 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9052_wdt.ko 2024-05-28T05:51:53.787 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9055_wdt.ko 2024-05-28T05:51:53.787 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9063_wdt.ko 2024-05-28T05:51:53.787 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/dw_wdt.ko 2024-05-28T05:51:53.787 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/eurotechwdt.ko 2024-05-28T05:51:53.787 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-28T05:51:53.787 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/hpwdt.ko 2024-05-28T05:51:53.787 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/i6300esb.ko 2024-05-28T05:51:53.788 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-28T05:51:53.788 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-28T05:51:53.788 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ib700wdt.ko 2024-05-28T05:51:53.788 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ibmasr.ko 2024-05-28T05:51:53.788 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-28T05:51:53.788 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-28T05:51:53.788 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it87_wdt.ko 2024-05-28T05:51:53.788 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/kempld_wdt.ko 2024-05-28T05:51:53.788 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/machzwd.ko 2024-05-28T05:51:53.788 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/mena21_wdt.ko 2024-05-28T05:51:53.788 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-05-28T05:51:53.788 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/nv_tco.ko 2024-05-28T05:51:53.788 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-05-28T05:51:53.788 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pc87413_wdt.ko 2024-05-28T05:51:53.789 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 46945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-28T05:51:53.789 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-28T05:51:53.789 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/retu_wdt.ko 2024-05-28T05:51:53.789 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-05-28T05:51:53.789 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-05-28T05:51:53.789 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-28T05:51:53.789 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sc1200wdt.ko 2024-05-28T05:51:53.789 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-28T05:51:53.789 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-05-28T05:51:53.789 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/softdog.ko 2024-05-28T05:51:53.789 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-28T05:51:53.789 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/twl4030_wdt.ko 2024-05-28T05:51:53.789 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/via_wdt.ko 2024-05-28T05:51:53.790 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-28T05:51:53.790 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-28T05:51:53.790 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-28T05:51:53.790 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wafer5823wdt.ko 2024-05-28T05:51:53.790 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wdt_pci.ko 2024-05-28T05:51:53.790 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wm831x_wdt.ko 2024-05-28T05:51:53.790 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wm8350_wdt.ko 2024-05-28T05:51:53.790 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/xen_wdt.ko 2024-05-28T05:51:53.790 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/ 2024-05-28T05:51:53.790 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-evtchn.ko 2024-05-28T05:51:53.790 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntalloc.ko 2024-05-28T05:51:53.790 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 55705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntdev.ko 2024-05-28T05:51:53.790 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/ 2024-05-28T05:51:53.791 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 213865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-28T05:51:53.791 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 47673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-privcmd.ko 2024-05-28T05:51:53.791 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 85705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-scsiback.ko 2024-05-28T05:51:53.791 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/ 2024-05-28T05:51:53.791 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-28T05:51:53.791 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ 2024-05-28T05:51:53.791 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/ 2024-05-28T05:51:53.791 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 194449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/9p.ko 2024-05-28T05:51:53.791 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/adfs/ 2024-05-28T05:51:53.791 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 78049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/adfs/adfs.ko 2024-05-28T05:51:53.791 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/ 2024-05-28T05:51:53.791 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 197801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/affs.ko 2024-05-28T05:51:53.791 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/afs/ 2024-05-28T05:51:53.792 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1260937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/afs/kafs.ko 2024-05-28T05:51:53.792 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/autofs/ 2024-05-28T05:51:53.792 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 127337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/autofs/autofs4.ko 2024-05-28T05:51:53.792 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/ 2024-05-28T05:51:53.792 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 80481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/befs.ko 2024-05-28T05:51:53.792 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/bfs/ 2024-05-28T05:51:53.792 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 50457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/bfs/bfs.ko 2024-05-28T05:51:53.792 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 45553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/binfmt_misc.ko 2024-05-28T05:51:53.792 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/ 2024-05-28T05:51:53.792 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 4491713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/btrfs.ko 2024-05-28T05:51:53.839 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/ 2024-05-28T05:51:53.839 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 376801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/cachefiles.ko 2024-05-28T05:51:53.839 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ 2024-05-28T05:51:53.839 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1586617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ceph.ko 2024-05-28T05:51:53.840 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/ 2024-05-28T05:51:53.840 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 130017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/coda.ko 2024-05-28T05:51:53.840 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/configfs/ 2024-05-28T05:51:53.840 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 139049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/configfs/configfs.ko 2024-05-28T05:51:53.840 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/ 2024-05-28T05:51:53.840 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/cramfs.ko 2024-05-28T05:51:53.840 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/ 2024-05-28T05:51:53.840 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 813137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/dlm.ko 2024-05-28T05:51:53.840 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/efs/ 2024-05-28T05:51:53.840 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 46377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/efs/efs.ko 2024-05-28T05:51:53.840 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/ 2024-05-28T05:51:53.840 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1906713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/f2fs.ko 2024-05-28T05:51:53.840 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/ 2024-05-28T05:51:53.840 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/msdos.ko 2024-05-28T05:51:53.841 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/freevxfs/ 2024-05-28T05:51:53.841 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 52265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/freevxfs/freevxfs.ko 2024-05-28T05:51:53.841 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/ 2024-05-28T05:51:53.841 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/cuse.ko 2024-05-28T05:51:53.841 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/ 2024-05-28T05:51:53.841 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1486393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/gfs2.ko 2024-05-28T05:51:53.841 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/ 2024-05-28T05:51:53.841 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 183217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/hfs.ko 2024-05-28T05:51:53.841 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/ 2024-05-28T05:51:53.841 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 281993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/hfsplus.ko 2024-05-28T05:51:53.841 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hpfs/ 2024-05-28T05:51:53.841 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 248945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hpfs/hpfs.ko 2024-05-28T05:51:53.841 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/ 2024-05-28T05:51:53.841 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 92985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/isofs.ko 2024-05-28T05:51:53.842 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/ 2024-05-28T05:51:53.842 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 532953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/jfs.ko 2024-05-28T05:51:53.842 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/ 2024-05-28T05:51:53.842 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 361281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/lockd.ko 2024-05-28T05:51:53.842 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/ 2024-05-28T05:51:53.842 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 112569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/minix.ko 2024-05-28T05:51:53.842 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/ 2024-05-28T05:51:53.842 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 591625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/netfs.ko 2024-05-28T05:51:53.842 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/ 2024-05-28T05:51:53.842 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/ 2024-05-28T05:51:53.842 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 102537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-28T05:51:53.842 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/ 2024-05-28T05:51:53.842 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 74337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-28T05:51:53.843 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/ 2024-05-28T05:51:53.843 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 147673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-28T05:51:53.843 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1320377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfs.ko 2024-05-28T05:51:53.843 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 82089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv2.ko 2024-05-28T05:51:53.843 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 151617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv3.ko 2024-05-28T05:51:53.843 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 2518385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv4.ko 2024-05-28T05:51:53.843 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/ 2024-05-28T05:51:53.843 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/grace.ko 2024-05-28T05:51:53.843 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/nfs_acl.ko 2024-05-28T05:51:53.843 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/ 2024-05-28T05:51:53.843 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 2021969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/nfsd.ko 2024-05-28T05:51:53.843 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/ 2024-05-28T05:51:53.843 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 733969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/nilfs2.ko 2024-05-28T05:51:53.843 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/ 2024-05-28T05:51:53.844 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-celtic.ko 2024-05-28T05:51:53.844 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-centeuro.ko 2024-05-28T05:51:53.844 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-croatian.ko 2024-05-28T05:51:53.844 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-cyrillic.ko 2024-05-28T05:51:53.844 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-gaelic.ko 2024-05-28T05:51:53.844 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-greek.ko 2024-05-28T05:51:53.844 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-iceland.ko 2024-05-28T05:51:53.844 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-inuit.ko 2024-05-28T05:51:53.844 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-roman.ko 2024-05-28T05:51:53.844 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-romanian.ko 2024-05-28T05:51:53.844 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-turkish.ko 2024-05-28T05:51:53.844 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ascii.ko 2024-05-28T05:51:53.844 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1250.ko 2024-05-28T05:51:53.844 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1251.ko 2024-05-28T05:51:53.844 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1255.ko 2024-05-28T05:51:53.845 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp737.ko 2024-05-28T05:51:53.845 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp775.ko 2024-05-28T05:51:53.845 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp850.ko 2024-05-28T05:51:53.845 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp852.ko 2024-05-28T05:51:53.845 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp855.ko 2024-05-28T05:51:53.845 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp857.ko 2024-05-28T05:51:53.845 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp860.ko 2024-05-28T05:51:53.845 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp861.ko 2024-05-28T05:51:53.845 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp862.ko 2024-05-28T05:51:53.845 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp863.ko 2024-05-28T05:51:53.845 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp864.ko 2024-05-28T05:51:53.845 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp865.ko 2024-05-28T05:51:53.845 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp866.ko 2024-05-28T05:51:53.846 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp869.ko 2024-05-28T05:51:53.846 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp874.ko 2024-05-28T05:51:53.846 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 95617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp932.ko 2024-05-28T05:51:53.846 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 144201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp936.ko 2024-05-28T05:51:53.846 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 167129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp949.ko 2024-05-28T05:51:53.846 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 119505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp950.ko 2024-05-28T05:51:53.846 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_euc-jp.ko 2024-05-28T05:51:53.846 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-1.ko 2024-05-28T05:51:53.846 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-13.ko 2024-05-28T05:51:53.846 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-14.ko 2024-05-28T05:51:53.846 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-15.ko 2024-05-28T05:51:53.846 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-2.ko 2024-05-28T05:51:53.846 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-3.ko 2024-05-28T05:51:53.846 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-4.ko 2024-05-28T05:51:53.847 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-5.ko 2024-05-28T05:51:53.847 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-6.ko 2024-05-28T05:51:53.847 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-7.ko 2024-05-28T05:51:53.847 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-9.ko 2024-05-28T05:51:53.847 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-r.ko 2024-05-28T05:51:53.847 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-ru.ko 2024-05-28T05:51:53.847 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-u.ko 2024-05-28T05:51:53.847 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-28T05:51:53.847 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_utf8.ko 2024-05-28T05:51:53.847 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ntfs3/ 2024-05-28T05:51:53.847 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 634457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ntfs3/ntfs3.ko 2024-05-28T05:51:53.847 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ 2024-05-28T05:51:53.847 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ 2024-05-28T05:51:53.847 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 302033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-28T05:51:53.848 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ 2024-05-28T05:51:53.848 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 548057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-28T05:51:53.848 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ 2024-05-28T05:51:53.848 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 66345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-28T05:51:53.848 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 3245449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2.ko 2024-05-28T05:51:53.848 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-28T05:51:53.848 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 39305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-28T05:51:53.848 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-28T05:51:53.848 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/omfs/ 2024-05-28T05:51:53.848 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 67465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/omfs/omfs.ko 2024-05-28T05:51:53.848 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/ 2024-05-28T05:51:53.848 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 462817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/overlay.ko 2024-05-28T05:51:53.848 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ 2024-05-28T05:51:53.848 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 67961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ramoops.ko 2024-05-28T05:51:53.849 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx4/ 2024-05-28T05:51:53.849 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx4/qnx4.ko 2024-05-28T05:51:53.849 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx6/ 2024-05-28T05:51:53.849 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 56073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx6/qnx6.ko 2024-05-28T05:51:53.849 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/ 2024-05-28T05:51:53.849 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_tree.ko 2024-05-28T05:51:53.849 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_v1.ko 2024-05-28T05:51:53.849 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_v2.ko 2024-05-28T05:51:53.849 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/ 2024-05-28T05:51:53.849 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 684713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/reiserfs.ko 2024-05-28T05:51:53.849 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/ 2024-05-28T05:51:53.849 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/romfs.ko 2024-05-28T05:51:53.849 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/ 2024-05-28T05:51:53.850 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/ 2024-05-28T05:51:53.850 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 3350841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/cifs.ko 2024-05-28T05:51:53.850 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/ 2024-05-28T05:51:53.850 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_arc4.ko 2024-05-28T05:51:53.850 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_md4.ko 2024-05-28T05:51:53.850 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/ 2024-05-28T05:51:53.850 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 164145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/squashfs.ko 2024-05-28T05:51:53.850 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/ 2024-05-28T05:51:53.850 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 115865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/sysv.ko 2024-05-28T05:51:53.850 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/ 2024-05-28T05:51:53.850 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 309937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/udf.ko 2024-05-28T05:51:53.850 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ 2024-05-28T05:51:53.850 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 198185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ufs.ko 2024-05-28T05:51:53.851 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/ 2024-05-28T05:51:53.851 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 5192193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/xfs.ko 2024-05-28T05:51:53.851 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/ 2024-05-28T05:51:53.851 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/locking/ 2024-05-28T05:51:53.851 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 97617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/locking/locktorture.ko 2024-05-28T05:51:53.851 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/time/ 2024-05-28T05:51:53.851 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/time/test_udelay.ko 2024-05-28T05:51:53.851 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 72657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/torture.ko 2024-05-28T05:51:53.851 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ 2024-05-28T05:51:53.851 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc-itu-t.ko 2024-05-28T05:51:53.851 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc7.ko 2024-05-28T05:51:53.851 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc8.ko 2024-05-28T05:51:53.851 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/ 2024-05-28T05:51:53.851 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libarc4.ko 2024-05-28T05:51:53.852 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libdes.ko 2024-05-28T05:51:53.852 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/interval_tree_test.ko 2024-05-28T05:51:53.852 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/libcrc32c.ko 2024-05-28T05:51:53.852 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lru_cache.ko 2024-05-28T05:51:53.852 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/ 2024-05-28T05:51:53.852 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4_compress.ko 2024-05-28T05:51:53.852 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4hc_compress.ko 2024-05-28T05:51:53.852 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/ 2024-05-28T05:51:53.852 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/cordic.ko 2024-05-28T05:51:53.852 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/memory-notifier-error-inject.ko 2024-05-28T05:51:53.852 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/notifier-error-inject.ko 2024-05-28T05:51:53.852 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/percpu_test.ko 2024-05-28T05:51:53.852 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/pm-notifier-error-inject.ko 2024-05-28T05:51:53.853 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/ 2024-05-28T05:51:53.853 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 151945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/raid6_pq.ko 2024-05-28T05:51:53.853 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/rbtree_test.ko 2024-05-28T05:51:53.853 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/ 2024-05-28T05:51:53.853 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-28T05:51:53.853 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test-kstrtox.ko 2024-05-28T05:51:53.853 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 4912433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_bpf.ko 2024-05-28T05:51:53.853 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 61161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_firmware.ko 2024-05-28T05:51:53.853 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_module.ko 2024-05-28T05:51:53.853 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_user_copy.ko 2024-05-28T05:51:53.853 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_bm.ko 2024-05-28T05:51:53.853 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_fsm.ko 2024-05-28T05:51:53.853 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_kmp.ko 2024-05-28T05:51:53.853 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/xz/ 2024-05-28T05:51:53.854 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/xz/xz_dec_test.ko 2024-05-28T05:51:53.854 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/mm/ 2024-05-28T05:51:53.854 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/mm/hwpoison-inject.ko 2024-05-28T05:51:53.854 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ 2024-05-28T05:51:53.854 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/ 2024-05-28T05:51:53.854 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 66945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/6lowpan.ko 2024-05-28T05:51:53.854 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_dest.ko 2024-05-28T05:51:53.854 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_fragment.ko 2024-05-28T05:51:53.854 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_hop.ko 2024-05-28T05:51:53.854 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-28T05:51:53.854 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_mobility.ko 2024-05-28T05:51:53.854 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_routing.ko 2024-05-28T05:51:53.854 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_udp.ko 2024-05-28T05:51:53.855 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/ 2024-05-28T05:51:53.855 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/garp.ko 2024-05-28T05:51:53.855 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/mrp.ko 2024-05-28T05:51:53.855 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/p8022.ko 2024-05-28T05:51:53.855 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/psnap.ko 2024-05-28T05:51:53.855 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/stp.ko 2024-05-28T05:51:53.855 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/ 2024-05-28T05:51:53.855 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 106697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/8021q.ko 2024-05-28T05:51:53.855 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/ 2024-05-28T05:51:53.855 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 236769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet.ko 2024-05-28T05:51:53.855 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_fd.ko 2024-05-28T05:51:53.855 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_rdma.ko 2024-05-28T05:51:53.855 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 39553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_virtio.ko 2024-05-28T05:51:53.855 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/ 2024-05-28T05:51:53.856 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 879593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/batman-adv.ko 2024-05-28T05:51:53.856 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/ 2024-05-28T05:51:53.856 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 85225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/br_netfilter.ko 2024-05-28T05:51:53.856 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1031177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/bridge.ko 2024-05-28T05:51:53.856 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ 2024-05-28T05:51:53.856 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-28T05:51:53.856 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-28T05:51:53.856 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-28T05:51:53.856 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-28T05:51:53.856 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-28T05:51:53.856 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-28T05:51:53.856 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-28T05:51:53.856 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-28T05:51:53.856 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-28T05:51:53.857 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-28T05:51:53.857 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-28T05:51:53.857 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-28T05:51:53.857 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-28T05:51:53.857 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-28T05:51:53.857 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-28T05:51:53.857 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-28T05:51:53.857 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-28T05:51:53.857 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-28T05:51:53.857 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-28T05:51:53.857 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-28T05:51:53.857 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 70521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtables.ko 2024-05-28T05:51:53.857 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-28T05:51:53.857 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-28T05:51:53.857 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/ 2024-05-28T05:51:53.857 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1243369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/libceph.ko 2024-05-28T05:51:53.858 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/core/ 2024-05-28T05:51:53.858 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 153793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/core/pktgen.ko 2024-05-28T05:51:53.858 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/ 2024-05-28T05:51:53.858 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 244825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp.ko 2024-05-28T05:51:53.858 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_diag.ko 2024-05-28T05:51:53.858 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 71025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv4.ko 2024-05-28T05:51:53.858 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 74985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv6.ko 2024-05-28T05:51:53.858 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/ 2024-05-28T05:51:53.858 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 507649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/dsa_core.ko 2024-05-28T05:51:53.858 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_brcm.ko 2024-05-28T05:51:53.858 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_dsa.ko 2024-05-28T05:51:53.858 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_none.ko 2024-05-28T05:51:53.858 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_trailer.ko 2024-05-28T05:51:53.858 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/hsr/ 2024-05-28T05:51:53.859 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 128577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/hsr/hsr.ko 2024-05-28T05:51:53.859 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ 2024-05-28T05:51:53.859 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ 2024-05-28T05:51:53.859 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 55481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-28T05:51:53.859 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 357369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154.ko 2024-05-28T05:51:53.859 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 59385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-28T05:51:53.859 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ 2024-05-28T05:51:53.859 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ah4.ko 2024-05-28T05:51:53.859 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 46409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/esp4.ko 2024-05-28T05:51:53.859 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 60217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/fou.ko 2024-05-28T05:51:53.859 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/gre.ko 2024-05-28T05:51:53.859 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 65657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/inet_diag.ko 2024-05-28T05:51:53.859 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 75481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_gre.ko 2024-05-28T05:51:53.859 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 77713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_tunnel.ko 2024-05-28T05:51:53.860 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_vti.ko 2024-05-28T05:51:53.860 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipcomp.ko 2024-05-28T05:51:53.860 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipip.ko 2024-05-28T05:51:53.860 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ 2024-05-28T05:51:53.860 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 45513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-28T05:51:53.860 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-28T05:51:53.860 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-28T05:51:53.860 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 50161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ip_tables.ko 2024-05-28T05:51:53.860 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-28T05:51:53.860 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-05-28T05:51:53.860 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-28T05:51:53.860 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-28T05:51:53.860 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-28T05:51:53.860 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-05-28T05:51:53.861 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-28T05:51:53.861 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-28T05:51:53.861 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-28T05:51:53.861 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-28T05:51:53.861 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-28T05:51:53.861 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-28T05:51:53.861 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-28T05:51:53.861 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-28T05:51:53.861 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-28T05:51:53.861 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-05-28T05:51:53.861 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-28T05:51:53.861 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-28T05:51:53.861 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-28T05:51:53.862 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-28T05:51:53.862 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-28T05:51:53.862 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_bic.ko 2024-05-28T05:51:53.862 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_dctcp.ko 2024-05-28T05:51:53.862 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_diag.ko 2024-05-28T05:51:53.862 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_highspeed.ko 2024-05-28T05:51:53.862 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_htcp.ko 2024-05-28T05:51:53.862 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_hybla.ko 2024-05-28T05:51:53.862 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_illinois.ko 2024-05-28T05:51:53.862 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_lp.ko 2024-05-28T05:51:53.862 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_scalable.ko 2024-05-28T05:51:53.862 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_vegas.ko 2024-05-28T05:51:53.862 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_veno.ko 2024-05-28T05:51:53.862 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_westwood.ko 2024-05-28T05:51:53.863 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_yeah.ko 2024-05-28T05:51:53.863 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tunnel4.ko 2024-05-28T05:51:53.863 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_diag.ko 2024-05-28T05:51:53.863 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 54425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_tunnel.ko 2024-05-28T05:51:53.863 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-28T05:51:53.863 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ 2024-05-28T05:51:53.863 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ah6.ko 2024-05-28T05:51:53.863 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 47425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/esp6.ko 2024-05-28T05:51:53.863 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/fou6.ko 2024-05-28T05:51:53.863 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 103169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_gre.ko 2024-05-28T05:51:53.863 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 118873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_tunnel.ko 2024-05-28T05:51:53.863 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-28T05:51:53.863 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 71081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_vti.ko 2024-05-28T05:51:53.863 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ipcomp6.ko 2024-05-28T05:51:53.863 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/mip6.ko 2024-05-28T05:51:53.864 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ 2024-05-28T05:51:53.864 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 50729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-28T05:51:53.864 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-05-28T05:51:53.864 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-28T05:51:53.864 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-28T05:51:53.864 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-28T05:51:53.864 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-28T05:51:53.864 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-28T05:51:53.864 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-28T05:51:53.864 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-28T05:51:53.864 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-28T05:51:53.864 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-28T05:51:53.864 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-28T05:51:53.864 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-28T05:51:53.864 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-28T05:51:53.865 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-28T05:51:53.865 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-28T05:51:53.865 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-28T05:51:53.865 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 46297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-28T05:51:53.865 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-28T05:51:53.865 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-28T05:51:53.865 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-28T05:51:53.865 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-28T05:51:53.865 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-28T05:51:53.865 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-28T05:51:53.865 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-28T05:51:53.865 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 94081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/sit.ko 2024-05-28T05:51:53.865 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/tunnel6.ko 2024-05-28T05:51:53.866 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-28T05:51:53.866 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/key/ 2024-05-28T05:51:53.866 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 106361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/key/af_key.ko 2024-05-28T05:51:53.866 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/ 2024-05-28T05:51:53.866 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 153209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_core.ko 2024-05-28T05:51:53.866 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-28T05:51:53.866 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_eth.ko 2024-05-28T05:51:53.866 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip.ko 2024-05-28T05:51:53.866 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip6.ko 2024-05-28T05:51:53.866 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_netlink.ko 2024-05-28T05:51:53.866 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 66233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ppp.ko 2024-05-28T05:51:53.869 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/lapb/ 2024-05-28T05:51:53.870 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 63321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/lapb/lapb.ko 2024-05-28T05:51:53.870 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/ 2024-05-28T05:51:53.870 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc.ko 2024-05-28T05:51:53.870 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 332817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc2.ko 2024-05-28T05:51:53.870 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/ 2024-05-28T05:51:53.870 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 388817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/mac802154.ko 2024-05-28T05:51:53.870 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/ 2024-05-28T05:51:53.870 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/mpls_gso.ko 2024-05-28T05:51:53.870 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ 2024-05-28T05:51:53.871 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ 2024-05-28T05:51:53.871 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 147729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set.ko 2024-05-28T05:51:53.871 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-28T05:51:53.871 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-28T05:51:53.871 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-28T05:51:53.871 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 124033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-28T05:51:53.871 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 124337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-28T05:51:53.871 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 126673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-28T05:51:53.871 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 126465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-28T05:51:53.871 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 137825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-28T05:51:53.871 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 72345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-28T05:51:53.871 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 133673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-28T05:51:53.871 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 139065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-28T05:51:53.871 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 138257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-28T05:51:53.872 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 136169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-28T05:51:53.872 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 139889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-28T05:51:53.872 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-28T05:51:53.872 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ 2024-05-28T05:51:53.872 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 534033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-28T05:51:53.872 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-28T05:51:53.872 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-28T05:51:53.872 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-28T05:51:53.872 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-28T05:51:53.872 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-28T05:51:53.872 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-28T05:51:53.872 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-28T05:51:53.873 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-28T05:51:53.873 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-28T05:51:53.873 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-28T05:51:53.873 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-28T05:51:53.873 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-28T05:51:53.873 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-28T05:51:53.873 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 55209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conncount.ko 2024-05-28T05:51:53.873 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 496713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack.ko 2024-05-28T05:51:53.873 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-28T05:51:53.873 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-28T05:51:53.873 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-28T05:51:53.873 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 134361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-28T05:51:53.873 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-28T05:51:53.873 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-28T05:51:53.874 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 140793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-28T05:51:53.874 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-28T05:51:53.874 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-28T05:51:53.874 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 79865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-28T05:51:53.874 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-28T05:51:53.874 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-28T05:51:53.874 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-28T05:51:53.874 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 117385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table.ko 2024-05-28T05:51:53.874 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-28T05:51:53.874 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 46097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_log_syslog.ko 2024-05-28T05:51:53.874 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 118337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat.ko 2024-05-28T05:51:53.874 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-28T05:51:53.875 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-28T05:51:53.875 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_irc.ko 2024-05-28T05:51:53.875 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_sip.ko 2024-05-28T05:51:53.875 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-28T05:51:53.875 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 53385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-28T05:51:53.875 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 811705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_tables.ko 2024-05-28T05:51:53.875 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 53041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink.ko 2024-05-28T05:51:53.875 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-28T05:51:53.875 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-05-28T05:51:53.875 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 49289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_log.ko 2024-05-28T05:51:53.875 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-28T05:51:53.875 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 65137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-28T05:51:53.875 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_chain_nat.ko 2024-05-28T05:51:53.876 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_compat.ko 2024-05-28T05:51:53.876 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 50649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_ct.ko 2024-05-28T05:51:53.876 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-28T05:51:53.876 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fib.ko 2024-05-28T05:51:53.876 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-28T05:51:53.876 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_hash.ko 2024-05-28T05:51:53.876 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_limit.ko 2024-05-28T05:51:53.876 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_log.ko 2024-05-28T05:51:53.876 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_masq.ko 2024-05-28T05:51:53.876 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_nat.ko 2024-05-28T05:51:53.876 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_numgen.ko 2024-05-28T05:51:53.876 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_osf.ko 2024-05-28T05:51:53.876 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_queue.ko 2024-05-28T05:51:53.876 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_redir.ko 2024-05-28T05:51:53.877 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject.ko 2024-05-28T05:51:53.877 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject_inet.ko 2024-05-28T05:51:53.877 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_socket.ko 2024-05-28T05:51:53.877 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_synproxy.ko 2024-05-28T05:51:53.877 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_tproxy.ko 2024-05-28T05:51:53.877 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 108385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/x_tables.ko 2024-05-28T05:51:53.877 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_AUDIT.ko 2024-05-28T05:51:53.877 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-28T05:51:53.877 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-28T05:51:53.877 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-28T05:51:53.877 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CT.ko 2024-05-28T05:51:53.877 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_DSCP.ko 2024-05-28T05:51:53.877 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HL.ko 2024-05-28T05:51:53.877 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HMARK.ko 2024-05-28T05:51:53.878 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 45209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-28T05:51:53.878 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LED.ko 2024-05-28T05:51:53.878 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LOG.ko 2024-05-28T05:51:53.878 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-28T05:51:53.878 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NETMAP.ko 2024-05-28T05:51:53.878 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFLOG.ko 2024-05-28T05:51:53.878 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-28T05:51:53.878 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_RATEEST.ko 2024-05-28T05:51:53.878 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-28T05:51:53.878 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_SECMARK.ko 2024-05-28T05:51:53.878 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-28T05:51:53.878 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-28T05:51:53.878 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TEE.ko 2024-05-28T05:51:53.879 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TPROXY.ko 2024-05-28T05:51:53.879 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TRACE.ko 2024-05-28T05:51:53.879 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_addrtype.ko 2024-05-28T05:51:53.879 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_bpf.ko 2024-05-28T05:51:53.879 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cgroup.ko 2024-05-28T05:51:53.879 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cluster.ko 2024-05-28T05:51:53.879 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_comment.ko 2024-05-28T05:51:53.879 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connbytes.ko 2024-05-28T05:51:53.879 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlabel.ko 2024-05-28T05:51:53.879 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlimit.ko 2024-05-28T05:51:53.879 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connmark.ko 2024-05-28T05:51:53.879 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_conntrack.ko 2024-05-28T05:51:53.879 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cpu.ko 2024-05-28T05:51:53.880 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dccp.ko 2024-05-28T05:51:53.880 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_devgroup.ko 2024-05-28T05:51:53.880 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dscp.ko 2024-05-28T05:51:53.880 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ecn.ko 2024-05-28T05:51:53.880 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_esp.ko 2024-05-28T05:51:53.880 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 52809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hashlimit.ko 2024-05-28T05:51:53.880 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_helper.ko 2024-05-28T05:51:53.880 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hl.ko 2024-05-28T05:51:53.880 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipcomp.ko 2024-05-28T05:51:53.880 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_iprange.ko 2024-05-28T05:51:53.880 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipvs.ko 2024-05-28T05:51:53.880 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_l2tp.ko 2024-05-28T05:51:53.880 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_length.ko 2024-05-28T05:51:53.881 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_limit.ko 2024-05-28T05:51:53.881 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mac.ko 2024-05-28T05:51:53.881 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mark.ko 2024-05-28T05:51:53.881 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_multiport.ko 2024-05-28T05:51:53.881 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nat.ko 2024-05-28T05:51:53.881 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nfacct.ko 2024-05-28T05:51:53.881 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_osf.ko 2024-05-28T05:51:53.881 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_owner.ko 2024-05-28T05:51:53.881 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_physdev.ko 2024-05-28T05:51:53.881 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_pkttype.ko 2024-05-28T05:51:53.881 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_policy.ko 2024-05-28T05:51:53.881 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_quota.ko 2024-05-28T05:51:53.881 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_rateest.ko 2024-05-28T05:51:53.881 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_realm.ko 2024-05-28T05:51:53.882 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_recent.ko 2024-05-28T05:51:53.882 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_sctp.ko 2024-05-28T05:51:53.882 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_set.ko 2024-05-28T05:51:53.882 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_socket.ko 2024-05-28T05:51:53.882 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_state.ko 2024-05-28T05:51:53.882 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_statistic.ko 2024-05-28T05:51:53.882 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_string.ko 2024-05-28T05:51:53.882 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpmss.ko 2024-05-28T05:51:53.882 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpudp.ko 2024-05-28T05:51:53.882 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_time.ko 2024-05-28T05:51:53.882 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_u32.ko 2024-05-28T05:51:53.882 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/ 2024-05-28T05:51:53.882 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/netlink_diag.ko 2024-05-28T05:51:53.883 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/ 2024-05-28T05:51:53.883 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/nsh.ko 2024-05-28T05:51:53.883 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/ 2024-05-28T05:51:53.883 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 488457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/openvswitch.ko 2024-05-28T05:51:53.883 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-geneve.ko 2024-05-28T05:51:53.883 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-gre.ko 2024-05-28T05:51:53.883 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-vxlan.ko 2024-05-28T05:51:53.883 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/ 2024-05-28T05:51:53.883 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/af_packet_diag.ko 2024-05-28T05:51:53.883 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/ 2024-05-28T05:51:53.883 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 141993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/phonet.ko 2024-05-28T05:51:53.883 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 68801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/pn_pep.ko 2024-05-28T05:51:53.883 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/ 2024-05-28T05:51:53.883 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 318537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds.ko 2024-05-28T05:51:53.883 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 202249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_rdma.ko 2024-05-28T05:51:53.884 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 85073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_tcp.ko 2024-05-28T05:51:53.884 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rxrpc/ 2024-05-28T05:51:53.884 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1028129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rxrpc/rxrpc.ko 2024-05-28T05:51:53.884 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/ 2024-05-28T05:51:53.884 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_csum.ko 2024-05-28T05:51:53.884 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_gact.ko 2024-05-28T05:51:53.884 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 45401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_mirred.ko 2024-05-28T05:51:53.884 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_nat.ko 2024-05-28T05:51:53.884 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 53457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_pedit.ko 2024-05-28T05:51:53.884 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_police.ko 2024-05-28T05:51:53.884 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_simple.ko 2024-05-28T05:51:53.884 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_skbedit.ko 2024-05-28T05:51:53.884 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 45665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_vlan.ko 2024-05-28T05:51:53.884 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_basic.ko 2024-05-28T05:51:53.884 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_bpf.ko 2024-05-28T05:51:53.885 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_cgroup.ko 2024-05-28T05:51:53.885 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_flow.ko 2024-05-28T05:51:53.885 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 39593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_fw.ko 2024-05-28T05:51:53.885 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 49313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_route.ko 2024-05-28T05:51:53.885 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 79137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_u32.ko 2024-05-28T05:51:53.885 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_cmp.ko 2024-05-28T05:51:53.885 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_ipset.ko 2024-05-28T05:51:53.885 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 48777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_meta.ko 2024-05-28T05:51:53.885 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_nbyte.ko 2024-05-28T05:51:53.885 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_text.ko 2024-05-28T05:51:53.885 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_u32.ko 2024-05-28T05:51:53.885 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_choke.ko 2024-05-28T05:51:53.886 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_codel.ko 2024-05-28T05:51:53.886 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_drr.ko 2024-05-28T05:51:53.886 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq.ko 2024-05-28T05:51:53.886 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 39169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq_codel.ko 2024-05-28T05:51:53.886 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_gred.ko 2024-05-28T05:51:53.886 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 62809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hfsc.ko 2024-05-28T05:51:53.886 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hhf.ko 2024-05-28T05:51:53.886 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 81825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_htb.ko 2024-05-28T05:51:53.886 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_ingress.ko 2024-05-28T05:51:53.886 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio.ko 2024-05-28T05:51:53.886 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio_lib.ko 2024-05-28T05:51:53.886 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_multiq.ko 2024-05-28T05:51:53.886 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_netem.ko 2024-05-28T05:51:53.887 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_pie.ko 2024-05-28T05:51:53.887 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_plug.ko 2024-05-28T05:51:53.887 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_prio.ko 2024-05-28T05:51:53.887 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 60241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_qfq.ko 2024-05-28T05:51:53.887 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_red.ko 2024-05-28T05:51:53.887 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfb.ko 2024-05-28T05:51:53.887 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfq.ko 2024-05-28T05:51:53.887 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_tbf.ko 2024-05-28T05:51:53.887 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_teql.ko 2024-05-28T05:51:53.887 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/ 2024-05-28T05:51:53.887 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1187153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp.ko 2024-05-28T05:51:53.887 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp_diag.ko 2024-05-28T05:51:53.887 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/ 2024-05-28T05:51:53.888 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/ 2024-05-28T05:51:53.888 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 432225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-28T05:51:53.888 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 70081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-28T05:51:53.888 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1940753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/sunrpc.ko 2024-05-28T05:51:53.888 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/ 2024-05-28T05:51:53.888 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 889729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-28T05:51:53.888 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/ 2024-05-28T05:51:53.888 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1122273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc.ko 2024-05-28T05:51:53.888 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc_diag.ko 2024-05-28T05:51:53.888 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/ 2024-05-28T05:51:53.888 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/unix_diag.ko 2024-05-28T05:51:53.888 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/ 2024-05-28T05:51:53.888 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 105601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-28T05:51:53.888 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 90249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-28T05:51:53.889 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 123745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock.ko 2024-05-28T05:51:53.889 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-28T05:51:53.889 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-28T05:51:53.889 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/x25/ 2024-05-28T05:51:53.889 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 165777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/x25/x25.ko 2024-05-28T05:51:53.889 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/ 2024-05-28T05:51:53.889 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_algo.ko 2024-05-28T05:51:53.889 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-28T05:51:53.889 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 131857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_user.ko 2024-05-28T05:51:53.889 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 646387 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.alias 2024-05-28T05:51:53.889 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 630543 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.alias.bin 2024-05-28T05:51:53.889 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7706 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin 2024-05-28T05:51:53.889 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.alias.bin 2024-05-28T05:51:53.889 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9941 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.bin 2024-05-28T05:51:53.890 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 70990 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.modinfo 2024-05-28T05:51:53.890 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 146985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.dep 2024-05-28T05:51:53.890 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 232892 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.dep.bin 2024-05-28T05:51:53.890 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 210 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.devname 2024-05-28T05:51:53.890 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 72627 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.order 2024-05-28T05:51:53.890 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 879 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.softdep 2024-05-28T05:51:53.890 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 258450 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.symbols 2024-05-28T05:51:53.890 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 313019 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.symbols.bin 2024-05-28T05:51:53.890 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/ 2024-05-28T05:51:53.890 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/ 2024-05-28T05:51:53.890 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/doc/ 2024-05-28T05:51:53.890 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/ 2024-05-28T05:51:53.890 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 171 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/changelog.Debian.gz 2024-05-28T05:51:53.891 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 691 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/copyright 2024-05-28T05:51:53.895 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-gb9459a26b088 2024-05-28T05:51:53.896 INFO:teuthology.task.kernel:searching for kernel 6.9.0-gb9459a26b088 2024-05-28T05:51:53.896 DEBUG:teuthology.orchestra.run.smithi153:> egrep '(submenu|menuentry.*6.9.0-gb9459a26b088).*{' /boot/grub/grub.cfg 2024-05-28T05:51:53.902 INFO:teuthology.orchestra.run.smithi153.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-28T05:51:53.902 INFO:teuthology.orchestra.run.smithi153.stdout: menuentry 'Ubuntu, with Linux 6.9.0-gb9459a26b088' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-gb9459a26b088-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-28T05:51:53.902 INFO:teuthology.orchestra.run.smithi153.stdout: menuentry 'Ubuntu, with Linux 6.9.0-gb9459a26b088 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-gb9459a26b088-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-28T05:51:53.903 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-05-28T05:51:53.903 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-gb9459a26b088 2024-05-28T05:51:53.903 DEBUG:teuthology.orchestra.run.smithi153:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-05-28T05:51:53.946 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi153.front.sepia.ceph.com to complete... 2024-05-28T05:51:54.436 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub' 2024-05-28T05:51:54.437 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-28T05:51:54.458 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2024-05-28T05:51:54.683 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-28T05:51:54.690 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-28T05:51:54.947 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-28T05:51:54.953 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-28T05:51:54.996 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-28T05:51:55.001 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-28T05:51:55.131 INFO:teuthology.orchestra.run.smithi153.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-28T05:51:55.131 INFO:teuthology.orchestra.run.smithi153.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-28T05:51:55.131 INFO:teuthology.orchestra.run.smithi153.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-28T05:51:55.150 INFO:teuthology.orchestra.run.smithi153.stderr:done 2024-05-28T05:51:55.162 INFO:teuthology.orchestra.run.smithi122.stderr:Sourcing file `/etc/default/grub' 2024-05-28T05:51:55.175 INFO:teuthology.orchestra.run.smithi122.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-28T05:51:55.204 INFO:teuthology.orchestra.run.smithi122.stderr:Generating grub configuration file ... 2024-05-28T05:51:55.522 INFO:teuthology.orchestra.run.smithi122.stderr:Found linux image: /boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-28T05:51:55.537 INFO:teuthology.orchestra.run.smithi122.stderr:Found initrd image: /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-28T05:51:55.824 INFO:teuthology.orchestra.run.smithi122.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-28T05:51:55.837 INFO:teuthology.orchestra.run.smithi122.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-28T05:51:55.900 INFO:teuthology.orchestra.run.smithi122.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-28T05:51:55.905 INFO:teuthology.orchestra.run.smithi122.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-28T05:51:56.054 INFO:teuthology.orchestra.run.smithi122.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-28T05:51:56.055 INFO:teuthology.orchestra.run.smithi122.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-28T05:51:56.055 INFO:teuthology.orchestra.run.smithi122.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-28T05:51:56.092 INFO:teuthology.orchestra.run.smithi122.stderr:done 2024-05-28T05:51:56.254 DEBUG:teuthology.orchestra.run.smithi122:> dpkg-deb -c /tmp/linux-image.deb 2024-05-28T05:51:56.262 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./ 2024-05-28T05:51:56.262 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./boot/ 2024-05-28T05:51:56.262 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 7004139 2024-05-23 11:07 ./boot/System.map-6.9.0-gb9459a26b088 2024-05-28T05:51:56.280 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 172251 2024-05-23 11:07 ./boot/config-6.9.0-gb9459a26b088 2024-05-28T05:51:56.280 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13136896 2024-05-23 11:07 ./boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-28T05:51:56.299 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/ 2024-05-28T05:51:56.299 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/ 2024-05-28T05:51:56.299 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/postinst.d/ 2024-05-28T05:51:56.300 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/postrm.d/ 2024-05-28T05:51:56.300 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/preinst.d/ 2024-05-28T05:51:56.300 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/prerm.d/ 2024-05-28T05:51:56.300 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/ 2024-05-28T05:51:56.300 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/ 2024-05-28T05:51:56.300 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/ 2024-05-28T05:51:56.300 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/ 2024-05-28T05:51:56.300 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/ 2024-05-28T05:51:56.300 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/ 2024-05-28T05:51:56.300 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ 2024-05-28T05:51:56.300 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 507497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/aesni-intel.ko 2024-05-28T05:51:56.303 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-28T05:51:56.303 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 34305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-28T05:51:56.303 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 35001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-28T05:51:56.303 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 97945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-28T05:51:56.303 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 109897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-28T05:51:56.303 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 155241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-28T05:51:56.303 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-28T05:51:56.304 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-28T05:51:56.304 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 87001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-28T05:51:56.304 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-28T05:51:56.304 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 50297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-28T05:51:56.304 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 50369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-28T05:51:56.304 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 54505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-28T05:51:56.304 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 44649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-28T05:51:56.304 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 48041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-28T05:51:56.304 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 62865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-28T05:51:56.304 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 53561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-28T05:51:56.304 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 34753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-28T05:51:56.304 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-28T05:51:56.304 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/ 2024-05-28T05:51:56.304 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/ 2024-05-28T05:51:56.304 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/ 2024-05-28T05:51:56.305 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 49073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-28T05:51:56.305 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpuid.ko 2024-05-28T05:51:56.305 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/msr.ko 2024-05-28T05:51:56.305 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/ 2024-05-28T05:51:56.305 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 443289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-28T05:51:56.305 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 1037081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-28T05:51:56.305 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 2850153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm.ko 2024-05-28T05:51:56.319 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ 2024-05-28T05:51:56.319 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 65017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/af_alg.ko 2024-05-28T05:51:56.319 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 27953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/algif_hash.ko 2024-05-28T05:51:56.319 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/algif_skcipher.ko 2024-05-28T05:51:56.319 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ansi_cprng.ko 2024-05-28T05:51:56.319 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/anubis.ko 2024-05-28T05:51:56.319 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/arc4.ko 2024-05-28T05:51:56.319 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/asymmetric_keys/ 2024-05-28T05:51:56.319 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-05-28T05:51:56.320 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/ 2024-05-28T05:51:56.320 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_memcpy.ko 2024-05-28T05:51:56.320 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_pq.ko 2024-05-28T05:51:56.320 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-28T05:51:56.320 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_tx.ko 2024-05-28T05:51:56.320 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_xor.ko 2024-05-28T05:51:56.320 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/raid6test.ko 2024-05-28T05:51:56.320 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authenc.ko 2024-05-28T05:51:56.320 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 27945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authencesn.ko 2024-05-28T05:51:56.320 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blake2b_generic.ko 2024-05-28T05:51:56.320 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_common.ko 2024-05-28T05:51:56.320 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_generic.ko 2024-05-28T05:51:56.320 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 40881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/camellia_generic.ko 2024-05-28T05:51:56.321 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast5_generic.ko 2024-05-28T05:51:56.321 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast6_generic.ko 2024-05-28T05:51:56.321 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast_common.ko 2024-05-28T05:51:56.321 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 43273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ccm.ko 2024-05-28T05:51:56.321 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cmac.ko 2024-05-28T05:51:56.321 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crc32_generic.ko 2024-05-28T05:51:56.321 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 59121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cryptd.ko 2024-05-28T05:51:56.321 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 48105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_engine.ko 2024-05-28T05:51:56.321 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 32161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_simd.ko 2024-05-28T05:51:56.322 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 30873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_user.ko 2024-05-28T05:51:56.322 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cts.ko 2024-05-28T05:51:56.322 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/des_generic.ko 2024-05-28T05:51:56.322 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/dh_generic.ko 2024-05-28T05:51:56.322 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/echainiv.ko 2024-05-28T05:51:56.322 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 30681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/essiv.ko 2024-05-28T05:51:56.322 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/fcrypt.ko 2024-05-28T05:51:56.322 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/khazad.ko 2024-05-28T05:51:56.322 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lrw.ko 2024-05-28T05:51:56.322 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4.ko 2024-05-28T05:51:56.322 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4hc.ko 2024-05-28T05:51:56.322 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/md4.ko 2024-05-28T05:51:56.323 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/michael_mic.ko 2024-05-28T05:51:56.323 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcbc.ko 2024-05-28T05:51:56.323 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcrypt.ko 2024-05-28T05:51:56.323 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/rmd160.ko 2024-05-28T05:51:56.323 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 30665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/seed.ko 2024-05-28T05:51:56.323 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/serpent_generic.ko 2024-05-28T05:51:56.323 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 169057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tcrypt.ko 2024-05-28T05:51:56.323 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tea.ko 2024-05-28T05:51:56.323 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_common.ko 2024-05-28T05:51:56.323 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_generic.ko 2024-05-28T05:51:56.323 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/vmac.ko 2024-05-28T05:51:56.323 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 38201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/wp512.ko 2024-05-28T05:51:56.323 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xcbc.ko 2024-05-28T05:51:56.323 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 30337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xor.ko 2024-05-28T05:51:56.324 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xts.ko 2024-05-28T05:51:56.324 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xxhash_generic.ko 2024-05-28T05:51:56.324 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ 2024-05-28T05:51:56.324 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ 2024-05-28T05:51:56.324 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_extlog.ko 2024-05-28T05:51:56.324 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 31913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-28T05:51:56.324 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 32273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_pad.ko 2024-05-28T05:51:56.324 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/apei/ 2024-05-28T05:51:56.324 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 44697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/apei/einj.ko 2024-05-28T05:51:56.324 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ec_sys.ko 2024-05-28T05:51:56.324 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/platform_profile.ko 2024-05-28T05:51:56.324 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbs.ko 2024-05-28T05:51:56.324 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbshc.ko 2024-05-28T05:51:56.325 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 119017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/video.ko 2024-05-28T05:51:56.325 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ 2024-05-28T05:51:56.325 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/acard-ahci.ko 2024-05-28T05:51:56.325 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 99177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci.ko 2024-05-28T05:51:56.325 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci_platform.ko 2024-05-28T05:51:56.325 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 107729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci.ko 2024-05-28T05:51:56.325 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 41993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci_platform.ko 2024-05-28T05:51:56.325 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_acpi.ko 2024-05-28T05:51:56.325 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 35697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ali.ko 2024-05-28T05:51:56.325 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 38321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_amd.ko 2024-05-28T05:51:56.325 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_artop.ko 2024-05-28T05:51:56.325 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atiixp.ko 2024-05-28T05:51:56.325 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atp867x.ko 2024-05-28T05:51:56.326 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd640.ko 2024-05-28T05:51:56.326 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd64x.ko 2024-05-28T05:51:56.326 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cypress.ko 2024-05-28T05:51:56.326 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_efar.ko 2024-05-28T05:51:56.326 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt366.ko 2024-05-28T05:51:56.326 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 38905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt37x.ko 2024-05-28T05:51:56.326 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-28T05:51:56.326 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-28T05:51:56.326 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it8213.ko 2024-05-28T05:51:56.326 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 41281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it821x.ko 2024-05-28T05:51:56.326 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_jmicron.ko 2024-05-28T05:51:56.326 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 60249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_legacy.ko 2024-05-28T05:51:56.326 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_marvell.ko 2024-05-28T05:51:56.327 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_mpiix.ko 2024-05-28T05:51:56.327 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_netcell.ko 2024-05-28T05:51:56.327 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ninja32.ko 2024-05-28T05:51:56.327 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87410.ko 2024-05-28T05:51:56.327 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87415.ko 2024-05-28T05:51:56.327 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_oldpiix.ko 2024-05-28T05:51:56.327 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_opti.ko 2024-05-28T05:51:56.327 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_optidma.ko 2024-05-28T05:51:56.327 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 35137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pcmcia.ko 2024-05-28T05:51:56.327 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 43001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-28T05:51:56.327 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-28T05:51:56.327 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_piccolo.ko 2024-05-28T05:51:56.327 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_radisys.ko 2024-05-28T05:51:56.327 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rdc.ko 2024-05-28T05:51:56.328 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rz1000.ko 2024-05-28T05:51:56.328 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sch.ko 2024-05-28T05:51:56.328 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_serverworks.ko 2024-05-28T05:51:56.328 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 27297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sil680.ko 2024-05-28T05:51:56.328 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sl82c105.ko 2024-05-28T05:51:56.328 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_triflex.ko 2024-05-28T05:51:56.328 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 34953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_via.ko 2024-05-28T05:51:56.328 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pdc_adma.ko 2024-05-28T05:51:56.328 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 34881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_inic162x.ko 2024-05-28T05:51:56.328 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 102113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_mv.ko 2024-05-28T05:51:56.328 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 85401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_nv.ko 2024-05-28T05:51:56.328 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 44305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_promise.ko 2024-05-28T05:51:56.328 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_qstor.ko 2024-05-28T05:51:56.329 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 34017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil.ko 2024-05-28T05:51:56.329 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 45897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil24.ko 2024-05-28T05:51:56.329 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sis.ko 2024-05-28T05:51:56.329 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_svw.ko 2024-05-28T05:51:56.329 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 53345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sx4.ko 2024-05-28T05:51:56.329 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_uli.ko 2024-05-28T05:51:56.329 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 40977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_via.ko 2024-05-28T05:51:56.329 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_vsc.ko 2024-05-28T05:51:56.329 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ 2024-05-28T05:51:56.329 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ks0108.ko 2024-05-28T05:51:56.329 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/ 2024-05-28T05:51:56.329 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 163833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/bcma.ko 2024-05-28T05:51:56.329 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/ 2024-05-28T05:51:56.329 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/ 2024-05-28T05:51:56.330 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 140833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/aoe.ko 2024-05-28T05:51:56.330 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/ 2024-05-28T05:51:56.330 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 1241585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/drbd.ko 2024-05-28T05:51:56.369 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 203281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/floppy.ko 2024-05-28T05:51:56.369 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/ 2024-05-28T05:51:56.369 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 115257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-28T05:51:56.369 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 143425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/nbd.ko 2024-05-28T05:51:56.369 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/ 2024-05-28T05:51:56.369 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 126609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/null_blk.ko 2024-05-28T05:51:56.370 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 119865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/pktcdvd.ko 2024-05-28T05:51:56.370 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 313209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/rbd.ko 2024-05-28T05:51:56.370 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/ 2024-05-28T05:51:56.370 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 117217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-28T05:51:56.370 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/ 2024-05-28T05:51:56.370 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 70369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/zram.ko 2024-05-28T05:51:56.370 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ 2024-05-28T05:51:56.370 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 35353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/applicom.ko 2024-05-28T05:51:56.370 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hangcheck-timer.ko 2024-05-28T05:51:56.370 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/ 2024-05-28T05:51:56.370 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-28T05:51:56.370 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-28T05:51:56.371 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-28T05:51:56.371 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/via-rng.ko 2024-05-28T05:51:56.371 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-28T05:51:56.371 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ 2024-05-28T05:51:56.371 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 37185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-28T05:51:56.371 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 186913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-28T05:51:56.371 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 32449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-28T05:51:56.371 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 179441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-28T05:51:56.371 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 85433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-28T05:51:56.371 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 65305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-28T05:51:56.371 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 43785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/lp.ko 2024-05-28T05:51:56.371 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/ 2024-05-28T05:51:56.371 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 103385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/mwave.ko 2024-05-28T05:51:56.371 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 31761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/nvram.ko 2024-05-28T05:51:56.372 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 38969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ppdev.ko 2024-05-28T05:51:56.372 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 59233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tlclk.ko 2024-05-28T05:51:56.372 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/ 2024-05-28T05:51:56.372 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-28T05:51:56.372 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-05-28T05:51:56.372 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-05-28T05:51:56.372 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 39185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-05-28T05:51:56.372 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 34161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-28T05:51:56.372 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-28T05:51:56.372 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-05-28T05:51:56.372 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/ 2024-05-28T05:51:56.372 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_class.ko 2024-05-28T05:51:56.372 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 62537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_core.ko 2024-05-28T05:51:56.373 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-05-28T05:51:56.373 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/ 2024-05-28T05:51:56.373 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-palmas.ko 2024-05-28T05:51:56.373 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 57281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-si5351.ko 2024-05-28T05:51:56.373 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-twl6040.ko 2024-05-28T05:51:56.373 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-wm831x.ko 2024-05-28T05:51:56.373 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/ 2024-05-28T05:51:56.373 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-28T05:51:56.373 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-28T05:51:56.373 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-28T05:51:56.373 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ 2024-05-28T05:51:56.373 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ 2024-05-28T05:51:56.373 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 89209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-28T05:51:56.373 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 333593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp.ko 2024-05-28T05:51:56.374 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/ 2024-05-28T05:51:56.374 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/ 2024-05-28T05:51:56.374 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/ 2024-05-28T05:51:56.374 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 751433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-28T05:51:56.374 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-05-28T05:51:56.374 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-28T05:51:56.374 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-aes.ko 2024-05-28T05:51:56.374 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-sha.ko 2024-05-28T05:51:56.374 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/ 2024-05-28T05:51:56.374 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 90465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-28T05:51:56.374 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/ 2024-05-28T05:51:56.374 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 36089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/dca.ko 2024-05-28T05:51:56.375 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ 2024-05-28T05:51:56.375 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/ 2024-05-28T05:51:56.375 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-28T05:51:56.375 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ 2024-05-28T05:51:56.375 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 146745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-28T05:51:56.375 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ 2024-05-28T05:51:56.375 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 96137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/amd64_edac.ko 2024-05-28T05:51:56.375 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 41985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/e752x_edac.ko 2024-05-28T05:51:56.375 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 51097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/edac_mce_amd.ko 2024-05-28T05:51:56.375 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3000_edac.ko 2024-05-28T05:51:56.375 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3200_edac.ko 2024-05-28T05:51:56.375 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5100_edac.ko 2024-05-28T05:51:56.375 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5400_edac.ko 2024-05-28T05:51:56.375 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7300_edac.ko 2024-05-28T05:51:56.376 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 64153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7core_edac.ko 2024-05-28T05:51:56.376 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i82975x_edac.ko 2024-05-28T05:51:56.376 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ie31200_edac.ko 2024-05-28T05:51:56.376 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 68689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/sb_edac.ko 2024-05-28T05:51:56.376 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/x38_edac.ko 2024-05-28T05:51:56.376 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/ 2024-05-28T05:51:56.376 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-gpio.ko 2024-05-28T05:51:56.376 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 31361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max14577.ko 2024-05-28T05:51:56.376 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 35593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max77693.ko 2024-05-28T05:51:56.376 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max8997.ko 2024-05-28T05:51:56.376 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 30953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-palmas.ko 2024-05-28T05:51:56.376 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 27193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-rt8973a.ko 2024-05-28T05:51:56.376 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 31985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-sm5502.ko 2024-05-28T05:51:56.376 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/ 2024-05-28T05:51:56.377 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 42945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/dmi-sysfs.ko 2024-05-28T05:51:56.377 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/efi/ 2024-05-28T05:51:56.377 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/efi/efi-pstore.ko 2024-05-28T05:51:56.377 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-28T05:51:56.377 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/ 2024-05-28T05:51:56.377 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-adp5520.ko 2024-05-28T05:51:56.377 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-amd8111.ko 2024-05-28T05:51:56.377 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-arizona.ko 2024-05-28T05:51:56.377 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-da9052.ko 2024-05-28T05:51:56.377 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-da9055.ko 2024-05-28T05:51:56.377 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-dln2.ko 2024-05-28T05:51:56.377 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 81065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-f7188x.ko 2024-05-28T05:51:56.377 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 40753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-generic.ko 2024-05-28T05:51:56.378 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ich.ko 2024-05-28T05:51:56.378 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-05-28T05:51:56.378 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-kempld.ko 2024-05-28T05:51:56.378 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-lp3943.ko 2024-05-28T05:51:56.378 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max7300.ko 2024-05-28T05:51:56.378 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max730x.ko 2024-05-28T05:51:56.378 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max732x.ko 2024-05-28T05:51:56.378 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-05-28T05:51:56.378 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 55497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-pca953x.ko 2024-05-28T05:51:56.378 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 31873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-pcf857x.ko 2024-05-28T05:51:56.378 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-rdc321x.ko 2024-05-28T05:51:56.378 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-sch.ko 2024-05-28T05:51:56.378 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-sch311x.ko 2024-05-28T05:51:56.378 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-tps65912.ko 2024-05-28T05:51:56.379 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-twl4030.ko 2024-05-28T05:51:56.379 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-twl6040.ko 2024-05-28T05:51:56.379 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-28T05:51:56.379 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-vx855.ko 2024-05-28T05:51:56.379 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm831x.ko 2024-05-28T05:51:56.379 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm8350.ko 2024-05-28T05:51:56.379 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm8994.ko 2024-05-28T05:51:56.379 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/ 2024-05-28T05:51:56.379 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-a4tech.ko 2024-05-28T05:51:56.379 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 43545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-apple.ko 2024-05-28T05:51:56.379 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-appleir.ko 2024-05-28T05:51:56.379 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-aureal.ko 2024-05-28T05:51:56.379 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-axff.ko 2024-05-28T05:51:56.380 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-belkin.ko 2024-05-28T05:51:56.380 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cherry.ko 2024-05-28T05:51:56.380 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-chicony.ko 2024-05-28T05:51:56.380 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 74385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cp2112.ko 2024-05-28T05:51:56.380 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cypress.ko 2024-05-28T05:51:56.380 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-dr.ko 2024-05-28T05:51:56.380 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elecom.ko 2024-05-28T05:51:56.380 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elo.ko 2024-05-28T05:51:56.380 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-emsff.ko 2024-05-28T05:51:56.380 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ezkey.ko 2024-05-28T05:51:56.380 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gaff.ko 2024-05-28T05:51:56.380 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-generic.ko 2024-05-28T05:51:56.380 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gt683r.ko 2024-05-28T05:51:56.381 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gyration.ko 2024-05-28T05:51:56.381 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-28T05:51:56.381 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-28T05:51:56.381 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtekff.ko 2024-05-28T05:51:56.381 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-hyperv.ko 2024-05-28T05:51:56.381 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-icade.ko 2024-05-28T05:51:56.381 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kensington.ko 2024-05-28T05:51:56.381 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-keytouch.ko 2024-05-28T05:51:56.381 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kye.ko 2024-05-28T05:51:56.381 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lcpower.ko 2024-05-28T05:51:56.381 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-led.ko 2024-05-28T05:51:56.381 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 54209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lenovo.ko 2024-05-28T05:51:56.381 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 37545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lg-g15.ko 2024-05-28T05:51:56.382 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 67961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-28T05:51:56.382 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 121361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-28T05:51:56.382 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 97929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech.ko 2024-05-28T05:51:56.382 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 36681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-magicmouse.ko 2024-05-28T05:51:56.382 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-microsoft.ko 2024-05-28T05:51:56.382 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-monterey.ko 2024-05-28T05:51:56.382 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 58993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-multitouch.ko 2024-05-28T05:51:56.382 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 39689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ntrig.ko 2024-05-28T05:51:56.382 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ortek.ko 2024-05-28T05:51:56.382 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-penmount.ko 2024-05-28T05:51:56.382 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-petalynx.ko 2024-05-28T05:51:56.382 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 91217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-picolcd.ko 2024-05-28T05:51:56.383 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-pl.ko 2024-05-28T05:51:56.383 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-plantronics.ko 2024-05-28T05:51:56.383 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-primax.ko 2024-05-28T05:51:56.383 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 42881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-rmi.ko 2024-05-28T05:51:56.383 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-28T05:51:56.383 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-common.ko 2024-05-28T05:51:56.383 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 38857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-28T05:51:56.383 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 36297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-28T05:51:56.383 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 38001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-28T05:51:56.383 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-28T05:51:56.383 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 35617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-28T05:51:56.383 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-28T05:51:56.383 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 35417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-28T05:51:56.383 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 35553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-28T05:51:56.384 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-28T05:51:56.384 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 27993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat.ko 2024-05-28T05:51:56.384 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-saitek.ko 2024-05-28T05:51:56.384 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 42297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-samsung.ko 2024-05-28T05:51:56.384 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 43601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-28T05:51:56.384 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sjoy.ko 2024-05-28T05:51:56.384 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 62121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sony.ko 2024-05-28T05:51:56.384 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-speedlink.ko 2024-05-28T05:51:56.384 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 30009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-steelseries.ko 2024-05-28T05:51:56.384 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sunplus.ko 2024-05-28T05:51:56.384 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-28T05:51:56.384 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tivo.ko 2024-05-28T05:51:56.384 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tmff.ko 2024-05-28T05:51:56.385 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-topseed.ko 2024-05-28T05:51:56.385 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-twinhan.ko 2024-05-28T05:51:56.385 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 81097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-uclogic.ko 2024-05-28T05:51:56.385 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-waltop.ko 2024-05-28T05:51:56.385 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 184729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-wiimote.ko 2024-05-28T05:51:56.385 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-xinmo.ko 2024-05-28T05:51:56.385 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zpff.ko 2024-05-28T05:51:56.385 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zydacron.ko 2024-05-28T05:51:56.385 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 319897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid.ko 2024-05-28T05:51:56.385 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 39521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/uhid.ko 2024-05-28T05:51:56.385 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/ 2024-05-28T05:51:56.385 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 153617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbhid.ko 2024-05-28T05:51:56.385 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbkbd.ko 2024-05-28T05:51:56.386 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbmouse.ko 2024-05-28T05:51:56.386 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 261929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/wacom.ko 2024-05-28T05:51:56.386 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/ 2024-05-28T05:51:56.386 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 75057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_balloon.ko 2024-05-28T05:51:56.386 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 110657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_utils.ko 2024-05-28T05:51:56.386 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 381625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_vmbus.ko 2024-05-28T05:51:56.386 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ 2024-05-28T05:51:56.386 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 77145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru.ko 2024-05-28T05:51:56.386 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 67001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru3.ko 2024-05-28T05:51:56.386 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 42241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-28T05:51:56.386 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7414.ko 2024-05-28T05:51:56.386 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7418.ko 2024-05-28T05:51:56.386 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adc128d818.ko 2024-05-28T05:51:56.387 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 38089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1025.ko 2024-05-28T05:51:56.387 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 115049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1026.ko 2024-05-28T05:51:56.387 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1029.ko 2024-05-28T05:51:56.387 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 55217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1031.ko 2024-05-28T05:51:56.387 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 31433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm9240.ko 2024-05-28T05:51:56.387 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ads7828.ko 2024-05-28T05:51:56.387 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7410.ko 2024-05-28T05:51:56.387 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7411.ko 2024-05-28T05:51:56.387 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 89017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7462.ko 2024-05-28T05:51:56.387 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 49145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7470.ko 2024-05-28T05:51:56.387 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 81465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7475.ko 2024-05-28T05:51:56.387 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7x10.ko 2024-05-28T05:51:56.387 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 48169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/amc6821.ko 2024-05-28T05:51:56.388 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 68857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/applesmc.ko 2024-05-28T05:51:56.388 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 60185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asb100.ko 2024-05-28T05:51:56.388 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 69001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asc7621.ko 2024-05-28T05:51:56.388 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 47969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-28T05:51:56.388 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/atxp1.ko 2024-05-28T05:51:56.388 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/coretemp.ko 2024-05-28T05:51:56.388 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/da9052-hwmon.ko 2024-05-28T05:51:56.388 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/da9055-hwmon.ko 2024-05-28T05:51:56.388 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 55705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-28T05:51:56.388 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 113129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dme1737.ko 2024-05-28T05:51:56.388 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds1621.ko 2024-05-28T05:51:56.388 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds620.ko 2024-05-28T05:51:56.388 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc1403.ko 2024-05-28T05:51:56.388 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 40169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc2103.ko 2024-05-28T05:51:56.389 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 34641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc6w201.ko 2024-05-28T05:51:56.389 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 78913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71805f.ko 2024-05-28T05:51:56.389 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 108953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71882fg.ko 2024-05-28T05:51:56.389 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 50689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f75375s.ko 2024-05-28T05:51:56.389 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fam15h_power.ko 2024-05-28T05:51:56.389 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 65761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fschmd.ko 2024-05-28T05:51:56.389 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g760a.ko 2024-05-28T05:51:56.389 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 30577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g762.ko 2024-05-28T05:51:56.389 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 59753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl518sm.ko 2024-05-28T05:51:56.389 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 56305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl520sm.ko 2024-05-28T05:51:56.389 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hih6130.ko 2024-05-28T05:51:56.389 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-28T05:51:56.389 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5500_temp.ko 2024-05-28T05:51:56.390 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 27625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5k_amb.ko 2024-05-28T05:51:56.390 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 42577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmaem.ko 2024-05-28T05:51:56.390 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmpex.ko 2024-05-28T05:51:56.390 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina209.ko 2024-05-28T05:51:56.390 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 32161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina2xx.ko 2024-05-28T05:51:56.390 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 156457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/it87.ko 2024-05-28T05:51:56.390 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/jc42.ko 2024-05-28T05:51:56.390 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k10temp.ko 2024-05-28T05:51:56.390 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k8temp.ko 2024-05-28T05:51:56.390 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lineage-pem.ko 2024-05-28T05:51:56.390 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 57761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm63.ko 2024-05-28T05:51:56.390 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm73.ko 2024-05-28T05:51:56.390 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 44113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm75.ko 2024-05-28T05:51:56.391 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm77.ko 2024-05-28T05:51:56.391 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 41465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm78.ko 2024-05-28T05:51:56.391 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 37041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm80.ko 2024-05-28T05:51:56.391 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm83.ko 2024-05-28T05:51:56.391 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 86489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm85.ko 2024-05-28T05:51:56.391 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 55633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm87.ko 2024-05-28T05:51:56.391 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 76481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm90.ko 2024-05-28T05:51:56.391 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm92.ko 2024-05-28T05:51:56.391 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 131497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm93.ko 2024-05-28T05:51:56.391 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 40217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95234.ko 2024-05-28T05:51:56.391 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95241.ko 2024-05-28T05:51:56.391 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95245.ko 2024-05-28T05:51:56.391 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc2945.ko 2024-05-28T05:51:56.391 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4151.ko 2024-05-28T05:51:56.392 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4215.ko 2024-05-28T05:51:56.392 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4222.ko 2024-05-28T05:51:56.392 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4245.ko 2024-05-28T05:51:56.392 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4260.ko 2024-05-28T05:51:56.392 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4261.ko 2024-05-28T05:51:56.392 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 36761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max16065.ko 2024-05-28T05:51:56.392 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1619.ko 2024-05-28T05:51:56.392 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1668.ko 2024-05-28T05:51:56.392 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max197.ko 2024-05-28T05:51:56.392 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 32497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6639.ko 2024-05-28T05:51:56.392 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 27297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6650.ko 2024-05-28T05:51:56.392 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 39721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6697.ko 2024-05-28T05:51:56.392 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mc13783-adc.ko 2024-05-28T05:51:56.393 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mcp3021.ko 2024-05-28T05:51:56.393 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-05-28T05:51:56.393 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 56497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6683.ko 2024-05-28T05:51:56.393 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 141345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775-core.ko 2024-05-28T05:51:56.393 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 72729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775.ko 2024-05-28T05:51:56.393 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 67769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct7802.ko 2024-05-28T05:51:56.393 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 97769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87360.ko 2024-05-28T05:51:56.393 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 61913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87427.ko 2024-05-28T05:51:56.393 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pcf8591.ko 2024-05-28T05:51:56.393 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ 2024-05-28T05:51:56.393 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-28T05:51:56.393 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-28T05:51:56.393 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-28T05:51:56.393 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-28T05:51:56.394 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-28T05:51:56.394 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-28T05:51:56.394 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-28T05:51:56.394 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 101225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-28T05:51:56.394 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-28T05:51:56.394 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 36169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-28T05:51:56.394 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-28T05:51:56.394 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-28T05:51:56.394 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/powr1220.ko 2024-05-28T05:51:56.394 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5627.ko 2024-05-28T05:51:56.394 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 32937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5636.ko 2024-05-28T05:51:56.394 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 34553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-28T05:51:56.394 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 40841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht15.ko 2024-05-28T05:51:56.395 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht21.ko 2024-05-28T05:51:56.395 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/shtc1.ko 2024-05-28T05:51:56.395 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 48705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sis5595.ko 2024-05-28T05:51:56.395 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47b397.ko 2024-05-28T05:51:56.395 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 46465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m1.ko 2024-05-28T05:51:56.395 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 44305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m192.ko 2024-05-28T05:51:56.395 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 31409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/thmc50.ko 2024-05-28T05:51:56.395 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp102.ko 2024-05-28T05:51:56.395 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp103.ko 2024-05-28T05:51:56.395 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp401.ko 2024-05-28T05:51:56.395 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp421.ko 2024-05-28T05:51:56.395 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via-cputemp.ko 2024-05-28T05:51:56.395 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 50209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via686a.ko 2024-05-28T05:51:56.396 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 59657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt1211.ko 2024-05-28T05:51:56.396 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 62729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt8231.ko 2024-05-28T05:51:56.396 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 71161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627ehf.ko 2024-05-28T05:51:56.396 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 96569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627hf.ko 2024-05-28T05:51:56.396 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 85905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83781d.ko 2024-05-28T05:51:56.396 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 75121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83791d.ko 2024-05-28T05:51:56.396 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 83417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83792d.ko 2024-05-28T05:51:56.396 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 116769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83793.ko 2024-05-28T05:51:56.396 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 134433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83795.ko 2024-05-28T05:51:56.396 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l785ts.ko 2024-05-28T05:51:56.396 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 43377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l786ng.ko 2024-05-28T05:51:56.396 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-05-28T05:51:56.396 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-05-28T05:51:56.397 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/ 2024-05-28T05:51:56.397 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/ 2024-05-28T05:51:56.397 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 27345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-28T05:51:56.397 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-28T05:51:56.397 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/ 2024-05-28T05:51:56.397 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-05-28T05:51:56.397 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 35065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-05-28T05:51:56.397 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 32897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-05-28T05:51:56.397 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-28T05:51:56.397 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 30353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-28T05:51:56.397 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-28T05:51:56.397 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-05-28T05:51:56.397 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 7721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-28T05:51:56.397 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-05-28T05:51:56.398 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 64217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-28T05:51:56.398 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-28T05:51:56.398 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-28T05:51:56.398 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-28T05:51:56.398 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-05-28T05:51:56.398 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-05-28T05:51:56.398 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 76961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-28T05:51:56.398 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-28T05:51:56.398 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 52929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-28T05:51:56.398 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-05-28T05:51:56.398 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-28T05:51:56.398 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-28T05:51:56.398 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-05-28T05:51:56.399 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 30041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-28T05:51:56.399 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-28T05:51:56.399 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 57209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-28T05:51:56.399 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-05-28T05:51:56.399 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-28T05:51:56.399 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-28T05:51:56.399 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-05-28T05:51:56.399 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 32577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-05-28T05:51:56.399 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-28T05:51:56.399 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-05-28T05:51:56.399 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-28T05:51:56.399 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-28T05:51:56.399 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-28T05:51:56.400 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-28T05:51:56.400 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 59121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-05-28T05:51:56.400 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 27841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-mux.ko 2024-05-28T05:51:56.400 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-smbus.ko 2024-05-28T05:51:56.400 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-stub.ko 2024-05-28T05:51:56.400 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/ 2024-05-28T05:51:56.400 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-05-28T05:51:56.400 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-05-28T05:51:56.400 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 36561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-05-28T05:51:56.400 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ 2024-05-28T05:51:56.400 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ 2024-05-28T05:51:56.400 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 329681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-28T05:51:56.400 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 1119785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_core.ko 2024-05-28T05:51:56.400 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 83897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-28T05:51:56.401 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 408329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-28T05:51:56.401 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 120905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-28T05:51:56.401 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 347201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-28T05:51:56.401 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 84937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-28T05:51:56.401 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ 2024-05-28T05:51:56.401 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/ 2024-05-28T05:51:56.401 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 590873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-28T05:51:56.401 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/ 2024-05-28T05:51:56.401 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 514577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-28T05:51:56.401 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/ 2024-05-28T05:51:56.401 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 911649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-28T05:51:56.401 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ 2024-05-28T05:51:56.401 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 375449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-28T05:51:56.401 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ocrdma/ 2024-05-28T05:51:56.402 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 197097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-05-28T05:51:56.402 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/usnic/ 2024-05-28T05:51:56.402 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 212497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-05-28T05:51:56.402 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ 2024-05-28T05:51:56.402 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ 2024-05-28T05:51:56.402 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 334353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-28T05:51:56.402 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ 2024-05-28T05:51:56.402 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 120649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-28T05:51:56.402 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ 2024-05-28T05:51:56.402 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 132577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-28T05:51:56.402 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ 2024-05-28T05:51:56.402 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 157929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-28T05:51:56.403 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ 2024-05-28T05:51:56.403 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 156665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-28T05:51:56.403 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/ 2024-05-28T05:51:56.403 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/evbug.ko 2024-05-28T05:51:56.403 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 27601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/ff-memless.ko 2024-05-28T05:51:56.403 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/ 2024-05-28T05:51:56.403 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-28T05:51:56.403 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-28T05:51:56.403 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 50705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/gameport.ko 2024-05-28T05:51:56.403 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 49433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/joydev.ko 2024-05-28T05:51:56.403 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/ 2024-05-28T05:51:56.403 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-05-28T05:51:56.403 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 36201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-05-28T05:51:56.403 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 35657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-05-28T05:51:56.404 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-05-28T05:51:56.404 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 45465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-28T05:51:56.404 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-05-28T05:51:56.404 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lkkbd.ko 2024-05-28T05:51:56.404 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 31849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lm8323.ko 2024-05-28T05:51:56.404 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lm8333.ko 2024-05-28T05:51:56.404 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-05-28T05:51:56.404 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-05-28T05:51:56.404 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-05-28T05:51:56.404 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-05-28T05:51:56.404 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/newtonkbd.ko 2024-05-28T05:51:56.404 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-05-28T05:51:56.404 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/qt1070.ko 2024-05-28T05:51:56.405 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/qt2160.ko 2024-05-28T05:51:56.405 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-05-28T05:51:56.405 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/stowaway.ko 2024-05-28T05:51:56.405 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/sunkbd.ko 2024-05-28T05:51:56.405 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-05-28T05:51:56.405 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-05-28T05:51:56.405 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-05-28T05:51:56.405 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/xtkbd.ko 2024-05-28T05:51:56.405 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/matrix-keymap.ko 2024-05-28T05:51:56.405 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/ 2024-05-28T05:51:56.405 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 40609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/appletouch.ko 2024-05-28T05:51:56.405 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 39545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/bcm5974.ko 2024-05-28T05:51:56.405 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 159993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/cyapatp.ko 2024-05-28T05:51:56.405 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 114193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-28T05:51:56.406 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/gpio_mouse.ko 2024-05-28T05:51:56.406 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 428121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/psmouse.ko 2024-05-28T05:51:56.406 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/sermouse.ko 2024-05-28T05:51:56.406 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 27857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-28T05:51:56.406 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 27185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-28T05:51:56.406 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-28T05:51:56.406 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/ 2024-05-28T05:51:56.406 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 140921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-28T05:51:56.406 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ 2024-05-28T05:51:56.406 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/altera_ps2.ko 2024-05-28T05:51:56.406 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/arc_ps2.ko 2024-05-28T05:51:56.406 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ct82c710.ko 2024-05-28T05:51:56.407 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-28T05:51:56.407 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/parkbd.ko 2024-05-28T05:51:56.407 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/pcips2.ko 2024-05-28T05:51:56.407 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ps2mult.ko 2024-05-28T05:51:56.407 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serio_raw.ko 2024-05-28T05:51:56.407 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serport.ko 2024-05-28T05:51:56.407 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/sparse-keymap.ko 2024-05-28T05:51:56.407 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/ 2024-05-28T05:51:56.407 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-88pm860x.ko 2024-05-28T05:51:56.407 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-adp5520.ko 2024-05-28T05:51:56.407 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 77193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-bd2802.ko 2024-05-28T05:51:56.407 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 31089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-blinkm.ko 2024-05-28T05:51:56.407 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-da903x.ko 2024-05-28T05:51:56.408 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-da9052.ko 2024-05-28T05:51:56.408 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-gpio.ko 2024-05-28T05:51:56.408 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3530.ko 2024-05-28T05:51:56.408 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 36697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3533.ko 2024-05-28T05:51:56.408 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm355x.ko 2024-05-28T05:51:56.408 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3642.ko 2024-05-28T05:51:56.408 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp3944.ko 2024-05-28T05:51:56.408 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp8788.ko 2024-05-28T05:51:56.408 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-max8997.ko 2024-05-28T05:51:56.408 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-mc13783.ko 2024-05-28T05:51:56.408 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-menf21bmc.ko 2024-05-28T05:51:56.408 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca9532.ko 2024-05-28T05:51:56.408 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca955x.ko 2024-05-28T05:51:56.409 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca963x.ko 2024-05-28T05:51:56.409 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 38105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-ss4200.ko 2024-05-28T05:51:56.409 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-tca6507.ko 2024-05-28T05:51:56.409 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-wm831x-status.ko 2024-05-28T05:51:56.409 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-wm8350.ko 2024-05-28T05:51:56.409 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ 2024-05-28T05:51:56.409 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-28T05:51:56.409 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-28T05:51:56.409 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-28T05:51:56.409 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 8633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-28T05:51:56.409 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-28T05:51:56.409 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-28T05:51:56.409 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-28T05:51:56.409 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-28T05:51:56.410 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-28T05:51:56.410 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/ 2024-05-28T05:51:56.410 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/ 2024-05-28T05:51:56.410 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 790665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/bcache.ko 2024-05-28T05:51:56.410 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 49065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bio-prison.ko 2024-05-28T05:51:56.410 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 116817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bufio.ko 2024-05-28T05:51:56.410 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 58273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache-smq.ko 2024-05-28T05:51:56.410 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 199017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache.ko 2024-05-28T05:51:56.410 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 134937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-crypt.ko 2024-05-28T05:51:56.410 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-delay.ko 2024-05-28T05:51:56.410 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 67489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-era.ko 2024-05-28T05:51:56.410 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-flakey.ko 2024-05-28T05:51:56.410 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 50441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log-userspace.ko 2024-05-28T05:51:56.411 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 41137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log.ko 2024-05-28T05:51:56.411 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 60969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-mirror.ko 2024-05-28T05:51:56.411 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 97193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-multipath.ko 2024-05-28T05:51:56.411 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-queue-length.ko 2024-05-28T05:51:56.411 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 85681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-raid.ko 2024-05-28T05:51:56.411 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 44281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-region-hash.ko 2024-05-28T05:51:56.411 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-round-robin.ko 2024-05-28T05:51:56.411 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-service-time.ko 2024-05-28T05:51:56.411 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 139793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-snapshot.ko 2024-05-28T05:51:56.411 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-switch.ko 2024-05-28T05:51:56.411 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 234441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-thin-pool.ko 2024-05-28T05:51:56.411 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 66417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-verity.ko 2024-05-28T05:51:56.411 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-zero.ko 2024-05-28T05:51:56.411 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/ 2024-05-28T05:51:56.412 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 264273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-28T05:51:56.412 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 43129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid0.ko 2024-05-28T05:51:56.412 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 124705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid1.ko 2024-05-28T05:51:56.412 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 157673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid10.ko 2024-05-28T05:51:56.412 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 444649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid456.ko 2024-05-28T05:51:56.412 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/ 2024-05-28T05:51:56.412 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/ 2024-05-28T05:51:56.412 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 214833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptbase.ko 2024-05-28T05:51:56.412 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 77977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptctl.ko 2024-05-28T05:51:56.412 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 54777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptfc.ko 2024-05-28T05:51:56.412 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 44625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptlan.ko 2024-05-28T05:51:56.412 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 150753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptsas.ko 2024-05-28T05:51:56.412 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 97209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptscsih.ko 2024-05-28T05:51:56.455 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 63865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptspi.ko 2024-05-28T05:51:56.455 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/ 2024-05-28T05:51:56.456 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm800.ko 2024-05-28T05:51:56.456 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm805.ko 2024-05-28T05:51:56.456 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm80x.ko 2024-05-28T05:51:56.456 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/arizona-i2c.ko 2024-05-28T05:51:56.456 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 148545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/arizona.ko 2024-05-28T05:51:56.456 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/bcm590xx.ko 2024-05-28T05:51:56.456 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/cros_ec_dev.ko 2024-05-28T05:51:56.456 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 41001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/dln2.ko 2024-05-28T05:51:56.456 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/janz-cmodio.ko 2024-05-28T05:51:56.456 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 59081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/kempld-core.ko 2024-05-28T05:51:56.456 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 31889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lm3533-core.ko 2024-05-28T05:51:56.456 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-05-28T05:51:56.457 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lp3943.ko 2024-05-28T05:51:56.457 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 60489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_ich.ko 2024-05-28T05:51:56.457 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_sch.ko 2024-05-28T05:51:56.457 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/max8907.ko 2024-05-28T05:51:56.457 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 35529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mc13xxx-core.ko 2024-05-28T05:51:56.457 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-05-28T05:51:56.457 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/menf21bmc.ko 2024-05-28T05:51:56.457 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633-adc.ko 2024-05-28T05:51:56.457 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633-gpio.ko 2024-05-28T05:51:56.457 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 42281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633.ko 2024-05-28T05:51:56.457 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-05-28T05:51:56.457 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/retu-mfd.ko 2024-05-28T05:51:56.457 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 99409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/si476x-core.ko 2024-05-28T05:51:56.458 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 58049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/sm501.ko 2024-05-28T05:51:56.458 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 60673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/tps65010.ko 2024-05-28T05:51:56.458 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/tps6507x.ko 2024-05-28T05:51:56.458 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/viperboard.ko 2024-05-28T05:51:56.458 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/vx855.ko 2024-05-28T05:51:56.458 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wl1273-core.ko 2024-05-28T05:51:56.458 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 52345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wm8994.ko 2024-05-28T05:51:56.458 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ 2024-05-28T05:51:56.458 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-05-28T05:51:56.458 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 64257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ad525x_dpot.ko 2024-05-28T05:51:56.458 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/ 2024-05-28T05:51:56.458 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 57497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-28T05:51:56.458 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds9802als.ko 2024-05-28T05:51:56.459 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 47681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds990x.ko 2024-05-28T05:51:56.459 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 58625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/bh1770glc.ko 2024-05-28T05:51:56.459 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/ 2024-05-28T05:51:56.459 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-05-28T05:51:56.459 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 47441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/core.ko 2024-05-28T05:51:56.459 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/ 2024-05-28T05:51:56.459 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/cb710.ko 2024-05-28T05:51:56.459 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ds1682.ko 2024-05-28T05:51:56.459 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/dummy-irq.ko 2024-05-28T05:51:56.459 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/echo/ 2024-05-28T05:51:56.459 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/echo/echo.ko 2024-05-28T05:51:56.459 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/ 2024-05-28T05:51:56.459 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 42921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/at24.ko 2024-05-28T05:51:56.459 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-28T05:51:56.460 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/max6875.ko 2024-05-28T05:51:56.460 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 41177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/enclosure.ko 2024-05-28T05:51:56.460 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/genwqe/ 2024-05-28T05:51:56.460 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 191617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-05-28T05:51:56.460 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hmc6352.ko 2024-05-28T05:51:56.460 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 37753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hpilo.ko 2024-05-28T05:51:56.460 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ibmasm/ 2024-05-28T05:51:56.460 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 92289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-05-28T05:51:56.460 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ics932s401.ko 2024-05-28T05:51:56.460 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29003.ko 2024-05-28T05:51:56.460 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29020.ko 2024-05-28T05:51:56.460 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/ 2024-05-28T05:51:56.460 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 54857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-28T05:51:56.460 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-28T05:51:56.461 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/ 2024-05-28T05:51:56.461 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 154257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-me.ko 2024-05-28T05:51:56.461 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 69793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-txe.ko 2024-05-28T05:51:56.461 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 388977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei.ko 2024-05-28T05:51:56.461 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 37953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/phantom.ko 2024-05-28T05:51:56.461 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ti-st/ 2024-05-28T05:51:56.461 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 91129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ti-st/st_drv.ko 2024-05-28T05:51:56.461 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_7xx1.ko 2024-05-28T05:51:56.461 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 34449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_core.ko 2024-05-28T05:51:56.461 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tsl2550.ko 2024-05-28T05:51:56.461 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 55785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_balloon.ko 2024-05-28T05:51:56.461 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/ 2024-05-28T05:51:56.461 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 234849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-28T05:51:56.462 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ 2024-05-28T05:51:56.462 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/ 2024-05-28T05:51:56.462 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 620849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/bonding.ko 2024-05-28T05:51:56.462 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/ 2024-05-28T05:51:56.462 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/ 2024-05-28T05:51:56.462 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 139745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-28T05:51:56.462 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 49529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-28T05:51:56.462 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-28T05:51:56.462 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/ 2024-05-28T05:51:56.462 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 589537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-28T05:51:56.462 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dummy.ko 2024-05-28T05:51:56.462 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/eql.ko 2024-05-28T05:51:56.462 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ 2024-05-28T05:51:56.463 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/ 2024-05-28T05:51:56.463 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 53745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-28T05:51:56.463 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 49193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-28T05:51:56.463 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 158641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-28T05:51:56.463 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 85945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-28T05:51:56.463 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ 2024-05-28T05:51:56.463 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 44153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-28T05:51:56.463 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 73857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-28T05:51:56.463 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-28T05:51:56.463 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 109513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-28T05:51:56.463 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/ 2024-05-28T05:51:56.463 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 64697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-28T05:51:56.463 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/ 2024-05-28T05:51:56.464 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 84321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-28T05:51:56.464 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/ 2024-05-28T05:51:56.464 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 70729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-28T05:51:56.464 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/ 2024-05-28T05:51:56.464 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 52681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-28T05:51:56.464 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/ 2024-05-28T05:51:56.464 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 65785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-28T05:51:56.464 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 56049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-28T05:51:56.464 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 115873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-28T05:51:56.464 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/ 2024-05-28T05:51:56.464 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/ 2024-05-28T05:51:56.464 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 124481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-28T05:51:56.464 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-05-28T05:51:56.464 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 128393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-28T05:51:56.465 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-05-28T05:51:56.465 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 110321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-28T05:51:56.465 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/ 2024-05-28T05:51:56.465 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 101849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-28T05:51:56.465 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 88945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-28T05:51:56.465 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/ 2024-05-28T05:51:56.465 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 105625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-28T05:51:56.465 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 228977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-28T05:51:56.465 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-05-28T05:51:56.465 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 1733297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-28T05:51:56.465 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 167177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-28T05:51:56.465 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/ 2024-05-28T05:51:56.465 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 164249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-28T05:51:56.466 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 440553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-28T05:51:56.466 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/ 2024-05-28T05:51:56.466 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/ 2024-05-28T05:51:56.466 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 432145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-28T05:51:56.466 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/ 2024-05-28T05:51:56.466 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-05-28T05:51:56.466 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 257145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-28T05:51:56.466 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-05-28T05:51:56.466 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 446057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-28T05:51:56.466 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-05-28T05:51:56.466 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 1311193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-28T05:51:56.466 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-05-28T05:51:56.466 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 206673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-28T05:51:56.467 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-05-28T05:51:56.467 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 40145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-28T05:51:56.467 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/ 2024-05-28T05:51:56.467 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/ 2024-05-28T05:51:56.467 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 269249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-28T05:51:56.467 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/ 2024-05-28T05:51:56.467 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/ 2024-05-28T05:51:56.467 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 85377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-28T05:51:56.467 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 77449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-28T05:51:56.467 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 169041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-28T05:51:56.467 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 65905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-28T05:51:56.467 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 76201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-28T05:51:56.467 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 38057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-28T05:51:56.467 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/ 2024-05-28T05:51:56.468 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 75937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-28T05:51:56.468 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 78697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-28T05:51:56.468 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 52305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dnet.ko 2024-05-28T05:51:56.468 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 30401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ec_bhf.ko 2024-05-28T05:51:56.468 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/ 2024-05-28T05:51:56.468 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/ 2024-05-28T05:51:56.468 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 356353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-28T05:51:56.468 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 61729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ethoc.ko 2024-05-28T05:51:56.468 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 63177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fealnx.ko 2024-05-28T05:51:56.468 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fujitsu/ 2024-05-28T05:51:56.468 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 51505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-05-28T05:51:56.468 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ 2024-05-28T05:51:56.468 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 115561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-28T05:51:56.469 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/ 2024-05-28T05:51:56.469 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 366193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-28T05:51:56.469 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/ 2024-05-28T05:51:56.469 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 755673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-28T05:51:56.469 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/ 2024-05-28T05:51:56.469 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 324513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-28T05:51:56.469 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/ 2024-05-28T05:51:56.469 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 1196201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-28T05:51:56.469 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/ 2024-05-28T05:51:56.469 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 362609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-28T05:51:56.469 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/ 2024-05-28T05:51:56.469 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 672313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-28T05:51:56.469 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/ 2024-05-28T05:51:56.470 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 121513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-28T05:51:56.470 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-05-28T05:51:56.470 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 966601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-28T05:51:56.470 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-05-28T05:51:56.470 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 193465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-28T05:51:56.470 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 108625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/jme.ko 2024-05-28T05:51:56.470 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/ 2024-05-28T05:51:56.470 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-28T05:51:56.470 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 126873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-28T05:51:56.470 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 150769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-28T05:51:56.470 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/ 2024-05-28T05:51:56.470 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-05-28T05:51:56.470 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 904929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-28T05:51:56.470 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 344089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-28T05:51:56.471 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-05-28T05:51:56.471 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-05-28T05:51:56.471 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 1413529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-28T05:51:56.471 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ 2024-05-28T05:51:56.471 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 65905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-05-28T05:51:56.471 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 54217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-05-28T05:51:56.471 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-05-28T05:51:56.471 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 117345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-28T05:51:56.471 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/ 2024-05-28T05:51:56.471 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-05-28T05:51:56.471 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 131353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-28T05:51:56.471 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ 2024-05-28T05:51:56.471 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 91457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-28T05:51:56.472 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 56681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-28T05:51:56.472 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/ 2024-05-28T05:51:56.472 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 181201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-28T05:51:56.472 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/ 2024-05-28T05:51:56.472 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 171409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-28T05:51:56.472 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/ 2024-05-28T05:51:56.472 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 58241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-28T05:51:56.472 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 50113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-28T05:51:56.472 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/ 2024-05-28T05:51:56.472 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-05-28T05:51:56.472 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 300793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-28T05:51:56.472 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 105681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-28T05:51:56.472 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-05-28T05:51:56.472 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 885057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-28T05:51:56.473 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/ 2024-05-28T05:51:56.473 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 52297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-28T05:51:56.473 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/ 2024-05-28T05:51:56.473 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 81633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-28T05:51:56.473 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 100681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-28T05:51:56.473 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 34065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-28T05:51:56.473 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 264145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-28T05:51:56.473 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/ 2024-05-28T05:51:56.473 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-05-28T05:51:56.473 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 142401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-05-28T05:51:56.473 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/ 2024-05-28T05:51:56.473 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 1350201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-28T05:51:56.473 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/ 2024-05-28T05:51:56.474 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 57945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-28T05:51:56.474 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/ 2024-05-28T05:51:56.474 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 66497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-28T05:51:56.474 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 80057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-28T05:51:56.474 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/ 2024-05-28T05:51:56.474 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 74281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-28T05:51:56.474 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 79449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-28T05:51:56.474 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 100777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-28T05:51:56.474 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 83433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-28T05:51:56.474 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/ 2024-05-28T05:51:56.474 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-05-28T05:51:56.474 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-05-28T05:51:56.474 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 46977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-28T05:51:56.474 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-05-28T05:51:56.475 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 644329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-28T05:51:56.475 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/ 2024-05-28T05:51:56.475 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 128489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-28T05:51:56.475 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 207985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-28T05:51:56.475 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 82625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-28T05:51:56.475 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 91345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-28T05:51:56.475 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/ 2024-05-28T05:51:56.475 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 59793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-28T05:51:56.475 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/ 2024-05-28T05:51:56.475 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 110721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-28T05:51:56.475 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/ 2024-05-28T05:51:56.475 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 98681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-28T05:51:56.475 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 102505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-28T05:51:56.476 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/ 2024-05-28T05:51:56.476 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 61489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-28T05:51:56.476 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 40601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-28T05:51:56.476 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/ 2024-05-28T05:51:56.476 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 69905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-28T05:51:56.476 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/ 2024-05-28T05:51:56.476 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 49441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/defxx.ko 2024-05-28T05:51:56.476 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/skfp/ 2024-05-28T05:51:56.476 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 275713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/skfp/skfp.ko 2024-05-28T05:51:56.476 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 91665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/geneve.ko 2024-05-28T05:51:56.476 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/ 2024-05-28T05:51:56.476 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 290441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-28T05:51:56.476 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/ 2024-05-28T05:51:56.476 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-28T05:51:56.477 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ifb.ko 2024-05-28T05:51:56.477 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ 2024-05-28T05:51:56.477 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 108313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-28T05:51:56.477 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 78057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvlan.ko 2024-05-28T05:51:56.477 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvtap.ko 2024-05-28T05:51:56.477 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/ 2024-05-28T05:51:56.477 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-28T05:51:56.477 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-28T05:51:56.477 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-gpio.ko 2024-05-28T05:51:56.477 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-28T05:51:56.477 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio.ko 2024-05-28T05:51:56.477 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mii.ko 2024-05-28T05:51:56.477 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 62673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/netconsole.ko 2024-05-28T05:51:56.478 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/nlmon.ko 2024-05-28T05:51:56.478 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/ 2024-05-28T05:51:56.478 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-28T05:51:56.478 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 48233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-28T05:51:56.478 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ 2024-05-28T05:51:56.478 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/amd.ko 2024-05-28T05:51:56.478 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 61977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-28T05:51:56.478 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 52857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-28T05:51:56.478 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm87xx.ko 2024-05-28T05:51:56.478 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 53401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/broadcom.ko 2024-05-28T05:51:56.478 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/cicada.ko 2024-05-28T05:51:56.478 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/davicom.ko 2024-05-28T05:51:56.478 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/et1011c.ko 2024-05-28T05:51:56.478 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 31305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/icplus.ko 2024-05-28T05:51:56.479 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/lxt.ko 2024-05-28T05:51:56.479 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 103369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/marvell.ko 2024-05-28T05:51:56.479 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 96017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/micrel.ko 2024-05-28T05:51:56.479 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/national.ko 2024-05-28T05:51:56.479 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 121097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/phylink.ko 2024-05-28T05:51:56.479 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/qsemi.ko 2024-05-28T05:51:56.479 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 62105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/realtek.ko 2024-05-28T05:51:56.479 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 35505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/smsc.ko 2024-05-28T05:51:56.479 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ste10Xp.ko 2024-05-28T05:51:56.479 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/vitesse.ko 2024-05-28T05:51:56.479 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/plip/ 2024-05-28T05:51:56.479 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 55345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/plip/plip.ko 2024-05-28T05:51:56.479 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ 2024-05-28T05:51:56.479 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-28T05:51:56.480 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 36265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_async.ko 2024-05-28T05:51:56.480 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-28T05:51:56.480 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-28T05:51:56.480 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 35361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-28T05:51:56.480 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 53225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppoe.ko 2024-05-28T05:51:56.480 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppox.ko 2024-05-28T05:51:56.480 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 40073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pptp.ko 2024-05-28T05:51:56.480 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 35929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sb1000.ko 2024-05-28T05:51:56.480 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/ 2024-05-28T05:51:56.480 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 52065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slip.ko 2024-05-28T05:51:56.480 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 42401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sungem_phy.ko 2024-05-28T05:51:56.480 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 80153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tap.ko 2024-05-28T05:51:56.480 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/ 2024-05-28T05:51:56.480 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 137313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team.ko 2024-05-28T05:51:56.481 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-28T05:51:56.481 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-28T05:51:56.481 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 36201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-28T05:51:56.481 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_random.ko 2024-05-28T05:51:56.481 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-28T05:51:56.481 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 108081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/veth.ko 2024-05-28T05:51:56.481 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/ 2024-05-28T05:51:56.481 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 176481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-28T05:51:56.481 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/ 2024-05-28T05:51:56.481 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 384329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/vxlan.ko 2024-05-28T05:51:56.481 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/ 2024-05-28T05:51:56.481 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 175513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-28T05:51:56.481 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ 2024-05-28T05:51:56.482 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ntb.ko 2024-05-28T05:51:56.482 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/ 2024-05-28T05:51:56.482 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/ 2024-05-28T05:51:56.482 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 335489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme-core.ko 2024-05-28T05:51:56.482 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 127497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme.ko 2024-05-28T05:51:56.482 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/ 2024-05-28T05:51:56.482 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 168113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport.ko 2024-05-28T05:51:56.482 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_cs.ko 2024-05-28T05:51:56.482 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 103881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_pc.ko 2024-05-28T05:51:56.482 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 30305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_serial.ko 2024-05-28T05:51:56.482 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/ 2024-05-28T05:51:56.482 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/ 2024-05-28T05:51:56.482 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-28T05:51:56.483 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-05-28T05:51:56.483 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-05-28T05:51:56.483 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pci-stub.ko 2024-05-28T05:51:56.483 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 55321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/xen-pcifront.ko 2024-05-28T05:51:56.483 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/ 2024-05-28T05:51:56.483 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 31457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/i82092.ko 2024-05-28T05:51:56.483 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 179937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia.ko 2024-05-28T05:51:56.483 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 78145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia_core.ko 2024-05-28T05:51:56.483 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 41929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-05-28T05:51:56.483 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 40449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pd6729.ko 2024-05-28T05:51:56.483 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 133745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-28T05:51:56.483 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/ 2024-05-28T05:51:56.483 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/broadcom/ 2024-05-28T05:51:56.483 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-05-28T05:51:56.484 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/samsung/ 2024-05-28T05:51:56.484 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-05-28T05:51:56.484 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/ 2024-05-28T05:51:56.484 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/ 2024-05-28T05:51:56.484 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 78185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-28T05:51:56.484 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/ 2024-05-28T05:51:56.484 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/ 2024-05-28T05:51:56.484 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 61025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-05-28T05:51:56.484 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec.ko 2024-05-28T05:51:56.484 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-05-28T05:51:56.484 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 30209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-05-28T05:51:56.484 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 31793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-05-28T05:51:56.484 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-05-28T05:51:56.485 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-05-28T05:51:56.485 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/ 2024-05-28T05:51:56.485 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 87929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-28T05:51:56.485 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 44097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acerhdf.ko 2024-05-28T05:51:56.485 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 48249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-28T05:51:56.485 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 73857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-28T05:51:56.485 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-28T05:51:56.485 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 164761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-28T05:51:56.485 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 46177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-28T05:51:56.485 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 62065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-28T05:51:56.485 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-28T05:51:56.485 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 51873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-28T05:51:56.485 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-28T05:51:56.485 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 42753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/hdaps.ko 2024-05-28T05:51:56.486 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/ibm_rtl.ko 2024-05-28T05:51:56.486 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/ 2024-05-28T05:51:56.486 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-28T05:51:56.486 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-05-28T05:51:56.486 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 53993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel_ips.ko 2024-05-28T05:51:56.486 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-28T05:51:56.486 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-28T05:51:56.486 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 43745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-28T05:51:56.486 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 51889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-28T05:51:56.486 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-28T05:51:56.486 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-28T05:51:56.486 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-28T05:51:56.487 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-28T05:51:56.487 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-28T05:51:56.487 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 61409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi.ko 2024-05-28T05:51:56.487 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/ 2024-05-28T05:51:56.487 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ 2024-05-28T05:51:56.487 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 36505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/88pm860x_battery.ko 2024-05-28T05:51:56.487 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 40417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/88pm860x_charger.ko 2024-05-28T05:51:56.487 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 68825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq2415x_charger.ko 2024-05-28T05:51:56.487 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 73065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq24190_charger.ko 2024-05-28T05:51:56.487 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq24735-charger.ko 2024-05-28T05:51:56.487 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-05-28T05:51:56.487 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/da9030_battery.ko 2024-05-28T05:51:56.487 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/da9052-battery.ko 2024-05-28T05:51:56.488 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 34481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2760_battery.ko 2024-05-28T05:51:56.488 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2780_battery.ko 2024-05-28T05:51:56.488 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2781_battery.ko 2024-05-28T05:51:56.488 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2782_battery.ko 2024-05-28T05:51:56.488 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/gpio-charger.ko 2024-05-28T05:51:56.488 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/isp1704_charger.ko 2024-05-28T05:51:56.488 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/lp8727_charger.ko 2024-05-28T05:51:56.488 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max14577_charger.ko 2024-05-28T05:51:56.488 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 37825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max17042_battery.ko 2024-05-28T05:51:56.488 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max8903_charger.ko 2024-05-28T05:51:56.488 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 27681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max8925_power.ko 2024-05-28T05:51:56.488 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/pcf50633-charger.ko 2024-05-28T05:51:56.488 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 44833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/sbs-battery.ko 2024-05-28T05:51:56.488 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 34897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/test_power.ko 2024-05-28T05:51:56.489 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/tps65090-charger.ko 2024-05-28T05:51:56.489 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm831x_backup.ko 2024-05-28T05:51:56.489 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm831x_power.ko 2024-05-28T05:51:56.489 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 27433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm8350_power.ko 2024-05-28T05:51:56.489 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/ 2024-05-28T05:51:56.489 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 73289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-28T05:51:56.489 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-28T05:51:56.489 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/ 2024-05-28T05:51:56.489 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/ 2024-05-28T05:51:56.489 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-28T05:51:56.489 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-28T05:51:56.489 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps_parport.ko 2024-05-28T05:51:56.489 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 49801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/pps_core.ko 2024-05-28T05:51:56.490 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ 2024-05-28T05:51:56.490 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 91369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp.ko 2024-05-28T05:51:56.490 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp_kvm.ko 2024-05-28T05:51:56.490 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/ 2024-05-28T05:51:56.490 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/ 2024-05-28T05:51:56.490 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/ 2024-05-28T05:51:56.490 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 67473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-28T05:51:56.490 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 47129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/fmpm.ko 2024-05-28T05:51:56.490 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/ 2024-05-28T05:51:56.490 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 27585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-88pm80x.ko 2024-05-28T05:51:56.490 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-88pm860x.ko 2024-05-28T05:51:56.490 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-28T05:51:56.490 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9052.ko 2024-05-28T05:51:56.491 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9055.ko 2024-05-28T05:51:56.491 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9063.ko 2024-05-28T05:51:56.491 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-28T05:51:56.491 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 82217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-28T05:51:56.491 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-28T05:51:56.491 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-28T05:51:56.491 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-28T05:51:56.491 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-28T05:51:56.491 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-28T05:51:56.491 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-28T05:51:56.491 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-28T05:51:56.491 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-em3027.ko 2024-05-28T05:51:56.491 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-28T05:51:56.491 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-28T05:51:56.492 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 44121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-28T05:51:56.492 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-lp8788.ko 2024-05-28T05:51:56.492 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 46905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-28T05:51:56.492 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-28T05:51:56.492 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-28T05:51:56.492 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t86.ko 2024-05-28T05:51:56.492 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max6900.ko 2024-05-28T05:51:56.492 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8907.ko 2024-05-28T05:51:56.492 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8925.ko 2024-05-28T05:51:56.492 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 31329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8997.ko 2024-05-28T05:51:56.492 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8998.ko 2024-05-28T05:51:56.492 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-05-28T05:51:56.492 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-28T05:51:56.493 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-palmas.ko 2024-05-28T05:51:56.493 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 56769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-28T05:51:56.493 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf50633.ko 2024-05-28T05:51:56.493 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 32649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-28T05:51:56.493 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-28T05:51:56.493 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 36057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-28T05:51:56.493 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-28T05:51:56.493 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rc5t583.ko 2024-05-28T05:51:56.493 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-28T05:51:56.493 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 40073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-28T05:51:56.493 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 34521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-28T05:51:56.493 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-28T05:51:56.493 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-28T05:51:56.493 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-s35390a.ko 2024-05-28T05:51:56.494 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-28T05:51:56.494 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-tps6586x.ko 2024-05-28T05:51:56.494 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-tps65910.ko 2024-05-28T05:51:56.494 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-wm831x.ko 2024-05-28T05:51:56.494 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-wm8350.ko 2024-05-28T05:51:56.494 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-x1205.ko 2024-05-28T05:51:56.494 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ 2024-05-28T05:51:56.494 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 90369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-9xxx.ko 2024-05-28T05:51:56.494 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 69585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-sas.ko 2024-05-28T05:51:56.494 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 65937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-xxxx.ko 2024-05-28T05:51:56.494 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 164473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/BusLogic.ko 2024-05-28T05:51:56.494 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 31609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/a100u2w.ko 2024-05-28T05:51:56.494 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/ 2024-05-28T05:51:56.495 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 340689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-28T05:51:56.495 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 120393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/advansys.ko 2024-05-28T05:51:56.495 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/ 2024-05-28T05:51:56.495 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 468049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-28T05:51:56.495 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 380633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-28T05:51:56.495 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic94xx/ 2024-05-28T05:51:56.495 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 243649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-05-28T05:51:56.495 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/am53c974.ko 2024-05-28T05:51:56.495 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/ 2024-05-28T05:51:56.495 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 135601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-28T05:51:56.495 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 44281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/atp870u.ko 2024-05-28T05:51:56.495 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/ 2024-05-28T05:51:56.495 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 304969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-28T05:51:56.496 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/ 2024-05-28T05:51:56.496 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 1527017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/bfa.ko 2024-05-28T05:51:56.496 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/ 2024-05-28T05:51:56.496 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 297769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-28T05:51:56.496 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/ 2024-05-28T05:51:56.496 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 144377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-28T05:51:56.496 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 47449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ch.ko 2024-05-28T05:51:56.496 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/ 2024-05-28T05:51:56.496 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 390657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-28T05:51:56.496 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/ 2024-05-28T05:51:56.496 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-05-28T05:51:56.496 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 88873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-28T05:51:56.496 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-05-28T05:51:56.497 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 117473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-28T05:51:56.497 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 173009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-28T05:51:56.497 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 91497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dc395x.ko 2024-05-28T05:51:56.497 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 45393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dmx3191d.ko 2024-05-28T05:51:56.497 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/ 2024-05-28T05:51:56.497 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 267521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-28T05:51:56.497 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 78961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esp_scsi.ko 2024-05-28T05:51:56.497 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/ 2024-05-28T05:51:56.497 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 95321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-28T05:51:56.497 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 194001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-28T05:51:56.497 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fdomain.ko 2024-05-28T05:51:56.497 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/ 2024-05-28T05:51:56.497 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 366457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/fnic.ko 2024-05-28T05:51:56.498 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 251497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hpsa.ko 2024-05-28T05:51:56.498 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 65689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hptiop.ko 2024-05-28T05:51:56.498 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 57089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hv_storvsc.ko 2024-05-28T05:51:56.498 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 44681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/imm.ko 2024-05-28T05:51:56.498 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 55145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/initio.ko 2024-05-28T05:51:56.498 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 327833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ipr.ko 2024-05-28T05:51:56.498 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 129777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ips.ko 2024-05-28T05:51:56.498 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/ 2024-05-28T05:51:56.498 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 397657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/isci.ko 2024-05-28T05:51:56.498 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 32009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-28T05:51:56.498 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 63113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-28T05:51:56.498 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/ 2024-05-28T05:51:56.499 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 386801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/libfc.ko 2024-05-28T05:51:56.499 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 178169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi.ko 2024-05-28T05:51:56.499 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 64801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-28T05:51:56.499 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/ 2024-05-28T05:51:56.499 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 273953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/libsas.ko 2024-05-28T05:51:56.499 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/ 2024-05-28T05:51:56.499 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 2735913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-28T05:51:56.499 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/ 2024-05-28T05:51:56.499 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 88521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-28T05:51:56.499 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 40137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-28T05:51:56.499 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 389089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-28T05:51:56.499 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 104761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid.ko 2024-05-28T05:51:56.499 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/ 2024-05-28T05:51:56.499 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 836897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-28T05:51:56.544 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/ 2024-05-28T05:51:56.544 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 158705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-28T05:51:56.545 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 96529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvumi.ko 2024-05-28T05:51:56.545 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/ 2024-05-28T05:51:56.545 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 101609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-05-28T05:51:56.545 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-05-28T05:51:56.545 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-05-28T05:51:56.545 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-05-28T05:51:56.545 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/ 2024-05-28T05:51:56.545 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 443713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-28T05:51:56.545 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 152025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pmcraid.ko 2024-05-28T05:51:56.545 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 41617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ppa.ko 2024-05-28T05:51:56.545 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 66969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla1280.ko 2024-05-28T05:51:56.545 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/ 2024-05-28T05:51:56.545 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 2324713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-28T05:51:56.545 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 103593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-28T05:51:56.546 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/ 2024-05-28T05:51:56.546 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 697281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-28T05:51:56.546 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qlogicfas408.ko 2024-05-28T05:51:56.546 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/raid_class.ko 2024-05-28T05:51:56.546 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 322857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_debug.ko 2024-05-28T05:51:56.546 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 219849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-28T05:51:56.546 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 357145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-28T05:51:56.546 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 121177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-28T05:51:56.546 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 93473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-28T05:51:56.546 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 55393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-28T05:51:56.546 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ses.ko 2024-05-28T05:51:56.547 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 138113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/st.ko 2024-05-28T05:51:56.547 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 57393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/stex.ko 2024-05-28T05:51:56.547 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/ 2024-05-28T05:51:56.547 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 205001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-28T05:51:56.547 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 55465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/virtio_scsi.ko 2024-05-28T05:51:56.547 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 59113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-28T05:51:56.547 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 48769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/wd719x.ko 2024-05-28T05:51:56.547 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 59409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/xen-scsifront.ko 2024-05-28T05:51:56.547 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ 2024-05-28T05:51:56.547 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 174865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ssb.ko 2024-05-28T05:51:56.547 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/ 2024-05-28T05:51:56.547 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/ 2024-05-28T05:51:56.547 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 920073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-28T05:51:56.547 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/ 2024-05-28T05:51:56.548 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 60313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-28T05:51:56.548 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 48121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_file.ko 2024-05-28T05:51:56.548 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 54225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_iblock.ko 2024-05-28T05:51:56.548 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 1170873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_mod.ko 2024-05-28T05:51:56.548 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 51889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_pscsi.ko 2024-05-28T05:51:56.548 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 149777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_user.ko 2024-05-28T05:51:56.548 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/ 2024-05-28T05:51:56.548 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 90033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-28T05:51:56.548 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/ 2024-05-28T05:51:56.548 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/ 2024-05-28T05:51:56.548 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/ 2024-05-28T05:51:56.548 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-28T05:51:56.548 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 35201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-28T05:51:56.549 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-28T05:51:56.549 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-28T05:51:56.549 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-28T05:51:56.549 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-28T05:51:56.549 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 36721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-28T05:51:56.549 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-28T05:51:56.549 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-28T05:51:56.549 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-28T05:51:56.549 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-28T05:51:56.549 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-28T05:51:56.549 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 45993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-28T05:51:56.549 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-28T05:51:56.549 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-28T05:51:56.550 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 35905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-05-28T05:51:56.550 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-28T05:51:56.550 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-28T05:51:56.550 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 30569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-28T05:51:56.550 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ 2024-05-28T05:51:56.550 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ 2024-05-28T05:51:56.550 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 99289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-28T05:51:56.550 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 69721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/moxa.ko 2024-05-28T05:51:56.550 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 61641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/mxser.ko 2024-05-28T05:51:56.550 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 134329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_gsm.ko 2024-05-28T05:51:56.550 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 37897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_hdlc.ko 2024-05-28T05:51:56.550 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 78961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/nozomi.ko 2024-05-28T05:51:56.551 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/ 2024-05-28T05:51:56.551 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/ 2024-05-28T05:51:56.551 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 43873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-05-28T05:51:56.551 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 65113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-28T05:51:56.551 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-05-28T05:51:56.551 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/altera_uart.ko 2024-05-28T05:51:56.551 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/arc_uart.ko 2024-05-28T05:51:56.551 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 91593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-05-28T05:51:56.551 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/ 2024-05-28T05:51:56.551 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 120553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-28T05:51:56.551 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 35153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/rp2.ko 2024-05-28T05:51:56.551 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 65633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/sc16is7xx.ko 2024-05-28T05:51:56.551 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/ 2024-05-28T05:51:56.552 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ 2024-05-28T05:51:56.552 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 693057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-28T05:51:56.552 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ 2024-05-28T05:51:56.552 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 34441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-28T05:51:56.552 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-05-28T05:51:56.552 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/ 2024-05-28T05:51:56.552 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 55609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio.ko 2024-05-28T05:51:56.552 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_aec.ko 2024-05-28T05:51:56.552 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_cif.ko 2024-05-28T05:51:56.552 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_dmem_genirq.ko 2024-05-28T05:51:56.552 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_mf624.ko 2024-05-28T05:51:56.552 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_netx.ko 2024-05-28T05:51:56.552 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pci_generic.ko 2024-05-28T05:51:56.552 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-05-28T05:51:56.553 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_sercos3.ko 2024-05-28T05:51:56.553 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/ 2024-05-28T05:51:56.553 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/c67x00/ 2024-05-28T05:51:56.553 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 90297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/c67x00/c67x00.ko 2024-05-28T05:51:56.553 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ 2024-05-28T05:51:56.553 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 189169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-05-28T05:51:56.553 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-05-28T05:51:56.553 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-05-28T05:51:56.553 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-05-28T05:51:56.553 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-05-28T05:51:56.553 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/ 2024-05-28T05:51:56.553 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 101537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-acm.ko 2024-05-28T05:51:56.554 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 63017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-28T05:51:56.554 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 56713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usblp.ko 2024-05-28T05:51:56.554 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 107409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usbtmc.ko 2024-05-28T05:51:56.554 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/common/ 2024-05-28T05:51:56.554 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/common/ulpi.ko 2024-05-28T05:51:56.554 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc2/ 2024-05-28T05:51:56.554 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-05-28T05:51:56.554 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/ 2024-05-28T05:51:56.554 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-05-28T05:51:56.554 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-05-28T05:51:56.554 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 575217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3.ko 2024-05-28T05:51:56.554 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/ 2024-05-28T05:51:56.555 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/ 2024-05-28T05:51:56.555 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 72241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/u_ether.ko 2024-05-28T05:51:56.555 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 61945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/u_serial.ko 2024-05-28T05:51:56.555 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-05-28T05:51:56.555 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 49729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-05-28T05:51:56.555 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-05-28T05:51:56.555 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 43481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-05-28T05:51:56.555 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 131513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-05-28T05:51:56.555 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 62313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-05-28T05:51:56.555 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 146601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-05-28T05:51:56.555 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 70569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-05-28T05:51:56.555 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-05-28T05:51:56.555 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 37641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-05-28T05:51:56.555 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 70009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-05-28T05:51:56.555 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 101233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-05-28T05:51:56.556 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-05-28T05:51:56.556 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 71241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-05-28T05:51:56.556 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 84929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-05-28T05:51:56.556 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/ 2024-05-28T05:51:56.556 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-05-28T05:51:56.556 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-05-28T05:51:56.556 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-05-28T05:51:56.556 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-05-28T05:51:56.556 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-05-28T05:51:56.556 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-05-28T05:51:56.556 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-05-28T05:51:56.556 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-05-28T05:51:56.556 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 35681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-05-28T05:51:56.557 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-05-28T05:51:56.557 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-05-28T05:51:56.557 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 30273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-05-28T05:51:56.557 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 78065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-05-28T05:51:56.557 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-05-28T05:51:56.557 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 204009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/libcomposite.ko 2024-05-28T05:51:56.557 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/ 2024-05-28T05:51:56.557 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-05-28T05:51:56.557 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/bdc/ 2024-05-28T05:51:56.557 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 182537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-05-28T05:51:56.557 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 45537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-05-28T05:51:56.557 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 66505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-05-28T05:51:56.558 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 85209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-05-28T05:51:56.558 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 69305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-05-28T05:51:56.558 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 90305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/net2272.ko 2024-05-28T05:51:56.558 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 90353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/net2280.ko 2024-05-28T05:51:56.558 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 94833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-05-28T05:51:56.558 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 80513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-05-28T05:51:56.558 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 87457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-05-28T05:51:56.558 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 95433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-05-28T05:51:56.558 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 195953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-05-28T05:51:56.558 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/ 2024-05-28T05:51:56.558 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/bcma-hcd.ko 2024-05-28T05:51:56.558 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 108313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/isp116x-hcd.ko 2024-05-28T05:51:56.558 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 104433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-05-28T05:51:56.559 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 102265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-05-28T05:51:56.559 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 60097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-28T05:51:56.559 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811_cs.ko 2024-05-28T05:51:56.559 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/ssb-hcd.ko 2024-05-28T05:51:56.559 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 32545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-05-28T05:51:56.559 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/ 2024-05-28T05:51:56.559 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 40401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/mdc800.ko 2024-05-28T05:51:56.559 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/microtek.ko 2024-05-28T05:51:56.559 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ 2024-05-28T05:51:56.559 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 47345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/adutux.ko 2024-05-28T05:51:56.559 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/appledisplay.ko 2024-05-28T05:51:56.559 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-05-28T05:51:56.559 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/cytherm.ko 2024-05-28T05:51:56.559 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ehset.ko 2024-05-28T05:51:56.560 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi26.ko 2024-05-28T05:51:56.560 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi62.ko 2024-05-28T05:51:56.560 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ezusb.ko 2024-05-28T05:51:56.560 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/idmouse.ko 2024-05-28T05:51:56.560 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 42721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/iowarrior.ko 2024-05-28T05:51:56.560 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-28T05:51:56.560 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 42233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ldusb.ko 2024-05-28T05:51:56.560 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 42225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/legousbtower.ko 2024-05-28T05:51:56.560 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/lvstest.ko 2024-05-28T05:51:56.560 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/ 2024-05-28T05:51:56.560 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 85305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-28T05:51:56.560 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-28T05:51:56.560 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usb3503.ko 2024-05-28T05:51:56.561 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usblcd.ko 2024-05-28T05:51:56.561 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 27801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-28T05:51:56.561 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 84257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbtest.ko 2024-05-28T05:51:56.561 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 52057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/uss720.ko 2024-05-28T05:51:56.561 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 32337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/yurex.ko 2024-05-28T05:51:56.561 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/mon/ 2024-05-28T05:51:56.561 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 91505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/mon/usbmon.ko 2024-05-28T05:51:56.561 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/musb/ 2024-05-28T05:51:56.561 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 396169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/musb/musb_hdrc.ko 2024-05-28T05:51:56.561 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/ 2024-05-28T05:51:56.561 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-generic.ko 2024-05-28T05:51:56.561 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-05-28T05:51:56.561 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-isp1301.ko 2024-05-28T05:51:56.561 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-tahvo.ko 2024-05-28T05:51:56.562 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ 2024-05-28T05:51:56.562 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/aircable.ko 2024-05-28T05:51:56.562 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 38201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ark3116.ko 2024-05-28T05:51:56.562 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 30673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-28T05:51:56.562 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 44321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ch341.ko 2024-05-28T05:51:56.562 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 79673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cp210x.ko 2024-05-28T05:51:56.562 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 35129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cyberjack.ko 2024-05-28T05:51:56.562 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 66865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-28T05:51:56.562 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 58321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-28T05:51:56.562 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/empeg.ko 2024-05-28T05:51:56.562 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 53001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/f81232.ko 2024-05-28T05:51:56.562 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 188601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-28T05:51:56.563 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 61481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-28T05:51:56.563 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 152297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-28T05:51:56.563 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 142825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_ti.ko 2024-05-28T05:51:56.563 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 69209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipaq.ko 2024-05-28T05:51:56.563 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipw.ko 2024-05-28T05:51:56.563 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ir-usb.ko 2024-05-28T05:51:56.563 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 66353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-28T05:51:56.563 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 122321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan.ko 2024-05-28T05:51:56.563 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 41289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-28T05:51:56.563 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-28T05:51:56.563 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 38041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-28T05:51:56.563 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 38033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mct_u232.ko 2024-05-28T05:51:56.563 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/metro-usb.ko 2024-05-28T05:51:56.563 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 79673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7720.ko 2024-05-28T05:51:56.564 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 89961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7840.ko 2024-05-28T05:51:56.564 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 65065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mxuport.ko 2024-05-28T05:51:56.564 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/navman.ko 2024-05-28T05:51:56.564 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/omninet.ko 2024-05-28T05:51:56.564 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/opticon.ko 2024-05-28T05:51:56.564 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 197201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/option.ko 2024-05-28T05:51:56.564 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 45329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/oti6858.ko 2024-05-28T05:51:56.564 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 61753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/pl2303.ko 2024-05-28T05:51:56.564 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcaux.ko 2024-05-28T05:51:56.564 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 39977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcserial.ko 2024-05-28T05:51:56.564 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 40521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/quatech2.ko 2024-05-28T05:51:56.564 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/safe_serial.ko 2024-05-28T05:51:56.564 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 59337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/sierra.ko 2024-05-28T05:51:56.564 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-28T05:51:56.565 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 34057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ssu100.ko 2024-05-28T05:51:56.565 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/symbolserial.ko 2024-05-28T05:51:56.565 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 70489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-28T05:51:56.565 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-28T05:51:56.565 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_debug.ko 2024-05-28T05:51:56.565 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 39313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-28T05:51:56.565 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 151121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usbserial.ko 2024-05-28T05:51:56.565 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 32497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/visor.ko 2024-05-28T05:51:56.565 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 43569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/whiteheat.ko 2024-05-28T05:51:56.565 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/wishbone-serial.ko 2024-05-28T05:51:56.565 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-28T05:51:56.565 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ 2024-05-28T05:51:56.565 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 64041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/uas.ko 2024-05-28T05:51:56.566 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 30201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-28T05:51:56.566 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-28T05:51:56.566 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-28T05:51:56.566 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 41065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-28T05:51:56.566 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-28T05:51:56.566 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-28T05:51:56.566 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-28T05:51:56.566 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-karma.ko 2024-05-28T05:51:56.566 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-28T05:51:56.566 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-28T05:51:56.566 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-28T05:51:56.566 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-28T05:51:56.566 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 41777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-28T05:51:56.566 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 201145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/usb-storage.ko 2024-05-28T05:51:56.567 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/ 2024-05-28T05:51:56.567 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 76025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-28T05:51:56.567 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 85233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-28T05:51:56.567 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 122233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-28T05:51:56.567 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/ 2024-05-28T05:51:56.567 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/ 2024-05-28T05:51:56.567 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 206897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-28T05:51:56.567 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-28T05:51:56.567 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 134241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio.ko 2024-05-28T05:51:56.567 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 93665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-28T05:51:56.567 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/ 2024-05-28T05:51:56.567 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 138641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost.ko 2024-05-28T05:51:56.567 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-28T05:51:56.568 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 71273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_net.ko 2024-05-28T05:51:56.568 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 107897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_scsi.ko 2024-05-28T05:51:56.568 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/ 2024-05-28T05:51:56.568 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/ 2024-05-28T05:51:56.568 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-05-28T05:51:56.568 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/aat2870_bl.ko 2024-05-28T05:51:56.568 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp5520_bl.ko 2024-05-28T05:51:56.568 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 41161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp8860_bl.ko 2024-05-28T05:51:56.568 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 51737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp8870_bl.ko 2024-05-28T05:51:56.568 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/apple_bl.ko 2024-05-28T05:51:56.568 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/as3711_bl.ko 2024-05-28T05:51:56.568 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/bd6107.ko 2024-05-28T05:51:56.568 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/da903x_bl.ko 2024-05-28T05:51:56.568 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/da9052_bl.ko 2024-05-28T05:51:56.569 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/gpio_backlight.ko 2024-05-28T05:51:56.569 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/kb3886_bl.ko 2024-05-28T05:51:56.569 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lcd.ko 2024-05-28T05:51:56.569 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lm3533_bl.ko 2024-05-28T05:51:56.569 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lm3639_bl.ko 2024-05-28T05:51:56.569 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lv5207lp.ko 2024-05-28T05:51:56.569 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/max8925_bl.ko 2024-05-28T05:51:56.569 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/pandora_bl.ko 2024-05-28T05:51:56.569 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-05-28T05:51:56.569 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-28T05:51:56.569 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/wm831x_bl.ko 2024-05-28T05:51:56.569 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/ 2024-05-28T05:51:56.569 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ 2024-05-28T05:51:56.569 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2482.ko 2024-05-28T05:51:56.570 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 46793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2490.ko 2024-05-28T05:51:56.570 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/matrox_w1.ko 2024-05-28T05:51:56.570 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/w1-gpio.ko 2024-05-28T05:51:56.570 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/ 2024-05-28T05:51:56.570 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-28T05:51:56.570 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 27249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-28T05:51:56.570 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-28T05:51:56.570 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-28T05:51:56.570 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-28T05:51:56.570 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-28T05:51:56.570 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-28T05:51:56.570 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-28T05:51:56.570 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-28T05:51:56.571 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 8305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-28T05:51:56.571 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 70361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-28T05:51:56.571 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 129409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/wire.ko 2024-05-28T05:51:56.571 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ 2024-05-28T05:51:56.571 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/acquirewdt.ko 2024-05-28T05:51:56.571 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/advantechwdt.ko 2024-05-28T05:51:56.571 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-28T05:51:56.571 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 27393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-28T05:51:56.571 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/cpu5wdt.ko 2024-05-28T05:51:56.571 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9052_wdt.ko 2024-05-28T05:51:56.571 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9055_wdt.ko 2024-05-28T05:51:56.571 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9063_wdt.ko 2024-05-28T05:51:56.571 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/dw_wdt.ko 2024-05-28T05:51:56.572 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/eurotechwdt.ko 2024-05-28T05:51:56.572 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-28T05:51:56.572 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 32849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/hpwdt.ko 2024-05-28T05:51:56.572 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/i6300esb.ko 2024-05-28T05:51:56.572 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-28T05:51:56.572 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-28T05:51:56.572 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ib700wdt.ko 2024-05-28T05:51:56.572 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ibmasr.ko 2024-05-28T05:51:56.572 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-28T05:51:56.572 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-28T05:51:56.572 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it87_wdt.ko 2024-05-28T05:51:56.572 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/kempld_wdt.ko 2024-05-28T05:51:56.572 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/machzwd.ko 2024-05-28T05:51:56.572 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/mena21_wdt.ko 2024-05-28T05:51:56.573 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-05-28T05:51:56.573 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/nv_tco.ko 2024-05-28T05:51:56.573 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-05-28T05:51:56.573 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 27649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pc87413_wdt.ko 2024-05-28T05:51:56.573 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 46945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-28T05:51:56.573 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 37185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-28T05:51:56.573 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/retu_wdt.ko 2024-05-28T05:51:56.573 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-05-28T05:51:56.573 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-05-28T05:51:56.573 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-28T05:51:56.573 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sc1200wdt.ko 2024-05-28T05:51:56.573 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 27481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-28T05:51:56.573 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-05-28T05:51:56.574 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/softdog.ko 2024-05-28T05:51:56.574 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-28T05:51:56.574 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/twl4030_wdt.ko 2024-05-28T05:51:56.574 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/via_wdt.ko 2024-05-28T05:51:56.574 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-28T05:51:56.574 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-28T05:51:56.574 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 32473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-28T05:51:56.574 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wafer5823wdt.ko 2024-05-28T05:51:56.574 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wdt_pci.ko 2024-05-28T05:51:56.574 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wm831x_wdt.ko 2024-05-28T05:51:56.574 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wm8350_wdt.ko 2024-05-28T05:51:56.574 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/xen_wdt.ko 2024-05-28T05:51:56.574 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/ 2024-05-28T05:51:56.575 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 30041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-evtchn.ko 2024-05-28T05:51:56.575 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 30641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntalloc.ko 2024-05-28T05:51:56.575 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 55705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntdev.ko 2024-05-28T05:51:56.575 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/ 2024-05-28T05:51:56.575 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 213865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-28T05:51:56.575 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 47673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-privcmd.ko 2024-05-28T05:51:56.575 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 85705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-scsiback.ko 2024-05-28T05:51:56.575 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/ 2024-05-28T05:51:56.575 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-28T05:51:56.575 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ 2024-05-28T05:51:56.575 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/ 2024-05-28T05:51:56.576 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 194449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/9p.ko 2024-05-28T05:51:56.576 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/adfs/ 2024-05-28T05:51:56.576 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 78049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/adfs/adfs.ko 2024-05-28T05:51:56.576 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/ 2024-05-28T05:51:56.576 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 197801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/affs.ko 2024-05-28T05:51:56.576 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/afs/ 2024-05-28T05:51:56.576 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 1260937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/afs/kafs.ko 2024-05-28T05:51:56.576 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/autofs/ 2024-05-28T05:51:56.576 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 127337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/autofs/autofs4.ko 2024-05-28T05:51:56.576 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/ 2024-05-28T05:51:56.576 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 80481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/befs.ko 2024-05-28T05:51:56.576 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/bfs/ 2024-05-28T05:51:56.576 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 50457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/bfs/bfs.ko 2024-05-28T05:51:56.576 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 45553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/binfmt_misc.ko 2024-05-28T05:51:56.577 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/ 2024-05-28T05:51:56.577 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 4491713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/btrfs.ko 2024-05-28T05:51:56.577 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/ 2024-05-28T05:51:56.577 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 376801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/cachefiles.ko 2024-05-28T05:51:56.577 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ 2024-05-28T05:51:56.577 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 1586617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ceph.ko 2024-05-28T05:51:56.577 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/ 2024-05-28T05:51:56.577 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 130017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/coda.ko 2024-05-28T05:51:56.577 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/configfs/ 2024-05-28T05:51:56.577 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 139049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/configfs/configfs.ko 2024-05-28T05:51:56.577 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/ 2024-05-28T05:51:56.577 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 35649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/cramfs.ko 2024-05-28T05:51:56.577 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/ 2024-05-28T05:51:56.578 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 813137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/dlm.ko 2024-05-28T05:51:56.578 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/efs/ 2024-05-28T05:51:56.578 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 46377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/efs/efs.ko 2024-05-28T05:51:56.578 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/ 2024-05-28T05:51:56.578 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 1906713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/f2fs.ko 2024-05-28T05:51:56.578 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/ 2024-05-28T05:51:56.578 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 35129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/msdos.ko 2024-05-28T05:51:56.578 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/freevxfs/ 2024-05-28T05:51:56.578 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 52265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/freevxfs/freevxfs.ko 2024-05-28T05:51:56.578 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/ 2024-05-28T05:51:56.578 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/cuse.ko 2024-05-28T05:51:56.578 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/ 2024-05-28T05:51:56.578 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 1486393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/gfs2.ko 2024-05-28T05:51:56.579 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/ 2024-05-28T05:51:56.579 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 183217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/hfs.ko 2024-05-28T05:51:56.579 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/ 2024-05-28T05:51:56.579 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 281993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/hfsplus.ko 2024-05-28T05:51:56.579 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hpfs/ 2024-05-28T05:51:56.579 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 248945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hpfs/hpfs.ko 2024-05-28T05:51:56.579 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/ 2024-05-28T05:51:56.579 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 92985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/isofs.ko 2024-05-28T05:51:56.579 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/ 2024-05-28T05:51:56.579 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 532953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/jfs.ko 2024-05-28T05:51:56.579 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/ 2024-05-28T05:51:56.579 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 361281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/lockd.ko 2024-05-28T05:51:56.579 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/ 2024-05-28T05:51:56.579 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 112569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/minix.ko 2024-05-28T05:51:56.580 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/ 2024-05-28T05:51:56.580 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 591625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/netfs.ko 2024-05-28T05:51:56.580 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/ 2024-05-28T05:51:56.580 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/ 2024-05-28T05:51:56.580 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 102537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-28T05:51:56.580 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/ 2024-05-28T05:51:56.580 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 74337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-28T05:51:56.580 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/ 2024-05-28T05:51:56.580 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 147673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-28T05:51:56.580 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 1320377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfs.ko 2024-05-28T05:51:56.580 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 82089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv2.ko 2024-05-28T05:51:56.580 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 151617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv3.ko 2024-05-28T05:51:56.580 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 2518385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv4.ko 2024-05-28T05:51:56.580 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/ 2024-05-28T05:51:56.581 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/grace.ko 2024-05-28T05:51:56.581 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/nfs_acl.ko 2024-05-28T05:51:56.581 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/ 2024-05-28T05:51:56.581 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 2021969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/nfsd.ko 2024-05-28T05:51:56.581 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/ 2024-05-28T05:51:56.581 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 733969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/nilfs2.ko 2024-05-28T05:51:56.581 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/ 2024-05-28T05:51:56.581 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-celtic.ko 2024-05-28T05:51:56.581 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-centeuro.ko 2024-05-28T05:51:56.581 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-croatian.ko 2024-05-28T05:51:56.581 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-cyrillic.ko 2024-05-28T05:51:56.581 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-gaelic.ko 2024-05-28T05:51:56.581 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-greek.ko 2024-05-28T05:51:56.582 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-iceland.ko 2024-05-28T05:51:56.582 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-inuit.ko 2024-05-28T05:51:56.582 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-roman.ko 2024-05-28T05:51:56.582 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-romanian.ko 2024-05-28T05:51:56.582 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-turkish.ko 2024-05-28T05:51:56.582 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ascii.ko 2024-05-28T05:51:56.582 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1250.ko 2024-05-28T05:51:56.582 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1251.ko 2024-05-28T05:51:56.582 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1255.ko 2024-05-28T05:51:56.582 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp737.ko 2024-05-28T05:51:56.582 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp775.ko 2024-05-28T05:51:56.582 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp850.ko 2024-05-28T05:51:56.582 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp852.ko 2024-05-28T05:51:56.582 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp855.ko 2024-05-28T05:51:56.583 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp857.ko 2024-05-28T05:51:56.583 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp860.ko 2024-05-28T05:51:56.583 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp861.ko 2024-05-28T05:51:56.583 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp862.ko 2024-05-28T05:51:56.583 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp863.ko 2024-05-28T05:51:56.583 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp864.ko 2024-05-28T05:51:56.583 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp865.ko 2024-05-28T05:51:56.583 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp866.ko 2024-05-28T05:51:56.583 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp869.ko 2024-05-28T05:51:56.583 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp874.ko 2024-05-28T05:51:56.583 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 95617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp932.ko 2024-05-28T05:51:56.583 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 144201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp936.ko 2024-05-28T05:51:56.583 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 167129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp949.ko 2024-05-28T05:51:56.584 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 119505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp950.ko 2024-05-28T05:51:56.584 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_euc-jp.ko 2024-05-28T05:51:56.584 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-1.ko 2024-05-28T05:51:56.584 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-13.ko 2024-05-28T05:51:56.584 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-14.ko 2024-05-28T05:51:56.584 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-15.ko 2024-05-28T05:51:56.584 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-2.ko 2024-05-28T05:51:56.584 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-3.ko 2024-05-28T05:51:56.584 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-4.ko 2024-05-28T05:51:56.584 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-5.ko 2024-05-28T05:51:56.584 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-6.ko 2024-05-28T05:51:56.584 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-7.ko 2024-05-28T05:51:56.584 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-9.ko 2024-05-28T05:51:56.585 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-r.ko 2024-05-28T05:51:56.585 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-ru.ko 2024-05-28T05:51:56.585 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-u.ko 2024-05-28T05:51:56.585 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 7513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-28T05:51:56.585 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_utf8.ko 2024-05-28T05:51:56.585 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ntfs3/ 2024-05-28T05:51:56.585 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 634457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ntfs3/ntfs3.ko 2024-05-28T05:51:56.585 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ 2024-05-28T05:51:56.585 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ 2024-05-28T05:51:56.585 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 302033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-28T05:51:56.585 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ 2024-05-28T05:51:56.585 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 548057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-28T05:51:56.585 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ 2024-05-28T05:51:56.585 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 66345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-28T05:51:56.586 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 3245449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2.ko 2024-05-28T05:51:56.586 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 22105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-28T05:51:56.586 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 39305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-28T05:51:56.586 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 43065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-28T05:51:56.586 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/omfs/ 2024-05-28T05:51:56.586 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 67465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/omfs/omfs.ko 2024-05-28T05:51:56.586 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/ 2024-05-28T05:51:56.586 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 462817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/overlay.ko 2024-05-28T05:51:56.586 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ 2024-05-28T05:51:56.586 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 67961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ramoops.ko 2024-05-28T05:51:56.586 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx4/ 2024-05-28T05:51:56.586 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx4/qnx4.ko 2024-05-28T05:51:56.586 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx6/ 2024-05-28T05:51:56.587 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 56073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx6/qnx6.ko 2024-05-28T05:51:56.587 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/ 2024-05-28T05:51:56.587 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 40305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_tree.ko 2024-05-28T05:51:56.587 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_v1.ko 2024-05-28T05:51:56.587 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_v2.ko 2024-05-28T05:51:56.587 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/ 2024-05-28T05:51:56.587 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 684713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/reiserfs.ko 2024-05-28T05:51:56.587 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/ 2024-05-28T05:51:56.587 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 34593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/romfs.ko 2024-05-28T05:51:56.587 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/ 2024-05-28T05:51:56.587 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/ 2024-05-28T05:51:56.587 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 3350841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/cifs.ko 2024-05-28T05:51:56.625 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/ 2024-05-28T05:51:56.625 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 8065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_arc4.ko 2024-05-28T05:51:56.625 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_md4.ko 2024-05-28T05:51:56.625 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/ 2024-05-28T05:51:56.625 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 164145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/squashfs.ko 2024-05-28T05:51:56.625 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/ 2024-05-28T05:51:56.625 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 115865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/sysv.ko 2024-05-28T05:51:56.626 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/ 2024-05-28T05:51:56.626 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 309937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/udf.ko 2024-05-28T05:51:56.626 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ 2024-05-28T05:51:56.626 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 198185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ufs.ko 2024-05-28T05:51:56.626 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/ 2024-05-28T05:51:56.626 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 5192193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/xfs.ko 2024-05-28T05:51:56.626 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/ 2024-05-28T05:51:56.626 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/locking/ 2024-05-28T05:51:56.626 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 97617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/locking/locktorture.ko 2024-05-28T05:51:56.626 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/time/ 2024-05-28T05:51:56.626 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/time/test_udelay.ko 2024-05-28T05:51:56.626 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 72657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/torture.ko 2024-05-28T05:51:56.626 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ 2024-05-28T05:51:56.627 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 7305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc-itu-t.ko 2024-05-28T05:51:56.627 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 7073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc7.ko 2024-05-28T05:51:56.627 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 7945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc8.ko 2024-05-28T05:51:56.627 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/ 2024-05-28T05:51:56.627 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 8001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libarc4.ko 2024-05-28T05:51:56.627 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 38977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libdes.ko 2024-05-28T05:51:56.627 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/interval_tree_test.ko 2024-05-28T05:51:56.627 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/libcrc32c.ko 2024-05-28T05:51:56.627 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lru_cache.ko 2024-05-28T05:51:56.627 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/ 2024-05-28T05:51:56.627 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 36161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4_compress.ko 2024-05-28T05:51:56.627 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4hc_compress.ko 2024-05-28T05:51:56.627 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/ 2024-05-28T05:51:56.627 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 7273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/cordic.ko 2024-05-28T05:51:56.628 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/memory-notifier-error-inject.ko 2024-05-28T05:51:56.628 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/notifier-error-inject.ko 2024-05-28T05:51:56.628 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/percpu_test.ko 2024-05-28T05:51:56.628 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/pm-notifier-error-inject.ko 2024-05-28T05:51:56.628 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/ 2024-05-28T05:51:56.628 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 151945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/raid6_pq.ko 2024-05-28T05:51:56.628 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/rbtree_test.ko 2024-05-28T05:51:56.628 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/ 2024-05-28T05:51:56.628 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-28T05:51:56.628 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 40961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test-kstrtox.ko 2024-05-28T05:51:56.628 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 4912433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_bpf.ko 2024-05-28T05:51:56.628 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 61161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_firmware.ko 2024-05-28T05:51:56.628 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 7113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_module.ko 2024-05-28T05:51:56.628 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_user_copy.ko 2024-05-28T05:51:56.629 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_bm.ko 2024-05-28T05:51:56.629 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_fsm.ko 2024-05-28T05:51:56.629 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_kmp.ko 2024-05-28T05:51:56.629 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/xz/ 2024-05-28T05:51:56.629 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/xz/xz_dec_test.ko 2024-05-28T05:51:56.629 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/mm/ 2024-05-28T05:51:56.629 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/mm/hwpoison-inject.ko 2024-05-28T05:51:56.629 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ 2024-05-28T05:51:56.629 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/ 2024-05-28T05:51:56.629 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 66945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/6lowpan.ko 2024-05-28T05:51:56.629 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_dest.ko 2024-05-28T05:51:56.629 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 7521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_fragment.ko 2024-05-28T05:51:56.629 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_hop.ko 2024-05-28T05:51:56.629 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-28T05:51:56.630 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 7521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_mobility.ko 2024-05-28T05:51:56.630 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 7513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_routing.ko 2024-05-28T05:51:56.630 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_udp.ko 2024-05-28T05:51:56.630 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/ 2024-05-28T05:51:56.630 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 36721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/garp.ko 2024-05-28T05:51:56.630 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 42289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/mrp.ko 2024-05-28T05:51:56.630 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/p8022.ko 2024-05-28T05:51:56.630 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/psnap.ko 2024-05-28T05:51:56.630 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/stp.ko 2024-05-28T05:51:56.630 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/ 2024-05-28T05:51:56.630 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 106697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/8021q.ko 2024-05-28T05:51:56.630 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/ 2024-05-28T05:51:56.630 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 236769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet.ko 2024-05-28T05:51:56.631 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 44441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_fd.ko 2024-05-28T05:51:56.631 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 32201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_rdma.ko 2024-05-28T05:51:56.631 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 39553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_virtio.ko 2024-05-28T05:51:56.631 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/ 2024-05-28T05:51:56.631 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 879593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/batman-adv.ko 2024-05-28T05:51:56.631 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/ 2024-05-28T05:51:56.631 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 85225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/br_netfilter.ko 2024-05-28T05:51:56.631 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 1031177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/bridge.ko 2024-05-28T05:51:56.631 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ 2024-05-28T05:51:56.631 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 8897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-28T05:51:56.631 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-28T05:51:56.631 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-28T05:51:56.631 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-28T05:51:56.631 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-28T05:51:56.632 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-28T05:51:56.632 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-28T05:51:56.632 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-28T05:51:56.632 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-28T05:51:56.632 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 8833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-28T05:51:56.632 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 8769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-28T05:51:56.632 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-28T05:51:56.632 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-28T05:51:56.632 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-28T05:51:56.632 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-28T05:51:56.632 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-28T05:51:56.632 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-28T05:51:56.632 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-28T05:51:56.632 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-28T05:51:56.633 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-28T05:51:56.633 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 70521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtables.ko 2024-05-28T05:51:56.633 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-28T05:51:56.633 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-28T05:51:56.633 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/ 2024-05-28T05:51:56.633 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 1243369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/libceph.ko 2024-05-28T05:51:56.633 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/core/ 2024-05-28T05:51:56.633 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 153793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/core/pktgen.ko 2024-05-28T05:51:56.633 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/ 2024-05-28T05:51:56.633 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 244825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp.ko 2024-05-28T05:51:56.633 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_diag.ko 2024-05-28T05:51:56.633 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 71025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv4.ko 2024-05-28T05:51:56.633 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 74985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv6.ko 2024-05-28T05:51:56.634 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/ 2024-05-28T05:51:56.634 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 507649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/dsa_core.ko 2024-05-28T05:51:56.634 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_brcm.ko 2024-05-28T05:51:56.634 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_dsa.ko 2024-05-28T05:51:56.634 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 8865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_none.ko 2024-05-28T05:51:56.634 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_trailer.ko 2024-05-28T05:51:56.634 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/hsr/ 2024-05-28T05:51:56.634 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 128577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/hsr/hsr.ko 2024-05-28T05:51:56.634 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ 2024-05-28T05:51:56.634 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ 2024-05-28T05:51:56.634 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 55481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-28T05:51:56.634 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 357369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154.ko 2024-05-28T05:51:56.634 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 59385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-28T05:51:56.635 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ 2024-05-28T05:51:56.635 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ah4.ko 2024-05-28T05:51:56.635 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 46409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/esp4.ko 2024-05-28T05:51:56.635 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 60217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/fou.ko 2024-05-28T05:51:56.635 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/gre.ko 2024-05-28T05:51:56.635 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 65657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/inet_diag.ko 2024-05-28T05:51:56.635 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 75481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_gre.ko 2024-05-28T05:51:56.635 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 77713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_tunnel.ko 2024-05-28T05:51:56.635 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 43697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_vti.ko 2024-05-28T05:51:56.635 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipcomp.ko 2024-05-28T05:51:56.635 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 34737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipip.ko 2024-05-28T05:51:56.635 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ 2024-05-28T05:51:56.635 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 45513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-28T05:51:56.635 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-28T05:51:56.636 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-28T05:51:56.636 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 50161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ip_tables.ko 2024-05-28T05:51:56.636 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-28T05:51:56.636 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-05-28T05:51:56.636 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-28T05:51:56.636 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-28T05:51:56.636 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-28T05:51:56.636 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-05-28T05:51:56.636 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-28T05:51:56.636 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-28T05:51:56.636 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-28T05:51:56.636 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-28T05:51:56.636 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-28T05:51:56.637 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-28T05:51:56.637 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 32401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-28T05:51:56.637 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-28T05:51:56.637 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-28T05:51:56.637 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-05-28T05:51:56.637 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-28T05:51:56.637 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-28T05:51:56.637 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-28T05:51:56.637 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-28T05:51:56.637 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-28T05:51:56.637 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_bic.ko 2024-05-28T05:51:56.637 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_dctcp.ko 2024-05-28T05:51:56.637 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_diag.ko 2024-05-28T05:51:56.637 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_highspeed.ko 2024-05-28T05:51:56.638 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_htcp.ko 2024-05-28T05:51:56.638 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_hybla.ko 2024-05-28T05:51:56.638 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_illinois.ko 2024-05-28T05:51:56.638 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_lp.ko 2024-05-28T05:51:56.638 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_scalable.ko 2024-05-28T05:51:56.638 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_vegas.ko 2024-05-28T05:51:56.638 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_veno.ko 2024-05-28T05:51:56.638 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_westwood.ko 2024-05-28T05:51:56.638 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_yeah.ko 2024-05-28T05:51:56.638 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tunnel4.ko 2024-05-28T05:51:56.638 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_diag.ko 2024-05-28T05:51:56.638 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 54425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_tunnel.ko 2024-05-28T05:51:56.638 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-28T05:51:56.639 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ 2024-05-28T05:51:56.639 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 31065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ah6.ko 2024-05-28T05:51:56.639 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 47425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/esp6.ko 2024-05-28T05:51:56.639 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/fou6.ko 2024-05-28T05:51:56.639 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 103169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_gre.ko 2024-05-28T05:51:56.639 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 118873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_tunnel.ko 2024-05-28T05:51:56.639 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-28T05:51:56.639 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 71081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_vti.ko 2024-05-28T05:51:56.639 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ipcomp6.ko 2024-05-28T05:51:56.639 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/mip6.ko 2024-05-28T05:51:56.639 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ 2024-05-28T05:51:56.639 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 50729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-28T05:51:56.639 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-05-28T05:51:56.640 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-28T05:51:56.640 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-28T05:51:56.640 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-28T05:51:56.640 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 8713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-28T05:51:56.640 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-28T05:51:56.640 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-28T05:51:56.640 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-28T05:51:56.640 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-28T05:51:56.640 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-28T05:51:56.640 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-28T05:51:56.640 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-28T05:51:56.640 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-28T05:51:56.640 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-28T05:51:56.641 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-28T05:51:56.641 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-28T05:51:56.641 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 46297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-28T05:51:56.641 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-28T05:51:56.641 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 29809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-28T05:51:56.641 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-28T05:51:56.641 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-28T05:51:56.641 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-28T05:51:56.641 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-28T05:51:56.641 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-28T05:51:56.641 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 94081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/sit.ko 2024-05-28T05:51:56.641 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 30289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/tunnel6.ko 2024-05-28T05:51:56.641 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-28T05:51:56.641 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/key/ 2024-05-28T05:51:56.642 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 106361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/key/af_key.ko 2024-05-28T05:51:56.642 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/ 2024-05-28T05:51:56.642 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 153209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_core.ko 2024-05-28T05:51:56.642 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-28T05:51:56.642 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 32041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_eth.ko 2024-05-28T05:51:56.642 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 43633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip.ko 2024-05-28T05:51:56.642 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 44985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip6.ko 2024-05-28T05:51:56.642 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 42041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_netlink.ko 2024-05-28T05:51:56.642 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 66233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ppp.ko 2024-05-28T05:51:56.642 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/lapb/ 2024-05-28T05:51:56.642 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 63321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/lapb/lapb.ko 2024-05-28T05:51:56.642 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/ 2024-05-28T05:51:56.642 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 27369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc.ko 2024-05-28T05:51:56.643 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 332817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc2.ko 2024-05-28T05:51:56.643 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/ 2024-05-28T05:51:56.643 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 388817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/mac802154.ko 2024-05-28T05:51:56.643 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/ 2024-05-28T05:51:56.643 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/mpls_gso.ko 2024-05-28T05:51:56.643 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ 2024-05-28T05:51:56.643 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ 2024-05-28T05:51:56.643 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 147729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set.ko 2024-05-28T05:51:56.643 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 34465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-28T05:51:56.643 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-28T05:51:56.643 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 32545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-28T05:51:56.643 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 124033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-28T05:51:56.643 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 124337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-28T05:51:56.644 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 126673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-28T05:51:56.644 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 126465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-28T05:51:56.644 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 137825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-28T05:51:56.644 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 72345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-28T05:51:56.644 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 133673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-28T05:51:56.644 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 139065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-28T05:51:56.644 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 138257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-28T05:51:56.644 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 136169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-28T05:51:56.644 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 139889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-28T05:51:56.644 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 37121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-28T05:51:56.644 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ 2024-05-28T05:51:56.644 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 534033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-28T05:51:56.645 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-28T05:51:56.645 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 8793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-28T05:51:56.645 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-28T05:51:56.645 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-28T05:51:56.645 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-28T05:51:56.645 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 8793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-28T05:51:56.645 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 8857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-28T05:51:56.645 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-28T05:51:56.645 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-28T05:51:56.645 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 8913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-28T05:51:56.645 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-28T05:51:56.645 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 8913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-28T05:51:56.645 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-28T05:51:56.645 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 55209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conncount.ko 2024-05-28T05:51:56.646 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 496713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack.ko 2024-05-28T05:51:56.646 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-28T05:51:56.646 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-28T05:51:56.646 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 37857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-28T05:51:56.646 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 134361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-28T05:51:56.646 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-28T05:51:56.646 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-28T05:51:56.646 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 140793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-28T05:51:56.646 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 38297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-28T05:51:56.646 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-28T05:51:56.646 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 79865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-28T05:51:56.646 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-28T05:51:56.646 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-28T05:51:56.647 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-28T05:51:56.647 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 117385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table.ko 2024-05-28T05:51:56.647 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-28T05:51:56.647 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 46097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_log_syslog.ko 2024-05-28T05:51:56.647 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 118337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat.ko 2024-05-28T05:51:56.647 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-28T05:51:56.647 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-28T05:51:56.647 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_irc.ko 2024-05-28T05:51:56.647 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 34601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_sip.ko 2024-05-28T05:51:56.647 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-28T05:51:56.647 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 53385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-28T05:51:56.647 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 811705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_tables.ko 2024-05-28T05:51:56.647 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 53041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink.ko 2024-05-28T05:51:56.648 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 36473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-28T05:51:56.648 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 37201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-05-28T05:51:56.648 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 49289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_log.ko 2024-05-28T05:51:56.648 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-28T05:51:56.648 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 65137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-28T05:51:56.648 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_chain_nat.ko 2024-05-28T05:51:56.648 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 41761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_compat.ko 2024-05-28T05:51:56.648 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 50649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_ct.ko 2024-05-28T05:51:56.648 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-28T05:51:56.648 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fib.ko 2024-05-28T05:51:56.648 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-28T05:51:56.648 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_hash.ko 2024-05-28T05:51:56.648 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_limit.ko 2024-05-28T05:51:56.648 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_log.ko 2024-05-28T05:51:56.649 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_masq.ko 2024-05-28T05:51:56.649 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_nat.ko 2024-05-28T05:51:56.649 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_numgen.ko 2024-05-28T05:51:56.649 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_osf.ko 2024-05-28T05:51:56.649 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_queue.ko 2024-05-28T05:51:56.649 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_redir.ko 2024-05-28T05:51:56.649 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject.ko 2024-05-28T05:51:56.649 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject_inet.ko 2024-05-28T05:51:56.649 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_socket.ko 2024-05-28T05:51:56.649 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 24985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_synproxy.ko 2024-05-28T05:51:56.649 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_tproxy.ko 2024-05-28T05:51:56.649 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 108385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/x_tables.ko 2024-05-28T05:51:56.650 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_AUDIT.ko 2024-05-28T05:51:56.650 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-28T05:51:56.650 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-28T05:51:56.650 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-28T05:51:56.650 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 21857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CT.ko 2024-05-28T05:51:56.650 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_DSCP.ko 2024-05-28T05:51:56.650 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HL.ko 2024-05-28T05:51:56.650 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HMARK.ko 2024-05-28T05:51:56.650 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 45209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-28T05:51:56.650 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LED.ko 2024-05-28T05:51:56.650 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LOG.ko 2024-05-28T05:51:56.650 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-28T05:51:56.650 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NETMAP.ko 2024-05-28T05:51:56.650 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFLOG.ko 2024-05-28T05:51:56.651 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-28T05:51:56.651 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_RATEEST.ko 2024-05-28T05:51:56.651 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-28T05:51:56.651 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_SECMARK.ko 2024-05-28T05:51:56.651 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-28T05:51:56.651 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-28T05:51:56.651 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TEE.ko 2024-05-28T05:51:56.651 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TPROXY.ko 2024-05-28T05:51:56.651 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TRACE.ko 2024-05-28T05:51:56.651 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_addrtype.ko 2024-05-28T05:51:56.651 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_bpf.ko 2024-05-28T05:51:56.651 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cgroup.ko 2024-05-28T05:51:56.651 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cluster.ko 2024-05-28T05:51:56.651 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 8457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_comment.ko 2024-05-28T05:51:56.652 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connbytes.ko 2024-05-28T05:51:56.652 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlabel.ko 2024-05-28T05:51:56.652 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlimit.ko 2024-05-28T05:51:56.652 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connmark.ko 2024-05-28T05:51:56.652 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_conntrack.ko 2024-05-28T05:51:56.652 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 8905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cpu.ko 2024-05-28T05:51:56.652 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dccp.ko 2024-05-28T05:51:56.652 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 8993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_devgroup.ko 2024-05-28T05:51:56.652 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dscp.ko 2024-05-28T05:51:56.652 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ecn.ko 2024-05-28T05:51:56.652 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_esp.ko 2024-05-28T05:51:56.652 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 52809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hashlimit.ko 2024-05-28T05:51:56.652 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_helper.ko 2024-05-28T05:51:56.653 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hl.ko 2024-05-28T05:51:56.653 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipcomp.ko 2024-05-28T05:51:56.653 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_iprange.ko 2024-05-28T05:51:56.653 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipvs.ko 2024-05-28T05:51:56.653 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_l2tp.ko 2024-05-28T05:51:56.653 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_length.ko 2024-05-28T05:51:56.653 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_limit.ko 2024-05-28T05:51:56.653 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 8441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mac.ko 2024-05-28T05:51:56.653 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mark.ko 2024-05-28T05:51:56.653 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_multiport.ko 2024-05-28T05:51:56.653 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 16153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nat.ko 2024-05-28T05:51:56.653 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nfacct.ko 2024-05-28T05:51:56.653 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_osf.ko 2024-05-28T05:51:56.654 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_owner.ko 2024-05-28T05:51:56.654 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_physdev.ko 2024-05-28T05:51:56.654 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_pkttype.ko 2024-05-28T05:51:56.654 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_policy.ko 2024-05-28T05:51:56.654 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_quota.ko 2024-05-28T05:51:56.654 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 11873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_rateest.ko 2024-05-28T05:51:56.654 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_realm.ko 2024-05-28T05:51:56.654 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 43457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_recent.ko 2024-05-28T05:51:56.654 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_sctp.ko 2024-05-28T05:51:56.654 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 36481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_set.ko 2024-05-28T05:51:56.654 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 19769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_socket.ko 2024-05-28T05:51:56.654 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_state.ko 2024-05-28T05:51:56.654 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_statistic.ko 2024-05-28T05:51:56.655 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_string.ko 2024-05-28T05:51:56.655 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpmss.ko 2024-05-28T05:51:56.655 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpudp.ko 2024-05-28T05:51:56.655 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_time.ko 2024-05-28T05:51:56.655 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_u32.ko 2024-05-28T05:51:56.655 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/ 2024-05-28T05:51:56.655 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 17225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/netlink_diag.ko 2024-05-28T05:51:56.655 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/ 2024-05-28T05:51:56.655 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 14241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/nsh.ko 2024-05-28T05:51:56.655 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/ 2024-05-28T05:51:56.655 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 488457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/openvswitch.ko 2024-05-28T05:51:56.655 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-geneve.ko 2024-05-28T05:51:56.655 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 10865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-gre.ko 2024-05-28T05:51:56.656 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-vxlan.ko 2024-05-28T05:51:56.656 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/ 2024-05-28T05:51:56.656 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/af_packet_diag.ko 2024-05-28T05:51:56.656 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/ 2024-05-28T05:51:56.656 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 141993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/phonet.ko 2024-05-28T05:51:56.656 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 68801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/pn_pep.ko 2024-05-28T05:51:56.656 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/ 2024-05-28T05:51:56.656 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 318537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds.ko 2024-05-28T05:51:56.656 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 202249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_rdma.ko 2024-05-28T05:51:56.656 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 85073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_tcp.ko 2024-05-28T05:51:56.656 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rxrpc/ 2024-05-28T05:51:56.656 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 1028129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rxrpc/rxrpc.ko 2024-05-28T05:51:56.656 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/ 2024-05-28T05:51:56.656 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 38993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_csum.ko 2024-05-28T05:51:56.657 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 28713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_gact.ko 2024-05-28T05:51:56.657 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 45401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_mirred.ko 2024-05-28T05:51:56.657 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 27585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_nat.ko 2024-05-28T05:51:56.657 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 53457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_pedit.ko 2024-05-28T05:51:56.657 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 38633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_police.ko 2024-05-28T05:51:56.657 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_simple.ko 2024-05-28T05:51:56.657 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 43409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_skbedit.ko 2024-05-28T05:51:56.657 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 45665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_vlan.ko 2024-05-28T05:51:56.657 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 32121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_basic.ko 2024-05-28T05:51:56.657 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 41449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_bpf.ko 2024-05-28T05:51:56.657 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_cgroup.ko 2024-05-28T05:51:56.657 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 37297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_flow.ko 2024-05-28T05:51:56.657 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 39593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_fw.ko 2024-05-28T05:51:56.658 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 49313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_route.ko 2024-05-28T05:51:56.658 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 79137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_u32.ko 2024-05-28T05:51:56.658 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 8705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_cmp.ko 2024-05-28T05:51:56.658 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 15377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_ipset.ko 2024-05-28T05:51:56.658 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 48777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_meta.ko 2024-05-28T05:51:56.658 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_nbyte.ko 2024-05-28T05:51:56.658 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_text.ko 2024-05-28T05:51:56.658 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 8305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_u32.ko 2024-05-28T05:51:56.658 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_choke.ko 2024-05-28T05:51:56.658 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 25089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_codel.ko 2024-05-28T05:51:56.658 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 43473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_drr.ko 2024-05-28T05:51:56.658 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 43145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq.ko 2024-05-28T05:51:56.658 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 39169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq_codel.ko 2024-05-28T05:51:56.658 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 42881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_gred.ko 2024-05-28T05:51:56.659 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 62809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hfsc.ko 2024-05-28T05:51:56.659 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hhf.ko 2024-05-28T05:51:56.659 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 81825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_htb.ko 2024-05-28T05:51:56.659 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_ingress.ko 2024-05-28T05:51:56.659 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 36617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio.ko 2024-05-28T05:51:56.659 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio_lib.ko 2024-05-28T05:51:56.659 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_multiq.ko 2024-05-28T05:51:56.659 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 44785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_netem.ko 2024-05-28T05:51:56.659 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 32825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_pie.ko 2024-05-28T05:51:56.659 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 13497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_plug.ko 2024-05-28T05:51:56.659 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 31793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_prio.ko 2024-05-28T05:51:56.659 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 60241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_qfq.ko 2024-05-28T05:51:56.659 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 40881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_red.ko 2024-05-28T05:51:56.659 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 33425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfb.ko 2024-05-28T05:51:56.660 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 38321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfq.ko 2024-05-28T05:51:56.660 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 35769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_tbf.ko 2024-05-28T05:51:56.660 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 34153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_teql.ko 2024-05-28T05:51:56.660 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/ 2024-05-28T05:51:56.660 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 1187153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp.ko 2024-05-28T05:51:56.660 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp_diag.ko 2024-05-28T05:51:56.660 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/ 2024-05-28T05:51:56.660 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/ 2024-05-28T05:51:56.660 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 432225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-28T05:51:56.660 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 70081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-28T05:51:56.660 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 1940753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/sunrpc.ko 2024-05-28T05:51:56.660 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/ 2024-05-28T05:51:56.660 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 889729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-28T05:51:56.661 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/ 2024-05-28T05:51:56.661 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 1122273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc.ko 2024-05-28T05:51:56.661 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc_diag.ko 2024-05-28T05:51:56.661 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/ 2024-05-28T05:51:56.661 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 18793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/unix_diag.ko 2024-05-28T05:51:56.661 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/ 2024-05-28T05:51:56.661 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 105601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-28T05:51:56.661 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 90249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-28T05:51:56.661 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 123745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock.ko 2024-05-28T05:51:56.661 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 12897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-28T05:51:56.661 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-28T05:51:56.661 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/x25/ 2024-05-28T05:51:56.661 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 165777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/x25/x25.ko 2024-05-28T05:51:56.662 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/ 2024-05-28T05:51:56.662 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 26721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_algo.ko 2024-05-28T05:51:56.662 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-28T05:51:56.662 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 131857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_user.ko 2024-05-28T05:51:56.662 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 646387 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.alias 2024-05-28T05:51:56.662 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 630543 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.alias.bin 2024-05-28T05:51:56.662 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 7706 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin 2024-05-28T05:51:56.662 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 23609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.alias.bin 2024-05-28T05:51:56.662 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 9941 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.bin 2024-05-28T05:51:56.662 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 70990 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.modinfo 2024-05-28T05:51:56.662 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 146985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.dep 2024-05-28T05:51:56.662 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 232892 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.dep.bin 2024-05-28T05:51:56.662 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 210 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.devname 2024-05-28T05:51:56.663 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 72627 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.order 2024-05-28T05:51:56.663 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 879 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.softdep 2024-05-28T05:51:56.663 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 258450 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.symbols 2024-05-28T05:51:56.663 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 313019 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.symbols.bin 2024-05-28T05:51:56.663 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/ 2024-05-28T05:51:56.663 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/ 2024-05-28T05:51:56.663 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/doc/ 2024-05-28T05:51:56.663 INFO:teuthology.orchestra.run.smithi122.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/ 2024-05-28T05:51:56.663 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 171 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/changelog.Debian.gz 2024-05-28T05:51:56.663 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r-- root/root 691 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/copyright 2024-05-28T05:51:56.668 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-gb9459a26b088 2024-05-28T05:51:56.668 INFO:teuthology.task.kernel:searching for kernel 6.9.0-gb9459a26b088 2024-05-28T05:51:56.668 DEBUG:teuthology.orchestra.run.smithi122:> egrep '(submenu|menuentry.*6.9.0-gb9459a26b088).*{' /boot/grub/grub.cfg 2024-05-28T05:51:56.674 INFO:teuthology.orchestra.run.smithi122.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-28T05:51:56.674 INFO:teuthology.orchestra.run.smithi122.stdout: menuentry 'Ubuntu, with Linux 6.9.0-gb9459a26b088' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-gb9459a26b088-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-28T05:51:56.675 INFO:teuthology.orchestra.run.smithi122.stdout: menuentry 'Ubuntu, with Linux 6.9.0-gb9459a26b088 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-gb9459a26b088-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-28T05:51:56.675 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-05-28T05:51:56.675 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-gb9459a26b088 2024-05-28T05:51:56.675 DEBUG:teuthology.orchestra.run.smithi122:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-05-28T05:51:56.718 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi122.front.sepia.ceph.com to complete... 2024-05-28T05:51:57.076 INFO:teuthology.orchestra.run.smithi122.stderr:Sourcing file `/etc/default/grub' 2024-05-28T05:51:57.077 INFO:teuthology.orchestra.run.smithi122.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-28T05:51:57.110 INFO:teuthology.orchestra.run.smithi122.stderr:Generating grub configuration file ... 2024-05-28T05:51:57.282 INFO:teuthology.orchestra.run.smithi122.stderr:Found linux image: /boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-28T05:51:57.288 INFO:teuthology.orchestra.run.smithi122.stderr:Found initrd image: /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-28T05:51:57.561 INFO:teuthology.orchestra.run.smithi122.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-28T05:51:57.567 INFO:teuthology.orchestra.run.smithi122.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-28T05:51:57.608 INFO:teuthology.orchestra.run.smithi122.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-28T05:51:57.613 INFO:teuthology.orchestra.run.smithi122.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-28T05:51:57.752 INFO:teuthology.orchestra.run.smithi122.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-28T05:51:57.753 INFO:teuthology.orchestra.run.smithi122.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-28T05:51:57.753 INFO:teuthology.orchestra.run.smithi122.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-28T05:51:57.776 INFO:teuthology.orchestra.run.smithi122.stderr:done 2024-05-28T05:51:58.907 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-05-28T05:52:26.307 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-05-28T05:52:26.308 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-05-28T05:52:26.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-28T05:52:28.911 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-28T05:52:28.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-05-28T05:52:28.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-28T05:53:00.959 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-05-28T05:53:03.518 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-05-28T05:53:09.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-05-28T05:53:09.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-28T05:53:12.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-05-28T05:53:12.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-28T05:53:28.354 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-05-28T05:53:30.910 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-05-28T05:53:40.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-05-28T05:53:40.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-28T05:53:41.300 ERROR:teuthology.orchestra.connection:Error authenticating with smithi153.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/virtualenv/lib/python3.10/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2024-05-28T05:53:42.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-05-28T05:53:42.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-28T05:53:42.916 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-05-28T05:53:45.383 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-05-28T05:53:46.671 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-05-28T05:53:46.672 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-gb9459a26b088"... 2024-05-28T05:53:46.672 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-05-28T05:53:46.725 INFO:teuthology.orchestra.run.smithi153.stdout:6.9.0-gb9459a26b088 2024-05-28T05:53:46.725 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-gb9459a26b088 vs 6.9.0-gb9459a26b088 2024-05-28T05:53:46.725 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-28T05:53:46.725 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-28T05:53:47.729 DEBUG:teuthology.parallel:result is None 2024-05-28T05:53:57.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-05-28T05:53:57.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-28T05:53:58.145 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-05-28T05:53:58.810 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-05-28T05:53:58.810 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-gb9459a26b088"... 2024-05-28T05:53:58.810 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-05-28T05:53:58.861 INFO:teuthology.orchestra.run.smithi122.stdout:6.9.0-gb9459a26b088 2024-05-28T05:53:58.861 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-gb9459a26b088 vs 6.9.0-gb9459a26b088 2024-05-28T05:53:58.861 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-28T05:53:58.861 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-28T05:53:59.864 DEBUG:teuthology.parallel:result is None 2024-05-28T05:53:59.865 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-28T05:53:59.873 INFO:teuthology.task.internal:Creating test directory... 2024-05-28T05:53:59.873 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-28T05:53:59.877 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-28T05:53:59.886 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-28T05:53:59.892 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-28T05:53:59.900 INFO:teuthology.task.internal:Creating archive directory... 2024-05-28T05:53:59.900 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-28T05:53:59.928 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-28T05:53:59.956 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-28T05:53:59.963 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-28T05:53:59.963 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-28T05:53:59.989 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-28T05:54:00.075 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-28T05:54:00.083 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-28T05:54:00.092 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-28T05:54:00.112 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-28T05:54:00.114 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-28T05:54:00.122 INFO:teuthology.task.internal:Configuring sudo... 2024-05-28T05:54:00.122 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-28T05:54:00.126 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-28T05:54:00.147 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-28T05:54:00.156 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-28T05:54:00.157 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-28T05:54:00.192 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-28T05:54:00.202 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-28T05:54:00.250 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-28T05:54:00.305 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T05:54:00.306 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-28T05:54:00.378 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-28T05:54:00.387 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-28T05:54:00.437 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T05:54:00.438 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-28T05:54:00.502 DEBUG:teuthology.orchestra.run.smithi122:> sudo service rsyslog restart 2024-05-28T05:54:00.505 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2024-05-28T05:54:00.659 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-28T05:54:00.666 INFO:teuthology.task.internal:Starting timer... 2024-05-28T05:54:00.666 INFO:teuthology.run_tasks:Running task pcp... 2024-05-28T05:54:00.677 INFO:teuthology.run_tasks:Running task selinux... 2024-05-28T05:54:00.685 DEBUG:teuthology.task.selinux:Excluding smithi122: OS 'ubuntu' does not support SELinux 2024-05-28T05:54:00.686 DEBUG:teuthology.task.selinux:Excluding smithi153: OS 'ubuntu' does not support SELinux 2024-05-28T05:54:00.686 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-28T05:54:00.686 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-28T05:54:00.686 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-28T05:54:00.686 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-28T05:54:00.694 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-28T05:54:00.709 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-28T05:54:00.710 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi122.front.sepia.ceph.com,smithi153.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-28T06:01:45.174 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi122.front.sepia.ceph.com'), Remote(name='ubuntu@smithi153.front.sepia.ceph.com')] 2024-05-28T06:01:45.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-05-28T06:01:45.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-28T06:01:45.259 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-05-28T06:01:45.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-05-28T06:01:45.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-05-28T06:01:45.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-28T06:01:45.461 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-05-28T06:01:45.577 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-05-28T06:01:45.578 INFO:teuthology.run_tasks:Running task clock... 2024-05-28T06:01:45.589 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-28T06:01:45.589 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-28T06:01:45.590 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-28T06:01:45.593 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-28T06:01:45.593 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-28T06:01:45.629 INFO:teuthology.orchestra.run.smithi122.stdout:28 May 06:01:45 ntpd[17566]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-28T06:01:45.630 INFO:teuthology.orchestra.run.smithi122.stdout:28 May 06:01:45 ntpd[17566]: Command line: ntpd -gq 2024-05-28T06:01:45.630 INFO:teuthology.orchestra.run.smithi122.stdout:28 May 06:01:45 ntpd[17566]: ---------------------------------------------------- 2024-05-28T06:01:45.630 INFO:teuthology.orchestra.run.smithi122.stdout:28 May 06:01:45 ntpd[17566]: ntp-4 is maintained by Network Time Foundation, 2024-05-28T06:01:45.630 INFO:teuthology.orchestra.run.smithi122.stdout:28 May 06:01:45 ntpd[17566]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-28T06:01:45.630 INFO:teuthology.orchestra.run.smithi122.stdout:28 May 06:01:45 ntpd[17566]: corporation. Support and training for ntp-4 are 2024-05-28T06:01:45.630 INFO:teuthology.orchestra.run.smithi122.stdout:28 May 06:01:45 ntpd[17566]: available at https://www.nwtime.org/support 2024-05-28T06:01:45.630 INFO:teuthology.orchestra.run.smithi122.stdout:28 May 06:01:45 ntpd[17566]: ---------------------------------------------------- 2024-05-28T06:01:45.631 INFO:teuthology.orchestra.run.smithi122.stdout:28 May 06:01:45 ntpd[17566]: proto: precision = 0.044 usec (-24) 2024-05-28T06:01:45.631 INFO:teuthology.orchestra.run.smithi122.stdout:28 May 06:01:45 ntpd[17566]: basedate set to 2022-02-04 2024-05-28T06:01:45.631 INFO:teuthology.orchestra.run.smithi122.stdout:28 May 06:01:45 ntpd[17566]: gps base set to 2022-02-06 (week 2196) 2024-05-28T06:01:45.631 INFO:teuthology.orchestra.run.smithi122.stdout:28 May 06:01:45 ntpd[17566]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-28T06:01:45.631 INFO:teuthology.orchestra.run.smithi122.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-28T06:01:45.631 INFO:teuthology.orchestra.run.smithi122.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-28T06:01:45.632 INFO:teuthology.orchestra.run.smithi122.stdout:28 May 06:01:45 ntpd[17566]: restrict ::: KOD does nothing without LIMITED. 2024-05-28T06:01:45.632 INFO:teuthology.orchestra.run.smithi122.stdout:28 May 06:01:45 ntpd[17566]: Listen and drop on 0 v6wildcard [::]:123 2024-05-28T06:01:45.633 INFO:teuthology.orchestra.run.smithi122.stdout:28 May 06:01:45 ntpd[17566]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-28T06:01:45.633 INFO:teuthology.orchestra.run.smithi122.stdout:28 May 06:01:45 ntpd[17566]: Listen normally on 2 lo 127.0.0.1:123 2024-05-28T06:01:45.633 INFO:teuthology.orchestra.run.smithi122.stdout:28 May 06:01:45 ntpd[17566]: Listen normally on 3 enp3s0f1 172.21.15.122:123 2024-05-28T06:01:45.633 INFO:teuthology.orchestra.run.smithi122.stdout:28 May 06:01:45 ntpd[17566]: Listen normally on 4 lo [::1]:123 2024-05-28T06:01:45.633 INFO:teuthology.orchestra.run.smithi122.stdout:28 May 06:01:45 ntpd[17566]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d515%5]:123 2024-05-28T06:01:45.633 INFO:teuthology.orchestra.run.smithi122.stdout:28 May 06:01:45 ntpd[17566]: Listening on routing socket on fd #22 for interface updates 2024-05-28T06:01:45.656 INFO:teuthology.orchestra.run.smithi153.stdout:28 May 06:01:45 ntpd[17624]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-28T06:01:45.657 INFO:teuthology.orchestra.run.smithi153.stdout:28 May 06:01:45 ntpd[17624]: Command line: ntpd -gq 2024-05-28T06:01:45.657 INFO:teuthology.orchestra.run.smithi153.stdout:28 May 06:01:45 ntpd[17624]: ---------------------------------------------------- 2024-05-28T06:01:45.657 INFO:teuthology.orchestra.run.smithi153.stdout:28 May 06:01:45 ntpd[17624]: ntp-4 is maintained by Network Time Foundation, 2024-05-28T06:01:45.657 INFO:teuthology.orchestra.run.smithi153.stdout:28 May 06:01:45 ntpd[17624]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-28T06:01:45.657 INFO:teuthology.orchestra.run.smithi153.stdout:28 May 06:01:45 ntpd[17624]: corporation. Support and training for ntp-4 are 2024-05-28T06:01:45.657 INFO:teuthology.orchestra.run.smithi153.stdout:28 May 06:01:45 ntpd[17624]: available at https://www.nwtime.org/support 2024-05-28T06:01:45.657 INFO:teuthology.orchestra.run.smithi153.stdout:28 May 06:01:45 ntpd[17624]: ---------------------------------------------------- 2024-05-28T06:01:45.658 INFO:teuthology.orchestra.run.smithi153.stdout:28 May 06:01:45 ntpd[17624]: proto: precision = 0.040 usec (-24) 2024-05-28T06:01:45.658 INFO:teuthology.orchestra.run.smithi153.stdout:28 May 06:01:45 ntpd[17624]: basedate set to 2022-02-04 2024-05-28T06:01:45.658 INFO:teuthology.orchestra.run.smithi153.stdout:28 May 06:01:45 ntpd[17624]: gps base set to 2022-02-06 (week 2196) 2024-05-28T06:01:45.658 INFO:teuthology.orchestra.run.smithi153.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-28T06:01:45.658 INFO:teuthology.orchestra.run.smithi153.stdout:28 May 06:01:45 ntpd[17624]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-28T06:01:45.659 INFO:teuthology.orchestra.run.smithi153.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-28T06:01:45.660 INFO:teuthology.orchestra.run.smithi153.stdout:28 May 06:01:45 ntpd[17624]: restrict ::: KOD does nothing without LIMITED. 2024-05-28T06:01:45.660 INFO:teuthology.orchestra.run.smithi153.stdout:28 May 06:01:45 ntpd[17624]: Listen and drop on 0 v6wildcard [::]:123 2024-05-28T06:01:45.660 INFO:teuthology.orchestra.run.smithi153.stdout:28 May 06:01:45 ntpd[17624]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-28T06:01:45.660 INFO:teuthology.orchestra.run.smithi153.stdout:28 May 06:01:45 ntpd[17624]: Listen normally on 2 lo 127.0.0.1:123 2024-05-28T06:01:45.660 INFO:teuthology.orchestra.run.smithi153.stdout:28 May 06:01:45 ntpd[17624]: Listen normally on 3 enp3s0f1 172.21.15.153:123 2024-05-28T06:01:45.660 INFO:teuthology.orchestra.run.smithi153.stdout:28 May 06:01:45 ntpd[17624]: Listen normally on 4 lo [::1]:123 2024-05-28T06:01:45.660 INFO:teuthology.orchestra.run.smithi153.stdout:28 May 06:01:45 ntpd[17624]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6deb%5]:123 2024-05-28T06:01:45.660 INFO:teuthology.orchestra.run.smithi153.stdout:28 May 06:01:45 ntpd[17624]: Listening on routing socket on fd #22 for interface updates 2024-05-28T06:01:46.630 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:46 ntpd[17566]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:46.630 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:46 ntpd[17566]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:46.630 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:46 ntpd[17566]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:46.630 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:46 ntpd[17566]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:46.631 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:46 ntpd[17566]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:46.631 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:46 ntpd[17566]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:46.631 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:46 ntpd[17566]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-28T06:01:46.631 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:46 ntpd[17566]: can't open /var/log/ntpstats/peerstats.20240528: Permission denied 2024-05-28T06:01:46.657 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:46 ntpd[17624]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:46.657 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:46 ntpd[17624]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:46.657 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:46 ntpd[17624]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:46.657 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:46 ntpd[17624]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:46.657 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:46 ntpd[17624]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-28T06:01:46.657 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:46 ntpd[17624]: can't open /var/log/ntpstats/peerstats.20240528: Permission denied 2024-05-28T06:01:47.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:47 ntpd[17624]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:47.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:47 ntpd[17624]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:47.659 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:47 ntpd[17624]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:47.659 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:47 ntpd[17624]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:47.659 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:47 ntpd[17624]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:47.659 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:47 ntpd[17624]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:47.659 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:47 ntpd[17624]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-28T06:01:47.659 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:47 ntpd[17624]: can't open /var/log/ntpstats/peerstats.20240528: Permission denied 2024-05-28T06:01:47.659 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:47 ntpd[17624]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:47.659 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:47 ntpd[17624]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:47.659 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:47 ntpd[17624]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-28T06:01:47.659 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:47 ntpd[17624]: can't open /var/log/ntpstats/peerstats.20240528: Permission denied 2024-05-28T06:01:48.630 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:48 ntpd[17566]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:48.630 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:48 ntpd[17566]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:48.630 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:48 ntpd[17566]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:48.631 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:48 ntpd[17566]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:48.631 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:48 ntpd[17566]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-28T06:01:48.631 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:48 ntpd[17566]: can't open /var/log/ntpstats/peerstats.20240528: Permission denied 2024-05-28T06:01:48.657 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:48 ntpd[17624]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:48.657 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:48 ntpd[17624]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:48.657 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:48 ntpd[17624]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:48.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:48 ntpd[17624]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:48.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:48 ntpd[17624]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:48.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:48 ntpd[17624]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:48.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:48 ntpd[17624]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-28T06:01:48.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:48 ntpd[17624]: can't open /var/log/ntpstats/peerstats.20240528: Permission denied 2024-05-28T06:01:49.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:49 ntpd[17624]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:49.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:49 ntpd[17624]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:49.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:49 ntpd[17624]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:49.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:49 ntpd[17624]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:49.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:49 ntpd[17624]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:49.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:49 ntpd[17624]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:49.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:49 ntpd[17624]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-28T06:01:49.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:49 ntpd[17624]: can't open /var/log/ntpstats/peerstats.20240528: Permission denied 2024-05-28T06:01:49.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:49 ntpd[17624]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:49.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:49 ntpd[17624]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:49.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:49 ntpd[17624]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-28T06:01:49.659 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:49 ntpd[17624]: can't open /var/log/ntpstats/peerstats.20240528: Permission denied 2024-05-28T06:01:50.631 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:50 ntpd[17566]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:50.632 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:50 ntpd[17566]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:50.632 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:50 ntpd[17566]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:50.632 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:50 ntpd[17566]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:50.632 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:50 ntpd[17566]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:50.632 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:50 ntpd[17566]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:50.632 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:50 ntpd[17566]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:50.632 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:50 ntpd[17566]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:50.632 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:50 ntpd[17566]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-28T06:01:50.632 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:50 ntpd[17566]: can't open /var/log/ntpstats/peerstats.20240528: Permission denied 2024-05-28T06:01:50.632 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:50 ntpd[17566]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:50.633 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:50 ntpd[17566]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:50.633 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:50 ntpd[17566]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-28T06:01:50.633 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:50 ntpd[17566]: can't open /var/log/ntpstats/peerstats.20240528: Permission denied 2024-05-28T06:01:50.633 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:50 ntpd[17566]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:50.633 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:50 ntpd[17566]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:50.633 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:50 ntpd[17566]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-28T06:01:50.633 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:50 ntpd[17566]: can't open /var/log/ntpstats/peerstats.20240528: Permission denied 2024-05-28T06:01:50.657 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:50 ntpd[17624]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:50.657 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:50 ntpd[17624]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:50.657 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:50 ntpd[17624]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:50.657 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:50 ntpd[17624]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:50.657 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:50 ntpd[17624]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-28T06:01:50.657 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:50 ntpd[17624]: can't open /var/log/ntpstats/peerstats.20240528: Permission denied 2024-05-28T06:01:51.657 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:51 ntpd[17624]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:51.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:51 ntpd[17624]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:51.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:51 ntpd[17624]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:51.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:51 ntpd[17624]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:51.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:51 ntpd[17624]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:51.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:51 ntpd[17624]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:51.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:51 ntpd[17624]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-28T06:01:51.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:51 ntpd[17624]: can't open /var/log/ntpstats/peerstats.20240528: Permission denied 2024-05-28T06:01:51.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:51 ntpd[17624]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:51.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:51 ntpd[17624]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:51.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:51 ntpd[17624]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-28T06:01:51.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:51 ntpd[17624]: can't open /var/log/ntpstats/peerstats.20240528: Permission denied 2024-05-28T06:01:52.631 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:52 ntpd[17566]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:52.631 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:52 ntpd[17566]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:52.631 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:52 ntpd[17566]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:52.631 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:52 ntpd[17566]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:52.631 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:52 ntpd[17566]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:52.631 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:52 ntpd[17566]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:52.631 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:52 ntpd[17566]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:52.631 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:52 ntpd[17566]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:52.632 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:52 ntpd[17566]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-28T06:01:52.632 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:52 ntpd[17566]: can't open /var/log/ntpstats/peerstats.20240528: Permission denied 2024-05-28T06:01:52.632 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:52 ntpd[17566]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:52.632 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:52 ntpd[17566]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:52.632 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:52 ntpd[17566]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-28T06:01:52.632 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:52 ntpd[17566]: can't open /var/log/ntpstats/peerstats.20240528: Permission denied 2024-05-28T06:01:52.632 INFO:teuthology.orchestra.run.smithi122.stdout:28 May 06:01:52 ntpd[17566]: ntpd: time slew -0.000711 s 2024-05-28T06:01:52.632 INFO:teuthology.orchestra.run.smithi122.stdout:ntpd: time slew -0.000711s 2024-05-28T06:01:52.633 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:52 ntpd[17566]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-28T06:01:52.633 INFO:teuthology.orchestra.run.smithi122.stderr:28 May 06:01:52 ntpd[17566]: can't open /var/log/ntpstats/loopstats.20240528: Permission denied 2024-05-28T06:01:52.657 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:52 ntpd[17624]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:52.657 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:52 ntpd[17624]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:52.657 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:52 ntpd[17624]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-28T06:01:52.657 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:52 ntpd[17624]: can't open /var/log/ntpstats/rawstats.20240528: Permission denied 2024-05-28T06:01:52.657 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:52 ntpd[17624]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-28T06:01:52.657 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:52 ntpd[17624]: can't open /var/log/ntpstats/peerstats.20240528: Permission denied 2024-05-28T06:01:52.658 INFO:teuthology.orchestra.run.smithi153.stdout:28 May 06:01:52 ntpd[17624]: ntpd: time slew -0.001311 s 2024-05-28T06:01:52.658 INFO:teuthology.orchestra.run.smithi153.stdout:ntpd: time slew -0.001311s 2024-05-28T06:01:52.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:52 ntpd[17624]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-28T06:01:52.658 INFO:teuthology.orchestra.run.smithi153.stderr:28 May 06:01:52 ntpd[17624]: can't open /var/log/ntpstats/loopstats.20240528: Permission denied 2024-05-28T06:01:52.718 INFO:teuthology.orchestra.run.smithi122.stdout: remote refid st t when poll reach delay offset jitter 2024-05-28T06:01:52.718 INFO:teuthology.orchestra.run.smithi122.stdout:============================================================================== 2024-05-28T06:01:52.718 INFO:teuthology.orchestra.run.smithi122.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-28T06:01:52.718 INFO:teuthology.orchestra.run.smithi122.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-28T06:01:52.718 INFO:teuthology.orchestra.run.smithi122.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-28T06:01:52.719 INFO:teuthology.orchestra.run.smithi122.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-28T06:01:52.784 INFO:teuthology.orchestra.run.smithi153.stdout: remote refid st t when poll reach delay offset jitter 2024-05-28T06:01:52.784 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================== 2024-05-28T06:01:52.784 INFO:teuthology.orchestra.run.smithi153.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-28T06:01:52.784 INFO:teuthology.orchestra.run.smithi153.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-28T06:01:52.784 INFO:teuthology.orchestra.run.smithi153.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-28T06:01:52.784 INFO:teuthology.orchestra.run.smithi153.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-28T06:01:52.785 INFO:teuthology.run_tasks:Running task install... 2024-05-28T06:01:52.794 DEBUG:teuthology.task.install:project ceph 2024-05-28T06:01:52.794 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863'}} 2024-05-28T06:01:52.794 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863'} 2024-05-28T06:01:52.794 INFO:teuthology.task.install:Using flavor: default 2024-05-28T06:01:52.800 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-28T06:01:52.800 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-28T06:01:52.800 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-key list | grep Ceph 2024-05-28T06:01:52.801 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-key list | grep Ceph 2024-05-28T06:01:52.904 INFO:teuthology.orchestra.run.smithi122.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-28T06:01:52.925 INFO:teuthology.orchestra.run.smithi153.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-28T06:01:52.955 INFO:teuthology.orchestra.run.smithi122.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-28T06:01:52.955 INFO:teuthology.orchestra.run.smithi122.stdout:uid [ unknown] Ceph.com (release key) 2024-05-28T06:01:52.956 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-28T06:01:52.956 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-28T06:01:52.957 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9ed025fbf4406fb54980a0647506b15895b6d863 2024-05-28T06:01:52.975 INFO:teuthology.orchestra.run.smithi153.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-28T06:01:52.975 INFO:teuthology.orchestra.run.smithi153.stdout:uid [ unknown] Ceph.com (release key) 2024-05-28T06:01:52.976 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-28T06:01:52.977 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-28T06:01:52.977 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9ed025fbf4406fb54980a0647506b15895b6d863 2024-05-28T06:01:53.125 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default/ 2024-05-28T06:01:53.125 INFO:teuthology.task.install.deb:Package version is 19.0.0-3154-g9ed025fb-1jammy 2024-05-28T06:01:53.173 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default/ 2024-05-28T06:01:53.173 INFO:teuthology.task.install.deb:Package version is 19.0.0-3154-g9ed025fb-1jammy 2024-05-28T06:01:53.254 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:01:53.254 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-28T06:01:53.274 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2024-05-28T06:01:53.342 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:01:53.342 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-28T06:01:53.363 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-get update 2024-05-28T06:01:53.485 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-28T06:01:53.485 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-28T06:01:53.495 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-28T06:01:53.516 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-28T06:01:53.556 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-28T06:01:53.566 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-28T06:01:53.575 INFO:teuthology.orchestra.run.smithi153.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy InRelease 2024-05-28T06:01:53.584 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-28T06:01:53.600 INFO:teuthology.orchestra.run.smithi122.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy InRelease 2024-05-28T06:01:53.614 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-28T06:01:53.621 INFO:teuthology.orchestra.run.smithi122.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-28T06:01:53.643 INFO:teuthology.orchestra.run.smithi122.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-28T06:01:53.651 INFO:teuthology.orchestra.run.smithi153.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-28T06:01:53.664 INFO:teuthology.orchestra.run.smithi122.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-05-28T06:01:53.675 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-28T06:01:53.687 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-05-28T06:01:53.697 INFO:teuthology.orchestra.run.smithi122.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,409 B] 2024-05-28T06:01:53.742 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,409 B] 2024-05-28T06:01:54.076 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 29.2 kB in 1s (50.2 kB/s) 2024-05-28T06:01:54.145 INFO:teuthology.orchestra.run.smithi122.stdout:Fetched 29.2 kB in 1s (52.4 kB/s) 2024-05-28T06:01:55.076 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-05-28T06:01:55.091 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3154-g9ed025fb-1jammy cephadm=19.0.0-3154-g9ed025fb-1jammy ceph-mds=19.0.0-3154-g9ed025fb-1jammy ceph-mgr=19.0.0-3154-g9ed025fb-1jammy ceph-common=19.0.0-3154-g9ed025fb-1jammy ceph-fuse=19.0.0-3154-g9ed025fb-1jammy ceph-test=19.0.0-3154-g9ed025fb-1jammy ceph-volume=19.0.0-3154-g9ed025fb-1jammy radosgw=19.0.0-3154-g9ed025fb-1jammy python3-rados=19.0.0-3154-g9ed025fb-1jammy python3-rgw=19.0.0-3154-g9ed025fb-1jammy python3-cephfs=19.0.0-3154-g9ed025fb-1jammy python3-rbd=19.0.0-3154-g9ed025fb-1jammy libcephfs2=19.0.0-3154-g9ed025fb-1jammy libcephfs-dev=19.0.0-3154-g9ed025fb-1jammy librados2=19.0.0-3154-g9ed025fb-1jammy librbd1=19.0.0-3154-g9ed025fb-1jammy rbd-fuse=19.0.0-3154-g9ed025fb-1jammy python3-cephfs=19.0.0-3154-g9ed025fb-1jammy cephfs-shell=19.0.0-3154-g9ed025fb-1jammy cephfs-top=19.0.0-3154-g9ed025fb-1jammy cephfs-mirror=19.0.0-3154-g9ed025fb-1jammy 2024-05-28T06:01:55.137 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-05-28T06:01:55.151 DEBUG:teuthology.orchestra.run.smithi122:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3154-g9ed025fb-1jammy cephadm=19.0.0-3154-g9ed025fb-1jammy ceph-mds=19.0.0-3154-g9ed025fb-1jammy ceph-mgr=19.0.0-3154-g9ed025fb-1jammy ceph-common=19.0.0-3154-g9ed025fb-1jammy ceph-fuse=19.0.0-3154-g9ed025fb-1jammy ceph-test=19.0.0-3154-g9ed025fb-1jammy ceph-volume=19.0.0-3154-g9ed025fb-1jammy radosgw=19.0.0-3154-g9ed025fb-1jammy python3-rados=19.0.0-3154-g9ed025fb-1jammy python3-rgw=19.0.0-3154-g9ed025fb-1jammy python3-cephfs=19.0.0-3154-g9ed025fb-1jammy python3-rbd=19.0.0-3154-g9ed025fb-1jammy libcephfs2=19.0.0-3154-g9ed025fb-1jammy libcephfs-dev=19.0.0-3154-g9ed025fb-1jammy librados2=19.0.0-3154-g9ed025fb-1jammy librbd1=19.0.0-3154-g9ed025fb-1jammy rbd-fuse=19.0.0-3154-g9ed025fb-1jammy python3-cephfs=19.0.0-3154-g9ed025fb-1jammy cephfs-shell=19.0.0-3154-g9ed025fb-1jammy cephfs-top=19.0.0-3154-g9ed025fb-1jammy cephfs-mirror=19.0.0-3154-g9ed025fb-1jammy 2024-05-28T06:01:55.164 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-05-28T06:01:55.225 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-05-28T06:01:55.340 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-05-28T06:01:55.341 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-05-28T06:01:55.402 INFO:teuthology.orchestra.run.smithi122.stdout:Building dependency tree... 2024-05-28T06:01:55.403 INFO:teuthology.orchestra.run.smithi122.stdout:Reading state information... 2024-05-28T06:01:55.516 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-05-28T06:01:55.516 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-28T06:01:55.516 INFO:teuthology.orchestra.run.smithi153.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-28T06:01:55.516 INFO:teuthology.orchestra.run.smithi153.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-28T06:01:55.517 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-28T06:01:55.517 INFO:teuthology.orchestra.run.smithi153.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-28T06:01:55.517 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-28T06:01:55.518 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-05-28T06:01:55.518 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-28T06:01:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-28T06:01:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-28T06:01:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-28T06:01:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-28T06:01:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-28T06:01:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-28T06:01:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-28T06:01:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-28T06:01:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-28T06:01:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-28T06:01:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-28T06:01:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-28T06:01:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-28T06:01:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-28T06:01:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-28T06:01:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-28T06:01:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-28T06:01:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-28T06:01:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-28T06:01:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-28T06:01:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-28T06:01:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-28T06:01:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-05-28T06:01:55.521 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-05-28T06:01:55.521 INFO:teuthology.orchestra.run.smithi153.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-28T06:01:55.521 INFO:teuthology.orchestra.run.smithi153.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-28T06:01:55.521 INFO:teuthology.orchestra.run.smithi153.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-28T06:01:55.521 INFO:teuthology.orchestra.run.smithi153.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-28T06:01:55.521 INFO:teuthology.orchestra.run.smithi153.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-28T06:01:55.521 INFO:teuthology.orchestra.run.smithi153.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-28T06:01:55.521 INFO:teuthology.orchestra.run.smithi153.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-28T06:01:55.521 INFO:teuthology.orchestra.run.smithi153.stdout:Recommended packages: 2024-05-28T06:01:55.521 INFO:teuthology.orchestra.run.smithi153.stdout: btrfs-tools 2024-05-28T06:01:55.576 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages were automatically installed and are no longer required: 2024-05-28T06:01:55.577 INFO:teuthology.orchestra.run.smithi122.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-28T06:01:55.577 INFO:teuthology.orchestra.run.smithi122.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-28T06:01:55.577 INFO:teuthology.orchestra.run.smithi122.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-28T06:01:55.577 INFO:teuthology.orchestra.run.smithi122.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-28T06:01:55.578 INFO:teuthology.orchestra.run.smithi122.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-28T06:01:55.578 INFO:teuthology.orchestra.run.smithi122.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-28T06:01:55.578 INFO:teuthology.orchestra.run.smithi122.stdout:The following additional packages will be installed: 2024-05-28T06:01:55.578 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-28T06:01:55.578 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-28T06:01:55.578 INFO:teuthology.orchestra.run.smithi122.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-28T06:01:55.578 INFO:teuthology.orchestra.run.smithi122.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-28T06:01:55.580 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-28T06:01:55.580 INFO:teuthology.orchestra.run.smithi122.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-28T06:01:55.580 INFO:teuthology.orchestra.run.smithi122.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-28T06:01:55.580 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-28T06:01:55.580 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-28T06:01:55.580 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-28T06:01:55.580 INFO:teuthology.orchestra.run.smithi122.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-28T06:01:55.580 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-28T06:01:55.580 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-28T06:01:55.580 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-28T06:01:55.580 INFO:teuthology.orchestra.run.smithi122.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-28T06:01:55.581 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-28T06:01:55.581 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-28T06:01:55.581 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-28T06:01:55.581 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-28T06:01:55.581 INFO:teuthology.orchestra.run.smithi122.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-28T06:01:55.581 INFO:teuthology.orchestra.run.smithi122.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-28T06:01:55.581 INFO:teuthology.orchestra.run.smithi122.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-28T06:01:55.581 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-28T06:01:55.581 INFO:teuthology.orchestra.run.smithi122.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-05-28T06:01:55.581 INFO:teuthology.orchestra.run.smithi122.stdout:Suggested packages: 2024-05-28T06:01:55.582 INFO:teuthology.orchestra.run.smithi122.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-28T06:01:55.582 INFO:teuthology.orchestra.run.smithi122.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-28T06:01:55.582 INFO:teuthology.orchestra.run.smithi122.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-28T06:01:55.582 INFO:teuthology.orchestra.run.smithi122.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-28T06:01:55.582 INFO:teuthology.orchestra.run.smithi122.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-28T06:01:55.582 INFO:teuthology.orchestra.run.smithi122.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-28T06:01:55.582 INFO:teuthology.orchestra.run.smithi122.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-28T06:01:55.582 INFO:teuthology.orchestra.run.smithi122.stdout:Recommended packages: 2024-05-28T06:01:55.582 INFO:teuthology.orchestra.run.smithi122.stdout: btrfs-tools 2024-05-28T06:01:55.678 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-05-28T06:01:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-28T06:01:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-28T06:01:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-28T06:01:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-28T06:01:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-28T06:01:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-28T06:01:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-05-28T06:01:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-28T06:01:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-28T06:01:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-28T06:01:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-28T06:01:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-28T06:01:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-28T06:01:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-28T06:01:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-28T06:01:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-28T06:01:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-28T06:01:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-28T06:01:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-28T06:01:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-28T06:01:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-28T06:01:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-28T06:01:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-28T06:01:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-28T06:01:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-28T06:01:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-28T06:01:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-28T06:01:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: socat unzip xmlstarlet zip 2024-05-28T06:01:55.736 INFO:teuthology.orchestra.run.smithi122.stdout:The following NEW packages will be installed: 2024-05-28T06:01:55.737 INFO:teuthology.orchestra.run.smithi122.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-28T06:01:55.737 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-28T06:01:55.737 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-28T06:01:55.737 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-28T06:01:55.737 INFO:teuthology.orchestra.run.smithi122.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-28T06:01:55.737 INFO:teuthology.orchestra.run.smithi122.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-28T06:01:55.737 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-05-28T06:01:55.737 INFO:teuthology.orchestra.run.smithi122.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-28T06:01:55.738 INFO:teuthology.orchestra.run.smithi122.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-28T06:01:55.738 INFO:teuthology.orchestra.run.smithi122.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-28T06:01:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-28T06:01:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-28T06:01:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-28T06:01:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-28T06:01:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-28T06:01:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-28T06:01:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-28T06:01:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-28T06:01:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-28T06:01:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-28T06:01:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-28T06:01:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-28T06:01:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-28T06:01:55.739 INFO:teuthology.orchestra.run.smithi122.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-28T06:01:55.740 INFO:teuthology.orchestra.run.smithi122.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-28T06:01:55.740 INFO:teuthology.orchestra.run.smithi122.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-28T06:01:55.740 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-28T06:01:55.740 INFO:teuthology.orchestra.run.smithi122.stdout: socat unzip xmlstarlet zip 2024-05-28T06:01:55.877 INFO:teuthology.orchestra.run.smithi153.stdout:0 upgraded, 124 newly installed, 0 to remove and 310 not upgraded. 2024-05-28T06:01:55.877 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 182 MB of archives. 2024-05-28T06:01:55.877 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 831 MB of additional disk space will be used. 2024-05-28T06:01:55.877 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-28T06:01:55.887 INFO:teuthology.orchestra.run.smithi122.stdout:0 upgraded, 124 newly installed, 0 to remove and 310 not upgraded. 2024-05-28T06:01:55.887 INFO:teuthology.orchestra.run.smithi122.stdout:Need to get 182 MB of archives. 2024-05-28T06:01:55.887 INFO:teuthology.orchestra.run.smithi122.stdout:After this operation, 831 MB of additional disk space will be used. 2024-05-28T06:01:55.887 INFO:teuthology.orchestra.run.smithi122.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3154-g9ed025fb-1jammy [3,555 kB] 2024-05-28T06:01:55.908 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3154-g9ed025fb-1jammy [3,555 kB] 2024-05-28T06:01:55.933 INFO:teuthology.orchestra.run.smithi122.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-28T06:01:55.961 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-28T06:01:56.015 INFO:teuthology.orchestra.run.smithi122.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-28T06:01:56.019 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-28T06:01:56.061 INFO:teuthology.orchestra.run.smithi122.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-28T06:01:56.214 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-28T06:01:56.257 INFO:teuthology.orchestra.run.smithi122.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-28T06:01:56.309 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-28T06:01:56.323 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-28T06:01:56.352 INFO:teuthology.orchestra.run.smithi122.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-28T06:01:56.365 INFO:teuthology.orchestra.run.smithi122.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-28T06:01:56.375 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-28T06:01:56.381 INFO:teuthology.orchestra.run.smithi122.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3154-g9ed025fb-1jammy [3,224 kB] 2024-05-28T06:01:56.416 INFO:teuthology.orchestra.run.smithi122.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-28T06:01:56.441 INFO:teuthology.orchestra.run.smithi122.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3154-g9ed025fb-1jammy [712 kB] 2024-05-28T06:01:56.460 INFO:teuthology.orchestra.run.smithi122.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3154-g9ed025fb-1jammy [356 kB] 2024-05-28T06:01:56.478 INFO:teuthology.orchestra.run.smithi122.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3154-g9ed025fb-1jammy [32.8 kB] 2024-05-28T06:01:56.479 INFO:teuthology.orchestra.run.smithi122.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3154-g9ed025fb-1jammy [180 kB] 2024-05-28T06:01:56.481 INFO:teuthology.orchestra.run.smithi122.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3154-g9ed025fb-1jammy [66.9 kB] 2024-05-28T06:01:56.483 INFO:teuthology.orchestra.run.smithi122.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3154-g9ed025fb-1jammy [330 kB] 2024-05-28T06:01:56.491 INFO:teuthology.orchestra.run.smithi122.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3154-g9ed025fb-1jammy [6,895 kB] 2024-05-28T06:01:56.549 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-28T06:01:56.564 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-28T06:01:56.591 INFO:teuthology.orchestra.run.smithi122.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-28T06:01:56.592 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-28T06:01:56.600 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-28T06:01:56.604 INFO:teuthology.orchestra.run.smithi122.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-28T06:01:56.632 INFO:teuthology.orchestra.run.smithi122.stdout:Get:19 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3154-g9ed025fb-1jammy [112 kB] 2024-05-28T06:01:56.648 INFO:teuthology.orchestra.run.smithi122.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-28T06:01:56.656 INFO:teuthology.orchestra.run.smithi122.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-28T06:01:56.746 INFO:teuthology.orchestra.run.smithi122.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3154-g9ed025fb-1jammy [466 kB] 2024-05-28T06:01:56.766 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-28T06:01:56.820 INFO:teuthology.orchestra.run.smithi122.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-28T06:01:56.858 INFO:teuthology.orchestra.run.smithi122.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3154-g9ed025fb-1jammy [25.8 MB] 2024-05-28T06:01:57.350 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-28T06:01:57.365 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-28T06:01:57.381 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-28T06:01:57.390 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-28T06:01:57.390 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-28T06:01:57.407 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-28T06:01:57.409 INFO:teuthology.orchestra.run.smithi122.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-28T06:01:57.424 INFO:teuthology.orchestra.run.smithi122.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-28T06:01:57.440 INFO:teuthology.orchestra.run.smithi122.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-28T06:01:57.446 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-28T06:01:57.448 INFO:teuthology.orchestra.run.smithi122.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-28T06:01:57.449 INFO:teuthology.orchestra.run.smithi122.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-28T06:01:57.458 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-28T06:01:57.462 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-28T06:01:57.462 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-28T06:01:57.466 INFO:teuthology.orchestra.run.smithi122.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-28T06:01:57.503 INFO:teuthology.orchestra.run.smithi122.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-28T06:01:57.517 INFO:teuthology.orchestra.run.smithi122.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-28T06:01:57.521 INFO:teuthology.orchestra.run.smithi122.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-28T06:01:57.521 INFO:teuthology.orchestra.run.smithi122.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-28T06:01:57.581 INFO:teuthology.orchestra.run.smithi122.stdout:Get:35 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3154-g9ed025fb-1jammy [5,092 kB] 2024-05-28T06:01:57.588 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3154-g9ed025fb-1jammy [3,224 kB] 2024-05-28T06:01:57.636 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-28T06:01:57.692 INFO:teuthology.orchestra.run.smithi122.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-28T06:01:57.719 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-28T06:01:57.742 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-28T06:01:57.776 INFO:teuthology.orchestra.run.smithi122.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-28T06:01:57.786 INFO:teuthology.orchestra.run.smithi122.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3154-g9ed025fb-1jammy [247 kB] 2024-05-28T06:01:57.796 INFO:teuthology.orchestra.run.smithi122.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-28T06:01:57.800 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-28T06:01:57.837 INFO:teuthology.orchestra.run.smithi122.stdout:Get:40 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3154-g9ed025fb-1jammy [124 kB] 2024-05-28T06:01:57.852 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-28T06:01:57.855 INFO:teuthology.orchestra.run.smithi122.stdout:Get:41 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3154-g9ed025fb-1jammy [1,527 kB] 2024-05-28T06:01:57.858 INFO:teuthology.orchestra.run.smithi122.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-28T06:01:57.874 INFO:teuthology.orchestra.run.smithi153.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-28T06:01:57.898 INFO:teuthology.orchestra.run.smithi153.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-28T06:01:57.903 INFO:teuthology.orchestra.run.smithi122.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-28T06:01:57.903 INFO:teuthology.orchestra.run.smithi122.stdout:Get:44 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3154-g9ed025fb-1jammy [6,257 kB] 2024-05-28T06:01:57.926 INFO:teuthology.orchestra.run.smithi122.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-28T06:01:57.951 INFO:teuthology.orchestra.run.smithi122.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-28T06:01:58.017 INFO:teuthology.orchestra.run.smithi122.stdout:Get:47 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3154-g9ed025fb-1jammy [22.8 MB] 2024-05-28T06:01:58.084 INFO:teuthology.orchestra.run.smithi153.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-28T06:01:58.105 INFO:teuthology.orchestra.run.smithi153.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-28T06:01:58.106 INFO:teuthology.orchestra.run.smithi153.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-28T06:01:58.111 INFO:teuthology.orchestra.run.smithi153.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-28T06:01:58.130 INFO:teuthology.orchestra.run.smithi122.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-28T06:01:58.145 INFO:teuthology.orchestra.run.smithi122.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-28T06:01:58.152 INFO:teuthology.orchestra.run.smithi122.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-28T06:01:58.163 INFO:teuthology.orchestra.run.smithi122.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-28T06:01:58.299 INFO:teuthology.orchestra.run.smithi153.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-28T06:01:58.343 INFO:teuthology.orchestra.run.smithi122.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-28T06:01:58.383 INFO:teuthology.orchestra.run.smithi153.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-28T06:01:58.410 INFO:teuthology.orchestra.run.smithi153.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-28T06:01:58.425 INFO:teuthology.orchestra.run.smithi122.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-28T06:01:58.439 INFO:teuthology.orchestra.run.smithi122.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-28T06:01:58.598 INFO:teuthology.orchestra.run.smithi153.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-28T06:01:58.626 INFO:teuthology.orchestra.run.smithi122.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-28T06:01:58.648 INFO:teuthology.orchestra.run.smithi153.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-28T06:01:58.661 INFO:teuthology.orchestra.run.smithi153.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-28T06:01:58.676 INFO:teuthology.orchestra.run.smithi122.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-28T06:01:58.689 INFO:teuthology.orchestra.run.smithi122.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-28T06:01:58.724 INFO:teuthology.orchestra.run.smithi122.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3154-g9ed025fb-1jammy [14.1 kB] 2024-05-28T06:01:58.741 INFO:teuthology.orchestra.run.smithi122.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3154-g9ed025fb-1jammy [870 kB] 2024-05-28T06:01:58.767 INFO:teuthology.orchestra.run.smithi122.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3154-g9ed025fb-1jammy [2,436 kB] 2024-05-28T06:01:58.837 INFO:teuthology.orchestra.run.smithi122.stdout:Get:61 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3154-g9ed025fb-1jammy [791 kB] 2024-05-28T06:01:58.848 INFO:teuthology.orchestra.run.smithi122.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-28T06:01:58.849 INFO:teuthology.orchestra.run.smithi122.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-28T06:01:58.853 INFO:teuthology.orchestra.run.smithi122.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-28T06:01:58.859 INFO:teuthology.orchestra.run.smithi122.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-28T06:01:58.864 INFO:teuthology.orchestra.run.smithi122.stdout:Get:66 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3154-g9ed025fb-1jammy [148 kB] 2024-05-28T06:01:58.873 INFO:teuthology.orchestra.run.smithi122.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-28T06:01:58.887 INFO:teuthology.orchestra.run.smithi122.stdout:Get:68 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3154-g9ed025fb-1jammy [2,297 kB] 2024-05-28T06:01:58.962 INFO:teuthology.orchestra.run.smithi122.stdout:Get:69 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3154-g9ed025fb-1jammy [8,625 kB] 2024-05-28T06:01:58.990 INFO:teuthology.orchestra.run.smithi153.stdout:Get:42 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3154-g9ed025fb-1jammy [712 kB] 2024-05-28T06:01:59.058 INFO:teuthology.orchestra.run.smithi122.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-05-28T06:01:59.258 INFO:teuthology.orchestra.run.smithi122.stdout:Get:71 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3154-g9ed025fb-1jammy [14.2 kB] 2024-05-28T06:01:59.259 INFO:teuthology.orchestra.run.smithi122.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3154-g9ed025fb-1jammy [51.6 MB] 2024-05-28T06:01:59.268 INFO:teuthology.orchestra.run.smithi153.stdout:Get:43 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3154-g9ed025fb-1jammy [356 kB] 2024-05-28T06:01:59.273 INFO:teuthology.orchestra.run.smithi153.stdout:Get:44 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3154-g9ed025fb-1jammy [32.8 kB] 2024-05-28T06:01:59.315 INFO:teuthology.orchestra.run.smithi122.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-28T06:01:59.348 INFO:teuthology.orchestra.run.smithi153.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-28T06:01:59.353 INFO:teuthology.orchestra.run.smithi153.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-28T06:01:59.389 INFO:teuthology.orchestra.run.smithi153.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-28T06:01:59.448 INFO:teuthology.orchestra.run.smithi122.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-28T06:01:59.461 INFO:teuthology.orchestra.run.smithi153.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-28T06:01:59.496 INFO:teuthology.orchestra.run.smithi122.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-28T06:01:59.583 INFO:teuthology.orchestra.run.smithi122.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-28T06:01:59.593 INFO:teuthology.orchestra.run.smithi122.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-28T06:01:59.606 INFO:teuthology.orchestra.run.smithi122.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-28T06:01:59.649 INFO:teuthology.orchestra.run.smithi122.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-28T06:01:59.706 INFO:teuthology.orchestra.run.smithi153.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-28T06:01:59.911 INFO:teuthology.orchestra.run.smithi122.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-28T06:01:59.912 INFO:teuthology.orchestra.run.smithi122.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-28T06:01:59.913 INFO:teuthology.orchestra.run.smithi122.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-28T06:02:00.080 INFO:teuthology.orchestra.run.smithi122.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-28T06:02:00.266 INFO:teuthology.orchestra.run.smithi153.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-05-28T06:02:00.456 INFO:teuthology.orchestra.run.smithi122.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-28T06:02:00.535 INFO:teuthology.orchestra.run.smithi153.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-28T06:02:00.666 INFO:teuthology.orchestra.run.smithi153.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-28T06:02:00.731 INFO:teuthology.orchestra.run.smithi153.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-28T06:02:00.975 INFO:teuthology.orchestra.run.smithi153.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-28T06:02:01.142 INFO:teuthology.orchestra.run.smithi122.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3154-g9ed025fb-1jammy [124 kB] 2024-05-28T06:02:01.162 INFO:teuthology.orchestra.run.smithi122.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3154-g9ed025fb-1jammy [232 kB] 2024-05-28T06:02:01.166 INFO:teuthology.orchestra.run.smithi153.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-28T06:02:01.175 INFO:teuthology.orchestra.run.smithi153.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3154-g9ed025fb-1jammy [180 kB] 2024-05-28T06:02:01.179 INFO:teuthology.orchestra.run.smithi122.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3154-g9ed025fb-1jammy [33.9 kB] 2024-05-28T06:02:01.203 INFO:teuthology.orchestra.run.smithi122.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3154-g9ed025fb-1jammy [23.4 kB] 2024-05-28T06:02:01.218 INFO:teuthology.orchestra.run.smithi122.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3154-g9ed025fb-1jammy [38.9 kB] 2024-05-28T06:02:01.221 INFO:teuthology.orchestra.run.smithi122.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3154-g9ed025fb-1jammy [13.6 MB] 2024-05-28T06:02:01.247 INFO:teuthology.orchestra.run.smithi153.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-28T06:02:01.249 INFO:teuthology.orchestra.run.smithi153.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3154-g9ed025fb-1jammy [66.9 kB] 2024-05-28T06:02:01.284 INFO:teuthology.orchestra.run.smithi153.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3154-g9ed025fb-1jammy [330 kB] 2024-05-28T06:02:01.322 INFO:teuthology.orchestra.run.smithi153.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3154-g9ed025fb-1jammy [6,895 kB] 2024-05-28T06:02:01.598 INFO:teuthology.orchestra.run.smithi153.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-28T06:02:01.662 INFO:teuthology.orchestra.run.smithi122.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3154-g9ed025fb-1jammy [91.2 kB] 2024-05-28T06:02:01.784 INFO:teuthology.orchestra.run.smithi153.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3154-g9ed025fb-1jammy [112 kB] 2024-05-28T06:02:01.797 INFO:teuthology.orchestra.run.smithi153.stdout:Get:63 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3154-g9ed025fb-1jammy [466 kB] 2024-05-28T06:02:01.803 INFO:teuthology.orchestra.run.smithi153.stdout:Get:64 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3154-g9ed025fb-1jammy [25.8 MB] 2024-05-28T06:02:02.231 INFO:teuthology.orchestra.run.smithi153.stdout:Get:65 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3154-g9ed025fb-1jammy [5,092 kB] 2024-05-28T06:02:02.307 INFO:teuthology.orchestra.run.smithi153.stdout:Get:66 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3154-g9ed025fb-1jammy [247 kB] 2024-05-28T06:02:02.311 INFO:teuthology.orchestra.run.smithi153.stdout:Get:67 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3154-g9ed025fb-1jammy [124 kB] 2024-05-28T06:02:02.315 INFO:teuthology.orchestra.run.smithi153.stdout:Get:68 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3154-g9ed025fb-1jammy [1,527 kB] 2024-05-28T06:02:02.344 INFO:teuthology.orchestra.run.smithi153.stdout:Get:69 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3154-g9ed025fb-1jammy [6,257 kB] 2024-05-28T06:02:02.470 INFO:teuthology.orchestra.run.smithi153.stdout:Get:70 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3154-g9ed025fb-1jammy [22.8 MB] 2024-05-28T06:02:02.847 INFO:teuthology.orchestra.run.smithi153.stdout:Get:71 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3154-g9ed025fb-1jammy [14.1 kB] 2024-05-28T06:02:02.848 INFO:teuthology.orchestra.run.smithi153.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3154-g9ed025fb-1jammy [870 kB] 2024-05-28T06:02:02.856 INFO:teuthology.orchestra.run.smithi153.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3154-g9ed025fb-1jammy [2,436 kB] 2024-05-28T06:02:02.893 INFO:teuthology.orchestra.run.smithi153.stdout:Get:74 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3154-g9ed025fb-1jammy [791 kB] 2024-05-28T06:02:02.906 INFO:teuthology.orchestra.run.smithi153.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3154-g9ed025fb-1jammy [148 kB] 2024-05-28T06:02:02.908 INFO:teuthology.orchestra.run.smithi153.stdout:Get:76 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3154-g9ed025fb-1jammy [2,297 kB] 2024-05-28T06:02:02.947 INFO:teuthology.orchestra.run.smithi153.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3154-g9ed025fb-1jammy [8,625 kB] 2024-05-28T06:02:03.090 INFO:teuthology.orchestra.run.smithi153.stdout:Get:78 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3154-g9ed025fb-1jammy [14.2 kB] 2024-05-28T06:02:03.090 INFO:teuthology.orchestra.run.smithi153.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3154-g9ed025fb-1jammy [51.6 MB] 2024-05-28T06:02:03.952 INFO:teuthology.orchestra.run.smithi153.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3154-g9ed025fb-1jammy [124 kB] 2024-05-28T06:02:03.953 INFO:teuthology.orchestra.run.smithi153.stdout:Get:81 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3154-g9ed025fb-1jammy [232 kB] 2024-05-28T06:02:03.955 INFO:teuthology.orchestra.run.smithi153.stdout:Get:82 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3154-g9ed025fb-1jammy [33.9 kB] 2024-05-28T06:02:03.955 INFO:teuthology.orchestra.run.smithi153.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3154-g9ed025fb-1jammy [23.4 kB] 2024-05-28T06:02:03.956 INFO:teuthology.orchestra.run.smithi153.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3154-g9ed025fb-1jammy [38.9 kB] 2024-05-28T06:02:03.956 INFO:teuthology.orchestra.run.smithi153.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3154-g9ed025fb-1jammy [13.6 MB] 2024-05-28T06:02:04.171 INFO:teuthology.orchestra.run.smithi153.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3154-g9ed025fb-1jammy [91.2 kB] 2024-05-28T06:02:04.304 INFO:teuthology.orchestra.run.smithi122.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-28T06:02:04.677 INFO:teuthology.orchestra.run.smithi122.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-28T06:02:04.722 INFO:teuthology.orchestra.run.smithi122.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-28T06:02:06.447 INFO:teuthology.orchestra.run.smithi153.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-28T06:02:06.495 INFO:teuthology.orchestra.run.smithi153.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-28T06:02:06.556 INFO:teuthology.orchestra.run.smithi153.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-28T06:02:06.748 INFO:teuthology.orchestra.run.smithi153.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-28T06:02:07.093 INFO:teuthology.orchestra.run.smithi153.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-28T06:02:07.499 INFO:teuthology.orchestra.run.smithi153.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-28T06:02:07.505 INFO:teuthology.orchestra.run.smithi153.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-28T06:02:07.505 INFO:teuthology.orchestra.run.smithi153.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-28T06:02:07.599 INFO:teuthology.orchestra.run.smithi153.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-28T06:02:07.599 INFO:teuthology.orchestra.run.smithi153.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-28T06:02:07.600 INFO:teuthology.orchestra.run.smithi153.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-28T06:02:07.601 INFO:teuthology.orchestra.run.smithi153.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-28T06:02:07.602 INFO:teuthology.orchestra.run.smithi153.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-28T06:02:07.603 INFO:teuthology.orchestra.run.smithi153.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-28T06:02:07.768 INFO:teuthology.orchestra.run.smithi153.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-28T06:02:08.000 INFO:teuthology.orchestra.run.smithi153.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-28T06:02:08.175 INFO:teuthology.orchestra.run.smithi122.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-28T06:02:08.192 INFO:teuthology.orchestra.run.smithi122.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-28T06:02:08.344 INFO:teuthology.orchestra.run.smithi122.stdout:Ign:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 2024-05-28T06:02:08.508 INFO:teuthology.orchestra.run.smithi122.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-28T06:02:08.609 INFO:teuthology.orchestra.run.smithi153.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-28T06:02:08.631 INFO:teuthology.orchestra.run.smithi122.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-28T06:02:08.711 INFO:teuthology.orchestra.run.smithi122.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-28T06:02:08.777 INFO:teuthology.orchestra.run.smithi122.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-28T06:02:08.804 INFO:teuthology.orchestra.run.smithi122.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-28T06:02:08.843 INFO:teuthology.orchestra.run.smithi153.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-28T06:02:08.888 INFO:teuthology.orchestra.run.smithi122.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-28T06:02:09.021 INFO:teuthology.orchestra.run.smithi153.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-28T06:02:09.107 INFO:teuthology.orchestra.run.smithi153.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-28T06:02:09.525 INFO:teuthology.orchestra.run.smithi122.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-28T06:02:09.700 INFO:teuthology.orchestra.run.smithi153.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-28T06:02:09.875 INFO:teuthology.orchestra.run.smithi122.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-28T06:02:10.152 INFO:teuthology.orchestra.run.smithi122.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-28T06:02:10.209 INFO:teuthology.orchestra.run.smithi153.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-28T06:02:10.244 INFO:teuthology.orchestra.run.smithi153.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-28T06:02:10.280 INFO:teuthology.orchestra.run.smithi122.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-28T06:02:10.425 INFO:teuthology.orchestra.run.smithi153.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-28T06:02:10.481 INFO:teuthology.orchestra.run.smithi153.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-28T06:02:11.050 INFO:teuthology.orchestra.run.smithi122.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-28T06:02:11.380 INFO:teuthology.orchestra.run.smithi153.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-28T06:02:11.638 INFO:teuthology.orchestra.run.smithi153.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-28T06:02:11.864 INFO:teuthology.orchestra.run.smithi122.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-28T06:02:11.908 INFO:teuthology.orchestra.run.smithi153.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-28T06:02:11.911 INFO:teuthology.orchestra.run.smithi153.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-28T06:02:11.927 INFO:teuthology.orchestra.run.smithi153.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-28T06:02:11.932 INFO:teuthology.orchestra.run.smithi153.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-28T06:02:11.971 INFO:teuthology.orchestra.run.smithi153.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-28T06:02:11.986 INFO:teuthology.orchestra.run.smithi153.stdout:Get:119 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-28T06:02:12.049 INFO:teuthology.orchestra.run.smithi122.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-28T06:02:12.076 INFO:teuthology.orchestra.run.smithi153.stdout:Get:120 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-28T06:02:12.078 INFO:teuthology.orchestra.run.smithi153.stdout:Get:121 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-28T06:02:12.079 INFO:teuthology.orchestra.run.smithi153.stdout:Get:122 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-28T06:02:12.233 INFO:teuthology.orchestra.run.smithi122.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-28T06:02:12.260 INFO:teuthology.orchestra.run.smithi153.stdout:Get:123 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-28T06:02:12.270 INFO:teuthology.orchestra.run.smithi122.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-28T06:02:12.469 INFO:teuthology.orchestra.run.smithi122.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-28T06:02:12.478 INFO:teuthology.orchestra.run.smithi122.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-28T06:02:12.525 INFO:teuthology.orchestra.run.smithi122.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-28T06:02:12.526 INFO:teuthology.orchestra.run.smithi122.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-28T06:02:12.532 INFO:teuthology.orchestra.run.smithi122.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-28T06:02:12.533 INFO:teuthology.orchestra.run.smithi153.stdout:Get:124 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-28T06:02:12.535 INFO:teuthology.orchestra.run.smithi122.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-28T06:02:12.552 INFO:teuthology.orchestra.run.smithi122.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-28T06:02:12.723 INFO:teuthology.orchestra.run.smithi122.stdout:Get:119 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-28T06:02:13.333 INFO:teuthology.orchestra.run.smithi122.stdout:Get:120 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-28T06:02:13.334 INFO:teuthology.orchestra.run.smithi122.stdout:Get:121 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-28T06:02:13.336 INFO:teuthology.orchestra.run.smithi122.stdout:Get:122 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-28T06:02:13.353 INFO:teuthology.orchestra.run.smithi122.stdout:Get:123 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-28T06:02:13.356 INFO:teuthology.orchestra.run.smithi122.stdout:Get:124 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-28T06:02:13.515 INFO:teuthology.orchestra.run.smithi122.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-28T06:02:13.646 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 182 MB in 17s (10.5 MB/s) 2024-05-28T06:02:13.767 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-28T06:02:13.834 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132924 files and directories currently installed.) 2024-05-28T06:02:13.837 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-28T06:02:13.866 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-28T06:02:14.161 INFO:teuthology.orchestra.run.smithi122.stdout:Fetched 182 MB in 18s (10.2 MB/s) 2024-05-28T06:02:14.202 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-28T06:02:14.217 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-28T06:02:14.272 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-28T06:02:14.337 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-28T06:02:14.403 INFO:teuthology.orchestra.run.smithi122.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132924 files and directories currently installed.) 2024-05-28T06:02:14.407 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-28T06:02:14.451 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-28T06:02:14.539 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cmd2. 2024-05-28T06:02:14.552 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-28T06:02:14.597 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-28T06:02:14.729 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-28T06:02:14.743 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-28T06:02:14.780 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-28T06:02:14.933 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-28T06:02:14.946 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-28T06:02:15.025 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-28T06:02:15.141 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-cmd2. 2024-05-28T06:02:15.154 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-28T06:02:15.199 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-28T06:02:15.353 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-28T06:02:15.366 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-28T06:02:15.411 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-28T06:02:15.561 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-28T06:02:15.574 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-28T06:02:15.661 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-28T06:02:15.756 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-28T06:02:15.770 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-28T06:02:15.814 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-28T06:02:15.990 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-28T06:02:16.004 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-28T06:02:16.040 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-28T06:02:16.234 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-28T06:02:16.248 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-28T06:02:16.300 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-28T06:02:16.377 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-28T06:02:16.391 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-28T06:02:16.435 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-28T06:02:16.713 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-28T06:02:16.729 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-28T06:02:16.771 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-28T06:02:16.922 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-28T06:02:16.937 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-28T06:02:16.981 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-28T06:02:17.091 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-28T06:02:17.105 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-28T06:02:17.140 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-28T06:02:17.401 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-28T06:02:17.415 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-28T06:02:17.459 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-28T06:02:17.494 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-28T06:02:17.508 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-28T06:02:17.552 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-28T06:02:17.821 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-28T06:02:17.836 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-28T06:02:17.856 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librados2. 2024-05-28T06:02:17.870 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../010-librados2_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:17.888 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-28T06:02:17.913 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librados2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:18.234 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-28T06:02:18.248 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-28T06:02:18.283 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-28T06:02:18.366 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librbd1. 2024-05-28T06:02:18.381 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../011-librbd1_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:18.424 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librbd1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:18.586 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package librados2. 2024-05-28T06:02:18.601 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../010-librados2_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:18.645 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking librados2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:18.993 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcephfs2. 2024-05-28T06:02:19.008 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:19.043 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcephfs2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:19.081 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package librbd1. 2024-05-28T06:02:19.096 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../011-librbd1_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:19.140 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking librbd1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:19.321 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rados. 2024-05-28T06:02:19.336 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:19.379 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rados (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:19.699 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-28T06:02:19.713 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-28T06:02:19.759 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libcephfs2. 2024-05-28T06:02:19.774 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:19.794 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-ceph-argparse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:19.818 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libcephfs2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:20.051 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cephfs. 2024-05-28T06:02:20.066 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:20.109 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cephfs (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:20.112 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-rados. 2024-05-28T06:02:20.127 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:20.170 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-rados (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:20.387 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-28T06:02:20.402 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-28T06:02:20.446 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:20.482 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-28T06:02:20.497 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-28T06:02:20.540 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-ceph-argparse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:20.798 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-prettytable. 2024-05-28T06:02:20.814 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-28T06:02:20.818 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-cephfs. 2024-05-28T06:02:20.833 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:20.856 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-28T06:02:20.876 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-cephfs (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:21.126 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rbd. 2024-05-28T06:02:21.141 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:21.179 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-28T06:02:21.184 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rbd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:21.194 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-28T06:02:21.237 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:21.541 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-prettytable. 2024-05-28T06:02:21.555 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-28T06:02:21.562 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-28T06:02:21.577 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-28T06:02:21.599 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-28T06:02:21.620 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-28T06:02:21.848 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-28T06:02:21.863 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-28T06:02:21.885 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-rbd. 2024-05-28T06:02:21.898 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-28T06:02:21.900 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:21.944 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-rbd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:22.184 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-28T06:02:22.199 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-28T06:02:22.242 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-28T06:02:22.331 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-28T06:02:22.345 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-28T06:02:22.389 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-28T06:02:22.571 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua5.1. 2024-05-28T06:02:22.586 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-28T06:02:22.629 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-28T06:02:22.633 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-28T06:02:22.648 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-28T06:02:22.691 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-28T06:02:22.932 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua-any. 2024-05-28T06:02:22.947 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-28T06:02:22.982 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-28T06:02:22.986 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-28T06:02:23.001 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-28T06:02:23.045 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-28T06:02:23.243 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package zip. 2024-05-28T06:02:23.258 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-28T06:02:23.301 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking zip (3.0-12build2) ... 2024-05-28T06:02:23.399 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package lua5.1. 2024-05-28T06:02:23.413 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-28T06:02:23.457 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-28T06:02:23.648 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package unzip. 2024-05-28T06:02:23.663 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-28T06:02:23.706 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-28T06:02:23.744 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package lua-any. 2024-05-28T06:02:23.758 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-28T06:02:23.793 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-28T06:02:24.055 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package zip. 2024-05-28T06:02:24.069 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-28T06:02:24.076 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package luarocks. 2024-05-28T06:02:24.091 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-28T06:02:24.113 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking zip (3.0-12build2) ... 2024-05-28T06:02:24.126 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-28T06:02:24.408 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package unzip. 2024-05-28T06:02:24.423 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-28T06:02:24.466 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-28T06:02:24.517 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librgw2. 2024-05-28T06:02:24.531 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../027-librgw2_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:24.575 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librgw2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:24.896 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package luarocks. 2024-05-28T06:02:24.910 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-28T06:02:24.946 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-28T06:02:25.086 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rgw. 2024-05-28T06:02:25.101 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:25.144 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:25.363 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package librgw2. 2024-05-28T06:02:25.376 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../027-librgw2_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:25.421 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking librgw2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:25.472 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-28T06:02:25.487 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-28T06:02:25.530 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-28T06:02:25.825 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libradosstriper1. 2024-05-28T06:02:25.840 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:25.875 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libradosstriper1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:25.941 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-rgw. 2024-05-28T06:02:25.955 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:25.999 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-rgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:26.270 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-common. 2024-05-28T06:02:26.284 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:26.328 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:26.336 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-28T06:02:26.350 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-28T06:02:26.394 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-28T06:02:26.706 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libradosstriper1. 2024-05-28T06:02:26.720 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:26.764 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libradosstriper1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:27.193 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-common. 2024-05-28T06:02:27.207 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:27.251 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:27.467 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-base. 2024-05-28T06:02:27.482 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:27.534 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-base (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:28.079 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-28T06:02:28.092 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-28T06:02:28.173 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-28T06:02:28.382 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-base. 2024-05-28T06:02:28.397 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:28.449 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-base (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:28.481 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cheroot. 2024-05-28T06:02:28.495 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-28T06:02:28.540 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-28T06:02:29.610 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-28T06:02:29.625 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-28T06:02:29.659 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-28T06:02:29.937 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-28T06:02:29.952 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-28T06:02:29.995 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-28T06:02:30.029 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-28T06:02:30.043 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-28T06:02:30.087 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-28T06:02:30.307 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-28T06:02:30.322 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-28T06:02:30.357 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-cheroot. 2024-05-28T06:02:30.365 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-28T06:02:30.371 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-28T06:02:30.415 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-28T06:02:30.634 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-tempora. 2024-05-28T06:02:30.649 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-28T06:02:30.684 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-28T06:02:30.760 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-28T06:02:30.775 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-28T06:02:30.818 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-28T06:02:31.004 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-portend. 2024-05-28T06:02:31.018 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-28T06:02:31.062 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-28T06:02:31.147 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-28T06:02:31.161 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-28T06:02:31.205 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-28T06:02:31.373 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-28T06:02:31.388 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-28T06:02:31.431 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-28T06:02:31.475 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-28T06:02:31.490 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-28T06:02:31.525 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-28T06:02:31.709 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-28T06:02:31.724 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-28T06:02:31.759 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-28T06:02:31.845 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-tempora. 2024-05-28T06:02:31.859 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-28T06:02:31.903 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-28T06:02:32.104 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-natsort. 2024-05-28T06:02:32.119 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-28T06:02:32.162 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-28T06:02:32.206 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-portend. 2024-05-28T06:02:32.220 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-28T06:02:32.298 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-28T06:02:32.482 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-logutils. 2024-05-28T06:02:32.497 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-28T06:02:32.540 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-28T06:02:32.551 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-28T06:02:32.566 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-28T06:02:32.601 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-28T06:02:32.885 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-28T06:02:32.900 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-28T06:02:32.929 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-28T06:02:32.943 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-28T06:02:32.943 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-28T06:02:32.988 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-28T06:02:33.221 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-mako. 2024-05-28T06:02:33.236 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-28T06:02:33.271 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-28T06:02:33.343 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-natsort. 2024-05-28T06:02:33.358 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-28T06:02:33.422 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-28T06:02:33.632 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-28T06:02:33.647 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-28T06:02:33.682 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-28T06:02:33.755 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-logutils. 2024-05-28T06:02:33.770 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-28T06:02:33.813 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-28T06:02:33.935 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-28T06:02:33.949 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-28T06:02:33.984 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-28T06:02:34.166 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-28T06:02:34.181 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-28T06:02:34.225 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-28T06:02:34.312 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webob. 2024-05-28T06:02:34.327 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-28T06:02:34.370 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-28T06:02:34.503 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-mako. 2024-05-28T06:02:34.518 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-28T06:02:34.578 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-28T06:02:34.723 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-waitress. 2024-05-28T06:02:34.738 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-28T06:02:34.784 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-28T06:02:34.907 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-28T06:02:34.921 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-28T06:02:34.965 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-28T06:02:35.093 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-tempita. 2024-05-28T06:02:35.108 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-28T06:02:35.176 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-28T06:02:35.243 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-28T06:02:35.258 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-28T06:02:35.293 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-28T06:02:35.454 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-paste. 2024-05-28T06:02:35.469 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-28T06:02:35.504 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-28T06:02:35.596 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-webob. 2024-05-28T06:02:35.611 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-28T06:02:35.688 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-28T06:02:35.807 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-28T06:02:35.821 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-28T06:02:35.865 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-28T06:02:36.049 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-waitress. 2024-05-28T06:02:36.064 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-28T06:02:36.110 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-28T06:02:36.168 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-28T06:02:36.183 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-28T06:02:36.217 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-28T06:02:36.403 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-tempita. 2024-05-28T06:02:36.418 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-28T06:02:36.461 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-28T06:02:36.470 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webtest. 2024-05-28T06:02:36.485 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-28T06:02:36.520 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-28T06:02:36.764 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-paste. 2024-05-28T06:02:36.779 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-28T06:02:36.848 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-28T06:02:36.857 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pecan. 2024-05-28T06:02:36.872 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-28T06:02:36.915 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-28T06:02:37.143 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-28T06:02:37.157 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-28T06:02:37.202 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-28T06:02:37.277 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-certifi. 2024-05-28T06:02:37.293 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-28T06:02:37.336 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-28T06:02:37.530 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-28T06:02:37.545 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-28T06:02:37.588 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-28T06:02:37.655 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-idna. 2024-05-28T06:02:37.670 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-05-28T06:02:37.713 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-05-28T06:02:37.891 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-webtest. 2024-05-28T06:02:37.906 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-28T06:02:37.974 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-28T06:02:38.008 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-urllib3. 2024-05-28T06:02:38.023 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-28T06:02:38.058 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-28T06:02:38.244 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pecan. 2024-05-28T06:02:38.259 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-28T06:02:38.294 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-28T06:02:38.361 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-requests. 2024-05-28T06:02:38.376 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-28T06:02:38.411 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-28T06:02:38.666 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-certifi. 2024-05-28T06:02:38.680 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-28T06:02:38.689 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-28T06:02:38.704 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-28T06:02:38.725 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-28T06:02:38.738 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-28T06:02:39.033 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-28T06:02:39.048 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-28T06:02:39.078 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-idna. 2024-05-28T06:02:39.083 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:39.093 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-05-28T06:02:39.128 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-05-28T06:02:39.415 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-urllib3. 2024-05-28T06:02:39.429 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-28T06:02:39.473 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-28T06:02:39.496 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-28T06:02:39.510 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:39.554 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:39.818 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-requests. 2024-05-28T06:02:39.833 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-28T06:02:39.876 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-28T06:02:40.032 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-28T06:02:40.047 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-28T06:02:40.091 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-28T06:02:40.355 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-28T06:02:40.370 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-28T06:02:40.384 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-openssl. 2024-05-28T06:02:40.399 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-28T06:02:40.413 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-28T06:02:40.434 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-28T06:02:40.691 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-28T06:02:40.705 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-28T06:02:40.738 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr. 2024-05-28T06:02:40.752 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:40.758 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:40.796 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:41.124 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-28T06:02:41.136 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:41.180 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:41.217 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mon. 2024-05-28T06:02:41.231 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:41.274 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mon (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:41.525 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-28T06:02:41.538 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-28T06:02:41.575 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-28T06:02:41.852 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-osd. 2024-05-28T06:02:41.868 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:41.878 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-openssl. 2024-05-28T06:02:41.892 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-28T06:02:41.902 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-osd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:41.936 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-28T06:02:42.273 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr. 2024-05-28T06:02:42.288 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:42.331 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:42.597 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph. 2024-05-28T06:02:42.611 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../068-ceph_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:42.663 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:42.743 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mon. 2024-05-28T06:02:42.758 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:42.793 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mon (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:42.983 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-fuse. 2024-05-28T06:02:43.003 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:43.041 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:43.402 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mds. 2024-05-28T06:02:43.414 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-osd. 2024-05-28T06:02:43.417 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:43.428 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:43.472 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-osd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:43.485 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mds (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:43.838 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephadm. 2024-05-28T06:02:43.854 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../071-cephadm_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:43.888 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:44.191 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-28T06:02:44.206 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-28T06:02:44.249 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-28T06:02:44.258 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph. 2024-05-28T06:02:44.273 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../068-ceph_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:44.317 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:44.560 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-28T06:02:44.575 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-28T06:02:44.610 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-28T06:02:44.612 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-fuse. 2024-05-28T06:02:44.626 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:44.662 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:45.032 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mds. 2024-05-28T06:02:45.047 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:45.082 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mds (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:45.511 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package cephadm. 2024-05-28T06:02:45.531 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../071-cephadm_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:45.569 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:45.598 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-babel. 2024-05-28T06:02:45.611 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-28T06:02:45.656 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-28T06:02:45.905 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-28T06:02:45.920 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-28T06:02:45.950 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jinja2. 2024-05-28T06:02:45.963 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-28T06:02:45.964 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-28T06:02:46.009 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-28T06:02:46.275 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-28T06:02:46.290 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-28T06:02:46.324 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-28T06:02:46.345 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-28T06:02:46.359 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-28T06:02:46.395 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:46.723 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-28T06:02:46.738 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-28T06:02:46.781 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-28T06:02:47.067 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-routes. 2024-05-28T06:02:47.082 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-28T06:02:47.117 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-28T06:02:47.355 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-babel. 2024-05-28T06:02:47.369 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-28T06:02:47.404 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-28T06:02:47.413 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-28T06:02:47.419 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-28T06:02:47.453 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:47.708 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-jinja2. 2024-05-28T06:02:47.722 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-28T06:02:47.758 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-28T06:02:48.070 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-28T06:02:48.084 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-28T06:02:48.153 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:48.448 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-28T06:02:48.462 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-28T06:02:48.506 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-28T06:02:48.725 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-28T06:02:48.739 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-28T06:02:48.783 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-28T06:02:48.835 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-routes. 2024-05-28T06:02:48.849 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-28T06:02:48.893 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-28T06:02:49.245 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-joblib. 2024-05-28T06:02:49.259 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-28T06:02:49.263 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-28T06:02:49.279 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-28T06:02:49.294 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-28T06:02:49.321 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:49.631 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-28T06:02:49.645 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-28T06:02:49.767 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-28T06:02:50.086 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-sklearn. 2024-05-28T06:02:50.097 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-28T06:02:50.136 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-28T06:02:50.736 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-28T06:02:50.744 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-28T06:02:50.786 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:50.919 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-28T06:02:50.935 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-28T06:02:50.986 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-28T06:02:51.465 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-joblib. 2024-05-28T06:02:51.480 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-28T06:02:51.543 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-28T06:02:51.781 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cachetools. 2024-05-28T06:02:51.792 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-28T06:02:51.830 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-28T06:02:51.876 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-28T06:02:51.886 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-28T06:02:52.004 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-28T06:02:52.159 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-28T06:02:52.170 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-28T06:02:52.208 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-28T06:02:52.341 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-sklearn. 2024-05-28T06:02:52.356 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-28T06:02:52.399 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-28T06:02:52.520 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-28T06:02:52.530 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-28T06:02:52.569 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-28T06:02:52.864 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rsa. 2024-05-28T06:02:52.875 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-28T06:02:52.905 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-28T06:02:53.076 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-28T06:02:53.090 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-28T06:02:53.134 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:53.201 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-google-auth. 2024-05-28T06:02:53.212 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-28T06:02:53.251 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-28T06:02:53.596 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-28T06:02:53.607 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-28T06:02:53.645 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-28T06:02:53.957 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-websocket. 2024-05-28T06:02:53.967 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-28T06:02:54.007 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-28T06:02:54.154 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-cachetools. 2024-05-28T06:02:54.168 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-28T06:02:54.212 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-28T06:02:54.310 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-28T06:02:54.321 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-28T06:02:54.384 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-28T06:02:54.541 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-28T06:02:54.554 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-28T06:02:54.599 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-28T06:02:54.928 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-28T06:02:54.945 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-28T06:02:55.006 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-28T06:02:55.011 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-28T06:02:55.016 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-28T06:02:55.048 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:55.332 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-rsa. 2024-05-28T06:02:55.347 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-28T06:02:55.389 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-28T06:02:55.685 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-google-auth. 2024-05-28T06:02:55.699 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-28T06:02:55.709 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-28T06:02:55.720 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-28T06:02:55.743 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-28T06:02:55.760 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-28T06:02:56.106 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-28T06:02:56.120 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-28T06:02:56.121 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-28T06:02:56.133 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-28T06:02:56.164 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-28T06:02:56.170 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-28T06:02:56.415 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package jq. 2024-05-28T06:02:56.425 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-28T06:02:56.464 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-28T06:02:56.476 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-websocket. 2024-05-28T06:02:56.491 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-28T06:02:56.534 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-28T06:02:56.701 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package socat. 2024-05-28T06:02:56.711 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-28T06:02:56.750 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-28T06:02:56.855 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-28T06:02:56.870 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-28T06:02:56.904 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-28T06:02:57.072 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package xmlstarlet. 2024-05-28T06:02:57.084 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-28T06:02:57.128 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-28T06:02:57.499 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-test. 2024-05-28T06:02:57.509 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:57.548 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-test (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:57.619 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-28T06:02:57.633 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-28T06:02:57.677 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:58.039 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-28T06:02:58.053 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-28T06:02:58.097 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-28T06:02:58.383 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-28T06:02:58.398 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-28T06:02:58.450 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-28T06:02:58.712 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package jq. 2024-05-28T06:02:58.726 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-28T06:02:58.770 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-28T06:02:59.048 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package socat. 2024-05-28T06:02:59.062 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-28T06:02:59.106 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-28T06:02:59.409 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package xmlstarlet. 2024-05-28T06:02:59.424 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-28T06:02:59.460 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-28T06:02:59.545 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-volume. 2024-05-28T06:02:59.557 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-28T06:02:59.594 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-volume (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:59.831 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-test. 2024-05-28T06:02:59.845 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:02:59.889 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-test (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:02:59.973 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-28T06:02:59.983 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:03:00.023 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephfs-mirror (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:00.353 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-colorama. 2024-05-28T06:03:00.362 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-28T06:03:00.402 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-28T06:03:00.688 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephfs-shell. 2024-05-28T06:03:00.698 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-28T06:03:00.738 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephfs-shell (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:00.999 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephfs-top. 2024-05-28T06:03:01.012 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-28T06:03:01.082 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephfs-top (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:01.310 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-28T06:03:01.321 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:03:01.352 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcephfs-dev (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:01.654 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-28T06:03:01.665 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-28T06:03:01.704 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-28T06:03:02.036 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-volume. 2024-05-28T06:03:02.051 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-28T06:03:02.058 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-28T06:03:02.069 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-28T06:03:02.085 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-volume (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:02.108 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-28T06:03:02.437 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package nvme-cli. 2024-05-28T06:03:02.448 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-28T06:03:02.457 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-28T06:03:02.472 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:03:02.487 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-28T06:03:02.515 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking cephfs-mirror (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:02.826 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-colorama. 2024-05-28T06:03:02.841 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-28T06:03:02.885 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-28T06:03:02.933 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package pkg-config. 2024-05-28T06:03:02.944 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-28T06:03:02.983 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-28T06:03:03.179 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package cephfs-shell. 2024-05-28T06:03:03.194 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-28T06:03:03.236 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-28T06:03:03.238 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking cephfs-shell (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:03.247 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-28T06:03:03.286 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-28T06:03:03.524 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package cephfs-top. 2024-05-28T06:03:03.540 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-28T06:03:03.582 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking cephfs-top (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:03.705 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-28T06:03:03.716 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-28T06:03:03.755 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-28T06:03:03.818 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-28T06:03:03.834 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:03:03.877 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libcephfs-dev (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:04.000 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pastescript. 2024-05-28T06:03:04.011 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-28T06:03:04.049 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-28T06:03:04.222 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-28T06:03:04.237 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-28T06:03:04.279 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-28T06:03:04.384 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pluggy. 2024-05-28T06:03:04.395 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-28T06:03:04.438 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-28T06:03:04.618 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-28T06:03:04.634 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-28T06:03:04.694 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-28T06:03:04.731 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-psutil. 2024-05-28T06:03:04.742 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-28T06:03:04.780 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-28T06:03:05.081 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package nvme-cli. 2024-05-28T06:03:05.096 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-28T06:03:05.133 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-py. 2024-05-28T06:03:05.139 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-28T06:03:05.144 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-28T06:03:05.183 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-28T06:03:05.496 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pygments. 2024-05-28T06:03:05.506 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-28T06:03:05.544 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-28T06:03:05.553 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package pkg-config. 2024-05-28T06:03:05.567 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-28T06:03:05.602 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-28T06:03:05.882 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-28T06:03:05.896 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-28T06:03:05.939 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-28T06:03:05.973 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-28T06:03:05.983 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-28T06:03:06.046 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-28T06:03:06.367 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-toml. 2024-05-28T06:03:06.377 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-28T06:03:06.384 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-28T06:03:06.399 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-28T06:03:06.417 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-28T06:03:06.434 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-28T06:03:06.703 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pytest. 2024-05-28T06:03:06.713 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-28T06:03:06.721 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pastescript. 2024-05-28T06:03:06.736 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-28T06:03:06.753 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-28T06:03:06.779 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-28T06:03:07.108 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pluggy. 2024-05-28T06:03:07.115 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-simplejson. 2024-05-28T06:03:07.123 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-28T06:03:07.125 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-28T06:03:07.165 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-28T06:03:07.166 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-28T06:03:07.434 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-28T06:03:07.445 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-28T06:03:07.483 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-28T06:03:07.519 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-psutil. 2024-05-28T06:03:07.535 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-28T06:03:07.577 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-28T06:03:07.924 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-py. 2024-05-28T06:03:07.938 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-28T06:03:07.981 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-28T06:03:08.154 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package radosgw. 2024-05-28T06:03:08.164 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../122-radosgw_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:03:08.204 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking radosgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:08.326 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pygments. 2024-05-28T06:03:08.341 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-28T06:03:08.384 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-28T06:03:08.832 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package rbd-fuse. 2024-05-28T06:03:08.843 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:03:08.847 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-28T06:03:08.862 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-28T06:03:08.882 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking rbd-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:08.905 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-28T06:03:09.140 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-28T06:03:09.234 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-toml. 2024-05-28T06:03:09.248 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-28T06:03:09.292 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-28T06:03:09.437 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-28T06:03:09.563 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-28T06:03:09.595 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pytest. 2024-05-28T06:03:09.609 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-28T06:03:09.653 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-28T06:03:09.822 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-28T06:03:10.017 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-simplejson. 2024-05-28T06:03:10.032 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-28T06:03:10.075 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-28T06:03:10.218 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-28T06:03:10.370 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-28T06:03:10.384 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-28T06:03:10.428 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-28T06:03:10.815 INFO:teuthology.orchestra.run.smithi153.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-28T06:03:10.858 INFO:teuthology.orchestra.run.smithi153.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-05-28T06:03:10.997 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:11.165 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package radosgw. 2024-05-28T06:03:11.179 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../122-radosgw_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:03:11.223 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking radosgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:11.533 INFO:teuthology.orchestra.run.smithi153.stdout:Adding system user cephadm....done 2024-05-28T06:03:11.695 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-28T06:03:11.910 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package rbd-fuse. 2024-05-28T06:03:11.925 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-28T06:03:11.968 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking rbd-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:11.997 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-28T06:03:12.264 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-28T06:03:12.278 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-28T06:03:12.415 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-28T06:03:12.532 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-28T06:03:12.691 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-28T06:03:12.700 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-28T06:03:12.949 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-28T06:03:13.001 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-28T06:03:13.127 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-28T06:03:13.363 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-28T06:03:13.445 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-28T06:03:13.872 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-28T06:03:14.023 INFO:teuthology.orchestra.run.smithi122.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-28T06:03:14.080 INFO:teuthology.orchestra.run.smithi122.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-05-28T06:03:14.140 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-28T06:03:14.168 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:14.425 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-28T06:03:14.717 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-28T06:03:14.953 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-28T06:03:15.062 INFO:teuthology.orchestra.run.smithi122.stdout:Adding system user cephadm....done 2024-05-28T06:03:15.241 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-28T06:03:15.261 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-28T06:03:15.534 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-28T06:03:15.556 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-28T06:03:15.802 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-28T06:03:15.830 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-ceph-argparse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:15.928 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-28T06:03:16.123 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-28T06:03:16.187 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-28T06:03:16.232 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-28T06:03:16.333 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-28T06:03:16.455 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-28T06:03:16.573 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-28T06:03:16.618 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-28T06:03:16.752 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-28T06:03:16.883 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-28T06:03:17.011 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-28T06:03:17.251 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-28T06:03:17.401 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-28T06:03:17.441 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-28T06:03:17.506 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-28T06:03:17.519 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-28T06:03:17.623 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-28T06:03:17.795 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-28T06:03:18.016 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-28T06:03:18.125 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-28T06:03:18.188 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-28T06:03:18.393 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-28T06:03:18.448 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-28T06:03:18.678 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-28T06:03:18.716 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-28T06:03:18.984 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-28T06:03:19.012 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up zip (3.0-12build2) ... 2024-05-28T06:03:19.138 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-28T06:03:19.251 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-ceph-argparse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:19.536 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-28T06:03:19.687 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-28T06:03:19.813 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-28T06:03:19.823 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-28T06:03:20.072 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-28T06:03:20.083 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-28T06:03:20.192 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-28T06:03:20.206 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-28T06:03:20.343 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-28T06:03:20.482 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-28T06:03:20.661 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-28T06:03:20.898 INFO:teuthology.orchestra.run.smithi122.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-28T06:03:20.955 INFO:teuthology.orchestra.run.smithi122.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-28T06:03:21.019 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-28T06:03:21.096 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-28T06:03:21.145 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-28T06:03:21.371 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-28T06:03:21.513 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-28T06:03:21.630 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-28T06:03:21.773 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-28T06:03:21.924 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-28T06:03:22.116 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-28T06:03:22.191 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-28T06:03:22.425 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-28T06:03:22.517 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up zip (3.0-12build2) ... 2024-05-28T06:03:22.643 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-28T06:03:22.785 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-28T06:03:23.053 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-28T06:03:23.195 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:23.337 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-28T06:03:23.505 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-05-28T06:03:23.605 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-28T06:03:23.731 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-28T06:03:23.857 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-28T06:03:23.906 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-28T06:03:24.158 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-28T06:03:24.559 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-28T06:03:24.818 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-28T06:03:25.145 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-28T06:03:25.242 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-28T06:03:25.405 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-28T06:03:25.539 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-28T06:03:25.546 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-28T06:03:25.815 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-28T06:03:25.872 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-28T06:03:25.966 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-28T06:03:26.134 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-28T06:03:26.224 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-28T06:03:26.436 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-28T06:03:26.483 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-28T06:03:26.609 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:26.711 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-28T06:03:26.935 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-05-28T06:03:26.988 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-28T06:03:27.114 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-28T06:03:27.304 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-28T06:03:27.432 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-28T06:03:27.733 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-28T06:03:28.001 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-28T06:03:28.277 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-28T06:03:28.568 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-28T06:03:28.569 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-28T06:03:28.811 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-28T06:03:28.862 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-28T06:03:28.945 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-28T06:03:28.988 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-28T06:03:29.221 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-28T06:03:29.281 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-28T06:03:29.356 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-28T06:03:29.448 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-28T06:03:29.481 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-28T06:03:29.767 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-28T06:03:29.767 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-28T06:03:30.034 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-28T06:03:30.067 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-28T06:03:30.302 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-28T06:03:30.335 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-28T06:03:30.428 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-28T06:03:30.461 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-28T06:03:30.587 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-28T06:03:30.675 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-28T06:03:30.762 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-28T06:03:30.922 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-28T06:03:31.022 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-28T06:03:31.064 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-28T06:03:31.307 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-28T06:03:31.491 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-28T06:03:31.557 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-28T06:03:31.759 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-28T06:03:31.817 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-28T06:03:31.926 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-28T06:03:32.211 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-28T06:03:32.362 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-28T06:03:32.484 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-28T06:03:32.610 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-28T06:03:32.730 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-28T06:03:32.903 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-28T06:03:33.063 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-28T06:03:33.064 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-28T06:03:33.357 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-28T06:03:33.363 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-28T06:03:33.602 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-28T06:03:33.673 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-28T06:03:33.903 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-28T06:03:33.941 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-28T06:03:34.067 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-28T06:03:34.187 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-28T06:03:34.218 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-28T06:03:34.306 INFO:teuthology.orchestra.run.smithi122.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-28T06:03:34.481 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-28T06:03:34.553 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-28T06:03:34.679 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-28T06:03:34.874 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-28T06:03:35.097 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-28T06:03:35.167 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-28T06:03:35.373 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-28T06:03:35.499 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-28T06:03:35.553 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-28T06:03:35.678 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librados2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:35.759 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-28T06:03:35.805 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:35.884 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-28T06:03:35.930 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-28T06:03:36.236 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-28T06:03:36.250 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcephfs2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:36.393 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libradosstriper1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:36.519 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-28T06:03:36.553 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-28T06:03:36.829 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librbd1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:36.838 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-28T06:03:37.005 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-modules-core (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:37.074 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-28T06:03:37.156 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:37.351 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-28T06:03:37.381 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-28T06:03:37.382 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-28T06:03:37.627 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-28T06:03:37.895 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-28T06:03:38.098 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcephfs-dev (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:38.208 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rados (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:38.289 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-28T06:03:38.335 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librgw2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:38.460 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephfs-top (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:38.573 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-28T06:03:38.619 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-28T06:03:38.917 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-28T06:03:39.047 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up librados2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:39.169 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:39.329 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-28T06:03:39.641 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libcephfs2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:39.770 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libradosstriper1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:39.919 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-28T06:03:39.923 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rbd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:40.067 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up rbd-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:40.192 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:40.210 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up librbd1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:40.337 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-modules-core (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:40.359 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cephfs (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:40.487 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:40.511 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephfs-shell (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:40.670 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:40.700 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-28T06:03:40.700 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-28T06:03:41.265 INFO:teuthology.orchestra.run.smithi153.stdout:Adding group ceph....done 2024-05-28T06:03:41.347 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libcephfs-dev (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:41.489 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-rados (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:41.607 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up librgw2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:41.733 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up cephfs-top (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:41.859 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-28T06:03:41.924 INFO:teuthology.orchestra.run.smithi153.stdout:Adding system user ceph....done 2024-05-28T06:03:42.093 INFO:teuthology.orchestra.run.smithi153.stdout:Setting system user ceph properties....done 2024-05-28T06:03:42.112 INFO:teuthology.orchestra.run.smithi153.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-28T06:03:42.257 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-28T06:03:42.639 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-28T06:03:43.163 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-rbd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:43.287 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephfs-mirror (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:43.288 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up rbd-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:43.398 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-rgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:43.479 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-28T06:03:43.480 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-28T06:03:43.524 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-cephfs (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:43.683 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up cephfs-shell (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:43.809 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:44.113 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-test (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:44.240 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up radosgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:44.362 INFO:teuthology.orchestra.run.smithi122.stdout:Adding group ceph....done 2024-05-28T06:03:44.738 INFO:teuthology.orchestra.run.smithi122.stdout:Adding system user ceph....done 2024-05-28T06:03:44.808 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-28T06:03:44.808 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-28T06:03:44.932 INFO:teuthology.orchestra.run.smithi122.stdout:Setting system user ceph properties....done 2024-05-28T06:03:44.949 INFO:teuthology.orchestra.run.smithi122.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-28T06:03:45.091 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-28T06:03:45.441 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-base (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:45.483 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-28T06:03:45.801 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-28T06:03:46.227 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up cephfs-mirror (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:46.437 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-28T06:03:46.437 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-28T06:03:46.443 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mds (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:46.739 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-28T06:03:46.740 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-28T06:03:47.095 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-test (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:47.238 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up radosgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:47.395 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:47.591 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-28T06:03:47.591 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-28T06:03:47.772 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-28T06:03:47.772 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-28T06:03:48.221 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-osd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:48.466 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-base (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:48.528 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-28T06:03:48.528 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-28T06:03:48.828 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-28T06:03:49.131 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:49.240 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:49.408 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mon (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:49.484 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mds (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:49.620 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-28T06:03:49.620 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-28T06:03:49.725 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-28T06:03:49.725 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-28T06:03:50.251 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:50.369 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:50.394 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:50.519 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-dashboard (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:50.607 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-28T06:03:50.607 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-28T06:03:50.662 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-volume (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:51.052 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-28T06:03:51.157 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-28T06:03:51.245 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-osd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:51.309 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-28T06:03:51.570 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-28T06:03:51.570 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-28T06:03:52.238 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:52.339 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:52.463 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-28T06:03:52.482 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mon (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:52.690 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-28T06:03:52.690 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-28T06:03:53.248 INFO:teuthology.orchestra.run.smithi153.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-28T06:03:53.253 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-28T06:03:53.309 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:53.328 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-05-28T06:03:53.451 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:53.505 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-05-28T06:03:53.506 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-05-28T06:03:53.577 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-dashboard (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:53.679 INFO:teuthology.orchestra.run.smithi153.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-28T06:03:53.679 INFO:teuthology.orchestra.run.smithi153.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-28T06:03:53.679 INFO:teuthology.orchestra.run.smithi153.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-28T06:03:53.679 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-05-28T06:03:53.679 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-28T06:03:53.679 INFO:teuthology.orchestra.run.smithi153.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-28T06:03:53.679 INFO:teuthology.orchestra.run.smithi153.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-28T06:03:53.680 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-28T06:03:53.680 INFO:teuthology.orchestra.run.smithi153.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-28T06:03:53.680 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-28T06:03:53.681 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-05-28T06:03:53.681 INFO:teuthology.orchestra.run.smithi153.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-28T06:03:53.681 INFO:teuthology.orchestra.run.smithi153.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-28T06:03:53.681 INFO:teuthology.orchestra.run.smithi153.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-28T06:03:53.681 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-28T06:03:53.682 INFO:teuthology.orchestra.run.smithi153.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-28T06:03:53.682 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-05-28T06:03:53.682 INFO:teuthology.orchestra.run.smithi153.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-28T06:03:53.683 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-28T06:03:53.683 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-28T06:03:53.728 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-volume (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-28T06:03:53.737 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-05-28T06:03:53.738 INFO:teuthology.orchestra.run.smithi153.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-28T06:03:53.738 INFO:teuthology.orchestra.run.smithi153.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-28T06:03:53.739 INFO:teuthology.orchestra.run.smithi153.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-28T06:03:53.739 INFO:teuthology.orchestra.run.smithi153.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-28T06:03:53.739 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-28T06:03:53.739 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-28T06:03:53.739 INFO:teuthology.orchestra.run.smithi153.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-28T06:03:53.740 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages will be upgraded: 2024-05-28T06:03:53.741 INFO:teuthology.orchestra.run.smithi153.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-28T06:03:53.938 INFO:teuthology.orchestra.run.smithi153.stdout:4 upgraded, 39 newly installed, 0 to remove and 306 not upgraded. 2024-05-28T06:03:53.938 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 55.7 MB of archives. 2024-05-28T06:03:53.938 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-28T06:03:53.939 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-28T06:03:54.114 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-28T06:03:54.207 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-28T06:03:54.392 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-28T06:03:54.602 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-28T06:03:54.624 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-28T06:03:54.751 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-28T06:03:54.751 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-28T06:03:54.753 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-28T06:03:54.783 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-28T06:03:54.786 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-28T06:03:54.788 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-28T06:03:54.790 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-28T06:03:54.790 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-28T06:03:54.957 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-28T06:03:55.253 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-28T06:03:55.262 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-28T06:03:55.268 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-28T06:03:55.356 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-28T06:03:55.535 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-28T06:03:56.207 INFO:teuthology.orchestra.run.smithi122.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-28T06:03:56.213 DEBUG:teuthology.orchestra.run.smithi122:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-28T06:03:56.287 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-05-28T06:03:56.472 INFO:teuthology.orchestra.run.smithi122.stdout:Building dependency tree... 2024-05-28T06:03:56.474 INFO:teuthology.orchestra.run.smithi122.stdout:Reading state information... 2024-05-28T06:03:56.524 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-28T06:03:56.526 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-28T06:03:56.527 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-28T06:03:56.536 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-28T06:03:56.536 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-28T06:03:56.543 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-28T06:03:56.646 INFO:teuthology.orchestra.run.smithi122.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-28T06:03:56.647 INFO:teuthology.orchestra.run.smithi122.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-28T06:03:56.647 INFO:teuthology.orchestra.run.smithi122.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-28T06:03:56.647 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages were automatically installed and are no longer required: 2024-05-28T06:03:56.647 INFO:teuthology.orchestra.run.smithi122.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-28T06:03:56.647 INFO:teuthology.orchestra.run.smithi122.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-28T06:03:56.647 INFO:teuthology.orchestra.run.smithi122.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-28T06:03:56.648 INFO:teuthology.orchestra.run.smithi122.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-28T06:03:56.649 INFO:teuthology.orchestra.run.smithi122.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-28T06:03:56.649 INFO:teuthology.orchestra.run.smithi122.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-28T06:03:56.649 INFO:teuthology.orchestra.run.smithi122.stdout:The following additional packages will be installed: 2024-05-28T06:03:56.649 INFO:teuthology.orchestra.run.smithi122.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-28T06:03:56.649 INFO:teuthology.orchestra.run.smithi122.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-28T06:03:56.649 INFO:teuthology.orchestra.run.smithi122.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-28T06:03:56.650 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-28T06:03:56.650 INFO:teuthology.orchestra.run.smithi122.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-28T06:03:56.650 INFO:teuthology.orchestra.run.smithi122.stdout:Suggested packages: 2024-05-28T06:03:56.650 INFO:teuthology.orchestra.run.smithi122.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-28T06:03:56.650 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-28T06:03:56.650 INFO:teuthology.orchestra.run.smithi122.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-28T06:03:56.706 INFO:teuthology.orchestra.run.smithi122.stdout:The following NEW packages will be installed: 2024-05-28T06:03:56.707 INFO:teuthology.orchestra.run.smithi122.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-28T06:03:56.707 INFO:teuthology.orchestra.run.smithi122.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-28T06:03:56.707 INFO:teuthology.orchestra.run.smithi122.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-28T06:03:56.707 INFO:teuthology.orchestra.run.smithi122.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-28T06:03:56.707 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-28T06:03:56.707 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-28T06:03:56.707 INFO:teuthology.orchestra.run.smithi122.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-28T06:03:56.708 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages will be upgraded: 2024-05-28T06:03:56.708 INFO:teuthology.orchestra.run.smithi122.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-28T06:03:56.719 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-28T06:03:56.772 INFO:teuthology.orchestra.run.smithi122.stdout:4 upgraded, 39 newly installed, 0 to remove and 306 not upgraded. 2024-05-28T06:03:56.772 INFO:teuthology.orchestra.run.smithi122.stdout:Need to get 55.7 MB of archives. 2024-05-28T06:03:56.772 INFO:teuthology.orchestra.run.smithi122.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-28T06:03:56.772 INFO:teuthology.orchestra.run.smithi122.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-28T06:03:56.935 INFO:teuthology.orchestra.run.smithi122.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-28T06:03:56.939 INFO:teuthology.orchestra.run.smithi122.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-28T06:03:56.972 INFO:teuthology.orchestra.run.smithi122.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-28T06:03:56.973 INFO:teuthology.orchestra.run.smithi122.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-28T06:03:56.974 INFO:teuthology.orchestra.run.smithi122.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-28T06:03:56.982 INFO:teuthology.orchestra.run.smithi122.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-28T06:03:56.983 INFO:teuthology.orchestra.run.smithi122.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-28T06:03:56.985 INFO:teuthology.orchestra.run.smithi122.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-28T06:03:56.986 INFO:teuthology.orchestra.run.smithi122.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-28T06:03:56.986 INFO:teuthology.orchestra.run.smithi122.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-28T06:03:56.988 INFO:teuthology.orchestra.run.smithi122.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-28T06:03:56.999 INFO:teuthology.orchestra.run.smithi122.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-28T06:03:56.999 INFO:teuthology.orchestra.run.smithi122.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-28T06:03:57.000 INFO:teuthology.orchestra.run.smithi122.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-28T06:03:57.019 INFO:teuthology.orchestra.run.smithi122.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-28T06:03:57.280 INFO:teuthology.orchestra.run.smithi122.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-28T06:03:57.335 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-28T06:03:57.335 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-28T06:03:57.347 INFO:teuthology.orchestra.run.smithi122.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-28T06:03:57.347 INFO:teuthology.orchestra.run.smithi122.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-28T06:03:57.347 INFO:teuthology.orchestra.run.smithi122.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-28T06:03:57.348 INFO:teuthology.orchestra.run.smithi122.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-28T06:03:57.348 INFO:teuthology.orchestra.run.smithi122.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-28T06:03:57.348 INFO:teuthology.orchestra.run.smithi122.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-28T06:03:57.348 INFO:teuthology.orchestra.run.smithi122.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-28T06:03:57.348 INFO:teuthology.orchestra.run.smithi122.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-28T06:03:57.348 INFO:teuthology.orchestra.run.smithi122.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-28T06:03:57.348 INFO:teuthology.orchestra.run.smithi122.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-28T06:03:57.348 INFO:teuthology.orchestra.run.smithi122.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-28T06:03:57.359 INFO:teuthology.orchestra.run.smithi122.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-28T06:03:57.365 INFO:teuthology.orchestra.run.smithi122.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-28T06:03:57.365 INFO:teuthology.orchestra.run.smithi122.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-28T06:03:57.365 INFO:teuthology.orchestra.run.smithi122.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-28T06:03:57.365 INFO:teuthology.orchestra.run.smithi122.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-28T06:03:57.377 INFO:teuthology.orchestra.run.smithi122.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-28T06:03:57.379 INFO:teuthology.orchestra.run.smithi122.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-28T06:03:57.515 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-28T06:03:57.515 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-28T06:03:57.556 INFO:teuthology.orchestra.run.smithi122.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-28T06:03:57.556 INFO:teuthology.orchestra.run.smithi122.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-28T06:03:57.556 INFO:teuthology.orchestra.run.smithi122.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-28T06:03:57.557 INFO:teuthology.orchestra.run.smithi122.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-28T06:03:57.557 INFO:teuthology.orchestra.run.smithi122.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-28T06:03:57.558 INFO:teuthology.orchestra.run.smithi122.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-28T06:03:57.558 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-28T06:03:57.572 INFO:teuthology.orchestra.run.smithi122.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-28T06:03:57.573 INFO:teuthology.orchestra.run.smithi122.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-28T06:03:57.616 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-28T06:03:57.623 INFO:teuthology.orchestra.run.smithi153.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-28T06:03:57.624 INFO:teuthology.orchestra.run.smithi153.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-28T06:03:57.625 INFO:teuthology.orchestra.run.smithi153.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-28T06:03:57.626 INFO:teuthology.orchestra.run.smithi153.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-28T06:03:57.835 INFO:teuthology.orchestra.run.smithi153.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-28T06:03:57.953 INFO:teuthology.orchestra.run.smithi122.stdout:Preconfiguring packages ... 2024-05-28T06:03:58.099 INFO:teuthology.orchestra.run.smithi122.stdout:Fetched 55.7 MB in 1s (65.1 MB/s) 2024-05-28T06:03:58.265 INFO:teuthology.orchestra.run.smithi153.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-28T06:03:58.378 INFO:teuthology.orchestra.run.smithi122.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-05-28T06:03:58.382 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-28T06:03:58.507 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-28T06:03:59.072 INFO:teuthology.orchestra.run.smithi153.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-28T06:03:59.073 INFO:teuthology.orchestra.run.smithi153.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-28T06:03:59.073 INFO:teuthology.orchestra.run.smithi153.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-28T06:03:59.073 INFO:teuthology.orchestra.run.smithi153.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-28T06:03:59.073 INFO:teuthology.orchestra.run.smithi153.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-28T06:03:59.074 INFO:teuthology.orchestra.run.smithi153.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-28T06:03:59.106 INFO:teuthology.orchestra.run.smithi153.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-28T06:03:59.107 INFO:teuthology.orchestra.run.smithi153.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-28T06:03:59.324 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-28T06:03:59.487 INFO:teuthology.orchestra.run.smithi153.stdout:Preconfiguring packages ... 2024-05-28T06:03:59.646 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 55.7 MB in 5s (10.4 MB/s) 2024-05-28T06:03:59.874 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-05-28T06:03:59.878 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-28T06:04:00.020 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-28T06:04:00.537 INFO:teuthology.orchestra.run.smithi122.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-28T06:04:00.648 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-28T06:04:00.816 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package flex. 2024-05-28T06:04:00.887 INFO:teuthology.orchestra.run.smithi122.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-05-28T06:04:00.887 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-28T06:04:00.997 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-28T06:04:01.531 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-28T06:04:01.726 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-28T06:04:01.735 INFO:teuthology.orchestra.run.smithi153.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-28T06:04:02.034 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package flex. 2024-05-28T06:04:02.107 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-05-28T06:04:02.110 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-28T06:04:02.149 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-28T06:04:02.210 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-28T06:04:02.727 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-28T06:04:02.747 INFO:teuthology.orchestra.run.smithi122.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-05-28T06:04:02.749 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-28T06:04:02.868 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-28T06:04:02.905 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-28T06:04:03.270 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-28T06:04:03.278 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-28T06:04:03.433 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-28T06:04:03.730 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-28T06:04:03.895 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-05-28T06:04:03.898 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-28T06:04:04.030 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-28T06:04:04.458 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-28T06:04:04.608 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package bison. 2024-05-28T06:04:04.611 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-28T06:04:04.681 INFO:teuthology.orchestra.run.smithi122.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-05-28T06:04:04.685 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-28T06:04:04.727 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-28T06:04:04.925 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-28T06:04:05.136 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-28T06:04:05.151 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-28T06:04:05.186 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-28T06:04:05.303 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package bison. 2024-05-28T06:04:05.376 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-05-28T06:04:05.380 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-28T06:04:05.422 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-28T06:04:05.497 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package dump. 2024-05-28T06:04:05.512 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-28T06:04:05.555 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking dump (0.4b47-3) ... 2024-05-28T06:04:05.823 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-28T06:04:05.838 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-28T06:04:05.845 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package indent. 2024-05-28T06:04:05.860 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-28T06:04:05.882 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-28T06:04:05.895 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-28T06:04:06.131 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-28T06:04:06.146 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-28T06:04:06.206 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-28T06:04:06.226 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package dump. 2024-05-28T06:04:06.240 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-28T06:04:06.301 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking dump (0.4b47-3) ... 2024-05-28T06:04:06.543 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-28T06:04:06.558 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-28T06:04:06.580 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package indent. 2024-05-28T06:04:06.594 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-28T06:04:06.601 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-28T06:04:06.638 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-28T06:04:06.888 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-28T06:04:06.903 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-28T06:04:06.907 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-28T06:04:06.922 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-28T06:04:06.946 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-28T06:04:06.958 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-28T06:04:07.233 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-28T06:04:07.249 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-28T06:04:07.261 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-28T06:04:07.276 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-28T06:04:07.316 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-28T06:04:07.396 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-28T06:04:07.577 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-28T06:04:07.593 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-28T06:04:07.635 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-28T06:04:07.640 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-28T06:04:07.655 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-28T06:04:07.716 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-28T06:04:07.896 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libjson-perl. 2024-05-28T06:04:07.912 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-28T06:04:07.955 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-28T06:04:07.986 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-28T06:04:08.001 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-28T06:04:08.036 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-28T06:04:08.258 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-28T06:04:08.272 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-28T06:04:08.273 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-28T06:04:08.287 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-28T06:04:08.308 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-28T06:04:08.330 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-28T06:04:08.608 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjson-perl. 2024-05-28T06:04:08.624 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-28T06:04:08.666 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-28T06:04:08.953 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-28T06:04:08.969 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-28T06:04:09.003 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-28T06:04:09.713 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-28T06:04:09.730 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-28T06:04:09.771 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-28T06:04:10.058 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-28T06:04:10.073 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-28T06:04:10.107 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-28T06:04:10.364 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-28T06:04:10.380 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-28T06:04:10.419 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-28T06:04:10.422 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-28T06:04:10.434 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-28T06:04:10.494 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-28T06:04:10.683 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-28T06:04:10.699 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-28T06:04:10.741 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-28T06:04:10.838 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-28T06:04:10.854 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-28T06:04:10.897 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-28T06:04:11.078 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-28T06:04:11.094 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-28T06:04:11.128 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-28T06:04:11.250 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-28T06:04:11.265 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-28T06:04:11.308 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-28T06:04:11.397 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-28T06:04:11.413 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-28T06:04:11.455 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-28T06:04:11.661 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-28T06:04:11.676 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-28T06:04:11.719 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-28T06:04:11.750 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-28T06:04:11.766 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-28T06:04:11.800 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-28T06:04:12.056 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-28T06:04:12.071 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-28T06:04:12.114 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-28T06:04:12.178 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-28T06:04:12.194 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-28T06:04:12.236 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-28T06:04:12.417 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-28T06:04:12.432 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-28T06:04:12.475 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-28T06:04:12.711 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-28T06:04:12.727 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-28T06:04:12.786 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-28T06:04:13.090 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-28T06:04:13.107 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-28T06:04:13.148 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-28T06:04:13.306 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-28T06:04:13.321 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-28T06:04:13.364 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-28T06:04:13.426 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-28T06:04:13.442 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-28T06:04:13.484 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-28T06:04:13.667 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package modemmanager. 2024-05-28T06:04:13.683 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-28T06:04:13.717 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-28T06:04:13.779 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-28T06:04:13.795 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-28T06:04:13.837 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-28T06:04:14.316 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-28T06:04:14.330 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-28T06:04:14.412 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-28T06:04:14.576 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package network-manager. 2024-05-28T06:04:14.591 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-28T06:04:14.642 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-28T06:04:14.768 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package modemmanager. 2024-05-28T06:04:14.784 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-28T06:04:14.835 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-28T06:04:15.283 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ppp. 2024-05-28T06:04:15.299 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-28T06:04:15.508 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package network-manager. 2024-05-28T06:04:15.525 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-28T06:04:15.575 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-28T06:04:15.639 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-28T06:04:15.939 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package pptp-linux. 2024-05-28T06:04:15.953 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-28T06:04:15.997 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-28T06:04:16.200 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ppp. 2024-05-28T06:04:16.215 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-28T06:04:16.283 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-28T06:04:16.297 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-28T06:04:16.341 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-28T06:04:16.553 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-28T06:04:16.644 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-28T06:04:16.659 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-28T06:04:16.703 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking postgresql-client-common (238) ... 2024-05-28T06:04:16.812 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package pptp-linux. 2024-05-28T06:04:16.827 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-28T06:04:16.862 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-28T06:04:16.990 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-28T06:04:17.006 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-28T06:04:17.040 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-28T06:04:17.132 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-28T06:04:17.146 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-28T06:04:17.190 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-28T06:04:17.493 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-28T06:04:17.507 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-28T06:04:17.551 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking postgresql-client-common (238) ... 2024-05-28T06:04:17.736 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package postgresql-common. 2024-05-28T06:04:17.752 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-28T06:04:17.813 INFO:teuthology.orchestra.run.smithi122.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-28T06:04:17.845 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking postgresql-common (238) ... 2024-05-28T06:04:17.880 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-28T06:04:17.894 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-28T06:04:17.930 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-28T06:04:18.310 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package postgresql-14. 2024-05-28T06:04:18.326 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-28T06:04:18.371 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-28T06:04:18.468 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package postgresql-common. 2024-05-28T06:04:18.483 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-28T06:04:18.544 INFO:teuthology.orchestra.run.smithi153.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-28T06:04:18.592 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking postgresql-common (238) ... 2024-05-28T06:04:19.025 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package postgresql-14. 2024-05-28T06:04:19.040 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-28T06:04:19.086 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-28T06:04:19.447 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package postgresql. 2024-05-28T06:04:19.462 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-28T06:04:19.514 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking postgresql (14+238) ... 2024-05-28T06:04:19.798 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package postgresql-client. 2024-05-28T06:04:19.805 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-28T06:04:19.841 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking postgresql-client (14+238) ... 2024-05-28T06:04:20.060 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-28T06:04:20.075 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-28T06:04:20.138 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-28T06:04:20.245 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package postgresql. 2024-05-28T06:04:20.261 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-28T06:04:20.304 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking postgresql (14+238) ... 2024-05-28T06:04:20.471 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package tcl8.6. 2024-05-28T06:04:20.486 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-28T06:04:20.529 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-28T06:04:20.556 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package postgresql-client. 2024-05-28T06:04:20.570 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-28T06:04:20.614 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking postgresql-client (14+238) ... 2024-05-28T06:04:20.848 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package tcl. 2024-05-28T06:04:20.858 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-28T06:04:20.864 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-28T06:04:20.873 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-28T06:04:20.911 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-28T06:04:20.916 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-28T06:04:21.244 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package tcl8.6. 2024-05-28T06:04:21.259 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-28T06:04:21.284 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package wpasupplicant. 2024-05-28T06:04:21.293 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-28T06:04:21.300 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-28T06:04:21.343 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-28T06:04:21.563 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package tcl. 2024-05-28T06:04:21.578 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-28T06:04:21.626 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-28T06:04:21.697 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-28T06:04:21.713 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-28T06:04:21.755 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-28T06:04:22.025 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package wpasupplicant. 2024-05-28T06:04:22.040 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-28T06:04:22.082 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-28T06:04:22.150 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-28T06:04:22.167 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-28T06:04:22.218 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-28T06:04:22.403 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-28T06:04:22.419 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-28T06:04:22.454 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-28T06:04:22.527 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up postgresql-client-common (238) ... 2024-05-28T06:04:22.740 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-28T06:04:22.832 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-28T06:04:22.847 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-28T06:04:22.866 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-28T06:04:22.898 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-28T06:04:23.033 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-28T06:04:23.160 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-28T06:04:23.183 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up postgresql-client-common (238) ... 2024-05-28T06:04:23.286 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-28T06:04:23.371 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-28T06:04:23.404 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-28T06:04:23.480 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-28T06:04:23.632 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-28T06:04:23.757 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-28T06:04:23.883 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-28T06:04:24.009 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-28T06:04:24.373 INFO:teuthology.orchestra.run.smithi122.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-28T06:04:24.459 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-28T06:04:24.846 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-28T06:04:24.846 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-28T06:04:24.966 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-28T06:04:25.065 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-28T06:04:25.467 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-28T06:04:25.467 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-28T06:04:25.579 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-28T06:04:25.738 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-28T06:04:25.864 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-28T06:04:25.990 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-28T06:04:26.116 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-28T06:04:26.184 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-28T06:04:26.242 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-28T06:04:26.319 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-28T06:04:26.385 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-28T06:04:26.453 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-28T06:04:26.586 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-28T06:04:26.604 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-28T06:04:26.755 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-28T06:04:26.940 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-28T06:04:27.091 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-28T06:04:27.242 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-28T06:04:27.267 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-28T06:04:27.417 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up dump (0.4b47-3) ... 2024-05-28T06:04:27.512 INFO:teuthology.orchestra.run.smithi122.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-28T06:04:27.577 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-28T06:04:27.687 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-28T06:04:27.813 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-28T06:04:27.964 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-28T06:04:28.089 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-28T06:04:28.131 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-28T06:04:28.179 INFO:teuthology.orchestra.run.smithi122.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-28T06:04:28.250 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-28T06:04:28.282 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up dump (0.4b47-3) ... 2024-05-28T06:04:28.376 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-28T06:04:28.393 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-28T06:04:28.467 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-28T06:04:28.585 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-28T06:04:28.659 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-28T06:04:28.694 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-28T06:04:28.802 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-28T06:04:28.821 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-28T06:04:28.937 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-28T06:04:28.989 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up postgresql-client (14+238) ... 2024-05-28T06:04:29.079 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-28T06:04:29.151 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-28T06:04:29.186 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-28T06:04:29.264 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-28T06:04:29.441 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-28T06:04:29.650 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-28T06:04:29.801 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-28T06:04:29.952 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-28T06:04:30.053 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:30.053 INFO:teuthology.orchestra.run.smithi122.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-28T06:04:30.053 INFO:teuthology.orchestra.run.smithi122.stdout:which means they are currently configured by ifupdown: 2024-05-28T06:04:30.053 INFO:teuthology.orchestra.run.smithi122.stdout:- enp3s0f1 2024-05-28T06:04:30.053 INFO:teuthology.orchestra.run.smithi122.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-28T06:04:30.053 INFO:teuthology.orchestra.run.smithi122.stdout:remove their configuration from /etc/network/interfaces. 2024-05-28T06:04:30.053 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:30.104 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up postgresql-client (14+238) ... 2024-05-28T06:04:30.194 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-28T06:04:30.255 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-28T06:04:30.598 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-28T06:04:30.860 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:30.861 INFO:teuthology.orchestra.run.smithi153.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-28T06:04:30.861 INFO:teuthology.orchestra.run.smithi153.stdout:which means they are currently configured by ifupdown: 2024-05-28T06:04:30.861 INFO:teuthology.orchestra.run.smithi153.stdout:- enp3s0f1 2024-05-28T06:04:30.861 INFO:teuthology.orchestra.run.smithi153.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-28T06:04:30.861 INFO:teuthology.orchestra.run.smithi153.stdout:remove their configuration from /etc/network/interfaces. 2024-05-28T06:04:30.861 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:30.989 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-28T06:04:30.992 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-28T06:04:31.381 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-28T06:04:31.651 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-28T06:04:31.778 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-28T06:04:31.785 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-28T06:04:31.937 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-28T06:04:32.063 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up postgresql-common (238) ... 2024-05-28T06:04:32.541 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-28T06:04:32.734 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-28T06:04:32.885 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-28T06:04:33.028 INFO:teuthology.orchestra.run.smithi122.stdout:Adding user postgres to group ssl-cert 2024-05-28T06:04:33.036 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up postgresql-common (238) ... 2024-05-28T06:04:33.286 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:33.286 INFO:teuthology.orchestra.run.smithi122.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-28T06:04:33.536 INFO:teuthology.orchestra.run.smithi122.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-28T06:04:33.537 INFO:teuthology.orchestra.run.smithi122.stdout:Removing obsolete dictionary files: 2024-05-28T06:04:34.041 INFO:teuthology.orchestra.run.smithi153.stdout:Adding user postgres to group ssl-cert 2024-05-28T06:04:34.263 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-28T06:04:34.290 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:34.291 INFO:teuthology.orchestra.run.smithi153.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-28T06:04:34.539 INFO:teuthology.orchestra.run.smithi153.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-28T06:04:34.539 INFO:teuthology.orchestra.run.smithi153.stdout:Removing obsolete dictionary files: 2024-05-28T06:04:34.831 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-28T06:04:35.170 INFO:teuthology.orchestra.run.smithi122.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-28T06:04:35.188 INFO:teuthology.orchestra.run.smithi122.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-28T06:04:35.252 INFO:teuthology.orchestra.run.smithi122.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-28T06:04:35.252 INFO:teuthology.orchestra.run.smithi122.stdout:This user must also own the server process. 2024-05-28T06:04:35.252 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:35.252 INFO:teuthology.orchestra.run.smithi122.stdout:The database cluster will be initialized with locale "en_US". 2024-05-28T06:04:35.252 INFO:teuthology.orchestra.run.smithi122.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-28T06:04:35.252 INFO:teuthology.orchestra.run.smithi122.stdout:The default text search configuration will be set to "english". 2024-05-28T06:04:35.252 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:35.252 INFO:teuthology.orchestra.run.smithi122.stdout:Data page checksums are disabled. 2024-05-28T06:04:35.252 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:35.252 INFO:teuthology.orchestra.run.smithi122.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-28T06:04:35.253 INFO:teuthology.orchestra.run.smithi122.stdout:creating subdirectories ... ok 2024-05-28T06:04:35.253 INFO:teuthology.orchestra.run.smithi122.stdout:selecting dynamic shared memory implementation ... posix 2024-05-28T06:04:35.271 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-28T06:04:35.277 INFO:teuthology.orchestra.run.smithi122.stdout:selecting default max_connections ... 100 2024-05-28T06:04:35.310 INFO:teuthology.orchestra.run.smithi122.stdout:selecting default shared_buffers ... 128MB 2024-05-28T06:04:35.324 INFO:teuthology.orchestra.run.smithi122.stdout:selecting default time zone ... Etc/UTC 2024-05-28T06:04:35.325 INFO:teuthology.orchestra.run.smithi122.stdout:creating configuration files ... ok 2024-05-28T06:04:35.491 INFO:teuthology.orchestra.run.smithi122.stdout:running bootstrap script ... ok 2024-05-28T06:04:35.904 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-28T06:04:36.138 INFO:teuthology.orchestra.run.smithi122.stdout:performing post-bootstrap initialization ... ok 2024-05-28T06:04:36.306 INFO:teuthology.orchestra.run.smithi153.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-28T06:04:36.328 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-28T06:04:36.383 INFO:teuthology.orchestra.run.smithi153.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-28T06:04:36.383 INFO:teuthology.orchestra.run.smithi153.stdout:This user must also own the server process. 2024-05-28T06:04:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:36.384 INFO:teuthology.orchestra.run.smithi153.stdout:The database cluster will be initialized with locale "en_US". 2024-05-28T06:04:36.384 INFO:teuthology.orchestra.run.smithi153.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-28T06:04:36.384 INFO:teuthology.orchestra.run.smithi153.stdout:The default text search configuration will be set to "english". 2024-05-28T06:04:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:36.384 INFO:teuthology.orchestra.run.smithi153.stdout:Data page checksums are disabled. 2024-05-28T06:04:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:36.384 INFO:teuthology.orchestra.run.smithi153.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-28T06:04:36.385 INFO:teuthology.orchestra.run.smithi153.stdout:creating subdirectories ... ok 2024-05-28T06:04:36.385 INFO:teuthology.orchestra.run.smithi153.stdout:selecting dynamic shared memory implementation ... posix 2024-05-28T06:04:36.408 INFO:teuthology.orchestra.run.smithi153.stdout:selecting default max_connections ... 100 2024-05-28T06:04:36.442 INFO:teuthology.orchestra.run.smithi153.stdout:selecting default shared_buffers ... 128MB 2024-05-28T06:04:36.456 INFO:teuthology.orchestra.run.smithi153.stdout:selecting default time zone ... Etc/UTC 2024-05-28T06:04:36.457 INFO:teuthology.orchestra.run.smithi153.stdout:creating configuration files ... ok 2024-05-28T06:04:36.623 INFO:teuthology.orchestra.run.smithi153.stdout:running bootstrap script ... ok 2024-05-28T06:04:36.788 INFO:teuthology.orchestra.run.smithi122.stdout:syncing data to disk ... ok 2024-05-28T06:04:37.266 INFO:teuthology.orchestra.run.smithi153.stdout:performing post-bootstrap initialization ... ok 2024-05-28T06:04:37.330 INFO:teuthology.orchestra.run.smithi122.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-28T06:04:37.863 INFO:teuthology.orchestra.run.smithi153.stdout:syncing data to disk ... ok 2024-05-28T06:04:38.373 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-28T06:04:40.689 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-28T06:04:40.815 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-28T06:04:40.941 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up postgresql (14+238) ... 2024-05-28T06:04:41.070 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-28T06:04:41.201 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-28T06:04:41.428 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-28T06:04:41.460 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-28T06:04:41.460 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-28T06:04:41.579 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-28T06:04:41.730 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up postgresql (14+238) ... 2024-05-28T06:04:41.923 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-28T06:04:42.073 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-28T06:04:42.287 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-28T06:04:42.358 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-28T06:04:42.358 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-28T06:04:42.379 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-28T06:04:42.706 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-28T06:04:42.900 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-28T06:04:43.126 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-28T06:04:43.235 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-28T06:04:43.606 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-28T06:04:43.774 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-28T06:04:44.311 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-28T06:04:44.403 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-28T06:04:44.953 INFO:teuthology.orchestra.run.smithi122.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-28T06:04:44.961 DEBUG:teuthology.parallel:result is None 2024-05-28T06:04:45.135 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-28T06:04:45.260 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-28T06:04:45.788 INFO:teuthology.orchestra.run.smithi153.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-28T06:04:45.794 DEBUG:teuthology.parallel:result is None 2024-05-28T06:04:45.795 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9ed025fbf4406fb54980a0647506b15895b6d863 2024-05-28T06:04:45.953 DEBUG:teuthology.orchestra.run.smithi122:> dpkg-query -W -f '${Version}' ceph 2024-05-28T06:04:45.977 INFO:teuthology.orchestra.run.smithi122.stdout:19.0.0-3154-g9ed025fb-1jammy 2024-05-28T06:04:45.977 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3154-g9ed025fb-1jammy 2024-05-28T06:04:45.977 INFO:teuthology.task.install:The correct ceph version 19.0.0-3154-g9ed025fb-1jammy is installed. 2024-05-28T06:04:45.979 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9ed025fbf4406fb54980a0647506b15895b6d863 2024-05-28T06:04:46.217 DEBUG:teuthology.orchestra.run.smithi153:> dpkg-query -W -f '${Version}' ceph 2024-05-28T06:04:46.239 INFO:teuthology.orchestra.run.smithi153.stdout:19.0.0-3154-g9ed025fb-1jammy 2024-05-28T06:04:46.239 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3154-g9ed025fb-1jammy 2024-05-28T06:04:46.239 INFO:teuthology.task.install:The correct ceph version 19.0.0-3154-g9ed025fb-1jammy is installed. 2024-05-28T06:04:46.242 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-28T06:04:46.242 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:04:46.242 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-28T06:04:46.264 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:04:46.264 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-28T06:04:46.306 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-28T06:04:46.307 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:04:46.307 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/daemon-helper 2024-05-28T06:04:46.328 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-28T06:04:46.391 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:04:46.391 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2024-05-28T06:04:46.410 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-28T06:04:46.468 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-28T06:04:46.469 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:04:46.469 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-28T06:04:46.492 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-28T06:04:46.560 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:04:46.560 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-28T06:04:46.579 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-28T06:04:46.641 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-28T06:04:46.641 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:04:46.641 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/stdin-killer 2024-05-28T06:04:46.662 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-28T06:04:46.725 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:04:46.725 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2024-05-28T06:04:46.744 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-28T06:04:46.804 INFO:teuthology.run_tasks:Running task ceph... 2024-05-28T06:04:46.882 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-28T06:04:46.882 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 777 /var/log/ceph 2024-05-28T06:04:46.886 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /var/log/ceph 2024-05-28T06:04:46.904 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-28T06:04:46.904 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-28T06:04:46.951 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-28T06:04:46.969 INFO:tasks.ceph:Creating extra log directories... 2024-05-28T06:04:46.969 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-28T06:04:47.015 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-28T06:04:47.044 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-28T06:04:47.044 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-28T06:04:47.044 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-28T06:04:47.044 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:04:47.044 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-28T06:04:47.084 DEBUG:teuthology.orchestra.run.smithi122:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-28T06:04:47.182 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:04:47.182 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-28T06:04:47.191 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-28T06:04:47.284 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-28T06:04:47.284 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-28T06:04:47.284 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-05-28_05:40:25-fs:volumes-rishabh-clone-stats-testing-default-smithi/7729375', 'branch': 'rishabh-clone-stats', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}}', 'email': None, 'first_in_suite': False, 'job_id': '7729375', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-05-28_05:40:25-fs:volumes-rishabh-clone-stats-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'rishabh-clone-stats'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'mgr-vol-clone-stats', 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8528, 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863', 'sleep_before_teardown': 0, 'suite': 'fs:volumes', 'suite_branch': 'mgr-vol-clone-stats', 'suite_path': '/home/teuthworker/src/github.com_rishabh-d-dave_ceph_9ed025fbf4406fb54980a0647506b15895b6d863/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/rishabh-d-dave/ceph', 'suite_sha1': '9ed025fbf4406fb54980a0647506b15895b6d863', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi122.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLbBynBp/pDTBjGa0Y/fN4CIiFmU8fAurd+dyBbqsI7q6xsk3cBL1v3upoHWkU0wbLJp99SES3jbDL4evuExqBo=', 'smithi153.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB4OA8sdrlF7TAhicM9dZbM2UnsKyW3yN/uyX8xEz3/V3LyqP8jnzN77ERl+h4zsXdfL3brsWwaEZkpPOkaNMt4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestCloneProgressReporter']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e7ae7580c417d6ab27fda98fecadca5d9f85d63e', 'timestamp': '2024-05-28_05:40:25', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841'} 2024-05-28T06:04:47.285 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-28T06:04:47.288 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-28T06:04:47.334 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m0777 -- /var/run/ceph 2024-05-28T06:04:47.338 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/run/ceph 2024-05-28T06:04:47.393 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:04:47.393 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/scratch_devs of=/dev/stdout 2024-05-28T06:04:47.408 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-28T06:04:47.408 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_1 2024-05-28T06:04:47.460 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-28T06:04:47.461 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-28T06:04:47.461 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 6h/6d Inode: 899 Links: 1 2024-05-28T06:04:47.461 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-28T06:04:47.461 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-05-28 05:58:14.887782708 +0000 2024-05-28T06:04:47.461 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-05-28 05:58:14.627785030 +0000 2024-05-28T06:04:47.461 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-05-28 05:58:14.627785030 +0000 2024-05-28T06:04:47.461 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-05-28 05:58:14.627785030 +0000 2024-05-28T06:04:47.461 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-28T06:04:47.522 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-05-28T06:04:47.522 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-05-28T06:04:47.522 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000420386 s, 1.2 MB/s 2024-05-28T06:04:47.524 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-28T06:04:47.578 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_2 2024-05-28T06:04:47.628 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-28T06:04:47.629 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-28T06:04:47.629 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 6h/6d Inode: 913 Links: 1 2024-05-28T06:04:47.629 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-28T06:04:47.629 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-05-28 05:58:15.415777993 +0000 2024-05-28T06:04:47.629 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-05-28 05:58:15.139780458 +0000 2024-05-28T06:04:47.629 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-05-28 05:58:15.139780458 +0000 2024-05-28T06:04:47.629 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-05-28 05:58:15.139780458 +0000 2024-05-28T06:04:47.629 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-28T06:04:47.690 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-05-28T06:04:47.690 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-05-28T06:04:47.690 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000381399 s, 1.3 MB/s 2024-05-28T06:04:47.692 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-28T06:04:47.750 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_3 2024-05-28T06:04:47.801 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-28T06:04:47.801 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-28T06:04:47.801 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 6h/6d Inode: 930 Links: 1 2024-05-28T06:04:47.801 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-28T06:04:47.801 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-05-28 05:58:15.991772846 +0000 2024-05-28T06:04:47.801 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-05-28 05:58:15.735775134 +0000 2024-05-28T06:04:47.801 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-05-28 05:58:15.735775134 +0000 2024-05-28T06:04:47.801 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-05-28 05:58:15.735775134 +0000 2024-05-28T06:04:47.801 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-28T06:04:47.862 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-05-28T06:04:47.863 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-05-28T06:04:47.863 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.00064721 s, 791 kB/s 2024-05-28T06:04:47.865 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-28T06:04:47.920 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_4 2024-05-28T06:04:47.972 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-28T06:04:47.972 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-28T06:04:47.972 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 6h/6d Inode: 950 Links: 1 2024-05-28T06:04:47.972 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-28T06:04:47.972 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-05-28 05:58:16.311769990 +0000 2024-05-28T06:04:47.973 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-05-28 05:58:16.307770024 +0000 2024-05-28T06:04:47.973 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-05-28 05:58:16.307770024 +0000 2024-05-28T06:04:47.973 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-05-28 05:58:16.307770024 +0000 2024-05-28T06:04:47.973 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-28T06:04:48.034 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-05-28T06:04:48.034 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-05-28T06:04:48.034 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000393309 s, 1.3 MB/s 2024-05-28T06:04:48.036 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-28T06:04:48.091 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-28T06:04:48.091 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:04:48.091 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2024-05-28T06:04:48.099 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-28T06:04:48.100 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2024-05-28T06:04:48.151 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-28T06:04:48.151 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-28T06:04:48.151 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 896 Links: 1 2024-05-28T06:04:48.152 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-28T06:04:48.152 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-05-28 05:58:11.655895603 +0000 2024-05-28T06:04:48.152 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-05-28 05:58:11.275898997 +0000 2024-05-28T06:04:48.152 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-05-28 05:58:11.275898997 +0000 2024-05-28T06:04:48.152 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-05-28 05:58:11.275898997 +0000 2024-05-28T06:04:48.152 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-28T06:04:48.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-05-28T06:04:48.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-05-28T06:04:48.217 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000662113 s, 773 kB/s 2024-05-28T06:04:48.219 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-28T06:04:48.273 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2024-05-28T06:04:48.327 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-28T06:04:48.328 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-28T06:04:48.328 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 916 Links: 1 2024-05-28T06:04:48.328 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-28T06:04:48.328 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-05-28 05:58:12.191890814 +0000 2024-05-28T06:04:48.328 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-05-28 05:58:11.935893102 +0000 2024-05-28T06:04:48.328 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-05-28 05:58:11.935893102 +0000 2024-05-28T06:04:48.328 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-05-28 05:58:11.935893102 +0000 2024-05-28T06:04:48.329 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-28T06:04:48.389 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-05-28T06:04:48.390 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-05-28T06:04:48.390 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000382635 s, 1.3 MB/s 2024-05-28T06:04:48.391 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-28T06:04:48.446 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2024-05-28T06:04:48.496 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-28T06:04:48.496 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-28T06:04:48.496 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 933 Links: 1 2024-05-28T06:04:48.496 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-28T06:04:48.496 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-05-28 05:58:12.775885599 +0000 2024-05-28T06:04:48.496 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-05-28 05:58:12.495888099 +0000 2024-05-28T06:04:48.496 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-05-28 05:58:12.495888099 +0000 2024-05-28T06:04:48.496 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-05-28 05:58:12.495888099 +0000 2024-05-28T06:04:48.496 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-28T06:04:48.558 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-05-28T06:04:48.558 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-05-28T06:04:48.558 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000383949 s, 1.3 MB/s 2024-05-28T06:04:48.560 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-28T06:04:48.615 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2024-05-28T06:04:48.668 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-28T06:04:48.668 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-28T06:04:48.668 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 949 Links: 1 2024-05-28T06:04:48.668 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-28T06:04:48.668 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-05-28 05:58:13.339880561 +0000 2024-05-28T06:04:48.668 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-05-28 05:58:13.071882954 +0000 2024-05-28T06:04:48.669 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-05-28 05:58:13.071882954 +0000 2024-05-28T06:04:48.669 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-05-28 05:58:13.071882954 +0000 2024-05-28T06:04:48.669 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-28T06:04:48.729 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-05-28T06:04:48.730 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-05-28T06:04:48.730 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000389322 s, 1.3 MB/s 2024-05-28T06:04:48.732 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-28T06:04:48.792 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-28T06:04:48.792 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi122.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-28T06:04:48.792 INFO:tasks.ceph:Generating config... 2024-05-28T06:04:48.794 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-28T06:04:48.794 INFO:tasks.ceph:[client] debug client = 20 2024-05-28T06:04:48.794 INFO:tasks.ceph:[client] debug ms = 1 2024-05-28T06:04:48.794 INFO:tasks.ceph:[client] pid file = 2024-05-28T06:04:48.794 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-28T06:04:48.794 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-28T06:04:48.794 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-28T06:04:48.794 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-28T06:04:48.795 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-28T06:04:48.795 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-28T06:04:48.795 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-28T06:04:48.795 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-28T06:04:48.795 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-28T06:04:48.795 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-28T06:04:48.795 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-28T06:04:48.795 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-28T06:04:48.795 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-28T06:04:48.795 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-28T06:04:48.795 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-05-28T06:04:48.796 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-28T06:04:48.796 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-28T06:04:48.796 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-28T06:04:48.796 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-28T06:04:48.796 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-28T06:04:48.796 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-28T06:04:48.797 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-28T06:04:48.797 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-28T06:04:48.797 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-28T06:04:48.797 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-28T06:04:48.797 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-28T06:04:48.797 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-28T06:04:48.797 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-28T06:04:48.797 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-28T06:04:48.797 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-28T06:04:48.797 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-28T06:04:48.798 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-28T06:04:48.798 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-28T06:04:48.798 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-28T06:04:48.798 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-28T06:04:48.798 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-28T06:04:48.798 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-28T06:04:48.798 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-28T06:04:48.798 INFO:tasks.ceph:Setting up mon.a... 2024-05-28T06:04:48.798 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-28T06:04:48.843 INFO:teuthology.orchestra.run.smithi122.stdout:creating /etc/ceph/ceph.keyring 2024-05-28T06:04:48.856 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-28T06:04:48.953 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-28T06:04:49.019 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.122'), ('mon.b', '172.21.15.153'), ('mon.c', '[v2:172.21.15.153:3301,v1:172.21.15.153:6790]')] 2024-05-28T06:04:49.020 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.122,172.21.15.153,[v2:172.21.15.153:3301,v1:172.21.15.153:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-28T06:04:49.021 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:04:49.021 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-28T06:04:49.082 DEBUG:teuthology.orchestra.run.smithi122:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.122 --add b 172.21.15.153 --addv c '[v2:172.21.15.153:3301,v1:172.21.15.153:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-28T06:04:49.175 INFO:teuthology.orchestra.run.smithi122.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-28T06:04:49.175 INFO:teuthology.orchestra.run.smithi122.stdout:monmaptool: generated fsid e63a9349-baf2-4247-95d1-eb8599fad84f 2024-05-28T06:04:49.175 INFO:teuthology.orchestra.run.smithi122.stdout:setting min_mon_release = quincy 2024-05-28T06:04:49.175 INFO:teuthology.orchestra.run.smithi122.stdout:epoch 0 2024-05-28T06:04:49.175 INFO:teuthology.orchestra.run.smithi122.stdout:fsid e63a9349-baf2-4247-95d1-eb8599fad84f 2024-05-28T06:04:49.175 INFO:teuthology.orchestra.run.smithi122.stdout:last_changed 2024-05-28T06:04:49.178180+0000 2024-05-28T06:04:49.175 INFO:teuthology.orchestra.run.smithi122.stdout:created 2024-05-28T06:04:49.178180+0000 2024-05-28T06:04:49.175 INFO:teuthology.orchestra.run.smithi122.stdout:min_mon_release 17 (quincy) 2024-05-28T06:04:49.175 INFO:teuthology.orchestra.run.smithi122.stdout:election_strategy: 1 2024-05-28T06:04:49.176 INFO:teuthology.orchestra.run.smithi122.stdout:0: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.a 2024-05-28T06:04:49.176 INFO:teuthology.orchestra.run.smithi122.stdout:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-05-28T06:04:49.176 INFO:teuthology.orchestra.run.smithi122.stdout:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-05-28T06:04:49.176 INFO:teuthology.orchestra.run.smithi122.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-28T06:04:49.178 DEBUG:teuthology.orchestra.run.smithi122:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-28T06:04:49.187 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e63a9349-baf2-4247-95d1-eb8599fad84f... 2024-05-28T06:04:49.188 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-28T06:04:49.231 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-28T06:04:49.271 INFO:teuthology.orchestra.run.smithi122.stdout:[global] 2024-05-28T06:04:49.271 INFO:teuthology.orchestra.run.smithi122.stdout: chdir = "" 2024-05-28T06:04:49.272 INFO:teuthology.orchestra.run.smithi122.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-28T06:04:49.272 INFO:teuthology.orchestra.run.smithi122.stdout: auth supported = cephx 2024-05-28T06:04:49.272 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.272 INFO:teuthology.orchestra.run.smithi122.stdout: filestore xattr use omap = true 2024-05-28T06:04:49.272 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.272 INFO:teuthology.orchestra.run.smithi122.stdout: mon clock drift allowed = 1.000 2024-05-28T06:04:49.272 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.272 INFO:teuthology.orchestra.run.smithi122.stdout: osd crush chooseleaf type = 0 2024-05-28T06:04:49.273 INFO:teuthology.orchestra.run.smithi122.stdout: auth debug = true 2024-05-28T06:04:49.273 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.273 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on old message = true 2024-05-28T06:04:49.273 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on bug = true 2024-05-28T06:04:49.273 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.273 INFO:teuthology.orchestra.run.smithi122.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-28T06:04:49.273 INFO:teuthology.orchestra.run.smithi122.stdout: mon pg warn max object skew = 0 2024-05-28T06:04:49.273 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.273 INFO:teuthology.orchestra.run.smithi122.stdout: # disable pg_autoscaler by default for new pools 2024-05-28T06:04:49.273 INFO:teuthology.orchestra.run.smithi122.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-28T06:04:49.274 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.274 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default size = 2 2024-05-28T06:04:49.274 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.274 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow primary affinity = true 2024-05-28T06:04:49.274 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow pg remap = true 2024-05-28T06:04:49.274 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on legacy crush tunables = false 2024-05-28T06:04:49.274 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on crush straw calc version zero = false 2024-05-28T06:04:49.275 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on no sortbitwise = false 2024-05-28T06:04:49.275 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on osd down out interval zero = false 2024-05-28T06:04:49.275 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on too few osds = false 2024-05-28T06:04:49.275 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-28T06:04:49.275 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-28T06:04:49.275 INFO:teuthology.orchestra.run.smithi122.stdout: mon_allow_pool_size_one = true 2024-05-28T06:04:49.275 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.276 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-28T06:04:49.276 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.276 INFO:teuthology.orchestra.run.smithi122.stdout: osd default data pool replay window = 5 2024-05-28T06:04:49.276 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.276 INFO:teuthology.orchestra.run.smithi122.stdout: mon allow pool delete = true 2024-05-28T06:04:49.276 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.276 INFO:teuthology.orchestra.run.smithi122.stdout: mon cluster log file level = debug 2024-05-28T06:04:49.276 INFO:teuthology.orchestra.run.smithi122.stdout: debug asserts on shutdown = true 2024-05-28T06:04:49.276 INFO:teuthology.orchestra.run.smithi122.stdout: mon health detail to clog = false 2024-05-28T06:04:49.276 INFO:teuthology.orchestra.run.smithi122.stdout: mon host = "172.21.15.122,172.21.15.153,[v2:172.21.15.153:3301,v1:172.21.15.153:6790]" 2024-05-28T06:04:49.277 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on skipped message = False 2024-05-28T06:04:49.277 INFO:teuthology.orchestra.run.smithi122.stdout: fsid = e63a9349-baf2-4247-95d1-eb8599fad84f 2024-05-28T06:04:49.277 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.277 INFO:teuthology.orchestra.run.smithi122.stdout:[osd] 2024-05-28T06:04:49.277 INFO:teuthology.orchestra.run.smithi122.stdout: osd journal size = 100 2024-05-28T06:04:49.277 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.277 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub load threshold = 5.0 2024-05-28T06:04:49.277 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub max interval = 600 2024-05-28T06:04:49.277 INFO:teuthology.orchestra.run.smithi122.stdout: osd mclock profile = high_recovery_ops 2024-05-28T06:04:49.278 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.278 INFO:teuthology.orchestra.run.smithi122.stdout: osd recover clone overlap = true 2024-05-28T06:04:49.278 INFO:teuthology.orchestra.run.smithi122.stdout: osd recovery max chunk = 1048576 2024-05-28T06:04:49.278 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.278 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug shutdown = true 2024-05-28T06:04:49.278 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug op order = true 2024-05-28T06:04:49.278 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug verify stray on activate = true 2024-05-28T06:04:49.278 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug trim objects = true 2024-05-28T06:04:49.278 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.278 INFO:teuthology.orchestra.run.smithi122.stdout: osd open classes on start = true 2024-05-28T06:04:49.278 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug pg log writeout = true 2024-05-28T06:04:49.278 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.278 INFO:teuthology.orchestra.run.smithi122.stdout: osd deep scrub update digest min age = 30 2024-05-28T06:04:49.278 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.279 INFO:teuthology.orchestra.run.smithi122.stdout: osd map max advance = 10 2024-05-28T06:04:49.279 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.279 INFO:teuthology.orchestra.run.smithi122.stdout: journal zero on create = true 2024-05-28T06:04:49.279 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.279 INFO:teuthology.orchestra.run.smithi122.stdout: filestore ondisk finisher threads = 3 2024-05-28T06:04:49.279 INFO:teuthology.orchestra.run.smithi122.stdout: filestore apply finisher threads = 3 2024-05-28T06:04:49.279 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.279 INFO:teuthology.orchestra.run.smithi122.stdout: bdev debug aio = true 2024-05-28T06:04:49.279 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug misdirected ops = true 2024-05-28T06:04:49.279 INFO:teuthology.orchestra.run.smithi122.stdout: bdev async discard = True 2024-05-28T06:04:49.279 INFO:teuthology.orchestra.run.smithi122.stdout: bdev enable discard = True 2024-05-28T06:04:49.279 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore allocator = bitmap 2024-05-28T06:04:49.279 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore block size = 96636764160 2024-05-28T06:04:49.279 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore fsck on mount = True 2024-05-28T06:04:49.280 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluefs = 1/20 2024-05-28T06:04:49.280 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluestore = 1/20 2024-05-28T06:04:49.280 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-05-28T06:04:49.280 INFO:teuthology.orchestra.run.smithi122.stdout: debug osd = 20 2024-05-28T06:04:49.280 INFO:teuthology.orchestra.run.smithi122.stdout: debug rocksdb = 4/10 2024-05-28T06:04:49.280 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd backfillfull_ratio = 0.85 2024-05-28T06:04:49.280 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd full ratio = 0.9 2024-05-28T06:04:49.280 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd nearfull ratio = 0.8 2024-05-28T06:04:49.280 INFO:teuthology.orchestra.run.smithi122.stdout: osd failsafe full ratio = 0.95 2024-05-28T06:04:49.280 INFO:teuthology.orchestra.run.smithi122.stdout: osd objectstore = bluestore 2024-05-28T06:04:49.280 INFO:teuthology.orchestra.run.smithi122.stdout: osd op complaint time = 180 2024-05-28T06:04:49.280 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.280 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr] 2024-05-28T06:04:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-05-28T06:04:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: debug mgr = 20 2024-05-28T06:04:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2024-05-28T06:04:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2024-05-28T06:04:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2024-05-28T06:04:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2024-05-28T06:04:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: mgr/telemetry/nag = false 2024-05-28T06:04:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: debug client = 20 2024-05-28T06:04:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: debug finisher = 20 2024-05-28T06:04:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.281 INFO:teuthology.orchestra.run.smithi122.stdout:[mon] 2024-05-28T06:04:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-05-28T06:04:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2024-05-28T06:04:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: debug paxos = 20 2024-05-28T06:04:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2024-05-28T06:04:49.282 INFO:teuthology.orchestra.run.smithi122.stdout: mon data avail warn = 5 2024-05-28T06:04:49.282 INFO:teuthology.orchestra.run.smithi122.stdout: mon mgr mkfs grace = 240 2024-05-28T06:04:49.282 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2024-05-28T06:04:49.282 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd reporter subtree level = osd 2024-05-28T06:04:49.282 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd prime pg temp = true 2024-05-28T06:04:49.282 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2024-05-28T06:04:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-28T06:04:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: auth mon ticket ttl = 660 # 11m 2024-05-28T06:04:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: auth service ticket ttl = 240 # 4m 2024-05-28T06:04:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: # don't complain about insecure global_id in the test suite 2024-05-28T06:04:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-28T06:04:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-28T06:04:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: # 1m isn't quite enough 2024-05-28T06:04:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: mon_down_mkfs_grace = 2m 2024-05-28T06:04:49.284 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.284 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_filestore_osds = false 2024-05-28T06:04:49.284 INFO:teuthology.orchestra.run.smithi122.stdout: mon down mkfs grace = 300 2024-05-28T06:04:49.284 INFO:teuthology.orchestra.run.smithi122.stdout: mon op complaint time = 120 2024-05-28T06:04:49.284 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:04:49.284 INFO:teuthology.orchestra.run.smithi122.stdout:[client] 2024-05-28T06:04:49.284 INFO:teuthology.orchestra.run.smithi122.stdout: rgw cache enabled = true 2024-05-28T06:04:49.284 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable ops log = true 2024-05-28T06:04:49.284 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable usage log = true 2024-05-28T06:04:49.285 INFO:teuthology.orchestra.run.smithi122.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-28T06:04:49.285 INFO:teuthology.orchestra.run.smithi122.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-28T06:04:49.285 INFO:teuthology.orchestra.run.smithi122.stdout: client mount timeout = 600 2024-05-28T06:04:49.285 INFO:teuthology.orchestra.run.smithi122.stdout: debug client = 20 2024-05-28T06:04:49.285 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-05-28T06:04:49.285 INFO:teuthology.orchestra.run.smithi122.stdout: pid file = "" 2024-05-28T06:04:49.285 INFO:teuthology.orchestra.run.smithi122.stdout: rados mon op timeout = 900 2024-05-28T06:04:49.285 INFO:teuthology.orchestra.run.smithi122.stdout: rados osd op timeout = 900 2024-05-28T06:04:49.285 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.a] 2024-05-28T06:04:49.285 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.b] 2024-05-28T06:04:49.285 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.c] 2024-05-28T06:04:49.285 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.a] 2024-05-28T06:04:49.285 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.c] 2024-05-28T06:04:49.285 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.b] 2024-05-28T06:04:49.285 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.d] 2024-05-28T06:04:49.286 INFO:teuthology.orchestra.run.smithi122.stdout:[mds] 2024-05-28T06:04:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: debug mds = 20 2024-05-28T06:04:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: debug mds balancer = 20 2024-05-28T06:04:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-05-28T06:04:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: mds debug frag = True 2024-05-28T06:04:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: mds debug scatterstat = True 2024-05-28T06:04:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: mds op complaint time = 180 2024-05-28T06:04:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: mds verify scatter = True 2024-05-28T06:04:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: osd op complaint time = 180 2024-05-28T06:04:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: rados mon op timeout = 900 2024-05-28T06:04:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: rados osd op timeout = 900 2024-05-28T06:04:49.287 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2024-05-28T06:04:49.287 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2024-05-28T06:04:49.287 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-28T06:04:49.287 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2024-05-28T06:04:49.287 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.287 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2024-05-28T06:04:49.287 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.287 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2024-05-28T06:04:49.287 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.288 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2024-05-28T06:04:49.288 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2024-05-28T06:04:49.288 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.288 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2024-05-28T06:04:49.288 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2024-05-28T06:04:49.288 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.288 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-28T06:04:49.288 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2024-05-28T06:04:49.288 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.288 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2024-05-28T06:04:49.288 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-28T06:04:49.288 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.288 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2024-05-28T06:04:49.288 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.289 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2024-05-28T06:04:49.289 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2024-05-28T06:04:49.289 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2024-05-28T06:04:49.289 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2024-05-28T06:04:49.289 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2024-05-28T06:04:49.289 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2024-05-28T06:04:49.289 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2024-05-28T06:04:49.289 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-28T06:04:49.289 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-28T06:04:49.289 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2024-05-28T06:04:49.289 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.289 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-28T06:04:49.289 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.290 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2024-05-28T06:04:49.290 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.290 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2024-05-28T06:04:49.290 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.290 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2024-05-28T06:04:49.290 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2024-05-28T06:04:49.290 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2024-05-28T06:04:49.290 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.122,172.21.15.153,[v2:172.21.15.153:3301,v1:172.21.15.153:6790]" 2024-05-28T06:04:49.290 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on skipped message = False 2024-05-28T06:04:49.290 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = e63a9349-baf2-4247-95d1-eb8599fad84f 2024-05-28T06:04:49.290 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.291 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2024-05-28T06:04:49.291 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2024-05-28T06:04:49.291 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.291 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2024-05-28T06:04:49.291 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2024-05-28T06:04:49.291 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2024-05-28T06:04:49.291 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.291 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2024-05-28T06:04:49.291 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2024-05-28T06:04:49.291 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.291 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2024-05-28T06:04:49.291 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2024-05-28T06:04:49.291 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2024-05-28T06:04:49.291 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug trim objects = true 2024-05-28T06:04:49.292 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.292 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2024-05-28T06:04:49.292 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2024-05-28T06:04:49.292 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.292 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2024-05-28T06:04:49.292 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.292 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2024-05-28T06:04:49.292 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.292 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2024-05-28T06:04:49.292 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.292 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2024-05-28T06:04:49.292 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2024-05-28T06:04:49.292 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.293 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2024-05-28T06:04:49.293 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2024-05-28T06:04:49.293 INFO:teuthology.orchestra.run.smithi153.stdout: bdev async discard = True 2024-05-28T06:04:49.293 INFO:teuthology.orchestra.run.smithi153.stdout: bdev enable discard = True 2024-05-28T06:04:49.293 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore allocator = bitmap 2024-05-28T06:04:49.293 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2024-05-28T06:04:49.293 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2024-05-28T06:04:49.293 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 1/20 2024-05-28T06:04:49.293 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 1/20 2024-05-28T06:04:49.293 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-05-28T06:04:49.293 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2024-05-28T06:04:49.294 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 4/10 2024-05-28T06:04:49.294 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2024-05-28T06:04:49.294 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2024-05-28T06:04:49.294 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2024-05-28T06:04:49.294 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2024-05-28T06:04:49.294 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2024-05-28T06:04:49.294 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2024-05-28T06:04:49.294 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.294 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2024-05-28T06:04:49.294 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-05-28T06:04:49.294 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2024-05-28T06:04:49.294 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-05-28T06:04:49.294 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-05-28T06:04:49.294 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-05-28T06:04:49.295 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-05-28T06:04:49.295 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2024-05-28T06:04:49.295 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2024-05-28T06:04:49.295 INFO:teuthology.orchestra.run.smithi153.stdout: debug finisher = 20 2024-05-28T06:04:49.295 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.295 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2024-05-28T06:04:49.295 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-05-28T06:04:49.295 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-05-28T06:04:49.295 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2024-05-28T06:04:49.295 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-05-28T06:04:49.295 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2024-05-28T06:04:49.295 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2024-05-28T06:04:49.295 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-05-28T06:04:49.295 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2024-05-28T06:04:49.296 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2024-05-28T06:04:49.296 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-05-28T06:04:49.296 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.296 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-28T06:04:49.296 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2024-05-28T06:04:49.296 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2024-05-28T06:04:49.296 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.296 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2024-05-28T06:04:49.296 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-28T06:04:49.296 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-28T06:04:49.296 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.296 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2024-05-28T06:04:49.296 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2024-05-28T06:04:49.296 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.297 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2024-05-28T06:04:49.297 INFO:teuthology.orchestra.run.smithi153.stdout: mon down mkfs grace = 300 2024-05-28T06:04:49.297 INFO:teuthology.orchestra.run.smithi153.stdout: mon op complaint time = 120 2024-05-28T06:04:49.297 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-05-28T06:04:49.297 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2024-05-28T06:04:49.297 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2024-05-28T06:04:49.297 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2024-05-28T06:04:49.297 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2024-05-28T06:04:49.297 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-28T06:04:49.297 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-28T06:04:49.297 INFO:teuthology.orchestra.run.smithi153.stdout: client mount timeout = 600 2024-05-28T06:04:49.297 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2024-05-28T06:04:49.297 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-05-28T06:04:49.297 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = "" 2024-05-28T06:04:49.297 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2024-05-28T06:04:49.298 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2024-05-28T06:04:49.298 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2024-05-28T06:04:49.298 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2024-05-28T06:04:49.298 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2024-05-28T06:04:49.298 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-05-28T06:04:49.298 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2024-05-28T06:04:49.298 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2024-05-28T06:04:49.298 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2024-05-28T06:04:49.298 INFO:teuthology.orchestra.run.smithi153.stdout:[mds] 2024-05-28T06:04:49.298 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds = 20 2024-05-28T06:04:49.298 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds balancer = 20 2024-05-28T06:04:49.298 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-05-28T06:04:49.298 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug frag = True 2024-05-28T06:04:49.298 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug scatterstat = True 2024-05-28T06:04:49.299 INFO:teuthology.orchestra.run.smithi153.stdout: mds op complaint time = 180 2024-05-28T06:04:49.299 INFO:teuthology.orchestra.run.smithi153.stdout: mds verify scatter = True 2024-05-28T06:04:49.299 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2024-05-28T06:04:49.299 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2024-05-28T06:04:49.299 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2024-05-28T06:04:49.301 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-28T06:04:49.301 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-28T06:04:49.402 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-28T06:04:49.402 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:04:49.402 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-28T06:04:49.411 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:04:49.411 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-28T06:04:49.460 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi122.front.sepia.ceph.com 2024-05-28T06:04:49.460 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:04:49.460 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-28T06:04:49.460 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-28T06:04:49.539 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:04:49.539 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-28T06:04:49.588 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi153.front.sepia.ceph.com 2024-05-28T06:04:49.588 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:04:49.588 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-28T06:04:49.588 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-28T06:04:49.624 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:04:49.624 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-28T06:04:49.675 INFO:tasks.ceph:Setting up mon nodes... 2024-05-28T06:04:49.675 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-28T06:04:49.675 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-28T06:04:49.729 INFO:teuthology.orchestra.run.smithi122.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-28T06:04:49.735 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-28T06:04:49.798 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-28T06:04:49.822 INFO:tasks.ceph:Setting up mds nodes... 2024-05-28T06:04:49.822 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-28T06:04:49.878 INFO:teuthology.orchestra.run.smithi122.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-28T06:04:49.882 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-28T06:04:49.901 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-28T06:04:49.997 INFO:teuthology.orchestra.run.smithi122.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-28T06:04:50.002 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-28T06:04:50.023 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-28T06:04:50.082 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-28T06:04:50.086 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-28T06:04:50.153 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-28T06:04:50.248 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-28T06:04:50.253 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-28T06:04:50.279 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-28T06:04:50.279 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-28T06:04:50.327 INFO:teuthology.orchestra.run.smithi122.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-28T06:04:50.344 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-28T06:04:50.432 INFO:teuthology.orchestra.run.smithi122.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-28T06:04:50.449 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-28T06:04:50.492 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-28T06:04:50.509 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-28T06:04:50.593 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-28T06:04:50.612 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-28T06:04:50.614 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi122.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-28T06:04:50.614 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-28T06:04:50.635 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-28T06:04:50.635 INFO:tasks.ceph:role: osd.0 2024-05-28T06:04:50.636 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi122.front.sepia.ceph.com 2024-05-28T06:04:50.636 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-28T06:04:50.706 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-28T06:04:50.707 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-28T06:04:50.707 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-28T06:04:50.707 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-28T06:04:50.707 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-28T06:04:50.707 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2024-05-28T06:04:50.707 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-28T06:04:50.707 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-28T06:04:50.707 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-28T06:04:50.708 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-28T06:04:51.110 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2024-05-28T06:04:51.112 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2024-05-28T06:04:51.113 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-28T06:04:51.205 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-28T06:04:51.224 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: /sbin/restorecon: command not found 2024-05-28T06:04:51.224 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-28T06:04:51.225 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-28T06:04:51.289 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-28T06:04:51.289 INFO:tasks.ceph:role: osd.1 2024-05-28T06:04:51.289 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi122.front.sepia.ceph.com 2024-05-28T06:04:51.289 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-28T06:04:51.360 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-28T06:04:51.360 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-28T06:04:51.360 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-28T06:04:51.360 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-28T06:04:51.360 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-28T06:04:51.360 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2024-05-28T06:04:51.360 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-28T06:04:51.360 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-28T06:04:51.360 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-28T06:04:51.360 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-28T06:04:51.776 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2024-05-28T06:04:51.780 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2024-05-28T06:04:51.780 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-28T06:04:51.913 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-28T06:04:51.932 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: /sbin/restorecon: command not found 2024-05-28T06:04:51.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-28T06:04:51.933 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-28T06:04:52.002 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-28T06:04:52.002 INFO:tasks.ceph:role: osd.2 2024-05-28T06:04:52.003 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi122.front.sepia.ceph.com 2024-05-28T06:04:52.003 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-28T06:04:52.080 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-28T06:04:52.080 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-28T06:04:52.080 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-28T06:04:52.080 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-28T06:04:52.080 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-28T06:04:52.080 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2024-05-28T06:04:52.080 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-28T06:04:52.080 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-28T06:04:52.081 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-28T06:04:52.081 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-28T06:04:52.485 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2024-05-28T06:04:52.487 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2024-05-28T06:04:52.487 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-28T06:04:52.614 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-28T06:04:52.631 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: /sbin/restorecon: command not found 2024-05-28T06:04:52.631 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-28T06:04:52.632 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-28T06:04:52.696 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-28T06:04:52.696 INFO:tasks.ceph:role: osd.3 2024-05-28T06:04:52.696 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi122.front.sepia.ceph.com 2024-05-28T06:04:52.697 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-28T06:04:52.771 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-28T06:04:52.772 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-28T06:04:52.772 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-28T06:04:52.772 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-28T06:04:52.772 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-28T06:04:52.772 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2024-05-28T06:04:52.772 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-28T06:04:52.772 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-28T06:04:52.772 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-28T06:04:52.772 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-28T06:04:53.138 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2024-05-28T06:04:53.141 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2024-05-28T06:04:53.141 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-28T06:04:53.221 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-28T06:04:53.284 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: /sbin/restorecon: command not found 2024-05-28T06:04:53.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-28T06:04:53.286 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-28T06:04:53.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:04:53.404+0000 7fb0378ea7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-28T06:04:53.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:04:53.408+0000 7fb0378ea7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-28T06:04:53.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:04:53.408+0000 7fb0378ea7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-28T06:04:53.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:04:53.408+0000 7fb0378ea7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-28T06:04:53.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:04:53.408+0000 7fb0378ea7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-28T06:04:53.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:04:53.412+0000 7fb0378ea7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-28T06:04:56.467 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-28T06:04:56.488 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-28T06:04:56.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:04:56.580+0000 7f6865bcf7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-28T06:04:56.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:04:56.580+0000 7f6865bcf7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-28T06:04:56.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:04:56.580+0000 7f6865bcf7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-28T06:04:56.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:04:56.580+0000 7f6865bcf7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-28T06:04:56.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:04:56.580+0000 7f6865bcf7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-28T06:04:56.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:04:56.584+0000 7f6865bcf7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-28T06:04:59.630 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-28T06:04:59.651 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-28T06:04:59.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:04:59.744+0000 7f24778db7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-28T06:04:59.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:04:59.748+0000 7f24778db7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-28T06:04:59.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:04:59.748+0000 7f24778db7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-28T06:04:59.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:04:59.748+0000 7f24778db7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-28T06:04:59.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:04:59.748+0000 7f24778db7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-28T06:04:59.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:04:59.748+0000 7f24778db7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-28T06:05:02.821 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-28T06:05:02.842 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-28T06:05:02.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:02.936+0000 7fd73af657c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-28T06:05:02.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:02.936+0000 7fd73af657c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-28T06:05:02.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:02.936+0000 7fd73af657c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-28T06:05:02.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:02.936+0000 7fd73af657c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-28T06:05:02.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:02.936+0000 7fd73af657c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-28T06:05:02.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:02.936+0000 7fd73af657c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-28T06:05:05.998 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-28T06:05:06.020 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-28T06:05:06.042 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-28T06:05:06.042 INFO:tasks.ceph:role: osd.4 2024-05-28T06:05:06.042 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com 2024-05-28T06:05:06.042 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-28T06:05:06.111 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-28T06:05:06.111 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-28T06:05:06.111 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-28T06:05:06.111 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-28T06:05:06.111 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-28T06:05:06.112 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-05-28T06:05:06.112 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-28T06:05:06.112 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-28T06:05:06.112 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-28T06:05:06.112 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-28T06:05:06.529 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-05-28T06:05:06.533 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-05-28T06:05:06.533 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-28T06:05:06.663 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-28T06:05:06.681 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-05-28T06:05:06.681 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-28T06:05:06.682 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-28T06:05:06.747 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-28T06:05:06.747 INFO:tasks.ceph:role: osd.5 2024-05-28T06:05:06.747 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com 2024-05-28T06:05:06.747 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-28T06:05:06.818 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-28T06:05:06.819 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-28T06:05:06.819 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-28T06:05:06.819 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-28T06:05:06.819 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-28T06:05:06.819 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-05-28T06:05:06.819 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-28T06:05:06.819 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-28T06:05:06.819 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-28T06:05:06.819 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-28T06:05:07.189 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-05-28T06:05:07.191 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-05-28T06:05:07.192 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-28T06:05:07.269 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-28T06:05:07.331 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-05-28T06:05:07.332 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-28T06:05:07.333 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-28T06:05:07.399 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-28T06:05:07.399 INFO:tasks.ceph:role: osd.6 2024-05-28T06:05:07.399 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com 2024-05-28T06:05:07.399 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-28T06:05:07.471 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-28T06:05:07.471 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-28T06:05:07.472 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-28T06:05:07.472 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-28T06:05:07.472 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-28T06:05:07.472 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-05-28T06:05:07.472 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-28T06:05:07.472 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-28T06:05:07.472 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-28T06:05:07.472 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-28T06:05:07.873 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-05-28T06:05:07.876 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-05-28T06:05:07.876 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-28T06:05:07.969 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-28T06:05:07.985 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-05-28T06:05:07.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-28T06:05:07.986 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-28T06:05:08.052 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-28T06:05:08.052 INFO:tasks.ceph:role: osd.7 2024-05-28T06:05:08.052 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com 2024-05-28T06:05:08.052 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-28T06:05:08.123 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-28T06:05:08.123 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-28T06:05:08.123 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-28T06:05:08.124 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-28T06:05:08.124 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-28T06:05:08.124 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-05-28T06:05:08.124 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-28T06:05:08.124 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-28T06:05:08.124 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-28T06:05:08.124 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-28T06:05:08.530 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-05-28T06:05:08.533 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-05-28T06:05:08.533 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-28T06:05:08.660 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-28T06:05:08.677 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-05-28T06:05:08.678 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-28T06:05:08.679 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-28T06:05:08.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:08.805+0000 7ff9596697c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-28T06:05:08.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:08.805+0000 7ff9596697c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-28T06:05:08.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:08.809+0000 7ff9596697c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-28T06:05:08.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:08.809+0000 7ff9596697c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-28T06:05:08.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:08.809+0000 7ff9596697c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-28T06:05:08.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:08.817+0000 7ff9596697c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-28T06:05:11.853 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-28T06:05:11.874 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-28T06:05:11.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:11.965+0000 7ff506a657c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-28T06:05:11.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:11.965+0000 7ff506a657c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-28T06:05:11.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:11.965+0000 7ff506a657c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-28T06:05:11.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:11.965+0000 7ff506a657c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-28T06:05:11.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:11.965+0000 7ff506a657c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-28T06:05:11.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:11.969+0000 7ff506a657c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-28T06:05:15.001 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-28T06:05:15.022 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-28T06:05:15.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:15.113+0000 7f8803c3d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-28T06:05:15.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:15.113+0000 7f8803c3d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-28T06:05:15.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:15.113+0000 7f8803c3d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-28T06:05:15.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:15.113+0000 7f8803c3d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-28T06:05:15.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:15.113+0000 7f8803c3d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-28T06:05:15.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:15.113+0000 7f8803c3d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-28T06:05:17.286 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:05:17.298 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:05:18.148 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-28T06:05:18.170 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-28T06:05:18.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:18.257+0000 7f0a3e5b67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-28T06:05:18.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:18.257+0000 7f0a3e5b67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-28T06:05:18.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:18.257+0000 7f0a3e5b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-28T06:05:18.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:18.257+0000 7f0a3e5b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-28T06:05:18.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:18.257+0000 7f0a3e5b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-28T06:05:18.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:18.261+0000 7f0a3e5b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-28T06:05:21.288 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-28T06:05:21.308 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-28T06:05:21.308 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:05:21.309 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-28T06:05:21.330 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:05:21.331 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-28T06:05:21.396 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:05:21.397 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-28T06:05:21.465 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:05:21.465 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-28T06:05:21.528 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:05:21.528 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-28T06:05:21.592 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:05:21.592 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-28T06:05:21.656 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:05:21.656 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-28T06:05:21.716 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:05:21.716 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-28T06:05:21.735 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:05:21.736 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-28T06:05:21.798 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:05:21.798 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-28T06:05:21.858 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:05:21.858 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-28T06:05:21.918 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:05:21.918 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-28T06:05:21.981 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:05:21.982 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-28T06:05:22.042 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:05:22.042 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-28T06:05:22.106 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:05:22.106 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-28T06:05:22.114 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:05:22.115 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-28T06:05:22.169 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:05:22.169 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-28T06:05:22.177 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:05:22.178 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-28T06:05:22.232 INFO:tasks.ceph:Adding keys to all mons... 2024-05-28T06:05:22.232 DEBUG:teuthology.orchestra.run.smithi122:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-28T06:05:22.236 DEBUG:teuthology.orchestra.run.smithi153:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-28T06:05:22.278 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr.y] 2024-05-28T06:05:22.278 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQABdFVmnI6oKxAARwnXRnNv2SZ59/x+YyuO6g== 2024-05-28T06:05:22.279 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.a] 2024-05-28T06:05:22.279 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQABdFVm1w+ENBAApIn8Y6gj7tEWLXulaHDeUQ== 2024-05-28T06:05:22.279 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.c] 2024-05-28T06:05:22.279 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQACdFVmFGgJABAA77ul3s2asGb5MaqgumfSug== 2024-05-28T06:05:22.279 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.0] 2024-05-28T06:05:22.279 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQAFdFVmyeJQGBAAvF5HlH71HfNSzHJgrGQSeQ== 2024-05-28T06:05:22.279 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.1] 2024-05-28T06:05:22.279 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQAIdFVm1gb0IhAAfdRRFfamBuhL6VC4fKnd6A== 2024-05-28T06:05:22.279 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.2] 2024-05-28T06:05:22.280 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQALdFVm7g3HLBAA9HywQrCOoZa52bOHJc8Nkw== 2024-05-28T06:05:22.280 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.3] 2024-05-28T06:05:22.280 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQAOdFVmo7kHOBAATvO+5IkILjPjVVGK09HAQw== 2024-05-28T06:05:22.280 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr.x] 2024-05-28T06:05:22.280 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQABdFVmyM6lLxAACnc16i7218VDdALiqlbb0A== 2024-05-28T06:05:22.280 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.b] 2024-05-28T06:05:22.280 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQACdFVmGk7xBBAAMqLBLe5planzHBjA6ArHRw== 2024-05-28T06:05:22.280 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.d] 2024-05-28T06:05:22.281 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQACdFVmJ6bgDhAAyvzv5Q6Q10llEPpP2ZrVMw== 2024-05-28T06:05:22.281 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.4] 2024-05-28T06:05:22.281 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQAUdFVmlS0xMBAAnznRAYw5OO6Cgn/cfRrcfA== 2024-05-28T06:05:22.281 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.5] 2024-05-28T06:05:22.281 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQAXdFVmCcjTORAALJZO51S0QxuOlJVBtTl25A== 2024-05-28T06:05:22.281 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.6] 2024-05-28T06:05:22.281 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQAbdFVmMl0ABxAAPNjpXSKXvza1dAIaFCdesw== 2024-05-28T06:05:22.281 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.7] 2024-05-28T06:05:22.281 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQAedFVmA7ufDxAAPQwbA2Cb+c5sHN6cA1cwbQ== 2024-05-28T06:05:22.282 INFO:teuthology.orchestra.run.smithi122.stdout:[client.0] 2024-05-28T06:05:22.282 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQACdFVm0fSmExAAkwJTGq732gbcMsBbs84lWw== 2024-05-28T06:05:22.282 INFO:teuthology.orchestra.run.smithi122.stdout:[client.2] 2024-05-28T06:05:22.282 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQACdFVmekj8GRAA2pS9myP+ygZmUImxnfgjiw== 2024-05-28T06:05:22.282 INFO:teuthology.orchestra.run.smithi122.stdout:[client.1] 2024-05-28T06:05:22.282 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQACdFVmrapoHRAAgM01mt0lQsXP/W8G1QETmQ== 2024-05-28T06:05:22.282 INFO:teuthology.orchestra.run.smithi122.stdout:[client.3] 2024-05-28T06:05:22.282 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQACdFVmwRh0IxAACbmN8+zTza+A3aB9xeRRRg== 2024-05-28T06:05:22.291 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.y] 2024-05-28T06:05:22.291 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQABdFVmnI6oKxAARwnXRnNv2SZ59/x+YyuO6g== 2024-05-28T06:05:22.291 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-05-28T06:05:22.292 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQABdFVm1w+ENBAApIn8Y6gj7tEWLXulaHDeUQ== 2024-05-28T06:05:22.292 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2024-05-28T06:05:22.292 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQACdFVmFGgJABAA77ul3s2asGb5MaqgumfSug== 2024-05-28T06:05:22.292 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.0] 2024-05-28T06:05:22.292 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAFdFVmyeJQGBAAvF5HlH71HfNSzHJgrGQSeQ== 2024-05-28T06:05:22.292 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.1] 2024-05-28T06:05:22.292 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAIdFVm1gb0IhAAfdRRFfamBuhL6VC4fKnd6A== 2024-05-28T06:05:22.292 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.2] 2024-05-28T06:05:22.292 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQALdFVm7g3HLBAA9HywQrCOoZa52bOHJc8Nkw== 2024-05-28T06:05:22.292 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.3] 2024-05-28T06:05:22.292 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAOdFVmo7kHOBAATvO+5IkILjPjVVGK09HAQw== 2024-05-28T06:05:22.292 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.x] 2024-05-28T06:05:22.292 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQABdFVmyM6lLxAACnc16i7218VDdALiqlbb0A== 2024-05-28T06:05:22.292 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2024-05-28T06:05:22.293 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQACdFVmGk7xBBAAMqLBLe5planzHBjA6ArHRw== 2024-05-28T06:05:22.293 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2024-05-28T06:05:22.293 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQACdFVmJ6bgDhAAyvzv5Q6Q10llEPpP2ZrVMw== 2024-05-28T06:05:22.293 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.4] 2024-05-28T06:05:22.293 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAUdFVmlS0xMBAAnznRAYw5OO6Cgn/cfRrcfA== 2024-05-28T06:05:22.293 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.5] 2024-05-28T06:05:22.293 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAXdFVmCcjTORAALJZO51S0QxuOlJVBtTl25A== 2024-05-28T06:05:22.293 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.6] 2024-05-28T06:05:22.293 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAbdFVmMl0ABxAAPNjpXSKXvza1dAIaFCdesw== 2024-05-28T06:05:22.293 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.7] 2024-05-28T06:05:22.293 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAedFVmA7ufDxAAPQwbA2Cb+c5sHN6cA1cwbQ== 2024-05-28T06:05:22.293 INFO:teuthology.orchestra.run.smithi153.stdout:[client.0] 2024-05-28T06:05:22.293 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQACdFVm0fSmExAAkwJTGq732gbcMsBbs84lWw== 2024-05-28T06:05:22.294 INFO:teuthology.orchestra.run.smithi153.stdout:[client.2] 2024-05-28T06:05:22.294 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQACdFVmekj8GRAA2pS9myP+ygZmUImxnfgjiw== 2024-05-28T06:05:22.294 INFO:teuthology.orchestra.run.smithi153.stdout:[client.1] 2024-05-28T06:05:22.294 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQACdFVmrapoHRAAgM01mt0lQsXP/W8G1QETmQ== 2024-05-28T06:05:22.294 INFO:teuthology.orchestra.run.smithi153.stdout:[client.3] 2024-05-28T06:05:22.294 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQACdFVmwRh0IxAACbmN8+zTza+A3aB9xeRRRg== 2024-05-28T06:05:22.295 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-28T06:05:22.332 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-28T06:05:22.391 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-28T06:05:22.394 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-28T06:05:22.449 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-28T06:05:22.452 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-28T06:05:22.508 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-28T06:05:22.512 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-28T06:05:22.567 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-28T06:05:22.571 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-28T06:05:22.624 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-28T06:05:22.627 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-28T06:05:22.679 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-28T06:05:22.682 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-28T06:05:22.736 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-28T06:05:22.739 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-28T06:05:22.791 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-28T06:05:22.794 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-28T06:05:22.849 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-28T06:05:22.853 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-28T06:05:22.908 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-28T06:05:22.912 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-28T06:05:22.964 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-28T06:05:22.968 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-28T06:05:23.020 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-28T06:05:23.023 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-28T06:05:23.075 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-28T06:05:23.078 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-28T06:05:23.132 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-28T06:05:23.136 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-28T06:05:23.191 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-28T06:05:23.194 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-28T06:05:23.249 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-28T06:05:23.252 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-28T06:05:23.308 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-28T06:05:23.312 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-28T06:05:23.368 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-28T06:05:23.368 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-28T06:05:23.387 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-28T06:05:23.499 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-28T06:05:23.518 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-28T06:05:23.538 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-28T06:05:23.646 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-28T06:05:23.666 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-28T06:05:23.730 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-28T06:05:23.839 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-28T06:05:23.859 DEBUG:teuthology.orchestra.run.smithi122:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-28T06:05:23.862 DEBUG:teuthology.orchestra.run.smithi153:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-28T06:05:23.914 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-28T06:05:23.914 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-28T06:05:23.915 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-28T06:05:23.917 INFO:tasks.ceph.mon.a:Started 2024-05-28T06:05:23.918 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-28T06:05:23.918 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-28T06:05:23.958 INFO:tasks.ceph.mon.b:Started 2024-05-28T06:05:23.958 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-28T06:05:23.958 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-28T06:05:23.961 INFO:tasks.ceph.mon.c:Started 2024-05-28T06:05:23.961 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-28T06:05:23.961 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-28T06:05:23.961 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-28T06:05:23.964 INFO:tasks.ceph.mgr.y:Started 2024-05-28T06:05:23.964 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-28T06:05:23.964 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-28T06:05:23.967 INFO:tasks.ceph.mgr.x:Started 2024-05-28T06:05:23.967 INFO:tasks.ceph:Setting crush tunables to default 2024-05-28T06:05:23.967 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd crush tunables default 2024-05-28T06:05:24.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.107+0000 7f5b8aa00640 1 Processor -- start 2024-05-28T06:05:24.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.107+0000 7f5b8aa00640 1 -- start start 2024-05-28T06:05:24.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.107+0000 7f5b8aa00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5b8409b080 0x7f5b840b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:24.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.107+0000 7f5b8aa00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b840d0bf0 con 0x7f5b84160240 2024-05-28T06:05:24.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.107+0000 7f5b8aa00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b840d0eb0 con 0x7f5b8409aca0 2024-05-28T06:05:24.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.107+0000 7f5b8aa00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5b840b5460 con 0x7f5b8409b080 2024-05-28T06:05:24.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.107+0000 7f5b88a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5b8409b080 0x7f5b840b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:24.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.107+0000 7f5b88a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5b8409b080 0x7f5b840b35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:36930/0 (socket says 172.21.15.122:36930) 2024-05-28T06:05:24.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.107+0000 7f5b7b400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f5b84160240 0x7f5b840b58f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:53908/0 (socket says 172.21.15.122:53908) 2024-05-28T06:05:24.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.107+0000 7f5b88a00640 1 -- 172.21.15.122:0/4088972131 learned_addr learned my addr 172.21.15.122:0/4088972131 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:24.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.107+0000 7f5b88a00640 1 -- 172.21.15.122:0/4088972131 >> v2:172.21.15.153:3300/0 conn(0x7f5b8409b080 msgr2=0x7f5b840b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-28T06:05:24.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.107+0000 7f5b88a00640 1 -- 172.21.15.122:0/4088972131 >> v2:172.21.15.153:3300/0 conn(0x7f5b8409b080 msgr2=0x7f5b840b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-28T06:05:24.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.107+0000 7f5b88a00640 1 --2- 172.21.15.122:0/4088972131 >> v2:172.21.15.153:3300/0 conn(0x7f5b8409b080 0x7f5b840b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-28T06:05:24.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.107+0000 7f5b88a00640 1 --2- 172.21.15.122:0/4088972131 >> v2:172.21.15.153:3300/0 conn(0x7f5b8409b080 0x7f5b840b35b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-28T06:05:24.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.263+0000 7f5b83400640 1 -- 172.21.15.122:0/4088972131 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4202677790 0 0) 0x7f5b840d0bf0 con 0x7f5b84160240 2024-05-28T06:05:24.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.263+0000 7f5b83400640 1 -- 172.21.15.122:0/4088972131 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b68003530 con 0x7f5b84160240 2024-05-28T06:05:24.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.267+0000 7f5b83400640 1 -- 172.21.15.122:0/4088972131 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 554891757 0 0) 0x7f5b68003530 con 0x7f5b84160240 2024-05-28T06:05:24.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.267+0000 7f5b83400640 1 -- 172.21.15.122:0/4088972131 >> v2:172.21.15.153:3300/0 conn(0x7f5b8409b080 msgr2=0x7f5b840b35b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-28T06:05:24.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.267+0000 7f5b83400640 1 --2- 172.21.15.122:0/4088972131 >> v2:172.21.15.153:3300/0 conn(0x7f5b8409b080 0x7f5b840b35b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:24.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.267+0000 7f5b83400640 1 -- 172.21.15.122:0/4088972131 >> v1:172.21.15.153:6789/0 conn(0x7f5b8409aca0 legacy=0x7f5b8415fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:24.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.267+0000 7f5b83400640 1 -- 172.21.15.122:0/4088972131 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b840d1190 con 0x7f5b84160240 2024-05-28T06:05:24.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.267+0000 7f5b83400640 1 -- 172.21.15.122:0/4088972131 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f5b6c001680 con 0x7f5b84160240 2024-05-28T06:05:24.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.267+0000 7f5b83400640 1 -- 172.21.15.122:0/4088972131 >> v1:172.21.15.122:6789/0 conn(0x7f5b84160240 legacy=0x7f5b840b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:24.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.267+0000 7f5b83400640 1 --2- 172.21.15.122:0/4088972131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b680039c0 0x7f5b68003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:24.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.267+0000 7f5b83400640 1 --2- 172.21.15.122:0/4088972131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b68004810 0x7f5b68004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:24.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.267+0000 7f5b83400640 1 --2- 172.21.15.122:0/4088972131 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b680051d0 0x7f5b6800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:24.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.267+0000 7f5b83400640 1 -- 172.21.15.122:0/4088972131 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5b840b5460 con 0x7f5b680039c0 2024-05-28T06:05:24.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.267+0000 7f5b83400640 1 -- 172.21.15.122:0/4088972131 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6800c120 con 0x7f5b68004810 2024-05-28T06:05:24.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.267+0000 7f5b83400640 1 -- 172.21.15.122:0/4088972131 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5b68010730 con 0x7f5b680051d0 2024-05-28T06:05:24.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.267+0000 7f5b83e00640 1 --2- 172.21.15.122:0/4088972131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b680039c0 0x7f5b68003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:24.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.267+0000 7f5b7b400640 1 --2- 172.21.15.122:0/4088972131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b68004810 0x7f5b68004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:24.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.267+0000 7f5b83e00640 1 -- 172.21.15.122:0/4088972131 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b680051d0 msgr2=0x7f5b6800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:24.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.267+0000 7f5b83e00640 1 --2- 172.21.15.122:0/4088972131 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b680051d0 0x7f5b6800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:24.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.267+0000 7f5b83e00640 1 -- 172.21.15.122:0/4088972131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b68004810 msgr2=0x7f5b68004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:24.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.267+0000 7f5b83e00640 1 --2- 172.21.15.122:0/4088972131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b68004810 0x7f5b68004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:24.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.267+0000 7f5b83e00640 1 -- 172.21.15.122:0/4088972131 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b68003530 con 0x7f5b680039c0 2024-05-28T06:05:24.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.267+0000 7f5b88a00640 1 -- 172.21.15.122:0/4088972131 reap_dead start 2024-05-28T06:05:24.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.271+0000 7f5b83e00640 1 --2- 172.21.15.122:0/4088972131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b680039c0 0x7f5b68003de0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5b74001e70 tx=0x7f5b7401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=612d9e9b6f5ad5ba server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:24.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.271+0000 7f5b83400640 1 -- 172.21.15.122:0/4088972131 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b74001a90 con 0x7f5b680039c0 2024-05-28T06:05:24.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.271+0000 7f5b83400640 1 -- 172.21.15.122:0/4088972131 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b74003b80 con 0x7f5b680039c0 2024-05-28T06:05:24.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.271+0000 7f5b83400640 1 -- 172.21.15.122:0/4088972131 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b740050d0 con 0x7f5b680039c0 2024-05-28T06:05:24.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.271+0000 7f5b8aa00640 1 -- 172.21.15.122:0/4088972131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b680039c0 msgr2=0x7f5b68003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:24.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.271+0000 7f5b8aa00640 1 --2- 172.21.15.122:0/4088972131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b680039c0 0x7f5b68003de0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5b74001e70 tx=0x7f5b7401c760 comp rx=0 tx=0).stop 2024-05-28T06:05:24.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.271+0000 7f5b8aa00640 1 -- 172.21.15.122:0/4088972131 shutdown_connections 2024-05-28T06:05:24.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.271+0000 7f5b8aa00640 1 --2- 172.21.15.122:0/4088972131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b680039c0 0x7f5b68003de0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:24.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.271+0000 7f5b8aa00640 1 -- 172.21.15.122:0/4088972131 >> 172.21.15.122:0/4088972131 conn(0x7f5b840b4100 msgr2=0x7f5b840b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:24.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.271+0000 7f5b8aa00640 1 -- 172.21.15.122:0/4088972131 shutdown_connections 2024-05-28T06:05:24.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.271+0000 7f5b8aa00640 1 -- 172.21.15.122:0/4088972131 wait complete. 2024-05-28T06:05:24.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b8aa00640 1 Processor -- start 2024-05-28T06:05:24.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b8aa00640 1 -- start start 2024-05-28T06:05:24.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b8aa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b680039c0 0x7f5b8409c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:24.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b8aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b840c8d50 0x7f5b840c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:24.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b8aa00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b84151760 0x7f5b8409dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:24.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b8aa00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8409bb10 con 0x7f5b680039c0 2024-05-28T06:05:24.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b8aa00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8409b990 con 0x7f5b840c8d50 2024-05-28T06:05:24.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b8aa00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5b8409bc90 con 0x7f5b84151760 2024-05-28T06:05:24.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b83e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b680039c0 0x7f5b8409c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:24.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b83e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b680039c0 0x7f5b8409c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:32774/0 (socket says 172.21.15.122:32774) 2024-05-28T06:05:24.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b83e00640 1 -- 172.21.15.122:0/3056948872 learned_addr learned my addr 172.21.15.122:0/3056948872 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:24.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b7b400640 1 --2- 172.21.15.122:0/3056948872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b840c8d50 0x7f5b840c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:24.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b88a00640 1 --2- 172.21.15.122:0/3056948872 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b84151760 0x7f5b8409dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:24.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b83e00640 1 -- 172.21.15.122:0/3056948872 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b84151760 msgr2=0x7f5b8409dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:24.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b83e00640 1 --2- 172.21.15.122:0/3056948872 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b84151760 0x7f5b8409dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:24.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b83e00640 1 -- 172.21.15.122:0/3056948872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b840c8d50 msgr2=0x7f5b840c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:24.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b83e00640 1 --2- 172.21.15.122:0/3056948872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b840c8d50 0x7f5b840c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:24.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b83e00640 1 -- 172.21.15.122:0/3056948872 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b840c94c0 con 0x7f5b680039c0 2024-05-28T06:05:24.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b83e00640 1 --2- 172.21.15.122:0/3056948872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b680039c0 0x7f5b8409c420 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5b7401cc40 tx=0x7f5b68005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:24.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b80c00640 1 -- 172.21.15.122:0/3056948872 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b740b3070 con 0x7f5b680039c0 2024-05-28T06:05:24.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b80c00640 1 -- 172.21.15.122:0/3056948872 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b74006d60 con 0x7f5b680039c0 2024-05-28T06:05:24.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b80c00640 1 -- 172.21.15.122:0/3056948872 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b740052f0 con 0x7f5b680039c0 2024-05-28T06:05:24.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b8aa00640 1 -- 172.21.15.122:0/3056948872 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b840c71c0 con 0x7f5b680039c0 2024-05-28T06:05:24.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.275+0000 7f5b8aa00640 1 -- 172.21.15.122:0/3056948872 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b840c7780 con 0x7f5b680039c0 2024-05-28T06:05:24.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.279+0000 7f5b80c00640 1 -- 172.21.15.122:0/3056948872 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5b74003a00 con 0x7f5b680039c0 2024-05-28T06:05:24.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.279+0000 7f5b80c00640 1 -- 172.21.15.122:0/3056948872 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5b740a6a80 con 0x7f5b680039c0 2024-05-28T06:05:24.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.279+0000 7f5b8aa00640 1 -- 172.21.15.122:0/3056948872 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b84068c40 con 0x7f5b680039c0 2024-05-28T06:05:24.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.295+0000 7f5b80c00640 1 -- 172.21.15.122:0/3056948872 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5b74016470 con 0x7f5b680039c0 2024-05-28T06:05:24.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.355+0000 7f5b8aa00640 1 -- 172.21.15.122:0/3056948872 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f5b8415fea0 con 0x7f5b680039c0 2024-05-28T06:05:24.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.359+0000 7f5b80c00640 1 -- 172.21.15.122:0/3056948872 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f5b740a64f0 con 0x7f5b680039c0 2024-05-28T06:05:24.360 INFO:teuthology.orchestra.run.smithi122.stderr:adjusted tunables profile to default 2024-05-28T06:05:24.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.359+0000 7f5b8aa00640 1 -- 172.21.15.122:0/3056948872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b680039c0 msgr2=0x7f5b8409c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:24.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.359+0000 7f5b8aa00640 1 --2- 172.21.15.122:0/3056948872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b680039c0 0x7f5b8409c420 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5b7401cc40 tx=0x7f5b68005840 comp rx=0 tx=0).stop 2024-05-28T06:05:24.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.359+0000 7f5b8aa00640 1 -- 172.21.15.122:0/3056948872 shutdown_connections 2024-05-28T06:05:24.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.359+0000 7f5b8aa00640 1 --2- 172.21.15.122:0/3056948872 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b84151760 0x7f5b8409dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:24.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.359+0000 7f5b8aa00640 1 --2- 172.21.15.122:0/3056948872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b840c8d50 0x7f5b840c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:24.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.359+0000 7f5b8aa00640 1 --2- 172.21.15.122:0/3056948872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b680039c0 0x7f5b8409c420 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:24.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.359+0000 7f5b8aa00640 1 -- 172.21.15.122:0/3056948872 >> 172.21.15.122:0/3056948872 conn(0x7f5b840b4100 msgr2=0x7f5b84074d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:24.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.359+0000 7f5b8aa00640 1 -- 172.21.15.122:0/3056948872 shutdown_connections 2024-05-28T06:05:24.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:24.359+0000 7f5b8aa00640 1 -- 172.21.15.122:0/3056948872 wait complete. 2024-05-28T06:05:24.380 INFO:tasks.ceph:check_enable_crimson: False 2024-05-28T06:05:24.380 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-28T06:05:24.380 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:05:24.380 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-28T06:05:24.401 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:05:24.401 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-28T06:05:24.465 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:05:24.465 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-28T06:05:24.479 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-28T06:05:24.472+0000 7f7475eee180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-28T06:05:24.488 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:24.487+0000 7f9e6c4c1180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-28T06:05:24.509 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:05:24.509 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-28T06:05:24.573 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:05:24.573 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-28T06:05:24.593 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:05:24.593 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-28T06:05:24.654 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:05:24.654 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-28T06:05:24.714 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:05:24.714 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-28T06:05:24.774 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 8db3ddab-8e60-476f-b178-931092fcb97a 0 2024-05-28T06:05:24.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.944+0000 7ff75fe00640 1 Processor -- start 2024-05-28T06:05:24.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.944+0000 7ff75fe00640 1 -- start start 2024-05-28T06:05:24.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.944+0000 7ff75fe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff76015c7c0 0x7ff76009ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:24.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.944+0000 7ff75fe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7600d0020 0x7ff7600af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:24.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.944+0000 7ff75fe00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff76009ac50 con 0x7ff7600af720 2024-05-28T06:05:24.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.944+0000 7ff75fe00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff76009af30 con 0x7ff76015c7c0 2024-05-28T06:05:24.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.944+0000 7ff75fe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff76009b210 con 0x7ff7600d0020 2024-05-28T06:05:24.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.944+0000 7ff75ea00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff76015c7c0 0x7ff76009ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:24.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.944+0000 7ff75e000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7600d0020 0x7ff7600af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:24.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.944+0000 7ff75ea00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff76015c7c0 0x7ff76009ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55176/0 (socket says 172.21.15.153:55176) 2024-05-28T06:05:24.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.944+0000 7ff75ea00640 1 -- 172.21.15.153:0/1750380830 learned_addr learned my addr 172.21.15.153:0/1750380830 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-28T06:05:24.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.944+0000 7ff75ea00640 1 -- 172.21.15.153:0/1750380830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7600d0020 msgr2=0x7ff7600af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:24.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.944+0000 7ff75ea00640 1 --2- 172.21.15.153:0/1750380830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7600d0020 0x7ff7600af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:24.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.944+0000 7ff75ea00640 1 -- 172.21.15.153:0/1750380830 >> v1:172.21.15.122:6789/0 conn(0x7ff7600af720 legacy=0x7ff760160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:24.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.944+0000 7ff75ea00640 1 -- 172.21.15.153:0/1750380830 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76009b4f0 con 0x7ff76015c7c0 2024-05-28T06:05:24.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.948+0000 7ff75ea00640 1 --2- 172.21.15.153:0/1750380830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff76015c7c0 0x7ff76009ba10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff750009870 tx=0x7ff75001c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dc5b4b466a05285 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:24.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.948+0000 7ff75d600640 1 -- 172.21.15.153:0/1750380830 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7500a7070 con 0x7ff76015c7c0 2024-05-28T06:05:24.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.948+0000 7ff75d600640 1 -- 172.21.15.153:0/1750380830 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7500b0070 con 0x7ff76015c7c0 2024-05-28T06:05:24.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.948+0000 7ff75d600640 1 -- 172.21.15.153:0/1750380830 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7500ab890 con 0x7ff76015c7c0 2024-05-28T06:05:24.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.948+0000 7ff75fe00640 1 -- 172.21.15.153:0/1750380830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff76015c7c0 msgr2=0x7ff76009ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:24.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.948+0000 7ff75fe00640 1 --2- 172.21.15.153:0/1750380830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff76015c7c0 0x7ff76009ba10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff750009870 tx=0x7ff75001c560 comp rx=0 tx=0).stop 2024-05-28T06:05:24.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.948+0000 7ff75fe00640 1 -- 172.21.15.153:0/1750380830 shutdown_connections 2024-05-28T06:05:24.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.948+0000 7ff75fe00640 1 --2- 172.21.15.153:0/1750380830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7600d0020 0x7ff7600af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:24.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.948+0000 7ff75fe00640 1 --2- 172.21.15.153:0/1750380830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff76015c7c0 0x7ff76009ba10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:24.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.948+0000 7ff75fe00640 1 -- 172.21.15.153:0/1750380830 >> 172.21.15.153:0/1750380830 conn(0x7ff7600b3f40 msgr2=0x7ff7600b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:24.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.948+0000 7ff75fe00640 1 -- 172.21.15.153:0/1750380830 shutdown_connections 2024-05-28T06:05:24.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.948+0000 7ff75fe00640 1 -- 172.21.15.153:0/1750380830 wait complete. 2024-05-28T06:05:24.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.952+0000 7ff75fe00640 1 Processor -- start 2024-05-28T06:05:24.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.952+0000 7ff75fe00640 1 -- start start 2024-05-28T06:05:24.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.952+0000 7ff75fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7600af720 0x7ff760157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:24.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.952+0000 7ff75fe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7600d0020 0x7ff7600b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:24.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.952+0000 7ff75fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7601578c0 0x7ff7600b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:24.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.952+0000 7ff75fe00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff760169850 con 0x7ff7601578c0 2024-05-28T06:05:24.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.952+0000 7ff75fe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff7601696d0 con 0x7ff7600af720 2024-05-28T06:05:24.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.952+0000 7ff75fe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff7601699d0 con 0x7ff7600d0020 2024-05-28T06:05:24.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.952+0000 7ff75ea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7600af720 0x7ff760157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:24.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.952+0000 7ff75ea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7600af720 0x7ff760157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55190/0 (socket says 172.21.15.153:55190) 2024-05-28T06:05:24.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.952+0000 7ff75ea00640 1 -- 172.21.15.153:0/3660388331 learned_addr learned my addr 172.21.15.153:0/3660388331 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-28T06:05:24.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.952+0000 7ff75e000640 1 --2- 172.21.15.153:0/3660388331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7600d0020 0x7ff7600b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:24.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.952+0000 7ff75f400640 1 --2- 172.21.15.153:0/3660388331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7601578c0 0x7ff7600b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:24.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.952+0000 7ff75ea00640 1 -- 172.21.15.153:0/3660388331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7600d0020 msgr2=0x7ff7600b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:24.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.952+0000 7ff75ea00640 1 --2- 172.21.15.153:0/3660388331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7600d0020 0x7ff7600b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:24.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.952+0000 7ff75ea00640 1 -- 172.21.15.153:0/3660388331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7601578c0 msgr2=0x7ff7600b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:24.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.952+0000 7ff75ea00640 1 --2- 172.21.15.153:0/3660388331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7601578c0 0x7ff7600b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:24.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.952+0000 7ff75ea00640 1 -- 172.21.15.153:0/3660388331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7600b6340 con 0x7ff7600af720 2024-05-28T06:05:24.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.952+0000 7ff75ea00640 1 --2- 172.21.15.153:0/3660388331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7600af720 0x7ff760157000 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff75001ac10 tx=0x7ff75001ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:24.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.952+0000 7ff756a00640 1 -- 172.21.15.153:0/3660388331 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7500b4800 con 0x7ff7600af720 2024-05-28T06:05:24.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.952+0000 7ff756a00640 1 -- 172.21.15.153:0/3660388331 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7500b49c0 con 0x7ff7600af720 2024-05-28T06:05:24.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.952+0000 7ff756a00640 1 -- 172.21.15.153:0/3660388331 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7500b4db0 con 0x7ff7600af720 2024-05-28T06:05:24.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.952+0000 7ff75fe00640 1 -- 172.21.15.153:0/3660388331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7600b6620 con 0x7ff7600af720 2024-05-28T06:05:24.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.956+0000 7ff75fe00640 1 -- 172.21.15.153:0/3660388331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff76015a2a0 con 0x7ff7600af720 2024-05-28T06:05:24.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.956+0000 7ff756a00640 1 -- 172.21.15.153:0/3660388331 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff7500be780 con 0x7ff7600af720 2024-05-28T06:05:24.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.956+0000 7ff756a00640 1 -- 172.21.15.153:0/3660388331 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7ff7500b3830 con 0x7ff7600af720 2024-05-28T06:05:24.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.956+0000 7ff75fe00640 1 -- 172.21.15.153:0/3660388331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff760075620 con 0x7ff7600af720 2024-05-28T06:05:24.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:24.956+0000 7ff756a00640 1 -- 172.21.15.153:0/3660388331 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff750016150 con 0x7ff7600af720 2024-05-28T06:05:24.987 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:24.987+0000 7f9e6c4c1180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-28T06:05:25.001 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-28T06:05:24.996+0000 7f7475eee180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-28T06:05:25.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.024+0000 7ff75fe00640 1 -- 172.21.15.153:0/3660388331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8db3ddab-8e60-476f-b178-931092fcb97a", "id": 0} v 0) -- 0x7ff7600b83d0 con 0x7ff7600af720 2024-05-28T06:05:25.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.032+0000 7ff756a00640 1 -- 172.21.15.153:0/3660388331 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8db3ddab-8e60-476f-b178-931092fcb97a", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7ff7500b3380 con 0x7ff7600af720 2024-05-28T06:05:25.036 INFO:teuthology.orchestra.run.smithi153.stdout:0 2024-05-28T06:05:25.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.032+0000 7ff75fe00640 1 -- 172.21.15.153:0/3660388331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7600af720 msgr2=0x7ff760157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:25.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.032+0000 7ff75fe00640 1 --2- 172.21.15.153:0/3660388331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7600af720 0x7ff760157000 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff75001ac10 tx=0x7ff75001ada0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.032+0000 7ff75fe00640 1 -- 172.21.15.153:0/3660388331 shutdown_connections 2024-05-28T06:05:25.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.032+0000 7ff75fe00640 1 --2- 172.21.15.153:0/3660388331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7601578c0 0x7ff7600b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.032+0000 7ff75fe00640 1 --2- 172.21.15.153:0/3660388331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7600d0020 0x7ff7600b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.032+0000 7ff75fe00640 1 --2- 172.21.15.153:0/3660388331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7600af720 0x7ff760157000 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.032+0000 7ff75fe00640 1 -- 172.21.15.153:0/3660388331 >> 172.21.15.153:0/3660388331 conn(0x7ff7600b3f40 msgr2=0x7ff7600b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:25.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.032+0000 7ff75fe00640 1 -- 172.21.15.153:0/3660388331 shutdown_connections 2024-05-28T06:05:25.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.032+0000 7ff75fe00640 1 -- 172.21.15.153:0/3660388331 wait complete. 2024-05-28T06:05:25.055 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 42751133-d830-4153-835f-0f2df6383268 1 2024-05-28T06:05:25.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.184+0000 7fc400c00640 1 Processor -- start 2024-05-28T06:05:25.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.184+0000 7fc400c00640 1 -- start start 2024-05-28T06:05:25.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.184+0000 7fc400c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc3fc162490 0x7fc3fc162900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:25.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.184+0000 7fc400c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3fc06caa0 0x7fc3fc06cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:25.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.184+0000 7fc400c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3fc09bb60 con 0x7fc3fc15ea30 2024-05-28T06:05:25.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.184+0000 7fc400c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc3fc162e40 con 0x7fc3fc162490 2024-05-28T06:05:25.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.184+0000 7fc400c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc3fc0d0c80 con 0x7fc3fc06caa0 2024-05-28T06:05:25.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.184+0000 7fc3fa800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3fc06caa0 0x7fc3fc06cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:25.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.184+0000 7fc3f9400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc3fc162490 0x7fc3fc162900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:25.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.188+0000 7fc3f9400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc3fc162490 0x7fc3fc162900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55202/0 (socket says 172.21.15.153:55202) 2024-05-28T06:05:25.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.188+0000 7fc3fa800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3fc06caa0 0x7fc3fc06cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:38072/0 (socket says 172.21.15.153:38072) 2024-05-28T06:05:25.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.188+0000 7fc3f9400640 1 -- 172.21.15.153:0/4234244095 learned_addr learned my addr 172.21.15.153:0/4234244095 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-28T06:05:25.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.188+0000 7fc3f9400640 1 -- 172.21.15.153:0/4234244095 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3fc06caa0 msgr2=0x7fc3fc06cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:25.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.188+0000 7fc3f9400640 1 --2- 172.21.15.153:0/4234244095 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3fc06caa0 0x7fc3fc06cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.188+0000 7fc3f9400640 1 -- 172.21.15.153:0/4234244095 >> v1:172.21.15.122:6789/0 conn(0x7fc3fc15ea30 legacy=0x7fc3fc09b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:25.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.188+0000 7fc3f9400640 1 -- 172.21.15.153:0/4234244095 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3fc0d0f60 con 0x7fc3fc162490 2024-05-28T06:05:25.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.188+0000 7fc3f9400640 1 --2- 172.21.15.153:0/4234244095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3fc162490 0x7fc3fc162900 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009870 tx=0x7fc3e801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adccec571a2f959d server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:25.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.188+0000 7fc3f8a00640 1 -- 172.21.15.153:0/4234244095 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e80aa600 con 0x7fc3fc162490 2024-05-28T06:05:25.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.188+0000 7fc3f8a00640 1 -- 172.21.15.153:0/4234244095 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3e80af070 con 0x7fc3fc162490 2024-05-28T06:05:25.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.188+0000 7fc3f8a00640 1 -- 172.21.15.153:0/4234244095 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e80aa9c0 con 0x7fc3fc162490 2024-05-28T06:05:25.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc400c00640 1 -- 172.21.15.153:0/4234244095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3fc162490 msgr2=0x7fc3fc162900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:25.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc400c00640 1 --2- 172.21.15.153:0/4234244095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3fc162490 0x7fc3fc162900 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009870 tx=0x7fc3e801c4a0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc400c00640 1 -- 172.21.15.153:0/4234244095 shutdown_connections 2024-05-28T06:05:25.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc400c00640 1 --2- 172.21.15.153:0/4234244095 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3fc06caa0 0x7fc3fc06cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc400c00640 1 --2- 172.21.15.153:0/4234244095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3fc162490 0x7fc3fc162900 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc400c00640 1 -- 172.21.15.153:0/4234244095 >> 172.21.15.153:0/4234244095 conn(0x7fc3fc0b4100 msgr2=0x7fc3fc0b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:25.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc400c00640 1 -- 172.21.15.153:0/4234244095 shutdown_connections 2024-05-28T06:05:25.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc400c00640 1 -- 172.21.15.153:0/4234244095 wait complete. 2024-05-28T06:05:25.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc400c00640 1 Processor -- start 2024-05-28T06:05:25.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc400c00640 1 -- start start 2024-05-28T06:05:25.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc400c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3fc06caa0 0x7fc3fc0b7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:25.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc400c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3fc15ea30 0x7fc3fc15b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:25.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc400c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3fc162490 0x7fc3fc15d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:25.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc400c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc0d09d0 con 0x7fc3fc15ea30 2024-05-28T06:05:25.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc400c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc0d0850 con 0x7fc3fc06caa0 2024-05-28T06:05:25.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc400c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc3fc16b830 con 0x7fc3fc162490 2024-05-28T06:05:25.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc3fa800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3fc162490 0x7fc3fc15d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:25.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc3f9e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3fc06caa0 0x7fc3fc0b7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:25.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc3fa800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3fc162490 0x7fc3fc15d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:38082/0 (socket says 172.21.15.153:38082) 2024-05-28T06:05:25.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc3f9e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3fc06caa0 0x7fc3fc0b7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55206/0 (socket says 172.21.15.153:55206) 2024-05-28T06:05:25.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc3fa800640 1 -- 172.21.15.153:0/3409405213 learned_addr learned my addr 172.21.15.153:0/3409405213 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-28T06:05:25.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc3f9400640 1 --2- 172.21.15.153:0/3409405213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3fc15ea30 0x7fc3fc15b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:25.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc3fa800640 1 -- 172.21.15.153:0/3409405213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3fc06caa0 msgr2=0x7fc3fc0b7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:25.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc3fa800640 1 --2- 172.21.15.153:0/3409405213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3fc06caa0 0x7fc3fc0b7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc3fa800640 1 -- 172.21.15.153:0/3409405213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3fc15ea30 msgr2=0x7fc3fc15b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:25.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc3fa800640 1 --2- 172.21.15.153:0/3409405213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3fc15ea30 0x7fc3fc15b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.192+0000 7fc3fa800640 1 -- 172.21.15.153:0/3409405213 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3fc0b6670 con 0x7fc3fc162490 2024-05-28T06:05:25.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.196+0000 7fc3fa800640 1 --2- 172.21.15.153:0/3409405213 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3fc162490 0x7fc3fc15d340 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400efc0 tx=0x7fc3f400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:25.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.196+0000 7fc3f2000640 1 -- 172.21.15.153:0/3409405213 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f4018020 con 0x7fc3fc162490 2024-05-28T06:05:25.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.196+0000 7fc3f2000640 1 -- 172.21.15.153:0/3409405213 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f4014480 con 0x7fc3fc162490 2024-05-28T06:05:25.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.196+0000 7fc400c00640 1 -- 172.21.15.153:0/3409405213 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3fc0b6950 con 0x7fc3fc162490 2024-05-28T06:05:25.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.196+0000 7fc3f2000640 1 -- 172.21.15.153:0/3409405213 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f4014870 con 0x7fc3fc162490 2024-05-28T06:05:25.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.196+0000 7fc400c00640 1 -- 172.21.15.153:0/3409405213 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3fc0b6f10 con 0x7fc3fc162490 2024-05-28T06:05:25.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.196+0000 7fc3f2000640 1 -- 172.21.15.153:0/3409405213 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc3f401b020 con 0x7fc3fc162490 2024-05-28T06:05:25.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.196+0000 7fc3f2000640 1 -- 172.21.15.153:0/3409405213 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fc3f4013790 con 0x7fc3fc162490 2024-05-28T06:05:25.203 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:25.203+0000 7f9e6c4c1180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-28T06:05:25.203 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.196+0000 7fc400c00640 1 -- 172.21.15.153:0/3409405213 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3fc068c40 con 0x7fc3fc162490 2024-05-28T06:05:25.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.208+0000 7fc3f2000640 1 -- 172.21.15.153:0/3409405213 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc3f4022070 con 0x7fc3fc162490 2024-05-28T06:05:25.247 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-28T06:05:25.240+0000 7f7475eee180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-28T06:05:25.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.276+0000 7fc400c00640 1 -- 172.21.15.153:0/3409405213 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "42751133-d830-4153-835f-0f2df6383268", "id": 1} v 0) -- 0x7fc3fc0cffc0 con 0x7fc3fc162490 2024-05-28T06:05:25.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.284+0000 7fc3f2000640 1 -- 172.21.15.153:0/3409405213 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "42751133-d830-4153-835f-0f2df6383268", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fc3f4010040 con 0x7fc3fc162490 2024-05-28T06:05:25.288 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-05-28T06:05:25.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.284+0000 7fc400c00640 1 -- 172.21.15.153:0/3409405213 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3fc162490 msgr2=0x7fc3fc15d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:25.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.284+0000 7fc400c00640 1 --2- 172.21.15.153:0/3409405213 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3fc162490 0x7fc3fc15d340 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400efc0 tx=0x7fc3f400c490 comp rx=0 tx=0).stop 2024-05-28T06:05:25.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.284+0000 7fc400c00640 1 -- 172.21.15.153:0/3409405213 shutdown_connections 2024-05-28T06:05:25.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.284+0000 7fc400c00640 1 --2- 172.21.15.153:0/3409405213 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3fc162490 0x7fc3fc15d340 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.284+0000 7fc400c00640 1 --2- 172.21.15.153:0/3409405213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3fc15ea30 0x7fc3fc15b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.284+0000 7fc400c00640 1 --2- 172.21.15.153:0/3409405213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3fc06caa0 0x7fc3fc0b7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.284+0000 7fc400c00640 1 -- 172.21.15.153:0/3409405213 >> 172.21.15.153:0/3409405213 conn(0x7fc3fc0b4100 msgr2=0x7fc3fc0b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:25.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.284+0000 7fc400c00640 1 -- 172.21.15.153:0/3409405213 shutdown_connections 2024-05-28T06:05:25.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.284+0000 7fc400c00640 1 -- 172.21.15.153:0/3409405213 wait complete. 2024-05-28T06:05:25.307 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 3a4d62cc-ba0b-401e-8638-24c43b946c0c 2 2024-05-28T06:05:25.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.436+0000 7f11e9200640 1 Processor -- start 2024-05-28T06:05:25.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.436+0000 7f11e9200640 1 -- start start 2024-05-28T06:05:25.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.436+0000 7f11e9200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e415b760 0x7f11e40af530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:25.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.436+0000 7f11e9200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f11e40b0200 0x7f11e40b0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:25.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.436+0000 7f11e9200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11e415bb40 con 0x7f11e415f240 2024-05-28T06:05:25.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.436+0000 7f11e9200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f11e40afdf0 con 0x7f11e40b0200 2024-05-28T06:05:25.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.436+0000 7f11e9200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f11e40afb10 con 0x7f11e415b760 2024-05-28T06:05:25.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.436+0000 7f11e3400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e415b760 0x7f11e40af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:25.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.436+0000 7f11e2a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f11e40b0200 0x7f11e40b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:25.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.436+0000 7f11e3400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e415b760 0x7f11e40af530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:38088/0 (socket says 172.21.15.153:38088) 2024-05-28T06:05:25.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.436+0000 7f11e3400640 1 -- 172.21.15.153:0/951827046 learned_addr learned my addr 172.21.15.153:0/951827046 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-28T06:05:25.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.436+0000 7f11e3e00640 1 --1- 172.21.15.153:0/951827046 >> v1:172.21.15.153:6789/0 conn(0x7f11e415f240 0x7f11e40b4ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:48430/0 (socket says 172.21.15.153:48430) 2024-05-28T06:05:25.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.440+0000 7f11e3400640 1 -- 172.21.15.153:0/951827046 >> v2:172.21.15.153:3300/0 conn(0x7f11e40b0200 msgr2=0x7f11e40b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:25.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.440+0000 7f11e3400640 1 --2- 172.21.15.153:0/951827046 >> v2:172.21.15.153:3300/0 conn(0x7f11e40b0200 0x7f11e40b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.440+0000 7f11e2000640 1 -- 172.21.15.153:0/951827046 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2834448538 0 0) 0x7f11e415bb40 con 0x7f11e415f240 2024-05-28T06:05:25.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.440+0000 7f11e3400640 1 -- 172.21.15.153:0/951827046 >> v1:172.21.15.153:6789/0 conn(0x7f11e415f240 legacy=0x7f11e40b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:25.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.440+0000 7f11e3400640 1 -- 172.21.15.153:0/951827046 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e40b43f0 con 0x7f11e415b760 2024-05-28T06:05:25.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.440+0000 7f11e3400640 1 --2- 172.21.15.153:0/951827046 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e415b760 0x7f11e40af530 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f11d4009870 tx=0x7f11d401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5fbb03645f04fa6 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:25.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.440+0000 7f11e2000640 1 -- 172.21.15.153:0/951827046 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d40aa600 con 0x7f11e415b760 2024-05-28T06:05:25.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.440+0000 7f11e2000640 1 -- 172.21.15.153:0/951827046 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11d40af070 con 0x7f11e415b760 2024-05-28T06:05:25.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.440+0000 7f11e2000640 1 -- 172.21.15.153:0/951827046 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d40aa9c0 con 0x7f11e415b760 2024-05-28T06:05:25.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e9200640 1 -- 172.21.15.153:0/951827046 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e415b760 msgr2=0x7f11e40af530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:25.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e9200640 1 --2- 172.21.15.153:0/951827046 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e415b760 0x7f11e40af530 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f11d4009870 tx=0x7f11d401c4a0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e9200640 1 -- 172.21.15.153:0/951827046 shutdown_connections 2024-05-28T06:05:25.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e9200640 1 --2- 172.21.15.153:0/951827046 >> v2:172.21.15.153:3300/0 conn(0x7f11e40b0200 0x7f11e40b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e9200640 1 --2- 172.21.15.153:0/951827046 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e415b760 0x7f11e40af530 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e9200640 1 -- 172.21.15.153:0/951827046 >> 172.21.15.153:0/951827046 conn(0x7f11e40b67e0 msgr2=0x7f11e40b6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:25.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e9200640 1 -- 172.21.15.153:0/951827046 shutdown_connections 2024-05-28T06:05:25.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e9200640 1 -- 172.21.15.153:0/951827046 wait complete. 2024-05-28T06:05:25.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e9200640 1 Processor -- start 2024-05-28T06:05:25.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e9200640 1 -- start start 2024-05-28T06:05:25.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e9200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11e40b0200 0x7f11e4145460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:25.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e9200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11e415b760 0x7f11e406bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:25.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e9200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e415f240 0x7f11e406c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:25.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e9200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f11e40b05e0 con 0x7f11e40b0200 2024-05-28T06:05:25.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e9200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f11e40b59f0 con 0x7f11e415b760 2024-05-28T06:05:25.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e9200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f11e40b0760 con 0x7f11e415f240 2024-05-28T06:05:25.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e2a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11e415b760 0x7f11e406bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:25.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e3e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e415f240 0x7f11e406c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:25.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e2a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11e415b760 0x7f11e406bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55220/0 (socket says 172.21.15.153:55220) 2024-05-28T06:05:25.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e2a00640 1 -- 172.21.15.153:0/2648158254 learned_addr learned my addr 172.21.15.153:0/2648158254 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-28T06:05:25.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e3400640 1 --2- 172.21.15.153:0/2648158254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11e40b0200 0x7f11e4145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:25.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e2a00640 1 -- 172.21.15.153:0/2648158254 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e415f240 msgr2=0x7f11e406c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:25.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e2a00640 1 --2- 172.21.15.153:0/2648158254 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e415f240 0x7f11e406c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e2a00640 1 -- 172.21.15.153:0/2648158254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11e40b0200 msgr2=0x7f11e4145460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:25.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e2a00640 1 --2- 172.21.15.153:0/2648158254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11e40b0200 0x7f11e4145460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e2a00640 1 -- 172.21.15.153:0/2648158254 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e4165440 con 0x7f11e415b760 2024-05-28T06:05:25.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e3e00640 1 --2- 172.21.15.153:0/2648158254 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e415f240 0x7f11e406c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:05:25.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.444+0000 7f11e3400640 1 --2- 172.21.15.153:0/2648158254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11e40b0200 0x7f11e4145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:05:25.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.448+0000 7f11e2a00640 1 --2- 172.21.15.153:0/2648158254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11e415b760 0x7f11e406bf30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f11d000d800 tx=0x7f11d000dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:25.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.448+0000 7f11db400640 1 -- 172.21.15.153:0/2648158254 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d000b6c0 con 0x7f11e415b760 2024-05-28T06:05:25.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.448+0000 7f11db400640 1 -- 172.21.15.153:0/2648158254 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11d0019070 con 0x7f11e415b760 2024-05-28T06:05:25.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.448+0000 7f11e9200640 1 -- 172.21.15.153:0/2648158254 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11e4165720 con 0x7f11e415b760 2024-05-28T06:05:25.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.448+0000 7f11db400640 1 -- 172.21.15.153:0/2648158254 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d000ba60 con 0x7f11e415b760 2024-05-28T06:05:25.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.448+0000 7f11e9200640 1 -- 172.21.15.153:0/2648158254 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11e4164780 con 0x7f11e415b760 2024-05-28T06:05:25.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.448+0000 7f11db400640 1 -- 172.21.15.153:0/2648158254 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f11d000bc00 con 0x7f11e415b760 2024-05-28T06:05:25.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.448+0000 7f11db400640 1 -- 172.21.15.153:0/2648158254 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f11d001e880 con 0x7f11e415b760 2024-05-28T06:05:25.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.448+0000 7f11e9200640 1 -- 172.21.15.153:0/2648158254 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11e4075620 con 0x7f11e415b760 2024-05-28T06:05:25.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.448+0000 7f11db400640 1 -- 172.21.15.153:0/2648158254 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f11d001ea80 con 0x7f11e415b760 2024-05-28T06:05:25.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.516+0000 7f11e9200640 1 -- 172.21.15.153:0/2648158254 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3a4d62cc-ba0b-401e-8638-24c43b946c0c", "id": 2} v 0) -- 0x7f11e41658f0 con 0x7f11e415b760 2024-05-28T06:05:25.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.520+0000 7f11db400640 1 -- 172.21.15.153:0/2648158254 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3a4d62cc-ba0b-401e-8638-24c43b946c0c", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f11d001e460 con 0x7f11e415b760 2024-05-28T06:05:25.527 INFO:teuthology.orchestra.run.smithi153.stdout:2 2024-05-28T06:05:25.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.524+0000 7f11e9200640 1 -- 172.21.15.153:0/2648158254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11e415b760 msgr2=0x7f11e406bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:25.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.524+0000 7f11e9200640 1 --2- 172.21.15.153:0/2648158254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11e415b760 0x7f11e406bf30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f11d000d800 tx=0x7f11d000dcc0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.524+0000 7f11e9200640 1 -- 172.21.15.153:0/2648158254 shutdown_connections 2024-05-28T06:05:25.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.524+0000 7f11e9200640 1 --2- 172.21.15.153:0/2648158254 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e415f240 0x7f11e406c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.524+0000 7f11e9200640 1 --2- 172.21.15.153:0/2648158254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11e415b760 0x7f11e406bf30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.524+0000 7f11e9200640 1 --2- 172.21.15.153:0/2648158254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11e40b0200 0x7f11e4145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.524+0000 7f11e9200640 1 -- 172.21.15.153:0/2648158254 >> 172.21.15.153:0/2648158254 conn(0x7f11e40b67e0 msgr2=0x7f11e40b6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:25.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.524+0000 7f11e9200640 1 -- 172.21.15.153:0/2648158254 shutdown_connections 2024-05-28T06:05:25.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.524+0000 7f11e9200640 1 -- 172.21.15.153:0/2648158254 wait complete. 2024-05-28T06:05:25.547 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 15794de8-a4d1-47fd-bc23-155938919715 3 2024-05-28T06:05:25.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.676+0000 7fc90e800640 1 Processor -- start 2024-05-28T06:05:25.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.676+0000 7fc90e800640 1 -- start start 2024-05-28T06:05:25.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.680+0000 7fc90e800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc908162900 0x7fc90806d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:25.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.680+0000 7fc90e800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc90809bb60 con 0x7fc90815ea30 2024-05-28T06:05:25.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.680+0000 7fc90e800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9080d0c80 con 0x7fc908162490 2024-05-28T06:05:25.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.680+0000 7fc90e800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc9080d0f60 con 0x7fc908162900 2024-05-28T06:05:25.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.680+0000 7fc907e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc908162900 0x7fc90806d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:25.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.680+0000 7fc906a00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc908162490 0x7fc90806caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:48446/0 (socket says 172.21.15.153:48446) 2024-05-28T06:05:25.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.680+0000 7fc906a00640 1 -- 172.21.15.153:0/2145652844 learned_addr learned my addr 172.21.15.153:0/2145652844 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-05-28T06:05:25.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.680+0000 7fc907e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc908162900 0x7fc90806d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55226/0 (socket says 172.21.15.153:55226) 2024-05-28T06:05:25.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.680+0000 7fc907e00640 1 -- 172.21.15.153:0/2145652844 >> v1:172.21.15.153:6789/0 conn(0x7fc908162490 legacy=0x7fc90806caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:25.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.680+0000 7fc907e00640 1 -- 172.21.15.153:0/2145652844 >> v1:172.21.15.122:6789/0 conn(0x7fc90815ea30 legacy=0x7fc90809b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:25.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.680+0000 7fc906000640 1 -- 172.21.15.153:0/2145652844 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2676993706 0 0) 0x7fc9080d0c80 con 0x7fc908162490 2024-05-28T06:05:25.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.680+0000 7fc907e00640 1 -- 172.21.15.153:0/2145652844 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9080d1240 con 0x7fc908162900 2024-05-28T06:05:25.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.684+0000 7fc907e00640 1 --2- 172.21.15.153:0/2145652844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc908162900 0x7fc90806d1b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc900009d90 tx=0x7fc90001c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2465d2f3a0623d85 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:25.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.684+0000 7fc906000640 1 -- 172.21.15.153:0/2145652844 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9000b2070 con 0x7fc908162900 2024-05-28T06:05:25.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.684+0000 7fc906000640 1 -- 172.21.15.153:0/2145652844 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9000a5970 con 0x7fc908162900 2024-05-28T06:05:25.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.684+0000 7fc906000640 1 -- 172.21.15.153:0/2145652844 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9000a5d40 con 0x7fc908162900 2024-05-28T06:05:25.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.684+0000 7fc90e800640 1 -- 172.21.15.153:0/2145652844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc908162900 msgr2=0x7fc90806d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:25.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.684+0000 7fc90e800640 1 --2- 172.21.15.153:0/2145652844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc908162900 0x7fc90806d1b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc900009d90 tx=0x7fc90001c8b0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.684+0000 7fc90e800640 1 -- 172.21.15.153:0/2145652844 shutdown_connections 2024-05-28T06:05:25.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.684+0000 7fc90e800640 1 --2- 172.21.15.153:0/2145652844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc908162900 0x7fc90806d1b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.684+0000 7fc90e800640 1 -- 172.21.15.153:0/2145652844 >> 172.21.15.153:0/2145652844 conn(0x7fc9080b4100 msgr2=0x7fc9080b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:25.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.684+0000 7fc90e800640 1 -- 172.21.15.153:0/2145652844 shutdown_connections 2024-05-28T06:05:25.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.684+0000 7fc90e800640 1 -- 172.21.15.153:0/2145652844 wait complete. 2024-05-28T06:05:25.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc90e800640 1 Processor -- start 2024-05-28T06:05:25.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc90e800640 1 -- start start 2024-05-28T06:05:25.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc90e800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc90815ea30 0x7fc90814dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:25.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc90e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc908162490 0x7fc90815bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:25.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc90e800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc908162900 0x7fc908161020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:25.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc90e800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc9080d09d0 con 0x7fc908162900 2024-05-28T06:05:25.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc90e800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc9080d0850 con 0x7fc908162490 2024-05-28T06:05:25.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc90e800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc90806db00 con 0x7fc90815ea30 2024-05-28T06:05:25.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc906a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc908162490 0x7fc90815bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:25.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc907400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc90815ea30 0x7fc90814dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:25.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc906a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc908162490 0x7fc90815bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55232/0 (socket says 172.21.15.153:55232) 2024-05-28T06:05:25.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc906a00640 1 -- 172.21.15.153:0/2314793278 learned_addr learned my addr 172.21.15.153:0/2314793278 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-28T06:05:25.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc907e00640 1 --2- 172.21.15.153:0/2314793278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc908162900 0x7fc908161020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:25.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc907400640 1 -- 172.21.15.153:0/2314793278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc908162490 msgr2=0x7fc90815bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:25.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc907400640 1 --2- 172.21.15.153:0/2314793278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc908162490 0x7fc90815bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc907400640 1 -- 172.21.15.153:0/2314793278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc908162900 msgr2=0x7fc908161020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:25.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc907400640 1 --2- 172.21.15.153:0/2314793278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc908162900 0x7fc908161020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc907400640 1 -- 172.21.15.153:0/2314793278 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc90815c730 con 0x7fc90815ea30 2024-05-28T06:05:25.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc907400640 1 --2- 172.21.15.153:0/2314793278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc90815ea30 0x7fc90814dac0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8000f70 tx=0x7fc8f800c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:25.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc8ff400640 1 -- 172.21.15.153:0/2314793278 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8017070 con 0x7fc90815ea30 2024-05-28T06:05:25.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc8ff400640 1 -- 172.21.15.153:0/2314793278 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f80052d0 con 0x7fc90815ea30 2024-05-28T06:05:25.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc8ff400640 1 -- 172.21.15.153:0/2314793278 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f80054c0 con 0x7fc90815ea30 2024-05-28T06:05:25.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc90e800640 1 -- 172.21.15.153:0/2314793278 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc90815ca10 con 0x7fc90815ea30 2024-05-28T06:05:25.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc90e800640 1 -- 172.21.15.153:0/2314793278 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc90815cfd0 con 0x7fc90815ea30 2024-05-28T06:05:25.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc8ff400640 1 -- 172.21.15.153:0/2314793278 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc8f801a070 con 0x7fc90815ea30 2024-05-28T06:05:25.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.688+0000 7fc8ff400640 1 -- 172.21.15.153:0/2314793278 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fc8f8011590 con 0x7fc90815ea30 2024-05-28T06:05:25.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.692+0000 7fc90e800640 1 -- 172.21.15.153:0/2314793278 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc90815d410 con 0x7fc90815ea30 2024-05-28T06:05:25.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.692+0000 7fc8ff400640 1 -- 172.21.15.153:0/2314793278 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc8f8021070 con 0x7fc90815ea30 2024-05-28T06:05:25.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.760+0000 7fc90e800640 1 -- 172.21.15.153:0/2314793278 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "15794de8-a4d1-47fd-bc23-155938919715", "id": 3} v 0) -- 0x7fc908068c40 con 0x7fc90815ea30 2024-05-28T06:05:25.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.764+0000 7fc8ff400640 1 -- 172.21.15.153:0/2314793278 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "15794de8-a4d1-47fd-bc23-155938919715", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fc8f8011b90 con 0x7fc90815ea30 2024-05-28T06:05:25.771 INFO:teuthology.orchestra.run.smithi153.stdout:3 2024-05-28T06:05:25.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.768+0000 7fc90e800640 1 -- 172.21.15.153:0/2314793278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc90815ea30 msgr2=0x7fc90814dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:25.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.768+0000 7fc90e800640 1 --2- 172.21.15.153:0/2314793278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc90815ea30 0x7fc90814dac0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8000f70 tx=0x7fc8f800c890 comp rx=0 tx=0).stop 2024-05-28T06:05:25.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.768+0000 7fc90e800640 1 -- 172.21.15.153:0/2314793278 shutdown_connections 2024-05-28T06:05:25.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.768+0000 7fc90e800640 1 --2- 172.21.15.153:0/2314793278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc908162900 0x7fc908161020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.768+0000 7fc90e800640 1 --2- 172.21.15.153:0/2314793278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc908162490 0x7fc90815bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.768+0000 7fc90e800640 1 --2- 172.21.15.153:0/2314793278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc90815ea30 0x7fc90814dac0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.768+0000 7fc90e800640 1 -- 172.21.15.153:0/2314793278 >> 172.21.15.153:0/2314793278 conn(0x7fc9080b4100 msgr2=0x7fc908071740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:25.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.768+0000 7fc90e800640 1 -- 172.21.15.153:0/2314793278 shutdown_connections 2024-05-28T06:05:25.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.768+0000 7fc90e800640 1 -- 172.21.15.153:0/2314793278 wait complete. 2024-05-28T06:05:25.791 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 2e017ba9-3ac6-4756-a3bd-0e0d76085bbc 4 2024-05-28T06:05:25.819 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:25.818+0000 7f9e6c4c1180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-28T06:05:25.881 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:25.878+0000 7f9e6c4c1180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-28T06:05:25.905 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-28T06:05:25.900+0000 7f7475eee180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-28T06:05:25.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.920+0000 7fe1ffe00640 1 Processor -- start 2024-05-28T06:05:25.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.920+0000 7fe1ffe00640 1 -- start start 2024-05-28T06:05:25.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.920+0000 7fe1ffe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe1f8160240 0x7fe1f80b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:25.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.920+0000 7fe1ffe00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe1f809b080 0x7fe1f809b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:25.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.920+0000 7fe1ffe00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1f80d0bf0 con 0x7fe1f809aca0 2024-05-28T06:05:25.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.920+0000 7fe1ffe00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fe1f80b5460 con 0x7fe1f809b080 2024-05-28T06:05:25.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.924+0000 7fe1ffe00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe1f80d0eb0 con 0x7fe1f8160240 2024-05-28T06:05:25.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.924+0000 7fe1fca00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe1f8160240 0x7fe1f80b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:25.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.924+0000 7fe1fd400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe1f809aca0 0x7fe1f815fb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:48456/0 (socket says 172.21.15.153:48456) 2024-05-28T06:05:25.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.924+0000 7fe1fd400640 1 -- 172.21.15.153:0/3918719283 learned_addr learned my addr 172.21.15.153:0/3918719283 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-05-28T06:05:25.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.924+0000 7fe1fde00640 1 --2- 172.21.15.153:0/3918719283 >> v2:172.21.15.122:3300/0 conn(0x7fe1f809b080 0x7fe1f809b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:25.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.924+0000 7fe1fca00640 1 -- 172.21.15.153:0/3918719283 >> v2:172.21.15.122:3300/0 conn(0x7fe1f809b080 msgr2=0x7fe1f809b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:25.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.924+0000 7fe1fca00640 1 --2- 172.21.15.153:0/3918719283 >> v2:172.21.15.122:3300/0 conn(0x7fe1f809b080 0x7fe1f809b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.924+0000 7fe1fca00640 1 -- 172.21.15.153:0/3918719283 >> v1:172.21.15.153:6789/0 conn(0x7fe1f809aca0 legacy=0x7fe1f815fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:25.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.924+0000 7fe1fca00640 1 -- 172.21.15.153:0/3918719283 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f80d1190 con 0x7fe1f8160240 2024-05-28T06:05:25.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.924+0000 7fe1f7e00640 1 -- 172.21.15.153:0/3918719283 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3717140604 0 0) 0x7fe1f80d0bf0 con 0x7fe1f809aca0 2024-05-28T06:05:25.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.924+0000 7fe1fca00640 1 --2- 172.21.15.153:0/3918719283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1f8160240 0x7fe1f80b35b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe1f80cecd0 tx=0x7fe1e401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e71a898b622d12c server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:25.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.924+0000 7fe1f7e00640 1 -- 172.21.15.153:0/3918719283 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e40b1070 con 0x7fe1f8160240 2024-05-28T06:05:25.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.924+0000 7fe1f7e00640 1 -- 172.21.15.153:0/3918719283 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e40ac5f0 con 0x7fe1f8160240 2024-05-28T06:05:25.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.924+0000 7fe1f7e00640 1 -- 172.21.15.153:0/3918719283 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e40ac9c0 con 0x7fe1f8160240 2024-05-28T06:05:25.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.928+0000 7fe1ffe00640 1 -- 172.21.15.153:0/3918719283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1f8160240 msgr2=0x7fe1f80b35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:25.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.928+0000 7fe1ffe00640 1 --2- 172.21.15.153:0/3918719283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1f8160240 0x7fe1f80b35b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe1f80cecd0 tx=0x7fe1e401c480 comp rx=0 tx=0).stop 2024-05-28T06:05:25.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.928+0000 7fe1ffe00640 1 -- 172.21.15.153:0/3918719283 shutdown_connections 2024-05-28T06:05:25.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.928+0000 7fe1ffe00640 1 --2- 172.21.15.153:0/3918719283 >> v2:172.21.15.122:3300/0 conn(0x7fe1f809b080 0x7fe1f809b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.928+0000 7fe1ffe00640 1 --2- 172.21.15.153:0/3918719283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1f8160240 0x7fe1f80b35b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.928+0000 7fe1ffe00640 1 -- 172.21.15.153:0/3918719283 >> 172.21.15.153:0/3918719283 conn(0x7fe1f80b4100 msgr2=0x7fe1f80b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:25.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.928+0000 7fe1ffe00640 1 -- 172.21.15.153:0/3918719283 shutdown_connections 2024-05-28T06:05:25.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.928+0000 7fe1ffe00640 1 -- 172.21.15.153:0/3918719283 wait complete. 2024-05-28T06:05:25.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.928+0000 7fe1ffe00640 1 Processor -- start 2024-05-28T06:05:25.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.928+0000 7fe1ffe00640 1 -- start start 2024-05-28T06:05:25.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.928+0000 7fe1ffe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1f809aca0 0x7fe1f80cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:25.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.928+0000 7fe1ffe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1f809b080 0x7fe1f8159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:25.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.928+0000 7fe1ffe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1f8160240 0x7fe1f8070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:25.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.928+0000 7fe1ffe00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f80b6490 con 0x7fe1f809b080 2024-05-28T06:05:25.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.928+0000 7fe1ffe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f80b6310 con 0x7fe1f809aca0 2024-05-28T06:05:25.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.928+0000 7fe1ffe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe1f80b6610 con 0x7fe1f8160240 2024-05-28T06:05:25.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.928+0000 7fe1fd400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1f809aca0 0x7fe1f80cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:25.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.928+0000 7fe1fde00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1f8160240 0x7fe1f8070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:25.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.928+0000 7fe1fd400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1f809aca0 0x7fe1f80cbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55244/0 (socket says 172.21.15.153:55244) 2024-05-28T06:05:25.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.928+0000 7fe1fd400640 1 -- 172.21.15.153:0/1958277351 learned_addr learned my addr 172.21.15.153:0/1958277351 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-28T06:05:25.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.928+0000 7fe1fca00640 1 --2- 172.21.15.153:0/1958277351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1f809b080 0x7fe1f8159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:25.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.932+0000 7fe1fd400640 1 -- 172.21.15.153:0/1958277351 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1f8160240 msgr2=0x7fe1f8070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:25.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.932+0000 7fe1fd400640 1 --2- 172.21.15.153:0/1958277351 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1f8160240 0x7fe1f8070600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.932+0000 7fe1fd400640 1 -- 172.21.15.153:0/1958277351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1f809b080 msgr2=0x7fe1f8159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:25.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.932+0000 7fe1fd400640 1 --2- 172.21.15.153:0/1958277351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1f809b080 0x7fe1f8159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:25.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.932+0000 7fe1fd400640 1 -- 172.21.15.153:0/1958277351 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f815b4a0 con 0x7fe1f809aca0 2024-05-28T06:05:25.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.932+0000 7fe1fca00640 1 --2- 172.21.15.153:0/1958277351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1f809b080 0x7fe1f8159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:05:25.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.932+0000 7fe1fd400640 1 --2- 172.21.15.153:0/1958277351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1f809aca0 0x7fe1f80cbd20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec0011f0 tx=0x7fe1ec00c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:25.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.932+0000 7fe1f5600640 1 -- 172.21.15.153:0/1958277351 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec018070 con 0x7fe1f809aca0 2024-05-28T06:05:25.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.932+0000 7fe1f5600640 1 -- 172.21.15.153:0/1958277351 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1ec0074e0 con 0x7fe1f809aca0 2024-05-28T06:05:25.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.932+0000 7fe1ffe00640 1 -- 172.21.15.153:0/1958277351 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1f815b780 con 0x7fe1f809aca0 2024-05-28T06:05:25.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.932+0000 7fe1f5600640 1 -- 172.21.15.153:0/1958277351 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec004a10 con 0x7fe1f809aca0 2024-05-28T06:05:25.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.932+0000 7fe1ffe00640 1 -- 172.21.15.153:0/1958277351 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1f815bd40 con 0x7fe1f809aca0 2024-05-28T06:05:25.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.932+0000 7fe1f5600640 1 -- 172.21.15.153:0/1958277351 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe1ec01b070 con 0x7fe1f809aca0 2024-05-28T06:05:25.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.932+0000 7fe1f5600640 1 -- 172.21.15.153:0/1958277351 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fe1ec004bb0 con 0x7fe1f809aca0 2024-05-28T06:05:25.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.932+0000 7fe1ffe00640 1 -- 172.21.15.153:0/1958277351 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1f8068c40 con 0x7fe1f809aca0 2024-05-28T06:05:25.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:25.936+0000 7fe1f5600640 1 -- 172.21.15.153:0/1958277351 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fe1ec01d440 con 0x7fe1f809aca0 2024-05-28T06:05:25.941 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:25.942+0000 7f9e6c4c1180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-28T06:05:25.972 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-28T06:05:25.968+0000 7f7475eee180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-28T06:05:26.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.000+0000 7fe1ffe00640 1 -- 172.21.15.153:0/1958277351 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2e017ba9-3ac6-4756-a3bd-0e0d76085bbc", "id": 4} v 0) -- 0x7fe1f815f3e0 con 0x7fe1f809aca0 2024-05-28T06:05:26.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.004+0000 7fe1f5600640 1 -- 172.21.15.153:0/1958277351 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2e017ba9-3ac6-4756-a3bd-0e0d76085bbc", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fe1ec01d620 con 0x7fe1f809aca0 2024-05-28T06:05:26.011 INFO:teuthology.orchestra.run.smithi153.stdout:4 2024-05-28T06:05:26.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.008+0000 7fe1ffe00640 1 -- 172.21.15.153:0/1958277351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1f809aca0 msgr2=0x7fe1f80cbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:26.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.008+0000 7fe1ffe00640 1 --2- 172.21.15.153:0/1958277351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1f809aca0 0x7fe1f80cbd20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec0011f0 tx=0x7fe1ec00c9b0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.008+0000 7fe1ffe00640 1 -- 172.21.15.153:0/1958277351 shutdown_connections 2024-05-28T06:05:26.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.008+0000 7fe1ffe00640 1 --2- 172.21.15.153:0/1958277351 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1f8160240 0x7fe1f8070600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.008+0000 7fe1ffe00640 1 --2- 172.21.15.153:0/1958277351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1f809b080 0x7fe1f8159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.008+0000 7fe1ffe00640 1 --2- 172.21.15.153:0/1958277351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1f809aca0 0x7fe1f80cbd20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.008+0000 7fe1ffe00640 1 -- 172.21.15.153:0/1958277351 >> 172.21.15.153:0/1958277351 conn(0x7fe1f80b4100 msgr2=0x7fe1f80b7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:26.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.008+0000 7fe1ffe00640 1 -- 172.21.15.153:0/1958277351 shutdown_connections 2024-05-28T06:05:26.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.008+0000 7fe1ffe00640 1 -- 172.21.15.153:0/1958277351 wait complete. 2024-05-28T06:05:26.030 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 81d3617b-2e70-4767-8193-cc5addbb6c7e 5 2024-05-28T06:05:26.031 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:26.030+0000 7f9e6c4c1180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-28T06:05:26.037 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-28T06:05:26.032+0000 7f7475eee180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-28T06:05:26.090 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:26.090+0000 7f9e6c4c1180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-28T06:05:26.130 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-28T06:05:26.124+0000 7f7475eee180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-28T06:05:26.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.160+0000 7faa3d200640 1 Processor -- start 2024-05-28T06:05:26.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.160+0000 7faa3d200640 1 -- start start 2024-05-28T06:05:26.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.160+0000 7faa3d200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7faa3809aca0 0x7faa380b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:26.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.160+0000 7faa3d200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faa3809b080 0x7faa3809b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:26.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.160+0000 7faa3d200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa380d0bf0 con 0x7faa3815fb30 2024-05-28T06:05:26.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.160+0000 7faa3d200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7faa380b5460 con 0x7faa3809aca0 2024-05-28T06:05:26.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.160+0000 7faa3d200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7faa380d0eb0 con 0x7faa3809b080 2024-05-28T06:05:26.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.164+0000 7faa35400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faa3809b080 0x7faa3809b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:26.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.164+0000 7faa35400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faa3809b080 0x7faa3809b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55258/0 (socket says 172.21.15.153:55258) 2024-05-28T06:05:26.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.164+0000 7faa35400640 1 -- 172.21.15.153:0/917511793 learned_addr learned my addr 172.21.15.153:0/917511793 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-28T06:05:26.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.164+0000 7faa35e00640 1 --2- 172.21.15.153:0/917511793 >> v2:172.21.15.122:3300/0 conn(0x7faa3809aca0 0x7faa380b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:26.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.164+0000 7faa35400640 1 -- 172.21.15.153:0/917511793 >> v2:172.21.15.122:3300/0 conn(0x7faa3809aca0 msgr2=0x7faa380b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:26.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.164+0000 7faa35400640 1 --2- 172.21.15.153:0/917511793 >> v2:172.21.15.122:3300/0 conn(0x7faa3809aca0 0x7faa380b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.164+0000 7faa35400640 1 -- 172.21.15.153:0/917511793 >> v1:172.21.15.122:6789/0 conn(0x7faa3815fb30 legacy=0x7faa3815ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:26.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.164+0000 7faa35400640 1 -- 172.21.15.153:0/917511793 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa380d1190 con 0x7faa3809b080 2024-05-28T06:05:26.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.164+0000 7faa35400640 1 --2- 172.21.15.153:0/917511793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa3809b080 0x7faa3809b780 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faa38073fa0 tx=0x7faa2401c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4657a3daae2f7b69 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:26.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.164+0000 7faa34a00640 1 -- 172.21.15.153:0/917511793 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa240ab430 con 0x7faa3809b080 2024-05-28T06:05:26.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.164+0000 7faa34a00640 1 -- 172.21.15.153:0/917511793 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa240b0070 con 0x7faa3809b080 2024-05-28T06:05:26.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.164+0000 7faa34a00640 1 -- 172.21.15.153:0/917511793 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa240ab7f0 con 0x7faa3809b080 2024-05-28T06:05:26.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.168+0000 7faa3d200640 1 -- 172.21.15.153:0/917511793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa3809b080 msgr2=0x7faa3809b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:26.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.168+0000 7faa3d200640 1 --2- 172.21.15.153:0/917511793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa3809b080 0x7faa3809b780 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faa38073fa0 tx=0x7faa2401c520 comp rx=0 tx=0).stop 2024-05-28T06:05:26.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.168+0000 7faa3d200640 1 -- 172.21.15.153:0/917511793 shutdown_connections 2024-05-28T06:05:26.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.168+0000 7faa3d200640 1 --2- 172.21.15.153:0/917511793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa3809b080 0x7faa3809b780 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.168+0000 7faa3d200640 1 --2- 172.21.15.153:0/917511793 >> v2:172.21.15.122:3300/0 conn(0x7faa3809aca0 0x7faa380b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.168+0000 7faa3d200640 1 -- 172.21.15.153:0/917511793 >> 172.21.15.153:0/917511793 conn(0x7faa380b4100 msgr2=0x7faa380b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:26.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.168+0000 7faa3d200640 1 -- 172.21.15.153:0/917511793 shutdown_connections 2024-05-28T06:05:26.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.168+0000 7faa3d200640 1 -- 172.21.15.153:0/917511793 wait complete. 2024-05-28T06:05:26.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.168+0000 7faa3d200640 1 Processor -- start 2024-05-28T06:05:26.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.168+0000 7faa3d200640 1 -- start start 2024-05-28T06:05:26.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.168+0000 7faa3d200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa3809aca0 0x7faa3809f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:26.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.168+0000 7faa3d200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa3809b080 0x7faa38153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:26.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.168+0000 7faa3d200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa3815fb30 0x7faa38153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:26.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.168+0000 7faa3d200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7faa380b64b0 con 0x7faa3809aca0 2024-05-28T06:05:26.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.168+0000 7faa3d200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faa380b6330 con 0x7faa3815fb30 2024-05-28T06:05:26.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.168+0000 7faa3d200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7faa380b6630 con 0x7faa3809b080 2024-05-28T06:05:26.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.168+0000 7faa36800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa3815fb30 0x7faa38153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:26.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.168+0000 7faa35400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa3809b080 0x7faa38153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:26.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.168+0000 7faa36800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa3815fb30 0x7faa38153d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55270/0 (socket says 172.21.15.153:55270) 2024-05-28T06:05:26.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.168+0000 7faa36800640 1 -- 172.21.15.153:0/883591631 learned_addr learned my addr 172.21.15.153:0/883591631 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-28T06:05:26.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.168+0000 7faa35e00640 1 --2- 172.21.15.153:0/883591631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa3809aca0 0x7faa3809f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:26.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.172+0000 7faa36800640 1 -- 172.21.15.153:0/883591631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa3809b080 msgr2=0x7faa38153840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:26.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.172+0000 7faa36800640 1 --2- 172.21.15.153:0/883591631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa3809b080 0x7faa38153840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.172+0000 7faa36800640 1 -- 172.21.15.153:0/883591631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa3809aca0 msgr2=0x7faa3809f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:26.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.172+0000 7faa36800640 1 --2- 172.21.15.153:0/883591631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa3809aca0 0x7faa3809f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.172+0000 7faa36800640 1 -- 172.21.15.153:0/883591631 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa380cc0c0 con 0x7faa3815fb30 2024-05-28T06:05:26.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.172+0000 7faa36800640 1 --2- 172.21.15.153:0/883591631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa3815fb30 0x7faa38153d80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faa3000c730 tx=0x7faa3000cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:26.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.172+0000 7faa2e000640 1 -- 172.21.15.153:0/883591631 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa30003b80 con 0x7faa3815fb30 2024-05-28T06:05:26.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.172+0000 7faa2e000640 1 -- 172.21.15.153:0/883591631 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa30003d20 con 0x7faa3815fb30 2024-05-28T06:05:26.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.172+0000 7faa2e000640 1 -- 172.21.15.153:0/883591631 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3000aa30 con 0x7faa3815fb30 2024-05-28T06:05:26.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.172+0000 7faa3d200640 1 -- 172.21.15.153:0/883591631 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa380cc3a0 con 0x7faa3815fb30 2024-05-28T06:05:26.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.172+0000 7faa3d200640 1 -- 172.21.15.153:0/883591631 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa380ca790 con 0x7faa3815fb30 2024-05-28T06:05:26.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.172+0000 7faa2e000640 1 -- 172.21.15.153:0/883591631 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faa3000abd0 con 0x7faa3815fb30 2024-05-28T06:05:26.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.172+0000 7faa2e000640 1 -- 172.21.15.153:0/883591631 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7faa30005650 con 0x7faa3815fb30 2024-05-28T06:05:26.179 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:26.178+0000 7f9e6c4c1180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-28T06:05:26.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.172+0000 7faa3d200640 1 -- 172.21.15.153:0/883591631 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa38068c40 con 0x7faa3815fb30 2024-05-28T06:05:26.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.172+0000 7faa2e000640 1 -- 172.21.15.153:0/883591631 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7faa300050d0 con 0x7faa3815fb30 2024-05-28T06:05:26.195 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-28T06:05:26.188+0000 7f7475eee180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-28T06:05:26.241 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:26.242+0000 7f9e6c4c1180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-28T06:05:26.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.240+0000 7faa3d200640 1 -- 172.21.15.153:0/883591631 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "81d3617b-2e70-4767-8193-cc5addbb6c7e", "id": 5} v 0) -- 0x7faa380c63c0 con 0x7faa3815fb30 2024-05-28T06:05:26.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.244+0000 7faa2e000640 1 -- 172.21.15.153:0/883591631 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "81d3617b-2e70-4767-8193-cc5addbb6c7e", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7faa300052b0 con 0x7faa3815fb30 2024-05-28T06:05:26.250 INFO:teuthology.orchestra.run.smithi153.stdout:5 2024-05-28T06:05:26.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.248+0000 7faa3d200640 1 -- 172.21.15.153:0/883591631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa3815fb30 msgr2=0x7faa38153d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:26.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.248+0000 7faa3d200640 1 --2- 172.21.15.153:0/883591631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa3815fb30 0x7faa38153d80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faa3000c730 tx=0x7faa3000cbf0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.248+0000 7faa3d200640 1 -- 172.21.15.153:0/883591631 shutdown_connections 2024-05-28T06:05:26.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.248+0000 7faa3d200640 1 --2- 172.21.15.153:0/883591631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa3815fb30 0x7faa38153d80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.248+0000 7faa3d200640 1 --2- 172.21.15.153:0/883591631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa3809b080 0x7faa38153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.248+0000 7faa3d200640 1 --2- 172.21.15.153:0/883591631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa3809aca0 0x7faa3809f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.248+0000 7faa3d200640 1 -- 172.21.15.153:0/883591631 >> 172.21.15.153:0/883591631 conn(0x7faa380b4100 msgr2=0x7faa380d1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:26.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.248+0000 7faa3d200640 1 -- 172.21.15.153:0/883591631 shutdown_connections 2024-05-28T06:05:26.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.248+0000 7faa3d200640 1 -- 172.21.15.153:0/883591631 wait complete. 2024-05-28T06:05:26.271 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new e00767ba-51bb-44c5-bacd-e523c388a32c 6 2024-05-28T06:05:26.290 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-28T06:05:26.284+0000 7f7475eee180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-28T06:05:26.356 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-28T06:05:26.352+0000 7f7475eee180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-28T06:05:26.407 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:26.406+0000 7f9e6c4c1180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-28T06:05:26.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.420+0000 7f4315800640 1 Processor -- start 2024-05-28T06:05:26.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.420+0000 7f4315800640 1 -- start start 2024-05-28T06:05:26.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.420+0000 7f4315800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f43100b4670 0x7f43100b0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:26.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.420+0000 7f4315800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43100b4b00 con 0x7f431015e860 2024-05-28T06:05:26.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.420+0000 7f4315800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43100b5c90 con 0x7f43100b0c60 2024-05-28T06:05:26.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.420+0000 7f4315800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f43100b5a40 con 0x7f43100b4670 2024-05-28T06:05:26.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.420+0000 7f4307e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f43100b4670 0x7f43100b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:26.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.420+0000 7f430f400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f43100b0c60 0x7f431015f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:48468/0 (socket says 172.21.15.153:48468) 2024-05-28T06:05:26.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.420+0000 7f430f400640 1 -- 172.21.15.153:0/1356642379 learned_addr learned my addr 172.21.15.153:0/1356642379 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-05-28T06:05:26.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.420+0000 7f4307e00640 1 -- 172.21.15.153:0/1356642379 >> v1:172.21.15.153:6789/0 conn(0x7f43100b0c60 legacy=0x7f431015f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:26.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.420+0000 7f4307e00640 1 -- 172.21.15.153:0/1356642379 >> v1:172.21.15.122:6789/0 conn(0x7f431015e860 legacy=0x7f4310071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:26.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.420+0000 7f4307e00640 1 -- 172.21.15.153:0/1356642379 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43100b5f70 con 0x7f43100b4670 2024-05-28T06:05:26.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.420+0000 7f430e000640 1 -- 172.21.15.153:0/1356642379 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2073117129 0 0) 0x7f43100b5c90 con 0x7f43100b0c60 2024-05-28T06:05:26.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.424+0000 7f4307e00640 1 --2- 172.21.15.153:0/1356642379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43100b4670 0x7f43100b0720 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f42f80097c0 tx=0x7f42f801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc352e191dfa34b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:26.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.424+0000 7f430e000640 1 -- 172.21.15.153:0/1356642379 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f80b0070 con 0x7f43100b4670 2024-05-28T06:05:26.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.424+0000 7f430e000640 1 -- 172.21.15.153:0/1356642379 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f80ab600 con 0x7f43100b4670 2024-05-28T06:05:26.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.424+0000 7f430e000640 1 -- 172.21.15.153:0/1356642379 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f80ab9d0 con 0x7f43100b4670 2024-05-28T06:05:26.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.424+0000 7f4315800640 1 -- 172.21.15.153:0/1356642379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43100b4670 msgr2=0x7f43100b0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:26.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.424+0000 7f4315800640 1 --2- 172.21.15.153:0/1356642379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43100b4670 0x7f43100b0720 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f42f80097c0 tx=0x7f42f801c4a0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.424+0000 7f4315800640 1 -- 172.21.15.153:0/1356642379 shutdown_connections 2024-05-28T06:05:26.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.424+0000 7f4315800640 1 --2- 172.21.15.153:0/1356642379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43100b4670 0x7f43100b0720 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.424+0000 7f4315800640 1 -- 172.21.15.153:0/1356642379 >> 172.21.15.153:0/1356642379 conn(0x7f431006f100 msgr2=0x7f431006f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:26.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.424+0000 7f4315800640 1 -- 172.21.15.153:0/1356642379 shutdown_connections 2024-05-28T06:05:26.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.424+0000 7f4315800640 1 -- 172.21.15.153:0/1356642379 wait complete. 2024-05-28T06:05:26.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f4315800640 1 Processor -- start 2024-05-28T06:05:26.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f4315800640 1 -- start start 2024-05-28T06:05:26.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f4315800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43100b0c60 0x7f43100cba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:26.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f4315800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43100b4670 0x7f43101555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:26.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f4315800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f431015e860 0x7f431014f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:26.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f4315800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4310071730 con 0x7f43100b0c60 2024-05-28T06:05:26.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f4315800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f431015ec40 con 0x7f43100b4670 2024-05-28T06:05:26.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f4315800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f43100718b0 con 0x7f431015e860 2024-05-28T06:05:26.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f4307e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43100b4670 0x7f43101555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:26.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f4307e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43100b4670 0x7f43101555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55288/0 (socket says 172.21.15.153:55288) 2024-05-28T06:05:26.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f4307e00640 1 -- 172.21.15.153:0/2337387091 learned_addr learned my addr 172.21.15.153:0/2337387091 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-28T06:05:26.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f430f400640 1 --2- 172.21.15.153:0/2337387091 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f431015e860 0x7f431014f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:26.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f430ea00640 1 --2- 172.21.15.153:0/2337387091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43100b0c60 0x7f43100cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:26.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f4307e00640 1 -- 172.21.15.153:0/2337387091 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f431015e860 msgr2=0x7f431014f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:26.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f4307e00640 1 --2- 172.21.15.153:0/2337387091 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f431015e860 0x7f431014f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f4307e00640 1 -- 172.21.15.153:0/2337387091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43100b0c60 msgr2=0x7f43100cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:26.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f4307e00640 1 --2- 172.21.15.153:0/2337387091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43100b0c60 0x7f43100cba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f4307e00640 1 -- 172.21.15.153:0/2337387091 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43100cc0d0 con 0x7f43100b4670 2024-05-28T06:05:26.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f4307e00640 1 --2- 172.21.15.153:0/2337387091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43100b4670 0x7f43101555d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f42f80190b0 tx=0x7f42f801ace0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:26.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f4306a00640 1 -- 172.21.15.153:0/2337387091 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f80b0050 con 0x7f43100b4670 2024-05-28T06:05:26.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f4306a00640 1 -- 172.21.15.153:0/2337387091 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f80bc070 con 0x7f43100b4670 2024-05-28T06:05:26.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f4306a00640 1 -- 172.21.15.153:0/2337387091 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f80b5a70 con 0x7f43100b4670 2024-05-28T06:05:26.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f4315800640 1 -- 172.21.15.153:0/2337387091 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43100cc3b0 con 0x7f43100b4670 2024-05-28T06:05:26.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f4315800640 1 -- 172.21.15.153:0/2337387091 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43100cc970 con 0x7f43100b4670 2024-05-28T06:05:26.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.428+0000 7f4306a00640 1 -- 172.21.15.153:0/2337387091 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f42f80ab480 con 0x7f43100b4670 2024-05-28T06:05:26.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.432+0000 7f4306a00640 1 -- 172.21.15.153:0/2337387091 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f42f80b5c10 con 0x7f43100b4670 2024-05-28T06:05:26.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.432+0000 7f4315800640 1 -- 172.21.15.153:0/2337387091 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4310068c40 con 0x7f43100b4670 2024-05-28T06:05:26.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.432+0000 7f4306a00640 1 -- 172.21.15.153:0/2337387091 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f42f8016090 con 0x7f43100b4670 2024-05-28T06:05:26.479 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:26.478+0000 7f9e6c4c1180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-28T06:05:26.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.500+0000 7f4315800640 1 -- 172.21.15.153:0/2337387091 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e00767ba-51bb-44c5-bacd-e523c388a32c", "id": 6} v 0) -- 0x7f43100b0a40 con 0x7f43100b4670 2024-05-28T06:05:26.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.508+0000 7f4306a00640 1 -- 172.21.15.153:0/2337387091 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e00767ba-51bb-44c5-bacd-e523c388a32c", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f42f80b5e10 con 0x7f43100b4670 2024-05-28T06:05:26.512 INFO:teuthology.orchestra.run.smithi153.stdout:6 2024-05-28T06:05:26.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.508+0000 7f4315800640 1 -- 172.21.15.153:0/2337387091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43100b4670 msgr2=0x7f43101555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:26.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.508+0000 7f4315800640 1 --2- 172.21.15.153:0/2337387091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43100b4670 0x7f43101555d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f42f80190b0 tx=0x7f42f801ace0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.508+0000 7f4315800640 1 -- 172.21.15.153:0/2337387091 shutdown_connections 2024-05-28T06:05:26.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.508+0000 7f4315800640 1 --2- 172.21.15.153:0/2337387091 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f431015e860 0x7f431014f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.508+0000 7f4315800640 1 --2- 172.21.15.153:0/2337387091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43100b4670 0x7f43101555d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.508+0000 7f4315800640 1 --2- 172.21.15.153:0/2337387091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43100b0c60 0x7f43100cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.508+0000 7f4315800640 1 -- 172.21.15.153:0/2337387091 >> 172.21.15.153:0/2337387091 conn(0x7f431006f100 msgr2=0x7f431015c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:26.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.508+0000 7f4315800640 1 -- 172.21.15.153:0/2337387091 shutdown_connections 2024-05-28T06:05:26.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.508+0000 7f4315800640 1 -- 172.21.15.153:0/2337387091 wait complete. 2024-05-28T06:05:26.531 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-28T06:05:26.524+0000 7f7475eee180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-28T06:05:26.532 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new f47cf583-8054-4b5a-9e38-b3c3df13fbd4 7 2024-05-28T06:05:26.605 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-28T06:05:26.600+0000 7f7475eee180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-28T06:05:26.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.664+0000 7f62a6c00640 1 Processor -- start 2024-05-28T06:05:26.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.664+0000 7f62a6c00640 1 -- start start 2024-05-28T06:05:26.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.668+0000 7f62a6c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62a009aa40 0x7f62a00d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:26.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.668+0000 7f62a6c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f62a00d1f70 0x7f62a009ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:26.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.668+0000 7f62a6c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62a00d0ab0 con 0x7f62a00b2e20 2024-05-28T06:05:26.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.668+0000 7f62a6c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f62a006cbd0 con 0x7f62a00d1f70 2024-05-28T06:05:26.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.668+0000 7f62a6c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f62a009b360 con 0x7f62a009aa40 2024-05-28T06:05:26.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.668+0000 7f62a5800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62a009aa40 0x7f62a00d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:26.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.668+0000 7f62a4e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f62a00d1f70 0x7f62a009ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:26.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.668+0000 7f62a5800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62a009aa40 0x7f62a00d0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:38152/0 (socket says 172.21.15.153:38152) 2024-05-28T06:05:26.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.668+0000 7f62a4e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f62a00d1f70 0x7f62a009ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55290/0 (socket says 172.21.15.153:55290) 2024-05-28T06:05:26.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.668+0000 7f62a5800640 1 -- 172.21.15.153:0/2962024032 learned_addr learned my addr 172.21.15.153:0/2962024032 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-28T06:05:26.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.668+0000 7f62a5800640 1 -- 172.21.15.153:0/2962024032 >> v2:172.21.15.153:3300/0 conn(0x7f62a00d1f70 msgr2=0x7f62a009ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:26.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.668+0000 7f62a5800640 1 --2- 172.21.15.153:0/2962024032 >> v2:172.21.15.153:3300/0 conn(0x7f62a00d1f70 0x7f62a009ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.668+0000 7f62a5800640 1 -- 172.21.15.153:0/2962024032 >> v1:172.21.15.122:6789/0 conn(0x7f62a00b2e20 legacy=0x7f62a006d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:26.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.668+0000 7f62a5800640 1 -- 172.21.15.153:0/2962024032 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a00b4dd0 con 0x7f62a009aa40 2024-05-28T06:05:26.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.668+0000 7f62a5800640 1 --2- 172.21.15.153:0/2962024032 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62a009aa40 0x7f62a00d0570 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6294009870 tx=0x7f629401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=322d480facf779bf server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:26.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f629fe00640 1 -- 172.21.15.153:0/2962024032 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62940b1070 con 0x7f62a009aa40 2024-05-28T06:05:26.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f629fe00640 1 -- 172.21.15.153:0/2962024032 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62940ac620 con 0x7f62a009aa40 2024-05-28T06:05:26.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f629fe00640 1 -- 172.21.15.153:0/2962024032 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62940ac9f0 con 0x7f62a009aa40 2024-05-28T06:05:26.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f62a6c00640 1 -- 172.21.15.153:0/2962024032 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62a009aa40 msgr2=0x7f62a00d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:26.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f62a6c00640 1 --2- 172.21.15.153:0/2962024032 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62a009aa40 0x7f62a00d0570 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6294009870 tx=0x7f629401c4d0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f62a6c00640 1 -- 172.21.15.153:0/2962024032 shutdown_connections 2024-05-28T06:05:26.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f62a6c00640 1 --2- 172.21.15.153:0/2962024032 >> v2:172.21.15.153:3300/0 conn(0x7f62a00d1f70 0x7f62a009ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f62a6c00640 1 --2- 172.21.15.153:0/2962024032 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62a009aa40 0x7f62a00d0570 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f62a6c00640 1 -- 172.21.15.153:0/2962024032 >> 172.21.15.153:0/2962024032 conn(0x7f62a00b3f40 msgr2=0x7f62a00b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:26.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f62a6c00640 1 -- 172.21.15.153:0/2962024032 shutdown_connections 2024-05-28T06:05:26.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f62a6c00640 1 -- 172.21.15.153:0/2962024032 wait complete. 2024-05-28T06:05:26.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f62a6c00640 1 Processor -- start 2024-05-28T06:05:26.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f62a6c00640 1 -- start start 2024-05-28T06:05:26.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f62a6c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62a009aa40 0x7f62a01574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:26.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f62a6c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62a00b2e20 0x7f62a015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:26.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f62a6c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62a00d1f70 0x7f62a00af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:26.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f62a6c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f62a00b33b0 con 0x7f62a00d1f70 2024-05-28T06:05:26.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f62a6c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f62a00b3230 con 0x7f62a00b2e20 2024-05-28T06:05:26.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f62a6c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f62a0160000 con 0x7f62a009aa40 2024-05-28T06:05:26.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f62a5800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62a009aa40 0x7f62a01574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:26.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f62a4e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62a00b2e20 0x7f62a015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:26.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f62a5800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62a009aa40 0x7f62a01574e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:38162/0 (socket says 172.21.15.153:38162) 2024-05-28T06:05:26.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f62a5800640 1 -- 172.21.15.153:0/3253780210 learned_addr learned my addr 172.21.15.153:0/3253780210 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-05-28T06:05:26.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.672+0000 7f62a6200640 1 --2- 172.21.15.153:0/3253780210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62a00d1f70 0x7f62a00af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:26.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.676+0000 7f62a4e00640 1 -- 172.21.15.153:0/3253780210 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62a009aa40 msgr2=0x7f62a01574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:26.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.676+0000 7f62a4e00640 1 --2- 172.21.15.153:0/3253780210 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62a009aa40 0x7f62a01574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.676+0000 7f62a4e00640 1 -- 172.21.15.153:0/3253780210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62a00d1f70 msgr2=0x7f62a00af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:26.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.676+0000 7f62a4e00640 1 --2- 172.21.15.153:0/3253780210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62a00d1f70 0x7f62a00af930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.676+0000 7f62a4e00640 1 -- 172.21.15.153:0/3253780210 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a00b5070 con 0x7f62a00b2e20 2024-05-28T06:05:26.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.676+0000 7f62a4e00640 1 --2- 172.21.15.153:0/3253780210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62a00b2e20 0x7f62a015c9c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f628c00e8a0 tx=0x7f628c00ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:26.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.676+0000 7f629d600640 1 -- 172.21.15.153:0/3253780210 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628c017070 con 0x7f62a00b2e20 2024-05-28T06:05:26.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.676+0000 7f629d600640 1 -- 172.21.15.153:0/3253780210 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f628c00c940 con 0x7f62a00b2e20 2024-05-28T06:05:26.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.676+0000 7f629d600640 1 -- 172.21.15.153:0/3253780210 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628c009e60 con 0x7f62a00b2e20 2024-05-28T06:05:26.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.676+0000 7f62a6c00640 1 -- 172.21.15.153:0/3253780210 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62a00b5330 con 0x7f62a00b2e20 2024-05-28T06:05:26.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.676+0000 7f62a6c00640 1 -- 172.21.15.153:0/3253780210 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62a00b58f0 con 0x7f62a00b2e20 2024-05-28T06:05:26.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.676+0000 7f629d600640 1 -- 172.21.15.153:0/3253780210 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f628c01a070 con 0x7f62a00b2e20 2024-05-28T06:05:26.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.676+0000 7f629d600640 1 -- 172.21.15.153:0/3253780210 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f628c0059a0 con 0x7f62a00b2e20 2024-05-28T06:05:26.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.676+0000 7f62a6c00640 1 -- 172.21.15.153:0/3253780210 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62a0075620 con 0x7f62a00b2e20 2024-05-28T06:05:26.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.680+0000 7f629d600640 1 -- 172.21.15.153:0/3253780210 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f628c00cd70 con 0x7f62a00b2e20 2024-05-28T06:05:26.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.748+0000 7f62a6c00640 1 -- 172.21.15.153:0/3253780210 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f47cf583-8054-4b5a-9e38-b3c3df13fbd4", "id": 7} v 0) -- 0x7f62a00b83d0 con 0x7f62a00b2e20 2024-05-28T06:05:26.756 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.752+0000 7f629d600640 1 -- 172.21.15.153:0/3253780210 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f47cf583-8054-4b5a-9e38-b3c3df13fbd4", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f628c0265b0 con 0x7f62a00b2e20 2024-05-28T06:05:26.756 INFO:teuthology.orchestra.run.smithi153.stdout:7 2024-05-28T06:05:26.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.752+0000 7f62a6c00640 1 -- 172.21.15.153:0/3253780210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62a00b2e20 msgr2=0x7f62a015c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:26.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.752+0000 7f62a6c00640 1 --2- 172.21.15.153:0/3253780210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62a00b2e20 0x7f62a015c9c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f628c00e8a0 tx=0x7f628c00ed60 comp rx=0 tx=0).stop 2024-05-28T06:05:26.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.752+0000 7f62a6c00640 1 -- 172.21.15.153:0/3253780210 shutdown_connections 2024-05-28T06:05:26.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.752+0000 7f62a6c00640 1 --2- 172.21.15.153:0/3253780210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62a00d1f70 0x7f62a00af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.752+0000 7f62a6c00640 1 --2- 172.21.15.153:0/3253780210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62a00b2e20 0x7f62a015c9c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.752+0000 7f62a6c00640 1 --2- 172.21.15.153:0/3253780210 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62a009aa40 0x7f62a01574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:26.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.752+0000 7f62a6c00640 1 -- 172.21.15.153:0/3253780210 >> 172.21.15.153:0/3253780210 conn(0x7f62a00b3f40 msgr2=0x7f62a0071740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:26.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.752+0000 7f62a6c00640 1 -- 172.21.15.153:0/3253780210 shutdown_connections 2024-05-28T06:05:26.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:05:26.752+0000 7f62a6c00640 1 -- 172.21.15.153:0/3253780210 wait complete. 2024-05-28T06:05:26.774 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-28T06:05:26.775 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-28T06:05:26.779 INFO:tasks.ceph.osd.0:Started 2024-05-28T06:05:26.779 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-28T06:05:26.779 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-28T06:05:26.793 INFO:tasks.ceph.osd.1:Started 2024-05-28T06:05:26.794 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-28T06:05:26.794 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-28T06:05:26.799 INFO:tasks.ceph.osd.2:Started 2024-05-28T06:05:26.799 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-28T06:05:26.799 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-28T06:05:26.808 INFO:tasks.ceph.osd.3:Started 2024-05-28T06:05:26.808 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-28T06:05:26.808 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-28T06:05:26.811 INFO:tasks.ceph.osd.4:Started 2024-05-28T06:05:26.811 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-28T06:05:26.811 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-28T06:05:26.816 INFO:tasks.ceph.osd.5:Started 2024-05-28T06:05:26.816 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-28T06:05:26.816 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-28T06:05:26.819 INFO:tasks.ceph.osd.6:Started 2024-05-28T06:05:26.819 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-28T06:05:26.819 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-28T06:05:26.822 INFO:tasks.ceph.osd.7:Started 2024-05-28T06:05:26.822 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:05:27.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.006+0000 7f4de3000640 1 Processor -- start 2024-05-28T06:05:27.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.006+0000 7f4de3000640 1 -- start start 2024-05-28T06:05:27.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.006+0000 7f4de3000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4ddc15ea50 0x7f4ddc15ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:27.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.006+0000 7f4de3000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4ddc06dab0 0x7f4ddc0d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:27.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.006+0000 7f4de3000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ddc162510 con 0x7f4ddc15f370 2024-05-28T06:05:27.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.006+0000 7f4de3000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f4ddc163120 con 0x7f4ddc15ea50 2024-05-28T06:05:27.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.006+0000 7f4de3000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4ddc1627f0 con 0x7f4ddc06dab0 2024-05-28T06:05:27.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.006+0000 7f4de1000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4ddc06dab0 0x7f4ddc0d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:27.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.006+0000 7f4de1000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4ddc06dab0 0x7f4ddc0d08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:59892/0 (socket says 172.21.15.122:59892) 2024-05-28T06:05:27.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.006+0000 7f4de1000640 1 -- 172.21.15.122:0/1334317481 learned_addr learned my addr 172.21.15.122:0/1334317481 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:27.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.006+0000 7f4ddb400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4ddc15f370 0x7f4ddc15f790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:43912/0 (socket says 172.21.15.122:43912) 2024-05-28T06:05:27.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.006+0000 7f4ddbe00640 1 --2- 172.21.15.122:0/1334317481 >> v2:172.21.15.153:3300/0 conn(0x7f4ddc15ea50 0x7f4ddc15ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:27.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.006+0000 7f4de1000640 1 -- 172.21.15.122:0/1334317481 >> v2:172.21.15.153:3300/0 conn(0x7f4ddc15ea50 msgr2=0x7f4ddc15ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:27.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.006+0000 7f4de1000640 1 --2- 172.21.15.122:0/1334317481 >> v2:172.21.15.153:3300/0 conn(0x7f4ddc15ea50 0x7f4ddc15ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:27.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.006+0000 7f4de1000640 1 -- 172.21.15.122:0/1334317481 >> v1:172.21.15.153:6789/0 conn(0x7f4ddc15f370 legacy=0x7f4ddc15f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:27.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.006+0000 7f4de1000640 1 -- 172.21.15.122:0/1334317481 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ddc162ad0 con 0x7f4ddc06dab0 2024-05-28T06:05:27.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.010+0000 7f4de1000640 1 --2- 172.21.15.122:0/1334317481 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4ddc06dab0 0x7f4ddc0d08e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4009e50 tx=0x7f4dd401ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a17dae69fea8cba server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:27.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.010+0000 7f4ddaa00640 1 -- 172.21.15.122:0/1334317481 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd40a57f0 con 0x7f4ddc06dab0 2024-05-28T06:05:27.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.010+0000 7f4ddaa00640 1 -- 172.21.15.122:0/1334317481 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dd40a5990 con 0x7f4ddc06dab0 2024-05-28T06:05:27.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.010+0000 7f4ddaa00640 1 -- 172.21.15.122:0/1334317481 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd40a5d60 con 0x7f4ddc06dab0 2024-05-28T06:05:27.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.010+0000 7f4de3000640 1 -- 172.21.15.122:0/1334317481 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4ddc06dab0 msgr2=0x7f4ddc0d08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:27.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.010+0000 7f4de3000640 1 --2- 172.21.15.122:0/1334317481 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4ddc06dab0 0x7f4ddc0d08e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4009e50 tx=0x7f4dd401ca00 comp rx=0 tx=0).stop 2024-05-28T06:05:27.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.010+0000 7f4de3000640 1 -- 172.21.15.122:0/1334317481 shutdown_connections 2024-05-28T06:05:27.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.010+0000 7f4de3000640 1 --2- 172.21.15.122:0/1334317481 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4ddc06dab0 0x7f4ddc0d08e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:27.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.010+0000 7f4de3000640 1 --2- 172.21.15.122:0/1334317481 >> v2:172.21.15.153:3300/0 conn(0x7f4ddc15ea50 0x7f4ddc15ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:27.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.010+0000 7f4de3000640 1 -- 172.21.15.122:0/1334317481 >> 172.21.15.122:0/1334317481 conn(0x7f4ddc0b4190 msgr2=0x7f4ddc0b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:27.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.010+0000 7f4de3000640 1 -- 172.21.15.122:0/1334317481 shutdown_connections 2024-05-28T06:05:27.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.010+0000 7f4de3000640 1 -- 172.21.15.122:0/1334317481 wait complete. 2024-05-28T06:05:27.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4de3000640 1 Processor -- start 2024-05-28T06:05:27.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4de3000640 1 -- start start 2024-05-28T06:05:27.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4de3000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ddc06dab0 0x7f4ddc0b7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:27.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4de3000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ddc15ea50 0x7f4ddc09f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:27.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4de3000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4ddc15f370 0x7f4ddc09f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:27.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4de3000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4ddc0d1a00 con 0x7f4ddc15ea50 2024-05-28T06:05:27.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4de3000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4ddc0d1880 con 0x7f4ddc06dab0 2024-05-28T06:05:27.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4de3000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4ddc0d1b80 con 0x7f4ddc15f370 2024-05-28T06:05:27.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4ddb400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ddc15ea50 0x7f4ddc09f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:27.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4ddb400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ddc15ea50 0x7f4ddc09f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44922/0 (socket says 172.21.15.122:44922) 2024-05-28T06:05:27.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4ddb400640 1 -- 172.21.15.122:0/3977639817 learned_addr learned my addr 172.21.15.122:0/3977639817 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:27.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4ddb400640 1 -- 172.21.15.122:0/3977639817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4ddc15f370 msgr2=0x7f4ddc09f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:27.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4ddb400640 1 --2- 172.21.15.122:0/3977639817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4ddc15f370 0x7f4ddc09f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:27.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4ddb400640 1 -- 172.21.15.122:0/3977639817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ddc06dab0 msgr2=0x7f4ddc0b7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:27.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4ddb400640 1 --2- 172.21.15.122:0/3977639817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ddc06dab0 0x7f4ddc0b7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:27.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4ddb400640 1 -- 172.21.15.122:0/3977639817 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ddc1f8590 con 0x7f4ddc15ea50 2024-05-28T06:05:27.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4ddb400640 1 --2- 172.21.15.122:0/3977639817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ddc15ea50 0x7f4ddc09f070 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4dc800c370 tx=0x7f4dc800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:27.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4dd3e00640 1 -- 172.21.15.122:0/3977639817 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc80074e0 con 0x7f4ddc15ea50 2024-05-28T06:05:27.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4dd3e00640 1 -- 172.21.15.122:0/3977639817 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dc8007680 con 0x7f4ddc15ea50 2024-05-28T06:05:27.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4dd3e00640 1 -- 172.21.15.122:0/3977639817 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8004a30 con 0x7f4ddc15ea50 2024-05-28T06:05:27.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4de3000640 1 -- 172.21.15.122:0/3977639817 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ddc1f8870 con 0x7f4ddc15ea50 2024-05-28T06:05:27.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4de3000640 1 -- 172.21.15.122:0/3977639817 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ddc0b8360 con 0x7f4ddc15ea50 2024-05-28T06:05:27.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4dd3e00640 1 -- 172.21.15.122:0/3977639817 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4dc801a020 con 0x7f4ddc15ea50 2024-05-28T06:05:27.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4dd3e00640 1 -- 172.21.15.122:0/3977639817 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f4dc8013ad0 con 0x7f4ddc15ea50 2024-05-28T06:05:27.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.014+0000 7f4de3000640 1 -- 172.21.15.122:0/3977639817 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ddc068c40 con 0x7f4ddc15ea50 2024-05-28T06:05:27.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.018+0000 7f4dd3e00640 1 -- 172.21.15.122:0/3977639817 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f4dc8021070 con 0x7f4ddc15ea50 2024-05-28T06:05:27.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.074+0000 7f4de3000640 1 -- 172.21.15.122:0/3977639817 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4ddc0b4ea0 con 0x7f4ddc15ea50 2024-05-28T06:05:27.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.074+0000 7f4dd3e00640 1 -- 172.21.15.122:0/3977639817 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f4dc8013400 con 0x7f4ddc15ea50 2024-05-28T06:05:27.076 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:05:27.076 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":10,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:05:26.755091+0000","last_up_change":"0.000000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:05:27.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.074+0000 7f4de3000640 1 -- 172.21.15.122:0/3977639817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ddc15ea50 msgr2=0x7f4ddc09f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:27.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.074+0000 7f4de3000640 1 --2- 172.21.15.122:0/3977639817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ddc15ea50 0x7f4ddc09f070 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4dc800c370 tx=0x7f4dc800c830 comp rx=0 tx=0).stop 2024-05-28T06:05:27.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.074+0000 7f4de3000640 1 -- 172.21.15.122:0/3977639817 shutdown_connections 2024-05-28T06:05:27.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.074+0000 7f4de3000640 1 --2- 172.21.15.122:0/3977639817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4ddc15f370 0x7f4ddc09f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:27.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.074+0000 7f4de3000640 1 --2- 172.21.15.122:0/3977639817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ddc15ea50 0x7f4ddc09f070 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:27.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.074+0000 7f4de3000640 1 --2- 172.21.15.122:0/3977639817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ddc06dab0 0x7f4ddc0b7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:27.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.074+0000 7f4de3000640 1 -- 172.21.15.122:0/3977639817 >> 172.21.15.122:0/3977639817 conn(0x7f4ddc0b4190 msgr2=0x7f4ddc161760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:27.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.074+0000 7f4de3000640 1 -- 172.21.15.122:0/3977639817 shutdown_connections 2024-05-28T06:05:27.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:27.074+0000 7f4de3000640 1 -- 172.21.15.122:0/3977639817 wait complete. 2024-05-28T06:05:27.095 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-28T06:05:27.095 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-28T06:05:27.128 INFO:tasks.ceph.mgr.y.smithi122.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-28T06:05:27.128 INFO:tasks.ceph.mgr.y.smithi122.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-28T06:05:27.128 INFO:tasks.ceph.mgr.y.smithi122.stderr: from numpy import show_config as show_numpy_config 2024-05-28T06:05:27.171 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:27.170+0000 7f9e6c4c1180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-28T06:05:27.289 INFO:tasks.ceph.mgr.x.smithi153.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-28T06:05:27.289 INFO:tasks.ceph.mgr.x.smithi153.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-28T06:05:27.289 INFO:tasks.ceph.mgr.x.smithi153.stderr: from numpy import show_config as show_numpy_config 2024-05-28T06:05:27.321 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:27.318+0000 7f9e6c4c1180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-28T06:05:27.336 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-28T06:05:27.332+0000 7f7475eee180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-28T06:05:27.475 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-05-28T06:05:27.474+0000 7ff86974a7c0 -1 Falling back to public interface 2024-05-28T06:05:27.481 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-05-28T06:05:27.476+0000 7fd55be8e7c0 -1 Falling back to public interface 2024-05-28T06:05:27.487 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-28T06:05:27.484+0000 7f7475eee180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-28T06:05:27.490 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-05-28T06:05:27.490+0000 7f0551fb67c0 -1 Falling back to public interface 2024-05-28T06:05:27.494 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-05-28T06:05:27.494+0000 7ff598aec7c0 -1 Falling back to public interface 2024-05-28T06:05:27.496 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-05-28T06:05:27.492+0000 7f48089207c0 -1 Falling back to public interface 2024-05-28T06:05:27.496 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-05-28T06:05:27.492+0000 7fe6fa2727c0 -1 Falling back to public interface 2024-05-28T06:05:27.498 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-05-28T06:05:27.498+0000 7fca211657c0 -1 Falling back to public interface 2024-05-28T06:05:27.501 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:27.498+0000 7f9e6c4c1180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-28T06:05:27.516 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-05-28T06:05:27.512+0000 7fbf82b827c0 -1 Falling back to public interface 2024-05-28T06:05:27.592 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:27.590+0000 7f9e6c4c1180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-28T06:05:27.672 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-28T06:05:27.664+0000 7f7475eee180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-28T06:05:27.742 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:27.742+0000 7f9e6c4c1180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-28T06:05:27.750 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-28T06:05:27.744+0000 7f7475eee180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-28T06:05:27.901 DEBUG:teuthology.orchestra.run.smithi122:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-28T06:05:27.902 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-28T06:05:27.896+0000 7f7475eee180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-28T06:05:28.027 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.026+0000 7f62cfa00640 1 Processor -- start 2024-05-28T06:05:28.027 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.026+0000 7f62cfa00640 1 -- start start 2024-05-28T06:05:28.028 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.026+0000 7f62cfa00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62c80d20d0 0x7f62c815cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:28.028 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.026+0000 7f62cfa00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62c80d0a80 con 0x7f62c80cf660 2024-05-28T06:05:28.028 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.026+0000 7f62cfa00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62c815d400 con 0x7f62c80cd800 2024-05-28T06:05:28.028 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.026+0000 7f62cfa00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f62c80cf1d0 con 0x7f62c80d20d0 2024-05-28T06:05:28.029 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.026+0000 7f62cd000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62c80d20d0 0x7f62c815cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:28.029 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.026+0000 7f62c7e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f62c80cd800 0x7f62c80d0370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:43928/0 (socket says 172.21.15.122:43928) 2024-05-28T06:05:28.029 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.026+0000 7f62c7e00640 1 -- 172.21.15.122:0/3299644924 learned_addr learned my addr 172.21.15.122:0/3299644924 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:28.030 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.026+0000 7f62c7400640 1 -- 172.21.15.122:0/3299644924 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1996125621 0 0) 0x7f62c815d400 con 0x7f62c80cd800 2024-05-28T06:05:28.030 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.030+0000 7f62c7400640 1 -- 172.21.15.122:0/3299644924 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62b0003530 con 0x7f62c80cd800 2024-05-28T06:05:28.030 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.030+0000 7f62c7400640 1 -- 172.21.15.122:0/3299644924 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2153962671 0 0) 0x7f62c80d0a80 con 0x7f62c80cf660 2024-05-28T06:05:28.030 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.030+0000 7f62c7400640 1 -- 172.21.15.122:0/3299644924 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62c815d400 con 0x7f62c80cf660 2024-05-28T06:05:28.030 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.030+0000 7f62cd000640 1 -- 172.21.15.122:0/3299644924 >> v1:172.21.15.153:6789/0 conn(0x7f62c80cd800 legacy=0x7f62c80d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:28.030 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.030+0000 7f62cd000640 1 -- 172.21.15.122:0/3299644924 >> v1:172.21.15.122:6789/0 conn(0x7f62c80cf660 legacy=0x7f62c80cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:28.030 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.030+0000 7f62cd000640 1 -- 172.21.15.122:0/3299644924 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c815d6e0 con 0x7f62c80d20d0 2024-05-28T06:05:28.032 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.030+0000 7f62cd000640 1 --2- 172.21.15.122:0/3299644924 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62c80d20d0 0x7f62c815cdf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0097f0 tx=0x7f62bc01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f55b4bd0243327ef server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:28.032 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.030+0000 7f62c7400640 1 -- 172.21.15.122:0/3299644924 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62bc0ab5f0 con 0x7f62c80d20d0 2024-05-28T06:05:28.033 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.030+0000 7f62c7400640 1 -- 172.21.15.122:0/3299644924 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62bc0b0070 con 0x7f62c80d20d0 2024-05-28T06:05:28.033 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.030+0000 7f62c7400640 1 -- 172.21.15.122:0/3299644924 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62bc0ab9b0 con 0x7f62c80d20d0 2024-05-28T06:05:28.033 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.030+0000 7f62cfa00640 1 -- 172.21.15.122:0/3299644924 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62c80d20d0 msgr2=0x7f62c815cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:28.034 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.030+0000 7f62cfa00640 1 --2- 172.21.15.122:0/3299644924 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62c80d20d0 0x7f62c815cdf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0097f0 tx=0x7f62bc01c4e0 comp rx=0 tx=0).stop 2024-05-28T06:05:28.034 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62cfa00640 1 -- 172.21.15.122:0/3299644924 shutdown_connections 2024-05-28T06:05:28.034 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62cfa00640 1 --2- 172.21.15.122:0/3299644924 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62c80d20d0 0x7f62c815cdf0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:28.034 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62cfa00640 1 -- 172.21.15.122:0/3299644924 >> 172.21.15.122:0/3299644924 conn(0x7f62c80b4390 msgr2=0x7f62c80b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:28.034 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62cfa00640 1 -- 172.21.15.122:0/3299644924 shutdown_connections 2024-05-28T06:05:28.034 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62cfa00640 1 -- 172.21.15.122:0/3299644924 wait complete. 2024-05-28T06:05:28.035 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62cfa00640 1 Processor -- start 2024-05-28T06:05:28.035 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62cfa00640 1 -- start start 2024-05-28T06:05:28.036 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62cfa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62c80cd800 0x7f62c8157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:28.036 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62cfa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62c80cf660 0x7f62c80cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:28.036 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62cfa00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62c80d20d0 0x7f62c8162df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:28.036 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62cfa00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f62c80d2e40 con 0x7f62c80cd800 2024-05-28T06:05:28.036 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62cfa00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f62c80d2cc0 con 0x7f62c80cf660 2024-05-28T06:05:28.036 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62cfa00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f62c80d2fc0 con 0x7f62c80d20d0 2024-05-28T06:05:28.037 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62cd000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62c80cd800 0x7f62c8157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:28.037 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62cd000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62c80cd800 0x7f62c8157600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44932/0 (socket says 172.21.15.122:44932) 2024-05-28T06:05:28.037 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62cd000640 1 -- 172.21.15.122:0/4092684301 learned_addr learned my addr 172.21.15.122:0/4092684301 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:28.037 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62c7e00640 1 --2- 172.21.15.122:0/4092684301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62c80cf660 0x7f62c80cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:28.037 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62cda00640 1 --2- 172.21.15.122:0/4092684301 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62c80d20d0 0x7f62c8162df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:28.038 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62cd000640 1 -- 172.21.15.122:0/4092684301 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62c80d20d0 msgr2=0x7f62c8162df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:28.038 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62cd000640 1 --2- 172.21.15.122:0/4092684301 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62c80d20d0 0x7f62c8162df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:28.038 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62cd000640 1 -- 172.21.15.122:0/4092684301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62c80cf660 msgr2=0x7f62c80cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:28.038 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62cd000640 1 --2- 172.21.15.122:0/4092684301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62c80cf660 0x7f62c80cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:28.038 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62cd000640 1 -- 172.21.15.122:0/4092684301 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c80ca6f0 con 0x7f62c80cd800 2024-05-28T06:05:28.038 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.034+0000 7f62cd000640 1 --2- 172.21.15.122:0/4092684301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62c80cd800 0x7f62c8157600 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0190f0 tx=0x7f62bc01ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:28.038 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.038+0000 7f62c4c00640 1 -- 172.21.15.122:0/4092684301 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62bc0bf410 con 0x7f62c80cd800 2024-05-28T06:05:28.039 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.038+0000 7f62c4c00640 1 -- 172.21.15.122:0/4092684301 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62bc0bf5d0 con 0x7f62c80cd800 2024-05-28T06:05:28.039 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.038+0000 7f62c4c00640 1 -- 172.21.15.122:0/4092684301 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62bc0bf9c0 con 0x7f62c80cd800 2024-05-28T06:05:28.039 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.038+0000 7f62cfa00640 1 -- 172.21.15.122:0/4092684301 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62c80ca9d0 con 0x7f62c80cd800 2024-05-28T06:05:28.039 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.038+0000 7f62cfa00640 1 -- 172.21.15.122:0/4092684301 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62c80caf90 con 0x7f62c80cd800 2024-05-28T06:05:28.039 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.038+0000 7f62c4c00640 1 -- 172.21.15.122:0/4092684301 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f62bc0bd020 con 0x7f62c80cd800 2024-05-28T06:05:28.039 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.038+0000 7f62c4c00640 1 -- 172.21.15.122:0/4092684301 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f62bc004020 con 0x7f62c80cd800 2024-05-28T06:05:28.039 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.038+0000 7f62cfa00640 1 -- 172.21.15.122:0/4092684301 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62c80717c0 con 0x7f62c80cd800 2024-05-28T06:05:28.040 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.038+0000 7f62c4c00640 1 -- 172.21.15.122:0/4092684301 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f62bc0160d0 con 0x7f62c80cd800 2024-05-28T06:05:28.097 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.098+0000 7f62cfa00640 1 -- 172.21.15.122:0/4092684301 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f62c804fdd0 con 0x7f62c80cd800 2024-05-28T06:05:28.098 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.098+0000 7f62c4c00640 1 -- 172.21.15.122:0/4092684301 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f62bc004220 con 0x7f62c80cd800 2024-05-28T06:05:28.098 INFO:teuthology.misc.health.smithi122.stdout: 2024-05-28T06:05:28.098 INFO:teuthology.misc.health.smithi122.stdout:{"epoch":10,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:05:26.755091+0000","last_up_change":"0.000000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:05:28.099 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.098+0000 7f62cfa00640 1 -- 172.21.15.122:0/4092684301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62c80cd800 msgr2=0x7f62c8157600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:28.099 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.098+0000 7f62cfa00640 1 --2- 172.21.15.122:0/4092684301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62c80cd800 0x7f62c8157600 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0190f0 tx=0x7f62bc01ad20 comp rx=0 tx=0).stop 2024-05-28T06:05:28.099 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.098+0000 7f62cfa00640 1 -- 172.21.15.122:0/4092684301 shutdown_connections 2024-05-28T06:05:28.100 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.098+0000 7f62cfa00640 1 --2- 172.21.15.122:0/4092684301 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62c80d20d0 0x7f62c8162df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:28.100 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.098+0000 7f62cfa00640 1 --2- 172.21.15.122:0/4092684301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62c80cf660 0x7f62c80cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:28.100 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.098+0000 7f62cfa00640 1 --2- 172.21.15.122:0/4092684301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62c80cd800 0x7f62c8157600 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:28.100 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.098+0000 7f62cfa00640 1 -- 172.21.15.122:0/4092684301 >> 172.21.15.122:0/4092684301 conn(0x7f62c80b4390 msgr2=0x7f62c815f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:28.100 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.098+0000 7f62cfa00640 1 -- 172.21.15.122:0/4092684301 shutdown_connections 2024-05-28T06:05:28.100 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:28.098+0000 7f62cfa00640 1 -- 172.21.15.122:0/4092684301 wait complete. 2024-05-28T06:05:28.116 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-28T06:05:28.449 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:28.446+0000 7f9e6c4c1180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-28T06:05:28.536 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:28.534+0000 7f9e6c4c1180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-28T06:05:28.588 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-28T06:05:28.584+0000 7f7475eee180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-28T06:05:28.676 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-28T06:05:28.672+0000 7f7475eee180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-28T06:05:28.741 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:28.738+0000 7f9e6c4c1180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-28T06:05:28.825 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:28.822+0000 7f9e6c4c1180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-28T06:05:28.884 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-28T06:05:28.880+0000 7f7475eee180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-28T06:05:28.968 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-28T06:05:28.964+0000 7f7475eee180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-28T06:05:29.157 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:29.154+0000 7f9e6c4c1180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-28T06:05:29.227 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:29.226+0000 7f9e6c4c1180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-28T06:05:29.315 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-28T06:05:29.312+0000 7f7475eee180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-28T06:05:29.387 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-05-28T06:05:29.380+0000 7f7475eee180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-28T06:05:30.247 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:30.246+0000 7f9e12600640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-28T06:05:30.250 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:05:30.250+0000 7f9e12600640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-28T06:05:31.409 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-05-28T06:05:31.404+0000 7f48089207c0 -1 osd.6 0 log_to_monitors true 2024-05-28T06:05:31.434 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-05-28T06:05:31.434+0000 7f0551fb67c0 -1 osd.1 0 log_to_monitors true 2024-05-28T06:05:31.457 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-05-28T06:05:31.454+0000 7ff86974a7c0 -1 osd.0 0 log_to_monitors true 2024-05-28T06:05:31.489 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-05-28T06:05:31.484+0000 7fd55be8e7c0 -1 osd.7 0 log_to_monitors true 2024-05-28T06:05:31.490 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-05-28T06:05:31.484+0000 7fbf82b827c0 -1 osd.4 0 log_to_monitors true 2024-05-28T06:05:31.542 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-05-28T06:05:31.536+0000 7fe6fa2727c0 -1 osd.5 0 log_to_monitors true 2024-05-28T06:05:31.564 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-05-28T06:05:31.562+0000 7ff598aec7c0 -1 osd.2 0 log_to_monitors true 2024-05-28T06:05:31.576 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-05-28T06:05:31.574+0000 7fca211657c0 -1 osd.3 0 log_to_monitors true 2024-05-28T06:05:34.924 DEBUG:teuthology.orchestra.run.smithi122:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-28T06:05:35.120 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.118+0000 7fac8dc00640 1 Processor -- start 2024-05-28T06:05:35.120 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.118+0000 7fac8dc00640 1 -- start start 2024-05-28T06:05:35.122 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac8dc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac880720f0 0x7fac8815b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:35.122 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac8dc00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fac880724d0 0x7fac8815a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:35.122 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac8dc00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac8815bf00 con 0x7fac8815a950 2024-05-28T06:05:35.123 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac8dc00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fac880b3720 con 0x7fac880724d0 2024-05-28T06:05:35.123 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac8dc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fac880b3ff0 con 0x7fac880720f0 2024-05-28T06:05:35.123 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac87400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fac8815a950 0x7fac8815e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:43066/0 (socket says 172.21.15.122:43066) 2024-05-28T06:05:35.123 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac87400640 1 -- 172.21.15.122:0/1760716270 learned_addr learned my addr 172.21.15.122:0/1760716270 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:35.124 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac86a00640 1 --2- 172.21.15.122:0/1760716270 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac880720f0 0x7fac8815b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:35.124 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac85600640 1 -- 172.21.15.122:0/1760716270 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1453123192 0 0) 0x7fac78001120 con 0x7fac8815a950 2024-05-28T06:05:35.124 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac85600640 1 -- 172.21.15.122:0/1760716270 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac6c003530 con 0x7fac8815a950 2024-05-28T06:05:35.124 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac85600640 1 -- 172.21.15.122:0/1760716270 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1484761680 0 0) 0x7fac6c003530 con 0x7fac8815a950 2024-05-28T06:05:35.124 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac85600640 1 -- 172.21.15.122:0/1760716270 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac880720f0 msgr2=0x7fac8815b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:35.125 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac85600640 1 --2- 172.21.15.122:0/1760716270 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac880720f0 0x7fac8815b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:35.125 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac85600640 1 -- 172.21.15.122:0/1760716270 >> v2:172.21.15.153:3300/0 conn(0x7fac880724d0 msgr2=0x7fac8815a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:35.125 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac85600640 1 --2- 172.21.15.122:0/1760716270 >> v2:172.21.15.153:3300/0 conn(0x7fac880724d0 0x7fac8815a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:35.125 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac85600640 1 -- 172.21.15.122:0/1760716270 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac880b42d0 con 0x7fac8815a950 2024-05-28T06:05:35.125 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac85600640 1 -- 172.21.15.122:0/1760716270 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7fac78001850 con 0x7fac8815a950 2024-05-28T06:05:35.125 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac85600640 1 -- 172.21.15.122:0/1760716270 >> v1:172.21.15.122:6789/0 conn(0x7fac8815a950 legacy=0x7fac8815e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:35.125 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac85600640 1 --2- 172.21.15.122:0/1760716270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac6c0039c0 0x7fac6c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:35.125 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac85600640 1 --2- 172.21.15.122:0/1760716270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac6c004810 0x7fac6c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:35.125 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac85600640 1 --2- 172.21.15.122:0/1760716270 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac880720f0 0x7fac6c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:35.125 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac85600640 1 -- 172.21.15.122:0/1760716270 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fac880b3720 con 0x7fac6c004810 2024-05-28T06:05:35.125 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac85600640 1 -- 172.21.15.122:0/1760716270 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fac880b3ff0 con 0x7fac6c0039c0 2024-05-28T06:05:35.125 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac85600640 1 -- 172.21.15.122:0/1760716270 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fac6c005b20 con 0x7fac880720f0 2024-05-28T06:05:35.125 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac87400640 1 --2- 172.21.15.122:0/1760716270 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac880720f0 0x7fac6c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:35.125 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac86a00640 1 --2- 172.21.15.122:0/1760716270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac6c0039c0 0x7fac6c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:35.126 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac86000640 1 --2- 172.21.15.122:0/1760716270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac6c004810 0x7fac6c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:35.126 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac87400640 1 -- 172.21.15.122:0/1760716270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac6c0039c0 msgr2=0x7fac6c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:35.126 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac87400640 1 --2- 172.21.15.122:0/1760716270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac6c0039c0 0x7fac6c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:35.126 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac87400640 1 -- 172.21.15.122:0/1760716270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac6c004810 msgr2=0x7fac6c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:35.126 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac87400640 1 --2- 172.21.15.122:0/1760716270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac6c004810 0x7fac6c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:35.126 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac87400640 1 -- 172.21.15.122:0/1760716270 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac880b42d0 con 0x7fac880720f0 2024-05-28T06:05:35.126 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.122+0000 7fac86a00640 1 --2- 172.21.15.122:0/1760716270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac6c0039c0 0x7fac6c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:05:35.128 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.126+0000 7fac87400640 1 --2- 172.21.15.122:0/1760716270 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac880720f0 0x7fac6c0051d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fac7800d500 tx=0x7fac7801d270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=682f6fb2e3e095db server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:35.134 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.126+0000 7fac85600640 1 -- 172.21.15.122:0/1760716270 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac780b1070 con 0x7fac880720f0 2024-05-28T06:05:35.134 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.126+0000 7fac85600640 1 -- 172.21.15.122:0/1760716270 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac78004f60 con 0x7fac880720f0 2024-05-28T06:05:35.135 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.126+0000 7fac85600640 1 -- 172.21.15.122:0/1760716270 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac78007050 con 0x7fac880720f0 2024-05-28T06:05:35.135 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.130+0000 7fac8dc00640 1 -- 172.21.15.122:0/1760716270 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac880720f0 msgr2=0x7fac6c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:35.135 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.130+0000 7fac8dc00640 1 --2- 172.21.15.122:0/1760716270 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac880720f0 0x7fac6c0051d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fac7800d500 tx=0x7fac7801d270 comp rx=0 tx=0).stop 2024-05-28T06:05:35.135 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.130+0000 7fac87400640 1 -- 172.21.15.122:0/1760716270 reap_dead start 2024-05-28T06:05:35.135 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.130+0000 7fac8dc00640 1 -- 172.21.15.122:0/1760716270 shutdown_connections 2024-05-28T06:05:35.135 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.130+0000 7fac8dc00640 1 -- 172.21.15.122:0/1760716270 >> 172.21.15.122:0/1760716270 conn(0x7fac88067eb0 msgr2=0x7fac8806b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:35.135 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.130+0000 7fac8dc00640 1 -- 172.21.15.122:0/1760716270 shutdown_connections 2024-05-28T06:05:35.135 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.130+0000 7fac8dc00640 1 -- 172.21.15.122:0/1760716270 wait complete. 2024-05-28T06:05:35.136 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.134+0000 7fac8dc00640 1 Processor -- start 2024-05-28T06:05:35.136 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.134+0000 7fac8dc00640 1 -- start start 2024-05-28T06:05:35.137 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.134+0000 7fac8dc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac880720f0 0x7fac881e9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:35.137 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.134+0000 7fac8dc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac881e8420 0x7fac881fc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:35.138 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.134+0000 7fac8dc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac881e6e80 0x7fac88155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:35.138 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.134+0000 7fac8dc00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fac8815ad60 con 0x7fac881e8420 2024-05-28T06:05:35.138 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.134+0000 7fac8dc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fac8806f910 con 0x7fac881e6e80 2024-05-28T06:05:35.138 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.134+0000 7fac8dc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fac8815c100 con 0x7fac880720f0 2024-05-28T06:05:35.138 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.134+0000 7fac86000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac881e8420 0x7fac881fc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:35.138 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.138+0000 7fac86a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac880720f0 0x7fac881e9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:35.138 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.138+0000 7fac86000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac881e8420 0x7fac881fc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45038/0 (socket says 172.21.15.122:45038) 2024-05-28T06:05:35.138 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.138+0000 7fac86000640 1 -- 172.21.15.122:0/4195657316 learned_addr learned my addr 172.21.15.122:0/4195657316 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:35.138 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.138+0000 7fac87400640 1 --2- 172.21.15.122:0/4195657316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac881e6e80 0x7fac88155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:35.139 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.138+0000 7fac86000640 1 -- 172.21.15.122:0/4195657316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac880720f0 msgr2=0x7fac881e9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:35.139 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.138+0000 7fac86000640 1 --2- 172.21.15.122:0/4195657316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac880720f0 0x7fac881e9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:35.139 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.138+0000 7fac86000640 1 -- 172.21.15.122:0/4195657316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac881e6e80 msgr2=0x7fac88155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:35.139 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.138+0000 7fac86000640 1 --2- 172.21.15.122:0/4195657316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac881e6e80 0x7fac88155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:35.139 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.138+0000 7fac86000640 1 -- 172.21.15.122:0/4195657316 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac881e7380 con 0x7fac881e8420 2024-05-28T06:05:35.139 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.138+0000 7fac86000640 1 --2- 172.21.15.122:0/4195657316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac881e8420 0x7fac881fc760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fac7400d5a0 tx=0x7fac7400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:35.140 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.138+0000 7fac7ea00640 1 -- 172.21.15.122:0/4195657316 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac74018020 con 0x7fac881e8420 2024-05-28T06:05:35.140 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.138+0000 7fac7ea00640 1 -- 172.21.15.122:0/4195657316 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac74014620 con 0x7fac881e8420 2024-05-28T06:05:35.140 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.138+0000 7fac7ea00640 1 -- 172.21.15.122:0/4195657316 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac740149d0 con 0x7fac881e8420 2024-05-28T06:05:35.140 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.138+0000 7fac8dc00640 1 -- 172.21.15.122:0/4195657316 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac881e7660 con 0x7fac881e8420 2024-05-28T06:05:35.140 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.138+0000 7fac8dc00640 1 -- 172.21.15.122:0/4195657316 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac881e7c20 con 0x7fac881e8420 2024-05-28T06:05:35.141 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.138+0000 7fac8dc00640 1 -- 172.21.15.122:0/4195657316 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac88073820 con 0x7fac881e8420 2024-05-28T06:05:35.143 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.142+0000 7fac7ea00640 1 -- 172.21.15.122:0/4195657316 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7fac7401b020 con 0x7fac881e8420 2024-05-28T06:05:35.144 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.142+0000 7fac7ea00640 1 --2- 172.21.15.122:0/4195657316 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fac68068370 0x7fac6806a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:35.144 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.142+0000 7fac7ea00640 1 -- 172.21.15.122:0/4195657316 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7fac74085be0 con 0x7fac881e8420 2024-05-28T06:05:35.145 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.142+0000 7fac86a00640 1 --2- 172.21.15.122:0/4195657316 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fac68068370 0x7fac6806a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:35.146 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.146+0000 7fac86a00640 1 --2- 172.21.15.122:0/4195657316 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fac68068370 0x7fac6806a830 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fac80007520 tx=0x7fac8000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:35.154 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.154+0000 7fac7ea00640 1 -- 172.21.15.122:0/4195657316 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fac74022030 con 0x7fac881e8420 2024-05-28T06:05:35.478 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-05-28T06:05:35.478+0000 7ff864600640 -1 osd.0 0 waiting for initial osdmap 2024-05-28T06:05:35.478 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.478+0000 7fac8dc00640 1 -- 172.21.15.122:0/4195657316 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac88072be0 con 0x7fac881e8420 2024-05-28T06:05:35.479 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.478+0000 7fac7ea00640 1 -- 172.21.15.122:0/4195657316 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7fac74056ff0 con 0x7fac881e8420 2024-05-28T06:05:35.489 INFO:teuthology.misc.health.smithi122.stdout: 2024-05-28T06:05:35.489 INFO:teuthology.misc.health.smithi122.stdout:{"epoch":12,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:05:33.288183+0000","last_up_change":"0.000000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:05:35.490 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.486+0000 7fac8dc00640 1 -- 172.21.15.122:0/4195657316 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fac68068370 msgr2=0x7fac6806a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:35.490 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.486+0000 7fac8dc00640 1 --2- 172.21.15.122:0/4195657316 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fac68068370 0x7fac6806a830 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fac80007520 tx=0x7fac8000b040 comp rx=0 tx=0).stop 2024-05-28T06:05:35.490 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.486+0000 7fac8dc00640 1 -- 172.21.15.122:0/4195657316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac881e8420 msgr2=0x7fac881fc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:35.490 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.486+0000 7fac8dc00640 1 --2- 172.21.15.122:0/4195657316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac881e8420 0x7fac881fc760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fac7400d5a0 tx=0x7fac7400da60 comp rx=0 tx=0).stop 2024-05-28T06:05:35.494 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.494+0000 7fac8dc00640 1 -- 172.21.15.122:0/4195657316 shutdown_connections 2024-05-28T06:05:35.494 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.494+0000 7fac8dc00640 1 --2- 172.21.15.122:0/4195657316 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fac68068370 0x7fac6806a830 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:35.494 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.494+0000 7fac8dc00640 1 --2- 172.21.15.122:0/4195657316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac881e6e80 0x7fac88155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:35.494 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.494+0000 7fac8dc00640 1 --2- 172.21.15.122:0/4195657316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac881e8420 0x7fac881fc760 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:35.494 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.494+0000 7fac8dc00640 1 --2- 172.21.15.122:0/4195657316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac880720f0 0x7fac881e9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:35.494 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.494+0000 7fac8dc00640 1 -- 172.21.15.122:0/4195657316 >> 172.21.15.122:0/4195657316 conn(0x7fac88067eb0 msgr2=0x7fac880b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:35.494 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.494+0000 7fac8dc00640 1 -- 172.21.15.122:0/4195657316 shutdown_connections 2024-05-28T06:05:35.494 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:35.494+0000 7fac8dc00640 1 -- 172.21.15.122:0/4195657316 wait complete. 2024-05-28T06:05:35.519 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-05-28T06:05:35.518+0000 7ff85a600640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-28T06:05:35.520 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-28T06:05:35.558 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-05-28T06:05:35.558+0000 7fca1c000640 -1 osd.3 0 waiting for initial osdmap 2024-05-28T06:05:35.576 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-05-28T06:05:35.574+0000 7f054d800640 -1 osd.1 0 waiting for initial osdmap 2024-05-28T06:05:35.582 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-05-28T06:05:35.582+0000 7ff594400640 -1 osd.2 0 waiting for initial osdmap 2024-05-28T06:05:35.587 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-05-28T06:05:35.588+0000 7f4804200640 -1 osd.6 0 waiting for initial osdmap 2024-05-28T06:05:35.594 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-05-28T06:05:35.594+0000 7fca12000640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-28T06:05:35.606 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-05-28T06:05:35.606+0000 7f0542e00640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-28T06:05:35.610 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-05-28T06:05:35.610+0000 7ff589a00640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-28T06:05:35.621 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-05-28T06:05:35.620+0000 7f47f9800640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-28T06:05:35.637 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-05-28T06:05:35.636+0000 7fbf7da00640 -1 osd.4 0 waiting for initial osdmap 2024-05-28T06:05:35.642 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-05-28T06:05:35.640+0000 7fe6f5200640 -1 osd.5 0 waiting for initial osdmap 2024-05-28T06:05:35.656 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-05-28T06:05:35.656+0000 7fd556e00640 -1 osd.7 0 waiting for initial osdmap 2024-05-28T06:05:35.677 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-05-28T06:05:35.676+0000 7fbf73a00640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-28T06:05:35.685 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-05-28T06:05:35.684+0000 7fd54ce00640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-28T06:05:35.688 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-05-28T06:05:35.688+0000 7fe6eb200640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-28T06:05:42.327 DEBUG:teuthology.orchestra.run.smithi122:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-28T06:05:42.462 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.457+0000 7fb995e00640 1 Processor -- start 2024-05-28T06:05:42.462 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.457+0000 7fb995e00640 1 -- start start 2024-05-28T06:05:42.464 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.461+0000 7fb995e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb9900b4870 0x7fb99006e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:42.465 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.461+0000 7fb995e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb99015f9b0 0x7fb990155000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:42.465 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.461+0000 7fb995e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb99015fe40 con 0x7fb9900b0500 2024-05-28T06:05:42.465 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.461+0000 7fb995e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fb99006f850 con 0x7fb9900b4870 2024-05-28T06:05:42.465 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.461+0000 7fb995e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb99006ec40 con 0x7fb99015f9b0 2024-05-28T06:05:42.465 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.461+0000 7fb98e000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb9900b4870 0x7fb99006e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:42.466 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.461+0000 7fb98e000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb9900b4870 0x7fb99006e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45506/0 (socket says 172.21.15.122:45506) 2024-05-28T06:05:42.466 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.461+0000 7fb98e000640 1 -- 172.21.15.122:0/3562792884 learned_addr learned my addr 172.21.15.122:0/3562792884 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:42.466 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.461+0000 7fb98f400640 1 --2- 172.21.15.122:0/3562792884 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb99015f9b0 0x7fb990155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:42.466 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.461+0000 7fb98e000640 1 -- 172.21.15.122:0/3562792884 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb99015f9b0 msgr2=0x7fb990155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:42.466 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.461+0000 7fb98e000640 1 --2- 172.21.15.122:0/3562792884 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb99015f9b0 0x7fb990155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:42.467 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.461+0000 7fb98e000640 1 -- 172.21.15.122:0/3562792884 >> v1:172.21.15.153:6789/0 conn(0x7fb9900b0500 legacy=0x7fb9900b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:42.467 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.461+0000 7fb98e000640 1 -- 172.21.15.122:0/3562792884 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99006ef20 con 0x7fb9900b4870 2024-05-28T06:05:42.467 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.461+0000 7fb98f400640 1 --2- 172.21.15.122:0/3562792884 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb99015f9b0 0x7fb990155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:05:42.469 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.465+0000 7fb98e000640 1 --2- 172.21.15.122:0/3562792884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9900b4870 0x7fb99006e560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009870 tx=0x7fb97c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956cb8bbd3f7ff29 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:42.469 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.465+0000 7fb98d600640 1 -- 172.21.15.122:0/3562792884 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c0b1070 con 0x7fb9900b4870 2024-05-28T06:05:42.470 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.465+0000 7fb98d600640 1 -- 172.21.15.122:0/3562792884 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb97c0ac630 con 0x7fb9900b4870 2024-05-28T06:05:42.470 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.465+0000 7fb98d600640 1 -- 172.21.15.122:0/3562792884 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c0a8050 con 0x7fb9900b4870 2024-05-28T06:05:42.470 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.465+0000 7fb995e00640 1 -- 172.21.15.122:0/3562792884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9900b4870 msgr2=0x7fb99006e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:42.470 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.465+0000 7fb995e00640 1 --2- 172.21.15.122:0/3562792884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9900b4870 0x7fb99006e560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009870 tx=0x7fb97c01c520 comp rx=0 tx=0).stop 2024-05-28T06:05:42.470 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.465+0000 7fb995e00640 1 -- 172.21.15.122:0/3562792884 shutdown_connections 2024-05-28T06:05:42.471 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.465+0000 7fb995e00640 1 --2- 172.21.15.122:0/3562792884 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb99015f9b0 0x7fb990155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:42.471 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.465+0000 7fb995e00640 1 --2- 172.21.15.122:0/3562792884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9900b4870 0x7fb99006e560 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:42.471 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.465+0000 7fb995e00640 1 -- 172.21.15.122:0/3562792884 >> 172.21.15.122:0/3562792884 conn(0x7fb9900d0d90 msgr2=0x7fb9900d11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:42.471 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.465+0000 7fb995e00640 1 -- 172.21.15.122:0/3562792884 shutdown_connections 2024-05-28T06:05:42.471 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.465+0000 7fb995e00640 1 -- 172.21.15.122:0/3562792884 wait complete. 2024-05-28T06:05:42.471 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.465+0000 7fb995e00640 1 Processor -- start 2024-05-28T06:05:42.472 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.465+0000 7fb995e00640 1 -- start start 2024-05-28T06:05:42.477 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb995e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9900b0500 0x7fb99014c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:42.477 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb995e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9900b4870 0x7fb990148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:42.477 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb995e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb99015f9b0 0x7fb990147f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:42.477 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb995e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb99006bf40 con 0x7fb9900b4870 2024-05-28T06:05:42.477 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb995e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb99006bdc0 con 0x7fb99015f9b0 2024-05-28T06:05:42.478 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb995e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb99006c0c0 con 0x7fb9900b0500 2024-05-28T06:05:42.478 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb98e000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9900b4870 0x7fb990148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:42.478 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb98e000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9900b4870 0x7fb990148960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45512/0 (socket says 172.21.15.122:45512) 2024-05-28T06:05:42.478 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb98e000640 1 -- 172.21.15.122:0/1183358878 learned_addr learned my addr 172.21.15.122:0/1183358878 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:42.478 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb98f400640 1 --2- 172.21.15.122:0/1183358878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb99015f9b0 0x7fb990147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:42.479 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb98ea00640 1 --2- 172.21.15.122:0/1183358878 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9900b0500 0x7fb99014c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:42.479 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb98e000640 1 -- 172.21.15.122:0/1183358878 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9900b0500 msgr2=0x7fb99014c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:42.479 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb98e000640 1 --2- 172.21.15.122:0/1183358878 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9900b0500 0x7fb99014c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:42.479 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb98e000640 1 -- 172.21.15.122:0/1183358878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb99015f9b0 msgr2=0x7fb990147f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:42.479 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb98e000640 1 --2- 172.21.15.122:0/1183358878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb99015f9b0 0x7fb990147f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:42.480 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb98e000640 1 -- 172.21.15.122:0/1183358878 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb990156560 con 0x7fb9900b4870 2024-05-28T06:05:42.480 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb98ea00640 1 --2- 172.21.15.122:0/1183358878 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9900b0500 0x7fb99014c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:05:42.480 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb98e000640 1 --2- 172.21.15.122:0/1183358878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9900b4870 0x7fb990148960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb97c01abd0 tx=0x7fb97c0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:42.480 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb987400640 1 -- 172.21.15.122:0/1183358878 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c0b1040 con 0x7fb9900b4870 2024-05-28T06:05:42.480 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb987400640 1 -- 172.21.15.122:0/1183358878 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb97c0ba070 con 0x7fb9900b4870 2024-05-28T06:05:42.480 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb995e00640 1 -- 172.21.15.122:0/1183358878 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb990156840 con 0x7fb9900b4870 2024-05-28T06:05:42.481 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb987400640 1 -- 172.21.15.122:0/1183358878 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c0a8040 con 0x7fb9900b4870 2024-05-28T06:05:42.481 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb995e00640 1 -- 172.21.15.122:0/1183358878 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb990156e00 con 0x7fb9900b4870 2024-05-28T06:05:42.481 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb995e00640 1 -- 172.21.15.122:0/1183358878 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb99009f120 con 0x7fb9900b4870 2024-05-28T06:05:42.481 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.469+0000 7fb987400640 1 -- 172.21.15.122:0/1183358878 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb97c0b5880 con 0x7fb9900b4870 2024-05-28T06:05:42.481 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.473+0000 7fb987400640 1 --2- 172.21.15.122:0/1183358878 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb970068380 0x7fb97006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:42.481 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.473+0000 7fb987400640 1 -- 172.21.15.122:0/1183358878 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fb97c120f70 con 0x7fb9900b4870 2024-05-28T06:05:42.482 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.473+0000 7fb98ea00640 1 --2- 172.21.15.122:0/1183358878 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb970068380 0x7fb97006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:42.482 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.473+0000 7fb98ea00640 1 --2- 172.21.15.122:0/1183358878 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb970068380 0x7fb97006a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb980007fd0 tx=0x7fb980009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:42.482 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.477+0000 7fb987400640 1 -- 172.21.15.122:0/1183358878 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb97c016110 con 0x7fb9900b4870 2024-05-28T06:05:42.637 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.633+0000 7fb995e00640 1 -- 172.21.15.122:0/1183358878 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb99004fdd0 con 0x7fb9900b4870 2024-05-28T06:05:42.638 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.637+0000 7fb987400640 1 -- 172.21.15.122:0/1183358878 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7fb97c0f18f0 con 0x7fb9900b4870 2024-05-28T06:05:42.639 INFO:teuthology.misc.health.smithi122.stdout: 2024-05-28T06:05:42.639 INFO:teuthology.misc.health.smithi122.stdout:{"epoch":16,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:05:39.505679+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:05:42.641 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.637+0000 7fb995e00640 1 -- 172.21.15.122:0/1183358878 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb970068380 msgr2=0x7fb97006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:42.641 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.637+0000 7fb995e00640 1 --2- 172.21.15.122:0/1183358878 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb970068380 0x7fb97006a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb980007fd0 tx=0x7fb980009040 comp rx=0 tx=0).stop 2024-05-28T06:05:42.641 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.637+0000 7fb995e00640 1 -- 172.21.15.122:0/1183358878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9900b4870 msgr2=0x7fb990148960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:42.641 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.637+0000 7fb995e00640 1 --2- 172.21.15.122:0/1183358878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9900b4870 0x7fb990148960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb97c01abd0 tx=0x7fb97c0192c0 comp rx=0 tx=0).stop 2024-05-28T06:05:42.641 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.637+0000 7fb995e00640 1 -- 172.21.15.122:0/1183358878 shutdown_connections 2024-05-28T06:05:42.641 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.637+0000 7fb995e00640 1 --2- 172.21.15.122:0/1183358878 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb970068380 0x7fb97006a840 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:42.641 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.637+0000 7fb995e00640 1 --2- 172.21.15.122:0/1183358878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb99015f9b0 0x7fb990147f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:42.641 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.637+0000 7fb995e00640 1 --2- 172.21.15.122:0/1183358878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9900b4870 0x7fb990148960 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:42.641 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.637+0000 7fb995e00640 1 --2- 172.21.15.122:0/1183358878 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9900b0500 0x7fb99014c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:42.642 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.637+0000 7fb995e00640 1 -- 172.21.15.122:0/1183358878 >> 172.21.15.122:0/1183358878 conn(0x7fb9900d0d90 msgr2=0x7fb9900b22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:42.642 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.637+0000 7fb995e00640 1 -- 172.21.15.122:0/1183358878 shutdown_connections 2024-05-28T06:05:42.642 INFO:teuthology.misc.health.smithi122.stderr:2024-05-28T06:05:42.637+0000 7fb995e00640 1 -- 172.21.15.122:0/1183358878 wait complete. 2024-05-28T06:05:42.658 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-28T06:05:42.658 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-28T06:05:42.658 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-28T06:05:42.658 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-28T06:05:42.661 INFO:tasks.ceph.mds.a:Started 2024-05-28T06:05:42.661 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-28T06:05:42.662 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-28T06:05:42.664 INFO:tasks.ceph.mds.c:Started 2024-05-28T06:05:42.665 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-28T06:05:42.665 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-28T06:05:42.668 INFO:tasks.ceph.mds.b:Started 2024-05-28T06:05:42.668 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-28T06:05:42.668 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-28T06:05:42.671 INFO:tasks.ceph.mds.d:Started 2024-05-28T06:05:42.671 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-28T06:05:42.672 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:05:42.762 INFO:tasks.ceph.mds.c.smithi122.stdout:starting mds.c at 2024-05-28T06:05:42.763 INFO:tasks.ceph.mds.a.smithi122.stdout:starting mds.a at 2024-05-28T06:05:42.767 INFO:tasks.ceph.mds.b.smithi153.stdout:starting mds.b at 2024-05-28T06:05:42.767 INFO:tasks.ceph.mds.d.smithi153.stdout:starting mds.d at 2024-05-28T06:05:42.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.813+0000 7f4fff200640 1 Processor -- start 2024-05-28T06:05:42.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.817+0000 7f4fff200640 1 -- start start 2024-05-28T06:05:42.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.817+0000 7f4fff200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f50000ba490 0x7f50000d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:42.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.817+0000 7f4fff200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f50000d1640 0x7f50000b7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:42.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.817+0000 7f4fff200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50000d33f0 con 0x7f500015e890 2024-05-28T06:05:42.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.817+0000 7f4fff200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f50000d31b0 con 0x7f50000d1640 2024-05-28T06:05:42.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.817+0000 7f4fff200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f50000d1a90 con 0x7f50000ba490 2024-05-28T06:05:42.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.817+0000 7f4ffe800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f50000d1640 0x7f50000b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:42.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.817+0000 7f4ffe800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f50000d1640 0x7f50000b7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45548/0 (socket says 172.21.15.122:45548) 2024-05-28T06:05:42.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.817+0000 7f4ffe800640 1 -- 172.21.15.122:0/2104449180 learned_addr learned my addr 172.21.15.122:0/2104449180 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:42.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.817+0000 7f4ffd400640 1 --2- 172.21.15.122:0/2104449180 >> v2:172.21.15.153:3300/0 conn(0x7f50000ba490 0x7f50000d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:42.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.817+0000 7f4ffe800640 1 -- 172.21.15.122:0/2104449180 >> v2:172.21.15.153:3300/0 conn(0x7f50000ba490 msgr2=0x7f50000d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:42.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.817+0000 7f4ffe800640 1 --2- 172.21.15.122:0/2104449180 >> v2:172.21.15.153:3300/0 conn(0x7f50000ba490 0x7f50000d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:42.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.817+0000 7f4ffe800640 1 -- 172.21.15.122:0/2104449180 >> v1:172.21.15.153:6789/0 conn(0x7f500015e890 legacy=0x7f50000d2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:42.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.817+0000 7f4ffe800640 1 -- 172.21.15.122:0/2104449180 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50000d36d0 con 0x7f50000d1640 2024-05-28T06:05:42.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.821+0000 7f4ffe800640 1 --2- 172.21.15.122:0/2104449180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50000d1640 0x7f50000b7870 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f50000d1070 tx=0x7f4ff801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8d79d1463ce101 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:42.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.821+0000 7f4ffca00640 1 -- 172.21.15.122:0/2104449180 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff80a5880 con 0x7f50000d1640 2024-05-28T06:05:42.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.821+0000 7f4ffca00640 1 -- 172.21.15.122:0/2104449180 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff80a5a20 con 0x7f50000d1640 2024-05-28T06:05:42.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.821+0000 7f4ffca00640 1 -- 172.21.15.122:0/2104449180 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff80a5df0 con 0x7f50000d1640 2024-05-28T06:05:42.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.821+0000 7f4fff200640 1 -- 172.21.15.122:0/2104449180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50000d1640 msgr2=0x7f50000b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:42.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.821+0000 7f4fff200640 1 --2- 172.21.15.122:0/2104449180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50000d1640 0x7f50000b7870 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f50000d1070 tx=0x7f4ff801c9c0 comp rx=0 tx=0).stop 2024-05-28T06:05:42.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.821+0000 7f4fff200640 1 -- 172.21.15.122:0/2104449180 shutdown_connections 2024-05-28T06:05:42.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.821+0000 7f4fff200640 1 --2- 172.21.15.122:0/2104449180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50000d1640 0x7f50000b7870 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:42.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.821+0000 7f4fff200640 1 --2- 172.21.15.122:0/2104449180 >> v2:172.21.15.153:3300/0 conn(0x7f50000ba490 0x7f50000d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:42.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.821+0000 7f4fff200640 1 -- 172.21.15.122:0/2104449180 >> 172.21.15.122:0/2104449180 conn(0x7f500006d370 msgr2=0x7f5000062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:42.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.821+0000 7f4fff200640 1 -- 172.21.15.122:0/2104449180 shutdown_connections 2024-05-28T06:05:42.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.821+0000 7f4fff200640 1 -- 172.21.15.122:0/2104449180 wait complete. 2024-05-28T06:05:42.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.821+0000 7f4fff200640 1 Processor -- start 2024-05-28T06:05:42.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.821+0000 7f4fff200640 1 -- start start 2024-05-28T06:05:42.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4fff200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50000ba490 0x7f5000149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:42.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4fff200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f50000d1640 0x7f500014b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:42.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4fff200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f500015e890 0x7f500014be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:42.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4fff200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f50000d4490 con 0x7f500015e890 2024-05-28T06:05:42.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4fff200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f500015ec70 con 0x7f50000ba490 2024-05-28T06:05:42.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4fff200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f50000b85c0 con 0x7f50000d1640 2024-05-28T06:05:42.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4ffe800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f500015e890 0x7f500014be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:42.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4ffe800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f500015e890 0x7f500014be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45560/0 (socket says 172.21.15.122:45560) 2024-05-28T06:05:42.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4ffde00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50000ba490 0x7f5000149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:42.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4ffe800640 1 -- 172.21.15.122:0/3945722812 learned_addr learned my addr 172.21.15.122:0/3945722812 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:42.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4ffd400640 1 --2- 172.21.15.122:0/3945722812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f50000d1640 0x7f500014b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:42.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4ffe800640 1 -- 172.21.15.122:0/3945722812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f50000d1640 msgr2=0x7f500014b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:42.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4ffe800640 1 --2- 172.21.15.122:0/3945722812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f50000d1640 0x7f500014b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:42.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4ffe800640 1 -- 172.21.15.122:0/3945722812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50000ba490 msgr2=0x7f5000149b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:42.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4ffe800640 1 --2- 172.21.15.122:0/3945722812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50000ba490 0x7f5000149b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:42.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4ffe800640 1 -- 172.21.15.122:0/3945722812 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5000152200 con 0x7f500015e890 2024-05-28T06:05:42.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4ffd400640 1 --2- 172.21.15.122:0/3945722812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f50000d1640 0x7f500014b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:05:42.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4ffe800640 1 --2- 172.21.15.122:0/3945722812 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f500015e890 0x7f500014be60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80af040 tx=0x7f4ff8019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:42.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4ff6000640 1 -- 172.21.15.122:0/3945722812 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff80b8470 con 0x7f500015e890 2024-05-28T06:05:42.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4ff6000640 1 -- 172.21.15.122:0/3945722812 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff80b8630 con 0x7f500015e890 2024-05-28T06:05:42.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4ff6000640 1 -- 172.21.15.122:0/3945722812 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff80b8a20 con 0x7f500015e890 2024-05-28T06:05:42.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4fff200640 1 -- 172.21.15.122:0/3945722812 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5000153c60 con 0x7f500015e890 2024-05-28T06:05:42.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4fff200640 1 -- 172.21.15.122:0/3945722812 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5000154220 con 0x7f500015e890 2024-05-28T06:05:42.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4fff200640 1 -- 172.21.15.122:0/3945722812 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5000075620 con 0x7f500015e890 2024-05-28T06:05:42.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.825+0000 7f4ff6000640 1 -- 172.21.15.122:0/3945722812 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4ff80c0020 con 0x7f500015e890 2024-05-28T06:05:42.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.829+0000 7f4ff6000640 1 --2- 172.21.15.122:0/3945722812 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4fe00683b0 0x7f4fe006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:42.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.829+0000 7f4ff6000640 1 -- 172.21.15.122:0/3945722812 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f4ff8121140 con 0x7f500015e890 2024-05-28T06:05:42.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.829+0000 7f4ffde00640 1 --2- 172.21.15.122:0/3945722812 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4fe00683b0 0x7f4fe006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:42.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.829+0000 7f4ffde00640 1 --2- 172.21.15.122:0/3945722812 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4fe00683b0 0x7f4fe006a870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0001770 tx=0x7f4ff0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:42.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.833+0000 7f4ff6000640 1 -- 172.21.15.122:0/3945722812 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4ff80165e0 con 0x7f500015e890 2024-05-28T06:05:42.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.989+0000 7f4fff200640 1 -- 172.21.15.122:0/3945722812 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50000b89f0 con 0x7f500015e890 2024-05-28T06:05:42.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.989+0000 7f4ff6000640 1 -- 172.21.15.122:0/3945722812 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7f4ff80f1a70 con 0x7f500015e890 2024-05-28T06:05:42.993 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:05:42.993 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":16,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:05:39.505679+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:05:42.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.993+0000 7f4fff200640 1 -- 172.21.15.122:0/3945722812 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4fe00683b0 msgr2=0x7f4fe006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:42.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.993+0000 7f4fff200640 1 --2- 172.21.15.122:0/3945722812 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4fe00683b0 0x7f4fe006a870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0001770 tx=0x7f4ff0009040 comp rx=0 tx=0).stop 2024-05-28T06:05:42.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.993+0000 7f4fff200640 1 -- 172.21.15.122:0/3945722812 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f500015e890 msgr2=0x7f500014be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:42.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.993+0000 7f4fff200640 1 --2- 172.21.15.122:0/3945722812 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f500015e890 0x7f500014be60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80af040 tx=0x7f4ff8019760 comp rx=0 tx=0).stop 2024-05-28T06:05:42.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.993+0000 7f4fff200640 1 -- 172.21.15.122:0/3945722812 shutdown_connections 2024-05-28T06:05:42.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.993+0000 7f4fff200640 1 --2- 172.21.15.122:0/3945722812 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4fe00683b0 0x7f4fe006a870 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:42.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.993+0000 7f4fff200640 1 --2- 172.21.15.122:0/3945722812 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f500015e890 0x7f500014be60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:42.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.993+0000 7f4fff200640 1 --2- 172.21.15.122:0/3945722812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f50000d1640 0x7f500014b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:42.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.993+0000 7f4fff200640 1 --2- 172.21.15.122:0/3945722812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50000ba490 0x7f5000149b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:42.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.993+0000 7f4fff200640 1 -- 172.21.15.122:0/3945722812 >> 172.21.15.122:0/3945722812 conn(0x7f500006d370 msgr2=0x7f500015bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:42.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.993+0000 7f4fff200640 1 -- 172.21.15.122:0/3945722812 shutdown_connections 2024-05-28T06:05:42.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:42.993+0000 7f4fff200640 1 -- 172.21.15.122:0/3945722812 wait complete. 2024-05-28T06:05:43.015 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:05:43.015 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:05:43.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.153+0000 7f3f90e00640 1 Processor -- start 2024-05-28T06:05:43.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.153+0000 7f3f90e00640 1 -- start start 2024-05-28T06:05:43.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.153+0000 7f3f90e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3f8c1588b0 0x7f3f8c06e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:43.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.153+0000 7f3f90e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f8c15e8b0 0x7f3f8c15ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:43.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.153+0000 7f3f90e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f8c141420 con 0x7f3f8c15f4c0 2024-05-28T06:05:43.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.153+0000 7f3f90e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f3f8c158c90 con 0x7f3f8c1588b0 2024-05-28T06:05:43.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.153+0000 7f3f90e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3f8c140e60 con 0x7f3f8c15e8b0 2024-05-28T06:05:43.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.153+0000 7f3f89e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3f8c1588b0 0x7f3f8c06e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:43.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.153+0000 7f3f89e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3f8c1588b0 0x7f3f8c06e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45562/0 (socket says 172.21.15.122:45562) 2024-05-28T06:05:43.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.153+0000 7f3f89e00640 1 -- 172.21.15.122:0/698960954 learned_addr learned my addr 172.21.15.122:0/698960954 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:43.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.153+0000 7f3f89400640 1 --1- 172.21.15.122:0/698960954 >> v1:172.21.15.122:6789/0 conn(0x7f3f8c15f4c0 0x7f3f8c140580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:53060/0 (socket says 172.21.15.122:53060) 2024-05-28T06:05:43.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.153+0000 7f3f89e00640 1 -- 172.21.15.122:0/698960954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f8c15e8b0 msgr2=0x7f3f8c15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:43.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.153+0000 7f3f89e00640 1 --2- 172.21.15.122:0/698960954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f8c15e8b0 0x7f3f8c15ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:43.157 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.153+0000 7f3f89e00640 1 -- 172.21.15.122:0/698960954 >> v1:172.21.15.122:6789/0 conn(0x7f3f8c15f4c0 legacy=0x7f3f8c140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:43.157 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.153+0000 7f3f89e00640 1 -- 172.21.15.122:0/698960954 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8c141140 con 0x7f3f8c1588b0 2024-05-28T06:05:43.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.157+0000 7f3f89e00640 1 --2- 172.21.15.122:0/698960954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f8c1588b0 0x7f3f8c06e070 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3f740098a0 tx=0x7f3f7401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e734f09cee0bb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:43.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.157+0000 7f3f88a00640 1 -- 172.21.15.122:0/698960954 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f740b0070 con 0x7f3f8c1588b0 2024-05-28T06:05:43.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.157+0000 7f3f88a00640 1 -- 172.21.15.122:0/698960954 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f740ab600 con 0x7f3f8c1588b0 2024-05-28T06:05:43.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.157+0000 7f3f88a00640 1 -- 172.21.15.122:0/698960954 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f740ab9d0 con 0x7f3f8c1588b0 2024-05-28T06:05:43.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.157+0000 7f3f90e00640 1 -- 172.21.15.122:0/698960954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f8c1588b0 msgr2=0x7f3f8c06e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:43.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.157+0000 7f3f90e00640 1 --2- 172.21.15.122:0/698960954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f8c1588b0 0x7f3f8c06e070 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3f740098a0 tx=0x7f3f7401c540 comp rx=0 tx=0).stop 2024-05-28T06:05:43.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.157+0000 7f3f90e00640 1 -- 172.21.15.122:0/698960954 shutdown_connections 2024-05-28T06:05:43.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.157+0000 7f3f90e00640 1 --2- 172.21.15.122:0/698960954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f8c15e8b0 0x7f3f8c15ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:43.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.157+0000 7f3f90e00640 1 --2- 172.21.15.122:0/698960954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f8c1588b0 0x7f3f8c06e070 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:43.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.157+0000 7f3f90e00640 1 -- 172.21.15.122:0/698960954 >> 172.21.15.122:0/698960954 conn(0x7f3f8c06bd90 msgr2=0x7f3f8c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:43.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.157+0000 7f3f90e00640 1 -- 172.21.15.122:0/698960954 shutdown_connections 2024-05-28T06:05:43.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.157+0000 7f3f90e00640 1 -- 172.21.15.122:0/698960954 wait complete. 2024-05-28T06:05:43.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.157+0000 7f3f90e00640 1 Processor -- start 2024-05-28T06:05:43.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.157+0000 7f3f90e00640 1 -- start start 2024-05-28T06:05:43.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f90e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f8c1588b0 0x7f3f8c13af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:43.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f90e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f8c15e8b0 0x7f3f8c1563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:43.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f90e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f8c15f4c0 0x7f3f8c15d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:43.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f90e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8c0cfa40 con 0x7f3f8c15f4c0 2024-05-28T06:05:43.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f90e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8c0cf8c0 con 0x7f3f8c15e8b0 2024-05-28T06:05:43.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f90e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3f8c0cfbc0 con 0x7f3f8c1588b0 2024-05-28T06:05:43.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f8a800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f8c15f4c0 0x7f3f8c15d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:43.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f8a800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f8c15f4c0 0x7f3f8c15d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45564/0 (socket says 172.21.15.122:45564) 2024-05-28T06:05:43.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f8a800640 1 -- 172.21.15.122:0/2562019315 learned_addr learned my addr 172.21.15.122:0/2562019315 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:43.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f89400640 1 --2- 172.21.15.122:0/2562019315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f8c15e8b0 0x7f3f8c1563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:43.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f89e00640 1 --2- 172.21.15.122:0/2562019315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f8c1588b0 0x7f3f8c13af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:43.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f8a800640 1 -- 172.21.15.122:0/2562019315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f8c1588b0 msgr2=0x7f3f8c13af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:43.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f8a800640 1 --2- 172.21.15.122:0/2562019315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f8c1588b0 0x7f3f8c13af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:43.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f8a800640 1 -- 172.21.15.122:0/2562019315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f8c15e8b0 msgr2=0x7f3f8c1563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:43.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f8a800640 1 --2- 172.21.15.122:0/2562019315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f8c15e8b0 0x7f3f8c1563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:43.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f8a800640 1 -- 172.21.15.122:0/2562019315 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8c15c490 con 0x7f3f8c15f4c0 2024-05-28T06:05:43.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f89400640 1 --2- 172.21.15.122:0/2562019315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f8c15e8b0 0x7f3f8c1563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:05:43.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f89e00640 1 --2- 172.21.15.122:0/2562019315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f8c1588b0 0x7f3f8c13af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:05:43.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f8a800640 1 --2- 172.21.15.122:0/2562019315 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f8c15f4c0 0x7f3f8c15d1e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400b970 tx=0x7f3f8400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:43.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f82000640 1 -- 172.21.15.122:0/2562019315 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84019070 con 0x7f3f8c15f4c0 2024-05-28T06:05:43.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f82000640 1 -- 172.21.15.122:0/2562019315 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f8400cb60 con 0x7f3f8c15f4c0 2024-05-28T06:05:43.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f90e00640 1 -- 172.21.15.122:0/2562019315 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f8c15c700 con 0x7f3f8c15f4c0 2024-05-28T06:05:43.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f82000640 1 -- 172.21.15.122:0/2562019315 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84014440 con 0x7f3f8c15f4c0 2024-05-28T06:05:43.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f90e00640 1 -- 172.21.15.122:0/2562019315 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f8c13b450 con 0x7f3f8c15f4c0 2024-05-28T06:05:43.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f90e00640 1 -- 172.21.15.122:0/2562019315 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f8c068c40 con 0x7f3f8c15f4c0 2024-05-28T06:05:43.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.161+0000 7f3f82000640 1 -- 172.21.15.122:0/2562019315 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3f8401c070 con 0x7f3f8c15f4c0 2024-05-28T06:05:43.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.165+0000 7f3f82000640 1 --2- 172.21.15.122:0/2562019315 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3f68068380 0x7f3f6806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:43.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.165+0000 7f3f82000640 1 -- 172.21.15.122:0/2562019315 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f3f84086410 con 0x7f3f8c15f4c0 2024-05-28T06:05:43.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.165+0000 7f3f89e00640 1 --2- 172.21.15.122:0/2562019315 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3f68068380 0x7f3f6806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:43.167 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.165+0000 7f3f89e00640 1 --2- 172.21.15.122:0/2562019315 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3f68068380 0x7f3f6806a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f740ad000 tx=0x7f3f740a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:43.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.169+0000 7f3f82000640 1 -- 172.21.15.122:0/2562019315 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3f84056d10 con 0x7f3f8c15f4c0 2024-05-28T06:05:43.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.325+0000 7f3f90e00640 1 -- 172.21.15.122:0/2562019315 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3f8c0b3d10 con 0x7f3f8c15f4c0 2024-05-28T06:05:43.330 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.325+0000 7f3f82000640 1 -- 172.21.15.122:0/2562019315 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f3f84056610 con 0x7f3f8c15f4c0 2024-05-28T06:05:43.330 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:05:43.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.329+0000 7f3f90e00640 1 -- 172.21.15.122:0/2562019315 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3f68068380 msgr2=0x7f3f6806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:43.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.329+0000 7f3f90e00640 1 --2- 172.21.15.122:0/2562019315 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3f68068380 0x7f3f6806a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f740ad000 tx=0x7f3f740a6000 comp rx=0 tx=0).stop 2024-05-28T06:05:43.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.329+0000 7f3f90e00640 1 -- 172.21.15.122:0/2562019315 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f8c15f4c0 msgr2=0x7f3f8c15d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:43.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.329+0000 7f3f90e00640 1 --2- 172.21.15.122:0/2562019315 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f8c15f4c0 0x7f3f8c15d1e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400b970 tx=0x7f3f8400be30 comp rx=0 tx=0).stop 2024-05-28T06:05:43.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.329+0000 7f3f90e00640 1 -- 172.21.15.122:0/2562019315 shutdown_connections 2024-05-28T06:05:43.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.329+0000 7f3f90e00640 1 --2- 172.21.15.122:0/2562019315 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3f68068380 0x7f3f6806a840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:43.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.329+0000 7f3f90e00640 1 --2- 172.21.15.122:0/2562019315 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f8c15f4c0 0x7f3f8c15d1e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:43.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.329+0000 7f3f90e00640 1 --2- 172.21.15.122:0/2562019315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f8c15e8b0 0x7f3f8c1563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:43.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.329+0000 7f3f90e00640 1 --2- 172.21.15.122:0/2562019315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f8c1588b0 0x7f3f8c13af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:43.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.329+0000 7f3f90e00640 1 -- 172.21.15.122:0/2562019315 >> 172.21.15.122:0/2562019315 conn(0x7f3f8c06bd90 msgr2=0x7f3f8c139de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:43.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.329+0000 7f3f90e00640 1 -- 172.21.15.122:0/2562019315 shutdown_connections 2024-05-28T06:05:43.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.329+0000 7f3f90e00640 1 -- 172.21.15.122:0/2562019315 wait complete. 2024-05-28T06:05:43.350 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:05:43.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.481+0000 7fa0f7400640 1 Processor -- start 2024-05-28T06:05:43.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.481+0000 7fa0f7400640 1 -- start start 2024-05-28T06:05:43.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.485+0000 7fa0f7400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f015e7a0 0x7fa0f006cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:43.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.485+0000 7fa0f7400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa0f0162e90 0x7fa0f00b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:43.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.485+0000 7fa0f7400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0f006be00 con 0x7fa0f00b4100 2024-05-28T06:05:43.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.485+0000 7fa0f7400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa0f006c0e0 con 0x7fa0f0162e90 2024-05-28T06:05:43.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.485+0000 7fa0f7400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa0f006c3c0 con 0x7fa0f015e7a0 2024-05-28T06:05:43.488 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.485+0000 7fa0f4a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f015e7a0 0x7fa0f006cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:43.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.485+0000 7fa0e7e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa0f0162e90 0x7fa0f00b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:43.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.485+0000 7fa0f5400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa0f00b4100 0x7fa0f00add80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:35042/0 (socket says 172.21.15.122:35042) 2024-05-28T06:05:43.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.485+0000 7fa0e7e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa0f0162e90 0x7fa0f00b3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:50306/0 (socket says 172.21.15.122:50306) 2024-05-28T06:05:43.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.485+0000 7fa0f5400640 1 -- 172.21.15.122:0/4076429401 learned_addr learned my addr 172.21.15.122:0/4076429401 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:43.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.485+0000 7fa0f4a00640 1 --2- 172.21.15.122:0/4076429401 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f015e7a0 0x7fa0f006cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:40140/0 (socket says 172.21.15.122:40140) 2024-05-28T06:05:43.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.485+0000 7fa0e7e00640 1 -- 172.21.15.122:0/4076429401 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f015e7a0 msgr2=0x7fa0f006cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:43.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.485+0000 7fa0e7e00640 1 --2- 172.21.15.122:0/4076429401 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f015e7a0 0x7fa0f006cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:43.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.485+0000 7fa0e7e00640 1 -- 172.21.15.122:0/4076429401 >> v1:172.21.15.153:6789/0 conn(0x7fa0f00b4100 legacy=0x7fa0f00add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:43.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.485+0000 7fa0e7e00640 1 -- 172.21.15.122:0/4076429401 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f006c6a0 con 0x7fa0f0162e90 2024-05-28T06:05:43.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.485+0000 7fa0efe00640 1 -- 172.21.15.122:0/4076429401 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1041281771 0 0) 0x7fa0f006be00 con 0x7fa0f00b4100 2024-05-28T06:05:43.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.489+0000 7fa0e7e00640 1 --2- 172.21.15.122:0/4076429401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0f0162e90 0x7fa0f00b3bc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa0d80097c0 tx=0x7fa0d801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc77db364fd50fc4 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:43.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.489+0000 7fa0efe00640 1 -- 172.21.15.122:0/4076429401 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d80b1070 con 0x7fa0f0162e90 2024-05-28T06:05:43.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.489+0000 7fa0efe00640 1 -- 172.21.15.122:0/4076429401 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d80ac410 con 0x7fa0f0162e90 2024-05-28T06:05:43.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.489+0000 7fa0efe00640 1 -- 172.21.15.122:0/4076429401 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d80ac7e0 con 0x7fa0f0162e90 2024-05-28T06:05:43.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.489+0000 7fa0f7400640 1 -- 172.21.15.122:0/4076429401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0f0162e90 msgr2=0x7fa0f00b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:43.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.489+0000 7fa0f7400640 1 --2- 172.21.15.122:0/4076429401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0f0162e90 0x7fa0f00b3bc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa0d80097c0 tx=0x7fa0d801c4a0 comp rx=0 tx=0).stop 2024-05-28T06:05:43.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.489+0000 7fa0f7400640 1 -- 172.21.15.122:0/4076429401 shutdown_connections 2024-05-28T06:05:43.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.489+0000 7fa0f7400640 1 --2- 172.21.15.122:0/4076429401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0f0162e90 0x7fa0f00b3bc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:43.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.489+0000 7fa0f7400640 1 --2- 172.21.15.122:0/4076429401 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f015e7a0 0x7fa0f006cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:43.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.489+0000 7fa0f7400640 1 -- 172.21.15.122:0/4076429401 >> 172.21.15.122:0/4076429401 conn(0x7fa0f00b3130 msgr2=0x7fa0f00d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:43.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.489+0000 7fa0f7400640 1 -- 172.21.15.122:0/4076429401 shutdown_connections 2024-05-28T06:05:43.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.489+0000 7fa0f7400640 1 -- 172.21.15.122:0/4076429401 wait complete. 2024-05-28T06:05:43.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.489+0000 7fa0f7400640 1 Processor -- start 2024-05-28T06:05:43.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0f7400640 1 -- start start 2024-05-28T06:05:43.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0f7400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f00b4100 0x7fa0f015be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:43.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0f7400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0f015e7a0 0x7fa0f0161800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:43.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0f7400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0f0162e90 0x7fa0f0159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:43.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0f7400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f015ed00 con 0x7fa0f0162e90 2024-05-28T06:05:43.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0f7400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f015eb80 con 0x7fa0f015e7a0 2024-05-28T06:05:43.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0f7400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa0f00ae8a0 con 0x7fa0f00b4100 2024-05-28T06:05:43.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0f5400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0f0162e90 0x7fa0f0159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:43.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0f5400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0f0162e90 0x7fa0f0159670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45578/0 (socket says 172.21.15.122:45578) 2024-05-28T06:05:43.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0e7e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0f015e7a0 0x7fa0f0161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:43.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0f5400640 1 -- 172.21.15.122:0/4038659621 learned_addr learned my addr 172.21.15.122:0/4038659621 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:43.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0f4a00640 1 --2- 172.21.15.122:0/4038659621 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f00b4100 0x7fa0f015be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:43.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0f5400640 1 -- 172.21.15.122:0/4038659621 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f00b4100 msgr2=0x7fa0f015be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:43.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0f5400640 1 --2- 172.21.15.122:0/4038659621 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f00b4100 0x7fa0f015be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:43.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0f5400640 1 -- 172.21.15.122:0/4038659621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0f015e7a0 msgr2=0x7fa0f0161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:43.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0f5400640 1 --2- 172.21.15.122:0/4038659621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0f015e7a0 0x7fa0f0161800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:43.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0f5400640 1 -- 172.21.15.122:0/4038659621 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f015c4b0 con 0x7fa0f0162e90 2024-05-28T06:05:43.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0f5400640 1 --2- 172.21.15.122:0/4038659621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0f0162e90 0x7fa0f0159670 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800c7a0 tx=0x7fa0e800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:43.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0ed600640 1 -- 172.21.15.122:0/4038659621 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8018070 con 0x7fa0f0162e90 2024-05-28T06:05:43.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0ed600640 1 -- 172.21.15.122:0/4038659621 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e800a640 con 0x7fa0f0162e90 2024-05-28T06:05:43.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0ed600640 1 -- 172.21.15.122:0/4038659621 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e800aa70 con 0x7fa0f0162e90 2024-05-28T06:05:43.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0f7400640 1 -- 172.21.15.122:0/4038659621 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0f015c790 con 0x7fa0f0162e90 2024-05-28T06:05:43.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0f7400640 1 -- 172.21.15.122:0/4038659621 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0f015cd50 con 0x7fa0f0162e90 2024-05-28T06:05:43.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.493+0000 7fa0f7400640 1 -- 172.21.15.122:0/4038659621 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0f0068c40 con 0x7fa0f0162e90 2024-05-28T06:05:43.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.497+0000 7fa0ed600640 1 -- 172.21.15.122:0/4038659621 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa0e801b070 con 0x7fa0f0162e90 2024-05-28T06:05:43.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.497+0000 7fa0ed600640 1 --2- 172.21.15.122:0/4038659621 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa0cc068380 0x7fa0cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:43.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.497+0000 7fa0ed600640 1 -- 172.21.15.122:0/4038659621 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fa0e8085d10 con 0x7fa0f0162e90 2024-05-28T06:05:43.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.497+0000 7fa0f4a00640 1 --2- 172.21.15.122:0/4038659621 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa0cc068380 0x7fa0cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:43.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.497+0000 7fa0f4a00640 1 --2- 172.21.15.122:0/4038659621 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa0cc068380 0x7fa0cc06a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0009b60 tx=0x7fa0e0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:43.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.501+0000 7fa0ed600640 1 -- 172.21.15.122:0/4038659621 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa0e808b020 con 0x7fa0f0162e90 2024-05-28T06:05:43.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.689+0000 7fa0f7400640 1 -- 172.21.15.122:0/4038659621 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0f00ccf70 con 0x7fa0f0162e90 2024-05-28T06:05:43.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.689+0000 7fa0ed600640 1 -- 172.21.15.122:0/4038659621 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7fa0e8055ea0 con 0x7fa0f0162e90 2024-05-28T06:05:43.693 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:05:43.693 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/360722760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":360722760},{"type":"v1","addr":"172.21.15.122:6836","nonce":360722760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-28T06:05:43.694 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 2 2024-05-28T06:05:43.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.693+0000 7fa0f7400640 1 -- 172.21.15.122:0/4038659621 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa0cc068380 msgr2=0x7fa0cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:43.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.693+0000 7fa0f7400640 1 --2- 172.21.15.122:0/4038659621 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa0cc068380 0x7fa0cc06a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0009b60 tx=0x7fa0e0009190 comp rx=0 tx=0).stop 2024-05-28T06:05:43.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.693+0000 7fa0f7400640 1 -- 172.21.15.122:0/4038659621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0f0162e90 msgr2=0x7fa0f0159670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:43.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.693+0000 7fa0f7400640 1 --2- 172.21.15.122:0/4038659621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0f0162e90 0x7fa0f0159670 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800c7a0 tx=0x7fa0e800cc60 comp rx=0 tx=0).stop 2024-05-28T06:05:43.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.693+0000 7fa0f7400640 1 -- 172.21.15.122:0/4038659621 shutdown_connections 2024-05-28T06:05:43.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.693+0000 7fa0f7400640 1 --2- 172.21.15.122:0/4038659621 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa0cc068380 0x7fa0cc06a840 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:43.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.693+0000 7fa0f7400640 1 --2- 172.21.15.122:0/4038659621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0f0162e90 0x7fa0f0159670 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:43.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.693+0000 7fa0f7400640 1 --2- 172.21.15.122:0/4038659621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0f015e7a0 0x7fa0f0161800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:43.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.693+0000 7fa0f7400640 1 --2- 172.21.15.122:0/4038659621 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa0f00b4100 0x7fa0f015be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:43.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.693+0000 7fa0f7400640 1 -- 172.21.15.122:0/4038659621 >> 172.21.15.122:0/4038659621 conn(0x7fa0f00b3130 msgr2=0x7fa0f00b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:43.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.693+0000 7fa0f7400640 1 -- 172.21.15.122:0/4038659621 shutdown_connections 2024-05-28T06:05:43.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:43.693+0000 7fa0f7400640 1 -- 172.21.15.122:0/4038659621 wait complete. 2024-05-28T06:05:45.716 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:05:45.865 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.861+0000 7fd725800640 1 Processor -- start 2024-05-28T06:05:45.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.861+0000 7fd725800640 1 -- start start 2024-05-28T06:05:45.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd725800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7200cff30 0x7fd72006f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:45.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd725800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7200d0310 con 0x7fd7200cdb00 2024-05-28T06:05:45.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd725800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd72015be20 con 0x7fd72006f6c0 2024-05-28T06:05:45.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd725800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd72006fb00 con 0x7fd7200cff30 2024-05-28T06:05:45.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71f400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fd7200cdb00 0x7fd7200b49b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56178/0 (socket says 172.21.15.122:56178) 2024-05-28T06:05:45.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71f400640 1 -- 172.21.15.122:0/1673393383 learned_addr learned my addr 172.21.15.122:0/1673393383 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:45.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71ea00640 1 --2- 172.21.15.122:0/1673393383 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7200cff30 0x7fd72006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:45.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71e000640 1 -- 172.21.15.122:0/1673393383 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 215994146 0 0) 0x7fd7200d0310 con 0x7fd7200cdb00 2024-05-28T06:05:45.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71e000640 1 -- 172.21.15.122:0/1673393383 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd704003530 con 0x7fd7200cdb00 2024-05-28T06:05:45.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71e000640 1 -- 172.21.15.122:0/1673393383 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2730885554 0 0) 0x7fd704003530 con 0x7fd7200cdb00 2024-05-28T06:05:45.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71e000640 1 -- 172.21.15.122:0/1673393383 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7200cff30 msgr2=0x7fd72006f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:45.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71e000640 1 --2- 172.21.15.122:0/1673393383 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7200cff30 0x7fd72006f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:45.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71e000640 1 -- 172.21.15.122:0/1673393383 >> v1:172.21.15.153:6789/0 conn(0x7fd72006f6c0 legacy=0x7fd7200cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:45.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71e000640 1 -- 172.21.15.122:0/1673393383 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72015c100 con 0x7fd7200cdb00 2024-05-28T06:05:45.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71e000640 1 -- 172.21.15.122:0/1673393383 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7fd718001a20 con 0x7fd7200cdb00 2024-05-28T06:05:45.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71e000640 1 -- 172.21.15.122:0/1673393383 >> v1:172.21.15.122:6789/0 conn(0x7fd7200cdb00 legacy=0x7fd7200b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:45.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71e000640 1 --2- 172.21.15.122:0/1673393383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7040039f0 0x7fd704003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:45.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71e000640 1 --2- 172.21.15.122:0/1673393383 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7200cff30 0x7fd704004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:45.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71e000640 1 --2- 172.21.15.122:0/1673393383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd704004d50 0x7fd7040051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:45.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71e000640 1 -- 172.21.15.122:0/1673393383 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd72006fb00 con 0x7fd704004d50 2024-05-28T06:05:45.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71e000640 1 -- 172.21.15.122:0/1673393383 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd70400dc90 con 0x7fd7040039f0 2024-05-28T06:05:45.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71e000640 1 -- 172.21.15.122:0/1673393383 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd70400de90 con 0x7fd7200cff30 2024-05-28T06:05:45.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71f400640 1 --2- 172.21.15.122:0/1673393383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd704004d50 0x7fd7040051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:45.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71ea00640 1 --2- 172.21.15.122:0/1673393383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7040039f0 0x7fd704003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:45.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd716000640 1 --2- 172.21.15.122:0/1673393383 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7200cff30 0x7fd704004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:45.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71f400640 1 -- 172.21.15.122:0/1673393383 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7200cff30 msgr2=0x7fd704004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:45.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71f400640 1 --2- 172.21.15.122:0/1673393383 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7200cff30 0x7fd704004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:45.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71f400640 1 -- 172.21.15.122:0/1673393383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7040039f0 msgr2=0x7fd704003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:45.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71f400640 1 --2- 172.21.15.122:0/1673393383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7040039f0 0x7fd704003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:45.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.865+0000 7fd71f400640 1 -- 172.21.15.122:0/1673393383 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd704003530 con 0x7fd704004d50 2024-05-28T06:05:45.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.869+0000 7fd71f400640 1 --2- 172.21.15.122:0/1673393383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd704004d50 0x7fd7040051d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd7200d04e0 tx=0x7fd71801d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc8ba10df3f3950 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:45.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.869+0000 7fd71e000640 1 -- 172.21.15.122:0/1673393383 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71800a4a0 con 0x7fd704004d50 2024-05-28T06:05:45.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.869+0000 7fd71e000640 1 -- 172.21.15.122:0/1673393383 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7180ad630 con 0x7fd704004d50 2024-05-28T06:05:45.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.869+0000 7fd71e000640 1 -- 172.21.15.122:0/1673393383 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7180ada00 con 0x7fd704004d50 2024-05-28T06:05:45.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.869+0000 7fd725800640 1 -- 172.21.15.122:0/1673393383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd704004d50 msgr2=0x7fd7040051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:45.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.869+0000 7fd725800640 1 --2- 172.21.15.122:0/1673393383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd704004d50 0x7fd7040051d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd7200d04e0 tx=0x7fd71801d340 comp rx=0 tx=0).stop 2024-05-28T06:05:45.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.869+0000 7fd71f400640 1 -- 172.21.15.122:0/1673393383 reap_dead start 2024-05-28T06:05:45.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.869+0000 7fd725800640 1 -- 172.21.15.122:0/1673393383 shutdown_connections 2024-05-28T06:05:45.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.869+0000 7fd725800640 1 -- 172.21.15.122:0/1673393383 >> 172.21.15.122:0/1673393383 conn(0x7fd72006bd90 msgr2=0x7fd72006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:45.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.869+0000 7fd725800640 1 -- 172.21.15.122:0/1673393383 shutdown_connections 2024-05-28T06:05:45.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.869+0000 7fd725800640 1 -- 172.21.15.122:0/1673393383 wait complete. 2024-05-28T06:05:45.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd725800640 1 Processor -- start 2024-05-28T06:05:45.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd725800640 1 -- start start 2024-05-28T06:05:45.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd725800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd704004d50 0x7fd72014ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:45.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd725800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7200ca350 0x7fd7200b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:45.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd725800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7200ca7d0 0x7fd7200b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:45.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd725800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd72015c6c0 con 0x7fd704004d50 2024-05-28T06:05:45.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd725800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd7200cdf30 con 0x7fd7200ca350 2024-05-28T06:05:45.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd725800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd72015baf0 con 0x7fd7200ca7d0 2024-05-28T06:05:45.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd71ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd704004d50 0x7fd72014ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:45.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd71ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd704004d50 0x7fd72014ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36024/0 (socket says 172.21.15.122:36024) 2024-05-28T06:05:45.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd71ea00640 1 -- 172.21.15.122:0/3837810352 learned_addr learned my addr 172.21.15.122:0/3837810352 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:45.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd716000640 1 --2- 172.21.15.122:0/3837810352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7200ca350 0x7fd7200b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:45.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd71f400640 1 --2- 172.21.15.122:0/3837810352 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7200ca7d0 0x7fd7200b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:45.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd71ea00640 1 -- 172.21.15.122:0/3837810352 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7200ca7d0 msgr2=0x7fd7200b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:45.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd71ea00640 1 --2- 172.21.15.122:0/3837810352 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7200ca7d0 0x7fd7200b4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:45.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd71ea00640 1 -- 172.21.15.122:0/3837810352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7200ca350 msgr2=0x7fd7200b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:45.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd71ea00640 1 --2- 172.21.15.122:0/3837810352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7200ca350 0x7fd7200b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:45.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd71ea00640 1 -- 172.21.15.122:0/3837810352 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72014d3d0 con 0x7fd704004d50 2024-05-28T06:05:45.878 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd71f400640 1 --2- 172.21.15.122:0/3837810352 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7200ca7d0 0x7fd7200b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:05:45.878 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd71ea00640 1 --2- 172.21.15.122:0/3837810352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd704004d50 0x7fd72014ce90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd7100119d0 tx=0x7fd710011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:45.878 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd717400640 1 -- 172.21.15.122:0/3837810352 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71000fb50 con 0x7fd704004d50 2024-05-28T06:05:45.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd717400640 1 -- 172.21.15.122:0/3837810352 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd71000fcf0 con 0x7fd704004d50 2024-05-28T06:05:45.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd725800640 1 -- 172.21.15.122:0/3837810352 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7200cb1e0 con 0x7fd704004d50 2024-05-28T06:05:45.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd717400640 1 -- 172.21.15.122:0/3837810352 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71000fea0 con 0x7fd704004d50 2024-05-28T06:05:45.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd725800640 1 -- 172.21.15.122:0/3837810352 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7200cb7a0 con 0x7fd704004d50 2024-05-28T06:05:45.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.873+0000 7fd725800640 1 -- 172.21.15.122:0/3837810352 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd720068c40 con 0x7fd704004d50 2024-05-28T06:05:45.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.877+0000 7fd717400640 1 -- 172.21.15.122:0/3837810352 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd710012040 con 0x7fd704004d50 2024-05-28T06:05:45.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.877+0000 7fd717400640 1 --2- 172.21.15.122:0/3837810352 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd6fc0683b0 0x7fd6fc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:45.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.877+0000 7fd717400640 1 -- 172.21.15.122:0/3837810352 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fd710086d70 con 0x7fd704004d50 2024-05-28T06:05:45.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.877+0000 7fd716000640 1 --2- 172.21.15.122:0/3837810352 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd6fc0683b0 0x7fd6fc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:45.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.877+0000 7fd716000640 1 --2- 172.21.15.122:0/3837810352 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd6fc0683b0 0x7fd6fc06a870 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd720154690 tx=0x7fd708009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:45.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:45.881+0000 7fd717400640 1 -- 172.21.15.122:0/3837810352 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd710019030 con 0x7fd704004d50 2024-05-28T06:05:46.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.073+0000 7fd725800640 1 -- 172.21.15.122:0/3837810352 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd72015a050 con 0x7fd704004d50 2024-05-28T06:05:46.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.073+0000 7fd717400640 1 -- 172.21.15.122:0/3837810352 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3873 (secure 0 0 0) 0x7fd7100570e0 con 0x7fd704004d50 2024-05-28T06:05:46.076 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:05:46.076 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4177682646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4177682646},{"type":"v1","addr":"172.21.15.153:6835","nonce":4177682646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3318983491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3318983491},{"type":"v1","addr":"172.21.15.153:6834","nonce":3318983491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/360722760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":360722760},{"type":"v1","addr":"172.21.15.122:6836","nonce":360722760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1474216380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1474216380},{"type":"v1","addr":"172.21.15.122:6837","nonce":1474216380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-28T06:05:46.077 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 3 2024-05-28T06:05:46.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.073+0000 7fd725800640 1 -- 172.21.15.122:0/3837810352 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd6fc0683b0 msgr2=0x7fd6fc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:46.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.073+0000 7fd725800640 1 --2- 172.21.15.122:0/3837810352 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd6fc0683b0 0x7fd6fc06a870 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd720154690 tx=0x7fd708009040 comp rx=0 tx=0).stop 2024-05-28T06:05:46.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.073+0000 7fd725800640 1 -- 172.21.15.122:0/3837810352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd704004d50 msgr2=0x7fd72014ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:46.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.073+0000 7fd725800640 1 --2- 172.21.15.122:0/3837810352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd704004d50 0x7fd72014ce90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd7100119d0 tx=0x7fd710011e90 comp rx=0 tx=0).stop 2024-05-28T06:05:46.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.073+0000 7fd725800640 1 -- 172.21.15.122:0/3837810352 shutdown_connections 2024-05-28T06:05:46.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.073+0000 7fd725800640 1 --2- 172.21.15.122:0/3837810352 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd6fc0683b0 0x7fd6fc06a870 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.073+0000 7fd725800640 1 --2- 172.21.15.122:0/3837810352 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7200ca7d0 0x7fd7200b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.073+0000 7fd725800640 1 --2- 172.21.15.122:0/3837810352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7200ca350 0x7fd7200b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.073+0000 7fd725800640 1 --2- 172.21.15.122:0/3837810352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd704004d50 0x7fd72014ce90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.073+0000 7fd725800640 1 -- 172.21.15.122:0/3837810352 >> 172.21.15.122:0/3837810352 conn(0x7fd72006bd90 msgr2=0x7fd72015a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:46.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.073+0000 7fd725800640 1 -- 172.21.15.122:0/3837810352 shutdown_connections 2024-05-28T06:05:46.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.073+0000 7fd725800640 1 -- 172.21.15.122:0/3837810352 wait complete. 2024-05-28T06:05:46.098 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:05:46.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.241+0000 7f8742400640 1 Processor -- start 2024-05-28T06:05:46.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.241+0000 7f8742400640 1 -- start start 2024-05-28T06:05:46.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.241+0000 7f8742400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f873c06f890 0x7f873c0cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:46.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.241+0000 7f8742400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f873c0cd930 0x7f873c0b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:46.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.241+0000 7f8742400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f873c0d0310 con 0x7f873c0cff30 2024-05-28T06:05:46.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.241+0000 7f8742400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f873c15be20 con 0x7f873c06f890 2024-05-28T06:05:46.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.241+0000 7f8742400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f873c15c100 con 0x7f873c0cd930 2024-05-28T06:05:46.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.241+0000 7f8732a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f873c06f890 0x7f873c0cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:46.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.241+0000 7f873be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f873c0cd930 0x7f873c0b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:46.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.241+0000 7f873be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f873c0cd930 0x7f873c0b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:35372/0 (socket says 172.21.15.122:35372) 2024-05-28T06:05:46.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.241+0000 7f873be00640 1 -- 172.21.15.122:0/2656208105 learned_addr learned my addr 172.21.15.122:0/2656208105 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:46.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.241+0000 7f873be00640 1 -- 172.21.15.122:0/2656208105 >> v2:172.21.15.153:3300/0 conn(0x7f873c06f890 msgr2=0x7f873c0cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:46.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.241+0000 7f873be00640 1 --2- 172.21.15.122:0/2656208105 >> v2:172.21.15.153:3300/0 conn(0x7f873c06f890 0x7f873c0cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.241+0000 7f873be00640 1 -- 172.21.15.122:0/2656208105 >> v1:172.21.15.153:6789/0 conn(0x7f873c0cff30 legacy=0x7f873c06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:46.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.241+0000 7f873be00640 1 -- 172.21.15.122:0/2656208105 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f873c15c3e0 con 0x7f873c0cd930 2024-05-28T06:05:46.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.245+0000 7f873be00640 1 --2- 172.21.15.122:0/2656208105 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f873c0cd930 0x7f873c0b49b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8734009870 tx=0x7f873401c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4f1f9bca0c06cc8 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:46.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.245+0000 7f873aa00640 1 -- 172.21.15.122:0/2656208105 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87340aa430 con 0x7f873c0cd930 2024-05-28T06:05:46.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.245+0000 7f873aa00640 1 -- 172.21.15.122:0/2656208105 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87340af070 con 0x7f873c0cd930 2024-05-28T06:05:46.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.245+0000 7f873aa00640 1 -- 172.21.15.122:0/2656208105 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87340aa7f0 con 0x7f873c0cd930 2024-05-28T06:05:46.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.245+0000 7f8742400640 1 -- 172.21.15.122:0/2656208105 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f873c0cd930 msgr2=0x7f873c0b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:46.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.245+0000 7f8742400640 1 --2- 172.21.15.122:0/2656208105 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f873c0cd930 0x7f873c0b49b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8734009870 tx=0x7f873401c530 comp rx=0 tx=0).stop 2024-05-28T06:05:46.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.245+0000 7f8742400640 1 -- 172.21.15.122:0/2656208105 shutdown_connections 2024-05-28T06:05:46.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.245+0000 7f8742400640 1 --2- 172.21.15.122:0/2656208105 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f873c0cd930 0x7f873c0b49b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.245+0000 7f8742400640 1 --2- 172.21.15.122:0/2656208105 >> v2:172.21.15.153:3300/0 conn(0x7f873c06f890 0x7f873c0cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.245+0000 7f8742400640 1 -- 172.21.15.122:0/2656208105 >> 172.21.15.122:0/2656208105 conn(0x7f873c06bd90 msgr2=0x7f873c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:46.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.245+0000 7f8742400640 1 -- 172.21.15.122:0/2656208105 shutdown_connections 2024-05-28T06:05:46.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.245+0000 7f8742400640 1 -- 172.21.15.122:0/2656208105 wait complete. 2024-05-28T06:05:46.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f8742400640 1 Processor -- start 2024-05-28T06:05:46.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f8742400640 1 -- start start 2024-05-28T06:05:46.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f8742400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f873c06f890 0x7f873c135db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:46.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f8742400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f873c0cd930 0x7f873c147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:46.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f8742400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f873c0cff30 0x7f873c1f76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:46.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f8742400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f873c0b5880 con 0x7f873c06f890 2024-05-28T06:05:46.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f8742400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f873c0b5700 con 0x7f873c0cff30 2024-05-28T06:05:46.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f8742400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f873c0b5a00 con 0x7f873c0cd930 2024-05-28T06:05:46.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f873b400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f873c06f890 0x7f873c135db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:46.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f873b400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f873c06f890 0x7f873c135db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36040/0 (socket says 172.21.15.122:36040) 2024-05-28T06:05:46.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f873b400640 1 -- 172.21.15.122:0/3568052281 learned_addr learned my addr 172.21.15.122:0/3568052281 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:46.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f8732a00640 1 --2- 172.21.15.122:0/3568052281 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f873c0cd930 0x7f873c147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:46.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f873be00640 1 --2- 172.21.15.122:0/3568052281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f873c0cff30 0x7f873c1f76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:46.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f873b400640 1 -- 172.21.15.122:0/3568052281 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f873c0cd930 msgr2=0x7f873c147520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:46.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f873b400640 1 --2- 172.21.15.122:0/3568052281 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f873c0cd930 0x7f873c147520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f873b400640 1 -- 172.21.15.122:0/3568052281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f873c0cff30 msgr2=0x7f873c1f76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:46.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f873b400640 1 --2- 172.21.15.122:0/3568052281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f873c0cff30 0x7f873c1f76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f873b400640 1 -- 172.21.15.122:0/3568052281 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f873c0cf790 con 0x7f873c06f890 2024-05-28T06:05:46.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f873b400640 1 --2- 172.21.15.122:0/3568052281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f873c06f890 0x7f873c135db0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f872c00c760 tx=0x7f872c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:46.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f8733e00640 1 -- 172.21.15.122:0/3568052281 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c003ba0 con 0x7f873c06f890 2024-05-28T06:05:46.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f8733e00640 1 -- 172.21.15.122:0/3568052281 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f872c003d60 con 0x7f873c06f890 2024-05-28T06:05:46.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f8733e00640 1 -- 172.21.15.122:0/3568052281 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c00aa30 con 0x7f873c06f890 2024-05-28T06:05:46.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f8742400640 1 -- 172.21.15.122:0/3568052281 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f873c150680 con 0x7f873c06f890 2024-05-28T06:05:46.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f8742400640 1 -- 172.21.15.122:0/3568052281 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f873c06eee0 con 0x7f873c06f890 2024-05-28T06:05:46.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.249+0000 7f8742400640 1 -- 172.21.15.122:0/3568052281 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f873c068c40 con 0x7f873c06f890 2024-05-28T06:05:46.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.253+0000 7f8733e00640 1 -- 172.21.15.122:0/3568052281 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f872c00abd0 con 0x7f873c06f890 2024-05-28T06:05:46.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.253+0000 7f8733e00640 1 --2- 172.21.15.122:0/3568052281 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8718068380 0x7f871806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:46.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.253+0000 7f8733e00640 1 -- 172.21.15.122:0/3568052281 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f872c0863a0 con 0x7f873c06f890 2024-05-28T06:05:46.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.253+0000 7f8732a00640 1 --2- 172.21.15.122:0/3568052281 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8718068380 0x7f871806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:46.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.253+0000 7f8732a00640 1 --2- 172.21.15.122:0/3568052281 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8718068380 0x7f871806a840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f873c155c50 tx=0x7f8724009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:46.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.257+0000 7f8733e00640 1 -- 172.21.15.122:0/3568052281 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f872c056650 con 0x7f873c06f890 2024-05-28T06:05:46.417 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.413+0000 7f8742400640 1 -- 172.21.15.122:0/3568052281 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f873c155f70 con 0x7f873c06f890 2024-05-28T06:05:46.418 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.413+0000 7f8733e00640 1 -- 172.21.15.122:0/3568052281 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7f872c05a950 con 0x7f873c06f890 2024-05-28T06:05:46.418 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:05:46.419 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":16,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:05:39.505679+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:05:46.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.417+0000 7f8742400640 1 -- 172.21.15.122:0/3568052281 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8718068380 msgr2=0x7f871806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:46.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.417+0000 7f8742400640 1 --2- 172.21.15.122:0/3568052281 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8718068380 0x7f871806a840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f873c155c50 tx=0x7f8724009190 comp rx=0 tx=0).stop 2024-05-28T06:05:46.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.417+0000 7f8742400640 1 -- 172.21.15.122:0/3568052281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f873c06f890 msgr2=0x7f873c135db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:46.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.417+0000 7f8742400640 1 --2- 172.21.15.122:0/3568052281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f873c06f890 0x7f873c135db0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f872c00c760 tx=0x7f872c00cc20 comp rx=0 tx=0).stop 2024-05-28T06:05:46.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.417+0000 7f8742400640 1 -- 172.21.15.122:0/3568052281 shutdown_connections 2024-05-28T06:05:46.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.417+0000 7f8742400640 1 --2- 172.21.15.122:0/3568052281 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8718068380 0x7f871806a840 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.417+0000 7f8742400640 1 --2- 172.21.15.122:0/3568052281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f873c0cff30 0x7f873c1f76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.417+0000 7f8742400640 1 --2- 172.21.15.122:0/3568052281 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f873c0cd930 0x7f873c147520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.417+0000 7f8742400640 1 --2- 172.21.15.122:0/3568052281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f873c06f890 0x7f873c135db0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.417+0000 7f8742400640 1 -- 172.21.15.122:0/3568052281 >> 172.21.15.122:0/3568052281 conn(0x7f873c06bd90 msgr2=0x7f873c1493f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:46.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.417+0000 7f8742400640 1 -- 172.21.15.122:0/3568052281 shutdown_connections 2024-05-28T06:05:46.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.417+0000 7f8742400640 1 -- 172.21.15.122:0/3568052281 wait complete. 2024-05-28T06:05:46.439 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:05:46.439 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:05:46.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.581+0000 7f3103c00640 1 Processor -- start 2024-05-28T06:05:46.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.581+0000 7f3103c00640 1 -- start start 2024-05-28T06:05:46.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.581+0000 7f3103c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f30fc0b59c0 0x7f30fc0cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:46.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.581+0000 7f3103c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30fc0d0310 con 0x7f30fc0cff30 2024-05-28T06:05:46.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.581+0000 7f3103c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30fc15be20 con 0x7f30fc06f890 2024-05-28T06:05:46.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.581+0000 7f3103c00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f30fc15c100 con 0x7f30fc0b59c0 2024-05-28T06:05:46.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.581+0000 7f3101c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f30fc0b59c0 0x7f30fc0cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:46.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.581+0000 7f3101200640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f30fc0cff30 0x7f30fc06f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56192/0 (socket says 172.21.15.122:56192) 2024-05-28T06:05:46.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.581+0000 7f3101200640 1 -- 172.21.15.122:0/2538141686 learned_addr learned my addr 172.21.15.122:0/2538141686 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:46.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.585+0000 7f3101c00640 1 -- 172.21.15.122:0/2538141686 >> v1:172.21.15.153:6789/0 conn(0x7f30fc06f890 legacy=0x7f30fc0cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:46.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.585+0000 7f3101c00640 1 -- 172.21.15.122:0/2538141686 >> v1:172.21.15.122:6789/0 conn(0x7f30fc0cff30 legacy=0x7f30fc06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:46.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.585+0000 7f3101c00640 1 -- 172.21.15.122:0/2538141686 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30fc15c3e0 con 0x7f30fc0b59c0 2024-05-28T06:05:46.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.585+0000 7f30fb400640 1 -- 172.21.15.122:0/2538141686 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 482143464 0 0) 0x7f30fc0d0310 con 0x7f30fc0cff30 2024-05-28T06:05:46.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.585+0000 7f3101c00640 1 --2- 172.21.15.122:0/2538141686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30fc0b59c0 0x7f30fc0cdb00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009d90 tx=0x7f30f401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b0eba235b902f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:46.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.585+0000 7f30fb400640 1 -- 172.21.15.122:0/2538141686 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f40b2070 con 0x7f30fc0b59c0 2024-05-28T06:05:46.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.585+0000 7f30fb400640 1 -- 172.21.15.122:0/2538141686 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f40a5960 con 0x7f30fc0b59c0 2024-05-28T06:05:46.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.585+0000 7f30fb400640 1 -- 172.21.15.122:0/2538141686 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f40a5d30 con 0x7f30fc0b59c0 2024-05-28T06:05:46.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.585+0000 7f3103c00640 1 -- 172.21.15.122:0/2538141686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30fc0b59c0 msgr2=0x7f30fc0cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:46.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.585+0000 7f3103c00640 1 --2- 172.21.15.122:0/2538141686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30fc0b59c0 0x7f30fc0cdb00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009d90 tx=0x7f30f401c900 comp rx=0 tx=0).stop 2024-05-28T06:05:46.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.585+0000 7f3103c00640 1 -- 172.21.15.122:0/2538141686 shutdown_connections 2024-05-28T06:05:46.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.585+0000 7f3103c00640 1 --2- 172.21.15.122:0/2538141686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30fc0b59c0 0x7f30fc0cdb00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.585+0000 7f3103c00640 1 -- 172.21.15.122:0/2538141686 >> 172.21.15.122:0/2538141686 conn(0x7f30fc06bd90 msgr2=0x7f30fc06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:46.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.585+0000 7f3103c00640 1 -- 172.21.15.122:0/2538141686 shutdown_connections 2024-05-28T06:05:46.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f3103c00640 1 -- 172.21.15.122:0/2538141686 wait complete. 2024-05-28T06:05:46.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f3103c00640 1 Processor -- start 2024-05-28T06:05:46.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f3103c00640 1 -- start start 2024-05-28T06:05:46.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f3103c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30fc06f890 0x7f30fc150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:46.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f3103c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30fc0b59c0 0x7f30fc139d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:46.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f3103c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30fc0cff30 0x7f30fc153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:46.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f3103c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f30fc168cd0 con 0x7f30fc0cff30 2024-05-28T06:05:46.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f3103c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f30fc168b50 con 0x7f30fc06f890 2024-05-28T06:05:46.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f3103c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f30fc168e50 con 0x7f30fc0b59c0 2024-05-28T06:05:46.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f3101c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30fc0cff30 0x7f30fc153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:46.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f3101c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30fc0cff30 0x7f30fc153a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36052/0 (socket says 172.21.15.122:36052) 2024-05-28T06:05:46.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f3101c00640 1 -- 172.21.15.122:0/4017129377 learned_addr learned my addr 172.21.15.122:0/4017129377 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:46.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f3101200640 1 --2- 172.21.15.122:0/4017129377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30fc06f890 0x7f30fc150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:46.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f30fbe00640 1 --2- 172.21.15.122:0/4017129377 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30fc0b59c0 0x7f30fc139d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:46.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f3101c00640 1 -- 172.21.15.122:0/4017129377 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30fc0b59c0 msgr2=0x7f30fc139d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:46.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f3101c00640 1 --2- 172.21.15.122:0/4017129377 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30fc0b59c0 0x7f30fc139d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f3101c00640 1 -- 172.21.15.122:0/4017129377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30fc06f890 msgr2=0x7f30fc150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:46.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f3101c00640 1 --2- 172.21.15.122:0/4017129377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30fc06f890 0x7f30fc150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f3101c00640 1 -- 172.21.15.122:0/4017129377 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30fc151470 con 0x7f30fc0cff30 2024-05-28T06:05:46.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f30fbe00640 1 --2- 172.21.15.122:0/4017129377 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30fc0b59c0 0x7f30fc139d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:05:46.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f3101c00640 1 --2- 172.21.15.122:0/4017129377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30fc0cff30 0x7f30fc153a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009d90 tx=0x7f30f40196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:46.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f30f8c00640 1 -- 172.21.15.122:0/4017129377 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f40b2040 con 0x7f30fc0cff30 2024-05-28T06:05:46.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f30f8c00640 1 -- 172.21.15.122:0/4017129377 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f40ad580 con 0x7f30fc0cff30 2024-05-28T06:05:46.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f3103c00640 1 -- 172.21.15.122:0/4017129377 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30fc151750 con 0x7f30fc0cff30 2024-05-28T06:05:46.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.589+0000 7f30f8c00640 1 -- 172.21.15.122:0/4017129377 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f40ad970 con 0x7f30fc0cff30 2024-05-28T06:05:46.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.593+0000 7f3103c00640 1 -- 172.21.15.122:0/4017129377 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30fc1492b0 con 0x7f30fc0cff30 2024-05-28T06:05:46.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.593+0000 7f3103c00640 1 -- 172.21.15.122:0/4017129377 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30fc068c40 con 0x7f30fc0cff30 2024-05-28T06:05:46.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.593+0000 7f30f8c00640 1 -- 172.21.15.122:0/4017129377 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f30f40c1020 con 0x7f30fc0cff30 2024-05-28T06:05:46.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.593+0000 7f30f8c00640 1 --2- 172.21.15.122:0/4017129377 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f30dc068380 0x7f30dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:46.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.593+0000 7f30f8c00640 1 -- 172.21.15.122:0/4017129377 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f30f4121370 con 0x7f30fc0cff30 2024-05-28T06:05:46.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.593+0000 7f3101200640 1 --2- 172.21.15.122:0/4017129377 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f30dc068380 0x7f30dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:46.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.593+0000 7f3101200640 1 --2- 172.21.15.122:0/4017129377 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f30dc068380 0x7f30dc06a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f30ec000f70 tx=0x7f30ec007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:46.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.597+0000 7f30f8c00640 1 -- 172.21.15.122:0/4017129377 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f30f40c8020 con 0x7f30fc0cff30 2024-05-28T06:05:46.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.757+0000 7f3103c00640 1 -- 172.21.15.122:0/4017129377 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f30fc155f70 con 0x7f30fc0cff30 2024-05-28T06:05:46.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.757+0000 7f30f8c00640 1 -- 172.21.15.122:0/4017129377 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f30f4016520 con 0x7f30fc0cff30 2024-05-28T06:05:46.759 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:05:46.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.757+0000 7f3103c00640 1 -- 172.21.15.122:0/4017129377 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f30dc068380 msgr2=0x7f30dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:46.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.757+0000 7f3103c00640 1 --2- 172.21.15.122:0/4017129377 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f30dc068380 0x7f30dc06a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f30ec000f70 tx=0x7f30ec007c10 comp rx=0 tx=0).stop 2024-05-28T06:05:46.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.757+0000 7f3103c00640 1 -- 172.21.15.122:0/4017129377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30fc0cff30 msgr2=0x7f30fc153a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:46.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.757+0000 7f3103c00640 1 --2- 172.21.15.122:0/4017129377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30fc0cff30 0x7f30fc153a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009d90 tx=0x7f30f40196a0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.757+0000 7f3103c00640 1 -- 172.21.15.122:0/4017129377 shutdown_connections 2024-05-28T06:05:46.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.757+0000 7f3103c00640 1 --2- 172.21.15.122:0/4017129377 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f30dc068380 0x7f30dc06a840 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.757+0000 7f3103c00640 1 --2- 172.21.15.122:0/4017129377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30fc0cff30 0x7f30fc153a00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.757+0000 7f3103c00640 1 --2- 172.21.15.122:0/4017129377 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30fc0b59c0 0x7f30fc139d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.757+0000 7f3103c00640 1 --2- 172.21.15.122:0/4017129377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30fc06f890 0x7f30fc150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.757+0000 7f3103c00640 1 -- 172.21.15.122:0/4017129377 >> 172.21.15.122:0/4017129377 conn(0x7f30fc06bd90 msgr2=0x7f30fc156f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:46.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.757+0000 7f3103c00640 1 -- 172.21.15.122:0/4017129377 shutdown_connections 2024-05-28T06:05:46.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.757+0000 7f3103c00640 1 -- 172.21.15.122:0/4017129377 wait complete. 2024-05-28T06:05:46.781 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-28T06:05:46.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.913+0000 7fead9e00640 1 Processor -- start 2024-05-28T06:05:46.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.913+0000 7fead9e00640 1 -- start start 2024-05-28T06:05:46.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.913+0000 7fead9e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fead415ea50 0x7fead415ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:46.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.913+0000 7fead9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fead406dab0 0x7fead40d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:46.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.913+0000 7fead9e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fead4162510 con 0x7fead415f370 2024-05-28T06:05:46.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.917+0000 7fead9e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fead4163120 con 0x7fead415ea50 2024-05-28T06:05:46.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.917+0000 7fead9e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fead41627f0 con 0x7fead406dab0 2024-05-28T06:05:46.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.917+0000 7fead2a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fead415ea50 0x7fead415ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:46.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.917+0000 7fead3400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fead406dab0 0x7fead40d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:46.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.917+0000 7fead2000640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fead415f370 0x7fead415f790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:44822/0 (socket says 172.21.15.122:44822) 2024-05-28T06:05:46.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.917+0000 7fead2a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fead415ea50 0x7fead415ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:44876/0 (socket says 172.21.15.122:44876) 2024-05-28T06:05:46.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.917+0000 7fead2000640 1 -- 172.21.15.122:0/1196043096 learned_addr learned my addr 172.21.15.122:0/1196043096 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:46.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.917+0000 7fead1600640 1 -- 172.21.15.122:0/1196043096 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3999748330 0 0) 0x7fead4162510 con 0x7fead415f370 2024-05-28T06:05:46.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.917+0000 7fead3400640 1 -- 172.21.15.122:0/1196043096 >> v2:172.21.15.153:3300/0 conn(0x7fead415ea50 msgr2=0x7fead415ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:46.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.917+0000 7fead3400640 1 --2- 172.21.15.122:0/1196043096 >> v2:172.21.15.153:3300/0 conn(0x7fead415ea50 0x7fead415ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.917+0000 7fead3400640 1 -- 172.21.15.122:0/1196043096 >> v1:172.21.15.153:6789/0 conn(0x7fead415f370 legacy=0x7fead415f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:46.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.917+0000 7fead3400640 1 -- 172.21.15.122:0/1196043096 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead4162ad0 con 0x7fead406dab0 2024-05-28T06:05:46.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.917+0000 7fead2a00640 1 --2- 172.21.15.122:0/1196043096 >> v2:172.21.15.153:3300/0 conn(0x7fead415ea50 0x7fead415ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:05:46.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.917+0000 7fead3400640 1 --2- 172.21.15.122:0/1196043096 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fead406dab0 0x7fead40d08e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feacc0097c0 tx=0x7feacc01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6d1743ec70b440d server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:46.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.921+0000 7fead1600640 1 -- 172.21.15.122:0/1196043096 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feacc0b2070 con 0x7fead406dab0 2024-05-28T06:05:46.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.921+0000 7fead1600640 1 -- 172.21.15.122:0/1196043096 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feacc0ad640 con 0x7fead406dab0 2024-05-28T06:05:46.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.921+0000 7fead1600640 1 -- 172.21.15.122:0/1196043096 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feacc0ada10 con 0x7fead406dab0 2024-05-28T06:05:46.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.921+0000 7fead9e00640 1 -- 172.21.15.122:0/1196043096 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fead406dab0 msgr2=0x7fead40d08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:46.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.921+0000 7fead9e00640 1 --2- 172.21.15.122:0/1196043096 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fead406dab0 0x7fead40d08e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feacc0097c0 tx=0x7feacc01c470 comp rx=0 tx=0).stop 2024-05-28T06:05:46.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.921+0000 7fead9e00640 1 -- 172.21.15.122:0/1196043096 shutdown_connections 2024-05-28T06:05:46.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.921+0000 7fead9e00640 1 --2- 172.21.15.122:0/1196043096 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fead406dab0 0x7fead40d08e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.921+0000 7fead9e00640 1 --2- 172.21.15.122:0/1196043096 >> v2:172.21.15.153:3300/0 conn(0x7fead415ea50 0x7fead415ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.921+0000 7fead9e00640 1 -- 172.21.15.122:0/1196043096 >> 172.21.15.122:0/1196043096 conn(0x7fead40b4190 msgr2=0x7fead40b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:46.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.921+0000 7fead9e00640 1 -- 172.21.15.122:0/1196043096 shutdown_connections 2024-05-28T06:05:46.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.921+0000 7fead9e00640 1 -- 172.21.15.122:0/1196043096 wait complete. 2024-05-28T06:05:46.929 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.921+0000 7fead9e00640 1 Processor -- start 2024-05-28T06:05:46.929 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.921+0000 7fead9e00640 1 -- start start 2024-05-28T06:05:46.930 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.921+0000 7fead9e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fead406dab0 0x7fead41f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:46.930 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.921+0000 7fead9e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fead415ea50 0x7fead415be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:46.930 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.921+0000 7fead9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fead415f370 0x7fead40b7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:46.930 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.921+0000 7fead9e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fead40d19c0 con 0x7fead406dab0 2024-05-28T06:05:46.930 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.921+0000 7fead9e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fead40d1840 con 0x7fead415ea50 2024-05-28T06:05:46.930 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.921+0000 7fead9e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fead40d1b40 con 0x7fead415f370 2024-05-28T06:05:46.930 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.921+0000 7fead2a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fead406dab0 0x7fead41f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:46.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.921+0000 7fead2a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fead406dab0 0x7fead41f89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36066/0 (socket says 172.21.15.122:36066) 2024-05-28T06:05:46.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.921+0000 7fead2a00640 1 -- 172.21.15.122:0/2435672618 learned_addr learned my addr 172.21.15.122:0/2435672618 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:46.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.921+0000 7fead2000640 1 --2- 172.21.15.122:0/2435672618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fead415ea50 0x7fead415be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:46.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.925+0000 7fead3400640 1 --2- 172.21.15.122:0/2435672618 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fead415f370 0x7fead40b7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:46.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.925+0000 7fead2a00640 1 -- 172.21.15.122:0/2435672618 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fead415f370 msgr2=0x7fead40b7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:46.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.925+0000 7fead2a00640 1 --2- 172.21.15.122:0/2435672618 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fead415f370 0x7fead40b7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.925+0000 7fead2a00640 1 -- 172.21.15.122:0/2435672618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fead415ea50 msgr2=0x7fead415be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:46.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.925+0000 7fead2a00640 1 --2- 172.21.15.122:0/2435672618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fead415ea50 0x7fead415be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:46.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.925+0000 7fead2a00640 1 -- 172.21.15.122:0/2435672618 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead409b3e0 con 0x7fead406dab0 2024-05-28T06:05:46.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.925+0000 7fead2a00640 1 --2- 172.21.15.122:0/2435672618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fead406dab0 0x7fead41f89d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feac400efc0 tx=0x7feac400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:46.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.925+0000 7feacb400640 1 -- 172.21.15.122:0/2435672618 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac4018020 con 0x7fead406dab0 2024-05-28T06:05:46.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.925+0000 7feacb400640 1 -- 172.21.15.122:0/2435672618 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feac4014680 con 0x7fead406dab0 2024-05-28T06:05:46.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.925+0000 7fead9e00640 1 -- 172.21.15.122:0/2435672618 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fead415c390 con 0x7fead406dab0 2024-05-28T06:05:46.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.925+0000 7feacb400640 1 -- 172.21.15.122:0/2435672618 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac4014a50 con 0x7fead406dab0 2024-05-28T06:05:46.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.925+0000 7fead9e00640 1 -- 172.21.15.122:0/2435672618 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fead41f81d0 con 0x7fead406dab0 2024-05-28T06:05:46.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.925+0000 7fead9e00640 1 -- 172.21.15.122:0/2435672618 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fead4068c40 con 0x7fead406dab0 2024-05-28T06:05:46.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.925+0000 7feacb400640 1 -- 172.21.15.122:0/2435672618 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feac401b020 con 0x7fead406dab0 2024-05-28T06:05:46.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.929+0000 7feacb400640 1 --2- 172.21.15.122:0/2435672618 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feab4068380 0x7feab406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:46.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.929+0000 7feacb400640 1 -- 172.21.15.122:0/2435672618 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7feac4087400 con 0x7fead406dab0 2024-05-28T06:05:46.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.929+0000 7fead2000640 1 --2- 172.21.15.122:0/2435672618 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feab4068380 0x7feab406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:46.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.929+0000 7fead2000640 1 --2- 172.21.15.122:0/2435672618 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feab4068380 0x7feab406a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fead409bb70 tx=0x7feac0007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:46.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:46.933+0000 7feacb400640 1 -- 172.21.15.122:0/2435672618 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feac4022030 con 0x7fead406dab0 2024-05-28T06:05:47.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.089+0000 7fead9e00640 1 -- 172.21.15.122:0/2435672618 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fead40758a0 con 0x7fead406dab0 2024-05-28T06:05:47.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.089+0000 7feacb400640 1 -- 172.21.15.122:0/2435672618 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7feac4010040 con 0x7fead406dab0 2024-05-28T06:05:47.092 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:05:47.092 INFO:teuthology.orchestra.run.smithi122.stdout:[ 2024-05-28T06:05:47.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:05:47.092 INFO:teuthology.orchestra.run.smithi122.stdout: "poolnum": 1, 2024-05-28T06:05:47.092 INFO:teuthology.orchestra.run.smithi122.stdout: "poolname": ".mgr" 2024-05-28T06:05:47.092 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:05:47.092 INFO:teuthology.orchestra.run.smithi122.stdout:] 2024-05-28T06:05:47.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.089+0000 7fead9e00640 1 -- 172.21.15.122:0/2435672618 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feab4068380 msgr2=0x7feab406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:47.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.089+0000 7fead9e00640 1 --2- 172.21.15.122:0/2435672618 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feab4068380 0x7feab406a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fead409bb70 tx=0x7feac0007c10 comp rx=0 tx=0).stop 2024-05-28T06:05:47.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.089+0000 7fead9e00640 1 -- 172.21.15.122:0/2435672618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fead406dab0 msgr2=0x7fead41f89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:47.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.089+0000 7fead9e00640 1 --2- 172.21.15.122:0/2435672618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fead406dab0 0x7fead41f89d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feac400efc0 tx=0x7feac400c490 comp rx=0 tx=0).stop 2024-05-28T06:05:47.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.089+0000 7fead9e00640 1 -- 172.21.15.122:0/2435672618 shutdown_connections 2024-05-28T06:05:47.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.089+0000 7fead9e00640 1 --2- 172.21.15.122:0/2435672618 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feab4068380 0x7feab406a840 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:47.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.089+0000 7fead9e00640 1 --2- 172.21.15.122:0/2435672618 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fead415f370 0x7fead40b7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:47.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.089+0000 7fead9e00640 1 --2- 172.21.15.122:0/2435672618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fead415ea50 0x7fead415be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:47.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.089+0000 7fead9e00640 1 --2- 172.21.15.122:0/2435672618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fead406dab0 0x7fead41f89d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:47.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.089+0000 7fead9e00640 1 -- 172.21.15.122:0/2435672618 >> 172.21.15.122:0/2435672618 conn(0x7fead40b4190 msgr2=0x7fead4161cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:47.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.089+0000 7fead9e00640 1 -- 172.21.15.122:0/2435672618 shutdown_connections 2024-05-28T06:05:47.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.089+0000 7fead9e00640 1 -- 172.21.15.122:0/2435672618 wait complete. 2024-05-28T06:05:47.113 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-28T06:05:47.113 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-28T06:05:47.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.249+0000 7f12a9200640 1 Processor -- start 2024-05-28T06:05:47.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.253+0000 7f12a9200640 1 -- start start 2024-05-28T06:05:47.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.253+0000 7f12a9200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12a406f890 0x7f12a40cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:47.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.253+0000 7f12a9200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f12a40cd930 0x7f12a40b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:47.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.253+0000 7f12a9200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a40d0310 con 0x7f12a40cff30 2024-05-28T06:05:47.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.253+0000 7f12a9200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f12a415be20 con 0x7f12a40cd930 2024-05-28T06:05:47.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.253+0000 7f12a9200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f12a415c100 con 0x7f12a406f890 2024-05-28T06:05:47.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.253+0000 7f12a2800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f12a40cd930 0x7f12a40b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:47.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.253+0000 7f12a2800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f12a40cd930 0x7f12a40b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36078/0 (socket says 172.21.15.122:36078) 2024-05-28T06:05:47.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.253+0000 7f12a2800640 1 -- 172.21.15.122:0/550448048 learned_addr learned my addr 172.21.15.122:0/550448048 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:47.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.253+0000 7f12a1400640 1 --2- 172.21.15.122:0/550448048 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12a406f890 0x7f12a40cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:47.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.253+0000 7f12a2800640 1 -- 172.21.15.122:0/550448048 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12a406f890 msgr2=0x7f12a40cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:47.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.253+0000 7f12a2800640 1 --2- 172.21.15.122:0/550448048 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12a406f890 0x7f12a40cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:47.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.253+0000 7f12a2800640 1 -- 172.21.15.122:0/550448048 >> v1:172.21.15.153:6789/0 conn(0x7f12a40cff30 legacy=0x7f12a406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:47.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.253+0000 7f12a2800640 1 -- 172.21.15.122:0/550448048 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a415c3e0 con 0x7f12a40cd930 2024-05-28T06:05:47.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.253+0000 7f12a1400640 1 --2- 172.21.15.122:0/550448048 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12a406f890 0x7f12a40cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:05:47.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.257+0000 7f12a2800640 1 --2- 172.21.15.122:0/550448048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12a40cd930 0x7f12a40b49b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f12a40b3b00 tx=0x7f129c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13bb4ecb8d773f37 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:47.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.257+0000 7f12a0a00640 1 -- 172.21.15.122:0/550448048 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c0a57a0 con 0x7f12a40cd930 2024-05-28T06:05:47.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.257+0000 7f12a0a00640 1 -- 172.21.15.122:0/550448048 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f129c0a5940 con 0x7f12a40cd930 2024-05-28T06:05:47.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.257+0000 7f12a0a00640 1 -- 172.21.15.122:0/550448048 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c0a5d10 con 0x7f12a40cd930 2024-05-28T06:05:47.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.257+0000 7f12a9200640 1 -- 172.21.15.122:0/550448048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12a40cd930 msgr2=0x7f12a40b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:47.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.257+0000 7f12a9200640 1 --2- 172.21.15.122:0/550448048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12a40cd930 0x7f12a40b49b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f12a40b3b00 tx=0x7f129c01c980 comp rx=0 tx=0).stop 2024-05-28T06:05:47.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.257+0000 7f12a9200640 1 -- 172.21.15.122:0/550448048 shutdown_connections 2024-05-28T06:05:47.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.257+0000 7f12a9200640 1 --2- 172.21.15.122:0/550448048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12a40cd930 0x7f12a40b49b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:47.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.257+0000 7f12a9200640 1 --2- 172.21.15.122:0/550448048 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12a406f890 0x7f12a40cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:47.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.257+0000 7f12a9200640 1 -- 172.21.15.122:0/550448048 >> 172.21.15.122:0/550448048 conn(0x7f12a406bd90 msgr2=0x7f12a406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:47.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.257+0000 7f12a9200640 1 -- 172.21.15.122:0/550448048 shutdown_connections 2024-05-28T06:05:47.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.257+0000 7f12a9200640 1 -- 172.21.15.122:0/550448048 wait complete. 2024-05-28T06:05:47.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.257+0000 7f12a9200640 1 Processor -- start 2024-05-28T06:05:47.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.257+0000 7f12a9200640 1 -- start start 2024-05-28T06:05:47.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f12a9200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a406f890 0x7f12a40b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:47.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f12a9200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12a40cd930 0x7f12a415e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:47.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f12a9200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12a40cff30 0x7f12a4153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:47.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f12a9200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f12a40b5880 con 0x7f12a40cff30 2024-05-28T06:05:47.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f12a9200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f12a40b5700 con 0x7f12a406f890 2024-05-28T06:05:47.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f12a9200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f12a40b5a00 con 0x7f12a40cd930 2024-05-28T06:05:47.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f12a2800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12a40cff30 0x7f12a4153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:47.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f12a2800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12a40cff30 0x7f12a4153b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36080/0 (socket says 172.21.15.122:36080) 2024-05-28T06:05:47.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f12a2800640 1 -- 172.21.15.122:0/224656639 learned_addr learned my addr 172.21.15.122:0/224656639 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:47.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f12a1400640 1 --2- 172.21.15.122:0/224656639 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12a40cd930 0x7f12a415e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:47.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f12a1e00640 1 --2- 172.21.15.122:0/224656639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a406f890 0x7f12a40b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:47.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f12a2800640 1 -- 172.21.15.122:0/224656639 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12a40cd930 msgr2=0x7f12a415e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:47.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f12a2800640 1 --2- 172.21.15.122:0/224656639 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12a40cd930 0x7f12a415e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:47.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f12a2800640 1 -- 172.21.15.122:0/224656639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a406f890 msgr2=0x7f12a40b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:47.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f12a2800640 1 --2- 172.21.15.122:0/224656639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a406f890 0x7f12a40b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:47.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f12a2800640 1 -- 172.21.15.122:0/224656639 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a40b1470 con 0x7f12a40cff30 2024-05-28T06:05:47.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f12a1e00640 1 --2- 172.21.15.122:0/224656639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a406f890 0x7f12a40b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:05:47.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f12a1400640 1 --2- 172.21.15.122:0/224656639 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12a40cd930 0x7f12a415e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:05:47.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f12a2800640 1 --2- 172.21.15.122:0/224656639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12a40cff30 0x7f12a4153b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f129c01b030 tx=0x7f129c019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:47.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f129a000640 1 -- 172.21.15.122:0/224656639 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c0bc020 con 0x7f12a40cff30 2024-05-28T06:05:47.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f129a000640 1 -- 172.21.15.122:0/224656639 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f129c0b86b0 con 0x7f12a40cff30 2024-05-28T06:05:47.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f12a9200640 1 -- 172.21.15.122:0/224656639 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a40b2f00 con 0x7f12a40cff30 2024-05-28T06:05:47.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f129a000640 1 -- 172.21.15.122:0/224656639 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c0b8aa0 con 0x7f12a40cff30 2024-05-28T06:05:47.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f12a9200640 1 -- 172.21.15.122:0/224656639 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a40b1a10 con 0x7f12a40cff30 2024-05-28T06:05:47.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f12a9200640 1 -- 172.21.15.122:0/224656639 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12a4068c40 con 0x7f12a40cff30 2024-05-28T06:05:47.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.261+0000 7f129a000640 1 -- 172.21.15.122:0/224656639 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f129c0bf020 con 0x7f12a40cff30 2024-05-28T06:05:47.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.265+0000 7f129a000640 1 --2- 172.21.15.122:0/224656639 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1284068380 0x7f128406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:47.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.265+0000 7f129a000640 1 -- 172.21.15.122:0/224656639 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f129c121760 con 0x7f12a40cff30 2024-05-28T06:05:47.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.265+0000 7f12a1e00640 1 --2- 172.21.15.122:0/224656639 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1284068380 0x7f128406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:47.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.265+0000 7f12a1e00640 1 --2- 172.21.15.122:0/224656639 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1284068380 0x7f128406a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f12940098b0 tx=0x7f1294008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:47.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.269+0000 7f129a000640 1 -- 172.21.15.122:0/224656639 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f129c0165a0 con 0x7f12a40cff30 2024-05-28T06:05:47.394 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:05:47.403 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:05:47.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.429+0000 7f12a9200640 1 -- 172.21.15.122:0/224656639 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f12a4155f70 con 0x7f12a40cff30 2024-05-28T06:05:47.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.789+0000 7f129a000640 1 -- 172.21.15.122:0/224656639 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f129c0f2060 con 0x7f12a40cff30 2024-05-28T06:05:47.792 INFO:teuthology.orchestra.run.smithi122.stderr:pool 'cephfs_metadata' created 2024-05-28T06:05:47.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.793+0000 7f12a9200640 1 -- 172.21.15.122:0/224656639 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1284068380 msgr2=0x7f128406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:47.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.793+0000 7f12a9200640 1 --2- 172.21.15.122:0/224656639 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1284068380 0x7f128406a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f12940098b0 tx=0x7f1294008040 comp rx=0 tx=0).stop 2024-05-28T06:05:47.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.793+0000 7f12a9200640 1 -- 172.21.15.122:0/224656639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12a40cff30 msgr2=0x7f12a4153b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:47.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.793+0000 7f12a9200640 1 --2- 172.21.15.122:0/224656639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12a40cff30 0x7f12a4153b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f129c01b030 tx=0x7f129c019720 comp rx=0 tx=0).stop 2024-05-28T06:05:47.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.793+0000 7f12a9200640 1 -- 172.21.15.122:0/224656639 shutdown_connections 2024-05-28T06:05:47.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.793+0000 7f12a9200640 1 --2- 172.21.15.122:0/224656639 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1284068380 0x7f128406a840 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:47.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.793+0000 7f12a9200640 1 --2- 172.21.15.122:0/224656639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12a40cff30 0x7f12a4153b50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:47.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.793+0000 7f12a9200640 1 --2- 172.21.15.122:0/224656639 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12a40cd930 0x7f12a415e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:47.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.793+0000 7f12a9200640 1 --2- 172.21.15.122:0/224656639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a406f890 0x7f12a40b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:47.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.793+0000 7f12a9200640 1 -- 172.21.15.122:0/224656639 >> 172.21.15.122:0/224656639 conn(0x7f12a406bd90 msgr2=0x7f12a406f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:47.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.793+0000 7f12a9200640 1 -- 172.21.15.122:0/224656639 shutdown_connections 2024-05-28T06:05:47.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.793+0000 7f12a9200640 1 -- 172.21.15.122:0/224656639 wait complete. 2024-05-28T06:05:47.820 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-28T06:05:47.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.961+0000 7fa29de00640 1 Processor -- start 2024-05-28T06:05:47.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.961+0000 7fa29de00640 1 -- start start 2024-05-28T06:05:47.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.961+0000 7fa29de00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa2980cff30 0x7fa29806f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:47.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.961+0000 7fa29de00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2980cdf00 con 0x7fa29806f6c0 2024-05-28T06:05:47.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.961+0000 7fa29de00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2980d0310 con 0x7fa2980cdb00 2024-05-28T06:05:47.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.961+0000 7fa29de00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fa29806fb30 con 0x7fa2980cff30 2024-05-28T06:05:47.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.961+0000 7fa296a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa2980cff30 0x7fa29806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:47.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.961+0000 7fa296000640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fa29806f6c0 0x7fa2980cd3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56198/0 (socket says 172.21.15.122:56198) 2024-05-28T06:05:47.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.961+0000 7fa296000640 1 -- 172.21.15.122:0/1991026458 learned_addr learned my addr 172.21.15.122:0/1991026458 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:47.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.965+0000 7fa296a00640 1 -- 172.21.15.122:0/1991026458 >> v1:172.21.15.153:6789/0 conn(0x7fa2980cdb00 legacy=0x7fa2980b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:47.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.965+0000 7fa296a00640 1 -- 172.21.15.122:0/1991026458 >> v1:172.21.15.122:6789/0 conn(0x7fa29806f6c0 legacy=0x7fa2980cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:47.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.965+0000 7fa296a00640 1 -- 172.21.15.122:0/1991026458 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29815be20 con 0x7fa2980cff30 2024-05-28T06:05:47.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.965+0000 7fa296a00640 1 --2- 172.21.15.122:0/1991026458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2980cff30 0x7fa29806f180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa2880097c0 tx=0x7fa28801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d7d381c1a2156b server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:47.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.965+0000 7fa295600640 1 -- 172.21.15.122:0/1991026458 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2880ab430 con 0x7fa2980cff30 2024-05-28T06:05:47.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.965+0000 7fa295600640 1 -- 172.21.15.122:0/1991026458 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2880b0070 con 0x7fa2980cff30 2024-05-28T06:05:47.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.965+0000 7fa295600640 1 -- 172.21.15.122:0/1991026458 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2880ab7f0 con 0x7fa2980cff30 2024-05-28T06:05:47.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.965+0000 7fa29de00640 1 -- 172.21.15.122:0/1991026458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2980cff30 msgr2=0x7fa29806f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:47.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.965+0000 7fa29de00640 1 --2- 172.21.15.122:0/1991026458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2980cff30 0x7fa29806f180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa2880097c0 tx=0x7fa28801c430 comp rx=0 tx=0).stop 2024-05-28T06:05:47.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.965+0000 7fa29de00640 1 -- 172.21.15.122:0/1991026458 shutdown_connections 2024-05-28T06:05:47.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.965+0000 7fa29de00640 1 --2- 172.21.15.122:0/1991026458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2980cff30 0x7fa29806f180 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:47.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.965+0000 7fa29de00640 1 -- 172.21.15.122:0/1991026458 >> 172.21.15.122:0/1991026458 conn(0x7fa29806bd90 msgr2=0x7fa29806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:47.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.965+0000 7fa29de00640 1 -- 172.21.15.122:0/1991026458 shutdown_connections 2024-05-28T06:05:47.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.965+0000 7fa29de00640 1 -- 172.21.15.122:0/1991026458 wait complete. 2024-05-28T06:05:47.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa29de00640 1 Processor -- start 2024-05-28T06:05:47.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa29de00640 1 -- start start 2024-05-28T06:05:47.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa29de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa29806f6c0 0x7fa298157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:47.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa29de00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2980cdb00 0x7fa29815a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:47.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa29de00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2980cff30 0x7fa29814d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:47.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa29de00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa2980b58d0 con 0x7fa29806f6c0 2024-05-28T06:05:47.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa29de00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa29815baf0 con 0x7fa2980cff30 2024-05-28T06:05:47.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa29de00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa2980b5a50 con 0x7fa2980cdb00 2024-05-28T06:05:47.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa296a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa29806f6c0 0x7fa298157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:47.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa296a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa29806f6c0 0x7fa298157670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36100/0 (socket says 172.21.15.122:36100) 2024-05-28T06:05:47.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa296a00640 1 -- 172.21.15.122:0/62512874 learned_addr learned my addr 172.21.15.122:0/62512874 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:47.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa296000640 1 --2- 172.21.15.122:0/62512874 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2980cdb00 0x7fa29815a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:47.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa297400640 1 --2- 172.21.15.122:0/62512874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2980cff30 0x7fa29814d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:47.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa296a00640 1 -- 172.21.15.122:0/62512874 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2980cdb00 msgr2=0x7fa29815a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:47.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa296a00640 1 --2- 172.21.15.122:0/62512874 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2980cdb00 0x7fa29815a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:47.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa296a00640 1 -- 172.21.15.122:0/62512874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2980cff30 msgr2=0x7fa29814d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:47.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa296a00640 1 --2- 172.21.15.122:0/62512874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2980cff30 0x7fa29814d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:47.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa296a00640 1 -- 172.21.15.122:0/62512874 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29815b230 con 0x7fa29806f6c0 2024-05-28T06:05:47.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa296a00640 1 --2- 172.21.15.122:0/62512874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa29806f6c0 0x7fa298157670 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa2880ad040 tx=0x7fa28801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:47.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa28f400640 1 -- 172.21.15.122:0/62512874 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2880bf610 con 0x7fa29806f6c0 2024-05-28T06:05:47.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa28f400640 1 -- 172.21.15.122:0/62512874 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2880bf7d0 con 0x7fa29806f6c0 2024-05-28T06:05:47.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa28f400640 1 -- 172.21.15.122:0/62512874 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2880bfbc0 con 0x7fa29806f6c0 2024-05-28T06:05:47.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa29de00640 1 -- 172.21.15.122:0/62512874 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa29815b510 con 0x7fa29806f6c0 2024-05-28T06:05:47.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.969+0000 7fa29de00640 1 -- 172.21.15.122:0/62512874 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa29815ae40 con 0x7fa29806f6c0 2024-05-28T06:05:47.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.973+0000 7fa29de00640 1 -- 172.21.15.122:0/62512874 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa298068c40 con 0x7fa29806f6c0 2024-05-28T06:05:47.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.973+0000 7fa28f400640 1 -- 172.21.15.122:0/62512874 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa2880bd020 con 0x7fa29806f6c0 2024-05-28T06:05:47.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.973+0000 7fa28f400640 1 --2- 172.21.15.122:0/62512874 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa278068380 0x7fa27806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:47.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.973+0000 7fa28f400640 1 -- 172.21.15.122:0/62512874 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7fa2880a8020 con 0x7fa29806f6c0 2024-05-28T06:05:47.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.973+0000 7fa296000640 1 --2- 172.21.15.122:0/62512874 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa278068380 0x7fa27806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:47.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.973+0000 7fa296000640 1 --2- 172.21.15.122:0/62512874 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa278068380 0x7fa27806a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa29806ecf0 tx=0x7fa284009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:47.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:47.977+0000 7fa28f400640 1 -- 172.21.15.122:0/62512874 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa288016050 con 0x7fa29806f6c0 2024-05-28T06:05:48.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.133+0000 7fa29de00640 1 -- 172.21.15.122:0/62512874 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa29815b6e0 con 0x7fa29806f6c0 2024-05-28T06:05:48.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.793+0000 7fa28f400640 1 -- 172.21.15.122:0/62512874 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7fa2880f1650 con 0x7fa29806f6c0 2024-05-28T06:05:48.796 INFO:teuthology.orchestra.run.smithi122.stderr:pool 'cephfs_data' created 2024-05-28T06:05:48.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.797+0000 7fa29de00640 1 -- 172.21.15.122:0/62512874 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa278068380 msgr2=0x7fa27806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:48.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.797+0000 7fa29de00640 1 --2- 172.21.15.122:0/62512874 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa278068380 0x7fa27806a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa29806ecf0 tx=0x7fa284009040 comp rx=0 tx=0).stop 2024-05-28T06:05:48.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.797+0000 7fa29de00640 1 -- 172.21.15.122:0/62512874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa29806f6c0 msgr2=0x7fa298157670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:48.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.797+0000 7fa29de00640 1 --2- 172.21.15.122:0/62512874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa29806f6c0 0x7fa298157670 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa2880ad040 tx=0x7fa28801ac70 comp rx=0 tx=0).stop 2024-05-28T06:05:48.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.797+0000 7fa29de00640 1 -- 172.21.15.122:0/62512874 shutdown_connections 2024-05-28T06:05:48.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.797+0000 7fa29de00640 1 --2- 172.21.15.122:0/62512874 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa278068380 0x7fa27806a840 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:48.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.797+0000 7fa29de00640 1 --2- 172.21.15.122:0/62512874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2980cff30 0x7fa29814d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:48.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.797+0000 7fa29de00640 1 --2- 172.21.15.122:0/62512874 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2980cdb00 0x7fa29815a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:48.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.797+0000 7fa29de00640 1 --2- 172.21.15.122:0/62512874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa29806f6c0 0x7fa298157670 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:48.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.797+0000 7fa29de00640 1 -- 172.21.15.122:0/62512874 >> 172.21.15.122:0/62512874 conn(0x7fa29806bd90 msgr2=0x7fa2981588d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:48.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.797+0000 7fa29de00640 1 -- 172.21.15.122:0/62512874 shutdown_connections 2024-05-28T06:05:48.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.797+0000 7fa29de00640 1 -- 172.21.15.122:0/62512874 wait complete. 2024-05-28T06:05:48.840 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-28T06:05:48.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.977+0000 7fa3dce00640 1 Processor -- start 2024-05-28T06:05:48.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.977+0000 7fa3dce00640 1 -- start start 2024-05-28T06:05:48.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.981+0000 7fa3dce00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa3d806f890 0x7fa3d80cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:48.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.981+0000 7fa3dce00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3d80cd930 0x7fa3d80b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:48.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.981+0000 7fa3dce00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3d80d0310 con 0x7fa3d80cff30 2024-05-28T06:05:48.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.981+0000 7fa3dce00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fa3d815be20 con 0x7fa3d806f890 2024-05-28T06:05:48.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.981+0000 7fa3dce00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d815c100 con 0x7fa3d80cd930 2024-05-28T06:05:48.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.981+0000 7fa3cd400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa3d806f890 0x7fa3d80cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:48.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.981+0000 7fa3d5e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fa3d80cff30 0x7fa3d806f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56210/0 (socket says 172.21.15.122:56210) 2024-05-28T06:05:48.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.981+0000 7fa3cd400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa3d806f890 0x7fa3d80cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36116/0 (socket says 172.21.15.122:36116) 2024-05-28T06:05:48.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.981+0000 7fa3d5e00640 1 -- 172.21.15.122:0/2504875108 learned_addr learned my addr 172.21.15.122:0/2504875108 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:48.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.981+0000 7fa3d6800640 1 --2- 172.21.15.122:0/2504875108 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3d80cd930 0x7fa3d80b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:48.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.981+0000 7fa3cd400640 1 -- 172.21.15.122:0/2504875108 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3d80cd930 msgr2=0x7fa3d80b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:48.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.981+0000 7fa3cd400640 1 --2- 172.21.15.122:0/2504875108 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3d80cd930 0x7fa3d80b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:48.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.981+0000 7fa3cd400640 1 -- 172.21.15.122:0/2504875108 >> v1:172.21.15.122:6789/0 conn(0x7fa3d80cff30 legacy=0x7fa3d806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:48.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.981+0000 7fa3cd400640 1 -- 172.21.15.122:0/2504875108 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d815c3e0 con 0x7fa3d806f890 2024-05-28T06:05:48.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.981+0000 7fa3d5400640 1 -- 172.21.15.122:0/2504875108 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3898288569 0 0) 0x7fa3d80d0310 con 0x7fa3d80cff30 2024-05-28T06:05:48.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.985+0000 7fa3cd400640 1 --2- 172.21.15.122:0/2504875108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3d806f890 0x7fa3d80cd3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009d90 tx=0x7fa3c001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db5f412727e37d6e server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:48.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.985+0000 7fa3d5400640 1 -- 172.21.15.122:0/2504875108 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c00b2070 con 0x7fa3d806f890 2024-05-28T06:05:48.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.985+0000 7fa3d5400640 1 -- 172.21.15.122:0/2504875108 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c00a59a0 con 0x7fa3d806f890 2024-05-28T06:05:48.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.985+0000 7fa3d5400640 1 -- 172.21.15.122:0/2504875108 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c00a5d70 con 0x7fa3d806f890 2024-05-28T06:05:48.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.985+0000 7fa3dce00640 1 -- 172.21.15.122:0/2504875108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3d806f890 msgr2=0x7fa3d80cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:48.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.985+0000 7fa3dce00640 1 --2- 172.21.15.122:0/2504875108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3d806f890 0x7fa3d80cd3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009d90 tx=0x7fa3c001c940 comp rx=0 tx=0).stop 2024-05-28T06:05:48.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.985+0000 7fa3dce00640 1 -- 172.21.15.122:0/2504875108 shutdown_connections 2024-05-28T06:05:48.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.985+0000 7fa3dce00640 1 --2- 172.21.15.122:0/2504875108 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3d80cd930 0x7fa3d80b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:48.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.985+0000 7fa3dce00640 1 --2- 172.21.15.122:0/2504875108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3d806f890 0x7fa3d80cd3f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:48.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.985+0000 7fa3dce00640 1 -- 172.21.15.122:0/2504875108 >> 172.21.15.122:0/2504875108 conn(0x7fa3d806bd90 msgr2=0x7fa3d806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:48.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.985+0000 7fa3dce00640 1 -- 172.21.15.122:0/2504875108 shutdown_connections 2024-05-28T06:05:48.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.985+0000 7fa3dce00640 1 -- 172.21.15.122:0/2504875108 wait complete. 2024-05-28T06:05:48.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.985+0000 7fa3dce00640 1 Processor -- start 2024-05-28T06:05:48.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.985+0000 7fa3dce00640 1 -- start start 2024-05-28T06:05:48.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.985+0000 7fa3dce00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3d806f890 0x7fa3d814ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:48.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.985+0000 7fa3dce00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3d80cd930 0x7fa3d8149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:48.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.985+0000 7fa3dce00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3d80cff30 0x7fa3d8150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:48.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.985+0000 7fa3dce00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d80b5700 con 0x7fa3d80cff30 2024-05-28T06:05:48.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.985+0000 7fa3dce00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d80b5880 con 0x7fa3d80cd930 2024-05-28T06:05:48.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.985+0000 7fa3dce00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d80b5a00 con 0x7fa3d806f890 2024-05-28T06:05:48.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.989+0000 7fa3d6800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3d80cff30 0x7fa3d8150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:48.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.989+0000 7fa3d6800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3d80cff30 0x7fa3d8150a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36132/0 (socket says 172.21.15.122:36132) 2024-05-28T06:05:48.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.989+0000 7fa3d6800640 1 -- 172.21.15.122:0/3805003194 learned_addr learned my addr 172.21.15.122:0/3805003194 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:48.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.989+0000 7fa3cd400640 1 --2- 172.21.15.122:0/3805003194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3d80cd930 0x7fa3d8149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:48.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.989+0000 7fa3d5e00640 1 --2- 172.21.15.122:0/3805003194 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3d806f890 0x7fa3d814ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:48.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.989+0000 7fa3d6800640 1 -- 172.21.15.122:0/3805003194 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3d806f890 msgr2=0x7fa3d814ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.989+0000 7fa3d6800640 1 --2- 172.21.15.122:0/3805003194 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3d806f890 0x7fa3d814ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.989+0000 7fa3d6800640 1 -- 172.21.15.122:0/3805003194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3d80cd930 msgr2=0x7fa3d8149be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.989+0000 7fa3d6800640 1 --2- 172.21.15.122:0/3805003194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3d80cd930 0x7fa3d8149be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.989+0000 7fa3d6800640 1 -- 172.21.15.122:0/3805003194 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d814a780 con 0x7fa3d80cff30 2024-05-28T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.989+0000 7fa3cd400640 1 --2- 172.21.15.122:0/3805003194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3d80cd930 0x7fa3d8149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.989+0000 7fa3d6800640 1 --2- 172.21.15.122:0/3805003194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3d80cff30 0x7fa3d8150a70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa3d000d800 tx=0x7fa3d000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.989+0000 7fa3cea00640 1 -- 172.21.15.122:0/3805003194 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d000b6c0 con 0x7fa3d80cff30 2024-05-28T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.989+0000 7fa3cea00640 1 -- 172.21.15.122:0/3805003194 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d0019070 con 0x7fa3d80cff30 2024-05-28T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.989+0000 7fa3cea00640 1 -- 172.21.15.122:0/3805003194 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d000baa0 con 0x7fa3d80cff30 2024-05-28T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.989+0000 7fa3dce00640 1 -- 172.21.15.122:0/3805003194 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d814ec60 con 0x7fa3d80cff30 2024-05-28T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.989+0000 7fa3dce00640 1 -- 172.21.15.122:0/3805003194 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d814f720 con 0x7fa3d80cff30 2024-05-28T06:05:48.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.989+0000 7fa3dce00640 1 -- 172.21.15.122:0/3805003194 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d8068c40 con 0x7fa3d80cff30 2024-05-28T06:05:48.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.989+0000 7fa3cea00640 1 -- 172.21.15.122:0/3805003194 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa3d000bc40 con 0x7fa3d80cff30 2024-05-28T06:05:48.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.993+0000 7fa3cea00640 1 --2- 172.21.15.122:0/3805003194 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa3b40683b0 0x7fa3b406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:48.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.993+0000 7fa3cea00640 1 -- 172.21.15.122:0/3805003194 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fa3d0086d30 con 0x7fa3d80cff30 2024-05-28T06:05:48.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.993+0000 7fa3d5e00640 1 --2- 172.21.15.122:0/3805003194 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa3b40683b0 0x7fa3b406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:48.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.993+0000 7fa3d5e00640 1 --2- 172.21.15.122:0/3805003194 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa3b40683b0 0x7fa3b406a870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8007fd0 tx=0x7fa3c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:48.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:48.997+0000 7fa3cea00640 1 -- 172.21.15.122:0/3805003194 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa3d814a780 con 0x7fa3d80cff30 2024-05-28T06:05:49.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:49.189+0000 7fa3dce00640 1 -- 172.21.15.122:0/3805003194 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa3d8155f70 con 0x7fa3d80cff30 2024-05-28T06:05:49.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:49.821+0000 7fa3cea00640 1 -- 172.21.15.122:0/3805003194 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fa3d00573e0 con 0x7fa3d80cff30 2024-05-28T06:05:49.824 INFO:teuthology.orchestra.run.smithi122.stderr:new fs with metadata pool 2 and data pool 3 2024-05-28T06:05:49.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:49.825+0000 7fa3dce00640 1 -- 172.21.15.122:0/3805003194 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa3b40683b0 msgr2=0x7fa3b406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:49.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:49.825+0000 7fa3dce00640 1 --2- 172.21.15.122:0/3805003194 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa3b40683b0 0x7fa3b406a870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8007fd0 tx=0x7fa3c8009040 comp rx=0 tx=0).stop 2024-05-28T06:05:49.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:49.825+0000 7fa3dce00640 1 -- 172.21.15.122:0/3805003194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3d80cff30 msgr2=0x7fa3d8150a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:49.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:49.825+0000 7fa3dce00640 1 --2- 172.21.15.122:0/3805003194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3d80cff30 0x7fa3d8150a70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa3d000d800 tx=0x7fa3d000dcc0 comp rx=0 tx=0).stop 2024-05-28T06:05:49.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:49.825+0000 7fa3dce00640 1 -- 172.21.15.122:0/3805003194 shutdown_connections 2024-05-28T06:05:49.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:49.825+0000 7fa3dce00640 1 --2- 172.21.15.122:0/3805003194 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa3b40683b0 0x7fa3b406a870 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:49.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:49.825+0000 7fa3dce00640 1 --2- 172.21.15.122:0/3805003194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3d80cff30 0x7fa3d8150a70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:49.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:49.825+0000 7fa3dce00640 1 --2- 172.21.15.122:0/3805003194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3d80cd930 0x7fa3d8149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:49.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:49.825+0000 7fa3dce00640 1 --2- 172.21.15.122:0/3805003194 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3d806f890 0x7fa3d814ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:49.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:49.825+0000 7fa3dce00640 1 -- 172.21.15.122:0/3805003194 >> 172.21.15.122:0/3805003194 conn(0x7fa3d806bd90 msgr2=0x7fa3d8159850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:49.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:49.829+0000 7fa3dce00640 1 -- 172.21.15.122:0/3805003194 shutdown_connections 2024-05-28T06:05:49.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:49.833+0000 7fa3dce00640 1 -- 172.21.15.122:0/3805003194 wait complete. 2024-05-28T06:05:49.867 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:05:50.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.001+0000 7efdd1600640 1 Processor -- start 2024-05-28T06:05:50.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.001+0000 7efdd1600640 1 -- start start 2024-05-28T06:05:50.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.001+0000 7efdd1600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efdcc06dab0 0x7efdcc15f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:50.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.001+0000 7efdd1600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efdcc15fa80 0x7efdcc0d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:50.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.001+0000 7efdd1600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdcc162510 con 0x7efdcc15ea50 2024-05-28T06:05:50.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.001+0000 7efdd1600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7efdcc163120 con 0x7efdcc06dab0 2024-05-28T06:05:50.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.001+0000 7efdd1600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7efdcc1627f0 con 0x7efdcc15fa80 2024-05-28T06:05:50.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.001+0000 7efdca000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efdcc06dab0 0x7efdcc15f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:50.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.001+0000 7efdcaa00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7efdcc15ea50 0x7efdcc15ee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56222/0 (socket says 172.21.15.122:56222) 2024-05-28T06:05:50.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.001+0000 7efdcaa00640 1 -- 172.21.15.122:0/635623678 learned_addr learned my addr 172.21.15.122:0/635623678 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:50.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.001+0000 7efdcb400640 1 --2- 172.21.15.122:0/635623678 >> v2:172.21.15.153:3300/0 conn(0x7efdcc15fa80 0x7efdcc0d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:50.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.001+0000 7efdca000640 1 -- 172.21.15.122:0/635623678 >> v2:172.21.15.153:3300/0 conn(0x7efdcc15fa80 msgr2=0x7efdcc0d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:50.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.001+0000 7efdca000640 1 --2- 172.21.15.122:0/635623678 >> v2:172.21.15.153:3300/0 conn(0x7efdcc15fa80 0x7efdcc0d08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.001+0000 7efdca000640 1 -- 172.21.15.122:0/635623678 >> v1:172.21.15.122:6789/0 conn(0x7efdcc15ea50 legacy=0x7efdcc15ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:50.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.001+0000 7efdca000640 1 -- 172.21.15.122:0/635623678 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdcc162ad0 con 0x7efdcc06dab0 2024-05-28T06:05:50.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.001+0000 7efdc9600640 1 -- 172.21.15.122:0/635623678 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3966286000 0 0) 0x7efdcc162510 con 0x7efdcc15ea50 2024-05-28T06:05:50.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.005+0000 7efdca000640 1 --2- 172.21.15.122:0/635623678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc06dab0 0x7efdcc15f540 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efdcc072ad0 tx=0x7efdb801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a244249fc9161d server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:50.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.005+0000 7efdc9600640 1 -- 172.21.15.122:0/635623678 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb80b0070 con 0x7efdcc06dab0 2024-05-28T06:05:50.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.005+0000 7efdc9600640 1 -- 172.21.15.122:0/635623678 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb80ab600 con 0x7efdcc06dab0 2024-05-28T06:05:50.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.005+0000 7efdc9600640 1 -- 172.21.15.122:0/635623678 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb80ab9d0 con 0x7efdcc06dab0 2024-05-28T06:05:50.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.005+0000 7efdd1600640 1 -- 172.21.15.122:0/635623678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc06dab0 msgr2=0x7efdcc15f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:50.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.005+0000 7efdd1600640 1 --2- 172.21.15.122:0/635623678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc06dab0 0x7efdcc15f540 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efdcc072ad0 tx=0x7efdb801c450 comp rx=0 tx=0).stop 2024-05-28T06:05:50.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.005+0000 7efdd1600640 1 -- 172.21.15.122:0/635623678 shutdown_connections 2024-05-28T06:05:50.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.005+0000 7efdd1600640 1 --2- 172.21.15.122:0/635623678 >> v2:172.21.15.153:3300/0 conn(0x7efdcc15fa80 0x7efdcc0d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.005+0000 7efdd1600640 1 --2- 172.21.15.122:0/635623678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc06dab0 0x7efdcc15f540 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.005+0000 7efdd1600640 1 -- 172.21.15.122:0/635623678 >> 172.21.15.122:0/635623678 conn(0x7efdcc0b4190 msgr2=0x7efdcc0b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:50.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.005+0000 7efdd1600640 1 -- 172.21.15.122:0/635623678 shutdown_connections 2024-05-28T06:05:50.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.005+0000 7efdd1600640 1 -- 172.21.15.122:0/635623678 wait complete. 2024-05-28T06:05:50.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdd1600640 1 Processor -- start 2024-05-28T06:05:50.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdd1600640 1 -- start start 2024-05-28T06:05:50.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdd1600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdcc06dab0 0x7efdcc158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:50.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdd1600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc15ea50 0x7efdcc15d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:50.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdd1600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdcc15fa80 0x7efdcc1566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:50.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdd1600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc0d1a00 con 0x7efdcc15ea50 2024-05-28T06:05:50.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdd1600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc0d1880 con 0x7efdcc15fa80 2024-05-28T06:05:50.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdd1600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efdcc0d1b80 con 0x7efdcc06dab0 2024-05-28T06:05:50.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdca000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc15ea50 0x7efdcc15d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:50.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdca000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc15ea50 0x7efdcc15d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36142/0 (socket says 172.21.15.122:36142) 2024-05-28T06:05:50.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdca000640 1 -- 172.21.15.122:0/2645604176 learned_addr learned my addr 172.21.15.122:0/2645604176 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:50.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdcaa00640 1 --2- 172.21.15.122:0/2645604176 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdcc06dab0 0x7efdcc158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:50.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdcb400640 1 --2- 172.21.15.122:0/2645604176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdcc15fa80 0x7efdcc1566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:50.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdca000640 1 -- 172.21.15.122:0/2645604176 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdcc06dab0 msgr2=0x7efdcc158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:50.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdca000640 1 --2- 172.21.15.122:0/2645604176 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdcc06dab0 0x7efdcc158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdca000640 1 -- 172.21.15.122:0/2645604176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdcc15fa80 msgr2=0x7efdcc1566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:50.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdca000640 1 --2- 172.21.15.122:0/2645604176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdcc15fa80 0x7efdcc1566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdca000640 1 -- 172.21.15.122:0/2645604176 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdcc159650 con 0x7efdcc15ea50 2024-05-28T06:05:50.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdca000640 1 --2- 172.21.15.122:0/2645604176 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc15ea50 0x7efdcc15d610 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efdb80ae040 tx=0x7efdb801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:50.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdc2a00640 1 -- 172.21.15.122:0/2645604176 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb80b0050 con 0x7efdcc15ea50 2024-05-28T06:05:50.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdc2a00640 1 -- 172.21.15.122:0/2645604176 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb80bc070 con 0x7efdcc15ea50 2024-05-28T06:05:50.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdd1600640 1 -- 172.21.15.122:0/2645604176 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdcc159930 con 0x7efdcc15ea50 2024-05-28T06:05:50.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdc2a00640 1 -- 172.21.15.122:0/2645604176 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb80b5830 con 0x7efdcc15ea50 2024-05-28T06:05:50.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdd1600640 1 -- 172.21.15.122:0/2645604176 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdcc159ef0 con 0x7efdcc15ea50 2024-05-28T06:05:50.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.009+0000 7efdd1600640 1 -- 172.21.15.122:0/2645604176 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdcc068c40 con 0x7efdcc15ea50 2024-05-28T06:05:50.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.013+0000 7efdc2a00640 1 -- 172.21.15.122:0/2645604176 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efdb80b59d0 con 0x7efdcc15ea50 2024-05-28T06:05:50.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.013+0000 7efdc2a00640 1 --2- 172.21.15.122:0/2645604176 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdac068380 0x7efdac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:50.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.013+0000 7efdc2a00640 1 -- 172.21.15.122:0/2645604176 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7efdb8121130 con 0x7efdcc15ea50 2024-05-28T06:05:50.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.013+0000 7efdcaa00640 1 --2- 172.21.15.122:0/2645604176 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdac068380 0x7efdac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:50.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.013+0000 7efdcaa00640 1 --2- 172.21.15.122:0/2645604176 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdac068380 0x7efdac06a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efdbc000f70 tx=0x7efdbc007df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:50.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.017+0000 7efdc2a00640 1 -- 172.21.15.122:0/2645604176 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efdb8016070 con 0x7efdcc15ea50 2024-05-28T06:05:50.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.177+0000 7efdd1600640 1 -- 172.21.15.122:0/2645604176 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efdcc161f40 con 0x7efdcc15ea50 2024-05-28T06:05:50.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.177+0000 7efdc2a00640 1 -- 172.21.15.122:0/2645604176 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16618 (secure 0 0 0) 0x7efdb80f1000 con 0x7efdcc15ea50 2024-05-28T06:05:50.181 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:05:50.181 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":19,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:05:49.194805+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:05:47.441193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-28T06:05:48.148164+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:05:50.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.181+0000 7efdd1600640 1 -- 172.21.15.122:0/2645604176 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdac068380 msgr2=0x7efdac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:50.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.181+0000 7efdd1600640 1 --2- 172.21.15.122:0/2645604176 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdac068380 0x7efdac06a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efdbc000f70 tx=0x7efdbc007df0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.181+0000 7efdd1600640 1 -- 172.21.15.122:0/2645604176 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc15ea50 msgr2=0x7efdcc15d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:50.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.181+0000 7efdd1600640 1 --2- 172.21.15.122:0/2645604176 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc15ea50 0x7efdcc15d610 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efdb80ae040 tx=0x7efdb801ac90 comp rx=0 tx=0).stop 2024-05-28T06:05:50.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.181+0000 7efdd1600640 1 -- 172.21.15.122:0/2645604176 shutdown_connections 2024-05-28T06:05:50.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.181+0000 7efdd1600640 1 --2- 172.21.15.122:0/2645604176 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdac068380 0x7efdac06a840 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.181+0000 7efdd1600640 1 --2- 172.21.15.122:0/2645604176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdcc15fa80 0x7efdcc1566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.181+0000 7efdd1600640 1 --2- 172.21.15.122:0/2645604176 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc15ea50 0x7efdcc15d610 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.181+0000 7efdd1600640 1 --2- 172.21.15.122:0/2645604176 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdcc06dab0 0x7efdcc158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.181+0000 7efdd1600640 1 -- 172.21.15.122:0/2645604176 >> 172.21.15.122:0/2645604176 conn(0x7efdcc0b4190 msgr2=0x7efdcc15b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:50.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.181+0000 7efdd1600640 1 -- 172.21.15.122:0/2645604176 shutdown_connections 2024-05-28T06:05:50.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.181+0000 7efdd1600640 1 -- 172.21.15.122:0/2645604176 wait complete. 2024-05-28T06:05:50.202 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:05:50.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.333+0000 7f8e67c00640 1 Processor -- start 2024-05-28T06:05:50.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.333+0000 7f8e67c00640 1 -- start start 2024-05-28T06:05:50.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.337+0000 7f8e67c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8e600b58d0 0x7f8e600b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:50.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.337+0000 7f8e67c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8e600ce4f0 0x7f8e600ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:50.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.337+0000 7f8e67c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e600b61f0 con 0x7f8e600722a0 2024-05-28T06:05:50.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.337+0000 7f8e67c00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f8e6015d970 con 0x7f8e600ce4f0 2024-05-28T06:05:50.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.337+0000 7f8e67c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8e6015dc50 con 0x7f8e600b58d0 2024-05-28T06:05:50.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.337+0000 7f8e57e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8e600ce4f0 0x7f8e600ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:50.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.337+0000 7f8e65c00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f8e600722a0 0x7f8e600726f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56230/0 (socket says 172.21.15.122:56230) 2024-05-28T06:05:50.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.337+0000 7f8e65c00640 1 -- 172.21.15.122:0/3564110256 learned_addr learned my addr 172.21.15.122:0/3564110256 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:50.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.337+0000 7f8e65200640 1 --2- 172.21.15.122:0/3564110256 >> v2:172.21.15.153:3300/0 conn(0x7f8e600b58d0 0x7f8e600b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:50.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.337+0000 7f8e57e00640 1 -- 172.21.15.122:0/3564110256 >> v2:172.21.15.153:3300/0 conn(0x7f8e600b58d0 msgr2=0x7f8e600b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:50.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.337+0000 7f8e57e00640 1 --2- 172.21.15.122:0/3564110256 >> v2:172.21.15.153:3300/0 conn(0x7f8e600b58d0 0x7f8e600b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.337+0000 7f8e57e00640 1 -- 172.21.15.122:0/3564110256 >> v1:172.21.15.122:6789/0 conn(0x7f8e600722a0 legacy=0x7f8e600726f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:50.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.337+0000 7f8e57e00640 1 -- 172.21.15.122:0/3564110256 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e6015df30 con 0x7f8e600ce4f0 2024-05-28T06:05:50.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.337+0000 7f8e57e00640 1 --2- 172.21.15.122:0/3564110256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e600ce4f0 0x7f8e600ce980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8e60070130 tx=0x7f8e4801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f104f68935b79ef server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:50.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e5fe00640 1 -- 172.21.15.122:0/3564110256 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e480ab5f0 con 0x7f8e600ce4f0 2024-05-28T06:05:50.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e5fe00640 1 -- 172.21.15.122:0/3564110256 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e480b0070 con 0x7f8e600ce4f0 2024-05-28T06:05:50.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e5fe00640 1 -- 172.21.15.122:0/3564110256 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e480ab9b0 con 0x7f8e600ce4f0 2024-05-28T06:05:50.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e67c00640 1 -- 172.21.15.122:0/3564110256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e600ce4f0 msgr2=0x7f8e600ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:50.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e67c00640 1 --2- 172.21.15.122:0/3564110256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e600ce4f0 0x7f8e600ce980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8e60070130 tx=0x7f8e4801c450 comp rx=0 tx=0).stop 2024-05-28T06:05:50.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e67c00640 1 -- 172.21.15.122:0/3564110256 shutdown_connections 2024-05-28T06:05:50.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e67c00640 1 --2- 172.21.15.122:0/3564110256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e600ce4f0 0x7f8e600ce980 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e67c00640 1 --2- 172.21.15.122:0/3564110256 >> v2:172.21.15.153:3300/0 conn(0x7f8e600b58d0 0x7f8e600b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e67c00640 1 -- 172.21.15.122:0/3564110256 >> 172.21.15.122:0/3564110256 conn(0x7f8e6006bd90 msgr2=0x7f8e6006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:50.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e67c00640 1 -- 172.21.15.122:0/3564110256 shutdown_connections 2024-05-28T06:05:50.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e67c00640 1 -- 172.21.15.122:0/3564110256 wait complete. 2024-05-28T06:05:50.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e67c00640 1 Processor -- start 2024-05-28T06:05:50.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e67c00640 1 -- start start 2024-05-28T06:05:50.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e67c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e600722a0 0x7f8e6013a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:50.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e67c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e600b58d0 0x7f8e601599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:50.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e67c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e600ce4f0 0x7f8e6015b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:50.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e67c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8e60146260 con 0x7f8e600722a0 2024-05-28T06:05:50.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e67c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8e60169a60 con 0x7f8e600b58d0 2024-05-28T06:05:50.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e67c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8e600b2690 con 0x7f8e600ce4f0 2024-05-28T06:05:50.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e65200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e600722a0 0x7f8e6013a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:50.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e65200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e600722a0 0x7f8e6013a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36156/0 (socket says 172.21.15.122:36156) 2024-05-28T06:05:50.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e65200640 1 -- 172.21.15.122:0/2221067399 learned_addr learned my addr 172.21.15.122:0/2221067399 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:50.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e57e00640 1 --2- 172.21.15.122:0/2221067399 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e600b58d0 0x7f8e601599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:50.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.341+0000 7f8e65c00640 1 --2- 172.21.15.122:0/2221067399 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e600ce4f0 0x7f8e6015b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:50.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.345+0000 7f8e65200640 1 -- 172.21.15.122:0/2221067399 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e600ce4f0 msgr2=0x7f8e6015b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:50.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.345+0000 7f8e65200640 1 --2- 172.21.15.122:0/2221067399 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e600ce4f0 0x7f8e6015b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.345+0000 7f8e65200640 1 -- 172.21.15.122:0/2221067399 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e600b58d0 msgr2=0x7f8e601599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:50.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.345+0000 7f8e65200640 1 --2- 172.21.15.122:0/2221067399 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e600b58d0 0x7f8e601599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.345+0000 7f8e65200640 1 -- 172.21.15.122:0/2221067399 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e600b2970 con 0x7f8e600722a0 2024-05-28T06:05:50.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.345+0000 7f8e57e00640 1 --2- 172.21.15.122:0/2221067399 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e600b58d0 0x7f8e601599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:05:50.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.345+0000 7f8e65c00640 1 --2- 172.21.15.122:0/2221067399 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e600ce4f0 0x7f8e6015b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:05:50.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.345+0000 7f8e65200640 1 --2- 172.21.15.122:0/2221067399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e600722a0 0x7f8e6013a8b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000d830 tx=0x7f8e5000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:50.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.345+0000 7f8e5d600640 1 -- 172.21.15.122:0/2221067399 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5000b6c0 con 0x7f8e600722a0 2024-05-28T06:05:50.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.345+0000 7f8e67c00640 1 -- 172.21.15.122:0/2221067399 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e600b2c50 con 0x7f8e600722a0 2024-05-28T06:05:50.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.345+0000 7f8e5d600640 1 -- 172.21.15.122:0/2221067399 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e50019070 con 0x7f8e600722a0 2024-05-28T06:05:50.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.345+0000 7f8e5d600640 1 -- 172.21.15.122:0/2221067399 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5000ba60 con 0x7f8e600722a0 2024-05-28T06:05:50.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.345+0000 7f8e67c00640 1 -- 172.21.15.122:0/2221067399 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e60159f20 con 0x7f8e600722a0 2024-05-28T06:05:50.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.345+0000 7f8e67c00640 1 -- 172.21.15.122:0/2221067399 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e60157df0 con 0x7f8e600722a0 2024-05-28T06:05:50.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.345+0000 7f8e5d600640 1 -- 172.21.15.122:0/2221067399 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8e5001e460 con 0x7f8e600722a0 2024-05-28T06:05:50.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.345+0000 7f8e5d600640 1 --2- 172.21.15.122:0/2221067399 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8e3c0683b0 0x7f8e3c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:50.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.345+0000 7f8e5d600640 1 -- 172.21.15.122:0/2221067399 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f8e50087110 con 0x7f8e600722a0 2024-05-28T06:05:50.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.345+0000 7f8e57e00640 1 --2- 172.21.15.122:0/2221067399 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8e3c0683b0 0x7f8e3c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:50.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.349+0000 7f8e57e00640 1 --2- 172.21.15.122:0/2221067399 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8e3c0683b0 0x7f8e3c06a870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8e480af000 tx=0x7f8e480a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:50.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.349+0000 7f8e5d600640 1 -- 172.21.15.122:0/2221067399 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8e50057640 con 0x7f8e600722a0 2024-05-28T06:05:50.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.505+0000 7f8e67c00640 1 -- 172.21.15.122:0/2221067399 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e60068c40 con 0x7f8e600722a0 2024-05-28T06:05:50.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.505+0000 7f8e5d600640 1 -- 172.21.15.122:0/2221067399 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16618 (secure 0 0 0) 0x7f8e50056f40 con 0x7f8e600722a0 2024-05-28T06:05:50.510 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:05:50.510 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":19,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:05:49.194805+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:05:47.441193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-28T06:05:48.148164+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:05:50.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.509+0000 7f8e67c00640 1 -- 172.21.15.122:0/2221067399 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8e3c0683b0 msgr2=0x7f8e3c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:50.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.509+0000 7f8e67c00640 1 --2- 172.21.15.122:0/2221067399 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8e3c0683b0 0x7f8e3c06a870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8e480af000 tx=0x7f8e480a7000 comp rx=0 tx=0).stop 2024-05-28T06:05:50.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.509+0000 7f8e67c00640 1 -- 172.21.15.122:0/2221067399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e600722a0 msgr2=0x7f8e6013a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:50.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.509+0000 7f8e67c00640 1 --2- 172.21.15.122:0/2221067399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e600722a0 0x7f8e6013a8b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000d830 tx=0x7f8e5000dcf0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.509+0000 7f8e67c00640 1 -- 172.21.15.122:0/2221067399 shutdown_connections 2024-05-28T06:05:50.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.509+0000 7f8e67c00640 1 --2- 172.21.15.122:0/2221067399 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8e3c0683b0 0x7f8e3c06a870 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.509+0000 7f8e67c00640 1 --2- 172.21.15.122:0/2221067399 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e600ce4f0 0x7f8e6015b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.509+0000 7f8e67c00640 1 --2- 172.21.15.122:0/2221067399 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e600b58d0 0x7f8e601599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.509+0000 7f8e67c00640 1 --2- 172.21.15.122:0/2221067399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e600722a0 0x7f8e6013a8b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.509+0000 7f8e67c00640 1 -- 172.21.15.122:0/2221067399 >> 172.21.15.122:0/2221067399 conn(0x7f8e6006bd90 msgr2=0x7f8e6006e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:50.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.509+0000 7f8e67c00640 1 -- 172.21.15.122:0/2221067399 shutdown_connections 2024-05-28T06:05:50.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.509+0000 7f8e67c00640 1 -- 172.21.15.122:0/2221067399 wait complete. 2024-05-28T06:05:50.531 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-28T06:05:50.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.665+0000 7f26bc200640 1 Processor -- start 2024-05-28T06:05:50.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.665+0000 7f26bc200640 1 -- start start 2024-05-28T06:05:50.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.669+0000 7f26bc200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f26b415f4c0 0x7f26b406e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:50.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.669+0000 7f26bc200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f26b415e8b0 0x7f26b415ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:50.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.669+0000 7f26bc200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26b4141420 con 0x7f26b41588b0 2024-05-28T06:05:50.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.669+0000 7f26bc200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f26b4158c90 con 0x7f26b415f4c0 2024-05-28T06:05:50.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.669+0000 7f26bc200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f26b4140e60 con 0x7f26b415e8b0 2024-05-28T06:05:50.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.669+0000 7f26b8e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f26b415f4c0 0x7f26b406e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:50.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.669+0000 7f26b9800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f26b41588b0 0x7f26b4140580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56236/0 (socket says 172.21.15.122:56236) 2024-05-28T06:05:50.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.669+0000 7f26b9800640 1 -- 172.21.15.122:0/3014942957 learned_addr learned my addr 172.21.15.122:0/3014942957 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:50.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.669+0000 7f26ba200640 1 --2- 172.21.15.122:0/3014942957 >> v2:172.21.15.153:3300/0 conn(0x7f26b415e8b0 0x7f26b415ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:50.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.669+0000 7f26b8e00640 1 -- 172.21.15.122:0/3014942957 >> v2:172.21.15.153:3300/0 conn(0x7f26b415e8b0 msgr2=0x7f26b415ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:50.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.669+0000 7f26b8e00640 1 --2- 172.21.15.122:0/3014942957 >> v2:172.21.15.153:3300/0 conn(0x7f26b415e8b0 0x7f26b415ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.669+0000 7f26b8e00640 1 -- 172.21.15.122:0/3014942957 >> v1:172.21.15.122:6789/0 conn(0x7f26b41588b0 legacy=0x7f26b4140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:50.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.669+0000 7f26b8e00640 1 -- 172.21.15.122:0/3014942957 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b4141140 con 0x7f26b415f4c0 2024-05-28T06:05:50.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.669+0000 7f26ba200640 1 --2- 172.21.15.122:0/3014942957 >> v2:172.21.15.153:3300/0 conn(0x7f26b415e8b0 0x7f26b415ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:05:50.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.673+0000 7f26b8e00640 1 --2- 172.21.15.122:0/3014942957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26b415f4c0 0x7f26b406e070 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f26b40b6310 tx=0x7f26a001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98a23549205e38e server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:50.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.673+0000 7f26b3e00640 1 -- 172.21.15.122:0/3014942957 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a00b1070 con 0x7f26b415f4c0 2024-05-28T06:05:50.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.673+0000 7f26b3e00640 1 -- 172.21.15.122:0/3014942957 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a00ac640 con 0x7f26b415f4c0 2024-05-28T06:05:50.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.673+0000 7f26b3e00640 1 -- 172.21.15.122:0/3014942957 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a00aca10 con 0x7f26b415f4c0 2024-05-28T06:05:50.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.673+0000 7f26bc200640 1 -- 172.21.15.122:0/3014942957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26b415f4c0 msgr2=0x7f26b406e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:50.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.673+0000 7f26bc200640 1 --2- 172.21.15.122:0/3014942957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26b415f4c0 0x7f26b406e070 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f26b40b6310 tx=0x7f26a001c480 comp rx=0 tx=0).stop 2024-05-28T06:05:50.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.673+0000 7f26bc200640 1 -- 172.21.15.122:0/3014942957 shutdown_connections 2024-05-28T06:05:50.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.673+0000 7f26bc200640 1 --2- 172.21.15.122:0/3014942957 >> v2:172.21.15.153:3300/0 conn(0x7f26b415e8b0 0x7f26b415ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.673+0000 7f26bc200640 1 --2- 172.21.15.122:0/3014942957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26b415f4c0 0x7f26b406e070 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.673+0000 7f26bc200640 1 -- 172.21.15.122:0/3014942957 >> 172.21.15.122:0/3014942957 conn(0x7f26b406bd90 msgr2=0x7f26b406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:50.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.673+0000 7f26bc200640 1 -- 172.21.15.122:0/3014942957 shutdown_connections 2024-05-28T06:05:50.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.673+0000 7f26bc200640 1 -- 172.21.15.122:0/3014942957 wait complete. 2024-05-28T06:05:50.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.673+0000 7f26bc200640 1 Processor -- start 2024-05-28T06:05:50.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.673+0000 7f26bc200640 1 -- start start 2024-05-28T06:05:50.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.673+0000 7f26bc200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26b41588b0 0x7f26b4142f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:50.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.677+0000 7f26bc200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26b415e8b0 0x7f26b413e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:50.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.677+0000 7f26bc200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26b415f4c0 0x7f26b41415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:50.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.677+0000 7f26bc200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f26b40cfa00 con 0x7f26b415e8b0 2024-05-28T06:05:50.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.677+0000 7f26bc200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f26b40cf880 con 0x7f26b41588b0 2024-05-28T06:05:50.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.677+0000 7f26bc200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f26b40cfb80 con 0x7f26b415f4c0 2024-05-28T06:05:50.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.677+0000 7f26b8e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26b415e8b0 0x7f26b413e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:50.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.677+0000 7f26b8e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26b415e8b0 0x7f26b413e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36170/0 (socket says 172.21.15.122:36170) 2024-05-28T06:05:50.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.677+0000 7f26b8e00640 1 -- 172.21.15.122:0/1959408255 learned_addr learned my addr 172.21.15.122:0/1959408255 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:50.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.677+0000 7f26b9800640 1 --2- 172.21.15.122:0/1959408255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26b41588b0 0x7f26b4142f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:50.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.677+0000 7f26ba200640 1 --2- 172.21.15.122:0/1959408255 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26b415f4c0 0x7f26b41415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:50.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.677+0000 7f26b8e00640 1 -- 172.21.15.122:0/1959408255 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26b415f4c0 msgr2=0x7f26b41415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:50.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.677+0000 7f26b8e00640 1 --2- 172.21.15.122:0/1959408255 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26b415f4c0 0x7f26b41415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.677+0000 7f26b8e00640 1 -- 172.21.15.122:0/1959408255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26b41588b0 msgr2=0x7f26b4142f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:50.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.677+0000 7f26b8e00640 1 --2- 172.21.15.122:0/1959408255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26b41588b0 0x7f26b4142f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:50.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.677+0000 7f26b8e00640 1 -- 172.21.15.122:0/1959408255 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b40b65a0 con 0x7f26b415e8b0 2024-05-28T06:05:50.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.677+0000 7f26b8e00640 1 --2- 172.21.15.122:0/1959408255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26b415e8b0 0x7f26b413e3f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f26a0019090 tx=0x7f26a0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:50.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.677+0000 7f26b1600640 1 -- 172.21.15.122:0/1959408255 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a00b1040 con 0x7f26b415e8b0 2024-05-28T06:05:50.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.677+0000 7f26b1600640 1 -- 172.21.15.122:0/1959408255 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a00ac440 con 0x7f26b415e8b0 2024-05-28T06:05:50.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.677+0000 7f26bc200640 1 -- 172.21.15.122:0/1959408255 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b4141ef0 con 0x7f26b415e8b0 2024-05-28T06:05:50.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.677+0000 7f26b1600640 1 -- 172.21.15.122:0/1959408255 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a00b6660 con 0x7f26b415e8b0 2024-05-28T06:05:50.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.677+0000 7f26bc200640 1 -- 172.21.15.122:0/1959408255 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b41424b0 con 0x7f26b415e8b0 2024-05-28T06:05:50.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.677+0000 7f26bc200640 1 -- 172.21.15.122:0/1959408255 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26b4068c40 con 0x7f26b415e8b0 2024-05-28T06:05:50.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.677+0000 7f26b1600640 1 -- 172.21.15.122:0/1959408255 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f26a00c0020 con 0x7f26b415e8b0 2024-05-28T06:05:50.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.681+0000 7f26b1600640 1 --2- 172.21.15.122:0/1959408255 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2694068380 0x7f269406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:50.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.681+0000 7f26b1600640 1 -- 172.21.15.122:0/1959408255 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f26a0120660 con 0x7f26b415e8b0 2024-05-28T06:05:50.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.681+0000 7f26b9800640 1 --2- 172.21.15.122:0/1959408255 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2694068380 0x7f269406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:50.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.681+0000 7f26b9800640 1 --2- 172.21.15.122:0/1959408255 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2694068380 0x7f269406a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f26b40ccea0 tx=0x7f26a8007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:50.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.685+0000 7f26b1600640 1 -- 172.21.15.122:0/1959408255 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f26a0016070 con 0x7f26b415e8b0 2024-05-28T06:05:50.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:50.881+0000 7f26bc200640 1 -- 172.21.15.122:0/1959408255 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f26b40af330 con 0x7f26b415e8b0 2024-05-28T06:05:51.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.829+0000 7f26b1600640 1 -- 172.21.15.122:0/1959408255 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f26a00f0530 con 0x7f26b415e8b0 2024-05-28T06:05:51.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.833+0000 7f26bc200640 1 -- 172.21.15.122:0/1959408255 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2694068380 msgr2=0x7f269406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:51.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.833+0000 7f26bc200640 1 --2- 172.21.15.122:0/1959408255 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2694068380 0x7f269406a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f26b40ccea0 tx=0x7f26a8007e90 comp rx=0 tx=0).stop 2024-05-28T06:05:51.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.833+0000 7f26bc200640 1 -- 172.21.15.122:0/1959408255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26b415e8b0 msgr2=0x7f26b413e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:51.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.833+0000 7f26bc200640 1 --2- 172.21.15.122:0/1959408255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26b415e8b0 0x7f26b413e3f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f26a0019090 tx=0x7f26a0019220 comp rx=0 tx=0).stop 2024-05-28T06:05:51.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.833+0000 7f26bc200640 1 -- 172.21.15.122:0/1959408255 shutdown_connections 2024-05-28T06:05:51.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.833+0000 7f26bc200640 1 --2- 172.21.15.122:0/1959408255 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2694068380 0x7f269406a840 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:51.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.833+0000 7f26bc200640 1 --2- 172.21.15.122:0/1959408255 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26b415f4c0 0x7f26b41415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:51.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.833+0000 7f26bc200640 1 --2- 172.21.15.122:0/1959408255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26b415e8b0 0x7f26b413e3f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:51.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.833+0000 7f26bc200640 1 --2- 172.21.15.122:0/1959408255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26b41588b0 0x7f26b4142f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:51.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.833+0000 7f26bc200640 1 -- 172.21.15.122:0/1959408255 >> 172.21.15.122:0/1959408255 conn(0x7f26b406bd90 msgr2=0x7f26b4074d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:51.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.833+0000 7f26bc200640 1 -- 172.21.15.122:0/1959408255 shutdown_connections 2024-05-28T06:05:51.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.833+0000 7f26bc200640 1 -- 172.21.15.122:0/1959408255 wait complete. 2024-05-28T06:05:51.856 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-28T06:05:51.856 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-28T06:05:51.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.993+0000 7f3edd400640 1 Processor -- start 2024-05-28T06:05:51.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.993+0000 7f3edd400640 1 -- start start 2024-05-28T06:05:51.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.993+0000 7f3edd400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ed8073c80 0x7f3ed80d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:51.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.993+0000 7f3edd400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3ed80b36b0 0x7f3ed80b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:51.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.993+0000 7f3edd400640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ed80b46c0 con 0x7f3ed815ea20 2024-05-28T06:05:51.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.993+0000 7f3edd400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f3ed80b4060 con 0x7f3ed80b36b0 2024-05-28T06:05:51.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.993+0000 7f3edd400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3ed815ee00 con 0x7f3ed8073c80 2024-05-28T06:05:51.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.993+0000 7f3ed6800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f3ed815ea20 0x7f3ed80b4fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56240/0 (socket says 172.21.15.122:56240) 2024-05-28T06:05:51.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.993+0000 7f3ed6800640 1 -- 172.21.15.122:0/1019739094 learned_addr learned my addr 172.21.15.122:0/1019739094 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:51.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.993+0000 7f3ed7200640 1 --2- 172.21.15.122:0/1019739094 >> v2:172.21.15.122:3300/0 conn(0x7f3ed80b36b0 0x7f3ed80b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:51.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.993+0000 7f3ed5e00640 1 --2- 172.21.15.122:0/1019739094 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ed8073c80 0x7f3ed80d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:51.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.993+0000 7f3ed5400640 1 -- 172.21.15.122:0/1019739094 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3254534198 0 0) 0x7f3ed80b46c0 con 0x7f3ed815ea20 2024-05-28T06:05:51.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.993+0000 7f3ed5400640 1 -- 172.21.15.122:0/1019739094 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ebc003530 con 0x7f3ed815ea20 2024-05-28T06:05:51.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.993+0000 7f3ed7200640 1 -- 172.21.15.122:0/1019739094 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ed8073c80 msgr2=0x7f3ed80d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:51.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.993+0000 7f3ed7200640 1 --2- 172.21.15.122:0/1019739094 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ed8073c80 0x7f3ed80d0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:51.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.993+0000 7f3ed7200640 1 -- 172.21.15.122:0/1019739094 >> v1:172.21.15.122:6789/0 conn(0x7f3ed815ea20 legacy=0x7f3ed80b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:51.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.993+0000 7f3ed7200640 1 -- 172.21.15.122:0/1019739094 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed80b49a0 con 0x7f3ed80b36b0 2024-05-28T06:05:52.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.997+0000 7f3ed7200640 1 --2- 172.21.15.122:0/1019739094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ed80b36b0 0x7f3ed80b3b20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00097c0 tx=0x7f3ed001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=962af0b36198575 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:52.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.997+0000 7f3ed5400640 1 -- 172.21.15.122:0/1019739094 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed00b0070 con 0x7f3ed80b36b0 2024-05-28T06:05:52.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.997+0000 7f3ed5400640 1 -- 172.21.15.122:0/1019739094 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed00ab600 con 0x7f3ed80b36b0 2024-05-28T06:05:52.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.997+0000 7f3ed5400640 1 -- 172.21.15.122:0/1019739094 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed00ab9d0 con 0x7f3ed80b36b0 2024-05-28T06:05:52.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.997+0000 7f3edd400640 1 -- 172.21.15.122:0/1019739094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ed80b36b0 msgr2=0x7f3ed80b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:52.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.997+0000 7f3edd400640 1 --2- 172.21.15.122:0/1019739094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ed80b36b0 0x7f3ed80b3b20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00097c0 tx=0x7f3ed001c4a0 comp rx=0 tx=0).stop 2024-05-28T06:05:52.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.997+0000 7f3edd400640 1 -- 172.21.15.122:0/1019739094 shutdown_connections 2024-05-28T06:05:52.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.997+0000 7f3edd400640 1 --2- 172.21.15.122:0/1019739094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ed80b36b0 0x7f3ed80b3b20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:52.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.997+0000 7f3edd400640 1 --2- 172.21.15.122:0/1019739094 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ed8073c80 0x7f3ed80d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:52.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.997+0000 7f3edd400640 1 -- 172.21.15.122:0/1019739094 >> 172.21.15.122:0/1019739094 conn(0x7f3ed80b6c10 msgr2=0x7f3ed80b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:52.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.997+0000 7f3edd400640 1 -- 172.21.15.122:0/1019739094 shutdown_connections 2024-05-28T06:05:52.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:51.997+0000 7f3edd400640 1 -- 172.21.15.122:0/1019739094 wait complete. 2024-05-28T06:05:52.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3edd400640 1 Processor -- start 2024-05-28T06:05:52.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3edd400640 1 -- start start 2024-05-28T06:05:52.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3edd400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ed8073c80 0x7f3ed814e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:52.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3edd400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed80b36b0 0x7f3ed8156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:52.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3edd400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ed815ea20 0x7f3ed81572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:52.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3edd400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed80ce960 con 0x7f3ed815ea20 2024-05-28T06:05:52.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3edd400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed80b56d0 con 0x7f3ed80b36b0 2024-05-28T06:05:52.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3edd400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3ed80ceae0 con 0x7f3ed8073c80 2024-05-28T06:05:52.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3ed7200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ed815ea20 0x7f3ed81572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:52.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3ed7200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ed815ea20 0x7f3ed81572f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36186/0 (socket says 172.21.15.122:36186) 2024-05-28T06:05:52.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3ed7200640 1 -- 172.21.15.122:0/1707174175 learned_addr learned my addr 172.21.15.122:0/1707174175 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:52.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3ed6800640 1 --2- 172.21.15.122:0/1707174175 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ed8073c80 0x7f3ed814e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:52.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3ed5e00640 1 --2- 172.21.15.122:0/1707174175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed80b36b0 0x7f3ed8156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:52.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3ed7200640 1 -- 172.21.15.122:0/1707174175 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ed8073c80 msgr2=0x7f3ed814e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:52.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3ed7200640 1 --2- 172.21.15.122:0/1707174175 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ed8073c80 0x7f3ed814e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:52.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3ed7200640 1 -- 172.21.15.122:0/1707174175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed80b36b0 msgr2=0x7f3ed8156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:52.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3ed7200640 1 --2- 172.21.15.122:0/1707174175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed80b36b0 0x7f3ed8156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:52.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3ed7200640 1 -- 172.21.15.122:0/1707174175 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed81591a0 con 0x7f3ed815ea20 2024-05-28T06:05:52.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3ed5e00640 1 --2- 172.21.15.122:0/1707174175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed80b36b0 0x7f3ed8156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:05:52.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3ed6800640 1 --2- 172.21.15.122:0/1707174175 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ed8073c80 0x7f3ed814e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:05:52.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3ed7200640 1 --2- 172.21.15.122:0/1707174175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ed815ea20 0x7f3ed81572f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00ae040 tx=0x7f3ed0019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:52.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3ecea00640 1 -- 172.21.15.122:0/1707174175 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed00b8020 con 0x7f3ed815ea20 2024-05-28T06:05:52.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3ecea00640 1 -- 172.21.15.122:0/1707174175 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed00abe30 con 0x7f3ed815ea20 2024-05-28T06:05:52.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3edd400640 1 -- 172.21.15.122:0/1707174175 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ed8159440 con 0x7f3ed815ea20 2024-05-28T06:05:52.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3ecea00640 1 -- 172.21.15.122:0/1707174175 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed00b0040 con 0x7f3ed815ea20 2024-05-28T06:05:52.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.001+0000 7f3edd400640 1 -- 172.21.15.122:0/1707174175 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ed81596e0 con 0x7f3ed815ea20 2024-05-28T06:05:52.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.005+0000 7f3edd400640 1 -- 172.21.15.122:0/1707174175 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ed8068c40 con 0x7f3ed815ea20 2024-05-28T06:05:52.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.005+0000 7f3ecea00640 1 -- 172.21.15.122:0/1707174175 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3ed00bb020 con 0x7f3ed815ea20 2024-05-28T06:05:52.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.005+0000 7f3ecea00640 1 --2- 172.21.15.122:0/1707174175 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3eb8068380 0x7f3eb806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:52.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.005+0000 7f3ecea00640 1 -- 172.21.15.122:0/1707174175 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3ed0120400 con 0x7f3ed815ea20 2024-05-28T06:05:52.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.005+0000 7f3ed6800640 1 --2- 172.21.15.122:0/1707174175 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3eb8068380 0x7f3eb806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:52.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.005+0000 7f3ed6800640 1 --2- 172.21.15.122:0/1707174175 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3eb8068380 0x7f3eb806a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8005c10 tx=0x7f3ec8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:52.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.009+0000 7f3ecea00640 1 -- 172.21.15.122:0/1707174175 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3ed00c2030 con 0x7f3ed815ea20 2024-05-28T06:05:52.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.197+0000 7f3edd400640 1 -- 172.21.15.122:0/1707174175 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3ed815ccd0 con 0x7f3ed815ea20 2024-05-28T06:05:52.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.837+0000 7f3ecea00640 1 -- 172.21.15.122:0/1707174175 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f3ed0016090 con 0x7f3ed815ea20 2024-05-28T06:05:52.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.837+0000 7f3edd400640 1 -- 172.21.15.122:0/1707174175 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3eb8068380 msgr2=0x7f3eb806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:52.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.837+0000 7f3edd400640 1 --2- 172.21.15.122:0/1707174175 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3eb8068380 0x7f3eb806a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8005c10 tx=0x7f3ec8009040 comp rx=0 tx=0).stop 2024-05-28T06:05:52.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.837+0000 7f3edd400640 1 -- 172.21.15.122:0/1707174175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ed815ea20 msgr2=0x7f3ed81572f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:52.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.837+0000 7f3edd400640 1 --2- 172.21.15.122:0/1707174175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ed815ea20 0x7f3ed81572f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00ae040 tx=0x7f3ed0019240 comp rx=0 tx=0).stop 2024-05-28T06:05:52.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.837+0000 7f3edd400640 1 -- 172.21.15.122:0/1707174175 shutdown_connections 2024-05-28T06:05:52.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.837+0000 7f3edd400640 1 --2- 172.21.15.122:0/1707174175 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3eb8068380 0x7f3eb806a840 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:52.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.837+0000 7f3edd400640 1 --2- 172.21.15.122:0/1707174175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ed815ea20 0x7f3ed81572f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:52.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.837+0000 7f3edd400640 1 --2- 172.21.15.122:0/1707174175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed80b36b0 0x7f3ed8156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:52.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.837+0000 7f3edd400640 1 --2- 172.21.15.122:0/1707174175 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ed8073c80 0x7f3ed814e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:52.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.837+0000 7f3edd400640 1 -- 172.21.15.122:0/1707174175 >> 172.21.15.122:0/1707174175 conn(0x7f3ed80b6c10 msgr2=0x7f3ed815da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:52.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.837+0000 7f3edd400640 1 -- 172.21.15.122:0/1707174175 shutdown_connections 2024-05-28T06:05:52.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.837+0000 7f3edd400640 1 -- 172.21.15.122:0/1707174175 wait complete. 2024-05-28T06:05:52.862 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-28T06:05:52.862 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:05:52.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc359800640 1 Processor -- start 2024-05-28T06:05:52.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc359800640 1 -- start start 2024-05-28T06:05:53.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc359800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc3540b5060 0x7fc35415cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc359800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc35406bbf0 con 0x7fc3540cc0e0 2024-05-28T06:05:53.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc359800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc35406be90 con 0x7fc3540b4c40 2024-05-28T06:05:53.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc359800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc35406c7c0 con 0x7fc3540b5060 2024-05-28T06:05:53.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc353e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fc3540cc0e0 0x7fc354160070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56248/0 (socket says 172.21.15.122:56248) 2024-05-28T06:05:53.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc353e00640 1 -- 172.21.15.122:0/1659230247 learned_addr learned my addr 172.21.15.122:0/1659230247 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:53.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc358e00640 1 --2- 172.21.15.122:0/1659230247 >> v2:172.21.15.153:3300/0 conn(0x7fc3540b5060 0x7fc35415cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:53.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc352a00640 1 -- 172.21.15.122:0/1659230247 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3733177620 0 0) 0x7fc35406bbf0 con 0x7fc3540cc0e0 2024-05-28T06:05:53.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc352a00640 1 -- 172.21.15.122:0/1659230247 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc338003530 con 0x7fc3540cc0e0 2024-05-28T06:05:53.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc352a00640 1 -- 172.21.15.122:0/1659230247 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2683328173 0 0) 0x7fc338003530 con 0x7fc3540cc0e0 2024-05-28T06:05:53.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc352a00640 1 -- 172.21.15.122:0/1659230247 >> v2:172.21.15.153:3300/0 conn(0x7fc3540b5060 msgr2=0x7fc35415cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:53.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc352a00640 1 --2- 172.21.15.122:0/1659230247 >> v2:172.21.15.153:3300/0 conn(0x7fc3540b5060 0x7fc35415cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc352a00640 1 -- 172.21.15.122:0/1659230247 >> v1:172.21.15.153:6789/0 conn(0x7fc3540b4c40 legacy=0x7fc3540cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:53.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc352a00640 1 -- 172.21.15.122:0/1659230247 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35406c170 con 0x7fc3540cc0e0 2024-05-28T06:05:53.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc352a00640 1 -- 172.21.15.122:0/1659230247 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7fc344001680 con 0x7fc3540cc0e0 2024-05-28T06:05:53.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc352a00640 1 -- 172.21.15.122:0/1659230247 >> v1:172.21.15.122:6789/0 conn(0x7fc3540cc0e0 legacy=0x7fc354160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:53.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc352a00640 1 --2- 172.21.15.122:0/1659230247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3380039c0 0x7fc338003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc352a00640 1 --2- 172.21.15.122:0/1659230247 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc338004810 0x7fc338004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc352a00640 1 --2- 172.21.15.122:0/1659230247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3380051d0 0x7fc33800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc352a00640 1 -- 172.21.15.122:0/1659230247 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc35406c7c0 con 0x7fc3380051d0 2024-05-28T06:05:53.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc352a00640 1 -- 172.21.15.122:0/1659230247 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc33800c070 con 0x7fc3380039c0 2024-05-28T06:05:53.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc352a00640 1 -- 172.21.15.122:0/1659230247 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc33800c270 con 0x7fc338004810 2024-05-28T06:05:53.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc358e00640 1 --2- 172.21.15.122:0/1659230247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3380051d0 0x7fc33800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:53.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc353e00640 1 --2- 172.21.15.122:0/1659230247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3380039c0 0x7fc338003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:53.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc353400640 1 --2- 172.21.15.122:0/1659230247 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc338004810 0x7fc338004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:53.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc358e00640 1 -- 172.21.15.122:0/1659230247 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc338004810 msgr2=0x7fc338004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:53.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc358e00640 1 --2- 172.21.15.122:0/1659230247 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc338004810 0x7fc338004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc358e00640 1 -- 172.21.15.122:0/1659230247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3380039c0 msgr2=0x7fc338003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:53.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc358e00640 1 --2- 172.21.15.122:0/1659230247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3380039c0 0x7fc338003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc358e00640 1 -- 172.21.15.122:0/1659230247 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc338003530 con 0x7fc3380051d0 2024-05-28T06:05:53.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:52.997+0000 7fc353e00640 1 --2- 172.21.15.122:0/1659230247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3380039c0 0x7fc338003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:05:53.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.001+0000 7fc358e00640 1 -- 172.21.15.122:0/1659230247 reap_dead start 2024-05-28T06:05:53.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.001+0000 7fc358e00640 1 --2- 172.21.15.122:0/1659230247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3380051d0 0x7fc33800b9d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc34c009f90 tx=0x7fc34c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60e97d537ed3e37 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:53.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.001+0000 7fc352a00640 1 -- 172.21.15.122:0/1659230247 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c0b2070 con 0x7fc3380051d0 2024-05-28T06:05:53.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.001+0000 7fc352a00640 1 -- 172.21.15.122:0/1659230247 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc34c0a5c90 con 0x7fc3380051d0 2024-05-28T06:05:53.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.001+0000 7fc352a00640 1 -- 172.21.15.122:0/1659230247 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c009c10 con 0x7fc3380051d0 2024-05-28T06:05:53.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.001+0000 7fc359800640 1 -- 172.21.15.122:0/1659230247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3380051d0 msgr2=0x7fc33800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:53.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.001+0000 7fc359800640 1 --2- 172.21.15.122:0/1659230247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3380051d0 0x7fc33800b9d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc34c009f90 tx=0x7fc34c01cc80 comp rx=0 tx=0).stop 2024-05-28T06:05:53.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.001+0000 7fc359800640 1 -- 172.21.15.122:0/1659230247 shutdown_connections 2024-05-28T06:05:53.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.001+0000 7fc359800640 1 --2- 172.21.15.122:0/1659230247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3380051d0 0x7fc33800b9d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.001+0000 7fc359800640 1 -- 172.21.15.122:0/1659230247 >> 172.21.15.122:0/1659230247 conn(0x7fc3540b20a0 msgr2=0x7fc3540b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:53.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.001+0000 7fc359800640 1 -- 172.21.15.122:0/1659230247 shutdown_connections 2024-05-28T06:05:53.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.001+0000 7fc359800640 1 -- 172.21.15.122:0/1659230247 wait complete. 2024-05-28T06:05:53.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.005+0000 7fc359800640 1 Processor -- start 2024-05-28T06:05:53.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.005+0000 7fc359800640 1 -- start start 2024-05-28T06:05:53.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.005+0000 7fc359800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3380051d0 0x7fc35415e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.005+0000 7fc359800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3541549a0 0x7fc35415dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.005+0000 7fc359800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc35414c220 0x7fc3540cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.005+0000 7fc359800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc3540cc4c0 con 0x7fc35414c220 2024-05-28T06:05:53.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.005+0000 7fc359800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc35406b990 con 0x7fc3541549a0 2024-05-28T06:05:53.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.005+0000 7fc359800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc3540b40c0 con 0x7fc3380051d0 2024-05-28T06:05:53.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.005+0000 7fc358e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc35414c220 0x7fc3540cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:53.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.005+0000 7fc358e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc35414c220 0x7fc3540cc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36204/0 (socket says 172.21.15.122:36204) 2024-05-28T06:05:53.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.005+0000 7fc358e00640 1 -- 172.21.15.122:0/1022014912 learned_addr learned my addr 172.21.15.122:0/1022014912 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:53.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.005+0000 7fc358e00640 1 -- 172.21.15.122:0/1022014912 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3380051d0 msgr2=0x7fc35415e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:53.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.005+0000 7fc358e00640 1 --2- 172.21.15.122:0/1022014912 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3380051d0 0x7fc35415e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.005+0000 7fc358e00640 1 -- 172.21.15.122:0/1022014912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3541549a0 msgr2=0x7fc35415dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:53.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.005+0000 7fc358e00640 1 --2- 172.21.15.122:0/1022014912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3541549a0 0x7fc35415dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.005+0000 7fc358e00640 1 -- 172.21.15.122:0/1022014912 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35415e170 con 0x7fc35414c220 2024-05-28T06:05:53.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.005+0000 7fc358e00640 1 --2- 172.21.15.122:0/1022014912 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc35414c220 0x7fc3540cc700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc34c01cab0 tx=0x7fc34c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:53.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.005+0000 7fc34be00640 1 -- 172.21.15.122:0/1022014912 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c0b2040 con 0x7fc35414c220 2024-05-28T06:05:53.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.005+0000 7fc34be00640 1 -- 172.21.15.122:0/1022014912 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc34c0a6e50 con 0x7fc35414c220 2024-05-28T06:05:53.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.005+0000 7fc34be00640 1 -- 172.21.15.122:0/1022014912 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c0adca0 con 0x7fc35414c220 2024-05-28T06:05:53.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.005+0000 7fc359800640 1 -- 172.21.15.122:0/1022014912 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc35414cc30 con 0x7fc35414c220 2024-05-28T06:05:53.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.005+0000 7fc359800640 1 -- 172.21.15.122:0/1022014912 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc35415d150 con 0x7fc35414c220 2024-05-28T06:05:53.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.009+0000 7fc359800640 1 -- 172.21.15.122:0/1022014912 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc354075620 con 0x7fc35414c220 2024-05-28T06:05:53.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.009+0000 7fc34be00640 1 -- 172.21.15.122:0/1022014912 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc34c0c0030 con 0x7fc35414c220 2024-05-28T06:05:53.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.009+0000 7fc34be00640 1 --2- 172.21.15.122:0/1022014912 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc334068380 0x7fc33406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.009+0000 7fc34be00640 1 -- 172.21.15.122:0/1022014912 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc34c121320 con 0x7fc35414c220 2024-05-28T06:05:53.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.009+0000 7fc353e00640 1 --2- 172.21.15.122:0/1022014912 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc334068380 0x7fc33406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:53.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.009+0000 7fc353e00640 1 --2- 172.21.15.122:0/1022014912 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc334068380 0x7fc33406a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc344001ec0 tx=0x7fc344000ee0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:53.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.013+0000 7fc34be00640 1 -- 172.21.15.122:0/1022014912 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc34c0c7060 con 0x7fc35414c220 2024-05-28T06:05:53.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.205+0000 7fc359800640 1 -- 172.21.15.122:0/1022014912 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3540cb3b0 con 0x7fc35414c220 2024-05-28T06:05:53.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.205+0000 7fc34be00640 1 -- 172.21.15.122:0/1022014912 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7fc35415e170 con 0x7fc35414c220 2024-05-28T06:05:53.207 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:05:53.207 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4177682646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4177682646},{"type":"v1","addr":"172.21.15.153:6835","nonce":4177682646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3318983491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3318983491},{"type":"v1","addr":"172.21.15.153:6834","nonce":3318983491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/360722760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":360722760},{"type":"v1","addr":"172.21.15.122:6836","nonce":360722760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-28T06:05:49.194771+0000","modified":"2024-05-28T06:05:52.203797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1474216380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1474216380},{"type":"v1","addr":"172.21.15.122:6837","nonce":1474216380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4270,"qdb_cluster":[4270]},"id":1}]} 2024-05-28T06:05:53.207 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 8 2024-05-28T06:05:53.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.205+0000 7fc359800640 1 -- 172.21.15.122:0/1022014912 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc334068380 msgr2=0x7fc33406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:53.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.205+0000 7fc359800640 1 --2- 172.21.15.122:0/1022014912 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc334068380 0x7fc33406a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc344001ec0 tx=0x7fc344000ee0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.205+0000 7fc359800640 1 -- 172.21.15.122:0/1022014912 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc35414c220 msgr2=0x7fc3540cc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:53.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.205+0000 7fc359800640 1 --2- 172.21.15.122:0/1022014912 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc35414c220 0x7fc3540cc700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc34c01cab0 tx=0x7fc34c009750 comp rx=0 tx=0).stop 2024-05-28T06:05:53.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.205+0000 7fc359800640 1 -- 172.21.15.122:0/1022014912 shutdown_connections 2024-05-28T06:05:53.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.205+0000 7fc359800640 1 --2- 172.21.15.122:0/1022014912 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc334068380 0x7fc33406a840 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.205+0000 7fc359800640 1 --2- 172.21.15.122:0/1022014912 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc35414c220 0x7fc3540cc700 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.205+0000 7fc359800640 1 --2- 172.21.15.122:0/1022014912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3541549a0 0x7fc35415dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.205+0000 7fc359800640 1 --2- 172.21.15.122:0/1022014912 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3380051d0 0x7fc35415e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.205+0000 7fc359800640 1 -- 172.21.15.122:0/1022014912 >> 172.21.15.122:0/1022014912 conn(0x7fc3540b20a0 msgr2=0x7fc35415f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:53.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.205+0000 7fc359800640 1 -- 172.21.15.122:0/1022014912 shutdown_connections 2024-05-28T06:05:53.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.205+0000 7fc359800640 1 -- 172.21.15.122:0/1022014912 wait complete. 2024-05-28T06:05:53.228 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:05:53.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.361+0000 7fdb2d600640 1 Processor -- start 2024-05-28T06:05:53.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.361+0000 7fdb2d600640 1 -- start start 2024-05-28T06:05:53.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.361+0000 7fdb2d600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb280cff30 0x7fdb2806f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.361+0000 7fdb2d600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdb280cdb00 0x7fdb280b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.361+0000 7fdb2d600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb280d0310 con 0x7fdb2806f6c0 2024-05-28T06:05:53.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.361+0000 7fdb2d600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fdb2806fb00 con 0x7fdb280cdb00 2024-05-28T06:05:53.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.361+0000 7fdb2d600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdb280cdf30 con 0x7fdb280cff30 2024-05-28T06:05:53.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.361+0000 7fdb26000640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fdb2806f6c0 0x7fdb280cd3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56250/0 (socket says 172.21.15.122:56250) 2024-05-28T06:05:53.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.361+0000 7fdb26000640 1 -- 172.21.15.122:0/3519644596 learned_addr learned my addr 172.21.15.122:0/3519644596 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:53.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb26a00640 1 --2- 172.21.15.122:0/3519644596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb280cff30 0x7fdb2806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:53.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb27400640 1 --2- 172.21.15.122:0/3519644596 >> v2:172.21.15.153:3300/0 conn(0x7fdb280cdb00 0x7fdb280b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:53.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb25600640 1 -- 172.21.15.122:0/3519644596 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2755414444 0 0) 0x7fdb280d0310 con 0x7fdb2806f6c0 2024-05-28T06:05:53.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb25600640 1 -- 172.21.15.122:0/3519644596 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb0c003530 con 0x7fdb2806f6c0 2024-05-28T06:05:53.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb25600640 1 -- 172.21.15.122:0/3519644596 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3281269767 0 0) 0x7fdb0c003530 con 0x7fdb2806f6c0 2024-05-28T06:05:53.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb25600640 1 -- 172.21.15.122:0/3519644596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb280cff30 msgr2=0x7fdb2806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:53.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb25600640 1 --2- 172.21.15.122:0/3519644596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb280cff30 0x7fdb2806f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb25600640 1 -- 172.21.15.122:0/3519644596 >> v2:172.21.15.153:3300/0 conn(0x7fdb280cdb00 msgr2=0x7fdb280b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:53.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb25600640 1 --2- 172.21.15.122:0/3519644596 >> v2:172.21.15.153:3300/0 conn(0x7fdb280cdb00 0x7fdb280b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb25600640 1 -- 172.21.15.122:0/3519644596 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb2815be20 con 0x7fdb2806f6c0 2024-05-28T06:05:53.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb25600640 1 -- 172.21.15.122:0/3519644596 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7fdb140016a0 con 0x7fdb2806f6c0 2024-05-28T06:05:53.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb25600640 1 -- 172.21.15.122:0/3519644596 >> v1:172.21.15.122:6789/0 conn(0x7fdb2806f6c0 legacy=0x7fdb280cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:53.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb25600640 1 --2- 172.21.15.122:0/3519644596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb0c0039c0 0x7fdb0c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb25600640 1 --2- 172.21.15.122:0/3519644596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb280cff30 0x7fdb0c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb25600640 1 --2- 172.21.15.122:0/3519644596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb0c004d50 0x7fdb0c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb25600640 1 -- 172.21.15.122:0/3519644596 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2806fb00 con 0x7fdb0c004d50 2024-05-28T06:05:53.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb25600640 1 -- 172.21.15.122:0/3519644596 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdb280cdf30 con 0x7fdb0c0039c0 2024-05-28T06:05:53.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb25600640 1 -- 172.21.15.122:0/3519644596 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdb0c00dbe0 con 0x7fdb280cff30 2024-05-28T06:05:53.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb26a00640 1 --2- 172.21.15.122:0/3519644596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb0c0039c0 0x7fdb0c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:53.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb27400640 1 --2- 172.21.15.122:0/3519644596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb0c004d50 0x7fdb0c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:53.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb26000640 1 --2- 172.21.15.122:0/3519644596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb280cff30 0x7fdb0c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:53.370 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb26a00640 1 -- 172.21.15.122:0/3519644596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb280cff30 msgr2=0x7fdb0c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:53.370 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb26a00640 1 --2- 172.21.15.122:0/3519644596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb280cff30 0x7fdb0c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.370 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb26a00640 1 -- 172.21.15.122:0/3519644596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb0c004d50 msgr2=0x7fdb0c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:53.370 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb26a00640 1 --2- 172.21.15.122:0/3519644596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb0c004d50 0x7fdb0c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.370 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb26a00640 1 -- 172.21.15.122:0/3519644596 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0c003530 con 0x7fdb0c0039c0 2024-05-28T06:05:53.370 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.365+0000 7fdb27400640 1 --2- 172.21.15.122:0/3519644596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb0c004d50 0x7fdb0c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:05:53.371 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.369+0000 7fdb26a00640 1 --2- 172.21.15.122:0/3519644596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb0c0039c0 0x7fdb0c003de0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009fc0 tx=0x7fdb1801cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66b0722ef970c02a server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:53.371 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.369+0000 7fdb25600640 1 -- 172.21.15.122:0/3519644596 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb180b2070 con 0x7fdb0c0039c0 2024-05-28T06:05:53.371 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.369+0000 7fdb25600640 1 -- 172.21.15.122:0/3519644596 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb180a5c90 con 0x7fdb0c0039c0 2024-05-28T06:05:53.371 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.369+0000 7fdb25600640 1 -- 172.21.15.122:0/3519644596 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb18009c10 con 0x7fdb0c0039c0 2024-05-28T06:05:53.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.369+0000 7fdb2d600640 1 -- 172.21.15.122:0/3519644596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb0c0039c0 msgr2=0x7fdb0c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:53.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.369+0000 7fdb2d600640 1 --2- 172.21.15.122:0/3519644596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb0c0039c0 0x7fdb0c003de0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009fc0 tx=0x7fdb1801cc80 comp rx=0 tx=0).stop 2024-05-28T06:05:53.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.369+0000 7fdb27400640 1 -- 172.21.15.122:0/3519644596 reap_dead start 2024-05-28T06:05:53.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.369+0000 7fdb2d600640 1 -- 172.21.15.122:0/3519644596 shutdown_connections 2024-05-28T06:05:53.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.369+0000 7fdb2d600640 1 -- 172.21.15.122:0/3519644596 >> 172.21.15.122:0/3519644596 conn(0x7fdb2806bd90 msgr2=0x7fdb2806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:53.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.369+0000 7fdb2d600640 1 -- 172.21.15.122:0/3519644596 shutdown_connections 2024-05-28T06:05:53.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.369+0000 7fdb2d600640 1 -- 172.21.15.122:0/3519644596 wait complete. 2024-05-28T06:05:53.373 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.369+0000 7fdb2d600640 1 Processor -- start 2024-05-28T06:05:53.373 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.369+0000 7fdb2d600640 1 -- start start 2024-05-28T06:05:53.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb2d600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb0c0039c0 0x7fdb28143cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb2d600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb281f39a0 0x7fdb281f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb2d600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb28158760 0x7fdb28158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb2d600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2815c6c0 con 0x7fdb281f39a0 2024-05-28T06:05:53.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb2d600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2815c3e0 con 0x7fdb0c0039c0 2024-05-28T06:05:53.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb2d600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdb2815baf0 con 0x7fdb28158760 2024-05-28T06:05:53.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb26000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb281f39a0 0x7fdb281f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:53.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb26000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb281f39a0 0x7fdb281f3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36216/0 (socket says 172.21.15.122:36216) 2024-05-28T06:05:53.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb26000640 1 -- 172.21.15.122:0/3663116606 learned_addr learned my addr 172.21.15.122:0/3663116606 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:53.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb26a00640 1 --2- 172.21.15.122:0/3663116606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb0c0039c0 0x7fdb28143cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:53.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb27400640 1 --2- 172.21.15.122:0/3663116606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb28158760 0x7fdb28158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:53.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb26000640 1 -- 172.21.15.122:0/3663116606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb28158760 msgr2=0x7fdb28158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:53.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb26000640 1 --2- 172.21.15.122:0/3663116606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb28158760 0x7fdb28158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb26000640 1 -- 172.21.15.122:0/3663116606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb0c0039c0 msgr2=0x7fdb28143cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:53.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb26000640 1 --2- 172.21.15.122:0/3663116606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb0c0039c0 0x7fdb28143cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb26000640 1 -- 172.21.15.122:0/3663116606 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb281f4440 con 0x7fdb281f39a0 2024-05-28T06:05:53.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb26000640 1 --2- 172.21.15.122:0/3663116606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb281f39a0 0x7fdb281f3e20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdb140073a0 tx=0x7fdb14007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:53.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb1ea00640 1 -- 172.21.15.122:0/3663116606 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1401a070 con 0x7fdb281f39a0 2024-05-28T06:05:53.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb1ea00640 1 -- 172.21.15.122:0/3663116606 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb1400f930 con 0x7fdb281f39a0 2024-05-28T06:05:53.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb2d600640 1 -- 172.21.15.122:0/3663116606 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb281f4720 con 0x7fdb281f39a0 2024-05-28T06:05:53.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb1ea00640 1 -- 172.21.15.122:0/3663116606 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1400fd20 con 0x7fdb281f39a0 2024-05-28T06:05:53.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb2d600640 1 -- 172.21.15.122:0/3663116606 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb280b0240 con 0x7fdb281f39a0 2024-05-28T06:05:53.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb2d600640 1 -- 172.21.15.122:0/3663116606 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb280b0440 con 0x7fdb281f39a0 2024-05-28T06:05:53.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.373+0000 7fdb1ea00640 1 -- 172.21.15.122:0/3663116606 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdb1401e3f0 con 0x7fdb281f39a0 2024-05-28T06:05:53.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.377+0000 7fdb1ea00640 1 --2- 172.21.15.122:0/3663116606 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdb080683b0 0x7fdb0806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.377+0000 7fdb1ea00640 1 -- 172.21.15.122:0/3663116606 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdb140860d0 con 0x7fdb281f39a0 2024-05-28T06:05:53.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.377+0000 7fdb26a00640 1 --2- 172.21.15.122:0/3663116606 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdb080683b0 0x7fdb0806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:53.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.377+0000 7fdb26a00640 1 --2- 172.21.15.122:0/3663116606 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdb080683b0 0x7fdb0806a870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdb180af000 tx=0x7fdb18004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:53.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.381+0000 7fdb1ea00640 1 -- 172.21.15.122:0/3663116606 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdb280b0440 con 0x7fdb281f39a0 2024-05-28T06:05:53.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.537+0000 7fdb2d600640 1 -- 172.21.15.122:0/3663116606 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb280afd50 con 0x7fdb281f39a0 2024-05-28T06:05:53.541 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.537+0000 7fdb1ea00640 1 -- 172.21.15.122:0/3663116606 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fdb140560e0 con 0x7fdb281f39a0 2024-05-28T06:05:53.541 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:05:53.541 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":20,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:05:50.822555+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:05:47.441193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-28T06:05:48.148164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:05:53.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.541+0000 7fdb2d600640 1 -- 172.21.15.122:0/3663116606 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdb080683b0 msgr2=0x7fdb0806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:53.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.541+0000 7fdb2d600640 1 --2- 172.21.15.122:0/3663116606 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdb080683b0 0x7fdb0806a870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdb180af000 tx=0x7fdb18004ac0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.541+0000 7fdb2d600640 1 -- 172.21.15.122:0/3663116606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb281f39a0 msgr2=0x7fdb281f3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:53.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.541+0000 7fdb2d600640 1 --2- 172.21.15.122:0/3663116606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb281f39a0 0x7fdb281f3e20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdb140073a0 tx=0x7fdb14007860 comp rx=0 tx=0).stop 2024-05-28T06:05:53.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.541+0000 7fdb2d600640 1 -- 172.21.15.122:0/3663116606 shutdown_connections 2024-05-28T06:05:53.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.541+0000 7fdb2d600640 1 --2- 172.21.15.122:0/3663116606 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdb080683b0 0x7fdb0806a870 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.541+0000 7fdb2d600640 1 --2- 172.21.15.122:0/3663116606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb28158760 0x7fdb28158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.541+0000 7fdb2d600640 1 --2- 172.21.15.122:0/3663116606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb281f39a0 0x7fdb281f3e20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.541+0000 7fdb2d600640 1 --2- 172.21.15.122:0/3663116606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb0c0039c0 0x7fdb28143cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.541+0000 7fdb2d600640 1 -- 172.21.15.122:0/3663116606 >> 172.21.15.122:0/3663116606 conn(0x7fdb2806bd90 msgr2=0x7fdb2815b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:53.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.541+0000 7fdb2d600640 1 -- 172.21.15.122:0/3663116606 shutdown_connections 2024-05-28T06:05:53.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.541+0000 7fdb2d600640 1 -- 172.21.15.122:0/3663116606 wait complete. 2024-05-28T06:05:53.563 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-28T06:05:53.563 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-28T06:05:53.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff071c00640 1 Processor -- start 2024-05-28T06:05:53.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff071c00640 1 -- start start 2024-05-28T06:05:53.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff071c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff06c09b800 0x7ff06c15d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff071c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff06c0d0830 con 0x7ff06c0d0c80 2024-05-28T06:05:53.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff071c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff06c09aa40 con 0x7ff06c0d0270 2024-05-28T06:05:53.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff071c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff06c09ad20 con 0x7ff06c09b800 2024-05-28T06:05:53.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff06aa00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7ff06c0d0c80 0x7ff06c0d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56256/0 (socket says 172.21.15.122:56256) 2024-05-28T06:05:53.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff06aa00640 1 -- 172.21.15.122:0/4020281039 learned_addr learned my addr 172.21.15.122:0/4020281039 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:53.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff06b400640 1 --2- 172.21.15.122:0/4020281039 >> v2:172.21.15.153:3300/0 conn(0x7ff06c09b800 0x7ff06c15d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:53.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff069600640 1 -- 172.21.15.122:0/4020281039 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3903992836 0 0) 0x7ff06c0d0830 con 0x7ff06c0d0c80 2024-05-28T06:05:53.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff069600640 1 -- 172.21.15.122:0/4020281039 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff050003530 con 0x7ff06c0d0c80 2024-05-28T06:05:53.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff069600640 1 -- 172.21.15.122:0/4020281039 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1824598832 0 0) 0x7ff050003530 con 0x7ff06c0d0c80 2024-05-28T06:05:53.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff069600640 1 -- 172.21.15.122:0/4020281039 >> v2:172.21.15.153:3300/0 conn(0x7ff06c09b800 msgr2=0x7ff06c15d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:53.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff069600640 1 --2- 172.21.15.122:0/4020281039 >> v2:172.21.15.153:3300/0 conn(0x7ff06c09b800 0x7ff06c15d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff069600640 1 -- 172.21.15.122:0/4020281039 >> v1:172.21.15.153:6789/0 conn(0x7ff06c0d0270 legacy=0x7ff06c0cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:53.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff069600640 1 -- 172.21.15.122:0/4020281039 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff06c09b000 con 0x7ff06c0d0c80 2024-05-28T06:05:53.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff069600640 1 -- 172.21.15.122:0/4020281039 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7ff05c001680 con 0x7ff06c0d0c80 2024-05-28T06:05:53.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff069600640 1 -- 172.21.15.122:0/4020281039 >> v1:172.21.15.122:6789/0 conn(0x7ff06c0d0c80 legacy=0x7ff06c0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:53.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff069600640 1 --2- 172.21.15.122:0/4020281039 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0500039c0 0x7ff050003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff069600640 1 --2- 172.21.15.122:0/4020281039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff050004810 0x7ff050004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff069600640 1 --2- 172.21.15.122:0/4020281039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0500051d0 0x7ff05000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff069600640 1 -- 172.21.15.122:0/4020281039 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c09ad20 con 0x7ff0500039c0 2024-05-28T06:05:53.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff069600640 1 -- 172.21.15.122:0/4020281039 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff05000c170 con 0x7ff0500051d0 2024-05-28T06:05:53.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff069600640 1 -- 172.21.15.122:0/4020281039 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff05000c370 con 0x7ff050004810 2024-05-28T06:05:53.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff06aa00640 1 --2- 172.21.15.122:0/4020281039 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0500039c0 0x7ff050003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:53.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff06aa00640 1 -- 172.21.15.122:0/4020281039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff050004810 msgr2=0x7ff050004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:53.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff06aa00640 1 --2- 172.21.15.122:0/4020281039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff050004810 0x7ff050004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff06aa00640 1 -- 172.21.15.122:0/4020281039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0500051d0 msgr2=0x7ff05000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:53.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff06aa00640 1 --2- 172.21.15.122:0/4020281039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0500051d0 0x7ff05000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff06b400640 1 -- 172.21.15.122:0/4020281039 reap_dead start 2024-05-28T06:05:53.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.697+0000 7ff06aa00640 1 -- 172.21.15.122:0/4020281039 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff050003530 con 0x7ff0500039c0 2024-05-28T06:05:53.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.701+0000 7ff06aa00640 1 --2- 172.21.15.122:0/4020281039 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0500039c0 0x7ff050003de0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff05c00c210 tx=0x7ff05c01cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e43ab1d581fb6475 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:53.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.701+0000 7ff069600640 1 -- 172.21.15.122:0/4020281039 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff05c007d40 con 0x7ff0500039c0 2024-05-28T06:05:53.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.701+0000 7ff069600640 1 -- 172.21.15.122:0/4020281039 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff05c0a9070 con 0x7ff0500039c0 2024-05-28T06:05:53.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.701+0000 7ff069600640 1 -- 172.21.15.122:0/4020281039 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff05c005d80 con 0x7ff0500039c0 2024-05-28T06:05:53.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.701+0000 7ff071c00640 1 -- 172.21.15.122:0/4020281039 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0500039c0 msgr2=0x7ff050003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:53.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.701+0000 7ff071c00640 1 --2- 172.21.15.122:0/4020281039 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0500039c0 0x7ff050003de0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff05c00c210 tx=0x7ff05c01cc70 comp rx=0 tx=0).stop 2024-05-28T06:05:53.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.701+0000 7ff071c00640 1 -- 172.21.15.122:0/4020281039 shutdown_connections 2024-05-28T06:05:53.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.701+0000 7ff071c00640 1 --2- 172.21.15.122:0/4020281039 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0500039c0 0x7ff050003de0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.701+0000 7ff071c00640 1 -- 172.21.15.122:0/4020281039 >> 172.21.15.122:0/4020281039 conn(0x7ff06c0b4190 msgr2=0x7ff06c0b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:53.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.701+0000 7ff071c00640 1 -- 172.21.15.122:0/4020281039 shutdown_connections 2024-05-28T06:05:53.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.701+0000 7ff071c00640 1 -- 172.21.15.122:0/4020281039 wait complete. 2024-05-28T06:05:53.707 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.705+0000 7ff071c00640 1 Processor -- start 2024-05-28T06:05:53.707 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.705+0000 7ff071c00640 1 -- start start 2024-05-28T06:05:53.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.705+0000 7ff071c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0500039c0 0x7ff06c151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.705+0000 7ff071c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff06c0af3a0 0x7ff06c0af820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.705+0000 7ff071c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff06c0b6db0 0x7ff06c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.705+0000 7ff071c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c0d1470 con 0x7ff0500039c0 2024-05-28T06:05:53.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.705+0000 7ff071c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c09bbe0 con 0x7ff06c0b6db0 2024-05-28T06:05:53.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.705+0000 7ff071c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff06c0d15f0 con 0x7ff06c0af3a0 2024-05-28T06:05:53.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.705+0000 7ff06aa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0500039c0 0x7ff06c151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:53.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.705+0000 7ff06aa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0500039c0 0x7ff06c151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36246/0 (socket says 172.21.15.122:36246) 2024-05-28T06:05:53.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.705+0000 7ff06aa00640 1 -- 172.21.15.122:0/3122651915 learned_addr learned my addr 172.21.15.122:0/3122651915 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:53.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.705+0000 7ff06aa00640 1 -- 172.21.15.122:0/3122651915 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff06c0af3a0 msgr2=0x7ff06c0af820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:53.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.705+0000 7ff06aa00640 1 --2- 172.21.15.122:0/3122651915 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff06c0af3a0 0x7ff06c0af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.705+0000 7ff06aa00640 1 -- 172.21.15.122:0/3122651915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff06c0b6db0 msgr2=0x7ff06c0b7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:53.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.705+0000 7ff06aa00640 1 --2- 172.21.15.122:0/3122651915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff06c0b6db0 0x7ff06c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.705+0000 7ff06aa00640 1 -- 172.21.15.122:0/3122651915 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff06c1523c0 con 0x7ff0500039c0 2024-05-28T06:05:53.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.705+0000 7ff06aa00640 1 --2- 172.21.15.122:0/3122651915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0500039c0 0x7ff06c151a00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff05c01caa0 tx=0x7ff050005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:53.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.705+0000 7ff062a00640 1 -- 172.21.15.122:0/3122651915 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff05c0bc070 con 0x7ff0500039c0 2024-05-28T06:05:53.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.705+0000 7ff062a00640 1 -- 172.21.15.122:0/3122651915 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff05c000ee0 con 0x7ff0500039c0 2024-05-28T06:05:53.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.705+0000 7ff062a00640 1 -- 172.21.15.122:0/3122651915 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff05c007d40 con 0x7ff0500039c0 2024-05-28T06:05:53.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.705+0000 7ff071c00640 1 -- 172.21.15.122:0/3122651915 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff06c0b7b30 con 0x7ff0500039c0 2024-05-28T06:05:53.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.705+0000 7ff071c00640 1 -- 172.21.15.122:0/3122651915 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff06c0b1850 con 0x7ff0500039c0 2024-05-28T06:05:53.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.709+0000 7ff071c00640 1 -- 172.21.15.122:0/3122651915 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff06c068c40 con 0x7ff0500039c0 2024-05-28T06:05:53.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.709+0000 7ff062a00640 1 -- 172.21.15.122:0/3122651915 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff05c001480 con 0x7ff0500039c0 2024-05-28T06:05:53.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.709+0000 7ff062a00640 1 --2- 172.21.15.122:0/3122651915 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff04c0683b0 0x7ff04c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:53.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.709+0000 7ff062a00640 1 -- 172.21.15.122:0/3122651915 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff05c11fe10 con 0x7ff0500039c0 2024-05-28T06:05:53.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.709+0000 7ff06a000640 1 --2- 172.21.15.122:0/3122651915 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff04c0683b0 0x7ff04c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:53.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.709+0000 7ff06a000640 1 --2- 172.21.15.122:0/3122651915 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff04c0683b0 0x7ff04c06a870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff058007fd0 tx=0x7ff0580079e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:53.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.713+0000 7ff062a00640 1 -- 172.21.15.122:0/3122651915 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff05c123030 con 0x7ff0500039c0 2024-05-28T06:05:53.784 INFO:tasks.ceph.mds.a.smithi122.stderr:2024-05-28T06:05:53.781+0000 7f11e3c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-28T06:05:53.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.869+0000 7ff071c00640 1 -- 172.21.15.122:0/3122651915 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff06c076020 con 0x7ff04c0683b0 2024-05-28T06:05:53.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.877+0000 7ff062a00640 1 -- 172.21.15.122:0/3122651915 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7ff058055840 con 0x7ff04c0683b0 2024-05-28T06:05:53.883 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:05:53.885 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-05-28T06:05:53.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.881+0000 7ff071c00640 1 -- 172.21.15.122:0/3122651915 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff04c0683b0 msgr2=0x7ff04c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:53.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.881+0000 7ff071c00640 1 --2- 172.21.15.122:0/3122651915 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff04c0683b0 0x7ff04c06a870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff058007fd0 tx=0x7ff0580079e0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.881+0000 7ff071c00640 1 -- 172.21.15.122:0/3122651915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0500039c0 msgr2=0x7ff06c151a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:53.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.881+0000 7ff071c00640 1 --2- 172.21.15.122:0/3122651915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0500039c0 0x7ff06c151a00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff05c01caa0 tx=0x7ff050005840 comp rx=0 tx=0).stop 2024-05-28T06:05:53.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.881+0000 7ff071c00640 1 -- 172.21.15.122:0/3122651915 shutdown_connections 2024-05-28T06:05:53.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.881+0000 7ff071c00640 1 --2- 172.21.15.122:0/3122651915 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff04c0683b0 0x7ff04c06a870 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.881+0000 7ff071c00640 1 --2- 172.21.15.122:0/3122651915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff06c0b6db0 0x7ff06c0b7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.881+0000 7ff071c00640 1 --2- 172.21.15.122:0/3122651915 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff06c0af3a0 0x7ff06c0af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.881+0000 7ff071c00640 1 --2- 172.21.15.122:0/3122651915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0500039c0 0x7ff06c151a00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:53.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.881+0000 7ff071c00640 1 -- 172.21.15.122:0/3122651915 >> 172.21.15.122:0/3122651915 conn(0x7ff06c0b4190 msgr2=0x7ff06c15f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:53.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.881+0000 7ff071c00640 1 -- 172.21.15.122:0/3122651915 shutdown_connections 2024-05-28T06:05:53.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:53.881+0000 7ff071c00640 1 -- 172.21.15.122:0/3122651915 wait complete. 2024-05-28T06:05:53.903 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-28T06:05:53.244467+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218976,"kb_used_data":2788,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755744,"statfs":{"total":773094113280,"available":772869881856,"internally_reserved":0,"allocated":2854912,"data_stored":1734128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.449753"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619807+0000","last_change":"2024-05-28T06:05:49.850357+0000","last_active":"2024-05-28T06:05:51.619807+0000","last_peered":"2024-05-28T06:05:51.619807+0000","last_clean":"2024-05-28T06:05:51.619807+0000","last_became_active":"2024-05-28T06:05:49.850082+0000","last_became_peered":"2024-05-28T06:05:49.850082+0000","last_unstale":"2024-05-28T06:05:51.619807+0000","last_undegraded":"2024-05-28T06:05:51.619807+0000","last_fullsized":"2024-05-28T06:05:51.619807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:58:07.996206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.847064+0000","last_change":"2024-05-28T06:05:49.836997+0000","last_active":"2024-05-28T06:05:50.847064+0000","last_peered":"2024-05-28T06:05:50.847064+0000","last_clean":"2024-05-28T06:05:50.847064+0000","last_became_active":"2024-05-28T06:05:49.836057+0000","last_became_peered":"2024-05-28T06:05:49.836057+0000","last_unstale":"2024-05-28T06:05:50.847064+0000","last_undegraded":"2024-05-28T06:05:50.847064+0000","last_fullsized":"2024-05-28T06:05:50.847064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:05.258933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620342+0000","last_change":"2024-05-28T06:05:49.842388+0000","last_active":"2024-05-28T06:05:51.620342+0000","last_peered":"2024-05-28T06:05:51.620342+0000","last_clean":"2024-05-28T06:05:51.620342+0000","last_became_active":"2024-05-28T06:05:49.833739+0000","last_became_peered":"2024-05-28T06:05:49.833739+0000","last_unstale":"2024-05-28T06:05:51.620342+0000","last_undegraded":"2024-05-28T06:05:51.620342+0000","last_fullsized":"2024-05-28T06:05:51.620342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:45:56.563383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830740+0000","last_change":"2024-05-28T06:05:49.836000+0000","last_active":"2024-05-28T06:05:50.830740+0000","last_peered":"2024-05-28T06:05:50.830740+0000","last_clean":"2024-05-28T06:05:50.830740+0000","last_became_active":"2024-05-28T06:05:49.835023+0000","last_became_peered":"2024-05-28T06:05:49.835023+0000","last_unstale":"2024-05-28T06:05:50.830740+0000","last_undegraded":"2024-05-28T06:05:50.830740+0000","last_fullsized":"2024-05-28T06:05:50.830740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:47:59.969773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619431+0000","last_change":"2024-05-28T06:05:49.842728+0000","last_active":"2024-05-28T06:05:51.619431+0000","last_peered":"2024-05-28T06:05:51.619431+0000","last_clean":"2024-05-28T06:05:51.619431+0000","last_became_active":"2024-05-28T06:05:49.842348+0000","last_became_peered":"2024-05-28T06:05:49.842348+0000","last_unstale":"2024-05-28T06:05:51.619431+0000","last_undegraded":"2024-05-28T06:05:51.619431+0000","last_fullsized":"2024-05-28T06:05:51.619431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:57:50.858798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830496+0000","last_change":"2024-05-28T06:05:49.831551+0000","last_active":"2024-05-28T06:05:50.830496+0000","last_peered":"2024-05-28T06:05:50.830496+0000","last_clean":"2024-05-28T06:05:50.830496+0000","last_became_active":"2024-05-28T06:05:49.831275+0000","last_became_peered":"2024-05-28T06:05:49.831275+0000","last_unstale":"2024-05-28T06:05:50.830496+0000","last_undegraded":"2024-05-28T06:05:50.830496+0000","last_fullsized":"2024-05-28T06:05:50.830496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:05.258933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619374+0000","last_change":"2024-05-28T06:05:49.833865+0000","last_active":"2024-05-28T06:05:51.619374+0000","last_peered":"2024-05-28T06:05:51.619374+0000","last_clean":"2024-05-28T06:05:51.619374+0000","last_became_active":"2024-05-28T06:05:49.833613+0000","last_became_peered":"2024-05-28T06:05:49.833613+0000","last_unstale":"2024-05-28T06:05:51.619374+0000","last_undegraded":"2024-05-28T06:05:51.619374+0000","last_fullsized":"2024-05-28T06:05:51.619374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:47:59.969773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619570+0000","last_change":"2024-05-28T06:05:49.832366+0000","last_active":"2024-05-28T06:05:51.619570+0000","last_peered":"2024-05-28T06:05:51.619570+0000","last_clean":"2024-05-28T06:05:51.619570+0000","last_became_active":"2024-05-28T06:05:49.832055+0000","last_became_peered":"2024-05-28T06:05:49.832055+0000","last_unstale":"2024-05-28T06:05:51.619570+0000","last_undegraded":"2024-05-28T06:05:51.619570+0000","last_fullsized":"2024-05-28T06:05:51.619570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:45:56.563383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619839+0000","last_change":"2024-05-28T06:05:49.845929+0000","last_active":"2024-05-28T06:05:51.619839+0000","last_peered":"2024-05-28T06:05:51.619839+0000","last_clean":"2024-05-28T06:05:51.619839+0000","last_became_active":"2024-05-28T06:05:49.845642+0000","last_became_peered":"2024-05-28T06:05:49.845642+0000","last_unstale":"2024-05-28T06:05:51.619839+0000","last_undegraded":"2024-05-28T06:05:51.619839+0000","last_fullsized":"2024-05-28T06:05:51.619839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:25:16.860803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849143+0000","last_change":"2024-05-28T06:05:49.840616+0000","last_active":"2024-05-28T06:05:50.849143+0000","last_peered":"2024-05-28T06:05:50.849143+0000","last_clean":"2024-05-28T06:05:50.849143+0000","last_became_active":"2024-05-28T06:05:49.840364+0000","last_became_peered":"2024-05-28T06:05:49.840364+0000","last_unstale":"2024-05-28T06:05:50.849143+0000","last_undegraded":"2024-05-28T06:05:50.849143+0000","last_fullsized":"2024-05-28T06:05:50.849143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:39.576444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849043+0000","last_change":"2024-05-28T06:05:49.838656+0000","last_active":"2024-05-28T06:05:50.849043+0000","last_peered":"2024-05-28T06:05:50.849043+0000","last_clean":"2024-05-28T06:05:50.849043+0000","last_became_active":"2024-05-28T06:05:49.838227+0000","last_became_peered":"2024-05-28T06:05:49.838227+0000","last_unstale":"2024-05-28T06:05:50.849043+0000","last_undegraded":"2024-05-28T06:05:50.849043+0000","last_fullsized":"2024-05-28T06:05:50.849043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:39:57.417861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832049+0000","last_change":"2024-05-28T06:05:49.839298+0000","last_active":"2024-05-28T06:05:50.832049+0000","last_peered":"2024-05-28T06:05:50.832049+0000","last_clean":"2024-05-28T06:05:50.832049+0000","last_became_active":"2024-05-28T06:05:49.839024+0000","last_became_peered":"2024-05-28T06:05:49.839024+0000","last_unstale":"2024-05-28T06:05:50.832049+0000","last_undegraded":"2024-05-28T06:05:50.832049+0000","last_fullsized":"2024-05-28T06:05:50.832049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:24:17.481208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619981+0000","last_change":"2024-05-28T06:05:49.852183+0000","last_active":"2024-05-28T06:05:51.619981+0000","last_peered":"2024-05-28T06:05:51.619981+0000","last_clean":"2024-05-28T06:05:51.619981+0000","last_became_active":"2024-05-28T06:05:49.851929+0000","last_became_peered":"2024-05-28T06:05:49.851929+0000","last_unstale":"2024-05-28T06:05:51.619981+0000","last_undegraded":"2024-05-28T06:05:51.619981+0000","last_fullsized":"2024-05-28T06:05:51.619981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:40:46.277733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620009+0000","last_change":"2024-05-28T06:05:49.830872+0000","last_active":"2024-05-28T06:05:51.620009+0000","last_peered":"2024-05-28T06:05:51.620009+0000","last_clean":"2024-05-28T06:05:51.620009+0000","last_became_active":"2024-05-28T06:05:49.829663+0000","last_became_peered":"2024-05-28T06:05:49.829663+0000","last_unstale":"2024-05-28T06:05:51.620009+0000","last_undegraded":"2024-05-28T06:05:51.620009+0000","last_fullsized":"2024-05-28T06:05:51.620009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:45:45.914430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846818+0000","last_change":"2024-05-28T06:05:49.841218+0000","last_active":"2024-05-28T06:05:50.846818+0000","last_peered":"2024-05-28T06:05:50.846818+0000","last_clean":"2024-05-28T06:05:50.846818+0000","last_became_active":"2024-05-28T06:05:49.839685+0000","last_became_peered":"2024-05-28T06:05:49.839685+0000","last_unstale":"2024-05-28T06:05:50.846818+0000","last_undegraded":"2024-05-28T06:05:50.846818+0000","last_fullsized":"2024-05-28T06:05:50.846818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:45:56.563383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830436+0000","last_change":"2024-05-28T06:05:49.834469+0000","last_active":"2024-05-28T06:05:50.830436+0000","last_peered":"2024-05-28T06:05:50.830436+0000","last_clean":"2024-05-28T06:05:50.830436+0000","last_became_active":"2024-05-28T06:05:49.834129+0000","last_became_peered":"2024-05-28T06:05:49.834129+0000","last_unstale":"2024-05-28T06:05:50.830436+0000","last_undegraded":"2024-05-28T06:05:50.830436+0000","last_fullsized":"2024-05-28T06:05:50.830436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:39.576444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832847+0000","last_change":"2024-05-28T06:05:49.836984+0000","last_active":"2024-05-28T06:05:50.832847+0000","last_peered":"2024-05-28T06:05:50.832847+0000","last_clean":"2024-05-28T06:05:50.832847+0000","last_became_active":"2024-05-28T06:05:49.836754+0000","last_became_peered":"2024-05-28T06:05:49.836754+0000","last_unstale":"2024-05-28T06:05:50.832847+0000","last_undegraded":"2024-05-28T06:05:50.832847+0000","last_fullsized":"2024-05-28T06:05:50.832847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:25:16.860803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275303+0000","last_change":"2024-05-28T06:05:49.843255+0000","last_active":"2024-05-28T06:05:51.275303+0000","last_peered":"2024-05-28T06:05:51.275303+0000","last_clean":"2024-05-28T06:05:51.275303+0000","last_became_active":"2024-05-28T06:05:49.841453+0000","last_became_peered":"2024-05-28T06:05:49.841453+0000","last_unstale":"2024-05-28T06:05:51.275303+0000","last_undegraded":"2024-05-28T06:05:51.275303+0000","last_fullsized":"2024-05-28T06:05:51.275303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:47:11.938003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619672+0000","last_change":"2024-05-28T06:05:49.850933+0000","last_active":"2024-05-28T06:05:51.619672+0000","last_peered":"2024-05-28T06:05:51.619672+0000","last_clean":"2024-05-28T06:05:51.619672+0000","last_became_active":"2024-05-28T06:05:49.850659+0000","last_became_peered":"2024-05-28T06:05:49.850659+0000","last_unstale":"2024-05-28T06:05:51.619672+0000","last_undegraded":"2024-05-28T06:05:51.619672+0000","last_fullsized":"2024-05-28T06:05:51.619672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:54:25.520215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849165+0000","last_change":"2024-05-28T06:05:49.835678+0000","last_active":"2024-05-28T06:05:50.849165+0000","last_peered":"2024-05-28T06:05:50.849165+0000","last_clean":"2024-05-28T06:05:50.849165+0000","last_became_active":"2024-05-28T06:05:49.835404+0000","last_became_peered":"2024-05-28T06:05:49.835404+0000","last_unstale":"2024-05-28T06:05:50.849165+0000","last_undegraded":"2024-05-28T06:05:50.849165+0000","last_fullsized":"2024-05-28T06:05:50.849165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:05.258933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620237+0000","last_change":"2024-05-28T06:05:49.837644+0000","last_active":"2024-05-28T06:05:51.620237+0000","last_peered":"2024-05-28T06:05:51.620237+0000","last_clean":"2024-05-28T06:05:51.620237+0000","last_became_active":"2024-05-28T06:05:49.833254+0000","last_became_peered":"2024-05-28T06:05:49.833254+0000","last_unstale":"2024-05-28T06:05:51.620237+0000","last_undegraded":"2024-05-28T06:05:51.620237+0000","last_fullsized":"2024-05-28T06:05:51.620237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:37:35.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830664+0000","last_change":"2024-05-28T06:05:49.835830+0000","last_active":"2024-05-28T06:05:50.830664+0000","last_peered":"2024-05-28T06:05:50.830664+0000","last_clean":"2024-05-28T06:05:50.830664+0000","last_became_active":"2024-05-28T06:05:49.835539+0000","last_became_peered":"2024-05-28T06:05:49.835539+0000","last_unstale":"2024-05-28T06:05:50.830664+0000","last_undegraded":"2024-05-28T06:05:50.830664+0000","last_fullsized":"2024-05-28T06:05:50.830664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:40:46.277733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619508+0000","last_change":"2024-05-28T06:05:49.847289+0000","last_active":"2024-05-28T06:05:51.619508+0000","last_peered":"2024-05-28T06:05:51.619508+0000","last_clean":"2024-05-28T06:05:51.619508+0000","last_became_active":"2024-05-28T06:05:49.846943+0000","last_became_peered":"2024-05-28T06:05:49.846943+0000","last_unstale":"2024-05-28T06:05:51.619508+0000","last_undegraded":"2024-05-28T06:05:51.619508+0000","last_fullsized":"2024-05-28T06:05:51.619508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:46:50.877903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830612+0000","last_change":"2024-05-28T06:05:49.832701+0000","last_active":"2024-05-28T06:05:50.830612+0000","last_peered":"2024-05-28T06:05:50.830612+0000","last_clean":"2024-05-28T06:05:50.830612+0000","last_became_active":"2024-05-28T06:05:49.832339+0000","last_became_peered":"2024-05-28T06:05:49.832339+0000","last_unstale":"2024-05-28T06:05:50.830612+0000","last_undegraded":"2024-05-28T06:05:50.830612+0000","last_fullsized":"2024-05-28T06:05:50.830612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:19:32.041344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619788+0000","last_change":"2024-05-28T06:05:49.836126+0000","last_active":"2024-05-28T06:05:51.619788+0000","last_peered":"2024-05-28T06:05:51.619788+0000","last_clean":"2024-05-28T06:05:51.619788+0000","last_became_active":"2024-05-28T06:05:49.835875+0000","last_became_peered":"2024-05-28T06:05:49.835875+0000","last_unstale":"2024-05-28T06:05:51.619788+0000","last_undegraded":"2024-05-28T06:05:51.619788+0000","last_fullsized":"2024-05-28T06:05:51.619788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:39.576444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849191+0000","last_change":"2024-05-28T06:05:49.839809+0000","last_active":"2024-05-28T06:05:50.849191+0000","last_peered":"2024-05-28T06:05:50.849191+0000","last_clean":"2024-05-28T06:05:50.849191+0000","last_became_active":"2024-05-28T06:05:49.839063+0000","last_became_peered":"2024-05-28T06:05:49.839063+0000","last_unstale":"2024-05-28T06:05:50.849191+0000","last_undegraded":"2024-05-28T06:05:50.849191+0000","last_fullsized":"2024-05-28T06:05:50.849191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:19:32.041344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846997+0000","last_change":"2024-05-28T06:05:49.837449+0000","last_active":"2024-05-28T06:05:50.846997+0000","last_peered":"2024-05-28T06:05:50.846997+0000","last_clean":"2024-05-28T06:05:50.846997+0000","last_became_active":"2024-05-28T06:05:49.833358+0000","last_became_peered":"2024-05-28T06:05:49.833358+0000","last_unstale":"2024-05-28T06:05:50.846997+0000","last_undegraded":"2024-05-28T06:05:50.846997+0000","last_fullsized":"2024-05-28T06:05:50.846997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:39.576444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619737+0000","last_change":"2024-05-28T06:05:49.836384+0000","last_active":"2024-05-28T06:05:51.619737+0000","last_peered":"2024-05-28T06:05:51.619737+0000","last_clean":"2024-05-28T06:05:51.619737+0000","last_became_active":"2024-05-28T06:05:49.835821+0000","last_became_peered":"2024-05-28T06:05:49.835821+0000","last_unstale":"2024-05-28T06:05:51.619737+0000","last_undegraded":"2024-05-28T06:05:51.619737+0000","last_fullsized":"2024-05-28T06:05:51.619737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:32:22.883360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620320+0000","last_change":"2024-05-28T06:05:49.838410+0000","last_active":"2024-05-28T06:05:51.620320+0000","last_peered":"2024-05-28T06:05:51.620320+0000","last_clean":"2024-05-28T06:05:51.620320+0000","last_became_active":"2024-05-28T06:05:49.838053+0000","last_became_peered":"2024-05-28T06:05:49.838053+0000","last_unstale":"2024-05-28T06:05:51.620320+0000","last_undegraded":"2024-05-28T06:05:51.620320+0000","last_fullsized":"2024-05-28T06:05:51.620320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:46:50.877903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830834+0000","last_change":"2024-05-28T06:05:49.851329+0000","last_active":"2024-05-28T06:05:50.830834+0000","last_peered":"2024-05-28T06:05:50.830834+0000","last_clean":"2024-05-28T06:05:50.830834+0000","last_became_active":"2024-05-28T06:05:49.850771+0000","last_became_peered":"2024-05-28T06:05:49.850771+0000","last_unstale":"2024-05-28T06:05:50.830834+0000","last_undegraded":"2024-05-28T06:05:50.830834+0000","last_fullsized":"2024-05-28T06:05:50.830834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:57:50.858798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275129+0000","last_change":"2024-05-28T06:05:49.822523+0000","last_active":"2024-05-28T06:05:51.275129+0000","last_peered":"2024-05-28T06:05:51.275129+0000","last_clean":"2024-05-28T06:05:51.275129+0000","last_became_active":"2024-05-28T06:05:49.822143+0000","last_became_peered":"2024-05-28T06:05:49.822143+0000","last_unstale":"2024-05-28T06:05:51.275129+0000","last_undegraded":"2024-05-28T06:05:51.275129+0000","last_fullsized":"2024-05-28T06:05:51.275129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:24:17.481208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.848820+0000","last_change":"2024-05-28T06:05:49.840151+0000","last_active":"2024-05-28T06:05:50.848820+0000","last_peered":"2024-05-28T06:05:50.848820+0000","last_clean":"2024-05-28T06:05:50.848820+0000","last_became_active":"2024-05-28T06:05:49.839815+0000","last_became_peered":"2024-05-28T06:05:49.839815+0000","last_unstale":"2024-05-28T06:05:50.848820+0000","last_undegraded":"2024-05-28T06:05:50.848820+0000","last_fullsized":"2024-05-28T06:05:50.848820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:46:50.877903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832139+0000","last_change":"2024-05-28T06:05:49.834448+0000","last_active":"2024-05-28T06:05:50.832139+0000","last_peered":"2024-05-28T06:05:50.832139+0000","last_clean":"2024-05-28T06:05:50.832139+0000","last_became_active":"2024-05-28T06:05:49.833479+0000","last_became_peered":"2024-05-28T06:05:49.833479+0000","last_unstale":"2024-05-28T06:05:50.832139+0000","last_undegraded":"2024-05-28T06:05:50.832139+0000","last_fullsized":"2024-05-28T06:05:50.832139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:03:32.895368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620222+0000","last_change":"2024-05-28T06:05:48.832582+0000","last_active":"2024-05-28T06:05:51.620222+0000","last_peered":"2024-05-28T06:05:51.620222+0000","last_clean":"2024-05-28T06:05:51.620222+0000","last_became_active":"2024-05-28T06:05:48.828599+0000","last_became_peered":"2024-05-28T06:05:48.828599+0000","last_unstale":"2024-05-28T06:05:51.620222+0000","last_undegraded":"2024-05-28T06:05:51.620222+0000","last_fullsized":"2024-05-28T06:05:51.620222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:15:33.728795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620372+0000","last_change":"2024-05-28T06:05:49.838397+0000","last_active":"2024-05-28T06:05:51.620372+0000","last_peered":"2024-05-28T06:05:51.620372+0000","last_clean":"2024-05-28T06:05:51.620372+0000","last_became_active":"2024-05-28T06:05:49.838080+0000","last_became_peered":"2024-05-28T06:05:49.838080+0000","last_unstale":"2024-05-28T06:05:51.620372+0000","last_undegraded":"2024-05-28T06:05:51.620372+0000","last_fullsized":"2024-05-28T06:05:51.620372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:32:22.883360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.848958+0000","last_change":"2024-05-28T06:05:48.823837+0000","last_active":"2024-05-28T06:05:50.848958+0000","last_peered":"2024-05-28T06:05:50.848958+0000","last_clean":"2024-05-28T06:05:50.848958+0000","last_became_active":"2024-05-28T06:05:48.823531+0000","last_became_peered":"2024-05-28T06:05:48.823531+0000","last_unstale":"2024-05-28T06:05:50.848958+0000","last_undegraded":"2024-05-28T06:05:50.848958+0000","last_fullsized":"2024-05-28T06:05:50.848958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:30:03.706927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619568+0000","last_change":"2024-05-28T06:05:48.829331+0000","last_active":"2024-05-28T06:05:51.619568+0000","last_peered":"2024-05-28T06:05:51.619568+0000","last_clean":"2024-05-28T06:05:51.619568+0000","last_became_active":"2024-05-28T06:05:48.828618+0000","last_became_peered":"2024-05-28T06:05:48.828618+0000","last_unstale":"2024-05-28T06:05:51.619568+0000","last_undegraded":"2024-05-28T06:05:51.619568+0000","last_fullsized":"2024-05-28T06:05:51.619568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:41:15.562847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619431+0000","last_change":"2024-05-28T06:05:49.835162+0000","last_active":"2024-05-28T06:05:51.619431+0000","last_peered":"2024-05-28T06:05:51.619431+0000","last_clean":"2024-05-28T06:05:51.619431+0000","last_became_active":"2024-05-28T06:05:49.834914+0000","last_became_peered":"2024-05-28T06:05:49.834914+0000","last_unstale":"2024-05-28T06:05:51.619431+0000","last_undegraded":"2024-05-28T06:05:51.619431+0000","last_fullsized":"2024-05-28T06:05:51.619431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:37:35.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830705+0000","last_change":"2024-05-28T06:05:48.819148+0000","last_active":"2024-05-28T06:05:50.830705+0000","last_peered":"2024-05-28T06:05:50.830705+0000","last_clean":"2024-05-28T06:05:50.830705+0000","last_became_active":"2024-05-28T06:05:48.818867+0000","last_became_peered":"2024-05-28T06:05:48.818867+0000","last_unstale":"2024-05-28T06:05:50.830705+0000","last_undegraded":"2024-05-28T06:05:50.830705+0000","last_fullsized":"2024-05-28T06:05:50.830705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:54:54.655580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846821+0000","last_change":"2024-05-28T06:05:49.835117+0000","last_active":"2024-05-28T06:05:50.846821+0000","last_peered":"2024-05-28T06:05:50.846821+0000","last_clean":"2024-05-28T06:05:50.846821+0000","last_became_active":"2024-05-28T06:05:49.834862+0000","last_became_peered":"2024-05-28T06:05:49.834862+0000","last_unstale":"2024-05-28T06:05:50.846821+0000","last_undegraded":"2024-05-28T06:05:50.846821+0000","last_fullsized":"2024-05-28T06:05:50.846821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:46:50.877903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849118+0000","last_change":"2024-05-28T06:05:48.829871+0000","last_active":"2024-05-28T06:05:50.849118+0000","last_peered":"2024-05-28T06:05:50.849118+0000","last_clean":"2024-05-28T06:05:50.849118+0000","last_became_active":"2024-05-28T06:05:48.829598+0000","last_became_peered":"2024-05-28T06:05:48.829598+0000","last_unstale":"2024-05-28T06:05:50.849118+0000","last_undegraded":"2024-05-28T06:05:50.849118+0000","last_fullsized":"2024-05-28T06:05:50.849118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:18:51.804296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832692+0000","last_change":"2024-05-28T06:05:49.837126+0000","last_active":"2024-05-28T06:05:50.832692+0000","last_peered":"2024-05-28T06:05:50.832692+0000","last_clean":"2024-05-28T06:05:50.832692+0000","last_became_active":"2024-05-28T06:05:49.836676+0000","last_became_peered":"2024-05-28T06:05:49.836676+0000","last_unstale":"2024-05-28T06:05:50.832692+0000","last_undegraded":"2024-05-28T06:05:50.832692+0000","last_fullsized":"2024-05-28T06:05:50.832692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:58:07.996206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832655+0000","last_change":"2024-05-28T06:05:48.821859+0000","last_active":"2024-05-28T06:05:50.832655+0000","last_peered":"2024-05-28T06:05:50.832655+0000","last_clean":"2024-05-28T06:05:50.832655+0000","last_became_active":"2024-05-28T06:05:48.821297+0000","last_became_peered":"2024-05-28T06:05:48.821297+0000","last_unstale":"2024-05-28T06:05:50.832655+0000","last_undegraded":"2024-05-28T06:05:50.832655+0000","last_fullsized":"2024-05-28T06:05:50.832655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:35:04.180425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620652+0000","last_change":"2024-05-28T06:05:49.831784+0000","last_active":"2024-05-28T06:05:51.620652+0000","last_peered":"2024-05-28T06:05:51.620652+0000","last_clean":"2024-05-28T06:05:51.620652+0000","last_became_active":"2024-05-28T06:05:49.831487+0000","last_became_peered":"2024-05-28T06:05:49.831487+0000","last_unstale":"2024-05-28T06:05:51.620652+0000","last_undegraded":"2024-05-28T06:05:51.620652+0000","last_fullsized":"2024-05-28T06:05:51.620652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:05.258933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846970+0000","last_change":"2024-05-28T06:05:48.817642+0000","last_active":"2024-05-28T06:05:50.846970+0000","last_peered":"2024-05-28T06:05:50.846970+0000","last_clean":"2024-05-28T06:05:50.846970+0000","last_became_active":"2024-05-28T06:05:48.816830+0000","last_became_peered":"2024-05-28T06:05:48.816830+0000","last_unstale":"2024-05-28T06:05:50.846970+0000","last_undegraded":"2024-05-28T06:05:50.846970+0000","last_fullsized":"2024-05-28T06:05:50.846970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:30:03.706927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832103+0000","last_change":"2024-05-28T06:05:49.831624+0000","last_active":"2024-05-28T06:05:50.832103+0000","last_peered":"2024-05-28T06:05:50.832103+0000","last_clean":"2024-05-28T06:05:50.832103+0000","last_became_active":"2024-05-28T06:05:49.830861+0000","last_became_peered":"2024-05-28T06:05:49.830861+0000","last_unstale":"2024-05-28T06:05:50.832103+0000","last_undegraded":"2024-05-28T06:05:50.832103+0000","last_fullsized":"2024-05-28T06:05:50.832103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:47:11.938003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849091+0000","last_change":"2024-05-28T06:05:48.827308+0000","last_active":"2024-05-28T06:05:50.849091+0000","last_peered":"2024-05-28T06:05:50.849091+0000","last_clean":"2024-05-28T06:05:50.849091+0000","last_became_active":"2024-05-28T06:05:48.827058+0000","last_became_peered":"2024-05-28T06:05:48.827058+0000","last_unstale":"2024-05-28T06:05:50.849091+0000","last_undegraded":"2024-05-28T06:05:50.849091+0000","last_fullsized":"2024-05-28T06:05:50.849091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:03:31.889186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619356+0000","last_change":"2024-05-28T06:05:49.850742+0000","last_active":"2024-05-28T06:05:51.619356+0000","last_peered":"2024-05-28T06:05:51.619356+0000","last_clean":"2024-05-28T06:05:51.619356+0000","last_became_active":"2024-05-28T06:05:49.850284+0000","last_became_peered":"2024-05-28T06:05:49.850284+0000","last_unstale":"2024-05-28T06:05:51.619356+0000","last_undegraded":"2024-05-28T06:05:51.619356+0000","last_fullsized":"2024-05-28T06:05:51.619356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:19:32.041344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620430+0000","last_change":"2024-05-28T06:05:48.825087+0000","last_active":"2024-05-28T06:05:51.620430+0000","last_peered":"2024-05-28T06:05:51.620430+0000","last_clean":"2024-05-28T06:05:51.620430+0000","last_became_active":"2024-05-28T06:05:48.824790+0000","last_became_peered":"2024-05-28T06:05:48.824790+0000","last_unstale":"2024-05-28T06:05:51.620430+0000","last_undegraded":"2024-05-28T06:05:51.620430+0000","last_fullsized":"2024-05-28T06:05:51.620430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:41:15.562847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620110+0000","last_change":"2024-05-28T06:05:49.831857+0000","last_active":"2024-05-28T06:05:51.620110+0000","last_peered":"2024-05-28T06:05:51.620110+0000","last_clean":"2024-05-28T06:05:51.620110+0000","last_became_active":"2024-05-28T06:05:49.831461+0000","last_became_peered":"2024-05-28T06:05:49.831461+0000","last_unstale":"2024-05-28T06:05:51.620110+0000","last_undegraded":"2024-05-28T06:05:51.620110+0000","last_fullsized":"2024-05-28T06:05:51.620110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:02:07.375017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830945+0000","last_change":"2024-05-28T06:05:48.827406+0000","last_active":"2024-05-28T06:05:50.830945+0000","last_peered":"2024-05-28T06:05:50.830945+0000","last_clean":"2024-05-28T06:05:50.830945+0000","last_became_active":"2024-05-28T06:05:48.827095+0000","last_became_peered":"2024-05-28T06:05:48.827095+0000","last_unstale":"2024-05-28T06:05:50.830945+0000","last_undegraded":"2024-05-28T06:05:50.830945+0000","last_fullsized":"2024-05-28T06:05:50.830945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:18:51.804296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619606+0000","last_change":"2024-05-28T06:05:49.848867+0000","last_active":"2024-05-28T06:05:51.619606+0000","last_peered":"2024-05-28T06:05:51.619606+0000","last_clean":"2024-05-28T06:05:51.619606+0000","last_became_active":"2024-05-28T06:05:49.848544+0000","last_became_peered":"2024-05-28T06:05:49.848544+0000","last_unstale":"2024-05-28T06:05:51.619606+0000","last_undegraded":"2024-05-28T06:05:51.619606+0000","last_fullsized":"2024-05-28T06:05:51.619606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:54:32.928419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.848795+0000","last_change":"2024-05-28T06:05:48.823850+0000","last_active":"2024-05-28T06:05:50.848795+0000","last_peered":"2024-05-28T06:05:50.848795+0000","last_clean":"2024-05-28T06:05:50.848795+0000","last_became_active":"2024-05-28T06:05:48.823565+0000","last_became_peered":"2024-05-28T06:05:48.823565+0000","last_unstale":"2024-05-28T06:05:50.848795+0000","last_undegraded":"2024-05-28T06:05:50.848795+0000","last_fullsized":"2024-05-28T06:05:50.848795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:54:54.655580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.848867+0000","last_change":"2024-05-28T06:05:49.833197+0000","last_active":"2024-05-28T06:05:50.848867+0000","last_peered":"2024-05-28T06:05:50.848867+0000","last_clean":"2024-05-28T06:05:50.848867+0000","last_became_active":"2024-05-28T06:05:49.832937+0000","last_became_peered":"2024-05-28T06:05:49.832937+0000","last_unstale":"2024-05-28T06:05:50.848867+0000","last_undegraded":"2024-05-28T06:05:50.848867+0000","last_fullsized":"2024-05-28T06:05:50.848867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:32:22.883360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275013+0000","last_change":"2024-05-28T06:05:48.826780+0000","last_active":"2024-05-28T06:05:51.275013+0000","last_peered":"2024-05-28T06:05:51.275013+0000","last_clean":"2024-05-28T06:05:51.275013+0000","last_became_active":"2024-05-28T06:05:48.824955+0000","last_became_peered":"2024-05-28T06:05:48.824955+0000","last_unstale":"2024-05-28T06:05:51.275013+0000","last_undegraded":"2024-05-28T06:05:51.275013+0000","last_fullsized":"2024-05-28T06:05:51.275013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:41:15.562847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619355+0000","last_change":"2024-05-28T06:05:49.841278+0000","last_active":"2024-05-28T06:05:51.619355+0000","last_peered":"2024-05-28T06:05:51.619355+0000","last_clean":"2024-05-28T06:05:51.619355+0000","last_became_active":"2024-05-28T06:05:49.840945+0000","last_became_peered":"2024-05-28T06:05:49.840945+0000","last_unstale":"2024-05-28T06:05:51.619355+0000","last_undegraded":"2024-05-28T06:05:51.619355+0000","last_fullsized":"2024-05-28T06:05:51.619355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:40:46.277733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832319+0000","last_change":"2024-05-28T06:05:48.825832+0000","last_active":"2024-05-28T06:05:50.832319+0000","last_peered":"2024-05-28T06:05:50.832319+0000","last_clean":"2024-05-28T06:05:50.832319+0000","last_became_active":"2024-05-28T06:05:48.825446+0000","last_became_peered":"2024-05-28T06:05:48.825446+0000","last_unstale":"2024-05-28T06:05:50.832319+0000","last_undegraded":"2024-05-28T06:05:50.832319+0000","last_fullsized":"2024-05-28T06:05:50.832319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:09:22.855060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619710+0000","last_change":"2024-05-28T06:05:49.854377+0000","last_active":"2024-05-28T06:05:51.619710+0000","last_peered":"2024-05-28T06:05:51.619710+0000","last_clean":"2024-05-28T06:05:51.619710+0000","last_became_active":"2024-05-28T06:05:49.853287+0000","last_became_peered":"2024-05-28T06:05:49.853287+0000","last_unstale":"2024-05-28T06:05:51.619710+0000","last_undegraded":"2024-05-28T06:05:51.619710+0000","last_fullsized":"2024-05-28T06:05:51.619710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:54:47.876861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275258+0000","last_change":"2024-05-28T06:05:48.828277+0000","last_active":"2024-05-28T06:05:51.275258+0000","last_peered":"2024-05-28T06:05:51.275258+0000","last_clean":"2024-05-28T06:05:51.275258+0000","last_became_active":"2024-05-28T06:05:48.828066+0000","last_became_peered":"2024-05-28T06:05:48.828066+0000","last_unstale":"2024-05-28T06:05:51.275258+0000","last_undegraded":"2024-05-28T06:05:51.275258+0000","last_fullsized":"2024-05-28T06:05:51.275258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:54:54.655580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619958+0000","last_change":"2024-05-28T06:05:49.852523+0000","last_active":"2024-05-28T06:05:51.619958+0000","last_peered":"2024-05-28T06:05:51.619958+0000","last_clean":"2024-05-28T06:05:51.619958+0000","last_became_active":"2024-05-28T06:05:49.852170+0000","last_became_peered":"2024-05-28T06:05:49.852170+0000","last_unstale":"2024-05-28T06:05:51.619958+0000","last_undegraded":"2024-05-28T06:05:51.619958+0000","last_fullsized":"2024-05-28T06:05:51.619958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:30:15.652435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.847045+0000","last_change":"2024-05-28T06:05:48.825987+0000","last_active":"2024-05-28T06:05:50.847045+0000","last_peered":"2024-05-28T06:05:50.847045+0000","last_clean":"2024-05-28T06:05:50.847045+0000","last_became_active":"2024-05-28T06:05:48.824571+0000","last_became_peered":"2024-05-28T06:05:48.824571+0000","last_unstale":"2024-05-28T06:05:50.847045+0000","last_undegraded":"2024-05-28T06:05:50.847045+0000","last_fullsized":"2024-05-28T06:05:50.847045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:24:16.475026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830941+0000","last_change":"2024-05-28T06:05:49.835359+0000","last_active":"2024-05-28T06:05:50.830941+0000","last_peered":"2024-05-28T06:05:50.830941+0000","last_clean":"2024-05-28T06:05:50.830941+0000","last_became_active":"2024-05-28T06:05:49.834666+0000","last_became_peered":"2024-05-28T06:05:49.834666+0000","last_unstale":"2024-05-28T06:05:50.830941+0000","last_undegraded":"2024-05-28T06:05:50.830941+0000","last_fullsized":"2024-05-28T06:05:50.830941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:54:32.928419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275152+0000","last_change":"2024-05-28T06:05:48.826646+0000","last_active":"2024-05-28T06:05:51.275152+0000","last_peered":"2024-05-28T06:05:51.275152+0000","last_clean":"2024-05-28T06:05:51.275152+0000","last_became_active":"2024-05-28T06:05:48.825673+0000","last_became_peered":"2024-05-28T06:05:48.825673+0000","last_unstale":"2024-05-28T06:05:51.275152+0000","last_undegraded":"2024-05-28T06:05:51.275152+0000","last_fullsized":"2024-05-28T06:05:51.275152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:35:04.180425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619481+0000","last_change":"2024-05-28T06:05:49.846068+0000","last_active":"2024-05-28T06:05:51.619481+0000","last_peered":"2024-05-28T06:05:51.619481+0000","last_clean":"2024-05-28T06:05:51.619481+0000","last_became_active":"2024-05-28T06:05:49.845797+0000","last_became_peered":"2024-05-28T06:05:49.845797+0000","last_unstale":"2024-05-28T06:05:51.619481+0000","last_undegraded":"2024-05-28T06:05:51.619481+0000","last_fullsized":"2024-05-28T06:05:51.619481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:58:36.770938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619274+0000","last_change":"2024-05-28T06:05:38.517922+0000","last_active":"2024-05-28T06:05:51.619274+0000","last_peered":"2024-05-28T06:05:51.619274+0000","last_clean":"2024-05-28T06:05:51.619274+0000","last_became_active":"2024-05-28T06:05:38.514745+0000","last_became_peered":"2024-05-28T06:05:38.514745+0000","last_unstale":"2024-05-28T06:05:51.619274+0000","last_undegraded":"2024-05-28T06:05:51.619274+0000","last_fullsized":"2024-05-28T06:05:51.619274+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_clean_scrub_stamp":"2024-05-28T06:05:37.485018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:23:27.978203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830398+0000","last_change":"2024-05-28T06:05:48.821497+0000","last_active":"2024-05-28T06:05:50.830398+0000","last_peered":"2024-05-28T06:05:50.830398+0000","last_clean":"2024-05-28T06:05:50.830398+0000","last_became_active":"2024-05-28T06:05:48.821092+0000","last_became_peered":"2024-05-28T06:05:48.821092+0000","last_unstale":"2024-05-28T06:05:50.830398+0000","last_undegraded":"2024-05-28T06:05:50.830398+0000","last_fullsized":"2024-05-28T06:05:50.830398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:15:33.728795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620353+0000","last_change":"2024-05-28T06:05:49.841257+0000","last_active":"2024-05-28T06:05:51.620353+0000","last_peered":"2024-05-28T06:05:51.620353+0000","last_clean":"2024-05-28T06:05:51.620353+0000","last_became_active":"2024-05-28T06:05:49.840922+0000","last_became_peered":"2024-05-28T06:05:49.840922+0000","last_unstale":"2024-05-28T06:05:51.620353+0000","last_undegraded":"2024-05-28T06:05:51.620353+0000","last_fullsized":"2024-05-28T06:05:51.620353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:57:50.858798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619054+0000","last_change":"2024-05-28T06:05:48.829694+0000","last_active":"2024-05-28T06:05:51.619054+0000","last_peered":"2024-05-28T06:05:51.619054+0000","last_clean":"2024-05-28T06:05:51.619054+0000","last_became_active":"2024-05-28T06:05:48.829470+0000","last_became_peered":"2024-05-28T06:05:48.829470+0000","last_unstale":"2024-05-28T06:05:51.619054+0000","last_undegraded":"2024-05-28T06:05:51.619054+0000","last_fullsized":"2024-05-28T06:05:51.619054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:03:31.889186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619991+0000","last_change":"2024-05-28T06:05:49.842825+0000","last_active":"2024-05-28T06:05:51.619991+0000","last_peered":"2024-05-28T06:05:51.619991+0000","last_clean":"2024-05-28T06:05:51.619991+0000","last_became_active":"2024-05-28T06:05:49.842497+0000","last_became_peered":"2024-05-28T06:05:49.842497+0000","last_unstale":"2024-05-28T06:05:51.619991+0000","last_undegraded":"2024-05-28T06:05:51.619991+0000","last_fullsized":"2024-05-28T06:05:51.619991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:30:16.017763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275109+0000","last_change":"2024-05-28T06:05:48.824739+0000","last_active":"2024-05-28T06:05:51.275109+0000","last_peered":"2024-05-28T06:05:51.275109+0000","last_clean":"2024-05-28T06:05:51.275109+0000","last_became_active":"2024-05-28T06:05:48.824425+0000","last_became_peered":"2024-05-28T06:05:48.824425+0000","last_unstale":"2024-05-28T06:05:51.275109+0000","last_undegraded":"2024-05-28T06:05:51.275109+0000","last_fullsized":"2024-05-28T06:05:51.275109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:15:33.728795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846831+0000","last_change":"2024-05-28T06:05:49.832900+0000","last_active":"2024-05-28T06:05:50.846831+0000","last_peered":"2024-05-28T06:05:50.846831+0000","last_clean":"2024-05-28T06:05:50.846831+0000","last_became_active":"2024-05-28T06:05:49.832648+0000","last_became_peered":"2024-05-28T06:05:49.832648+0000","last_unstale":"2024-05-28T06:05:50.846831+0000","last_undegraded":"2024-05-28T06:05:50.846831+0000","last_fullsized":"2024-05-28T06:05:50.846831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:32:22.883360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.831036+0000","last_change":"2024-05-28T06:05:48.809280+0000","last_active":"2024-05-28T06:05:50.831036+0000","last_peered":"2024-05-28T06:05:50.831036+0000","last_clean":"2024-05-28T06:05:50.831036+0000","last_became_active":"2024-05-28T06:05:48.808937+0000","last_became_peered":"2024-05-28T06:05:48.808937+0000","last_unstale":"2024-05-28T06:05:50.831036+0000","last_undegraded":"2024-05-28T06:05:50.831036+0000","last_fullsized":"2024-05-28T06:05:50.831036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:03:31.889186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832022+0000","last_change":"2024-05-28T06:05:49.840563+0000","last_active":"2024-05-28T06:05:50.832022+0000","last_peered":"2024-05-28T06:05:50.832022+0000","last_clean":"2024-05-28T06:05:50.832022+0000","last_became_active":"2024-05-28T06:05:49.840221+0000","last_became_peered":"2024-05-28T06:05:49.840221+0000","last_unstale":"2024-05-28T06:05:50.832022+0000","last_undegraded":"2024-05-28T06:05:50.832022+0000","last_fullsized":"2024-05-28T06:05:50.832022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:53:43.751639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.847057+0000","last_change":"2024-05-28T06:05:48.819109+0000","last_active":"2024-05-28T06:05:50.847057+0000","last_peered":"2024-05-28T06:05:50.847057+0000","last_clean":"2024-05-28T06:05:50.847057+0000","last_became_active":"2024-05-28T06:05:48.818859+0000","last_became_peered":"2024-05-28T06:05:48.818859+0000","last_unstale":"2024-05-28T06:05:50.847057+0000","last_undegraded":"2024-05-28T06:05:50.847057+0000","last_fullsized":"2024-05-28T06:05:50.847057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:54:54.655580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.831618+0000","last_change":"2024-05-28T06:05:49.835770+0000","last_active":"2024-05-28T06:05:50.831618+0000","last_peered":"2024-05-28T06:05:50.831618+0000","last_clean":"2024-05-28T06:05:50.831618+0000","last_became_active":"2024-05-28T06:05:49.835041+0000","last_became_peered":"2024-05-28T06:05:49.835041+0000","last_unstale":"2024-05-28T06:05:50.831618+0000","last_undegraded":"2024-05-28T06:05:50.831618+0000","last_fullsized":"2024-05-28T06:05:50.831618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:54:47.876861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619634+0000","last_change":"2024-05-28T06:05:48.832048+0000","last_active":"2024-05-28T06:05:51.619634+0000","last_peered":"2024-05-28T06:05:51.619634+0000","last_clean":"2024-05-28T06:05:51.619634+0000","last_became_active":"2024-05-28T06:05:48.831810+0000","last_became_peered":"2024-05-28T06:05:48.831810+0000","last_unstale":"2024-05-28T06:05:51.619634+0000","last_undegraded":"2024-05-28T06:05:51.619634+0000","last_fullsized":"2024-05-28T06:05:51.619634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:47:10.931821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846971+0000","last_change":"2024-05-28T06:05:49.830201+0000","last_active":"2024-05-28T06:05:50.846971+0000","last_peered":"2024-05-28T06:05:50.846971+0000","last_clean":"2024-05-28T06:05:50.846971+0000","last_became_active":"2024-05-28T06:05:49.829999+0000","last_became_peered":"2024-05-28T06:05:49.829999+0000","last_unstale":"2024-05-28T06:05:50.846971+0000","last_undegraded":"2024-05-28T06:05:50.846971+0000","last_fullsized":"2024-05-28T06:05:50.846971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:39:57.417861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849020+0000","last_change":"2024-05-28T06:05:48.822728+0000","last_active":"2024-05-28T06:05:50.849020+0000","last_peered":"2024-05-28T06:05:50.849020+0000","last_clean":"2024-05-28T06:05:50.849020+0000","last_became_active":"2024-05-28T06:05:48.822411+0000","last_became_peered":"2024-05-28T06:05:48.822411+0000","last_unstale":"2024-05-28T06:05:50.849020+0000","last_undegraded":"2024-05-28T06:05:50.849020+0000","last_fullsized":"2024-05-28T06:05:50.849020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:53:42.745457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619778+0000","last_change":"2024-05-28T06:05:49.833123+0000","last_active":"2024-05-28T06:05:51.619778+0000","last_peered":"2024-05-28T06:05:51.619778+0000","last_clean":"2024-05-28T06:05:51.619778+0000","last_became_active":"2024-05-28T06:05:49.832802+0000","last_became_peered":"2024-05-28T06:05:49.832802+0000","last_unstale":"2024-05-28T06:05:51.619778+0000","last_undegraded":"2024-05-28T06:05:51.619778+0000","last_fullsized":"2024-05-28T06:05:51.619778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:39:57.417861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849200+0000","last_change":"2024-05-28T06:05:48.828295+0000","last_active":"2024-05-28T06:05:50.849200+0000","last_peered":"2024-05-28T06:05:50.849200+0000","last_clean":"2024-05-28T06:05:50.849200+0000","last_became_active":"2024-05-28T06:05:48.827978+0000","last_became_peered":"2024-05-28T06:05:48.827978+0000","last_unstale":"2024-05-28T06:05:50.849200+0000","last_undegraded":"2024-05-28T06:05:50.849200+0000","last_fullsized":"2024-05-28T06:05:50.849200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:35:04.180425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620520+0000","last_change":"2024-05-28T06:05:49.838136+0000","last_active":"2024-05-28T06:05:51.620520+0000","last_peered":"2024-05-28T06:05:51.620520+0000","last_clean":"2024-05-28T06:05:51.620520+0000","last_became_active":"2024-05-28T06:05:49.837836+0000","last_became_peered":"2024-05-28T06:05:49.837836+0000","last_unstale":"2024-05-28T06:05:51.620520+0000","last_undegraded":"2024-05-28T06:05:51.620520+0000","last_fullsized":"2024-05-28T06:05:51.620520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:39:57.417861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619057+0000","last_change":"2024-05-28T06:05:48.832109+0000","last_active":"2024-05-28T06:05:51.619057+0000","last_peered":"2024-05-28T06:05:51.619057+0000","last_clean":"2024-05-28T06:05:51.619057+0000","last_became_active":"2024-05-28T06:05:48.831767+0000","last_became_peered":"2024-05-28T06:05:48.831767+0000","last_unstale":"2024-05-28T06:05:51.619057+0000","last_undegraded":"2024-05-28T06:05:51.619057+0000","last_fullsized":"2024-05-28T06:05:51.619057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:18:51.804296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.831881+0000","last_change":"2024-05-28T06:05:49.833942+0000","last_active":"2024-05-28T06:05:50.831881+0000","last_peered":"2024-05-28T06:05:50.831881+0000","last_clean":"2024-05-28T06:05:50.831881+0000","last_became_active":"2024-05-28T06:05:49.833670+0000","last_became_peered":"2024-05-28T06:05:49.833670+0000","last_unstale":"2024-05-28T06:05:50.831881+0000","last_undegraded":"2024-05-28T06:05:50.831881+0000","last_fullsized":"2024-05-28T06:05:50.831881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:30:04.713109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846913+0000","last_change":"2024-05-28T06:05:48.829088+0000","last_active":"2024-05-28T06:05:50.846913+0000","last_peered":"2024-05-28T06:05:50.846913+0000","last_clean":"2024-05-28T06:05:50.846913+0000","last_became_active":"2024-05-28T06:05:48.827450+0000","last_became_peered":"2024-05-28T06:05:48.827450+0000","last_unstale":"2024-05-28T06:05:50.846913+0000","last_undegraded":"2024-05-28T06:05:50.846913+0000","last_fullsized":"2024-05-28T06:05:50.846913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:18:51.804296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619940+0000","last_change":"2024-05-28T06:05:49.833747+0000","last_active":"2024-05-28T06:05:51.619940+0000","last_peered":"2024-05-28T06:05:51.619940+0000","last_clean":"2024-05-28T06:05:51.619940+0000","last_became_active":"2024-05-28T06:05:49.833491+0000","last_became_peered":"2024-05-28T06:05:49.833491+0000","last_unstale":"2024-05-28T06:05:51.619940+0000","last_undegraded":"2024-05-28T06:05:51.619940+0000","last_fullsized":"2024-05-28T06:05:51.619940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:05.258933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846855+0000","last_change":"2024-05-28T06:05:48.833870+0000","last_active":"2024-05-28T06:05:50.846855+0000","last_peered":"2024-05-28T06:05:50.846855+0000","last_clean":"2024-05-28T06:05:50.846855+0000","last_became_active":"2024-05-28T06:05:48.833568+0000","last_became_peered":"2024-05-28T06:05:48.833568+0000","last_unstale":"2024-05-28T06:05:50.846855+0000","last_undegraded":"2024-05-28T06:05:50.846855+0000","last_fullsized":"2024-05-28T06:05:50.846855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:03:31.889186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620136+0000","last_change":"2024-05-28T06:05:49.843381+0000","last_active":"2024-05-28T06:05:51.620136+0000","last_peered":"2024-05-28T06:05:51.620136+0000","last_clean":"2024-05-28T06:05:51.620136+0000","last_became_active":"2024-05-28T06:05:49.843084+0000","last_became_peered":"2024-05-28T06:05:49.843084+0000","last_unstale":"2024-05-28T06:05:51.620136+0000","last_undegraded":"2024-05-28T06:05:51.620136+0000","last_fullsized":"2024-05-28T06:05:51.620136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:47:59.969773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619556+0000","last_change":"2024-05-28T06:05:48.835110+0000","last_active":"2024-05-28T06:05:51.619556+0000","last_peered":"2024-05-28T06:05:51.619556+0000","last_clean":"2024-05-28T06:05:51.619556+0000","last_became_active":"2024-05-28T06:05:48.834798+0000","last_became_peered":"2024-05-28T06:05:48.834798+0000","last_unstale":"2024-05-28T06:05:51.619556+0000","last_undegraded":"2024-05-28T06:05:51.619556+0000","last_fullsized":"2024-05-28T06:05:51.619556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:30:03.706927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.848840+0000","last_change":"2024-05-28T06:05:49.843875+0000","last_active":"2024-05-28T06:05:50.848840+0000","last_peered":"2024-05-28T06:05:50.848840+0000","last_clean":"2024-05-28T06:05:50.848840+0000","last_became_active":"2024-05-28T06:05:49.843563+0000","last_became_peered":"2024-05-28T06:05:49.843563+0000","last_unstale":"2024-05-28T06:05:50.848840+0000","last_undegraded":"2024-05-28T06:05:50.848840+0000","last_fullsized":"2024-05-28T06:05:50.848840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:45:56.563383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.831457+0000","last_change":"2024-05-28T06:05:49.836054+0000","last_active":"2024-05-28T06:05:50.831457+0000","last_peered":"2024-05-28T06:05:50.831457+0000","last_clean":"2024-05-28T06:05:50.831457+0000","last_became_active":"2024-05-28T06:05:49.835419+0000","last_became_peered":"2024-05-28T06:05:49.835419+0000","last_unstale":"2024-05-28T06:05:50.831457+0000","last_undegraded":"2024-05-28T06:05:50.831457+0000","last_fullsized":"2024-05-28T06:05:50.831457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:54:25.520215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619437+0000","last_change":"2024-05-28T06:05:48.834583+0000","last_active":"2024-05-28T06:05:51.619437+0000","last_peered":"2024-05-28T06:05:51.619437+0000","last_clean":"2024-05-28T06:05:51.619437+0000","last_became_active":"2024-05-28T06:05:48.834258+0000","last_became_peered":"2024-05-28T06:05:48.834258+0000","last_unstale":"2024-05-28T06:05:51.619437+0000","last_undegraded":"2024-05-28T06:05:51.619437+0000","last_fullsized":"2024-05-28T06:05:51.619437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:53:42.745457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830842+0000","last_change":"2024-05-28T06:05:49.836273+0000","last_active":"2024-05-28T06:05:50.830842+0000","last_peered":"2024-05-28T06:05:50.830842+0000","last_clean":"2024-05-28T06:05:50.830842+0000","last_became_active":"2024-05-28T06:05:49.835705+0000","last_became_peered":"2024-05-28T06:05:49.835705+0000","last_unstale":"2024-05-28T06:05:50.830842+0000","last_undegraded":"2024-05-28T06:05:50.830842+0000","last_fullsized":"2024-05-28T06:05:50.830842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:58:36.770938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619503+0000","last_change":"2024-05-28T06:05:48.833771+0000","last_active":"2024-05-28T06:05:51.619503+0000","last_peered":"2024-05-28T06:05:51.619503+0000","last_clean":"2024-05-28T06:05:51.619503+0000","last_became_active":"2024-05-28T06:05:48.833473+0000","last_became_peered":"2024-05-28T06:05:48.833473+0000","last_unstale":"2024-05-28T06:05:51.619503+0000","last_undegraded":"2024-05-28T06:05:51.619503+0000","last_fullsized":"2024-05-28T06:05:51.619503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:24:16.475026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620560+0000","last_change":"2024-05-28T06:05:49.831923+0000","last_active":"2024-05-28T06:05:51.620560+0000","last_peered":"2024-05-28T06:05:51.620560+0000","last_clean":"2024-05-28T06:05:51.620560+0000","last_became_active":"2024-05-28T06:05:49.830965+0000","last_became_peered":"2024-05-28T06:05:49.830965+0000","last_unstale":"2024-05-28T06:05:51.620560+0000","last_undegraded":"2024-05-28T06:05:51.620560+0000","last_fullsized":"2024-05-28T06:05:51.620560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:39.576444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620118+0000","last_change":"2024-05-28T06:05:48.828378+0000","last_active":"2024-05-28T06:05:51.620118+0000","last_peered":"2024-05-28T06:05:51.620118+0000","last_clean":"2024-05-28T06:05:51.620118+0000","last_became_active":"2024-05-28T06:05:48.827986+0000","last_became_peered":"2024-05-28T06:05:48.827986+0000","last_unstale":"2024-05-28T06:05:51.620118+0000","last_undegraded":"2024-05-28T06:05:51.620118+0000","last_fullsized":"2024-05-28T06:05:51.620118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:35:04.180425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619943+0000","last_change":"2024-05-28T06:05:49.852871+0000","last_active":"2024-05-28T06:05:51.619943+0000","last_peered":"2024-05-28T06:05:51.619943+0000","last_clean":"2024-05-28T06:05:51.619943+0000","last_became_active":"2024-05-28T06:05:49.852559+0000","last_became_peered":"2024-05-28T06:05:49.852559+0000","last_unstale":"2024-05-28T06:05:51.619943+0000","last_undegraded":"2024-05-28T06:05:51.619943+0000","last_fullsized":"2024-05-28T06:05:51.619943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:19:32.041344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620707+0000","last_change":"2024-05-28T06:05:48.832472+0000","last_active":"2024-05-28T06:05:51.620707+0000","last_peered":"2024-05-28T06:05:51.620707+0000","last_clean":"2024-05-28T06:05:51.620707+0000","last_became_active":"2024-05-28T06:05:48.831490+0000","last_became_peered":"2024-05-28T06:05:48.831490+0000","last_unstale":"2024-05-28T06:05:51.620707+0000","last_undegraded":"2024-05-28T06:05:51.620707+0000","last_fullsized":"2024-05-28T06:05:51.620707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:36:39.127901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-28T06:05:53.909 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-28T06:05:54.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.081+0000 7feacc400640 1 Processor -- start 2024-05-28T06:05:54.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.081+0000 7feacc400640 1 -- start start 2024-05-28T06:05:54.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.081+0000 7feacc400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7feac40722a0 0x7feac4072750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.081+0000 7feacc400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feac40ce6e0 0x7feac40ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.081+0000 7feacc400640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feac406e070 con 0x7feac4162be0 2024-05-28T06:05:54.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.081+0000 7feacc400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7feac41641b0 con 0x7feac40722a0 2024-05-28T06:05:54.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.081+0000 7feacc400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7feac4072c90 con 0x7feac40ce6e0 2024-05-28T06:05:54.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.081+0000 7feac9a00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7feac4162be0 0x7feac40cc7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56270/0 (socket says 172.21.15.122:56270) 2024-05-28T06:05:54.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.081+0000 7feac9a00640 1 -- 172.21.15.122:0/1182121726 learned_addr learned my addr 172.21.15.122:0/1182121726 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:54.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.081+0000 7feac9000640 1 --2- 172.21.15.122:0/1182121726 >> v2:172.21.15.153:3300/0 conn(0x7feac40722a0 0x7feac4072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:54.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.081+0000 7feaca400640 1 --2- 172.21.15.122:0/1182121726 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feac40ce6e0 0x7feac40ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:54.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feac3e00640 1 -- 172.21.15.122:0/1182121726 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 760769519 0 0) 0x7feac406e070 con 0x7feac4162be0 2024-05-28T06:05:54.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feac3e00640 1 -- 172.21.15.122:0/1182121726 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feaac003530 con 0x7feac4162be0 2024-05-28T06:05:54.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feac3e00640 1 -- 172.21.15.122:0/1182121726 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2527595830 0 0) 0x7feaac003530 con 0x7feac4162be0 2024-05-28T06:05:54.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feac3e00640 1 -- 172.21.15.122:0/1182121726 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feac40ce6e0 msgr2=0x7feac40ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:54.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feac3e00640 1 --2- 172.21.15.122:0/1182121726 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feac40ce6e0 0x7feac40ceb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feac3e00640 1 -- 172.21.15.122:0/1182121726 >> v2:172.21.15.153:3300/0 conn(0x7feac40722a0 msgr2=0x7feac4072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:54.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feac3e00640 1 --2- 172.21.15.122:0/1182121726 >> v2:172.21.15.153:3300/0 conn(0x7feac40722a0 0x7feac4072750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feac3e00640 1 -- 172.21.15.122:0/1182121726 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac406e350 con 0x7feac4162be0 2024-05-28T06:05:54.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feac3e00640 1 -- 172.21.15.122:0/1182121726 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7feab80016a0 con 0x7feac4162be0 2024-05-28T06:05:54.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feac3e00640 1 -- 172.21.15.122:0/1182121726 >> v1:172.21.15.122:6789/0 conn(0x7feac4162be0 legacy=0x7feac40cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:54.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feac3e00640 1 --2- 172.21.15.122:0/1182121726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feaac0039c0 0x7feaac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feac3e00640 1 --2- 172.21.15.122:0/1182121726 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feac40ce6e0 0x7feaac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feac3e00640 1 --2- 172.21.15.122:0/1182121726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feaac004d50 0x7feaac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feac3e00640 1 -- 172.21.15.122:0/1182121726 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7feaac00b9d0 con 0x7feaac004d50 2024-05-28T06:05:54.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feac3e00640 1 -- 172.21.15.122:0/1182121726 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feaac00bb50 con 0x7feaac0039c0 2024-05-28T06:05:54.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feac3e00640 1 -- 172.21.15.122:0/1182121726 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7feaac00bcd0 con 0x7feac40ce6e0 2024-05-28T06:05:54.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feac9000640 1 --2- 172.21.15.122:0/1182121726 >> v2:172.21.15.153:3300/0 conn(0x7feac40722a0 0x7feac4072750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:05:54.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feaca400640 1 --2- 172.21.15.122:0/1182121726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feaac004d50 0x7feaac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:54.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feac9a00640 1 --2- 172.21.15.122:0/1182121726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feaac0039c0 0x7feaac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:54.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feac9000640 1 --2- 172.21.15.122:0/1182121726 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feac40ce6e0 0x7feaac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:54.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feaca400640 1 -- 172.21.15.122:0/1182121726 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feac40ce6e0 msgr2=0x7feaac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:54.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feaca400640 1 --2- 172.21.15.122:0/1182121726 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feac40ce6e0 0x7feaac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feaca400640 1 -- 172.21.15.122:0/1182121726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feaac0039c0 msgr2=0x7feaac003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:54.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feaca400640 1 --2- 172.21.15.122:0/1182121726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feaac0039c0 0x7feaac003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.085+0000 7feaca400640 1 -- 172.21.15.122:0/1182121726 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaac003530 con 0x7feaac004d50 2024-05-28T06:05:54.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.089+0000 7feaca400640 1 --2- 172.21.15.122:0/1182121726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feaac004d50 0x7feaac0051d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7feabc009fc0 tx=0x7feabc01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8634eb4be0e205 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:54.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.089+0000 7feac3e00640 1 -- 172.21.15.122:0/1182121726 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc0b2070 con 0x7feaac004d50 2024-05-28T06:05:54.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.089+0000 7feac3e00640 1 -- 172.21.15.122:0/1182121726 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feabc0a5c90 con 0x7feaac004d50 2024-05-28T06:05:54.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.089+0000 7feac3e00640 1 -- 172.21.15.122:0/1182121726 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc009c10 con 0x7feaac004d50 2024-05-28T06:05:54.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.089+0000 7feacc400640 1 -- 172.21.15.122:0/1182121726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feaac004d50 msgr2=0x7feaac0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:54.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.089+0000 7feacc400640 1 --2- 172.21.15.122:0/1182121726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feaac004d50 0x7feaac0051d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7feabc009fc0 tx=0x7feabc01cc80 comp rx=0 tx=0).stop 2024-05-28T06:05:54.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.089+0000 7feaca400640 1 -- 172.21.15.122:0/1182121726 reap_dead start 2024-05-28T06:05:54.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.089+0000 7feacc400640 1 -- 172.21.15.122:0/1182121726 shutdown_connections 2024-05-28T06:05:54.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.089+0000 7feacc400640 1 -- 172.21.15.122:0/1182121726 >> 172.21.15.122:0/1182121726 conn(0x7feac406bd90 msgr2=0x7feac406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:54.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.089+0000 7feacc400640 1 -- 172.21.15.122:0/1182121726 shutdown_connections 2024-05-28T06:05:54.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.089+0000 7feacc400640 1 -- 172.21.15.122:0/1182121726 wait complete. 2024-05-28T06:05:54.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.089+0000 7feacc400640 1 Processor -- start 2024-05-28T06:05:54.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.089+0000 7feacc400640 1 -- start start 2024-05-28T06:05:54.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.089+0000 7feacc400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feaac004d50 0x7feac414c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.089+0000 7feacc400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feac41f88c0 0x7feac414f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.089+0000 7feacc400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feac4160550 0x7feac41609d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.089+0000 7feacc400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7feac406ebf0 con 0x7feaac004d50 2024-05-28T06:05:54.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.089+0000 7feacc400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feac406e910 con 0x7feac4160550 2024-05-28T06:05:54.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.089+0000 7feacc400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7feac406eed0 con 0x7feac41f88c0 2024-05-28T06:05:54.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.093+0000 7feac9a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feaac004d50 0x7feac414c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:54.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.093+0000 7feac9a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feaac004d50 0x7feac414c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36268/0 (socket says 172.21.15.122:36268) 2024-05-28T06:05:54.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.093+0000 7feac9a00640 1 -- 172.21.15.122:0/1771909385 learned_addr learned my addr 172.21.15.122:0/1771909385 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:54.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.093+0000 7feac9000640 1 --2- 172.21.15.122:0/1771909385 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feac41f88c0 0x7feac414f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:54.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.093+0000 7feaca400640 1 --2- 172.21.15.122:0/1771909385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feac4160550 0x7feac41609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:54.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.093+0000 7feac9a00640 1 -- 172.21.15.122:0/1771909385 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feac41f88c0 msgr2=0x7feac414f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:54.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.093+0000 7feac9a00640 1 --2- 172.21.15.122:0/1771909385 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feac41f88c0 0x7feac414f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.093+0000 7feac9a00640 1 -- 172.21.15.122:0/1771909385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feac4160550 msgr2=0x7feac41609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:54.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.093+0000 7feac9a00640 1 --2- 172.21.15.122:0/1771909385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feac4160550 0x7feac41609d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.093+0000 7feac9a00640 1 -- 172.21.15.122:0/1771909385 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac414fe40 con 0x7feaac004d50 2024-05-28T06:05:54.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.093+0000 7feac9a00640 1 --2- 172.21.15.122:0/1771909385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feaac004d50 0x7feac414c6c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feab800e7b0 tx=0x7feab800ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:54.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.093+0000 7feac1600640 1 -- 172.21.15.122:0/1771909385 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab800c660 con 0x7feaac004d50 2024-05-28T06:05:54.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.093+0000 7feac1600640 1 -- 172.21.15.122:0/1771909385 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab8018070 con 0x7feaac004d50 2024-05-28T06:05:54.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.093+0000 7feac1600640 1 -- 172.21.15.122:0/1771909385 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab800ca40 con 0x7feaac004d50 2024-05-28T06:05:54.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.093+0000 7feacc400640 1 -- 172.21.15.122:0/1771909385 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feac41f8df0 con 0x7feaac004d50 2024-05-28T06:05:54.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.093+0000 7feacc400640 1 -- 172.21.15.122:0/1771909385 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feac41f93b0 con 0x7feaac004d50 2024-05-28T06:05:54.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.093+0000 7feacc400640 1 -- 172.21.15.122:0/1771909385 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feac4068c40 con 0x7feaac004d50 2024-05-28T06:05:54.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.093+0000 7feac1600640 1 -- 172.21.15.122:0/1771909385 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feab800cbe0 con 0x7feaac004d50 2024-05-28T06:05:54.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.097+0000 7feac1600640 1 --2- 172.21.15.122:0/1771909385 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feaa4068380 0x7feaa406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.097+0000 7feac1600640 1 -- 172.21.15.122:0/1771909385 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7feab80866c0 con 0x7feaac004d50 2024-05-28T06:05:54.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.097+0000 7feac9000640 1 --2- 172.21.15.122:0/1771909385 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feaa4068380 0x7feaa406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:54.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.097+0000 7feac9000640 1 --2- 172.21.15.122:0/1771909385 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feaa4068380 0x7feaa406a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feac4165d00 tx=0x7feab0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:54.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.101+0000 7feac1600640 1 -- 172.21.15.122:0/1771909385 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feac414fe40 con 0x7feaac004d50 2024-05-28T06:05:54.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.253+0000 7feacc400640 1 -- 172.21.15.122:0/1771909385 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feac40b2760 con 0x7feaa4068380 2024-05-28T06:05:54.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.261+0000 7feac1600640 1 -- 172.21.15.122:0/1771909385 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7feab0009d00 con 0x7feaa4068380 2024-05-28T06:05:54.265 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:05:54.267 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-05-28T06:05:54.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.265+0000 7feacc400640 1 -- 172.21.15.122:0/1771909385 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feaa4068380 msgr2=0x7feaa406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:54.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.265+0000 7feacc400640 1 --2- 172.21.15.122:0/1771909385 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feaa4068380 0x7feaa406a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feac4165d00 tx=0x7feab0008040 comp rx=0 tx=0).stop 2024-05-28T06:05:54.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.265+0000 7feacc400640 1 -- 172.21.15.122:0/1771909385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feaac004d50 msgr2=0x7feac414c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:54.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.265+0000 7feacc400640 1 --2- 172.21.15.122:0/1771909385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feaac004d50 0x7feac414c6c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feab800e7b0 tx=0x7feab800ebb0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.265+0000 7feacc400640 1 -- 172.21.15.122:0/1771909385 shutdown_connections 2024-05-28T06:05:54.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.265+0000 7feacc400640 1 --2- 172.21.15.122:0/1771909385 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feaa4068380 0x7feaa406a840 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.265+0000 7feacc400640 1 --2- 172.21.15.122:0/1771909385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feac4160550 0x7feac41609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.265+0000 7feacc400640 1 --2- 172.21.15.122:0/1771909385 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feac41f88c0 0x7feac414f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.265+0000 7feacc400640 1 --2- 172.21.15.122:0/1771909385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feaac004d50 0x7feac414c6c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.265+0000 7feacc400640 1 -- 172.21.15.122:0/1771909385 >> 172.21.15.122:0/1771909385 conn(0x7feac406bd90 msgr2=0x7feac4162fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:54.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.265+0000 7feacc400640 1 -- 172.21.15.122:0/1771909385 shutdown_connections 2024-05-28T06:05:54.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.265+0000 7feacc400640 1 -- 172.21.15.122:0/1771909385 wait complete. 2024-05-28T06:05:54.285 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-28T06:05:53.244467+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218976,"kb_used_data":2788,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755744,"statfs":{"total":773094113280,"available":772869881856,"internally_reserved":0,"allocated":2854912,"data_stored":1734128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.449753"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619807+0000","last_change":"2024-05-28T06:05:49.850357+0000","last_active":"2024-05-28T06:05:51.619807+0000","last_peered":"2024-05-28T06:05:51.619807+0000","last_clean":"2024-05-28T06:05:51.619807+0000","last_became_active":"2024-05-28T06:05:49.850082+0000","last_became_peered":"2024-05-28T06:05:49.850082+0000","last_unstale":"2024-05-28T06:05:51.619807+0000","last_undegraded":"2024-05-28T06:05:51.619807+0000","last_fullsized":"2024-05-28T06:05:51.619807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:58:07.996206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.847064+0000","last_change":"2024-05-28T06:05:49.836997+0000","last_active":"2024-05-28T06:05:50.847064+0000","last_peered":"2024-05-28T06:05:50.847064+0000","last_clean":"2024-05-28T06:05:50.847064+0000","last_became_active":"2024-05-28T06:05:49.836057+0000","last_became_peered":"2024-05-28T06:05:49.836057+0000","last_unstale":"2024-05-28T06:05:50.847064+0000","last_undegraded":"2024-05-28T06:05:50.847064+0000","last_fullsized":"2024-05-28T06:05:50.847064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:05.258933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620342+0000","last_change":"2024-05-28T06:05:49.842388+0000","last_active":"2024-05-28T06:05:51.620342+0000","last_peered":"2024-05-28T06:05:51.620342+0000","last_clean":"2024-05-28T06:05:51.620342+0000","last_became_active":"2024-05-28T06:05:49.833739+0000","last_became_peered":"2024-05-28T06:05:49.833739+0000","last_unstale":"2024-05-28T06:05:51.620342+0000","last_undegraded":"2024-05-28T06:05:51.620342+0000","last_fullsized":"2024-05-28T06:05:51.620342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:45:56.563383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830740+0000","last_change":"2024-05-28T06:05:49.836000+0000","last_active":"2024-05-28T06:05:50.830740+0000","last_peered":"2024-05-28T06:05:50.830740+0000","last_clean":"2024-05-28T06:05:50.830740+0000","last_became_active":"2024-05-28T06:05:49.835023+0000","last_became_peered":"2024-05-28T06:05:49.835023+0000","last_unstale":"2024-05-28T06:05:50.830740+0000","last_undegraded":"2024-05-28T06:05:50.830740+0000","last_fullsized":"2024-05-28T06:05:50.830740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:47:59.969773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619431+0000","last_change":"2024-05-28T06:05:49.842728+0000","last_active":"2024-05-28T06:05:51.619431+0000","last_peered":"2024-05-28T06:05:51.619431+0000","last_clean":"2024-05-28T06:05:51.619431+0000","last_became_active":"2024-05-28T06:05:49.842348+0000","last_became_peered":"2024-05-28T06:05:49.842348+0000","last_unstale":"2024-05-28T06:05:51.619431+0000","last_undegraded":"2024-05-28T06:05:51.619431+0000","last_fullsized":"2024-05-28T06:05:51.619431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:57:50.858798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830496+0000","last_change":"2024-05-28T06:05:49.831551+0000","last_active":"2024-05-28T06:05:50.830496+0000","last_peered":"2024-05-28T06:05:50.830496+0000","last_clean":"2024-05-28T06:05:50.830496+0000","last_became_active":"2024-05-28T06:05:49.831275+0000","last_became_peered":"2024-05-28T06:05:49.831275+0000","last_unstale":"2024-05-28T06:05:50.830496+0000","last_undegraded":"2024-05-28T06:05:50.830496+0000","last_fullsized":"2024-05-28T06:05:50.830496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:05.258933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619374+0000","last_change":"2024-05-28T06:05:49.833865+0000","last_active":"2024-05-28T06:05:51.619374+0000","last_peered":"2024-05-28T06:05:51.619374+0000","last_clean":"2024-05-28T06:05:51.619374+0000","last_became_active":"2024-05-28T06:05:49.833613+0000","last_became_peered":"2024-05-28T06:05:49.833613+0000","last_unstale":"2024-05-28T06:05:51.619374+0000","last_undegraded":"2024-05-28T06:05:51.619374+0000","last_fullsized":"2024-05-28T06:05:51.619374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:47:59.969773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619570+0000","last_change":"2024-05-28T06:05:49.832366+0000","last_active":"2024-05-28T06:05:51.619570+0000","last_peered":"2024-05-28T06:05:51.619570+0000","last_clean":"2024-05-28T06:05:51.619570+0000","last_became_active":"2024-05-28T06:05:49.832055+0000","last_became_peered":"2024-05-28T06:05:49.832055+0000","last_unstale":"2024-05-28T06:05:51.619570+0000","last_undegraded":"2024-05-28T06:05:51.619570+0000","last_fullsized":"2024-05-28T06:05:51.619570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:45:56.563383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619839+0000","last_change":"2024-05-28T06:05:49.845929+0000","last_active":"2024-05-28T06:05:51.619839+0000","last_peered":"2024-05-28T06:05:51.619839+0000","last_clean":"2024-05-28T06:05:51.619839+0000","last_became_active":"2024-05-28T06:05:49.845642+0000","last_became_peered":"2024-05-28T06:05:49.845642+0000","last_unstale":"2024-05-28T06:05:51.619839+0000","last_undegraded":"2024-05-28T06:05:51.619839+0000","last_fullsized":"2024-05-28T06:05:51.619839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:25:16.860803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849143+0000","last_change":"2024-05-28T06:05:49.840616+0000","last_active":"2024-05-28T06:05:50.849143+0000","last_peered":"2024-05-28T06:05:50.849143+0000","last_clean":"2024-05-28T06:05:50.849143+0000","last_became_active":"2024-05-28T06:05:49.840364+0000","last_became_peered":"2024-05-28T06:05:49.840364+0000","last_unstale":"2024-05-28T06:05:50.849143+0000","last_undegraded":"2024-05-28T06:05:50.849143+0000","last_fullsized":"2024-05-28T06:05:50.849143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:39.576444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849043+0000","last_change":"2024-05-28T06:05:49.838656+0000","last_active":"2024-05-28T06:05:50.849043+0000","last_peered":"2024-05-28T06:05:50.849043+0000","last_clean":"2024-05-28T06:05:50.849043+0000","last_became_active":"2024-05-28T06:05:49.838227+0000","last_became_peered":"2024-05-28T06:05:49.838227+0000","last_unstale":"2024-05-28T06:05:50.849043+0000","last_undegraded":"2024-05-28T06:05:50.849043+0000","last_fullsized":"2024-05-28T06:05:50.849043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:39:57.417861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832049+0000","last_change":"2024-05-28T06:05:49.839298+0000","last_active":"2024-05-28T06:05:50.832049+0000","last_peered":"2024-05-28T06:05:50.832049+0000","last_clean":"2024-05-28T06:05:50.832049+0000","last_became_active":"2024-05-28T06:05:49.839024+0000","last_became_peered":"2024-05-28T06:05:49.839024+0000","last_unstale":"2024-05-28T06:05:50.832049+0000","last_undegraded":"2024-05-28T06:05:50.832049+0000","last_fullsized":"2024-05-28T06:05:50.832049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:24:17.481208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619981+0000","last_change":"2024-05-28T06:05:49.852183+0000","last_active":"2024-05-28T06:05:51.619981+0000","last_peered":"2024-05-28T06:05:51.619981+0000","last_clean":"2024-05-28T06:05:51.619981+0000","last_became_active":"2024-05-28T06:05:49.851929+0000","last_became_peered":"2024-05-28T06:05:49.851929+0000","last_unstale":"2024-05-28T06:05:51.619981+0000","last_undegraded":"2024-05-28T06:05:51.619981+0000","last_fullsized":"2024-05-28T06:05:51.619981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:40:46.277733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620009+0000","last_change":"2024-05-28T06:05:49.830872+0000","last_active":"2024-05-28T06:05:51.620009+0000","last_peered":"2024-05-28T06:05:51.620009+0000","last_clean":"2024-05-28T06:05:51.620009+0000","last_became_active":"2024-05-28T06:05:49.829663+0000","last_became_peered":"2024-05-28T06:05:49.829663+0000","last_unstale":"2024-05-28T06:05:51.620009+0000","last_undegraded":"2024-05-28T06:05:51.620009+0000","last_fullsized":"2024-05-28T06:05:51.620009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:45:45.914430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846818+0000","last_change":"2024-05-28T06:05:49.841218+0000","last_active":"2024-05-28T06:05:50.846818+0000","last_peered":"2024-05-28T06:05:50.846818+0000","last_clean":"2024-05-28T06:05:50.846818+0000","last_became_active":"2024-05-28T06:05:49.839685+0000","last_became_peered":"2024-05-28T06:05:49.839685+0000","last_unstale":"2024-05-28T06:05:50.846818+0000","last_undegraded":"2024-05-28T06:05:50.846818+0000","last_fullsized":"2024-05-28T06:05:50.846818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:45:56.563383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830436+0000","last_change":"2024-05-28T06:05:49.834469+0000","last_active":"2024-05-28T06:05:50.830436+0000","last_peered":"2024-05-28T06:05:50.830436+0000","last_clean":"2024-05-28T06:05:50.830436+0000","last_became_active":"2024-05-28T06:05:49.834129+0000","last_became_peered":"2024-05-28T06:05:49.834129+0000","last_unstale":"2024-05-28T06:05:50.830436+0000","last_undegraded":"2024-05-28T06:05:50.830436+0000","last_fullsized":"2024-05-28T06:05:50.830436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:39.576444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832847+0000","last_change":"2024-05-28T06:05:49.836984+0000","last_active":"2024-05-28T06:05:50.832847+0000","last_peered":"2024-05-28T06:05:50.832847+0000","last_clean":"2024-05-28T06:05:50.832847+0000","last_became_active":"2024-05-28T06:05:49.836754+0000","last_became_peered":"2024-05-28T06:05:49.836754+0000","last_unstale":"2024-05-28T06:05:50.832847+0000","last_undegraded":"2024-05-28T06:05:50.832847+0000","last_fullsized":"2024-05-28T06:05:50.832847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:25:16.860803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275303+0000","last_change":"2024-05-28T06:05:49.843255+0000","last_active":"2024-05-28T06:05:51.275303+0000","last_peered":"2024-05-28T06:05:51.275303+0000","last_clean":"2024-05-28T06:05:51.275303+0000","last_became_active":"2024-05-28T06:05:49.841453+0000","last_became_peered":"2024-05-28T06:05:49.841453+0000","last_unstale":"2024-05-28T06:05:51.275303+0000","last_undegraded":"2024-05-28T06:05:51.275303+0000","last_fullsized":"2024-05-28T06:05:51.275303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:47:11.938003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619672+0000","last_change":"2024-05-28T06:05:49.850933+0000","last_active":"2024-05-28T06:05:51.619672+0000","last_peered":"2024-05-28T06:05:51.619672+0000","last_clean":"2024-05-28T06:05:51.619672+0000","last_became_active":"2024-05-28T06:05:49.850659+0000","last_became_peered":"2024-05-28T06:05:49.850659+0000","last_unstale":"2024-05-28T06:05:51.619672+0000","last_undegraded":"2024-05-28T06:05:51.619672+0000","last_fullsized":"2024-05-28T06:05:51.619672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:54:25.520215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849165+0000","last_change":"2024-05-28T06:05:49.835678+0000","last_active":"2024-05-28T06:05:50.849165+0000","last_peered":"2024-05-28T06:05:50.849165+0000","last_clean":"2024-05-28T06:05:50.849165+0000","last_became_active":"2024-05-28T06:05:49.835404+0000","last_became_peered":"2024-05-28T06:05:49.835404+0000","last_unstale":"2024-05-28T06:05:50.849165+0000","last_undegraded":"2024-05-28T06:05:50.849165+0000","last_fullsized":"2024-05-28T06:05:50.849165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:05.258933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620237+0000","last_change":"2024-05-28T06:05:49.837644+0000","last_active":"2024-05-28T06:05:51.620237+0000","last_peered":"2024-05-28T06:05:51.620237+0000","last_clean":"2024-05-28T06:05:51.620237+0000","last_became_active":"2024-05-28T06:05:49.833254+0000","last_became_peered":"2024-05-28T06:05:49.833254+0000","last_unstale":"2024-05-28T06:05:51.620237+0000","last_undegraded":"2024-05-28T06:05:51.620237+0000","last_fullsized":"2024-05-28T06:05:51.620237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:37:35.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830664+0000","last_change":"2024-05-28T06:05:49.835830+0000","last_active":"2024-05-28T06:05:50.830664+0000","last_peered":"2024-05-28T06:05:50.830664+0000","last_clean":"2024-05-28T06:05:50.830664+0000","last_became_active":"2024-05-28T06:05:49.835539+0000","last_became_peered":"2024-05-28T06:05:49.835539+0000","last_unstale":"2024-05-28T06:05:50.830664+0000","last_undegraded":"2024-05-28T06:05:50.830664+0000","last_fullsized":"2024-05-28T06:05:50.830664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:40:46.277733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619508+0000","last_change":"2024-05-28T06:05:49.847289+0000","last_active":"2024-05-28T06:05:51.619508+0000","last_peered":"2024-05-28T06:05:51.619508+0000","last_clean":"2024-05-28T06:05:51.619508+0000","last_became_active":"2024-05-28T06:05:49.846943+0000","last_became_peered":"2024-05-28T06:05:49.846943+0000","last_unstale":"2024-05-28T06:05:51.619508+0000","last_undegraded":"2024-05-28T06:05:51.619508+0000","last_fullsized":"2024-05-28T06:05:51.619508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:46:50.877903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830612+0000","last_change":"2024-05-28T06:05:49.832701+0000","last_active":"2024-05-28T06:05:50.830612+0000","last_peered":"2024-05-28T06:05:50.830612+0000","last_clean":"2024-05-28T06:05:50.830612+0000","last_became_active":"2024-05-28T06:05:49.832339+0000","last_became_peered":"2024-05-28T06:05:49.832339+0000","last_unstale":"2024-05-28T06:05:50.830612+0000","last_undegraded":"2024-05-28T06:05:50.830612+0000","last_fullsized":"2024-05-28T06:05:50.830612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:19:32.041344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619788+0000","last_change":"2024-05-28T06:05:49.836126+0000","last_active":"2024-05-28T06:05:51.619788+0000","last_peered":"2024-05-28T06:05:51.619788+0000","last_clean":"2024-05-28T06:05:51.619788+0000","last_became_active":"2024-05-28T06:05:49.835875+0000","last_became_peered":"2024-05-28T06:05:49.835875+0000","last_unstale":"2024-05-28T06:05:51.619788+0000","last_undegraded":"2024-05-28T06:05:51.619788+0000","last_fullsized":"2024-05-28T06:05:51.619788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:39.576444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849191+0000","last_change":"2024-05-28T06:05:49.839809+0000","last_active":"2024-05-28T06:05:50.849191+0000","last_peered":"2024-05-28T06:05:50.849191+0000","last_clean":"2024-05-28T06:05:50.849191+0000","last_became_active":"2024-05-28T06:05:49.839063+0000","last_became_peered":"2024-05-28T06:05:49.839063+0000","last_unstale":"2024-05-28T06:05:50.849191+0000","last_undegraded":"2024-05-28T06:05:50.849191+0000","last_fullsized":"2024-05-28T06:05:50.849191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:19:32.041344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846997+0000","last_change":"2024-05-28T06:05:49.837449+0000","last_active":"2024-05-28T06:05:50.846997+0000","last_peered":"2024-05-28T06:05:50.846997+0000","last_clean":"2024-05-28T06:05:50.846997+0000","last_became_active":"2024-05-28T06:05:49.833358+0000","last_became_peered":"2024-05-28T06:05:49.833358+0000","last_unstale":"2024-05-28T06:05:50.846997+0000","last_undegraded":"2024-05-28T06:05:50.846997+0000","last_fullsized":"2024-05-28T06:05:50.846997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:39.576444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619737+0000","last_change":"2024-05-28T06:05:49.836384+0000","last_active":"2024-05-28T06:05:51.619737+0000","last_peered":"2024-05-28T06:05:51.619737+0000","last_clean":"2024-05-28T06:05:51.619737+0000","last_became_active":"2024-05-28T06:05:49.835821+0000","last_became_peered":"2024-05-28T06:05:49.835821+0000","last_unstale":"2024-05-28T06:05:51.619737+0000","last_undegraded":"2024-05-28T06:05:51.619737+0000","last_fullsized":"2024-05-28T06:05:51.619737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:32:22.883360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620320+0000","last_change":"2024-05-28T06:05:49.838410+0000","last_active":"2024-05-28T06:05:51.620320+0000","last_peered":"2024-05-28T06:05:51.620320+0000","last_clean":"2024-05-28T06:05:51.620320+0000","last_became_active":"2024-05-28T06:05:49.838053+0000","last_became_peered":"2024-05-28T06:05:49.838053+0000","last_unstale":"2024-05-28T06:05:51.620320+0000","last_undegraded":"2024-05-28T06:05:51.620320+0000","last_fullsized":"2024-05-28T06:05:51.620320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:46:50.877903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830834+0000","last_change":"2024-05-28T06:05:49.851329+0000","last_active":"2024-05-28T06:05:50.830834+0000","last_peered":"2024-05-28T06:05:50.830834+0000","last_clean":"2024-05-28T06:05:50.830834+0000","last_became_active":"2024-05-28T06:05:49.850771+0000","last_became_peered":"2024-05-28T06:05:49.850771+0000","last_unstale":"2024-05-28T06:05:50.830834+0000","last_undegraded":"2024-05-28T06:05:50.830834+0000","last_fullsized":"2024-05-28T06:05:50.830834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:57:50.858798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275129+0000","last_change":"2024-05-28T06:05:49.822523+0000","last_active":"2024-05-28T06:05:51.275129+0000","last_peered":"2024-05-28T06:05:51.275129+0000","last_clean":"2024-05-28T06:05:51.275129+0000","last_became_active":"2024-05-28T06:05:49.822143+0000","last_became_peered":"2024-05-28T06:05:49.822143+0000","last_unstale":"2024-05-28T06:05:51.275129+0000","last_undegraded":"2024-05-28T06:05:51.275129+0000","last_fullsized":"2024-05-28T06:05:51.275129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:24:17.481208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.848820+0000","last_change":"2024-05-28T06:05:49.840151+0000","last_active":"2024-05-28T06:05:50.848820+0000","last_peered":"2024-05-28T06:05:50.848820+0000","last_clean":"2024-05-28T06:05:50.848820+0000","last_became_active":"2024-05-28T06:05:49.839815+0000","last_became_peered":"2024-05-28T06:05:49.839815+0000","last_unstale":"2024-05-28T06:05:50.848820+0000","last_undegraded":"2024-05-28T06:05:50.848820+0000","last_fullsized":"2024-05-28T06:05:50.848820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:46:50.877903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832139+0000","last_change":"2024-05-28T06:05:49.834448+0000","last_active":"2024-05-28T06:05:50.832139+0000","last_peered":"2024-05-28T06:05:50.832139+0000","last_clean":"2024-05-28T06:05:50.832139+0000","last_became_active":"2024-05-28T06:05:49.833479+0000","last_became_peered":"2024-05-28T06:05:49.833479+0000","last_unstale":"2024-05-28T06:05:50.832139+0000","last_undegraded":"2024-05-28T06:05:50.832139+0000","last_fullsized":"2024-05-28T06:05:50.832139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:03:32.895368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620222+0000","last_change":"2024-05-28T06:05:48.832582+0000","last_active":"2024-05-28T06:05:51.620222+0000","last_peered":"2024-05-28T06:05:51.620222+0000","last_clean":"2024-05-28T06:05:51.620222+0000","last_became_active":"2024-05-28T06:05:48.828599+0000","last_became_peered":"2024-05-28T06:05:48.828599+0000","last_unstale":"2024-05-28T06:05:51.620222+0000","last_undegraded":"2024-05-28T06:05:51.620222+0000","last_fullsized":"2024-05-28T06:05:51.620222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:15:33.728795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620372+0000","last_change":"2024-05-28T06:05:49.838397+0000","last_active":"2024-05-28T06:05:51.620372+0000","last_peered":"2024-05-28T06:05:51.620372+0000","last_clean":"2024-05-28T06:05:51.620372+0000","last_became_active":"2024-05-28T06:05:49.838080+0000","last_became_peered":"2024-05-28T06:05:49.838080+0000","last_unstale":"2024-05-28T06:05:51.620372+0000","last_undegraded":"2024-05-28T06:05:51.620372+0000","last_fullsized":"2024-05-28T06:05:51.620372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:32:22.883360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.848958+0000","last_change":"2024-05-28T06:05:48.823837+0000","last_active":"2024-05-28T06:05:50.848958+0000","last_peered":"2024-05-28T06:05:50.848958+0000","last_clean":"2024-05-28T06:05:50.848958+0000","last_became_active":"2024-05-28T06:05:48.823531+0000","last_became_peered":"2024-05-28T06:05:48.823531+0000","last_unstale":"2024-05-28T06:05:50.848958+0000","last_undegraded":"2024-05-28T06:05:50.848958+0000","last_fullsized":"2024-05-28T06:05:50.848958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:30:03.706927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619568+0000","last_change":"2024-05-28T06:05:48.829331+0000","last_active":"2024-05-28T06:05:51.619568+0000","last_peered":"2024-05-28T06:05:51.619568+0000","last_clean":"2024-05-28T06:05:51.619568+0000","last_became_active":"2024-05-28T06:05:48.828618+0000","last_became_peered":"2024-05-28T06:05:48.828618+0000","last_unstale":"2024-05-28T06:05:51.619568+0000","last_undegraded":"2024-05-28T06:05:51.619568+0000","last_fullsized":"2024-05-28T06:05:51.619568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:41:15.562847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619431+0000","last_change":"2024-05-28T06:05:49.835162+0000","last_active":"2024-05-28T06:05:51.619431+0000","last_peered":"2024-05-28T06:05:51.619431+0000","last_clean":"2024-05-28T06:05:51.619431+0000","last_became_active":"2024-05-28T06:05:49.834914+0000","last_became_peered":"2024-05-28T06:05:49.834914+0000","last_unstale":"2024-05-28T06:05:51.619431+0000","last_undegraded":"2024-05-28T06:05:51.619431+0000","last_fullsized":"2024-05-28T06:05:51.619431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:37:35.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830705+0000","last_change":"2024-05-28T06:05:48.819148+0000","last_active":"2024-05-28T06:05:50.830705+0000","last_peered":"2024-05-28T06:05:50.830705+0000","last_clean":"2024-05-28T06:05:50.830705+0000","last_became_active":"2024-05-28T06:05:48.818867+0000","last_became_peered":"2024-05-28T06:05:48.818867+0000","last_unstale":"2024-05-28T06:05:50.830705+0000","last_undegraded":"2024-05-28T06:05:50.830705+0000","last_fullsized":"2024-05-28T06:05:50.830705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:54:54.655580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846821+0000","last_change":"2024-05-28T06:05:49.835117+0000","last_active":"2024-05-28T06:05:50.846821+0000","last_peered":"2024-05-28T06:05:50.846821+0000","last_clean":"2024-05-28T06:05:50.846821+0000","last_became_active":"2024-05-28T06:05:49.834862+0000","last_became_peered":"2024-05-28T06:05:49.834862+0000","last_unstale":"2024-05-28T06:05:50.846821+0000","last_undegraded":"2024-05-28T06:05:50.846821+0000","last_fullsized":"2024-05-28T06:05:50.846821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:46:50.877903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849118+0000","last_change":"2024-05-28T06:05:48.829871+0000","last_active":"2024-05-28T06:05:50.849118+0000","last_peered":"2024-05-28T06:05:50.849118+0000","last_clean":"2024-05-28T06:05:50.849118+0000","last_became_active":"2024-05-28T06:05:48.829598+0000","last_became_peered":"2024-05-28T06:05:48.829598+0000","last_unstale":"2024-05-28T06:05:50.849118+0000","last_undegraded":"2024-05-28T06:05:50.849118+0000","last_fullsized":"2024-05-28T06:05:50.849118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:18:51.804296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832692+0000","last_change":"2024-05-28T06:05:49.837126+0000","last_active":"2024-05-28T06:05:50.832692+0000","last_peered":"2024-05-28T06:05:50.832692+0000","last_clean":"2024-05-28T06:05:50.832692+0000","last_became_active":"2024-05-28T06:05:49.836676+0000","last_became_peered":"2024-05-28T06:05:49.836676+0000","last_unstale":"2024-05-28T06:05:50.832692+0000","last_undegraded":"2024-05-28T06:05:50.832692+0000","last_fullsized":"2024-05-28T06:05:50.832692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:58:07.996206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832655+0000","last_change":"2024-05-28T06:05:48.821859+0000","last_active":"2024-05-28T06:05:50.832655+0000","last_peered":"2024-05-28T06:05:50.832655+0000","last_clean":"2024-05-28T06:05:50.832655+0000","last_became_active":"2024-05-28T06:05:48.821297+0000","last_became_peered":"2024-05-28T06:05:48.821297+0000","last_unstale":"2024-05-28T06:05:50.832655+0000","last_undegraded":"2024-05-28T06:05:50.832655+0000","last_fullsized":"2024-05-28T06:05:50.832655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:35:04.180425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620652+0000","last_change":"2024-05-28T06:05:49.831784+0000","last_active":"2024-05-28T06:05:51.620652+0000","last_peered":"2024-05-28T06:05:51.620652+0000","last_clean":"2024-05-28T06:05:51.620652+0000","last_became_active":"2024-05-28T06:05:49.831487+0000","last_became_peered":"2024-05-28T06:05:49.831487+0000","last_unstale":"2024-05-28T06:05:51.620652+0000","last_undegraded":"2024-05-28T06:05:51.620652+0000","last_fullsized":"2024-05-28T06:05:51.620652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:05.258933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846970+0000","last_change":"2024-05-28T06:05:48.817642+0000","last_active":"2024-05-28T06:05:50.846970+0000","last_peered":"2024-05-28T06:05:50.846970+0000","last_clean":"2024-05-28T06:05:50.846970+0000","last_became_active":"2024-05-28T06:05:48.816830+0000","last_became_peered":"2024-05-28T06:05:48.816830+0000","last_unstale":"2024-05-28T06:05:50.846970+0000","last_undegraded":"2024-05-28T06:05:50.846970+0000","last_fullsized":"2024-05-28T06:05:50.846970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:30:03.706927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832103+0000","last_change":"2024-05-28T06:05:49.831624+0000","last_active":"2024-05-28T06:05:50.832103+0000","last_peered":"2024-05-28T06:05:50.832103+0000","last_clean":"2024-05-28T06:05:50.832103+0000","last_became_active":"2024-05-28T06:05:49.830861+0000","last_became_peered":"2024-05-28T06:05:49.830861+0000","last_unstale":"2024-05-28T06:05:50.832103+0000","last_undegraded":"2024-05-28T06:05:50.832103+0000","last_fullsized":"2024-05-28T06:05:50.832103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:47:11.938003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849091+0000","last_change":"2024-05-28T06:05:48.827308+0000","last_active":"2024-05-28T06:05:50.849091+0000","last_peered":"2024-05-28T06:05:50.849091+0000","last_clean":"2024-05-28T06:05:50.849091+0000","last_became_active":"2024-05-28T06:05:48.827058+0000","last_became_peered":"2024-05-28T06:05:48.827058+0000","last_unstale":"2024-05-28T06:05:50.849091+0000","last_undegraded":"2024-05-28T06:05:50.849091+0000","last_fullsized":"2024-05-28T06:05:50.849091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:03:31.889186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619356+0000","last_change":"2024-05-28T06:05:49.850742+0000","last_active":"2024-05-28T06:05:51.619356+0000","last_peered":"2024-05-28T06:05:51.619356+0000","last_clean":"2024-05-28T06:05:51.619356+0000","last_became_active":"2024-05-28T06:05:49.850284+0000","last_became_peered":"2024-05-28T06:05:49.850284+0000","last_unstale":"2024-05-28T06:05:51.619356+0000","last_undegraded":"2024-05-28T06:05:51.619356+0000","last_fullsized":"2024-05-28T06:05:51.619356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:19:32.041344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620430+0000","last_change":"2024-05-28T06:05:48.825087+0000","last_active":"2024-05-28T06:05:51.620430+0000","last_peered":"2024-05-28T06:05:51.620430+0000","last_clean":"2024-05-28T06:05:51.620430+0000","last_became_active":"2024-05-28T06:05:48.824790+0000","last_became_peered":"2024-05-28T06:05:48.824790+0000","last_unstale":"2024-05-28T06:05:51.620430+0000","last_undegraded":"2024-05-28T06:05:51.620430+0000","last_fullsized":"2024-05-28T06:05:51.620430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:41:15.562847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620110+0000","last_change":"2024-05-28T06:05:49.831857+0000","last_active":"2024-05-28T06:05:51.620110+0000","last_peered":"2024-05-28T06:05:51.620110+0000","last_clean":"2024-05-28T06:05:51.620110+0000","last_became_active":"2024-05-28T06:05:49.831461+0000","last_became_peered":"2024-05-28T06:05:49.831461+0000","last_unstale":"2024-05-28T06:05:51.620110+0000","last_undegraded":"2024-05-28T06:05:51.620110+0000","last_fullsized":"2024-05-28T06:05:51.620110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:02:07.375017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830945+0000","last_change":"2024-05-28T06:05:48.827406+0000","last_active":"2024-05-28T06:05:50.830945+0000","last_peered":"2024-05-28T06:05:50.830945+0000","last_clean":"2024-05-28T06:05:50.830945+0000","last_became_active":"2024-05-28T06:05:48.827095+0000","last_became_peered":"2024-05-28T06:05:48.827095+0000","last_unstale":"2024-05-28T06:05:50.830945+0000","last_undegraded":"2024-05-28T06:05:50.830945+0000","last_fullsized":"2024-05-28T06:05:50.830945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:18:51.804296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619606+0000","last_change":"2024-05-28T06:05:49.848867+0000","last_active":"2024-05-28T06:05:51.619606+0000","last_peered":"2024-05-28T06:05:51.619606+0000","last_clean":"2024-05-28T06:05:51.619606+0000","last_became_active":"2024-05-28T06:05:49.848544+0000","last_became_peered":"2024-05-28T06:05:49.848544+0000","last_unstale":"2024-05-28T06:05:51.619606+0000","last_undegraded":"2024-05-28T06:05:51.619606+0000","last_fullsized":"2024-05-28T06:05:51.619606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:54:32.928419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.848795+0000","last_change":"2024-05-28T06:05:48.823850+0000","last_active":"2024-05-28T06:05:50.848795+0000","last_peered":"2024-05-28T06:05:50.848795+0000","last_clean":"2024-05-28T06:05:50.848795+0000","last_became_active":"2024-05-28T06:05:48.823565+0000","last_became_peered":"2024-05-28T06:05:48.823565+0000","last_unstale":"2024-05-28T06:05:50.848795+0000","last_undegraded":"2024-05-28T06:05:50.848795+0000","last_fullsized":"2024-05-28T06:05:50.848795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:54:54.655580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.848867+0000","last_change":"2024-05-28T06:05:49.833197+0000","last_active":"2024-05-28T06:05:50.848867+0000","last_peered":"2024-05-28T06:05:50.848867+0000","last_clean":"2024-05-28T06:05:50.848867+0000","last_became_active":"2024-05-28T06:05:49.832937+0000","last_became_peered":"2024-05-28T06:05:49.832937+0000","last_unstale":"2024-05-28T06:05:50.848867+0000","last_undegraded":"2024-05-28T06:05:50.848867+0000","last_fullsized":"2024-05-28T06:05:50.848867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:32:22.883360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275013+0000","last_change":"2024-05-28T06:05:48.826780+0000","last_active":"2024-05-28T06:05:51.275013+0000","last_peered":"2024-05-28T06:05:51.275013+0000","last_clean":"2024-05-28T06:05:51.275013+0000","last_became_active":"2024-05-28T06:05:48.824955+0000","last_became_peered":"2024-05-28T06:05:48.824955+0000","last_unstale":"2024-05-28T06:05:51.275013+0000","last_undegraded":"2024-05-28T06:05:51.275013+0000","last_fullsized":"2024-05-28T06:05:51.275013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:41:15.562847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619355+0000","last_change":"2024-05-28T06:05:49.841278+0000","last_active":"2024-05-28T06:05:51.619355+0000","last_peered":"2024-05-28T06:05:51.619355+0000","last_clean":"2024-05-28T06:05:51.619355+0000","last_became_active":"2024-05-28T06:05:49.840945+0000","last_became_peered":"2024-05-28T06:05:49.840945+0000","last_unstale":"2024-05-28T06:05:51.619355+0000","last_undegraded":"2024-05-28T06:05:51.619355+0000","last_fullsized":"2024-05-28T06:05:51.619355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:40:46.277733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832319+0000","last_change":"2024-05-28T06:05:48.825832+0000","last_active":"2024-05-28T06:05:50.832319+0000","last_peered":"2024-05-28T06:05:50.832319+0000","last_clean":"2024-05-28T06:05:50.832319+0000","last_became_active":"2024-05-28T06:05:48.825446+0000","last_became_peered":"2024-05-28T06:05:48.825446+0000","last_unstale":"2024-05-28T06:05:50.832319+0000","last_undegraded":"2024-05-28T06:05:50.832319+0000","last_fullsized":"2024-05-28T06:05:50.832319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:09:22.855060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619710+0000","last_change":"2024-05-28T06:05:49.854377+0000","last_active":"2024-05-28T06:05:51.619710+0000","last_peered":"2024-05-28T06:05:51.619710+0000","last_clean":"2024-05-28T06:05:51.619710+0000","last_became_active":"2024-05-28T06:05:49.853287+0000","last_became_peered":"2024-05-28T06:05:49.853287+0000","last_unstale":"2024-05-28T06:05:51.619710+0000","last_undegraded":"2024-05-28T06:05:51.619710+0000","last_fullsized":"2024-05-28T06:05:51.619710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:54:47.876861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275258+0000","last_change":"2024-05-28T06:05:48.828277+0000","last_active":"2024-05-28T06:05:51.275258+0000","last_peered":"2024-05-28T06:05:51.275258+0000","last_clean":"2024-05-28T06:05:51.275258+0000","last_became_active":"2024-05-28T06:05:48.828066+0000","last_became_peered":"2024-05-28T06:05:48.828066+0000","last_unstale":"2024-05-28T06:05:51.275258+0000","last_undegraded":"2024-05-28T06:05:51.275258+0000","last_fullsized":"2024-05-28T06:05:51.275258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:54:54.655580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619958+0000","last_change":"2024-05-28T06:05:49.852523+0000","last_active":"2024-05-28T06:05:51.619958+0000","last_peered":"2024-05-28T06:05:51.619958+0000","last_clean":"2024-05-28T06:05:51.619958+0000","last_became_active":"2024-05-28T06:05:49.852170+0000","last_became_peered":"2024-05-28T06:05:49.852170+0000","last_unstale":"2024-05-28T06:05:51.619958+0000","last_undegraded":"2024-05-28T06:05:51.619958+0000","last_fullsized":"2024-05-28T06:05:51.619958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:30:15.652435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.847045+0000","last_change":"2024-05-28T06:05:48.825987+0000","last_active":"2024-05-28T06:05:50.847045+0000","last_peered":"2024-05-28T06:05:50.847045+0000","last_clean":"2024-05-28T06:05:50.847045+0000","last_became_active":"2024-05-28T06:05:48.824571+0000","last_became_peered":"2024-05-28T06:05:48.824571+0000","last_unstale":"2024-05-28T06:05:50.847045+0000","last_undegraded":"2024-05-28T06:05:50.847045+0000","last_fullsized":"2024-05-28T06:05:50.847045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:24:16.475026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830941+0000","last_change":"2024-05-28T06:05:49.835359+0000","last_active":"2024-05-28T06:05:50.830941+0000","last_peered":"2024-05-28T06:05:50.830941+0000","last_clean":"2024-05-28T06:05:50.830941+0000","last_became_active":"2024-05-28T06:05:49.834666+0000","last_became_peered":"2024-05-28T06:05:49.834666+0000","last_unstale":"2024-05-28T06:05:50.830941+0000","last_undegraded":"2024-05-28T06:05:50.830941+0000","last_fullsized":"2024-05-28T06:05:50.830941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:54:32.928419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275152+0000","last_change":"2024-05-28T06:05:48.826646+0000","last_active":"2024-05-28T06:05:51.275152+0000","last_peered":"2024-05-28T06:05:51.275152+0000","last_clean":"2024-05-28T06:05:51.275152+0000","last_became_active":"2024-05-28T06:05:48.825673+0000","last_became_peered":"2024-05-28T06:05:48.825673+0000","last_unstale":"2024-05-28T06:05:51.275152+0000","last_undegraded":"2024-05-28T06:05:51.275152+0000","last_fullsized":"2024-05-28T06:05:51.275152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:35:04.180425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619481+0000","last_change":"2024-05-28T06:05:49.846068+0000","last_active":"2024-05-28T06:05:51.619481+0000","last_peered":"2024-05-28T06:05:51.619481+0000","last_clean":"2024-05-28T06:05:51.619481+0000","last_became_active":"2024-05-28T06:05:49.845797+0000","last_became_peered":"2024-05-28T06:05:49.845797+0000","last_unstale":"2024-05-28T06:05:51.619481+0000","last_undegraded":"2024-05-28T06:05:51.619481+0000","last_fullsized":"2024-05-28T06:05:51.619481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:58:36.770938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619274+0000","last_change":"2024-05-28T06:05:38.517922+0000","last_active":"2024-05-28T06:05:51.619274+0000","last_peered":"2024-05-28T06:05:51.619274+0000","last_clean":"2024-05-28T06:05:51.619274+0000","last_became_active":"2024-05-28T06:05:38.514745+0000","last_became_peered":"2024-05-28T06:05:38.514745+0000","last_unstale":"2024-05-28T06:05:51.619274+0000","last_undegraded":"2024-05-28T06:05:51.619274+0000","last_fullsized":"2024-05-28T06:05:51.619274+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_clean_scrub_stamp":"2024-05-28T06:05:37.485018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:23:27.978203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830398+0000","last_change":"2024-05-28T06:05:48.821497+0000","last_active":"2024-05-28T06:05:50.830398+0000","last_peered":"2024-05-28T06:05:50.830398+0000","last_clean":"2024-05-28T06:05:50.830398+0000","last_became_active":"2024-05-28T06:05:48.821092+0000","last_became_peered":"2024-05-28T06:05:48.821092+0000","last_unstale":"2024-05-28T06:05:50.830398+0000","last_undegraded":"2024-05-28T06:05:50.830398+0000","last_fullsized":"2024-05-28T06:05:50.830398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:15:33.728795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620353+0000","last_change":"2024-05-28T06:05:49.841257+0000","last_active":"2024-05-28T06:05:51.620353+0000","last_peered":"2024-05-28T06:05:51.620353+0000","last_clean":"2024-05-28T06:05:51.620353+0000","last_became_active":"2024-05-28T06:05:49.840922+0000","last_became_peered":"2024-05-28T06:05:49.840922+0000","last_unstale":"2024-05-28T06:05:51.620353+0000","last_undegraded":"2024-05-28T06:05:51.620353+0000","last_fullsized":"2024-05-28T06:05:51.620353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:57:50.858798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619054+0000","last_change":"2024-05-28T06:05:48.829694+0000","last_active":"2024-05-28T06:05:51.619054+0000","last_peered":"2024-05-28T06:05:51.619054+0000","last_clean":"2024-05-28T06:05:51.619054+0000","last_became_active":"2024-05-28T06:05:48.829470+0000","last_became_peered":"2024-05-28T06:05:48.829470+0000","last_unstale":"2024-05-28T06:05:51.619054+0000","last_undegraded":"2024-05-28T06:05:51.619054+0000","last_fullsized":"2024-05-28T06:05:51.619054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:03:31.889186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619991+0000","last_change":"2024-05-28T06:05:49.842825+0000","last_active":"2024-05-28T06:05:51.619991+0000","last_peered":"2024-05-28T06:05:51.619991+0000","last_clean":"2024-05-28T06:05:51.619991+0000","last_became_active":"2024-05-28T06:05:49.842497+0000","last_became_peered":"2024-05-28T06:05:49.842497+0000","last_unstale":"2024-05-28T06:05:51.619991+0000","last_undegraded":"2024-05-28T06:05:51.619991+0000","last_fullsized":"2024-05-28T06:05:51.619991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:30:16.017763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275109+0000","last_change":"2024-05-28T06:05:48.824739+0000","last_active":"2024-05-28T06:05:51.275109+0000","last_peered":"2024-05-28T06:05:51.275109+0000","last_clean":"2024-05-28T06:05:51.275109+0000","last_became_active":"2024-05-28T06:05:48.824425+0000","last_became_peered":"2024-05-28T06:05:48.824425+0000","last_unstale":"2024-05-28T06:05:51.275109+0000","last_undegraded":"2024-05-28T06:05:51.275109+0000","last_fullsized":"2024-05-28T06:05:51.275109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:15:33.728795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846831+0000","last_change":"2024-05-28T06:05:49.832900+0000","last_active":"2024-05-28T06:05:50.846831+0000","last_peered":"2024-05-28T06:05:50.846831+0000","last_clean":"2024-05-28T06:05:50.846831+0000","last_became_active":"2024-05-28T06:05:49.832648+0000","last_became_peered":"2024-05-28T06:05:49.832648+0000","last_unstale":"2024-05-28T06:05:50.846831+0000","last_undegraded":"2024-05-28T06:05:50.846831+0000","last_fullsized":"2024-05-28T06:05:50.846831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:32:22.883360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.831036+0000","last_change":"2024-05-28T06:05:48.809280+0000","last_active":"2024-05-28T06:05:50.831036+0000","last_peered":"2024-05-28T06:05:50.831036+0000","last_clean":"2024-05-28T06:05:50.831036+0000","last_became_active":"2024-05-28T06:05:48.808937+0000","last_became_peered":"2024-05-28T06:05:48.808937+0000","last_unstale":"2024-05-28T06:05:50.831036+0000","last_undegraded":"2024-05-28T06:05:50.831036+0000","last_fullsized":"2024-05-28T06:05:50.831036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:03:31.889186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832022+0000","last_change":"2024-05-28T06:05:49.840563+0000","last_active":"2024-05-28T06:05:50.832022+0000","last_peered":"2024-05-28T06:05:50.832022+0000","last_clean":"2024-05-28T06:05:50.832022+0000","last_became_active":"2024-05-28T06:05:49.840221+0000","last_became_peered":"2024-05-28T06:05:49.840221+0000","last_unstale":"2024-05-28T06:05:50.832022+0000","last_undegraded":"2024-05-28T06:05:50.832022+0000","last_fullsized":"2024-05-28T06:05:50.832022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:53:43.751639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.847057+0000","last_change":"2024-05-28T06:05:48.819109+0000","last_active":"2024-05-28T06:05:50.847057+0000","last_peered":"2024-05-28T06:05:50.847057+0000","last_clean":"2024-05-28T06:05:50.847057+0000","last_became_active":"2024-05-28T06:05:48.818859+0000","last_became_peered":"2024-05-28T06:05:48.818859+0000","last_unstale":"2024-05-28T06:05:50.847057+0000","last_undegraded":"2024-05-28T06:05:50.847057+0000","last_fullsized":"2024-05-28T06:05:50.847057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:54:54.655580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.831618+0000","last_change":"2024-05-28T06:05:49.835770+0000","last_active":"2024-05-28T06:05:50.831618+0000","last_peered":"2024-05-28T06:05:50.831618+0000","last_clean":"2024-05-28T06:05:50.831618+0000","last_became_active":"2024-05-28T06:05:49.835041+0000","last_became_peered":"2024-05-28T06:05:49.835041+0000","last_unstale":"2024-05-28T06:05:50.831618+0000","last_undegraded":"2024-05-28T06:05:50.831618+0000","last_fullsized":"2024-05-28T06:05:50.831618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:54:47.876861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619634+0000","last_change":"2024-05-28T06:05:48.832048+0000","last_active":"2024-05-28T06:05:51.619634+0000","last_peered":"2024-05-28T06:05:51.619634+0000","last_clean":"2024-05-28T06:05:51.619634+0000","last_became_active":"2024-05-28T06:05:48.831810+0000","last_became_peered":"2024-05-28T06:05:48.831810+0000","last_unstale":"2024-05-28T06:05:51.619634+0000","last_undegraded":"2024-05-28T06:05:51.619634+0000","last_fullsized":"2024-05-28T06:05:51.619634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:47:10.931821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846971+0000","last_change":"2024-05-28T06:05:49.830201+0000","last_active":"2024-05-28T06:05:50.846971+0000","last_peered":"2024-05-28T06:05:50.846971+0000","last_clean":"2024-05-28T06:05:50.846971+0000","last_became_active":"2024-05-28T06:05:49.829999+0000","last_became_peered":"2024-05-28T06:05:49.829999+0000","last_unstale":"2024-05-28T06:05:50.846971+0000","last_undegraded":"2024-05-28T06:05:50.846971+0000","last_fullsized":"2024-05-28T06:05:50.846971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:39:57.417861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849020+0000","last_change":"2024-05-28T06:05:48.822728+0000","last_active":"2024-05-28T06:05:50.849020+0000","last_peered":"2024-05-28T06:05:50.849020+0000","last_clean":"2024-05-28T06:05:50.849020+0000","last_became_active":"2024-05-28T06:05:48.822411+0000","last_became_peered":"2024-05-28T06:05:48.822411+0000","last_unstale":"2024-05-28T06:05:50.849020+0000","last_undegraded":"2024-05-28T06:05:50.849020+0000","last_fullsized":"2024-05-28T06:05:50.849020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:53:42.745457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619778+0000","last_change":"2024-05-28T06:05:49.833123+0000","last_active":"2024-05-28T06:05:51.619778+0000","last_peered":"2024-05-28T06:05:51.619778+0000","last_clean":"2024-05-28T06:05:51.619778+0000","last_became_active":"2024-05-28T06:05:49.832802+0000","last_became_peered":"2024-05-28T06:05:49.832802+0000","last_unstale":"2024-05-28T06:05:51.619778+0000","last_undegraded":"2024-05-28T06:05:51.619778+0000","last_fullsized":"2024-05-28T06:05:51.619778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:39:57.417861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849200+0000","last_change":"2024-05-28T06:05:48.828295+0000","last_active":"2024-05-28T06:05:50.849200+0000","last_peered":"2024-05-28T06:05:50.849200+0000","last_clean":"2024-05-28T06:05:50.849200+0000","last_became_active":"2024-05-28T06:05:48.827978+0000","last_became_peered":"2024-05-28T06:05:48.827978+0000","last_unstale":"2024-05-28T06:05:50.849200+0000","last_undegraded":"2024-05-28T06:05:50.849200+0000","last_fullsized":"2024-05-28T06:05:50.849200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:35:04.180425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620520+0000","last_change":"2024-05-28T06:05:49.838136+0000","last_active":"2024-05-28T06:05:51.620520+0000","last_peered":"2024-05-28T06:05:51.620520+0000","last_clean":"2024-05-28T06:05:51.620520+0000","last_became_active":"2024-05-28T06:05:49.837836+0000","last_became_peered":"2024-05-28T06:05:49.837836+0000","last_unstale":"2024-05-28T06:05:51.620520+0000","last_undegraded":"2024-05-28T06:05:51.620520+0000","last_fullsized":"2024-05-28T06:05:51.620520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:39:57.417861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619057+0000","last_change":"2024-05-28T06:05:48.832109+0000","last_active":"2024-05-28T06:05:51.619057+0000","last_peered":"2024-05-28T06:05:51.619057+0000","last_clean":"2024-05-28T06:05:51.619057+0000","last_became_active":"2024-05-28T06:05:48.831767+0000","last_became_peered":"2024-05-28T06:05:48.831767+0000","last_unstale":"2024-05-28T06:05:51.619057+0000","last_undegraded":"2024-05-28T06:05:51.619057+0000","last_fullsized":"2024-05-28T06:05:51.619057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:18:51.804296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.831881+0000","last_change":"2024-05-28T06:05:49.833942+0000","last_active":"2024-05-28T06:05:50.831881+0000","last_peered":"2024-05-28T06:05:50.831881+0000","last_clean":"2024-05-28T06:05:50.831881+0000","last_became_active":"2024-05-28T06:05:49.833670+0000","last_became_peered":"2024-05-28T06:05:49.833670+0000","last_unstale":"2024-05-28T06:05:50.831881+0000","last_undegraded":"2024-05-28T06:05:50.831881+0000","last_fullsized":"2024-05-28T06:05:50.831881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:30:04.713109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846913+0000","last_change":"2024-05-28T06:05:48.829088+0000","last_active":"2024-05-28T06:05:50.846913+0000","last_peered":"2024-05-28T06:05:50.846913+0000","last_clean":"2024-05-28T06:05:50.846913+0000","last_became_active":"2024-05-28T06:05:48.827450+0000","last_became_peered":"2024-05-28T06:05:48.827450+0000","last_unstale":"2024-05-28T06:05:50.846913+0000","last_undegraded":"2024-05-28T06:05:50.846913+0000","last_fullsized":"2024-05-28T06:05:50.846913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:18:51.804296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619940+0000","last_change":"2024-05-28T06:05:49.833747+0000","last_active":"2024-05-28T06:05:51.619940+0000","last_peered":"2024-05-28T06:05:51.619940+0000","last_clean":"2024-05-28T06:05:51.619940+0000","last_became_active":"2024-05-28T06:05:49.833491+0000","last_became_peered":"2024-05-28T06:05:49.833491+0000","last_unstale":"2024-05-28T06:05:51.619940+0000","last_undegraded":"2024-05-28T06:05:51.619940+0000","last_fullsized":"2024-05-28T06:05:51.619940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:05.258933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846855+0000","last_change":"2024-05-28T06:05:48.833870+0000","last_active":"2024-05-28T06:05:50.846855+0000","last_peered":"2024-05-28T06:05:50.846855+0000","last_clean":"2024-05-28T06:05:50.846855+0000","last_became_active":"2024-05-28T06:05:48.833568+0000","last_became_peered":"2024-05-28T06:05:48.833568+0000","last_unstale":"2024-05-28T06:05:50.846855+0000","last_undegraded":"2024-05-28T06:05:50.846855+0000","last_fullsized":"2024-05-28T06:05:50.846855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:03:31.889186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620136+0000","last_change":"2024-05-28T06:05:49.843381+0000","last_active":"2024-05-28T06:05:51.620136+0000","last_peered":"2024-05-28T06:05:51.620136+0000","last_clean":"2024-05-28T06:05:51.620136+0000","last_became_active":"2024-05-28T06:05:49.843084+0000","last_became_peered":"2024-05-28T06:05:49.843084+0000","last_unstale":"2024-05-28T06:05:51.620136+0000","last_undegraded":"2024-05-28T06:05:51.620136+0000","last_fullsized":"2024-05-28T06:05:51.620136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:47:59.969773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619556+0000","last_change":"2024-05-28T06:05:48.835110+0000","last_active":"2024-05-28T06:05:51.619556+0000","last_peered":"2024-05-28T06:05:51.619556+0000","last_clean":"2024-05-28T06:05:51.619556+0000","last_became_active":"2024-05-28T06:05:48.834798+0000","last_became_peered":"2024-05-28T06:05:48.834798+0000","last_unstale":"2024-05-28T06:05:51.619556+0000","last_undegraded":"2024-05-28T06:05:51.619556+0000","last_fullsized":"2024-05-28T06:05:51.619556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:30:03.706927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.848840+0000","last_change":"2024-05-28T06:05:49.843875+0000","last_active":"2024-05-28T06:05:50.848840+0000","last_peered":"2024-05-28T06:05:50.848840+0000","last_clean":"2024-05-28T06:05:50.848840+0000","last_became_active":"2024-05-28T06:05:49.843563+0000","last_became_peered":"2024-05-28T06:05:49.843563+0000","last_unstale":"2024-05-28T06:05:50.848840+0000","last_undegraded":"2024-05-28T06:05:50.848840+0000","last_fullsized":"2024-05-28T06:05:50.848840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:45:56.563383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.831457+0000","last_change":"2024-05-28T06:05:49.836054+0000","last_active":"2024-05-28T06:05:50.831457+0000","last_peered":"2024-05-28T06:05:50.831457+0000","last_clean":"2024-05-28T06:05:50.831457+0000","last_became_active":"2024-05-28T06:05:49.835419+0000","last_became_peered":"2024-05-28T06:05:49.835419+0000","last_unstale":"2024-05-28T06:05:50.831457+0000","last_undegraded":"2024-05-28T06:05:50.831457+0000","last_fullsized":"2024-05-28T06:05:50.831457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:54:25.520215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619437+0000","last_change":"2024-05-28T06:05:48.834583+0000","last_active":"2024-05-28T06:05:51.619437+0000","last_peered":"2024-05-28T06:05:51.619437+0000","last_clean":"2024-05-28T06:05:51.619437+0000","last_became_active":"2024-05-28T06:05:48.834258+0000","last_became_peered":"2024-05-28T06:05:48.834258+0000","last_unstale":"2024-05-28T06:05:51.619437+0000","last_undegraded":"2024-05-28T06:05:51.619437+0000","last_fullsized":"2024-05-28T06:05:51.619437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:53:42.745457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830842+0000","last_change":"2024-05-28T06:05:49.836273+0000","last_active":"2024-05-28T06:05:50.830842+0000","last_peered":"2024-05-28T06:05:50.830842+0000","last_clean":"2024-05-28T06:05:50.830842+0000","last_became_active":"2024-05-28T06:05:49.835705+0000","last_became_peered":"2024-05-28T06:05:49.835705+0000","last_unstale":"2024-05-28T06:05:50.830842+0000","last_undegraded":"2024-05-28T06:05:50.830842+0000","last_fullsized":"2024-05-28T06:05:50.830842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:58:36.770938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619503+0000","last_change":"2024-05-28T06:05:48.833771+0000","last_active":"2024-05-28T06:05:51.619503+0000","last_peered":"2024-05-28T06:05:51.619503+0000","last_clean":"2024-05-28T06:05:51.619503+0000","last_became_active":"2024-05-28T06:05:48.833473+0000","last_became_peered":"2024-05-28T06:05:48.833473+0000","last_unstale":"2024-05-28T06:05:51.619503+0000","last_undegraded":"2024-05-28T06:05:51.619503+0000","last_fullsized":"2024-05-28T06:05:51.619503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:24:16.475026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620560+0000","last_change":"2024-05-28T06:05:49.831923+0000","last_active":"2024-05-28T06:05:51.620560+0000","last_peered":"2024-05-28T06:05:51.620560+0000","last_clean":"2024-05-28T06:05:51.620560+0000","last_became_active":"2024-05-28T06:05:49.830965+0000","last_became_peered":"2024-05-28T06:05:49.830965+0000","last_unstale":"2024-05-28T06:05:51.620560+0000","last_undegraded":"2024-05-28T06:05:51.620560+0000","last_fullsized":"2024-05-28T06:05:51.620560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:39.576444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620118+0000","last_change":"2024-05-28T06:05:48.828378+0000","last_active":"2024-05-28T06:05:51.620118+0000","last_peered":"2024-05-28T06:05:51.620118+0000","last_clean":"2024-05-28T06:05:51.620118+0000","last_became_active":"2024-05-28T06:05:48.827986+0000","last_became_peered":"2024-05-28T06:05:48.827986+0000","last_unstale":"2024-05-28T06:05:51.620118+0000","last_undegraded":"2024-05-28T06:05:51.620118+0000","last_fullsized":"2024-05-28T06:05:51.620118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:35:04.180425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619943+0000","last_change":"2024-05-28T06:05:49.852871+0000","last_active":"2024-05-28T06:05:51.619943+0000","last_peered":"2024-05-28T06:05:51.619943+0000","last_clean":"2024-05-28T06:05:51.619943+0000","last_became_active":"2024-05-28T06:05:49.852559+0000","last_became_peered":"2024-05-28T06:05:49.852559+0000","last_unstale":"2024-05-28T06:05:51.619943+0000","last_undegraded":"2024-05-28T06:05:51.619943+0000","last_fullsized":"2024-05-28T06:05:51.619943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:19:32.041344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620707+0000","last_change":"2024-05-28T06:05:48.832472+0000","last_active":"2024-05-28T06:05:51.620707+0000","last_peered":"2024-05-28T06:05:51.620707+0000","last_clean":"2024-05-28T06:05:51.620707+0000","last_became_active":"2024-05-28T06:05:48.831490+0000","last_became_peered":"2024-05-28T06:05:48.831490+0000","last_unstale":"2024-05-28T06:05:51.620707+0000","last_undegraded":"2024-05-28T06:05:51.620707+0000","last_fullsized":"2024-05-28T06:05:51.620707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:36:39.127901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-28T06:05:54.289 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-28T06:05:54.289 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-28T06:05:54.290 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-28T06:05:54.290 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-28T06:05:54.290 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-28T06:05:54.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.461+0000 7f6ab8e00640 1 Processor -- start 2024-05-28T06:05:54.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.461+0000 7f6ab8e00640 1 -- start start 2024-05-28T06:05:54.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.461+0000 7f6ab8e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6ab415f4c0 0x7f6ab41588b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.461+0000 7f6ab8e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6ab406e070 0x7f6ab4140580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.461+0000 7f6ab8e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6ab40722a0 0x7f6ab415e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.461+0000 7f6ab8e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f6ab4141420 con 0x7f6ab415f4c0 2024-05-28T06:05:54.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.461+0000 7f6ab8e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6ab406e4b0 con 0x7f6ab406e070 2024-05-28T06:05:54.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.461+0000 7f6ab8e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab4140e60 con 0x7f6ab40722a0 2024-05-28T06:05:54.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.461+0000 7f6ab1e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6ab415f4c0 0x7f6ab41588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:54.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.461+0000 7f6ab1e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6ab415f4c0 0x7f6ab41588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36276/0 (socket says 172.21.15.122:36276) 2024-05-28T06:05:54.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.461+0000 7f6ab1e00640 1 -- 172.21.15.122:0/538140487 learned_addr learned my addr 172.21.15.122:0/538140487 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:54.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.465+0000 7f6ab1e00640 1 -- 172.21.15.122:0/538140487 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6ab40722a0 msgr2=0x7f6ab415e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:54.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.465+0000 7f6ab1e00640 1 --2- 172.21.15.122:0/538140487 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6ab40722a0 0x7f6ab415e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.465+0000 7f6ab1e00640 1 -- 172.21.15.122:0/538140487 >> v2:172.21.15.153:3300/0 conn(0x7f6ab406e070 msgr2=0x7f6ab4140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:54.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.465+0000 7f6ab1e00640 1 --2- 172.21.15.122:0/538140487 >> v2:172.21.15.153:3300/0 conn(0x7f6ab406e070 0x7f6ab4140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.465+0000 7f6ab1e00640 1 -- 172.21.15.122:0/538140487 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab4141140 con 0x7f6ab415f4c0 2024-05-28T06:05:54.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.465+0000 7f6ab1e00640 1 --2- 172.21.15.122:0/538140487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ab415f4c0 0x7f6ab41588b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4070310 tx=0x7f6aa401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7650ac427b799454 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:54.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.465+0000 7f6ab1400640 1 -- 172.21.15.122:0/538140487 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa40aa610 con 0x7f6ab415f4c0 2024-05-28T06:05:54.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.465+0000 7f6ab1400640 1 -- 172.21.15.122:0/538140487 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa40af070 con 0x7f6ab415f4c0 2024-05-28T06:05:54.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.465+0000 7f6ab1400640 1 -- 172.21.15.122:0/538140487 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa40aa9d0 con 0x7f6ab415f4c0 2024-05-28T06:05:54.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.465+0000 7f6ab8e00640 1 -- 172.21.15.122:0/538140487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ab415f4c0 msgr2=0x7f6ab41588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:54.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.465+0000 7f6ab8e00640 1 --2- 172.21.15.122:0/538140487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ab415f4c0 0x7f6ab41588b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4070310 tx=0x7f6aa401c4f0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.465+0000 7f6ab8e00640 1 -- 172.21.15.122:0/538140487 shutdown_connections 2024-05-28T06:05:54.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.465+0000 7f6ab8e00640 1 --2- 172.21.15.122:0/538140487 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6ab40722a0 0x7f6ab415e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.465+0000 7f6ab8e00640 1 --2- 172.21.15.122:0/538140487 >> v2:172.21.15.153:3300/0 conn(0x7f6ab406e070 0x7f6ab4140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.465+0000 7f6ab8e00640 1 --2- 172.21.15.122:0/538140487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ab415f4c0 0x7f6ab41588b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.465+0000 7f6ab8e00640 1 -- 172.21.15.122:0/538140487 >> 172.21.15.122:0/538140487 conn(0x7f6ab406bd90 msgr2=0x7f6ab406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:54.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.469+0000 7f6ab8e00640 1 -- 172.21.15.122:0/538140487 shutdown_connections 2024-05-28T06:05:54.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.469+0000 7f6ab8e00640 1 -- 172.21.15.122:0/538140487 wait complete. 2024-05-28T06:05:54.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.469+0000 7f6ab8e00640 1 Processor -- start 2024-05-28T06:05:54.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.469+0000 7f6ab8e00640 1 -- start start 2024-05-28T06:05:54.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.469+0000 7f6ab8e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6ab406e070 0x7f6ab413a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.469+0000 7f6ab8e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ab40722a0 0x7f6ab413de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.469+0000 7f6ab8e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab415f4c0 0x7f6ab413c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.469+0000 7f6ab8e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab4072890 con 0x7f6ab40722a0 2024-05-28T06:05:54.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.469+0000 7f6ab8e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab4072710 con 0x7f6ab415f4c0 2024-05-28T06:05:54.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.469+0000 7f6ab8e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab415edf0 con 0x7f6ab406e070 2024-05-28T06:05:54.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.469+0000 7f6aa9400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ab40722a0 0x7f6ab413de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:54.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.469+0000 7f6aa9400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ab40722a0 0x7f6ab413de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36290/0 (socket says 172.21.15.122:36290) 2024-05-28T06:05:54.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.469+0000 7f6aa9400640 1 -- 172.21.15.122:0/3338513409 learned_addr learned my addr 172.21.15.122:0/3338513409 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:54.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.469+0000 7f6aa9400640 1 -- 172.21.15.122:0/3338513409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6ab406e070 msgr2=0x7f6ab413a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:54.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.469+0000 7f6aa9400640 1 --2- 172.21.15.122:0/3338513409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6ab406e070 0x7f6ab413a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.469+0000 7f6aa9400640 1 -- 172.21.15.122:0/3338513409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab415f4c0 msgr2=0x7f6ab413c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:54.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.469+0000 7f6aa9400640 1 --2- 172.21.15.122:0/3338513409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab415f4c0 0x7f6ab413c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.469+0000 7f6aa9400640 1 -- 172.21.15.122:0/3338513409 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab413c930 con 0x7f6ab40722a0 2024-05-28T06:05:54.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.469+0000 7f6aa9400640 1 --2- 172.21.15.122:0/3338513409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ab40722a0 0x7f6ab413de60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c00b580 tx=0x7f6a9c00ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:54.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.469+0000 7f6aaaa00640 1 -- 172.21.15.122:0/3338513409 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c014070 con 0x7f6ab40722a0 2024-05-28T06:05:54.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.469+0000 7f6aaaa00640 1 -- 172.21.15.122:0/3338513409 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a9c010890 con 0x7f6ab40722a0 2024-05-28T06:05:54.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.469+0000 7f6aaaa00640 1 -- 172.21.15.122:0/3338513409 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c010c80 con 0x7f6ab40722a0 2024-05-28T06:05:54.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.469+0000 7f6ab8e00640 1 -- 172.21.15.122:0/3338513409 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab40ae9b0 con 0x7f6ab40722a0 2024-05-28T06:05:54.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.473+0000 7f6ab8e00640 1 -- 172.21.15.122:0/3338513409 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab40aef70 con 0x7f6ab40722a0 2024-05-28T06:05:54.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.473+0000 7f6ab8e00640 1 -- 172.21.15.122:0/3338513409 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ab4068c40 con 0x7f6ab40722a0 2024-05-28T06:05:54.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.473+0000 7f6aaaa00640 1 -- 172.21.15.122:0/3338513409 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6a9c017070 con 0x7f6ab40722a0 2024-05-28T06:05:54.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.473+0000 7f6aaaa00640 1 --2- 172.21.15.122:0/3338513409 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6a90068380 0x7f6a9006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.473+0000 7f6aaaa00640 1 -- 172.21.15.122:0/3338513409 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6a9c0867d0 con 0x7f6ab40722a0 2024-05-28T06:05:54.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.473+0000 7f6ab1e00640 1 --2- 172.21.15.122:0/3338513409 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6a90068380 0x7f6a9006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:54.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.473+0000 7f6ab1e00640 1 --2- 172.21.15.122:0/3338513409 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6a90068380 0x7f6a9006a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40ae000 tx=0x7f6aa4004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:54.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.477+0000 7f6aaaa00640 1 -- 172.21.15.122:0/3338513409 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6a9c056d00 con 0x7f6ab40722a0 2024-05-28T06:05:54.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.673+0000 7f6ab8e00640 1 -- 172.21.15.122:0/3338513409 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f6ab4157f50 con 0x7f6ab40722a0 2024-05-28T06:05:54.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.673+0000 7f6aaaa00640 1 -- 172.21.15.122:0/3338513409 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+168092 (secure 0 0 0) 0x7f6a9c010e20 con 0x7f6ab40722a0 2024-05-28T06:05:54.679 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:05:54.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.677+0000 7f6ab8e00640 1 -- 172.21.15.122:0/3338513409 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6a90068380 msgr2=0x7f6a9006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:54.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.677+0000 7f6ab8e00640 1 --2- 172.21.15.122:0/3338513409 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6a90068380 0x7f6a9006a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40ae000 tx=0x7f6aa4004740 comp rx=0 tx=0).stop 2024-05-28T06:05:54.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.677+0000 7f6ab8e00640 1 -- 172.21.15.122:0/3338513409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ab40722a0 msgr2=0x7f6ab413de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:54.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.677+0000 7f6ab8e00640 1 --2- 172.21.15.122:0/3338513409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ab40722a0 0x7f6ab413de60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c00b580 tx=0x7f6a9c00ba40 comp rx=0 tx=0).stop 2024-05-28T06:05:54.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.677+0000 7f6ab8e00640 1 -- 172.21.15.122:0/3338513409 shutdown_connections 2024-05-28T06:05:54.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.677+0000 7f6ab8e00640 1 --2- 172.21.15.122:0/3338513409 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6a90068380 0x7f6a9006a840 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.677+0000 7f6ab8e00640 1 --2- 172.21.15.122:0/3338513409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab415f4c0 0x7f6ab413c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.677+0000 7f6ab8e00640 1 --2- 172.21.15.122:0/3338513409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ab40722a0 0x7f6ab413de60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.677+0000 7f6ab8e00640 1 --2- 172.21.15.122:0/3338513409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6ab406e070 0x7f6ab413a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.677+0000 7f6ab8e00640 1 -- 172.21.15.122:0/3338513409 >> 172.21.15.122:0/3338513409 conn(0x7f6ab406bd90 msgr2=0x7f6ab415a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:54.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.677+0000 7f6ab8e00640 1 -- 172.21.15.122:0/3338513409 shutdown_connections 2024-05-28T06:05:54.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.677+0000 7f6ab8e00640 1 -- 172.21.15.122:0/3338513409 wait complete. 2024-05-28T06:05:54.700 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3134913340},{"type":"v1","addr":"172.21.15.122:6833","nonce":3134913340}]},"active_addr":"172.21.15.122:6833/3134913340","active_change":"2024-05-28T06:05:29.230946+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.122:0","nonce":2569594510}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.122:0","nonce":2705054814}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.122:0","nonce":1573179230}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.122:0","nonce":3486103989}]}]} 2024-05-28T06:05:54.703 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-28T06:05:54.703 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-28T06:05:54.704 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:05:54.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.837+0000 7fca80200640 1 Processor -- start 2024-05-28T06:05:54.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.837+0000 7fca80200640 1 -- start start 2024-05-28T06:05:54.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca80200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fca78072750 0x7fca780cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca80200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca7806e070 con 0x7fca78162be0 2024-05-28T06:05:54.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca80200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca7806e350 con 0x7fca780722a0 2024-05-28T06:05:54.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca80200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fca781641b0 con 0x7fca78072750 2024-05-28T06:05:54.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca7d800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fca78162be0 0x7fca780cc7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56272/0 (socket says 172.21.15.122:56272) 2024-05-28T06:05:54.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca7d800640 1 -- 172.21.15.122:0/69143824 learned_addr learned my addr 172.21.15.122:0/69143824 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:54.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca77e00640 1 -- 172.21.15.122:0/69143824 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4108010873 0 0) 0x7fca7806e070 con 0x7fca78162be0 2024-05-28T06:05:54.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca77e00640 1 -- 172.21.15.122:0/69143824 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca60003530 con 0x7fca78162be0 2024-05-28T06:05:54.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca7e200640 1 --2- 172.21.15.122:0/69143824 >> v2:172.21.15.153:3300/0 conn(0x7fca78072750 0x7fca780cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:54.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca77e00640 1 -- 172.21.15.122:0/69143824 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2589263883 0 0) 0x7fca60003530 con 0x7fca78162be0 2024-05-28T06:05:54.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca77e00640 1 -- 172.21.15.122:0/69143824 >> v2:172.21.15.153:3300/0 conn(0x7fca78072750 msgr2=0x7fca780cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:54.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca77e00640 1 --2- 172.21.15.122:0/69143824 >> v2:172.21.15.153:3300/0 conn(0x7fca78072750 0x7fca780cedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca77e00640 1 -- 172.21.15.122:0/69143824 >> v1:172.21.15.153:6789/0 conn(0x7fca780722a0 legacy=0x7fca780ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:54.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca77e00640 1 -- 172.21.15.122:0/69143824 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7806e630 con 0x7fca78162be0 2024-05-28T06:05:54.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca77e00640 1 -- 172.21.15.122:0/69143824 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7fca6c001680 con 0x7fca78162be0 2024-05-28T06:05:54.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca77e00640 1 -- 172.21.15.122:0/69143824 >> v1:172.21.15.122:6789/0 conn(0x7fca78162be0 legacy=0x7fca780cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:54.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca77e00640 1 --2- 172.21.15.122:0/69143824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca600039c0 0x7fca60003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca77e00640 1 --2- 172.21.15.122:0/69143824 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca60004810 0x7fca60004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca77e00640 1 --2- 172.21.15.122:0/69143824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca600051d0 0x7fca6000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca77e00640 1 -- 172.21.15.122:0/69143824 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fca6000c0a0 con 0x7fca600039c0 2024-05-28T06:05:54.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca77e00640 1 -- 172.21.15.122:0/69143824 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fca6000c220 con 0x7fca600051d0 2024-05-28T06:05:54.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca77e00640 1 -- 172.21.15.122:0/69143824 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fca6000c420 con 0x7fca60004810 2024-05-28T06:05:54.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca7d800640 1 --2- 172.21.15.122:0/69143824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca600039c0 0x7fca60003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:54.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca7e200640 1 --2- 172.21.15.122:0/69143824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca600051d0 0x7fca6000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:54.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca7d800640 1 -- 172.21.15.122:0/69143824 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca60004810 msgr2=0x7fca60004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:54.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca7d800640 1 --2- 172.21.15.122:0/69143824 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca60004810 0x7fca60004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca7d800640 1 -- 172.21.15.122:0/69143824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca600051d0 msgr2=0x7fca6000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:54.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca7d800640 1 --2- 172.21.15.122:0/69143824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca600051d0 0x7fca6000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca7d800640 1 -- 172.21.15.122:0/69143824 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca60003530 con 0x7fca600039c0 2024-05-28T06:05:54.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.841+0000 7fca7e200640 1 -- 172.21.15.122:0/69143824 reap_dead start 2024-05-28T06:05:54.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.845+0000 7fca7d800640 1 --2- 172.21.15.122:0/69143824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca600039c0 0x7fca60003da0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00c240 tx=0x7fca6c01cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bdda1de97e75cb4 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:54.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.849+0000 7fca77e00640 1 -- 172.21.15.122:0/69143824 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c007d20 con 0x7fca600039c0 2024-05-28T06:05:54.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.849+0000 7fca77e00640 1 -- 172.21.15.122:0/69143824 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca6c0a9020 con 0x7fca600039c0 2024-05-28T06:05:54.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.849+0000 7fca77e00640 1 -- 172.21.15.122:0/69143824 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c005b00 con 0x7fca600039c0 2024-05-28T06:05:54.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.849+0000 7fca80200640 1 -- 172.21.15.122:0/69143824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca600039c0 msgr2=0x7fca60003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:54.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.849+0000 7fca80200640 1 --2- 172.21.15.122:0/69143824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca600039c0 0x7fca60003da0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00c240 tx=0x7fca6c01cc50 comp rx=0 tx=0).stop 2024-05-28T06:05:54.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.849+0000 7fca80200640 1 -- 172.21.15.122:0/69143824 shutdown_connections 2024-05-28T06:05:54.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.849+0000 7fca80200640 1 --2- 172.21.15.122:0/69143824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca600039c0 0x7fca60003da0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.849+0000 7fca80200640 1 -- 172.21.15.122:0/69143824 >> 172.21.15.122:0/69143824 conn(0x7fca7806bd90 msgr2=0x7fca7806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:54.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.849+0000 7fca80200640 1 -- 172.21.15.122:0/69143824 shutdown_connections 2024-05-28T06:05:54.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.849+0000 7fca80200640 1 -- 172.21.15.122:0/69143824 wait complete. 2024-05-28T06:05:54.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.849+0000 7fca80200640 1 Processor -- start 2024-05-28T06:05:54.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.849+0000 7fca80200640 1 -- start start 2024-05-28T06:05:54.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca80200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca600039c0 0x7fca78154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca80200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca7815c950 0x7fca78155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca80200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca781fb4a0 0x7fca781fb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca80200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fca78072b30 con 0x7fca7815c950 2024-05-28T06:05:54.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca80200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fca78162fc0 con 0x7fca781fb4a0 2024-05-28T06:05:54.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca80200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fca781667e0 con 0x7fca600039c0 2024-05-28T06:05:54.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca7ce00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca7815c950 0x7fca78155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:54.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca7ce00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca7815c950 0x7fca78155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36306/0 (socket says 172.21.15.122:36306) 2024-05-28T06:05:54.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca7ce00640 1 -- 172.21.15.122:0/3358290792 learned_addr learned my addr 172.21.15.122:0/3358290792 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:54.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca7e200640 1 --2- 172.21.15.122:0/3358290792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca781fb4a0 0x7fca781fb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:54.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca7d800640 1 --2- 172.21.15.122:0/3358290792 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca600039c0 0x7fca78154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:54.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca7ce00640 1 -- 172.21.15.122:0/3358290792 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca600039c0 msgr2=0x7fca78154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:54.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca7ce00640 1 --2- 172.21.15.122:0/3358290792 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca600039c0 0x7fca78154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca7ce00640 1 -- 172.21.15.122:0/3358290792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca781fb4a0 msgr2=0x7fca781fb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:54.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca7ce00640 1 --2- 172.21.15.122:0/3358290792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca781fb4a0 0x7fca781fb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:54.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca7ce00640 1 -- 172.21.15.122:0/3358290792 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca78155b60 con 0x7fca7815c950 2024-05-28T06:05:54.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca7e200640 1 --2- 172.21.15.122:0/3358290792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca781fb4a0 0x7fca781fb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:05:54.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca7ce00640 1 --2- 172.21.15.122:0/3358290792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca7815c950 0x7fca78155320 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fca6400c460 tx=0x7fca6400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:54.857 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca75600640 1 -- 172.21.15.122:0/3358290792 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64018070 con 0x7fca7815c950 2024-05-28T06:05:54.857 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca75600640 1 -- 172.21.15.122:0/3358290792 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca64007030 con 0x7fca7815c950 2024-05-28T06:05:54.857 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca75600640 1 -- 172.21.15.122:0/3358290792 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca640054a0 con 0x7fca7815c950 2024-05-28T06:05:54.857 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca80200640 1 -- 172.21.15.122:0/3358290792 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca781fc360 con 0x7fca7815c950 2024-05-28T06:05:54.857 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca80200640 1 -- 172.21.15.122:0/3358290792 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca780b03b0 con 0x7fca7815c950 2024-05-28T06:05:54.857 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca80200640 1 -- 172.21.15.122:0/3358290792 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca78068c40 con 0x7fca7815c950 2024-05-28T06:05:54.857 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.853+0000 7fca75600640 1 -- 172.21.15.122:0/3358290792 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fca6401b070 con 0x7fca7815c950 2024-05-28T06:05:54.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.857+0000 7fca75600640 1 --2- 172.21.15.122:0/3358290792 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fca58068380 0x7fca5806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:54.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.857+0000 7fca75600640 1 -- 172.21.15.122:0/3358290792 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fca64085c90 con 0x7fca7815c950 2024-05-28T06:05:54.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.857+0000 7fca7d800640 1 --2- 172.21.15.122:0/3358290792 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fca58068380 0x7fca5806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:54.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.857+0000 7fca7d800640 1 --2- 172.21.15.122:0/3358290792 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fca58068380 0x7fca5806a840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00c240 tx=0x7fca7806e240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:54.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:54.861+0000 7fca75600640 1 -- 172.21.15.122:0/3358290792 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fca640561b0 con 0x7fca7815c950 2024-05-28T06:05:55.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.021+0000 7fca80200640 1 -- 172.21.15.122:0/3358290792 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca7806fbb0 con 0x7fca7815c950 2024-05-28T06:05:55.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.021+0000 7fca75600640 1 -- 172.21.15.122:0/3358290792 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fca64055ab0 con 0x7fca7815c950 2024-05-28T06:05:55.024 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:05:55.025 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":20,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:05:50.822555+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:05:47.441193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-28T06:05:48.148164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:05:55.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.025+0000 7fca80200640 1 -- 172.21.15.122:0/3358290792 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fca58068380 msgr2=0x7fca5806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.025+0000 7fca80200640 1 --2- 172.21.15.122:0/3358290792 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fca58068380 0x7fca5806a840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00c240 tx=0x7fca7806e240 comp rx=0 tx=0).stop 2024-05-28T06:05:55.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.025+0000 7fca80200640 1 -- 172.21.15.122:0/3358290792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca7815c950 msgr2=0x7fca78155320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.025+0000 7fca80200640 1 --2- 172.21.15.122:0/3358290792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca7815c950 0x7fca78155320 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fca6400c460 tx=0x7fca6400c920 comp rx=0 tx=0).stop 2024-05-28T06:05:55.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.025+0000 7fca80200640 1 -- 172.21.15.122:0/3358290792 shutdown_connections 2024-05-28T06:05:55.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.025+0000 7fca80200640 1 --2- 172.21.15.122:0/3358290792 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fca58068380 0x7fca5806a840 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.025+0000 7fca80200640 1 --2- 172.21.15.122:0/3358290792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca781fb4a0 0x7fca781fb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.025+0000 7fca80200640 1 --2- 172.21.15.122:0/3358290792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca7815c950 0x7fca78155320 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.025+0000 7fca80200640 1 --2- 172.21.15.122:0/3358290792 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fca600039c0 0x7fca78154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.025+0000 7fca80200640 1 -- 172.21.15.122:0/3358290792 >> 172.21.15.122:0/3358290792 conn(0x7fca7806bd90 msgr2=0x7fca780b2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:55.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.025+0000 7fca80200640 1 -- 172.21.15.122:0/3358290792 shutdown_connections 2024-05-28T06:05:55.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.025+0000 7fca80200640 1 -- 172.21.15.122:0/3358290792 wait complete. 2024-05-28T06:05:55.046 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-28T06:05:55.046 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:05:55.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.177+0000 7fae49600640 1 Processor -- start 2024-05-28T06:05:55.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.177+0000 7fae49600640 1 -- start start 2024-05-28T06:05:55.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.181+0000 7fae49600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fae440d18f0 0x7fae44169800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.181+0000 7fae49600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae44162510 con 0x7fae4406dab0 2024-05-28T06:05:55.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.181+0000 7fae49600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae441627f0 con 0x7fae4415ea50 2024-05-28T06:05:55.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.181+0000 7fae49600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fae44163120 con 0x7fae440d18f0 2024-05-28T06:05:55.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.181+0000 7fae43400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fae440d18f0 0x7fae44169800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.181+0000 7fae43400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fae440d18f0 0x7fae44169800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36310/0 (socket says 172.21.15.122:36310) 2024-05-28T06:05:55.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.181+0000 7fae3a000640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fae4406dab0 0x7fae4415f540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56276/0 (socket says 172.21.15.122:56276) 2024-05-28T06:05:55.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.181+0000 7fae43400640 1 -- 172.21.15.122:0/55291170 learned_addr learned my addr 172.21.15.122:0/55291170 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:55.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.181+0000 7fae43400640 1 -- 172.21.15.122:0/55291170 >> v1:172.21.15.153:6789/0 conn(0x7fae4415ea50 legacy=0x7fae4415ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:55.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.181+0000 7fae43400640 1 -- 172.21.15.122:0/55291170 >> v1:172.21.15.122:6789/0 conn(0x7fae4406dab0 legacy=0x7fae4415f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.181+0000 7fae43400640 1 -- 172.21.15.122:0/55291170 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae44162ad0 con 0x7fae440d18f0 2024-05-28T06:05:55.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.181+0000 7fae42000640 1 -- 172.21.15.122:0/55291170 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2868765497 0 0) 0x7fae44162510 con 0x7fae4406dab0 2024-05-28T06:05:55.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.185+0000 7fae43400640 1 --2- 172.21.15.122:0/55291170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae440d18f0 0x7fae44169800 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fae3c009e50 tx=0x7fae3c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba7cd9abcb9d8f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.185+0000 7fae42000640 1 -- 172.21.15.122:0/55291170 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c0a56c0 con 0x7fae440d18f0 2024-05-28T06:05:55.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.185+0000 7fae42000640 1 -- 172.21.15.122:0/55291170 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae3c0a5860 con 0x7fae440d18f0 2024-05-28T06:05:55.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.185+0000 7fae42000640 1 -- 172.21.15.122:0/55291170 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c0a5c30 con 0x7fae440d18f0 2024-05-28T06:05:55.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.185+0000 7fae49600640 1 -- 172.21.15.122:0/55291170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae440d18f0 msgr2=0x7fae44169800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.185+0000 7fae49600640 1 --2- 172.21.15.122:0/55291170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae440d18f0 0x7fae44169800 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fae3c009e50 tx=0x7fae3c01c9f0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.185+0000 7fae49600640 1 -- 172.21.15.122:0/55291170 shutdown_connections 2024-05-28T06:05:55.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.185+0000 7fae49600640 1 --2- 172.21.15.122:0/55291170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae440d18f0 0x7fae44169800 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.185+0000 7fae49600640 1 -- 172.21.15.122:0/55291170 >> 172.21.15.122:0/55291170 conn(0x7fae440b4190 msgr2=0x7fae440b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:55.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.185+0000 7fae49600640 1 -- 172.21.15.122:0/55291170 shutdown_connections 2024-05-28T06:05:55.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.185+0000 7fae49600640 1 -- 172.21.15.122:0/55291170 wait complete. 2024-05-28T06:05:55.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.185+0000 7fae49600640 1 Processor -- start 2024-05-28T06:05:55.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.185+0000 7fae49600640 1 -- start start 2024-05-28T06:05:55.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae49600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae4406dab0 0x7fae44154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae49600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae440d18f0 0x7fae44151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae49600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae4415ea50 0x7fae44157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae49600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fae4416c6e0 con 0x7fae440d18f0 2024-05-28T06:05:55.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae49600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fae4416c560 con 0x7fae4406dab0 2024-05-28T06:05:55.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae49600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fae4416c860 con 0x7fae4415ea50 2024-05-28T06:05:55.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae3a000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae440d18f0 0x7fae44151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae3a000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae440d18f0 0x7fae44151ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36312/0 (socket says 172.21.15.122:36312) 2024-05-28T06:05:55.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae3a000640 1 -- 172.21.15.122:0/3889478822 learned_addr learned my addr 172.21.15.122:0/3889478822 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:55.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae42a00640 1 --2- 172.21.15.122:0/3889478822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae4406dab0 0x7fae44154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae43400640 1 --2- 172.21.15.122:0/3889478822 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae4415ea50 0x7fae44157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae3a000640 1 -- 172.21.15.122:0/3889478822 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae4415ea50 msgr2=0x7fae44157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae3a000640 1 --2- 172.21.15.122:0/3889478822 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae4415ea50 0x7fae44157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae3a000640 1 -- 172.21.15.122:0/3889478822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae4406dab0 msgr2=0x7fae44154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae3a000640 1 --2- 172.21.15.122:0/3889478822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae4406dab0 0x7fae44154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae3a000640 1 -- 172.21.15.122:0/3889478822 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae44152410 con 0x7fae440d18f0 2024-05-28T06:05:55.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae3a000640 1 --2- 172.21.15.122:0/3889478822 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae440d18f0 0x7fae44151ed0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fae2c00c480 tx=0x7fae2c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae3b400640 1 -- 172.21.15.122:0/3889478822 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2c018070 con 0x7fae440d18f0 2024-05-28T06:05:55.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae3b400640 1 -- 172.21.15.122:0/3889478822 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae2c007500 con 0x7fae440d18f0 2024-05-28T06:05:55.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae3b400640 1 -- 172.21.15.122:0/3889478822 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2c004a30 con 0x7fae440d18f0 2024-05-28T06:05:55.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae49600640 1 -- 172.21.15.122:0/3889478822 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae4415ac20 con 0x7fae440d18f0 2024-05-28T06:05:55.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae49600640 1 -- 172.21.15.122:0/3889478822 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae441593b0 con 0x7fae440d18f0 2024-05-28T06:05:55.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae49600640 1 -- 172.21.15.122:0/3889478822 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae44068c40 con 0x7fae440d18f0 2024-05-28T06:05:55.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.189+0000 7fae3b400640 1 -- 172.21.15.122:0/3889478822 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fae2c004bd0 con 0x7fae440d18f0 2024-05-28T06:05:55.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.193+0000 7fae3b400640 1 --2- 172.21.15.122:0/3889478822 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fae20068380 0x7fae2006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.193+0000 7fae3b400640 1 -- 172.21.15.122:0/3889478822 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fae2c085ad0 con 0x7fae440d18f0 2024-05-28T06:05:55.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.193+0000 7fae42a00640 1 --2- 172.21.15.122:0/3889478822 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fae20068380 0x7fae2006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.193+0000 7fae42a00640 1 --2- 172.21.15.122:0/3889478822 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fae20068380 0x7fae2006a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fae441602d0 tx=0x7fae34007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.197+0000 7fae3b400640 1 -- 172.21.15.122:0/3889478822 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fae44152410 con 0x7fae440d18f0 2024-05-28T06:05:55.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.357+0000 7fae49600640 1 -- 172.21.15.122:0/3889478822 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fae440b8620 con 0x7fae440d18f0 2024-05-28T06:05:55.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.357+0000 7fae3b400640 1 -- 172.21.15.122:0/3889478822 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fae2c055ad0 con 0x7fae440d18f0 2024-05-28T06:05:55.361 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:05:55.361 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":20,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:05:50.822555+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:05:47.441193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-28T06:05:48.148164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:05:55.363 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.361+0000 7fae49600640 1 -- 172.21.15.122:0/3889478822 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fae20068380 msgr2=0x7fae2006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.361+0000 7fae49600640 1 --2- 172.21.15.122:0/3889478822 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fae20068380 0x7fae2006a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fae441602d0 tx=0x7fae34007e40 comp rx=0 tx=0).stop 2024-05-28T06:05:55.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.361+0000 7fae49600640 1 -- 172.21.15.122:0/3889478822 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae440d18f0 msgr2=0x7fae44151ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.361+0000 7fae49600640 1 --2- 172.21.15.122:0/3889478822 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae440d18f0 0x7fae44151ed0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fae2c00c480 tx=0x7fae2c00c940 comp rx=0 tx=0).stop 2024-05-28T06:05:55.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.361+0000 7fae49600640 1 -- 172.21.15.122:0/3889478822 shutdown_connections 2024-05-28T06:05:55.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.361+0000 7fae49600640 1 --2- 172.21.15.122:0/3889478822 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fae20068380 0x7fae2006a840 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.361+0000 7fae49600640 1 --2- 172.21.15.122:0/3889478822 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae4415ea50 0x7fae44157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.361+0000 7fae49600640 1 --2- 172.21.15.122:0/3889478822 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae440d18f0 0x7fae44151ed0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.361+0000 7fae49600640 1 --2- 172.21.15.122:0/3889478822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae4406dab0 0x7fae44154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.361+0000 7fae49600640 1 -- 172.21.15.122:0/3889478822 >> 172.21.15.122:0/3889478822 conn(0x7fae440b4190 msgr2=0x7fae44074d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:55.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.361+0000 7fae49600640 1 -- 172.21.15.122:0/3889478822 shutdown_connections 2024-05-28T06:05:55.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.361+0000 7fae49600640 1 -- 172.21.15.122:0/3889478822 wait complete. 2024-05-28T06:05:55.384 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-28T06:05:55.384 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-28T06:05:55.384 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-28T06:05:55.385 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-28T06:05:55.385 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-28T06:05:55.386 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-28T06:05:55.386 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-28T06:05:55.387 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-28T06:05:55.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.621+0000 7f7a99400640 1 Processor -- start 2024-05-28T06:05:55.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.621+0000 7f7a99400640 1 -- start start 2024-05-28T06:05:55.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.621+0000 7f7a99400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7a8c04a180 0x7f7a8c051d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.621+0000 7f735ba00640 1 Processor -- start 2024-05-28T06:05:55.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.621+0000 7f7a99400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a8c052b90 0x7f7a8c053020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.625+0000 7f7a99400640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a8c052250 con 0x7f7a8c035e00 2024-05-28T06:05:55.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.625+0000 7f7a99400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7a8c03b2e0 con 0x7f7a8c04a180 2024-05-28T06:05:55.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.625+0000 7f735ba00640 1 -- start start 2024-05-28T06:05:55.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.625+0000 7f7a99400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7a8c03c120 con 0x7f7a8c052b90 2024-05-28T06:05:55.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.625+0000 7f7a92800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7a8c04a180 0x7f7a8c051d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.625+0000 7f7a92800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7a8c04a180 0x7f7a8c051d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:37138/0 (socket says 172.21.15.122:37138) 2024-05-28T06:05:55.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.625+0000 7f7a92800640 1 -- 172.21.15.122:0/910966018 learned_addr learned my addr 172.21.15.122:0/910966018 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:55.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.625+0000 7f7a93200640 1 --2- 172.21.15.122:0/910966018 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a8c052b90 0x7f7a8c053020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.625+0000 7f7a92800640 1 -- 172.21.15.122:0/910966018 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a8c052b90 msgr2=0x7f7a8c053020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:55.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.625+0000 7f7a92800640 1 --2- 172.21.15.122:0/910966018 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a8c052b90 0x7f7a8c053020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.625+0000 7f7a92800640 1 -- 172.21.15.122:0/910966018 >> v1:172.21.15.122:6789/0 conn(0x7f7a8c035e00 legacy=0x7f7a8c03c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:55.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.625+0000 7f735ba00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f734c033e40 0x7f734c0eb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.625+0000 7f735ba00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f734c034220 con 0x7f734c047c20 2024-05-28T06:05:55.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.625+0000 7f735ba00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f734c04fa30 con 0x7f734c005ea0 2024-05-28T06:05:55.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.625+0000 7f7359a00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f734c005ea0 0x7f734c0062b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:36530/0 (socket says 172.21.15.122:36530) 2024-05-28T06:05:55.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.625+0000 7f7359a00640 1 -- 172.21.15.122:0/3474454541 learned_addr learned my addr 172.21.15.122:0/3474454541 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:55.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.625+0000 7f735ba00640 1 -- 172.21.15.122:0/3474454541 --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f734c050210 con 0x7f734c033e40 2024-05-28T06:05:55.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.625+0000 7f7a92800640 1 -- 172.21.15.122:0/910966018 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a8c0e7dc0 con 0x7f7a8c04a180 2024-05-28T06:05:55.631 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7353400640 1 -- 172.21.15.122:0/3474454541 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1488223599 0 0) 0x7f734c04fa30 con 0x7f734c005ea0 2024-05-28T06:05:55.631 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7353400640 1 -- 172.21.15.122:0/3474454541 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f733c003530 con 0x7f734c005ea0 2024-05-28T06:05:55.631 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7353400640 1 -- 172.21.15.122:0/3474454541 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3102263592 0 0) 0x7f734c034220 con 0x7f734c047c20 2024-05-28T06:05:55.631 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7353400640 1 -- 172.21.15.122:0/3474454541 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f734c04fa30 con 0x7f734c047c20 2024-05-28T06:05:55.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7353400640 1 -- 172.21.15.122:0/3474454541 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 774521207 0 0) 0x7f733c003530 con 0x7f734c005ea0 2024-05-28T06:05:55.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7353400640 1 -- 172.21.15.122:0/3474454541 >> v2:172.21.15.122:3300/0 conn(0x7f734c033e40 msgr2=0x7f734c0eb180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-28T06:05:55.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7353400640 1 --2- 172.21.15.122:0/3474454541 >> v2:172.21.15.122:3300/0 conn(0x7f734c033e40 0x7f734c0eb180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7353400640 1 -- 172.21.15.122:0/3474454541 >> v1:172.21.15.122:6789/0 conn(0x7f734c047c20 legacy=0x7f734c0eb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7353400640 1 -- 172.21.15.122:0/3474454541 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734c04f2e0 con 0x7f734c005ea0 2024-05-28T06:05:55.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7353400640 1 -- 172.21.15.122:0/3474454541 <== mon.1 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f7340001680 con 0x7f734c005ea0 2024-05-28T06:05:55.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7353400640 1 -- 172.21.15.122:0/3474454541 >> v1:172.21.15.153:6789/0 conn(0x7f734c005ea0 legacy=0x7f734c0062b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7353400640 1 --2- 172.21.15.122:0/3474454541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f733c003ba0 0x7f733c003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7353400640 1 --2- 172.21.15.122:0/3474454541 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f733c004810 0x7f733c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7353400640 1 --2- 172.21.15.122:0/3474454541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f733c0052f0 0x7f733c00ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7a92800640 1 --2- 172.21.15.122:0/910966018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a8c04a180 0x7f7a8c051d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7a94074780 tx=0x7f7a94097f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85c15514986e6a2b server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7353400640 1 -- 172.21.15.122:0/3474454541 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f734c050210 con 0x7f733c0052f0 2024-05-28T06:05:55.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7353400640 1 -- 172.21.15.122:0/3474454541 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f733c00c220 con 0x7f733c003ba0 2024-05-28T06:05:55.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7353400640 1 -- 172.21.15.122:0/3474454541 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f733c00c420 con 0x7f733c004810 2024-05-28T06:05:55.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7359a00640 1 --2- 172.21.15.122:0/3474454541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f733c0052f0 0x7f733c00ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7359000640 1 --2- 172.21.15.122:0/3474454541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f733c003ba0 0x7f733c003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7a91400640 1 -- 172.21.15.122:0/910966018 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a94120cb0 con 0x7f7a8c04a180 2024-05-28T06:05:55.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7a91400640 1 -- 172.21.15.122:0/910966018 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a94120e50 con 0x7f7a8c04a180 2024-05-28T06:05:55.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7353e00640 1 --2- 172.21.15.122:0/3474454541 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f733c004810 0x7f733c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7a91400640 1 -- 172.21.15.122:0/910966018 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a94128640 con 0x7f7a8c04a180 2024-05-28T06:05:55.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7fe22a200640 1 Processor -- start 2024-05-28T06:05:55.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7fe22a200640 1 -- start start 2024-05-28T06:05:55.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7a99400640 1 -- 172.21.15.122:0/910966018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a8c04a180 msgr2=0x7f7a8c051d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7f7a99400640 1 --2- 172.21.15.122:0/910966018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a8c04a180 0x7f7a8c051d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7a94074780 tx=0x7f7a94097f60 comp rx=0 tx=0).stop 2024-05-28T06:05:55.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7359000640 1 -- 172.21.15.122:0/3474454541 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f733c004810 msgr2=0x7f733c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:55.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7359000640 1 --2- 172.21.15.122:0/3474454541 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f733c004810 0x7f733c004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7359000640 1 -- 172.21.15.122:0/3474454541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f733c0052f0 msgr2=0x7f733c00ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:55.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7359000640 1 --2- 172.21.15.122:0/3474454541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f733c0052f0 0x7f733c00ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7359000640 1 -- 172.21.15.122:0/3474454541 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f733c003530 con 0x7f733c003ba0 2024-05-28T06:05:55.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7359a00640 1 --2- 172.21.15.122:0/3474454541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f733c0052f0 0x7f733c00ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:05:55.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7f7359a00640 1 -- 172.21.15.122:0/3474454541 reap_dead start 2024-05-28T06:05:55.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.629+0000 7fb226000640 1 Processor -- start 2024-05-28T06:05:55.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7fb226000640 1 -- start start 2024-05-28T06:05:55.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7f7a99400640 1 -- 172.21.15.122:0/910966018 shutdown_connections 2024-05-28T06:05:55.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7f7a99400640 1 --2- 172.21.15.122:0/910966018 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a8c052b90 0x7f7a8c053020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7f7a99400640 1 --2- 172.21.15.122:0/910966018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a8c04a180 0x7f7a8c051d10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7f7a99400640 1 -- 172.21.15.122:0/910966018 >> 172.21.15.122:0/910966018 conn(0x7f7a8c0537c0 msgr2=0x7f7a8c053bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:55.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7f2fa9600640 1 Processor -- start 2024-05-28T06:05:55.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7f7a99400640 1 -- 172.21.15.122:0/910966018 shutdown_connections 2024-05-28T06:05:55.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7f7a99400640 1 -- 172.21.15.122:0/910966018 wait complete. 2024-05-28T06:05:55.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7fb226000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb2200d4690 0x7fb2200d4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7fb226000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2200d4fb0 con 0x7fb2200d2af0 2024-05-28T06:05:55.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7fb226000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2200ba690 con 0x7fb2200d4140 2024-05-28T06:05:55.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7fe22a200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe22415fae0 0x7fe2240ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7fe22a200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2240726f0 con 0x7fe2240ccf30 2024-05-28T06:05:55.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7fe22a200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2240729d0 con 0x7fe2240b5560 2024-05-28T06:05:55.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7fe22a200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe22406e510 con 0x7fe22415fae0 2024-05-28T06:05:55.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7fe223e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fe2240ccf30 0x7fe2240cd330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38520/0 (socket says 172.21.15.122:38520) 2024-05-28T06:05:55.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7fe223e00640 1 -- 172.21.15.122:0/375439501 learned_addr learned my addr 172.21.15.122:0/375439501 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:55.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7fe21be00640 1 --2- 172.21.15.122:0/375439501 >> v2:172.21.15.153:3300/0 conn(0x7fe22415fae0 0x7fe2240ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7f2fa9600640 1 -- start start 2024-05-28T06:05:55.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7f2fa9600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f9c053170 0x7f2f9c03b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7f2fa9600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2f9c0e7db0 0x7f2f9c0548e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7f2fa9600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f9c056ad0 con 0x7f2f9c0e79d0 2024-05-28T06:05:55.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7f2fa9600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f2f9c03bb90 con 0x7f2f9c0e7db0 2024-05-28T06:05:55.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7f2fa9600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2f9c03be70 con 0x7f2f9c053170 2024-05-28T06:05:55.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7fb226000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb220162510 con 0x7fb2200d4690 2024-05-28T06:05:55.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7fb21fe00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fb2200d2af0 0x7fb2200d2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38514/0 (socket says 172.21.15.122:38514) 2024-05-28T06:05:55.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7fb21fe00640 1 -- 172.21.15.122:0/2153985273 learned_addr learned my addr 172.21.15.122:0/2153985273 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:55.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7fb21e000640 1 -- 172.21.15.122:0/2153985273 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2481094715 0 0) 0x7fb2200d4fb0 con 0x7fb2200d2af0 2024-05-28T06:05:55.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7fb21f400640 1 --2- 172.21.15.122:0/2153985273 >> v2:172.21.15.153:3300/0 conn(0x7fb2200d4690 0x7fb2200d4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7fb21e000640 1 -- 172.21.15.122:0/2153985273 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb204003530 con 0x7fb2200d2af0 2024-05-28T06:05:55.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7fb21f400640 1 -- 172.21.15.122:0/2153985273 >> v1:172.21.15.153:6789/0 conn(0x7fb2200d4140 legacy=0x7fb2200b9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7fb21f400640 1 -- 172.21.15.122:0/2153985273 >> v1:172.21.15.122:6789/0 conn(0x7fb2200d2af0 legacy=0x7fb2200d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7fb21f400640 1 -- 172.21.15.122:0/2153985273 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2201627f0 con 0x7fb2200d4690 2024-05-28T06:05:55.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7fe222a00640 1 -- 172.21.15.122:0/375439501 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3437222757 0 0) 0x7fe2240726f0 con 0x7fe2240ccf30 2024-05-28T06:05:55.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7fe222a00640 1 -- 172.21.15.122:0/375439501 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe208003530 con 0x7fe2240ccf30 2024-05-28T06:05:55.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7fe222a00640 1 -- 172.21.15.122:0/375439501 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 422387078 0 0) 0x7fe2240729d0 con 0x7fe2240b5560 2024-05-28T06:05:55.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7f2fa2000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f9c053170 0x7f2f9c03b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7f2fa2000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f9c053170 0x7f2f9c03b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:50166/0 (socket says 172.21.15.122:50166) 2024-05-28T06:05:55.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7f2fa2000640 1 -- 172.21.15.122:0/580669142 learned_addr learned my addr 172.21.15.122:0/580669142 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:55.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.633+0000 7f2fa3400640 1 --2- 172.21.15.122:0/580669142 >> v2:172.21.15.122:3300/0 conn(0x7f2f9c0e7db0 0x7f2f9c0548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f2fa1600640 1 -- 172.21.15.122:0/580669142 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2304544958 0 0) 0x7f2f9c056ad0 con 0x7f2f9c0e79d0 2024-05-28T06:05:55.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f2fa1600640 1 -- 172.21.15.122:0/580669142 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f88003530 con 0x7f2f9c0e79d0 2024-05-28T06:05:55.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f2fa1600640 1 -- 172.21.15.122:0/580669142 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2599441201 0 0) 0x7f2f88003530 con 0x7f2f9c0e79d0 2024-05-28T06:05:55.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f2fa1600640 1 -- 172.21.15.122:0/580669142 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f9c053170 msgr2=0x7f2f9c03b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:55.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f2fa1600640 1 --2- 172.21.15.122:0/580669142 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f9c053170 0x7f2f9c03b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f2fa1600640 1 -- 172.21.15.122:0/580669142 >> v2:172.21.15.122:3300/0 conn(0x7f2f9c0e7db0 msgr2=0x7f2f9c0548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:55.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f2fa1600640 1 --2- 172.21.15.122:0/580669142 >> v2:172.21.15.122:3300/0 conn(0x7f2f9c0e7db0 0x7f2f9c0548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f2fa1600640 1 -- 172.21.15.122:0/580669142 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9c03c150 con 0x7f2f9c0e79d0 2024-05-28T06:05:55.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f2fa1600640 1 -- 172.21.15.122:0/580669142 <== mon.1 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f2f94001680 con 0x7f2f9c0e79d0 2024-05-28T06:05:55.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f2fa1600640 1 -- 172.21.15.122:0/580669142 >> v1:172.21.15.153:6789/0 conn(0x7f2f9c0e79d0 legacy=0x7f2f9c052a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f2fa1600640 1 --2- 172.21.15.122:0/580669142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f880039c0 0x7f2f88003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f2fa1600640 1 --2- 172.21.15.122:0/580669142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f88004810 0x7f2f88004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f2fa1600640 1 --2- 172.21.15.122:0/580669142 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f880051d0 0x7f2f8800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f2fa1600640 1 -- 172.21.15.122:0/580669142 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c03bb90 con 0x7f2f880039c0 2024-05-28T06:05:55.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f2fa1600640 1 -- 172.21.15.122:0/580669142 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c03be70 con 0x7f2f88004810 2024-05-28T06:05:55.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f2fa1600640 1 -- 172.21.15.122:0/580669142 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2f8800c010 con 0x7f2f880051d0 2024-05-28T06:05:55.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f7a99400640 1 Processor -- start 2024-05-28T06:05:55.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f2fa3400640 1 --2- 172.21.15.122:0/580669142 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f880051d0 0x7f2f8800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f21c2200640 1 Processor -- start 2024-05-28T06:05:55.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f7359000640 1 --2- 172.21.15.122:0/3474454541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f733c003ba0 0x7f733c003fa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f73480097b0 tx=0x7f734801c2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71e272fdcc4ef47c server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f7a99400640 1 -- start start 2024-05-28T06:05:55.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f2fa2000640 1 --2- 172.21.15.122:0/580669142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f88004810 0x7f2f88004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7fe222a00640 1 -- 172.21.15.122:0/375439501 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2240726f0 con 0x7fe2240b5560 2024-05-28T06:05:55.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7fe21be00640 1 -- 172.21.15.122:0/375439501 >> v1:172.21.15.153:6789/0 conn(0x7fe2240b5560 legacy=0x7fe224071f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7fe21be00640 1 -- 172.21.15.122:0/375439501 >> v1:172.21.15.122:6789/0 conn(0x7fe2240ccf30 legacy=0x7fe2240cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7fe21be00640 1 -- 172.21.15.122:0/375439501 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe224072cb0 con 0x7fe22415fae0 2024-05-28T06:05:55.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f7353400640 1 -- 172.21.15.122:0/3474454541 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73480b0070 con 0x7f733c003ba0 2024-05-28T06:05:55.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f7353400640 1 -- 172.21.15.122:0/3474454541 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73480ab620 con 0x7f733c003ba0 2024-05-28T06:05:55.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f7353400640 1 -- 172.21.15.122:0/3474454541 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73480093b0 con 0x7f733c003ba0 2024-05-28T06:05:55.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f21c2200640 1 -- start start 2024-05-28T06:05:55.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f21c2200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f21bc15d7a0 0x7f21bc1646e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f21c2200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f21bc072360 0x7f21bc0727f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f21c2200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21bc0b4550 con 0x7f21bc0b3a60 2024-05-28T06:05:55.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f21c2200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f21bc0b47e0 con 0x7f21bc15d7a0 2024-05-28T06:05:55.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f21c2200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f21bc06e430 con 0x7f21bc072360 2024-05-28T06:05:55.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f7a99400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a8c035e00 0x7f7a8c0dfe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f7a99400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a8c04a180 0x7f7a8c0e96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f21baa00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f21bc072360 0x7f21bc0727f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f21baa00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f21bc072360 0x7f21bc0727f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:37182/0 (socket says 172.21.15.122:37182) 2024-05-28T06:05:55.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f21baa00640 1 -- 172.21.15.122:0/1275930138 learned_addr learned my addr 172.21.15.122:0/1275930138 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:55.650 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f7a99400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a8c052b90 0x7f7a8c0e6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.650 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f7a91e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a8c04a180 0x7f7a8c0e96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.650 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f7a91e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a8c04a180 0x7f7a8c0e96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:37190/0 (socket says 172.21.15.122:37190) 2024-05-28T06:05:55.650 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f7a92800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a8c035e00 0x7f7a8c0dfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.650 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f7a92800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a8c035e00 0x7f7a8c0dfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41220/0 (socket says 172.21.15.122:41220) 2024-05-28T06:05:55.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f21bb400640 1 --2- 172.21.15.122:0/1275930138 >> v2:172.21.15.122:3300/0 conn(0x7f21bc15d7a0 0x7f21bc1646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f21baa00640 1 -- 172.21.15.122:0/1275930138 >> v2:172.21.15.122:3300/0 conn(0x7f21bc15d7a0 msgr2=0x7f21bc1646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:55.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f735ba00640 1 -- 172.21.15.122:0/3474454541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f733c003ba0 msgr2=0x7f733c003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f735ba00640 1 --2- 172.21.15.122:0/3474454541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f733c003ba0 0x7f733c003fa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f73480097b0 tx=0x7f734801c2c0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f21baa00640 1 --2- 172.21.15.122:0/1275930138 >> v2:172.21.15.122:3300/0 conn(0x7f21bc15d7a0 0x7f21bc1646e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f7a91e00640 1 -- 172.21.15.122:0/2850748242 learned_addr learned my addr 172.21.15.122:0/2850748242 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:55.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f21baa00640 1 -- 172.21.15.122:0/1275930138 >> v1:172.21.15.153:6789/0 conn(0x7f21bc0b3a60 legacy=0x7f21bc0b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f7a99400640 1 -- 172.21.15.122:0/2850748242 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8c04a560 con 0x7f7a8c035e00 2024-05-28T06:05:55.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f7a99400640 1 -- 172.21.15.122:0/2850748242 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8c03bdb0 con 0x7f7a8c04a180 2024-05-28T06:05:55.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f7a99400640 1 -- 172.21.15.122:0/2850748242 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7a8c055090 con 0x7f7a8c052b90 2024-05-28T06:05:55.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f21baa00640 1 -- 172.21.15.122:0/1275930138 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21bc06e710 con 0x7f21bc072360 2024-05-28T06:05:55.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f21bb400640 1 --2- 172.21.15.122:0/1275930138 >> v2:172.21.15.122:3300/0 conn(0x7f21bc15d7a0 0x7f21bc1646e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:05:55.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f7a93200640 1 --2- 172.21.15.122:0/2850748242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a8c052b90 0x7f7a8c0e6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f735ba00640 1 -- 172.21.15.122:0/3474454541 shutdown_connections 2024-05-28T06:05:55.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f735ba00640 1 --2- 172.21.15.122:0/3474454541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f733c003ba0 0x7f733c003fa0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f735ba00640 1 -- 172.21.15.122:0/3474454541 >> 172.21.15.122:0/3474454541 conn(0x7f734c009fc0 msgr2=0x7f734c00a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:55.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f7a93200640 1 -- 172.21.15.122:0/2850748242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a8c04a180 msgr2=0x7f7a8c0e96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f7a93200640 1 --2- 172.21.15.122:0/2850748242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a8c04a180 0x7f7a8c0e96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f7a93200640 1 -- 172.21.15.122:0/2850748242 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a8c035e00 msgr2=0x7f7a8c0dfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f7a93200640 1 --2- 172.21.15.122:0/2850748242 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a8c035e00 0x7f7a8c0dfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f735ba00640 1 -- 172.21.15.122:0/3474454541 shutdown_connections 2024-05-28T06:05:55.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f735ba00640 1 -- 172.21.15.122:0/3474454541 wait complete. 2024-05-28T06:05:55.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f2fa3400640 1 -- 172.21.15.122:0/580669142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f88004810 msgr2=0x7f2f88004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:55.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f2fa3400640 1 --2- 172.21.15.122:0/580669142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f88004810 0x7f2f88004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f2fa3400640 1 -- 172.21.15.122:0/580669142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f880039c0 msgr2=0x7f2f88003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:55.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f2fa3400640 1 --2- 172.21.15.122:0/580669142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f880039c0 0x7f2f88003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.637+0000 7f2fa3400640 1 -- 172.21.15.122:0/580669142 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9c03c150 con 0x7f2f880051d0 2024-05-28T06:05:55.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f7a93200640 1 -- 172.21.15.122:0/2850748242 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a8c0e03a0 con 0x7f7a8c052b90 2024-05-28T06:05:55.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f8510400640 1 Processor -- start 2024-05-28T06:05:55.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7fe21be00640 1 --2- 172.21.15.122:0/375439501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe22415fae0 0x7fe2240ce3a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe20c009740 tx=0x7fe20c01c2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b63473e582949f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f8510400640 1 -- start start 2024-05-28T06:05:55.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f7a93200640 1 --2- 172.21.15.122:0/2850748242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a8c052b90 0x7f7a8c0e6190 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7a8400d4b0 tx=0x7f7a8400d970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7fe222a00640 1 -- 172.21.15.122:0/375439501 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c0b0070 con 0x7fe22415fae0 2024-05-28T06:05:55.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7fb21f400640 1 --2- 172.21.15.122:0/2153985273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2200d4690 0x7fb2200d4a70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb218009d90 tx=0x7fb21801c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a709744a1f4033eb server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f7a8aa00640 1 -- 172.21.15.122:0/2850748242 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84004020 con 0x7f7a8c052b90 2024-05-28T06:05:55.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f7a8aa00640 1 -- 172.21.15.122:0/2850748242 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a840041e0 con 0x7f7a8c052b90 2024-05-28T06:05:55.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f7a8aa00640 1 -- 172.21.15.122:0/2850748242 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a840043d0 con 0x7f7a8c052b90 2024-05-28T06:05:55.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7fb21e000640 1 -- 172.21.15.122:0/2153985273 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2180b2070 con 0x7fb2200d4690 2024-05-28T06:05:55.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7fb21e000640 1 -- 172.21.15.122:0/2153985273 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2180a5920 con 0x7fb2200d4690 2024-05-28T06:05:55.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7fb21e000640 1 -- 172.21.15.122:0/2153985273 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2180a5cf0 con 0x7fb2200d4690 2024-05-28T06:05:55.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f7d5ea00640 1 Processor -- start 2024-05-28T06:05:55.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7fe222a00640 1 -- 172.21.15.122:0/375439501 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe20c0ab400 con 0x7fe22415fae0 2024-05-28T06:05:55.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7fe222a00640 1 -- 172.21.15.122:0/375439501 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214001680 con 0x7fe22415fae0 2024-05-28T06:05:55.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7fe22a200640 1 -- 172.21.15.122:0/375439501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe22415fae0 msgr2=0x7fe2240ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7fe22a200640 1 --2- 172.21.15.122:0/375439501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe22415fae0 0x7fe2240ce3a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe20c009740 tx=0x7fe20c01c2a0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7fe22a200640 1 -- 172.21.15.122:0/375439501 shutdown_connections 2024-05-28T06:05:55.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7fe22a200640 1 --2- 172.21.15.122:0/375439501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe22415fae0 0x7fe2240ce3a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7fe22a200640 1 -- 172.21.15.122:0/375439501 >> 172.21.15.122:0/375439501 conn(0x7fe224062610 msgr2=0x7fe22406b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:55.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7fe22a200640 1 -- 172.21.15.122:0/375439501 shutdown_connections 2024-05-28T06:05:55.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7fe22a200640 1 -- 172.21.15.122:0/375439501 wait complete. 2024-05-28T06:05:55.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f7a99400640 1 -- 172.21.15.122:0/2850748242 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a8c04d590 con 0x7f7a8c052b90 2024-05-28T06:05:55.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.641+0000 7f7a99400640 1 -- 172.21.15.122:0/2850748242 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a8c04c7d0 con 0x7f7a8c052b90 2024-05-28T06:05:55.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7fb226000640 1 -- 172.21.15.122:0/2153985273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2200d4690 msgr2=0x7fb2200d4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7fb226000640 1 --2- 172.21.15.122:0/2153985273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2200d4690 0x7fb2200d4a70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb218009d90 tx=0x7fb21801c990 comp rx=0 tx=0).stop 2024-05-28T06:05:55.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f7d5ea00640 1 -- start start 2024-05-28T06:05:55.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f7a99400640 1 -- 172.21.15.122:0/2850748242 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7a8c0df390 con 0x7f7a8c052b90 2024-05-28T06:05:55.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f735ba00640 1 Processor -- start 2024-05-28T06:05:55.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f735ba00640 1 -- start start 2024-05-28T06:05:55.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f735ba00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f733c003ba0 0x7f734c04c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7fe22a200640 1 Processor -- start 2024-05-28T06:05:55.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f2fa3400640 1 --2- 172.21.15.122:0/580669142 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f880051d0 0x7f2f8800b9d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2f9000ba60 tx=0x7f2f9001c690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=544845e1d8a83661 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f2fa1600640 1 -- 172.21.15.122:0/580669142 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9000b600 con 0x7f2f880051d0 2024-05-28T06:05:55.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f2fa1600640 1 -- 172.21.15.122:0/580669142 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f900b0070 con 0x7f2f880051d0 2024-05-28T06:05:55.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f2fa9600640 1 -- 172.21.15.122:0/580669142 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f880051d0 msgr2=0x7f2f8800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f2fa1600640 1 -- 172.21.15.122:0/580669142 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9000b600 con 0x7f2f880051d0 2024-05-28T06:05:55.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f2fa9600640 1 --2- 172.21.15.122:0/580669142 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f880051d0 0x7f2f8800b9d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2f9000ba60 tx=0x7f2f9001c690 comp rx=0 tx=0).stop 2024-05-28T06:05:55.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f2fa3400640 1 -- 172.21.15.122:0/580669142 reap_dead start 2024-05-28T06:05:55.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f2fa9600640 1 -- 172.21.15.122:0/580669142 shutdown_connections 2024-05-28T06:05:55.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f2fa9600640 1 -- 172.21.15.122:0/580669142 >> 172.21.15.122:0/580669142 conn(0x7f2f9c056d10 msgr2=0x7f2f9c057120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:55.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f21baa00640 1 --2- 172.21.15.122:0/1275930138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21bc072360 0x7f21bc0727f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0d1390 tx=0x7f21a801c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2838ee37c25bef19 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f21ba000640 1 -- 172.21.15.122:0/1275930138 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a80ab610 con 0x7f21bc072360 2024-05-28T06:05:55.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f21ba000640 1 -- 172.21.15.122:0/1275930138 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a80b0070 con 0x7f21bc072360 2024-05-28T06:05:55.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f21ba000640 1 -- 172.21.15.122:0/1275930138 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a80ab9d0 con 0x7f21bc072360 2024-05-28T06:05:55.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f8510400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8508159280 0x7f85080b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f8510400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f850815c7a0 0x7f850806f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f8510400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85080b54d0 con 0x7f85080cced0 2024-05-28T06:05:55.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f8510400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f850815c310 con 0x7f8508159280 2024-05-28T06:05:55.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f8510400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f85080b57b0 con 0x7f850815c7a0 2024-05-28T06:05:55.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f850da00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8508159280 0x7f85080b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f850da00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8508159280 0x7f85080b4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41234/0 (socket says 172.21.15.122:41234) 2024-05-28T06:05:55.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f850da00640 1 -- 172.21.15.122:0/1471571565 learned_addr learned my addr 172.21.15.122:0/1471571565 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:55.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f850d000640 1 --2- 172.21.15.122:0/1471571565 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f850815c7a0 0x7f850806f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f735ba00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f734c0ea4f0 0x7f734c1857e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7fb226000640 1 -- 172.21.15.122:0/2153985273 shutdown_connections 2024-05-28T06:05:55.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7fb226000640 1 --2- 172.21.15.122:0/2153985273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2200d4690 0x7fb2200d4a70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7fb226000640 1 -- 172.21.15.122:0/2153985273 >> 172.21.15.122:0/2153985273 conn(0x7fb22006cc80 msgr2=0x7fb22006d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:55.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f735ba00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f734c0e4fe0 0x7f734c0e5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7fb226000640 1 -- 172.21.15.122:0/2153985273 shutdown_connections 2024-05-28T06:05:55.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f7d5ea00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7d58143e80 0x7f7d5815f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f735ba00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f734c04f090 con 0x7f734c0e4fe0 2024-05-28T06:05:55.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f735ba00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f734c04fd80 con 0x7f733c003ba0 2024-05-28T06:05:55.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f735ba00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f734c0482c0 con 0x7f734c0ea4f0 2024-05-28T06:05:55.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f7a8aa00640 1 -- 172.21.15.122:0/2850748242 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7a8401b020 con 0x7f7a8c052b90 2024-05-28T06:05:55.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f7d5ea00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7d58072360 0x7f7d580727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f7d5ea00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d580b5880 con 0x7f7d580701c0 2024-05-28T06:05:55.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f7d5ea00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f7d5815ec50 con 0x7f7d58072360 2024-05-28T06:05:55.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f7d5ea00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7d580b5e40 con 0x7f7d58143e80 2024-05-28T06:05:55.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f850da00640 1 -- 172.21.15.122:0/1471571565 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f850815c7a0 msgr2=0x7f850806f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:55.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f7359000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f733c003ba0 0x7f734c04c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f7359000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f733c003ba0 0x7f734c04c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:37194/0 (socket says 172.21.15.122:37194) 2024-05-28T06:05:55.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f7359000640 1 -- 172.21.15.122:0/1555711727 learned_addr learned my addr 172.21.15.122:0/1555711727 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:55.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f850da00640 1 --2- 172.21.15.122:0/1471571565 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f850815c7a0 0x7f850806f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f850da00640 1 -- 172.21.15.122:0/1471571565 >> v1:172.21.15.153:6789/0 conn(0x7f85080cced0 legacy=0x7f850815f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f7359a00640 1 --2- 172.21.15.122:0/1555711727 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f734c0e4fe0 0x7f734c0e5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f850da00640 1 -- 172.21.15.122:0/1471571565 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850815bfa0 con 0x7f8508159280 2024-05-28T06:05:55.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f21c2200640 1 -- 172.21.15.122:0/1275930138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21bc072360 msgr2=0x7f21bc0727f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f21c2200640 1 --2- 172.21.15.122:0/1275930138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21bc072360 0x7f21bc0727f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0d1390 tx=0x7f21a801c520 comp rx=0 tx=0).stop 2024-05-28T06:05:55.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7f7d57e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7d58143e80 0x7f7d5815f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7d57e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7d58143e80 0x7f7d5815f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:37204/0 (socket says 172.21.15.122:37204) 2024-05-28T06:05:55.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7d57e00640 1 -- 172.21.15.122:0/2195678714 learned_addr learned my addr 172.21.15.122:0/2195678714 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:55.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f21c2200640 1 -- 172.21.15.122:0/1275930138 shutdown_connections 2024-05-28T06:05:55.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f21c2200640 1 --2- 172.21.15.122:0/1275930138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21bc072360 0x7f21bc0727f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7359000640 1 -- 172.21.15.122:0/1555711727 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f734c0ea4f0 msgr2=0x7f734c1857e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-28T06:05:55.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7359000640 1 --2- 172.21.15.122:0/1555711727 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f734c0ea4f0 0x7f734c1857e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7359000640 1 -- 172.21.15.122:0/1555711727 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f734c0e4fe0 msgr2=0x7f734c0e5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f21c2200640 1 --2- 172.21.15.122:0/1275930138 >> v2:172.21.15.122:3300/0 conn(0x7f21bc15d7a0 0x7f21bc1646e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f21c2200640 1 -- 172.21.15.122:0/1275930138 >> 172.21.15.122:0/1275930138 conn(0x7f21bc0b3170 msgr2=0x7f21bc0d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:55.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7359000640 1 --2- 172.21.15.122:0/1555711727 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f734c0e4fe0 0x7f734c0e5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7a8aa00640 1 --2- 172.21.15.122:0/2850748242 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7a70068480 0x7f7a7006a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7359000640 1 -- 172.21.15.122:0/1555711727 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734c04cac0 con 0x7f733c003ba0 2024-05-28T06:05:55.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7fe22a200640 1 -- start start 2024-05-28T06:05:55.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7fe22a200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2240b5560 0x7fe2240c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f2fa9600640 1 -- 172.21.15.122:0/580669142 shutdown_connections 2024-05-28T06:05:55.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f2fa9600640 1 -- 172.21.15.122:0/580669142 wait complete. 2024-05-28T06:05:55.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.645+0000 7fb226000640 1 -- 172.21.15.122:0/2153985273 wait complete. 2024-05-28T06:05:55.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7a8aa00640 1 -- 172.21.15.122:0/2850748242 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7a84086480 con 0x7f7a8c052b90 2024-05-28T06:05:55.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7a8aa00640 1 --2- 172.21.15.122:0/2850748242 >> [v2:172.21.15.122:6800/642574294,v1:172.21.15.122:6801/642574294] conn(0x7f7a700706a0 0x7f7a70072ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7a8aa00640 1 -- 172.21.15.122:0/2850748242 --> [v2:172.21.15.122:6800/642574294,v1:172.21.15.122:6801/642574294] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7a70073170 con 0x7f7a700706a0 2024-05-28T06:05:55.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7a8aa00640 1 -- 172.21.15.122:0/2850748242 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7a8408d050 con 0x7f7a8c052b90 2024-05-28T06:05:55.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7a92800640 1 --2- 172.21.15.122:0/2850748242 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7a70068480 0x7f7a7006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7359000640 1 --2- 172.21.15.122:0/1555711727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f733c003ba0 0x7f734c04c580 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f734801c7a0 tx=0x7f733c005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f21c2200640 1 -- 172.21.15.122:0/1275930138 shutdown_connections 2024-05-28T06:05:55.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f21c2200640 1 -- 172.21.15.122:0/1275930138 wait complete. 2024-05-28T06:05:55.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7d5ca00640 1 --2- 172.21.15.122:0/2195678714 >> v2:172.21.15.122:3300/0 conn(0x7f7d58072360 0x7f7d580727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7d57e00640 1 -- 172.21.15.122:0/2195678714 >> v2:172.21.15.122:3300/0 conn(0x7f7d58072360 msgr2=0x7f7d580727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:55.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7d57e00640 1 --2- 172.21.15.122:0/2195678714 >> v2:172.21.15.122:3300/0 conn(0x7f7d58072360 0x7f7d580727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7d57e00640 1 -- 172.21.15.122:0/2195678714 >> v1:172.21.15.153:6789/0 conn(0x7f7d580701c0 legacy=0x7f7d580b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:55.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7d57e00640 1 -- 172.21.15.122:0/2195678714 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d580b5b60 con 0x7f7d58143e80 2024-05-28T06:05:55.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7fe22a200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2240ccf30 0x7fe224139880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7a91e00640 1 --2- 172.21.15.122:0/2850748242 >> [v2:172.21.15.122:6800/642574294,v1:172.21.15.122:6801/642574294] conn(0x7f7a700706a0 0x7f7a70072ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7fb226000640 1 Processor -- start 2024-05-28T06:05:55.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7fe22a200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe22415fae0 0x7fe224139dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7fe22a200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe224158620 con 0x7fe22415fae0 2024-05-28T06:05:55.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7fe22a200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe22406f440 con 0x7fe2240b5560 2024-05-28T06:05:55.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7fe22a200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe2241587a0 con 0x7fe2240ccf30 2024-05-28T06:05:55.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7fe223400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2240b5560 0x7fe2240c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7fe223400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2240b5560 0x7fe2240c7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:37208/0 (socket says 172.21.15.122:37208) 2024-05-28T06:05:55.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7fe223400640 1 -- 172.21.15.122:0/3450226381 learned_addr learned my addr 172.21.15.122:0/3450226381 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:55.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7350c00640 1 -- 172.21.15.122:0/1555711727 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73480bc070 con 0x7f733c003ba0 2024-05-28T06:05:55.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7350c00640 1 -- 172.21.15.122:0/1555711727 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73480b5480 con 0x7f733c003ba0 2024-05-28T06:05:55.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7350c00640 1 -- 172.21.15.122:0/1555711727 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73480bc070 con 0x7f733c003ba0 2024-05-28T06:05:55.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7fb226000640 1 -- start start 2024-05-28T06:05:55.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7a92800640 1 --2- 172.21.15.122:0/2850748242 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7a70068480 0x7f7a7006a940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c039930 tx=0x7f7a94122070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f7a91e00640 1 --2- 172.21.15.122:0/2850748242 >> [v2:172.21.15.122:6800/642574294,v1:172.21.15.122:6801/642574294] conn(0x7f7a700706a0 0x7f7a70072ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f735ba00640 1 -- 172.21.15.122:0/1555711727 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f734c04cd90 con 0x7f733c003ba0 2024-05-28T06:05:55.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7f735ba00640 1 -- 172.21.15.122:0/1555711727 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f734c04d350 con 0x7f733c003ba0 2024-05-28T06:05:55.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7fb226000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2200d2af0 0x7fb220161280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7fb226000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2200d4140 0x7fb2200ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7fb226000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2200d4690 0x7fb2200cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7fb226000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb22016c940 con 0x7fb2200d4140 2024-05-28T06:05:55.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7fb226000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb22016c7c0 con 0x7fb2200d2af0 2024-05-28T06:05:55.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7fb226000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb22016cac0 con 0x7fb2200d4690 2024-05-28T06:05:55.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.649+0000 7fe21be00640 1 --2- 172.21.15.122:0/3450226381 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2240ccf30 0x7fe224139880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7fe223400640 1 -- 172.21.15.122:0/3450226381 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2240ccf30 msgr2=0x7fe224139880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7fe223400640 1 --2- 172.21.15.122:0/3450226381 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2240ccf30 0x7fe224139880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7fe223400640 1 -- 172.21.15.122:0/3450226381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe22415fae0 msgr2=0x7fe224139dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7fe223400640 1 --2- 172.21.15.122:0/3450226381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe22415fae0 0x7fe224139dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7fe223400640 1 -- 172.21.15.122:0/3450226381 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2241620a0 con 0x7fe2240b5560 2024-05-28T06:05:55.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7f21c2200640 1 Processor -- start 2024-05-28T06:05:55.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7f21c2200640 1 -- start start 2024-05-28T06:05:55.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7fb21ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2200d4140 0x7fb2200ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7fb21ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2200d4140 0x7fb2200ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41250/0 (socket says 172.21.15.122:41250) 2024-05-28T06:05:55.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7fb21ea00640 1 -- 172.21.15.122:0/1877849421 learned_addr learned my addr 172.21.15.122:0/1877849421 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:55.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7fb21fe00640 1 --2- 172.21.15.122:0/1877849421 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2200d4690 0x7fb2200cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7f850da00640 1 --2- 172.21.15.122:0/1471571565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8508159280 0x7f85080b4e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f84fc009870 tx=0x7f84fc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4835ec547b626b server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7f735ba00640 1 -- 172.21.15.122:0/1555711727 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f734c0053a0 con 0x7f733c003ba0 2024-05-28T06:05:55.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7fe223400640 1 --2- 172.21.15.122:0/3450226381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2240b5560 0x7fe2240c7d20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe21400c7f0 tx=0x7fe21400ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7fb21f400640 1 --2- 172.21.15.122:0/1877849421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2200d2af0 0x7fb220161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7f7a8aa00640 1 -- 172.21.15.122:0/2850748242 <== osd.0 v2:172.21.15.122:6800/642574294 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7a70073170 con 0x7f7a700706a0 2024-05-28T06:05:55.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7fe21b400640 1 -- 172.21.15.122:0/3450226381 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214005480 con 0x7fe2240b5560 2024-05-28T06:05:55.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7fb21ea00640 1 -- 172.21.15.122:0/1877849421 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2200d4690 msgr2=0x7fb2200cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7fb21ea00640 1 --2- 172.21.15.122:0/1877849421 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2200d4690 0x7fb2200cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7fb21ea00640 1 -- 172.21.15.122:0/1877849421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2200d2af0 msgr2=0x7fb220161280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7fb21ea00640 1 --2- 172.21.15.122:0/1877849421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2200d2af0 0x7fb220161280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7fb21ea00640 1 -- 172.21.15.122:0/1877849421 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22015b9a0 con 0x7fb2200d4140 2024-05-28T06:05:55.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7f21c2200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21bc072360 0x7f21bc160250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7f21c2200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21bc0b3a60 0x7f21bc0aa950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7f21c2200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21bc15d7a0 0x7f21bc0aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7f21c2200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f21bc0d0560 con 0x7f21bc0b3a60 2024-05-28T06:05:55.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7f21c2200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f21bc0d03e0 con 0x7f21bc072360 2024-05-28T06:05:55.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7f21c2200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f21bc0d06e0 con 0x7f21bc15d7a0 2024-05-28T06:05:55.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7fe22a200640 1 -- 172.21.15.122:0/3450226381 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2240c5710 con 0x7fe2240b5560 2024-05-28T06:05:55.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7fe22a200640 1 -- 172.21.15.122:0/3450226381 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2240c5cd0 con 0x7fe2240b5560 2024-05-28T06:05:55.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7fe21b400640 1 -- 172.21.15.122:0/3450226381 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe21400a640 con 0x7fe2240b5560 2024-05-28T06:05:55.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7fe21b400640 1 -- 172.21.15.122:0/3450226381 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21400aa10 con 0x7fe2240b5560 2024-05-28T06:05:55.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7f21bb400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21bc072360 0x7f21bc160250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7fe22a200640 1 -- 172.21.15.122:0/3450226381 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe1fc001040 con 0x7fe2240b5560 2024-05-28T06:05:55.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7f2fa9600640 1 Processor -- start 2024-05-28T06:05:55.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7f21bbe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21bc15d7a0 0x7f21bc0aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7f21bbe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21bc15d7a0 0x7f21bc0aae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:50222/0 (socket says 172.21.15.122:50222) 2024-05-28T06:05:55.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7f21bbe00640 1 -- 172.21.15.122:0/952127033 learned_addr learned my addr 172.21.15.122:0/952127033 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:55.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7fb21ea00640 1 --2- 172.21.15.122:0/1877849421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2200d4140 0x7fb2200ccdb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00c3c0 tx=0x7fb20c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7f7d57e00640 1 --2- 172.21.15.122:0/2195678714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d58143e80 0x7f7d5815f0e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7d580733b0 tx=0x7f7d4401e960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ac82e9fcdbace61 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7f2fa9600640 1 -- start start 2024-05-28T06:05:55.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7f7350c00640 1 -- 172.21.15.122:0/1555711727 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f73480b3070 con 0x7f733c003ba0 2024-05-28T06:05:55.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7f21bbe00640 1 -- 172.21.15.122:0/952127033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21bc072360 msgr2=0x7f21bc160250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.653+0000 7f8507e00640 1 -- 172.21.15.122:0/1471571565 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84fc0b2070 con 0x7f8508159280 2024-05-28T06:05:55.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f8507e00640 1 -- 172.21.15.122:0/1471571565 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84fc0a9070 con 0x7f8508159280 2024-05-28T06:05:55.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f8507e00640 1 -- 172.21.15.122:0/1471571565 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84fc0ad880 con 0x7f8508159280 2024-05-28T06:05:55.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7fb217400640 1 -- 172.21.15.122:0/1877849421 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c017070 con 0x7fb2200d4140 2024-05-28T06:05:55.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7fb217400640 1 -- 172.21.15.122:0/1877849421 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb20c0052d0 con 0x7fb2200d4140 2024-05-28T06:05:55.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7fb217400640 1 -- 172.21.15.122:0/1877849421 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c003840 con 0x7fb2200d4140 2024-05-28T06:05:55.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f21bbe00640 1 --2- 172.21.15.122:0/952127033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21bc072360 0x7f21bc160250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f21bbe00640 1 -- 172.21.15.122:0/952127033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21bc0b3a60 msgr2=0x7f21bc0aa950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f21bbe00640 1 --2- 172.21.15.122:0/952127033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21bc0b3a60 0x7f21bc0aa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f21bbe00640 1 -- 172.21.15.122:0/952127033 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21bc0ab6d0 con 0x7f21bc15d7a0 2024-05-28T06:05:55.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f7350c00640 1 --2- 172.21.15.122:0/1555711727 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f73340687b0 0x7f733406ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f7350c00640 1 -- 172.21.15.122:0/1555711727 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f73480ab400 con 0x7f733c003ba0 2024-05-28T06:05:55.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f2fa9600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f880051d0 0x7f2f9c009790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f7350c00640 1 --2- 172.21.15.122:0/1555711727 >> [v2:172.21.15.122:6808/1210437339,v1:172.21.15.122:6809/1210437339] conn(0x7f73340709b0 0x7f7334072dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f7350c00640 1 -- 172.21.15.122:0/1555711727 --> [v2:172.21.15.122:6808/1210437339,v1:172.21.15.122:6809/1210437339] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7348004520 con 0x7f73340709b0 2024-05-28T06:05:55.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f7350c00640 1 -- 172.21.15.122:0/1555711727 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f73480ebbc0 con 0x7f733c003ba0 2024-05-28T06:05:55.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f8510400640 1 -- 172.21.15.122:0/1471571565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8508159280 msgr2=0x7f85080b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f8510400640 1 --2- 172.21.15.122:0/1471571565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8508159280 0x7f85080b4e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f84fc009870 tx=0x7f84fc01c560 comp rx=0 tx=0).stop 2024-05-28T06:05:55.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f2fa9600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f9c0d8410 0x7f2f9c0ea6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f7353e00640 1 --2- 172.21.15.122:0/1555711727 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f73340687b0 0x7f733406ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f7359a00640 1 --2- 172.21.15.122:0/1555711727 >> [v2:172.21.15.122:6808/1210437339,v1:172.21.15.122:6809/1210437339] conn(0x7f73340709b0 0x7f7334072dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f2fa2a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f880051d0 0x7f2f9c009790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f2fa2a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f880051d0 0x7f2f9c009790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:50238/0 (socket says 172.21.15.122:50238) 2024-05-28T06:05:55.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f21bb400640 1 --2- 172.21.15.122:0/952127033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21bc072360 0x7f21bc160250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:05:55.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f2fa2000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f9c0d8410 0x7f2f9c0ea6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f2fa2000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f9c0d8410 0x7f2f9c0ea6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:37242/0 (socket says 172.21.15.122:37242) 2024-05-28T06:05:55.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f2fa2a00640 1 -- 172.21.15.122:0/2950681575 learned_addr learned my addr 172.21.15.122:0/2950681575 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:55.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f2fa9600640 1 --2- 172.21.15.122:0/2950681575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f9c0d8890 0x7f2f9c0eac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f8510400640 1 -- 172.21.15.122:0/1471571565 shutdown_connections 2024-05-28T06:05:55.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f8510400640 1 --2- 172.21.15.122:0/1471571565 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f850815c7a0 0x7f850806f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f8510400640 1 --2- 172.21.15.122:0/1471571565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8508159280 0x7f85080b4e10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f2fa9600640 1 -- 172.21.15.122:0/2950681575 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c055630 con 0x7f2f9c0d8890 2024-05-28T06:05:55.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f8510400640 1 -- 172.21.15.122:0/1471571565 >> 172.21.15.122:0/1471571565 conn(0x7f8508062a40 msgr2=0x7f850806b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:55.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f2fa9600640 1 -- 172.21.15.122:0/2950681575 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c03cc30 con 0x7f2f9c0d8410 2024-05-28T06:05:55.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f2fa9600640 1 -- 172.21.15.122:0/2950681575 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2f9c0557b0 con 0x7f2f880051d0 2024-05-28T06:05:55.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f7d56a00640 1 -- 172.21.15.122:0/2195678714 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d440ad070 con 0x7f7d58143e80 2024-05-28T06:05:55.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f21bbe00640 1 --2- 172.21.15.122:0/952127033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21bc15d7a0 0x7f21bc0aae90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f21b400c740 tx=0x7f21b400cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f7d56a00640 1 -- 172.21.15.122:0/2195678714 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d440a7830 con 0x7f7d58143e80 2024-05-28T06:05:55.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f7d56a00640 1 -- 172.21.15.122:0/2195678714 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d440a7c00 con 0x7f7d58143e80 2024-05-28T06:05:55.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f7359a00640 1 --2- 172.21.15.122:0/1555711727 >> [v2:172.21.15.122:6808/1210437339,v1:172.21.15.122:6809/1210437339] conn(0x7f73340709b0 0x7f7334072dd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f7353e00640 1 --2- 172.21.15.122:0/1555711727 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f73340687b0 0x7f733406ac70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7354050b40 tx=0x7f735406f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f2fa3400640 1 --2- 172.21.15.122:0/2950681575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f9c0d8890 0x7f2f9c0eac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f21b3400640 1 -- 172.21.15.122:0/952127033 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b4016020 con 0x7f21bc15d7a0 2024-05-28T06:05:55.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f21b3400640 1 -- 172.21.15.122:0/952127033 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21b400ce50 con 0x7f21bc15d7a0 2024-05-28T06:05:55.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f21b3400640 1 -- 172.21.15.122:0/952127033 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b4003980 con 0x7f21bc15d7a0 2024-05-28T06:05:55.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f21c2200640 1 -- 172.21.15.122:0/952127033 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21bc0ab9b0 con 0x7f21bc15d7a0 2024-05-28T06:05:55.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f21c2200640 1 -- 172.21.15.122:0/952127033 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f21bc15dbe0 con 0x7f21bc15d7a0 2024-05-28T06:05:55.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f7d5ea00640 1 -- 172.21.15.122:0/2195678714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d58143e80 msgr2=0x7f7d5815f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f7d5ea00640 1 --2- 172.21.15.122:0/2195678714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d58143e80 0x7f7d5815f0e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7d580733b0 tx=0x7f7d4401e960 comp rx=0 tx=0).stop 2024-05-28T06:05:55.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f7d5ea00640 1 -- 172.21.15.122:0/2195678714 shutdown_connections 2024-05-28T06:05:55.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f7d5ea00640 1 --2- 172.21.15.122:0/2195678714 >> v2:172.21.15.122:3300/0 conn(0x7f7d58072360 0x7f7d580727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f7d5ea00640 1 --2- 172.21.15.122:0/2195678714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d58143e80 0x7f7d5815f0e0 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7d580733b0 tx=0x7f7d4401e960 comp rx=0 tx=0).stop 2024-05-28T06:05:55.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f7d5ea00640 1 -- 172.21.15.122:0/2195678714 >> 172.21.15.122:0/2195678714 conn(0x7f7d580b3170 msgr2=0x7f7d580d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:55.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f8510400640 1 -- 172.21.15.122:0/1471571565 shutdown_connections 2024-05-28T06:05:55.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f8510400640 1 -- 172.21.15.122:0/1471571565 wait complete. 2024-05-28T06:05:55.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7fe21b400640 1 -- 172.21.15.122:0/3450226381 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe21400abb0 con 0x7fe2240b5560 2024-05-28T06:05:55.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f7d5ea00640 1 -- 172.21.15.122:0/2195678714 shutdown_connections 2024-05-28T06:05:55.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f7350c00640 1 -- 172.21.15.122:0/1555711727 <== osd.1 v2:172.21.15.122:6808/1210437339 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7348004520 con 0x7f73340709b0 2024-05-28T06:05:55.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f2fa2a00640 1 -- 172.21.15.122:0/2950681575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f9c0d8410 msgr2=0x7f2f9c0ea6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f2fa2a00640 1 --2- 172.21.15.122:0/2950681575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f9c0d8410 0x7f2f9c0ea6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f2fa2a00640 1 -- 172.21.15.122:0/2950681575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f9c0d8890 msgr2=0x7f2f9c0eac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f2fa2a00640 1 --2- 172.21.15.122:0/2950681575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f9c0d8890 0x7f2f9c0eac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f2fa2a00640 1 -- 172.21.15.122:0/2950681575 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9c0f1360 con 0x7f2f880051d0 2024-05-28T06:05:55.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f2fa2a00640 1 --2- 172.21.15.122:0/2950681575 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f880051d0 0x7f2f9c009790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2f94007fd0 tx=0x7f2f9400cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f2f9aa00640 1 -- 172.21.15.122:0/2950681575 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f94017070 con 0x7f2f880051d0 2024-05-28T06:05:55.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f2f9aa00640 1 -- 172.21.15.122:0/2950681575 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f9400ce50 con 0x7f2f880051d0 2024-05-28T06:05:55.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f2f9aa00640 1 -- 172.21.15.122:0/2950681575 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9400a880 con 0x7f2f880051d0 2024-05-28T06:05:55.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f2fa9600640 1 -- 172.21.15.122:0/2950681575 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f9c0f1640 con 0x7f2f880051d0 2024-05-28T06:05:55.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f2fa9600640 1 -- 172.21.15.122:0/2950681575 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f9c0f1c00 con 0x7f2f880051d0 2024-05-28T06:05:55.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7fb226000640 1 -- 172.21.15.122:0/1877849421 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb22015bc80 con 0x7fb2200d4140 2024-05-28T06:05:55.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7fb226000640 1 -- 172.21.15.122:0/1877849421 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb220160d60 con 0x7fb2200d4140 2024-05-28T06:05:55.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.657+0000 7f7d5ea00640 1 -- 172.21.15.122:0/2195678714 wait complete. 2024-05-28T06:05:55.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f7d5ea00640 1 Processor -- start 2024-05-28T06:05:55.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f7d5ea00640 1 -- start start 2024-05-28T06:05:55.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7fe21b400640 1 --2- 172.21.15.122:0/3450226381 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe2000683b0 0x7fe20006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7fe21b400640 1 -- 172.21.15.122:0/3450226381 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe214086a40 con 0x7fe2240b5560 2024-05-28T06:05:55.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7fe21b400640 1 --2- 172.21.15.122:0/3450226381 >> [v2:172.21.15.122:6816/791000953,v1:172.21.15.122:6817/791000953] conn(0x7fe2000705d0 0x7fe2000729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7fe21be00640 1 --2- 172.21.15.122:0/3450226381 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe2000683b0 0x7fe20006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f21c2200640 1 -- 172.21.15.122:0/952127033 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f21bc075620 con 0x7f21bc15d7a0 2024-05-28T06:05:55.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f7d5ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d580701c0 0x7f7d58164460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f7d5ea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d58072360 0x7f7d580a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f7d5ea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d580aebe0 0x7f7d580aa040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f7d5ea00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7d580b4260 con 0x7f7d580701c0 2024-05-28T06:05:55.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f7d5ea00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7d580b40e0 con 0x7f7d58072360 2024-05-28T06:05:55.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f7d5ea00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7d580b43e0 con 0x7f7d580aebe0 2024-05-28T06:05:55.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f7d57400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d58072360 0x7f7d580a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f7d57400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d58072360 0x7f7d580a9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:37244/0 (socket says 172.21.15.122:37244) 2024-05-28T06:05:55.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f7d57400640 1 -- 172.21.15.122:0/3950315418 learned_addr learned my addr 172.21.15.122:0/3950315418 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:55.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7fb226000640 1 -- 172.21.15.122:0/1877849421 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb220075620 con 0x7fb2200d4140 2024-05-28T06:05:55.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7fb217400640 1 -- 172.21.15.122:0/1877849421 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb20c01a070 con 0x7fb2200d4140 2024-05-28T06:05:55.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f7d5ca00640 1 --2- 172.21.15.122:0/3950315418 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d580aebe0 0x7f7d580aa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f7d57400640 1 -- 172.21.15.122:0/3950315418 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d580aebe0 msgr2=0x7f7d580aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f7d57400640 1 --2- 172.21.15.122:0/3950315418 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d580aebe0 0x7f7d580aa040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f7d57400640 1 -- 172.21.15.122:0/3950315418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d580701c0 msgr2=0x7f7d58164460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f7d57400640 1 --2- 172.21.15.122:0/3950315418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d580701c0 0x7f7d58164460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f7d57400640 1 -- 172.21.15.122:0/3950315418 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d58164da0 con 0x7f7d58072360 2024-05-28T06:05:55.707 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7fe21b400640 1 -- 172.21.15.122:0/3450226381 --> [v2:172.21.15.122:6816/791000953,v1:172.21.15.122:6817/791000953] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe21401ce50 con 0x7fe2000705d0 2024-05-28T06:05:55.707 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7fe21b400640 1 -- 172.21.15.122:0/3450226381 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe21408b2a0 con 0x7fe2240b5560 2024-05-28T06:05:55.707 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f21b3400640 1 -- 172.21.15.122:0/952127033 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f21b4003b20 con 0x7f21bc15d7a0 2024-05-28T06:05:55.707 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f21b3400640 1 --2- 172.21.15.122:0/952127033 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f219c068380 0x7f219c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.707 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.661+0000 7f7d5ca00640 1 --2- 172.21.15.122:0/3950315418 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d580aebe0 0x7f7d580aa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:05:55.708 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f21bb400640 1 --2- 172.21.15.122:0/952127033 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f219c068380 0x7f219c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.708 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f7d57400640 1 --2- 172.21.15.122:0/3950315418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d58072360 0x7f7d580a9b00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000b9e0 tx=0x7f7d5000bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.708 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f21b3400640 1 -- 172.21.15.122:0/952127033 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f21b4086640 con 0x7f21bc15d7a0 2024-05-28T06:05:55.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f8510400640 1 Processor -- start 2024-05-28T06:05:55.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f2fa9600640 1 -- 172.21.15.122:0/2950681575 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2f9c005820 con 0x7f2f880051d0 2024-05-28T06:05:55.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f21b3400640 1 --2- 172.21.15.122:0/952127033 >> [v2:172.21.15.153:6809/2459238876,v1:172.21.15.153:6811/2459238876] conn(0x7f219c070580 0x7f219c0729a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f21b3400640 1 -- 172.21.15.122:0/952127033 --> [v2:172.21.15.153:6809/2459238876,v1:172.21.15.153:6811/2459238876] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f21b4017e70 con 0x7f219c070580 2024-05-28T06:05:55.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f21b3400640 1 -- 172.21.15.122:0/952127033 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f21b408d050 con 0x7f21bc15d7a0 2024-05-28T06:05:55.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7fe21be00640 1 --2- 172.21.15.122:0/3450226381 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe2000683b0 0x7fe20006a870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe20c0ad000 tx=0x7fe20c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7fe223e00640 1 --2- 172.21.15.122:0/3450226381 >> [v2:172.21.15.122:6816/791000953,v1:172.21.15.122:6817/791000953] conn(0x7fe2000705d0 0x7fe2000729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7fb217400640 1 --2- 172.21.15.122:0/1877849421 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb2000683d0 0x7fb20006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7fb21f400640 1 --2- 172.21.15.122:0/1877849421 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb2000683d0 0x7fb20006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7fb217400640 1 -- 172.21.15.122:0/1877849421 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb20c084350 con 0x7fb2200d4140 2024-05-28T06:05:55.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7fb217400640 1 --2- 172.21.15.122:0/1877849421 >> [v2:172.21.15.153:6824/3872438562,v1:172.21.15.153:6825/3872438562] conn(0x7fb200070570 0x7fb200072990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7fb217400640 1 -- 172.21.15.122:0/1877849421 --> [v2:172.21.15.153:6824/3872438562,v1:172.21.15.153:6825/3872438562] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb200073040 con 0x7fb200070570 2024-05-28T06:05:55.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7fb217400640 1 -- 172.21.15.122:0/1877849421 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb20c08b050 con 0x7fb2200d4140 2024-05-28T06:05:55.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f8510400640 1 -- start start 2024-05-28T06:05:55.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f21baa00640 1 --2- 172.21.15.122:0/952127033 >> [v2:172.21.15.153:6809/2459238876,v1:172.21.15.153:6811/2459238876] conn(0x7f219c070580 0x7f219c0729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f8510400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85080cced0 0x7f8508140a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f8510400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8508159280 0x7f8508160490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f8510400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f850815c7a0 0x7f85081609d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f8510400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f85080cd870 con 0x7f85080cced0 2024-05-28T06:05:55.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f8510400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f85080cd6f0 con 0x7f8508159280 2024-05-28T06:05:55.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f8510400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f850815cb80 con 0x7f850815c7a0 2024-05-28T06:05:55.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f850e400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f850815c7a0 0x7f85081609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f850e400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f850815c7a0 0x7f85081609d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:50260/0 (socket says 172.21.15.122:50260) 2024-05-28T06:05:55.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f850e400640 1 -- 172.21.15.122:0/2133876421 learned_addr learned my addr 172.21.15.122:0/2133876421 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:55.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f850d000640 1 --2- 172.21.15.122:0/2133876421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8508159280 0x7f8508160490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f850da00640 1 --2- 172.21.15.122:0/2133876421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85080cced0 0x7f8508140a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7f21bb400640 1 --2- 172.21.15.122:0/952127033 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f219c068380 0x7f219c06a840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f21ac006fd0 tx=0x7f21ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f7d4fe00640 1 -- 172.21.15.122:0/3950315418 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50019070 con 0x7f7d58072360 2024-05-28T06:05:55.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f7d4fe00640 1 -- 172.21.15.122:0/3950315418 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d5000cba0 con 0x7f7d58072360 2024-05-28T06:05:55.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f7d5ea00640 1 -- 172.21.15.122:0/3950315418 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d58165080 con 0x7f7d58072360 2024-05-28T06:05:55.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f7d4fe00640 1 -- 172.21.15.122:0/3950315418 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50014440 con 0x7f7d58072360 2024-05-28T06:05:55.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7f2f9aa00640 1 -- 172.21.15.122:0/2950681575 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2f9401a070 con 0x7f2f880051d0 2024-05-28T06:05:55.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7f7d5ea00640 1 -- 172.21.15.122:0/3950315418 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d58165640 con 0x7f7d58072360 2024-05-28T06:05:55.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7f7d5ea00640 1 -- 172.21.15.122:0/3950315418 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7d58075620 con 0x7f7d58072360 2024-05-28T06:05:55.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.665+0000 7fb21fe00640 1 --2- 172.21.15.122:0/1877849421 >> [v2:172.21.15.153:6824/3872438562,v1:172.21.15.153:6825/3872438562] conn(0x7fb200070570 0x7fb200072990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7fb21fe00640 1 --2- 172.21.15.122:0/1877849421 >> [v2:172.21.15.153:6824/3872438562,v1:172.21.15.153:6825/3872438562] conn(0x7fb200070570 0x7fb200072990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7fb21f400640 1 --2- 172.21.15.122:0/1877849421 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb2000683d0 0x7fb20006a890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb2180af000 tx=0x7fb2180a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7fe223e00640 1 --2- 172.21.15.122:0/3450226381 >> [v2:172.21.15.122:6816/791000953,v1:172.21.15.122:6817/791000953] conn(0x7fe2000705d0 0x7fe2000729f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7f850e400640 1 -- 172.21.15.122:0/2133876421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8508159280 msgr2=0x7f8508160490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7f850e400640 1 --2- 172.21.15.122:0/2133876421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8508159280 0x7f8508160490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7f850e400640 1 -- 172.21.15.122:0/2133876421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85080cced0 msgr2=0x7f8508140a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7f850e400640 1 --2- 172.21.15.122:0/2133876421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85080cced0 0x7f8508140a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7f850e400640 1 -- 172.21.15.122:0/2133876421 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8508143a90 con 0x7f850815c7a0 2024-05-28T06:05:55.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7f21baa00640 1 --2- 172.21.15.122:0/952127033 >> [v2:172.21.15.153:6809/2459238876,v1:172.21.15.153:6811/2459238876] conn(0x7f219c070580 0x7f219c0729a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7f850d000640 1 --2- 172.21.15.122:0/2133876421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8508159280 0x7f8508160490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:05:55.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7f850e400640 1 --2- 172.21.15.122:0/2133876421 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f850815c7a0 0x7f85081609d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f850000c730 tx=0x7f850000cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7f2f9aa00640 1 --2- 172.21.15.122:0/2950681575 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2f840683d0 0x7f2f8406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7fb217400640 1 -- 172.21.15.122:0/1877849421 <== osd.4 v2:172.21.15.153:6824/3872438562 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb200073040 con 0x7fb200070570 2024-05-28T06:05:55.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7f2f9aa00640 1 -- 172.21.15.122:0/2950681575 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2f94085e90 con 0x7f2f880051d0 2024-05-28T06:05:55.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7f8505600640 1 -- 172.21.15.122:0/2133876421 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8500003b80 con 0x7f850815c7a0 2024-05-28T06:05:55.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7fe21b400640 1 -- 172.21.15.122:0/3450226381 <== osd.2 v2:172.21.15.122:6816/791000953 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe21401ce50 con 0x7fe2000705d0 2024-05-28T06:05:55.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7f8505600640 1 -- 172.21.15.122:0/2133876421 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8500003d20 con 0x7f850815c7a0 2024-05-28T06:05:55.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7f8505600640 1 -- 172.21.15.122:0/2133876421 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850000aa30 con 0x7f850815c7a0 2024-05-28T06:05:55.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7f21b3400640 1 -- 172.21.15.122:0/952127033 <== osd.5 v2:172.21.15.153:6809/2459238876 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f21b4017e70 con 0x7f219c070580 2024-05-28T06:05:55.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7f2fa2000640 1 --2- 172.21.15.122:0/2950681575 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2f840683d0 0x7f2f8406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7f2f9aa00640 1 --2- 172.21.15.122:0/2950681575 >> [v2:172.21.15.122:6822/1935505897,v1:172.21.15.122:6824/1935505897] conn(0x7f2f84070650 0x7f2f84072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7f2f9aa00640 1 -- 172.21.15.122:0/2950681575 --> [v2:172.21.15.122:6822/1935505897,v1:172.21.15.122:6824/1935505897] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f84073120 con 0x7f2f84070650 2024-05-28T06:05:55.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7f2f9aa00640 1 -- 172.21.15.122:0/2950681575 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2f940885e0 con 0x7f2f880051d0 2024-05-28T06:05:55.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.669+0000 7f2fa2000640 1 --2- 172.21.15.122:0/2950681575 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2f840683d0 0x7f2f8406a890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40743d0 tx=0x7f2fa406f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.673+0000 7f7d4fe00640 1 -- 172.21.15.122:0/3950315418 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7d5001c070 con 0x7f7d58072360 2024-05-28T06:05:55.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.673+0000 7f2fa3400640 1 --2- 172.21.15.122:0/2950681575 >> [v2:172.21.15.122:6822/1935505897,v1:172.21.15.122:6824/1935505897] conn(0x7f2f84070650 0x7f2f84072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.673+0000 7f8510400640 1 -- 172.21.15.122:0/2133876421 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8508143d70 con 0x7f850815c7a0 2024-05-28T06:05:55.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.673+0000 7f8510400640 1 -- 172.21.15.122:0/2133876421 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8508144330 con 0x7f850815c7a0 2024-05-28T06:05:55.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.673+0000 7f7d4fe00640 1 --2- 172.21.15.122:0/3950315418 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7d38068380 0x7f7d3806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.673+0000 7f7d4fe00640 1 -- 172.21.15.122:0/3950315418 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7d50086e50 con 0x7f7d58072360 2024-05-28T06:05:55.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.673+0000 7f7d4fe00640 1 --2- 172.21.15.122:0/3950315418 >> [v2:172.21.15.153:6808/194393677,v1:172.21.15.153:6810/194393677] conn(0x7f7d380705a0 0x7f7d380729c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.673+0000 7f7d4fe00640 1 -- 172.21.15.122:0/3950315418 --> [v2:172.21.15.153:6808/194393677,v1:172.21.15.153:6810/194393677] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7d5000eea0 con 0x7f7d380705a0 2024-05-28T06:05:55.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.673+0000 7f7d4fe00640 1 -- 172.21.15.122:0/3950315418 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7d50087240 con 0x7f7d58072360 2024-05-28T06:05:55.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.673+0000 7f8510400640 1 -- 172.21.15.122:0/2133876421 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8508068bd0 con 0x7f850815c7a0 2024-05-28T06:05:55.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.673+0000 7f7d5ca00640 1 --2- 172.21.15.122:0/3950315418 >> [v2:172.21.15.153:6808/194393677,v1:172.21.15.153:6810/194393677] conn(0x7f7d380705a0 0x7f7d380729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.673+0000 7f7d5ca00640 1 --2- 172.21.15.122:0/3950315418 >> [v2:172.21.15.153:6808/194393677,v1:172.21.15.153:6810/194393677] conn(0x7f7d380705a0 0x7f7d380729c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.673+0000 7f2fa3400640 1 --2- 172.21.15.122:0/2950681575 >> [v2:172.21.15.122:6822/1935505897,v1:172.21.15.122:6824/1935505897] conn(0x7f2f84070650 0x7f2f84072a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.673+0000 7f2f9aa00640 1 -- 172.21.15.122:0/2950681575 <== osd.3 v2:172.21.15.122:6822/1935505897 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2f84073120 con 0x7f2f84070650 2024-05-28T06:05:55.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.673+0000 7f7d4fe00640 1 -- 172.21.15.122:0/3950315418 <== osd.6 v2:172.21.15.153:6808/194393677 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7d5000eea0 con 0x7f7d380705a0 2024-05-28T06:05:55.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.677+0000 7f8505600640 1 -- 172.21.15.122:0/2133876421 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f850000abd0 con 0x7f850815c7a0 2024-05-28T06:05:55.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.677+0000 7f7d57e00640 1 --2- 172.21.15.122:0/3950315418 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7d38068380 0x7f7d3806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.677+0000 7f7d57e00640 1 --2- 172.21.15.122:0/3950315418 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7d38068380 0x7f7d3806a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7d440b2000 tx=0x7f7d44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.677+0000 7f8505600640 1 --2- 172.21.15.122:0/2133876421 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f84e8068380 0x7f84e806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.677+0000 7f8505600640 1 -- 172.21.15.122:0/2133876421 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8500086880 con 0x7f850815c7a0 2024-05-28T06:05:55.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.677+0000 7f8505600640 1 --2- 172.21.15.122:0/2133876421 >> [v2:172.21.15.153:6800/23883170,v1:172.21.15.153:6801/23883170] conn(0x7f84e8070520 0x7f84e8072940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.677+0000 7f850da00640 1 --2- 172.21.15.122:0/2133876421 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f84e8068380 0x7f84e806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.677+0000 7f8505600640 1 -- 172.21.15.122:0/2133876421 --> [v2:172.21.15.153:6800/23883170,v1:172.21.15.153:6801/23883170] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8500010e50 con 0x7f84e8070520 2024-05-28T06:05:55.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.677+0000 7f850da00640 1 --2- 172.21.15.122:0/2133876421 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f84e8068380 0x7f84e806a840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0af000 tx=0x7f84fc0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.677+0000 7f8505600640 1 -- 172.21.15.122:0/2133876421 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8500052940 con 0x7f850815c7a0 2024-05-28T06:05:55.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.681+0000 7f850d000640 1 --2- 172.21.15.122:0/2133876421 >> [v2:172.21.15.153:6800/23883170,v1:172.21.15.153:6801/23883170] conn(0x7f84e8070520 0x7f84e8072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.681+0000 7f850d000640 1 --2- 172.21.15.122:0/2133876421 >> [v2:172.21.15.153:6800/23883170,v1:172.21.15.153:6801/23883170] conn(0x7f84e8070520 0x7f84e8072940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.681+0000 7f8505600640 1 -- 172.21.15.122:0/2133876421 <== osd.7 v2:172.21.15.153:6800/23883170 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8500010e50 con 0x7f84e8070520 2024-05-28T06:05:55.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.689+0000 7f7a99400640 1 -- 172.21.15.122:0/2850748242 --> [v2:172.21.15.122:6800/642574294,v1:172.21.15.122:6801/642574294] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7a8c0057f0 con 0x7f7a700706a0 2024-05-28T06:05:55.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.689+0000 7f7a8aa00640 1 -- 172.21.15.122:0/2850748242 <== osd.0 v2:172.21.15.122:6800/642574294 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7a8c0057f0 con 0x7f7a700706a0 2024-05-28T06:05:55.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.693+0000 7f7a99400640 1 -- 172.21.15.122:0/2850748242 >> [v2:172.21.15.122:6800/642574294,v1:172.21.15.122:6801/642574294] conn(0x7f7a700706a0 msgr2=0x7f7a70072ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.693+0000 7f7a99400640 1 --2- 172.21.15.122:0/2850748242 >> [v2:172.21.15.122:6800/642574294,v1:172.21.15.122:6801/642574294] conn(0x7f7a700706a0 0x7f7a70072ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.693+0000 7f7a99400640 1 -- 172.21.15.122:0/2850748242 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7a70068480 msgr2=0x7f7a7006a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.693+0000 7f7a99400640 1 --2- 172.21.15.122:0/2850748242 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7a70068480 0x7f7a7006a940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c039930 tx=0x7f7a94122070 comp rx=0 tx=0).stop 2024-05-28T06:05:55.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.693+0000 7f7a99400640 1 -- 172.21.15.122:0/2850748242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a8c052b90 msgr2=0x7f7a8c0e6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.693+0000 7f7a99400640 1 --2- 172.21.15.122:0/2850748242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a8c052b90 0x7f7a8c0e6190 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7a8400d4b0 tx=0x7f7a8400d970 comp rx=0 tx=0).stop 2024-05-28T06:05:55.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.693+0000 7f7a93200640 1 -- 172.21.15.122:0/2850748242 reap_dead start 2024-05-28T06:05:55.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.693+0000 7f735ba00640 1 -- 172.21.15.122:0/1555711727 --> [v2:172.21.15.122:6808/1210437339,v1:172.21.15.122:6809/1210437339] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f734c052830 con 0x7f73340709b0 2024-05-28T06:05:55.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.693+0000 7f7350c00640 1 -- 172.21.15.122:0/1555711727 <== osd.1 v2:172.21.15.122:6808/1210437339 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f734c052830 con 0x7f73340709b0 2024-05-28T06:05:55.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.693+0000 7f735ba00640 1 -- 172.21.15.122:0/1555711727 >> [v2:172.21.15.122:6808/1210437339,v1:172.21.15.122:6809/1210437339] conn(0x7f73340709b0 msgr2=0x7f7334072dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.693+0000 7f735ba00640 1 --2- 172.21.15.122:0/1555711727 >> [v2:172.21.15.122:6808/1210437339,v1:172.21.15.122:6809/1210437339] conn(0x7f73340709b0 0x7f7334072dd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.693+0000 7f735ba00640 1 -- 172.21.15.122:0/1555711727 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f73340687b0 msgr2=0x7f733406ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.693+0000 7f735ba00640 1 --2- 172.21.15.122:0/1555711727 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f73340687b0 0x7f733406ac70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7354050b40 tx=0x7f735406f040 comp rx=0 tx=0).stop 2024-05-28T06:05:55.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.693+0000 7f735ba00640 1 -- 172.21.15.122:0/1555711727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f733c003ba0 msgr2=0x7f734c04c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.697+0000 7f7a99400640 1 -- 172.21.15.122:0/2850748242 shutdown_connections 2024-05-28T06:05:55.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.697+0000 7f7a99400640 1 -- 172.21.15.122:0/2850748242 >> 172.21.15.122:0/2850748242 conn(0x7f7a8c0537c0 msgr2=0x7f7a8c008620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:55.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.693+0000 7f735ba00640 1 --2- 172.21.15.122:0/1555711727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f733c003ba0 0x7f734c04c580 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f734801c7a0 tx=0x7f733c005840 comp rx=0 tx=0).stop 2024-05-28T06:05:55.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.693+0000 7f7359a00640 1 -- 172.21.15.122:0/1555711727 reap_dead start 2024-05-28T06:05:55.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.693+0000 7f735ba00640 1 -- 172.21.15.122:0/1555711727 shutdown_connections 2024-05-28T06:05:55.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.693+0000 7f735ba00640 1 -- 172.21.15.122:0/1555711727 >> 172.21.15.122:0/1555711727 conn(0x7f734c009fc0 msgr2=0x7f734c054290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:55.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.697+0000 7f735ba00640 1 -- 172.21.15.122:0/1555711727 shutdown_connections 2024-05-28T06:05:55.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.697+0000 7f735ba00640 1 -- 172.21.15.122:0/1555711727 wait complete. 2024-05-28T06:05:55.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.697+0000 7f7a99400640 1 -- 172.21.15.122:0/2850748242 shutdown_connections 2024-05-28T06:05:55.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.697+0000 7f7a99400640 1 -- 172.21.15.122:0/2850748242 wait complete. 2024-05-28T06:05:55.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.697+0000 7fe22a200640 1 -- 172.21.15.122:0/3450226381 --> [v2:172.21.15.122:6816/791000953,v1:172.21.15.122:6817/791000953] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe1fc002de0 con 0x7fe2000705d0 2024-05-28T06:05:55.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.697+0000 7fe21b400640 1 -- 172.21.15.122:0/3450226381 <== osd.2 v2:172.21.15.122:6816/791000953 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe1fc002de0 con 0x7fe2000705d0 2024-05-28T06:05:55.732 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.697+0000 7fe22a200640 1 -- 172.21.15.122:0/3450226381 >> [v2:172.21.15.122:6816/791000953,v1:172.21.15.122:6817/791000953] conn(0x7fe2000705d0 msgr2=0x7fe2000729f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.732 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.697+0000 7fe22a200640 1 --2- 172.21.15.122:0/3450226381 >> [v2:172.21.15.122:6816/791000953,v1:172.21.15.122:6817/791000953] conn(0x7fe2000705d0 0x7fe2000729f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.732 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.697+0000 7fe22a200640 1 -- 172.21.15.122:0/3450226381 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe2000683b0 msgr2=0x7fe20006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.732 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.701+0000 7fe22a200640 1 --2- 172.21.15.122:0/3450226381 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe2000683b0 0x7fe20006a870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe20c0ad000 tx=0x7fe20c008040 comp rx=0 tx=0).stop 2024-05-28T06:05:55.732 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.701+0000 7fe22a200640 1 -- 172.21.15.122:0/3450226381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2240b5560 msgr2=0x7fe2240c7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.732 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.701+0000 7fe22a200640 1 --2- 172.21.15.122:0/3450226381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2240b5560 0x7fe2240c7d20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe21400c7f0 tx=0x7fe21400ccb0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.732 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.701+0000 7fe223e00640 1 -- 172.21.15.122:0/3450226381 reap_dead start 2024-05-28T06:05:55.732 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.701+0000 7fe22a200640 1 -- 172.21.15.122:0/3450226381 shutdown_connections 2024-05-28T06:05:55.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.701+0000 7fe22a200640 1 -- 172.21.15.122:0/3450226381 >> 172.21.15.122:0/3450226381 conn(0x7fe224062610 msgr2=0x7fe22415ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:55.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.701+0000 7f21c2200640 1 -- 172.21.15.122:0/952127033 --> [v2:172.21.15.153:6809/2459238876,v1:172.21.15.153:6811/2459238876] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f21bc0cf600 con 0x7f219c070580 2024-05-28T06:05:55.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.701+0000 7fe22a200640 1 -- 172.21.15.122:0/3450226381 shutdown_connections 2024-05-28T06:05:55.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.701+0000 7fe22a200640 1 -- 172.21.15.122:0/3450226381 wait complete. 2024-05-28T06:05:55.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.701+0000 7f2fa9600640 1 -- 172.21.15.122:0/2950681575 --> [v2:172.21.15.122:6822/1935505897,v1:172.21.15.122:6824/1935505897] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2f9c009310 con 0x7f2f84070650 2024-05-28T06:05:55.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.701+0000 7f21b3400640 1 -- 172.21.15.122:0/952127033 <== osd.5 v2:172.21.15.153:6809/2459238876 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f21bc0cf600 con 0x7f219c070580 2024-05-28T06:05:55.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.701+0000 7fb226000640 1 -- 172.21.15.122:0/1877849421 --> [v2:172.21.15.153:6824/3872438562,v1:172.21.15.153:6825/3872438562] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb220160f60 con 0x7fb200070570 2024-05-28T06:05:55.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.701+0000 7f2f9aa00640 1 -- 172.21.15.122:0/2950681575 <== osd.3 v2:172.21.15.122:6822/1935505897 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2f9c009310 con 0x7f2f84070650 2024-05-28T06:05:55.735 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.701+0000 7f21c2200640 1 -- 172.21.15.122:0/952127033 >> [v2:172.21.15.153:6809/2459238876,v1:172.21.15.153:6811/2459238876] conn(0x7f219c070580 msgr2=0x7f219c0729a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.735 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.701+0000 7f21c2200640 1 --2- 172.21.15.122:0/952127033 >> [v2:172.21.15.153:6809/2459238876,v1:172.21.15.153:6811/2459238876] conn(0x7f219c070580 0x7f219c0729a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.735 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.701+0000 7f7d5ea00640 1 -- 172.21.15.122:0/3950315418 --> [v2:172.21.15.153:6808/194393677,v1:172.21.15.153:6810/194393677] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7d580cd3e0 con 0x7f7d380705a0 2024-05-28T06:05:55.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f21c2200640 1 -- 172.21.15.122:0/952127033 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f219c068380 msgr2=0x7f219c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f21c2200640 1 --2- 172.21.15.122:0/952127033 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f219c068380 0x7f219c06a840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f21ac006fd0 tx=0x7f21ac008040 comp rx=0 tx=0).stop 2024-05-28T06:05:55.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7fb217400640 1 -- 172.21.15.122:0/1877849421 <== osd.4 v2:172.21.15.153:6824/3872438562 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb220160f60 con 0x7fb200070570 2024-05-28T06:05:55.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f21c2200640 1 -- 172.21.15.122:0/952127033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21bc15d7a0 msgr2=0x7f21bc0aae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f21c2200640 1 --2- 172.21.15.122:0/952127033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21bc15d7a0 0x7f21bc0aae90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f21b400c740 tx=0x7f21b400cc00 comp rx=0 tx=0).stop 2024-05-28T06:05:55.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f7d4fe00640 1 -- 172.21.15.122:0/3950315418 <== osd.6 v2:172.21.15.153:6808/194393677 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7d580cd3e0 con 0x7f7d380705a0 2024-05-28T06:05:55.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f21bbe00640 1 -- 172.21.15.122:0/952127033 reap_dead start 2024-05-28T06:05:55.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f2fa9600640 1 -- 172.21.15.122:0/2950681575 >> [v2:172.21.15.122:6822/1935505897,v1:172.21.15.122:6824/1935505897] conn(0x7f2f84070650 msgr2=0x7f2f84072a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f2fa9600640 1 --2- 172.21.15.122:0/2950681575 >> [v2:172.21.15.122:6822/1935505897,v1:172.21.15.122:6824/1935505897] conn(0x7f2f84070650 0x7f2f84072a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f2fa9600640 1 -- 172.21.15.122:0/2950681575 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2f840683d0 msgr2=0x7f2f8406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f2fa9600640 1 --2- 172.21.15.122:0/2950681575 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2f840683d0 0x7f2f8406a890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40743d0 tx=0x7f2fa406f040 comp rx=0 tx=0).stop 2024-05-28T06:05:55.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f2fa9600640 1 -- 172.21.15.122:0/2950681575 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f880051d0 msgr2=0x7f2f9c009790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f2fa9600640 1 --2- 172.21.15.122:0/2950681575 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2f880051d0 0x7f2f9c009790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2f94007fd0 tx=0x7f2f9400cc00 comp rx=0 tx=0).stop 2024-05-28T06:05:55.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f2fa3400640 1 -- 172.21.15.122:0/2950681575 reap_dead start 2024-05-28T06:05:55.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f21c2200640 1 -- 172.21.15.122:0/952127033 shutdown_connections 2024-05-28T06:05:55.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f21c2200640 1 -- 172.21.15.122:0/952127033 >> 172.21.15.122:0/952127033 conn(0x7f21bc0b3170 msgr2=0x7f21bc0cd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:55.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f7d5ea00640 1 -- 172.21.15.122:0/3950315418 >> [v2:172.21.15.153:6808/194393677,v1:172.21.15.153:6810/194393677] conn(0x7f7d380705a0 msgr2=0x7f7d380729c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f7d5ea00640 1 --2- 172.21.15.122:0/3950315418 >> [v2:172.21.15.153:6808/194393677,v1:172.21.15.153:6810/194393677] conn(0x7f7d380705a0 0x7f7d380729c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f21c2200640 1 -- 172.21.15.122:0/952127033 shutdown_connections 2024-05-28T06:05:55.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f21c2200640 1 -- 172.21.15.122:0/952127033 wait complete. 2024-05-28T06:05:55.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f2fa9600640 1 -- 172.21.15.122:0/2950681575 shutdown_connections 2024-05-28T06:05:55.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f2fa9600640 1 -- 172.21.15.122:0/2950681575 >> 172.21.15.122:0/2950681575 conn(0x7f2f9c056d10 msgr2=0x7f2f9c055b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:55.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f7d5ea00640 1 -- 172.21.15.122:0/3950315418 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7d38068380 msgr2=0x7f7d3806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f7d5ea00640 1 --2- 172.21.15.122:0/3950315418 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7d38068380 0x7f7d3806a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7d440b2000 tx=0x7f7d44008040 comp rx=0 tx=0).stop 2024-05-28T06:05:55.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f7d5ea00640 1 -- 172.21.15.122:0/3950315418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d58072360 msgr2=0x7f7d580a9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f7d5ea00640 1 --2- 172.21.15.122:0/3950315418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d58072360 0x7f7d580a9b00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000b9e0 tx=0x7f7d5000bea0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.705+0000 7f7d5ca00640 1 -- 172.21.15.122:0/3950315418 reap_dead start 2024-05-28T06:05:55.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.709+0000 7f2fa9600640 1 -- 172.21.15.122:0/2950681575 shutdown_connections 2024-05-28T06:05:55.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.709+0000 7fb226000640 1 -- 172.21.15.122:0/1877849421 >> [v2:172.21.15.153:6824/3872438562,v1:172.21.15.153:6825/3872438562] conn(0x7fb200070570 msgr2=0x7fb200072990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.709+0000 7fb226000640 1 --2- 172.21.15.122:0/1877849421 >> [v2:172.21.15.153:6824/3872438562,v1:172.21.15.153:6825/3872438562] conn(0x7fb200070570 0x7fb200072990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.709+0000 7f2fa9600640 1 -- 172.21.15.122:0/2950681575 wait complete. 2024-05-28T06:05:55.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.709+0000 7fb226000640 1 -- 172.21.15.122:0/1877849421 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb2000683d0 msgr2=0x7fb20006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.709+0000 7fb226000640 1 --2- 172.21.15.122:0/1877849421 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb2000683d0 0x7fb20006a890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb2180af000 tx=0x7fb2180a7070 comp rx=0 tx=0).stop 2024-05-28T06:05:55.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.709+0000 7fb226000640 1 -- 172.21.15.122:0/1877849421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2200d4140 msgr2=0x7fb2200ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.709+0000 7fb226000640 1 --2- 172.21.15.122:0/1877849421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2200d4140 0x7fb2200ccdb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00c3c0 tx=0x7fb20c00c880 comp rx=0 tx=0).stop 2024-05-28T06:05:55.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.709+0000 7fb21fe00640 1 -- 172.21.15.122:0/1877849421 reap_dead start 2024-05-28T06:05:55.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.709+0000 7fb226000640 1 -- 172.21.15.122:0/1877849421 shutdown_connections 2024-05-28T06:05:55.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.709+0000 7fb226000640 1 -- 172.21.15.122:0/1877849421 >> 172.21.15.122:0/1877849421 conn(0x7fb22006cc80 msgr2=0x7fb2200ca3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:55.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.709+0000 7f7d5ea00640 1 -- 172.21.15.122:0/3950315418 shutdown_connections 2024-05-28T06:05:55.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.709+0000 7f7d5ea00640 1 -- 172.21.15.122:0/3950315418 >> 172.21.15.122:0/3950315418 conn(0x7f7d580b3170 msgr2=0x7f7d5806e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:55.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.709+0000 7f8510400640 1 -- 172.21.15.122:0/2133876421 --> [v2:172.21.15.153:6800/23883170,v1:172.21.15.153:6801/23883170] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8508165a40 con 0x7f84e8070520 2024-05-28T06:05:55.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.709+0000 7f7d5ea00640 1 -- 172.21.15.122:0/3950315418 shutdown_connections 2024-05-28T06:05:55.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.713+0000 7f7d5ea00640 1 -- 172.21.15.122:0/3950315418 wait complete. 2024-05-28T06:05:55.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.713+0000 7fb226000640 1 -- 172.21.15.122:0/1877849421 shutdown_connections 2024-05-28T06:05:55.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.713+0000 7fb226000640 1 -- 172.21.15.122:0/1877849421 wait complete. 2024-05-28T06:05:55.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.713+0000 7f8505600640 1 -- 172.21.15.122:0/2133876421 <== osd.7 v2:172.21.15.153:6800/23883170 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8508165a40 con 0x7f84e8070520 2024-05-28T06:05:55.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.717+0000 7f8510400640 1 -- 172.21.15.122:0/2133876421 >> [v2:172.21.15.153:6800/23883170,v1:172.21.15.153:6801/23883170] conn(0x7f84e8070520 msgr2=0x7f84e8072940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.717+0000 7f8510400640 1 --2- 172.21.15.122:0/2133876421 >> [v2:172.21.15.153:6800/23883170,v1:172.21.15.153:6801/23883170] conn(0x7f84e8070520 0x7f84e8072940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.717+0000 7f8510400640 1 -- 172.21.15.122:0/2133876421 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f84e8068380 msgr2=0x7f84e806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.717+0000 7f8510400640 1 --2- 172.21.15.122:0/2133876421 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f84e8068380 0x7f84e806a840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0af000 tx=0x7f84fc0a7000 comp rx=0 tx=0).stop 2024-05-28T06:05:55.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.717+0000 7f8510400640 1 -- 172.21.15.122:0/2133876421 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f850815c7a0 msgr2=0x7f85081609d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.717+0000 7f8510400640 1 --2- 172.21.15.122:0/2133876421 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f850815c7a0 0x7f85081609d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f850000c730 tx=0x7f850000cbf0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.717+0000 7f850e400640 1 -- 172.21.15.122:0/2133876421 reap_dead start 2024-05-28T06:05:55.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.721+0000 7f8510400640 1 -- 172.21.15.122:0/2133876421 shutdown_connections 2024-05-28T06:05:55.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.721+0000 7f8510400640 1 -- 172.21.15.122:0/2133876421 >> 172.21.15.122:0/2133876421 conn(0x7f8508062a40 msgr2=0x7f8508141f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:55.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.721+0000 7f8510400640 1 -- 172.21.15.122:0/2133876421 shutdown_connections 2024-05-28T06:05:55.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.721+0000 7f8510400640 1 -- 172.21.15.122:0/2133876421 wait complete. 2024-05-28T06:05:55.747 INFO:teuthology.orchestra.run.smithi122.stdout:55834574854 2024-05-28T06:05:55.747 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-28T06:05:55.748 INFO:teuthology.orchestra.run.smithi122.stdout:55834574855 2024-05-28T06:05:55.748 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-28T06:05:55.749 INFO:teuthology.orchestra.run.smithi122.stdout:55834574855 2024-05-28T06:05:55.749 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-28T06:05:55.750 INFO:teuthology.orchestra.run.smithi122.stdout:55834574854 2024-05-28T06:05:55.751 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-28T06:05:55.756 INFO:teuthology.orchestra.run.smithi122.stdout:55834574856 2024-05-28T06:05:55.756 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-28T06:05:55.758 INFO:teuthology.orchestra.run.smithi122.stdout:55834574855 2024-05-28T06:05:55.758 INFO:teuthology.orchestra.run.smithi122.stdout:55834574855 2024-05-28T06:05:55.759 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-28T06:05:55.759 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-28T06:05:55.761 INFO:teuthology.orchestra.run.smithi122.stdout:55834574853 2024-05-28T06:05:55.761 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-28T06:05:55.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.957+0000 7f918fe00640 1 Processor -- start 2024-05-28T06:05:55.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.957+0000 7f918fe00640 1 -- start start 2024-05-28T06:05:55.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.961+0000 7f918fe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f91880cff10 0x7f91880b2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.961+0000 7f918d400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f9188144100 0x7f91880ce050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38526/0 (socket says 172.21.15.122:38526) 2024-05-28T06:05:55.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.961+0000 7f918d400640 1 -- 172.21.15.122:0/3589421869 learned_addr learned my addr 172.21.15.122:0/3589421869 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:55.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.961+0000 7f918ca00640 1 --2- 172.21.15.122:0/3589421869 >> v2:172.21.15.153:3300/0 conn(0x7f91880cff10 0x7f91880b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.961+0000 7f918fe00640 1 -- 172.21.15.122:0/3589421869 --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91880cee20 con 0x7f9188144100 2024-05-28T06:05:55.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.961+0000 7f918fe00640 1 -- 172.21.15.122:0/3589421869 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91880b3660 con 0x7f91880b2c80 2024-05-28T06:05:55.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f918fe00640 1 -- 172.21.15.122:0/3589421869 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f91880ce860 con 0x7f91880cff10 2024-05-28T06:05:55.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f9187e00640 1 -- 172.21.15.122:0/3589421869 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1052420204 0 0) 0x7f91880cee20 con 0x7f9188144100 2024-05-28T06:05:55.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f9187e00640 1 -- 172.21.15.122:0/3589421869 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9170005740 con 0x7f9188144100 2024-05-28T06:05:55.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f9187e00640 1 -- 172.21.15.122:0/3589421869 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1310155778 0 0) 0x7f91880b3660 con 0x7f91880b2c80 2024-05-28T06:05:55.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f9187e00640 1 -- 172.21.15.122:0/3589421869 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91880cee20 con 0x7f91880b2c80 2024-05-28T06:05:55.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f9907200640 1 Processor -- start 2024-05-28T06:05:55.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f0baa800640 1 Processor -- start 2024-05-28T06:05:55.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f9187e00640 1 -- 172.21.15.122:0/3589421869 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 316110664 0 0) 0x7f91880cee20 con 0x7f91880b2c80 2024-05-28T06:05:55.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f9907200640 1 -- start start 2024-05-28T06:05:55.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f9187e00640 1 -- 172.21.15.122:0/3589421869 >> v2:172.21.15.153:3300/0 conn(0x7f91880cff10 msgr2=0x7f91880b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:55.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f9187e00640 1 --2- 172.21.15.122:0/3589421869 >> v2:172.21.15.153:3300/0 conn(0x7f91880cff10 0x7f91880b2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f9187e00640 1 -- 172.21.15.122:0/3589421869 >> v1:172.21.15.122:6789/0 conn(0x7f9188144100 legacy=0x7f91880ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f9187e00640 1 -- 172.21.15.122:0/3589421869 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91880ceb40 con 0x7f91880b2c80 2024-05-28T06:05:55.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f9187e00640 1 -- 172.21.15.122:0/3589421869 <== mon.1 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f9180001a00 con 0x7f91880b2c80 2024-05-28T06:05:55.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f9187e00640 1 -- 172.21.15.122:0/3589421869 >> v1:172.21.15.153:6789/0 conn(0x7f91880b2c80 legacy=0x7f91880b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f9187e00640 1 --2- 172.21.15.122:0/3589421869 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9170006dc0 0x7f91700071c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f9187e00640 1 --2- 172.21.15.122:0/3589421869 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91700059c0 0x7f9170005e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f9187e00640 1 --2- 172.21.15.122:0/3589421869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9170006380 0x7f917000ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f9187e00640 1 -- 172.21.15.122:0/3589421869 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f91880ce860 con 0x7f91700059c0 2024-05-28T06:05:55.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f9187e00640 1 -- 172.21.15.122:0/3589421869 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9170010520 con 0x7f9170006380 2024-05-28T06:05:55.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f9187e00640 1 -- 172.21.15.122:0/3589421869 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9170010720 con 0x7f9170006dc0 2024-05-28T06:05:55.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f918d400640 1 --2- 172.21.15.122:0/3589421869 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9170006dc0 0x7f91700071c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f918de00640 1 --2- 172.21.15.122:0/3589421869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9170006380 0x7f917000ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f918ca00640 1 --2- 172.21.15.122:0/3589421869 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91700059c0 0x7f9170005e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f918d400640 1 -- 172.21.15.122:0/3589421869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9170006380 msgr2=0x7f917000ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:55.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f918d400640 1 --2- 172.21.15.122:0/3589421869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9170006380 0x7f917000ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f918d400640 1 -- 172.21.15.122:0/3589421869 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91700059c0 msgr2=0x7f9170005e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:55.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f918d400640 1 --2- 172.21.15.122:0/3589421869 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91700059c0 0x7f9170005e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f918d400640 1 -- 172.21.15.122:0/3589421869 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91880ceb40 con 0x7f9170006dc0 2024-05-28T06:05:55.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f918de00640 1 --2- 172.21.15.122:0/3589421869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9170006380 0x7f917000ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:05:55.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f918de00640 1 -- 172.21.15.122:0/3589421869 reap_dead start 2024-05-28T06:05:55.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f0baa800640 1 -- start start 2024-05-28T06:05:55.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f6b2c600640 1 Processor -- start 2024-05-28T06:05:55.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.965+0000 7f6b2c600640 1 -- start start 2024-05-28T06:05:55.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f0baa800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0b9c0501b0 0x7f0b9c006540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f9907200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9900047c20 0x7f99000eb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f9907200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9900034220 con 0x7f9900033e40 2024-05-28T06:05:55.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f9907200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f990004fa30 con 0x7f9900005ea0 2024-05-28T06:05:55.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f9907200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9900050210 con 0x7f9900047c20 2024-05-28T06:05:55.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f9905e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f9900033e40 0x7f99000eb180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38536/0 (socket says 172.21.15.122:38536) 2024-05-28T06:05:55.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f9905e00640 1 -- 172.21.15.122:0/2930488676 learned_addr learned my addr 172.21.15.122:0/2930488676 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:55.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f0ba9400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0b9c0df2b0 0x7f0b9c04faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:36602/0 (socket says 172.21.15.122:36602) 2024-05-28T06:05:55.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f0baa800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b9c00aae0 0x7f0b9c007310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f0baa800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b9c054120 con 0x7f0b9c0df2b0 2024-05-28T06:05:55.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f0baa800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f0b9c0df690 con 0x7f0b9c0501b0 2024-05-28T06:05:55.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f0baa800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0b9c054400 con 0x7f0b9c00aae0 2024-05-28T06:05:55.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f0ba9400640 1 -- 172.21.15.122:0/3110822733 learned_addr learned my addr 172.21.15.122:0/3110822733 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:55.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f0ba9e00640 1 --2- 172.21.15.122:0/3110822733 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b9c00aae0 0x7f0b9c007310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f0ba3e00640 1 -- 172.21.15.122:0/3110822733 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1062133721 0 0) 0x7f0b9c054120 con 0x7f0b9c0df2b0 2024-05-28T06:05:55.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f0ba3e00640 1 -- 172.21.15.122:0/3110822733 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b8c003530 con 0x7f0b9c0df2b0 2024-05-28T06:05:55.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f9905400640 1 --2- 172.21.15.122:0/2930488676 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9900047c20 0x7f99000eb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f9904a00640 1 -- 172.21.15.122:0/2930488676 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2507883696 0 0) 0x7f990004fa30 con 0x7f9900005ea0 2024-05-28T06:05:55.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f9904a00640 1 -- 172.21.15.122:0/2930488676 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98ec003530 con 0x7f9900005ea0 2024-05-28T06:05:55.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f9905400640 1 -- 172.21.15.122:0/2930488676 >> v1:172.21.15.153:6789/0 conn(0x7f9900005ea0 legacy=0x7f99000062f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f9905400640 1 -- 172.21.15.122:0/2930488676 >> v1:172.21.15.122:6789/0 conn(0x7f9900033e40 legacy=0x7f99000eb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f9905400640 1 -- 172.21.15.122:0/2930488676 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990004f2e0 con 0x7f9900047c20 2024-05-28T06:05:55.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f6b2c600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6b1c0e00d0 0x7f6b1c038e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f6b2c600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6b1c033a10 0x7f6b1c039370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f6b29c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6b1c0e00d0 0x7f6b1c038e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f6b29c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6b1c0e00d0 0x7f6b1c038e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41328/0 (socket says 172.21.15.122:41328) 2024-05-28T06:05:55.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f6b29c00640 1 -- 172.21.15.122:0/2142695410 learned_addr learned my addr 172.21.15.122:0/2142695410 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:55.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f6b29200640 1 --2- 172.21.15.122:0/2142695410 >> v2:172.21.15.153:3300/0 conn(0x7f6b1c033a10 0x7f6b1c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f6b2c600640 1 -- 172.21.15.122:0/2142695410 --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b1c039b00 con 0x7f6b1c03a610 2024-05-28T06:05:55.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f6b2c600640 1 -- 172.21.15.122:0/2142695410 --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f6b1c03a110 con 0x7f6b1c0e00d0 2024-05-28T06:05:55.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f6b2c600640 1 -- 172.21.15.122:0/2142695410 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6b1c0398b0 con 0x7f6b1c033a10 2024-05-28T06:05:55.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.973+0000 7f6b29200640 1 -- 172.21.15.122:0/2142695410 >> v2:172.21.15.122:3300/0 conn(0x7f6b1c0e00d0 msgr2=0x7f6b1c038e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:55.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.973+0000 7f6b29200640 1 --2- 172.21.15.122:0/2142695410 >> v2:172.21.15.122:3300/0 conn(0x7f6b1c0e00d0 0x7f6b1c038e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f0ba8a00640 1 --2- 172.21.15.122:0/3110822733 >> v2:172.21.15.153:3300/0 conn(0x7f0b9c0501b0 0x7f0b9c006540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f0ba9e00640 1 -- 172.21.15.122:0/3110822733 >> v2:172.21.15.153:3300/0 conn(0x7f0b9c0501b0 msgr2=0x7f0b9c006540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:55.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f0ba9e00640 1 --2- 172.21.15.122:0/3110822733 >> v2:172.21.15.153:3300/0 conn(0x7f0b9c0501b0 0x7f0b9c006540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f0ba9e00640 1 -- 172.21.15.122:0/3110822733 >> v1:172.21.15.153:6789/0 conn(0x7f0b9c0df2b0 legacy=0x7f0b9c04faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.969+0000 7f0ba9e00640 1 -- 172.21.15.122:0/3110822733 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9c0546e0 con 0x7f0b9c00aae0 2024-05-28T06:05:55.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.973+0000 7f6b29200640 1 -- 172.21.15.122:0/2142695410 >> v1:172.21.15.122:6789/0 conn(0x7f6b1c03a610 legacy=0x7f6b1c0526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.973+0000 7f0ba9e00640 1 --2- 172.21.15.122:0/3110822733 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b9c00aae0 0x7f0b9c007310 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4000b70 tx=0x7f0ba40a0810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6022d3c39c6febde server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.973+0000 7f0ba3e00640 1 -- 172.21.15.122:0/3110822733 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4136070 con 0x7f0b9c00aae0 2024-05-28T06:05:55.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.973+0000 7f0ba3e00640 1 -- 172.21.15.122:0/3110822733 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba4131680 con 0x7f0b9c00aae0 2024-05-28T06:05:55.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.973+0000 7f0ba3e00640 1 -- 172.21.15.122:0/3110822733 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4131ad0 con 0x7f0b9c00aae0 2024-05-28T06:05:55.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.973+0000 7f918d400640 1 --2- 172.21.15.122:0/3589421869 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9170006dc0 0x7f91700071c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f917c001a30 tx=0x7f917c01c630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99858483336a0188 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.973+0000 7f9187e00640 1 -- 172.21.15.122:0/3589421869 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c001620 con 0x7f9170006dc0 2024-05-28T06:05:55.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.973+0000 7f9187e00640 1 -- 172.21.15.122:0/3589421869 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f917c004ab0 con 0x7f9170006dc0 2024-05-28T06:05:55.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.973+0000 7f9187e00640 1 -- 172.21.15.122:0/3589421869 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c007070 con 0x7f9170006dc0 2024-05-28T06:05:55.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.973+0000 7f918fe00640 1 -- 172.21.15.122:0/3589421869 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9170006dc0 msgr2=0x7f91700071c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.973+0000 7f918fe00640 1 --2- 172.21.15.122:0/3589421869 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9170006dc0 0x7f91700071c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f917c001a30 tx=0x7f917c01c630 comp rx=0 tx=0).stop 2024-05-28T06:05:55.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.973+0000 7f6b29200640 1 -- 172.21.15.122:0/2142695410 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b1c034000 con 0x7f6b1c033a10 2024-05-28T06:05:55.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f918fe00640 1 -- 172.21.15.122:0/3589421869 shutdown_connections 2024-05-28T06:05:55.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f918fe00640 1 --2- 172.21.15.122:0/3589421869 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9170006dc0 0x7f91700071c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f918fe00640 1 -- 172.21.15.122:0/3589421869 >> 172.21.15.122:0/3589421869 conn(0x7f918806df90 msgr2=0x7f918806e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:55.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f918fe00640 1 -- 172.21.15.122:0/3589421869 shutdown_connections 2024-05-28T06:05:55.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f9905400640 1 --2- 172.21.15.122:0/2930488676 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9900047c20 0x7f99000eb890 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f98f40097f0 tx=0x7f98f401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8e03f44913511b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f0baa800640 1 -- 172.21.15.122:0/3110822733 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b9c00aae0 msgr2=0x7f0b9c007310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f9904a00640 1 -- 172.21.15.122:0/2930488676 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f40b2070 con 0x7f9900047c20 2024-05-28T06:05:55.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f9904a00640 1 -- 172.21.15.122:0/2930488676 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f40a9070 con 0x7f9900047c20 2024-05-28T06:05:55.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f9904a00640 1 -- 172.21.15.122:0/2930488676 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f40ad880 con 0x7f9900047c20 2024-05-28T06:05:55.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f0baa800640 1 --2- 172.21.15.122:0/3110822733 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b9c00aae0 0x7f0b9c007310 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4000b70 tx=0x7f0ba40a0810 comp rx=0 tx=0).stop 2024-05-28T06:05:55.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f0baa800640 1 -- 172.21.15.122:0/3110822733 shutdown_connections 2024-05-28T06:05:55.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f918fe00640 1 -- 172.21.15.122:0/3589421869 wait complete. 2024-05-28T06:05:55.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f0baa800640 1 --2- 172.21.15.122:0/3110822733 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b9c00aae0 0x7f0b9c007310 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f0baa800640 1 --2- 172.21.15.122:0/3110822733 >> v2:172.21.15.153:3300/0 conn(0x7f0b9c0501b0 0x7f0b9c006540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f0baa800640 1 -- 172.21.15.122:0/3110822733 >> 172.21.15.122:0/3110822733 conn(0x7f0b9c009fc0 msgr2=0x7f0b9c00a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:55.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f0baa800640 1 -- 172.21.15.122:0/3110822733 shutdown_connections 2024-05-28T06:05:55.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f0baa800640 1 -- 172.21.15.122:0/3110822733 wait complete. 2024-05-28T06:05:55.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f9907200640 1 -- 172.21.15.122:0/2930488676 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9900047c20 msgr2=0x7f99000eb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f9907200640 1 --2- 172.21.15.122:0/2930488676 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9900047c20 0x7f99000eb890 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f98f40097f0 tx=0x7f98f401c3c0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f6b29200640 1 --2- 172.21.15.122:0/2142695410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b1c033a10 0x7f6b1c039370 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00dad0 tx=0x7f6b1801cee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea0765186ee284c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f9907200640 1 -- 172.21.15.122:0/2930488676 shutdown_connections 2024-05-28T06:05:55.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f9907200640 1 --2- 172.21.15.122:0/2930488676 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9900047c20 0x7f99000eb890 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f9907200640 1 -- 172.21.15.122:0/2930488676 >> 172.21.15.122:0/2930488676 conn(0x7f9900009fc0 msgr2=0x7f990000a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:55.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f9907200640 1 -- 172.21.15.122:0/2930488676 shutdown_connections 2024-05-28T06:05:55.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f918fe00640 1 Processor -- start 2024-05-28T06:05:55.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f918fe00640 1 -- start start 2024-05-28T06:05:55.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f6b23e00640 1 -- 172.21.15.122:0/2142695410 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b180b1070 con 0x7f6b1c033a10 2024-05-28T06:05:55.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f6b23e00640 1 -- 172.21.15.122:0/2142695410 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b180ac5f0 con 0x7f6b1c033a10 2024-05-28T06:05:55.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f6b23e00640 1 -- 172.21.15.122:0/2142695410 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b180ac9c0 con 0x7f6b1c033a10 2024-05-28T06:05:55.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f6b2c600640 1 -- 172.21.15.122:0/2142695410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b1c033a10 msgr2=0x7f6b1c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f6b2c600640 1 --2- 172.21.15.122:0/2142695410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b1c033a10 0x7f6b1c039370 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00dad0 tx=0x7f6b1801cee0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.977+0000 7f9907200640 1 -- 172.21.15.122:0/2930488676 wait complete. 2024-05-28T06:05:55.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f0baa800640 1 Processor -- start 2024-05-28T06:05:55.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f6b2c600640 1 -- 172.21.15.122:0/2142695410 shutdown_connections 2024-05-28T06:05:55.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f9907200640 1 Processor -- start 2024-05-28T06:05:55.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f918fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9170006dc0 0x7f9188156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f6b2c600640 1 --2- 172.21.15.122:0/2142695410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b1c033a10 0x7f6b1c039370 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f6b2c600640 1 --2- 172.21.15.122:0/2142695410 >> v2:172.21.15.122:3300/0 conn(0x7f6b1c0e00d0 0x7f6b1c038e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f6b2c600640 1 -- 172.21.15.122:0/2142695410 >> 172.21.15.122:0/2142695410 conn(0x7f6b1c054b00 msgr2=0x7f6b1c054f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:55.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f918fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f918815d370 0x7f918813fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f9907200640 1 -- start start 2024-05-28T06:05:55.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f0baa800640 1 -- start start 2024-05-28T06:05:55.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f918d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9170006dc0 0x7f9188156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f918ca00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f918815d370 0x7f918813fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f918ca00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f918815d370 0x7f918813fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41344/0 (socket says 172.21.15.122:41344) 2024-05-28T06:05:55.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f918fe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91881f3590 0x7f91881f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f918fe00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f91880ce260 con 0x7f918815d370 2024-05-28T06:05:55.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f918fe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f91880b30f0 con 0x7f9170006dc0 2024-05-28T06:05:55.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f918fe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f91880ce3e0 con 0x7f91881f3590 2024-05-28T06:05:55.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f918d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9170006dc0 0x7f9188156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:37296/0 (socket says 172.21.15.122:37296) 2024-05-28T06:05:55.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f918d400640 1 -- 172.21.15.122:0/3125991998 learned_addr learned my addr 172.21.15.122:0/3125991998 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:55.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f918de00640 1 --2- 172.21.15.122:0/3125991998 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91881f3590 0x7f91881f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f918ca00640 1 -- 172.21.15.122:0/3125991998 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91881f3590 msgr2=0x7f91881f3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f918ca00640 1 --2- 172.21.15.122:0/3125991998 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91881f3590 0x7f91881f3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f918ca00640 1 -- 172.21.15.122:0/3125991998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9170006dc0 msgr2=0x7f9188156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f918ca00640 1 --2- 172.21.15.122:0/3125991998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9170006dc0 0x7f9188156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f918ca00640 1 -- 172.21.15.122:0/3125991998 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91881400b0 con 0x7f918815d370 2024-05-28T06:05:55.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f0baa800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b9c00aae0 0x7f0b9c04e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f0baa800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b9c0501b0 0x7f0b9c0d3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.981+0000 7f0baa800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b9c0df2b0 0x7f0b9c0daa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f0baa800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9c04f7e0 con 0x7f0b9c0501b0 2024-05-28T06:05:55.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f0baa800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9c04f660 con 0x7f0b9c00aae0 2024-05-28T06:05:55.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f0baa800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0b9c0ec050 con 0x7f0b9c0df2b0 2024-05-28T06:05:55.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f0ba9400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b9c00aae0 0x7f0b9c04e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f9907200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9900005ea0 0x7f9900185a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f0ba8a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b9c0501b0 0x7f0b9c0d3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f0ba9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b9c0df2b0 0x7f0b9c0daa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f0ba9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b9c0df2b0 0x7f0b9c0daa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:50302/0 (socket says 172.21.15.122:50302) 2024-05-28T06:05:55.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f0ba9e00640 1 -- 172.21.15.122:0/2418107373 learned_addr learned my addr 172.21.15.122:0/2418107373 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:55.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f9907200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9900033e40 0x7f99000e8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f9907200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9900047c20 0x7f99000dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f918ca00640 1 --2- 172.21.15.122:0/3125991998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f918815d370 0x7f918813fb70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f91740107e0 tx=0x7f9174010ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f0ba9e00640 1 -- 172.21.15.122:0/2418107373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b9c00aae0 msgr2=0x7f0b9c04e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f0ba9e00640 1 --2- 172.21.15.122:0/2418107373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b9c00aae0 0x7f0b9c04e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f0ba9e00640 1 -- 172.21.15.122:0/2418107373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b9c0501b0 msgr2=0x7f0b9c0d3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f0ba9e00640 1 --2- 172.21.15.122:0/2418107373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b9c0501b0 0x7f0b9c0d3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f0ba9e00640 1 -- 172.21.15.122:0/2418107373 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9c04d520 con 0x7f0b9c0df2b0 2024-05-28T06:05:55.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f9905e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9900005ea0 0x7f9900185a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f9905e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9900005ea0 0x7f9900185a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:37318/0 (socket says 172.21.15.122:37318) 2024-05-28T06:05:55.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f9905e00640 1 -- 172.21.15.122:0/4045422199 learned_addr learned my addr 172.21.15.122:0/4045422199 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:55.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f9907200640 1 -- 172.21.15.122:0/4045422199 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f990004f090 con 0x7f9900033e40 2024-05-28T06:05:55.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f9907200640 1 -- 172.21.15.122:0/4045422199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f990004fd80 con 0x7f9900005ea0 2024-05-28T06:05:55.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f9907200640 1 -- 172.21.15.122:0/4045422199 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f99000482c0 con 0x7f9900047c20 2024-05-28T06:05:55.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f9906800640 1 --2- 172.21.15.122:0/4045422199 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9900047c20 0x7f99000dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:55.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f9185600640 1 -- 172.21.15.122:0/3125991998 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917401c070 con 0x7f918815d370 2024-05-28T06:05:55.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f9185600640 1 -- 172.21.15.122:0/3125991998 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9174004440 con 0x7f918815d370 2024-05-28T06:05:55.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f9185600640 1 -- 172.21.15.122:0/3125991998 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91740098a0 con 0x7f918815d370 2024-05-28T06:05:55.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f0ba9e00640 1 --2- 172.21.15.122:0/2418107373 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b9c0df2b0 0x7f0b9c0daa30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0ba402db60 tx=0x7f0ba409f0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f0ba1600640 1 -- 172.21.15.122:0/2418107373 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4140020 con 0x7f0b9c0df2b0 2024-05-28T06:05:55.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f0ba1600640 1 -- 172.21.15.122:0/2418107373 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba4131a30 con 0x7f0b9c0df2b0 2024-05-28T06:05:55.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f0ba1600640 1 -- 172.21.15.122:0/2418107373 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4136040 con 0x7f0b9c0df2b0 2024-05-28T06:05:55.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f9905e00640 1 -- 172.21.15.122:0/4045422199 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9900047c20 msgr2=0x7f99000dd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f9905e00640 1 --2- 172.21.15.122:0/4045422199 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9900047c20 0x7f99000dd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f9905e00640 1 -- 172.21.15.122:0/4045422199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9900033e40 msgr2=0x7f99000e8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:55.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f9905e00640 1 --2- 172.21.15.122:0/4045422199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9900033e40 0x7f99000e8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:55.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f9905e00640 1 -- 172.21.15.122:0/4045422199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99000e9940 con 0x7f9900005ea0 2024-05-28T06:05:55.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f0baa800640 1 -- 172.21.15.122:0/2418107373 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b9c04d800 con 0x7f0b9c0df2b0 2024-05-28T06:05:55.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f0baa800640 1 -- 172.21.15.122:0/2418107373 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b9c04ddc0 con 0x7f0b9c0df2b0 2024-05-28T06:05:55.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f6b2c600640 1 -- 172.21.15.122:0/2142695410 shutdown_connections 2024-05-28T06:05:55.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f6b2c600640 1 -- 172.21.15.122:0/2142695410 wait complete. 2024-05-28T06:05:55.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f9905e00640 1 --2- 172.21.15.122:0/4045422199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9900005ea0 0x7f9900185a30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f98f800e410 tx=0x7f98f800e8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:55.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.989+0000 7f98fe000640 1 -- 172.21.15.122:0/4045422199 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8019070 con 0x7f9900005ea0 2024-05-28T06:05:55.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.989+0000 7f98fe000640 1 -- 172.21.15.122:0/4045422199 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f8007d00 con 0x7f9900005ea0 2024-05-28T06:05:55.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.989+0000 7f98fe000640 1 -- 172.21.15.122:0/4045422199 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8009270 con 0x7f9900005ea0 2024-05-28T06:05:55.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.989+0000 7f9907200640 1 -- 172.21.15.122:0/4045422199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99000e8d30 con 0x7f9900005ea0 2024-05-28T06:05:55.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.989+0000 7f9907200640 1 -- 172.21.15.122:0/4045422199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99000e92f0 con 0x7f9900005ea0 2024-05-28T06:05:55.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f918fe00640 1 -- 172.21.15.122:0/3125991998 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9188140320 con 0x7f918815d370 2024-05-28T06:05:55.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.985+0000 7f918fe00640 1 -- 172.21.15.122:0/3125991998 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91881408e0 con 0x7f918815d370 2024-05-28T06:05:55.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.989+0000 7f0b96a00640 1 -- 172.21.15.122:0/2418107373 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b800052a0 con 0x7f0b9c0df2b0 2024-05-28T06:05:55.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.989+0000 7f6b2c600640 1 Processor -- start 2024-05-28T06:05:55.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.989+0000 7f6b2c600640 1 -- start start 2024-05-28T06:05:55.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.989+0000 7f0ba1600640 1 -- 172.21.15.122:0/2418107373 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0ba4143020 con 0x7f0b9c0df2b0 2024-05-28T06:05:55.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f0ba1600640 1 --2- 172.21.15.122:0/2418107373 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0b84068450 0x7f0b8406a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f6b2c600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b1c033a10 0x7f6b1c17f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.989+0000 7f9185600640 1 -- 172.21.15.122:0/3125991998 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f917401f070 con 0x7f918815d370 2024-05-28T06:05:55.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f6b2c600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b1c03a610 0x7f6b1c04e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f918fe00640 1 -- 172.21.15.122:0/3125991998 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9188075620 con 0x7f918815d370 2024-05-28T06:05:55.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f9185600640 1 --2- 172.21.15.122:0/3125991998 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9168068480 0x7f916806a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:55.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f9185600640 1 -- 172.21.15.122:0/3125991998 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9174086250 con 0x7f918815d370 2024-05-28T06:05:55.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f6b2c600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b1c0e00d0 0x7f6b1c0c7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f6b2c600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6b1c0ecc30 con 0x7f6b1c03a610 2024-05-28T06:05:56.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f6b2c600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6b1c0ecab0 con 0x7f6b1c0e00d0 2024-05-28T06:05:56.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f6b2c600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6b1c0ecdb0 con 0x7f6b1c033a10 2024-05-28T06:05:56.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f6b29200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b1c03a610 0x7f6b1c04e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f6b29200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b1c03a610 0x7f6b1c04e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41360/0 (socket says 172.21.15.122:41360) 2024-05-28T06:05:56.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f6b29200640 1 -- 172.21.15.122:0/2373478157 learned_addr learned my addr 172.21.15.122:0/2373478157 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:56.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f98fe000640 1 -- 172.21.15.122:0/4045422199 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f98f801c070 con 0x7f9900005ea0 2024-05-28T06:05:56.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f9907200640 1 -- 172.21.15.122:0/4045422199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98e00052a0 con 0x7f9900005ea0 2024-05-28T06:05:56.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f98fe000640 1 --2- 172.21.15.122:0/4045422199 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f98e80683d0 0x7f98e806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f6b29c00640 1 --2- 172.21.15.122:0/2373478157 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b1c033a10 0x7f6b1c17f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f6b2a600640 1 --2- 172.21.15.122:0/2373478157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b1c0e00d0 0x7f6b1c0c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f6b29200640 1 -- 172.21.15.122:0/2373478157 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b1c033a10 msgr2=0x7f6b1c17f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f6b29200640 1 --2- 172.21.15.122:0/2373478157 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b1c033a10 0x7f6b1c17f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f6b29200640 1 -- 172.21.15.122:0/2373478157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b1c0e00d0 msgr2=0x7f6b1c0c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f6b29200640 1 --2- 172.21.15.122:0/2373478157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b1c0e00d0 0x7f6b1c0c7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f6b29200640 1 -- 172.21.15.122:0/2373478157 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b1c04dae0 con 0x7f6b1c03a610 2024-05-28T06:05:56.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f98fe000640 1 -- 172.21.15.122:0/4045422199 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f98f8056ab0 con 0x7f9900005ea0 2024-05-28T06:05:56.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f6b29200640 1 --2- 172.21.15.122:0/2373478157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b1c03a610 0x7f6b1c04e580 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6b180af040 tx=0x7f6b18019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:56.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f9905400640 1 --2- 172.21.15.122:0/4045422199 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f98e80683d0 0x7f98e806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f918d400640 1 --2- 172.21.15.122:0/3125991998 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9168068480 0x7f916806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f0ba1600640 1 -- 172.21.15.122:0/2418107373 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0ba41a46b0 con 0x7f0b9c0df2b0 2024-05-28T06:05:56.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.993+0000 7f0ba9400640 1 --2- 172.21.15.122:0/2418107373 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0b84068450 0x7f0b8406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.997+0000 7f9905400640 1 --2- 172.21.15.122:0/4045422199 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f98e80683d0 0x7f98e806a890 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f98f40af000 tx=0x7f98f4004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:56.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.997+0000 7f0ba9400640 1 --2- 172.21.15.122:0/2418107373 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0b84068450 0x7f0b8406a910 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0b98005890 tx=0x7f0b98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:56.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:55.997+0000 7f918d400640 1 --2- 172.21.15.122:0/3125991998 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9168068480 0x7f916806a940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f917c01c670 tx=0x7f917c0af040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:56.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.001+0000 7f98fe000640 1 -- 172.21.15.122:0/4045422199 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f98f8058a10 con 0x7f9900005ea0 2024-05-28T06:05:56.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.001+0000 7f6b21600640 1 -- 172.21.15.122:0/2373478157 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b180b1040 con 0x7f6b1c03a610 2024-05-28T06:05:56.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.001+0000 7f6b2c600640 1 -- 172.21.15.122:0/2373478157 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b1c036840 con 0x7f6b1c03a610 2024-05-28T06:05:56.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.001+0000 7f6b2c600640 1 -- 172.21.15.122:0/2373478157 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b1c04dd80 con 0x7f6b1c03a610 2024-05-28T06:05:56.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.001+0000 7f0ba1600640 1 -- 172.21.15.122:0/2418107373 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0ba414a030 con 0x7f0b9c0df2b0 2024-05-28T06:05:56.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.001+0000 7f9185600640 1 -- 172.21.15.122:0/3125991998 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9174056230 con 0x7f918815d370 2024-05-28T06:05:56.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.001+0000 7f6b21600640 1 -- 172.21.15.122:0/2373478157 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b180ac530 con 0x7f6b1c03a610 2024-05-28T06:05:56.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.001+0000 7f6b21600640 1 -- 172.21.15.122:0/2373478157 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b180b9df0 con 0x7f6b1c03a610 2024-05-28T06:05:56.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.005+0000 7f6b2c600640 1 -- 172.21.15.122:0/2373478157 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b000052a0 con 0x7f6b1c03a610 2024-05-28T06:05:56.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.005+0000 7f6b21600640 1 -- 172.21.15.122:0/2373478157 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6b180c8060 con 0x7f6b1c03a610 2024-05-28T06:05:56.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.005+0000 7f6b21600640 1 --2- 172.21.15.122:0/2373478157 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6b04068380 0x7f6b0406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.005+0000 7f6b21600640 1 -- 172.21.15.122:0/2373478157 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6b181285f0 con 0x7f6b1c03a610 2024-05-28T06:05:56.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.005+0000 7f6b29c00640 1 --2- 172.21.15.122:0/2373478157 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6b04068380 0x7f6b0406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.009+0000 7f6b29c00640 1 --2- 172.21.15.122:0/2373478157 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6b04068380 0x7f6b0406a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000c900 tx=0x7f6b10008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:56.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.013+0000 7f6b21600640 1 -- 172.21.15.122:0/2373478157 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6b180a9070 con 0x7f6b1c03a610 2024-05-28T06:05:56.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.045+0000 7f9947200640 1 Processor -- start 2024-05-28T06:05:56.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.049+0000 7f9947200640 1 -- start start 2024-05-28T06:05:56.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.049+0000 7f9947200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9948160610 0x7f9948070860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.049+0000 7f9947200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9948167510 con 0x7f99480701e0 2024-05-28T06:05:56.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.049+0000 7f9947200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99480b4640 con 0x7f994806b990 2024-05-28T06:05:56.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.049+0000 7f9947200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f99481634c0 con 0x7f9948160610 2024-05-28T06:05:56.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.049+0000 7f9946800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f99480701e0 0x7f9948166e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38560/0 (socket says 172.21.15.122:38560) 2024-05-28T06:05:56.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.049+0000 7f9946800640 1 -- 172.21.15.122:0/592598518 learned_addr learned my addr 172.21.15.122:0/592598518 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:56.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.049+0000 7f9945e00640 1 --2- 172.21.15.122:0/592598518 >> v2:172.21.15.153:3300/0 conn(0x7f9948160610 0x7f9948070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.049+0000 7f9944a00640 1 -- 172.21.15.122:0/592598518 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3884740419 0 0) 0x7f9948167510 con 0x7f99480701e0 2024-05-28T06:05:56.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.049+0000 7f9944a00640 1 -- 172.21.15.122:0/592598518 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f992c003530 con 0x7f99480701e0 2024-05-28T06:05:56.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7f9944a00640 1 -- 172.21.15.122:0/592598518 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3712551085 0 0) 0x7f992c003530 con 0x7f99480701e0 2024-05-28T06:05:56.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7f9944a00640 1 -- 172.21.15.122:0/592598518 >> v2:172.21.15.153:3300/0 conn(0x7f9948160610 msgr2=0x7f9948070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:56.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7f9944a00640 1 --2- 172.21.15.122:0/592598518 >> v2:172.21.15.153:3300/0 conn(0x7f9948160610 0x7f9948070860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7f9944a00640 1 -- 172.21.15.122:0/592598518 >> v1:172.21.15.153:6789/0 conn(0x7f994806b990 legacy=0x7f99481666f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7f9944a00640 1 -- 172.21.15.122:0/592598518 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99481637a0 con 0x7f99480701e0 2024-05-28T06:05:56.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7f9944a00640 1 -- 172.21.15.122:0/592598518 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f9940001a00 con 0x7f99480701e0 2024-05-28T06:05:56.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7f9944a00640 1 -- 172.21.15.122:0/592598518 >> v1:172.21.15.122:6789/0 conn(0x7f99480701e0 legacy=0x7f9948166e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7f9944a00640 1 --2- 172.21.15.122:0/592598518 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f992c0039c0 0x7f992c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7f9944a00640 1 --2- 172.21.15.122:0/592598518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f992c004810 0x7f992c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7f9944a00640 1 --2- 172.21.15.122:0/592598518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f992c0052f0 0x7f992c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7f9944a00640 1 -- 172.21.15.122:0/592598518 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f99481634c0 con 0x7f992c004810 2024-05-28T06:05:56.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7f9944a00640 1 -- 172.21.15.122:0/592598518 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f992c00c1c0 con 0x7f992c0052f0 2024-05-28T06:05:56.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7f9944a00640 1 -- 172.21.15.122:0/592598518 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f992c00c3c0 con 0x7f992c0039c0 2024-05-28T06:05:56.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7ff12bc00640 1 Processor -- start 2024-05-28T06:05:56.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7ff12bc00640 1 -- start start 2024-05-28T06:05:56.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7f9946800640 1 --2- 172.21.15.122:0/592598518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f992c0052f0 0x7f992c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7f9946800640 1 -- 172.21.15.122:0/592598518 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f992c0039c0 msgr2=0x7f992c003de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-28T06:05:56.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7f9946800640 1 --2- 172.21.15.122:0/592598518 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f992c0039c0 0x7f992c003de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7f9946800640 1 -- 172.21.15.122:0/592598518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f992c004810 msgr2=0x7f992c004c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-28T06:05:56.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7f9946800640 1 --2- 172.21.15.122:0/592598518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f992c004810 0x7f992c004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7f9946800640 1 -- 172.21.15.122:0/592598518 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992c003530 con 0x7f992c0052f0 2024-05-28T06:05:56.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7fbe5be00640 1 Processor -- start 2024-05-28T06:05:56.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7fbe5be00640 1 -- start start 2024-05-28T06:05:56.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.057+0000 7fbe5be00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbe54053820 0x7fbe54053c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7ff12bc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff124167420 0x7ff1240b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7ff12bc00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff1240b47f0 0x7ff1240ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7ff12bc00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff12414bf70 con 0x7ff12414bb90 2024-05-28T06:05:56.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7ff12bc00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff12406e6a0 con 0x7ff1240b47f0 2024-05-28T06:05:56.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7ff12bc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff124167880 con 0x7ff124167420 2024-05-28T06:05:56.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7ff129200640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff12414bb90 0x7ff12406df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:36620/0 (socket says 172.21.15.122:36620) 2024-05-28T06:05:56.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7ff129200640 1 -- 172.21.15.122:0/2235454005 learned_addr learned my addr 172.21.15.122:0/2235454005 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:56.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7ff123e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff124167420 0x7ff1240b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.053+0000 7ff129c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff1240b47f0 0x7ff1240ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.057+0000 7ff123e00640 1 -- 172.21.15.122:0/2235454005 >> v2:172.21.15.153:3300/0 conn(0x7ff1240b47f0 msgr2=0x7ff1240ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:56.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.057+0000 7ff123e00640 1 --2- 172.21.15.122:0/2235454005 >> v2:172.21.15.153:3300/0 conn(0x7ff1240b47f0 0x7ff1240ce3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.057+0000 7ff123e00640 1 -- 172.21.15.122:0/2235454005 >> v1:172.21.15.153:6789/0 conn(0x7ff12414bb90 legacy=0x7ff12406df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.057+0000 7ff123e00640 1 -- 172.21.15.122:0/2235454005 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1240b3ad0 con 0x7ff124167420 2024-05-28T06:05:56.064 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.057+0000 7fbe5aa00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fbe540df360 0x7fbe54038120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:36628/0 (socket says 172.21.15.122:36628) 2024-05-28T06:05:56.064 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.057+0000 7fbe5aa00640 1 -- 172.21.15.122:0/738514552 learned_addr learned my addr 172.21.15.122:0/738514552 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:56.064 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.057+0000 7fbe5be00640 1 -- 172.21.15.122:0/738514552 --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe540df740 con 0x7fbe5404f800 2024-05-28T06:05:56.064 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.057+0000 7fbe5be00640 1 -- 172.21.15.122:0/738514552 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe54054390 con 0x7fbe540df360 2024-05-28T06:05:56.064 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.057+0000 7fbe5be00640 1 -- 172.21.15.122:0/738514552 --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fbe54006070 con 0x7fbe54053820 2024-05-28T06:05:56.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe59600640 1 -- 172.21.15.122:0/738514552 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2832620856 0 0) 0x7fbe54054390 con 0x7fbe540df360 2024-05-28T06:05:56.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe59600640 1 -- 172.21.15.122:0/738514552 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe40003530 con 0x7fbe540df360 2024-05-28T06:05:56.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe5a000640 1 --2- 172.21.15.122:0/738514552 >> v2:172.21.15.122:3300/0 conn(0x7fbe54053820 0x7fbe54053c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe59600640 1 -- 172.21.15.122:0/738514552 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1181811389 0 0) 0x7fbe40003530 con 0x7fbe540df360 2024-05-28T06:05:56.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe59600640 1 -- 172.21.15.122:0/738514552 >> v2:172.21.15.122:3300/0 conn(0x7fbe54053820 msgr2=0x7fbe54053c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:56.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe59600640 1 --2- 172.21.15.122:0/738514552 >> v2:172.21.15.122:3300/0 conn(0x7fbe54053820 0x7fbe54053c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe59600640 1 -- 172.21.15.122:0/738514552 >> v1:172.21.15.122:6789/0 conn(0x7fbe5404f800 legacy=0x7fbe54006da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe59600640 1 -- 172.21.15.122:0/738514552 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe540062c0 con 0x7fbe540df360 2024-05-28T06:05:56.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe59600640 1 -- 172.21.15.122:0/738514552 <== mon.1 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7fbe4c001680 con 0x7fbe540df360 2024-05-28T06:05:56.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe59600640 1 -- 172.21.15.122:0/738514552 >> v1:172.21.15.153:6789/0 conn(0x7fbe540df360 legacy=0x7fbe54038120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe59600640 1 --2- 172.21.15.122:0/738514552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe40004ba0 0x7fbe400037b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe59600640 1 --2- 172.21.15.122:0/738514552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe40003e20 0x7fbe40008fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe59600640 1 --2- 172.21.15.122:0/738514552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe40009520 0x7fbe400099d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe59600640 1 -- 172.21.15.122:0/738514552 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbe54006070 con 0x7fbe40004ba0 2024-05-28T06:05:56.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe59600640 1 -- 172.21.15.122:0/738514552 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4000a0f0 con 0x7fbe40009520 2024-05-28T06:05:56.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe59600640 1 -- 172.21.15.122:0/738514552 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbe4000a2f0 con 0x7fbe40003e20 2024-05-28T06:05:56.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7f9946800640 1 -- 172.21.15.122:0/592598518 reap_dead start 2024-05-28T06:05:56.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe5a000640 1 --2- 172.21.15.122:0/738514552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe40003e20 0x7fbe40008fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe5aa00640 1 --2- 172.21.15.122:0/738514552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe40004ba0 0x7fbe400037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.067 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7f9946800640 1 --2- 172.21.15.122:0/592598518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f992c0052f0 0x7f992c00b9d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9940002240 tx=0x7f994001d2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83bc761a84ec05d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:56.067 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe5a000640 1 -- 172.21.15.122:0/738514552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe40009520 msgr2=0x7fbe400099d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-28T06:05:56.067 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe5a000640 1 --2- 172.21.15.122:0/738514552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe40009520 0x7fbe400099d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.067 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe5a000640 1 -- 172.21.15.122:0/738514552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe40004ba0 msgr2=0x7fbe400037b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:56.067 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7f9944a00640 1 -- 172.21.15.122:0/592598518 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994000a470 con 0x7f992c0052f0 2024-05-28T06:05:56.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe5a000640 1 --2- 172.21.15.122:0/738514552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe40004ba0 0x7fbe400037b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe5a000640 1 -- 172.21.15.122:0/738514552 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe40003530 con 0x7fbe40003e20 2024-05-28T06:05:56.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7fbe61600640 1 -- 172.21.15.122:0/738514552 reap_dead start 2024-05-28T06:05:56.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.061+0000 7f9944a00640 1 -- 172.21.15.122:0/592598518 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9940007390 con 0x7f992c0052f0 2024-05-28T06:05:56.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.065+0000 7f9947200640 1 -- 172.21.15.122:0/592598518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f992c0052f0 msgr2=0x7f992c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.065+0000 7f9947200640 1 --2- 172.21.15.122:0/592598518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f992c0052f0 0x7f992c00b9d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9940002240 tx=0x7f994001d2f0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.065+0000 7f9947200640 1 -- 172.21.15.122:0/592598518 shutdown_connections 2024-05-28T06:05:56.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.065+0000 7f9947200640 1 --2- 172.21.15.122:0/592598518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f992c0052f0 0x7f992c00b9d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.065+0000 7f9947200640 1 -- 172.21.15.122:0/592598518 >> 172.21.15.122:0/592598518 conn(0x7f994809aa40 msgr2=0x7f99480b6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:56.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.065+0000 7ff123e00640 1 --2- 172.21.15.122:0/2235454005 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff124167420 0x7ff1240b42b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009d90 tx=0x7ff11c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78b6aaaf5e26e94c server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:56.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.065+0000 7f9947200640 1 -- 172.21.15.122:0/592598518 shutdown_connections 2024-05-28T06:05:56.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.065+0000 7f9947200640 1 -- 172.21.15.122:0/592598518 wait complete. 2024-05-28T06:05:56.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.065+0000 7ff123400640 1 -- 172.21.15.122:0/2235454005 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c0ab620 con 0x7ff124167420 2024-05-28T06:05:56.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.065+0000 7ff123400640 1 -- 172.21.15.122:0/2235454005 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff11c0b0070 con 0x7ff124167420 2024-05-28T06:05:56.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.065+0000 7ff123400640 1 -- 172.21.15.122:0/2235454005 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c0ab9e0 con 0x7ff124167420 2024-05-28T06:05:56.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.065+0000 7f659e600640 1 Processor -- start 2024-05-28T06:05:56.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.065+0000 7f659e600640 1 -- start start 2024-05-28T06:05:56.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.065+0000 7ff12bc00640 1 -- 172.21.15.122:0/2235454005 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff124167420 msgr2=0x7ff1240b42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.065+0000 7ff12bc00640 1 --2- 172.21.15.122:0/2235454005 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff124167420 0x7ff1240b42b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009d90 tx=0x7ff11c01c920 comp rx=0 tx=0).stop 2024-05-28T06:05:56.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.065+0000 7ff12bc00640 1 -- 172.21.15.122:0/2235454005 shutdown_connections 2024-05-28T06:05:56.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.065+0000 7ff12bc00640 1 --2- 172.21.15.122:0/2235454005 >> v2:172.21.15.153:3300/0 conn(0x7ff1240b47f0 0x7ff1240ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.065+0000 7ff12bc00640 1 --2- 172.21.15.122:0/2235454005 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff124167420 0x7ff1240b42b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.065+0000 7ff12bc00640 1 -- 172.21.15.122:0/2235454005 >> 172.21.15.122:0/2235454005 conn(0x7ff124062610 msgr2=0x7ff12406b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:56.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.065+0000 7fbe5a000640 1 --2- 172.21.15.122:0/738514552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe40003e20 0x7fbe40008fe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbe48009ae0 tx=0x7fbe4801ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43c42fb77b21fda7 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:56.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7ff12bc00640 1 -- 172.21.15.122:0/2235454005 shutdown_connections 2024-05-28T06:05:56.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7f9947200640 1 Processor -- start 2024-05-28T06:05:56.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7ff12bc00640 1 -- 172.21.15.122:0/2235454005 wait complete. 2024-05-28T06:05:56.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7f659e600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f65981481e0 0x7f65980cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7f9947200640 1 -- start start 2024-05-28T06:05:56.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7fbe59600640 1 -- 172.21.15.122:0/738514552 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe480b2070 con 0x7fbe40003e20 2024-05-28T06:05:56.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7f659e600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65980cd350 con 0x7f6598072520 2024-05-28T06:05:56.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7f6597400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6598147e00 0x7f6598071e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:36636/0 (socket says 172.21.15.122:36636) 2024-05-28T06:05:56.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7f6597400640 1 -- 172.21.15.122:0/1668962767 learned_addr learned my addr 172.21.15.122:0/1668962767 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:56.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7f659e600640 1 -- 172.21.15.122:0/1668962767 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65980cc880 con 0x7f6598147e00 2024-05-28T06:05:56.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7f659e600640 1 -- 172.21.15.122:0/1668962767 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f65980ccb60 con 0x7f65981481e0 2024-05-28T06:05:56.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7f6596a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f65981481e0 0x7f65980cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7fbe59600640 1 -- 172.21.15.122:0/738514552 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe480a5630 con 0x7fbe40003e20 2024-05-28T06:05:56.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7fbe59600640 1 -- 172.21.15.122:0/738514552 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe480b2070 con 0x7fbe40003e20 2024-05-28T06:05:56.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7f9947200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f992c0052f0 0x7f994814bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7f6596a00640 1 -- 172.21.15.122:0/1668962767 >> v1:172.21.15.153:6789/0 conn(0x7f6598147e00 legacy=0x7f6598071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7f6596a00640 1 -- 172.21.15.122:0/1668962767 >> v1:172.21.15.122:6789/0 conn(0x7f6598072520 legacy=0x7f65980cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7f9947200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99480b1bc0 0x7f994814b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7ff12bc00640 1 Processor -- start 2024-05-28T06:05:56.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7f9945e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f992c0052f0 0x7f994814bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7f9945e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f992c0052f0 0x7f994814bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:37384/0 (socket says 172.21.15.122:37384) 2024-05-28T06:05:56.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7f6596a00640 1 -- 172.21.15.122:0/1668962767 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65980cd5f0 con 0x7f65981481e0 2024-05-28T06:05:56.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7f9945400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99480b1bc0 0x7f994814b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7f9945400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99480b1bc0 0x7f994814b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41382/0 (socket says 172.21.15.122:41382) 2024-05-28T06:05:56.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7f9945e00640 1 -- 172.21.15.122:0/2797784680 learned_addr learned my addr 172.21.15.122:0/2797784680 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:56.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7f9947200640 1 --2- 172.21.15.122:0/2797784680 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f99480b3880 0x7f99480b6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7ff12bc00640 1 -- start start 2024-05-28T06:05:56.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.069+0000 7f9947200640 1 -- 172.21.15.122:0/2797784680 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f99481609f0 con 0x7f99480b1bc0 2024-05-28T06:05:56.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7f9946800640 1 --2- 172.21.15.122:0/2797784680 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f99480b3880 0x7f99480b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7f9947200640 1 -- 172.21.15.122:0/2797784680 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f994806c230 con 0x7f992c0052f0 2024-05-28T06:05:56.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7f9947200640 1 -- 172.21.15.122:0/2797784680 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9948160b70 con 0x7f99480b3880 2024-05-28T06:05:56.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7ff12bc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1240b47f0 0x7ff1241659c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7ff12bc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff12414bb90 0x7ff1241605e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7ff12bc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff124167420 0x7ff12413e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7fbe5be00640 1 -- 172.21.15.122:0/738514552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe40003e20 msgr2=0x7fbe40008fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7fbe5be00640 1 --2- 172.21.15.122:0/738514552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe40003e20 0x7fbe40008fe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbe48009ae0 tx=0x7fbe4801ca60 comp rx=0 tx=0).stop 2024-05-28T06:05:56.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7ff123e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff12414bb90 0x7ff1241605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7ff123e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff12414bb90 0x7ff1241605e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:37398/0 (socket says 172.21.15.122:37398) 2024-05-28T06:05:56.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7ff129200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1240b47f0 0x7ff1241659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7f9945400640 1 -- 172.21.15.122:0/2797784680 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f99480b3880 msgr2=0x7f99480b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7f9945400640 1 --2- 172.21.15.122:0/2797784680 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f99480b3880 0x7f99480b6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7f9945400640 1 -- 172.21.15.122:0/2797784680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f992c0052f0 msgr2=0x7f994814bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7f9945400640 1 --2- 172.21.15.122:0/2797784680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f992c0052f0 0x7f994814bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7f9945400640 1 -- 172.21.15.122:0/2797784680 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994814e420 con 0x7f99480b1bc0 2024-05-28T06:05:56.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7ff129c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff124167420 0x7ff12413e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7ff12bc00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff12416fdb0 con 0x7ff124167420 2024-05-28T06:05:56.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7ff12bc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff1240b4c40 con 0x7ff12414bb90 2024-05-28T06:05:56.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7ff12bc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff12416ff30 con 0x7ff1240b47f0 2024-05-28T06:05:56.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7ff129c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff124167420 0x7ff12413e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41388/0 (socket says 172.21.15.122:41388) 2024-05-28T06:05:56.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7ff129c00640 1 -- 172.21.15.122:0/2505191047 learned_addr learned my addr 172.21.15.122:0/2505191047 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:56.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7f9945400640 1 --2- 172.21.15.122:0/2797784680 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99480b1bc0 0x7f994814b340 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f993400c3f0 tx=0x7f993400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:56.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7f9946800640 1 --2- 172.21.15.122:0/2797784680 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f99480b3880 0x7f99480b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:05:56.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7f993e000640 1 -- 172.21.15.122:0/2797784680 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9934017070 con 0x7f99480b1bc0 2024-05-28T06:05:56.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7f993e000640 1 -- 172.21.15.122:0/2797784680 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99340052d0 con 0x7f99480b1bc0 2024-05-28T06:05:56.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7f993e000640 1 -- 172.21.15.122:0/2797784680 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9934003820 con 0x7f99480b1bc0 2024-05-28T06:05:56.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7f9947200640 1 -- 172.21.15.122:0/2797784680 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99480b20c0 con 0x7f99480b1bc0 2024-05-28T06:05:56.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7f9947200640 1 -- 172.21.15.122:0/2797784680 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99480ae720 con 0x7f99480b1bc0 2024-05-28T06:05:56.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7fbe5be00640 1 -- 172.21.15.122:0/738514552 shutdown_connections 2024-05-28T06:05:56.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7fbe5be00640 1 --2- 172.21.15.122:0/738514552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe40003e20 0x7fbe40008fe0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7fbe5be00640 1 -- 172.21.15.122:0/738514552 >> 172.21.15.122:0/738514552 conn(0x7fbe54054ca0 msgr2=0x7fbe540550b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:56.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7ff123e00640 1 -- 172.21.15.122:0/2505191047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1240b47f0 msgr2=0x7ff1241659c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7ff123e00640 1 --2- 172.21.15.122:0/2505191047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1240b47f0 0x7ff1241659c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7ff123e00640 1 -- 172.21.15.122:0/2505191047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff124167420 msgr2=0x7ff12413e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7ff123e00640 1 --2- 172.21.15.122:0/2505191047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff124167420 0x7ff12413e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7ff123e00640 1 -- 172.21.15.122:0/2505191047 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff124165fa0 con 0x7ff12414bb90 2024-05-28T06:05:56.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7fbe5be00640 1 -- 172.21.15.122:0/738514552 shutdown_connections 2024-05-28T06:05:56.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.073+0000 7fbe5be00640 1 -- 172.21.15.122:0/738514552 wait complete. 2024-05-28T06:05:56.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.077+0000 7ff123e00640 1 --2- 172.21.15.122:0/2505191047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff12414bb90 0x7ff1241605e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff11c0ac000 tx=0x7ff11c0196c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:56.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.077+0000 7ff120c00640 1 -- 172.21.15.122:0/2505191047 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c0abc40 con 0x7ff12414bb90 2024-05-28T06:05:56.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.077+0000 7ff120c00640 1 -- 172.21.15.122:0/2505191047 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff11c0abde0 con 0x7ff12414bb90 2024-05-28T06:05:56.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.077+0000 7fbe5be00640 1 Processor -- start 2024-05-28T06:05:56.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.077+0000 7ff120c00640 1 -- 172.21.15.122:0/2505191047 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c0c0690 con 0x7ff12414bb90 2024-05-28T06:05:56.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.077+0000 7f6596a00640 1 --2- 172.21.15.122:0/1668962767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65981481e0 0x7f65980cbb10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f658c0097c0 tx=0x7f658c01c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e157d9a597c8539f server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:56.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.077+0000 7f9947200640 1 -- 172.21.15.122:0/2797784680 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99200052a0 con 0x7f99480b1bc0 2024-05-28T06:05:56.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.077+0000 7fbe5be00640 1 -- start start 2024-05-28T06:05:56.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.077+0000 7ff12bc00640 1 -- 172.21.15.122:0/2505191047 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff124166280 con 0x7ff12414bb90 2024-05-28T06:05:56.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.077+0000 7ff12bc00640 1 -- 172.21.15.122:0/2505191047 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff124160b20 con 0x7ff12414bb90 2024-05-28T06:05:56.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.077+0000 7fbe5be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe40003e20 0x7fbe54035540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.077+0000 7fbe5be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe540dafd0 0x7fbe5404ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.077+0000 7ff12bc00640 1 -- 172.21.15.122:0/2505191047 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff12406c920 con 0x7ff12414bb90 2024-05-28T06:05:56.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.081+0000 7f993e000640 1 -- 172.21.15.122:0/2797784680 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f993401a070 con 0x7f99480b1bc0 2024-05-28T06:05:56.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.081+0000 7fbe5aa00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe40003e20 0x7fbe54035540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.081+0000 7fbe5be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe5404b360 0x7fbe540e1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.081+0000 7fbe5aa00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe40003e20 0x7fbe54035540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:50364/0 (socket says 172.21.15.122:50364) 2024-05-28T06:05:56.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.081+0000 7fbe5be00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5404fbe0 con 0x7fbe540dafd0 2024-05-28T06:05:56.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.081+0000 7fbe5aa00640 1 -- 172.21.15.122:0/974157427 learned_addr learned my addr 172.21.15.122:0/974157427 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:56.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.081+0000 7fbe5be00640 1 -- 172.21.15.122:0/974157427 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbe54054010 con 0x7fbe5404b360 2024-05-28T06:05:56.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.081+0000 7fbe5be00640 1 -- 172.21.15.122:0/974157427 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbe5404fd60 con 0x7fbe40003e20 2024-05-28T06:05:56.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.081+0000 7fbe5a000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe540dafd0 0x7fbe5404ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.081+0000 7fbe61600640 1 --2- 172.21.15.122:0/974157427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe5404b360 0x7fbe540e1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.081+0000 7fbe5a000640 1 -- 172.21.15.122:0/974157427 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe40003e20 msgr2=0x7fbe54035540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.081+0000 7fbe5a000640 1 --2- 172.21.15.122:0/974157427 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe40003e20 0x7fbe54035540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.081+0000 7fbe5a000640 1 -- 172.21.15.122:0/974157427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe5404b360 msgr2=0x7fbe540e1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.081+0000 7fbe5a000640 1 --2- 172.21.15.122:0/974157427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe5404b360 0x7fbe540e1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.081+0000 7fbe5a000640 1 -- 172.21.15.122:0/974157427 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe54049d80 con 0x7fbe540dafd0 2024-05-28T06:05:56.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.081+0000 7f993e000640 1 --2- 172.21.15.122:0/2797784680 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9928068480 0x7f992806a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.081+0000 7f993e000640 1 -- 172.21.15.122:0/2797784680 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9934085b90 con 0x7f99480b1bc0 2024-05-28T06:05:56.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.081+0000 7ff120c00640 1 -- 172.21.15.122:0/2505191047 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff11c0c0830 con 0x7ff12414bb90 2024-05-28T06:05:56.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.081+0000 7ff120c00640 1 --2- 172.21.15.122:0/2505191047 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff104068450 0x7ff10406a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.081+0000 7ff120c00640 1 -- 172.21.15.122:0/2505191047 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff11c121d20 con 0x7ff12414bb90 2024-05-28T06:05:56.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.085+0000 7f6596000640 1 -- 172.21.15.122:0/1668962767 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658c0b0070 con 0x7f65981481e0 2024-05-28T06:05:56.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.085+0000 7f6596000640 1 -- 172.21.15.122:0/1668962767 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f658c0a4e50 con 0x7f65981481e0 2024-05-28T06:05:56.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.085+0000 7f6596000640 1 -- 172.21.15.122:0/1668962767 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658c0ab820 con 0x7f65981481e0 2024-05-28T06:05:56.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.085+0000 7fbe5a000640 1 --2- 172.21.15.122:0/974157427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe540dafd0 0x7fbe5404ae20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbe480ac000 tx=0x7fbe48019800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:56.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.085+0000 7ff129200640 1 --2- 172.21.15.122:0/2505191047 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff104068450 0x7ff10406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.085+0000 7f659e600640 1 -- 172.21.15.122:0/1668962767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65981481e0 msgr2=0x7f65980cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.085+0000 7f659e600640 1 --2- 172.21.15.122:0/1668962767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65981481e0 0x7f65980cbb10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f658c0097c0 tx=0x7f658c01c330 comp rx=0 tx=0).stop 2024-05-28T06:05:56.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.085+0000 7f659e600640 1 -- 172.21.15.122:0/1668962767 shutdown_connections 2024-05-28T06:05:56.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.085+0000 7f659e600640 1 --2- 172.21.15.122:0/1668962767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65981481e0 0x7f65980cbb10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.085+0000 7f659e600640 1 -- 172.21.15.122:0/1668962767 >> 172.21.15.122:0/1668962767 conn(0x7f6598062610 msgr2=0x7f659806b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:56.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.085+0000 7f659e600640 1 -- 172.21.15.122:0/1668962767 shutdown_connections 2024-05-28T06:05:56.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.085+0000 7ff120c00640 1 -- 172.21.15.122:0/2505191047 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff11c0c5060 con 0x7ff12414bb90 2024-05-28T06:05:56.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.085+0000 7ff129200640 1 --2- 172.21.15.122:0/2505191047 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff104068450 0x7ff10406a910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff110000f70 tx=0x7ff110007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:56.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.085+0000 7f659e600640 1 -- 172.21.15.122:0/1668962767 wait complete. 2024-05-28T06:05:56.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.085+0000 7f9945e00640 1 --2- 172.21.15.122:0/2797784680 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9928068480 0x7f992806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.085+0000 7f9945e00640 1 --2- 172.21.15.122:0/2797784680 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9928068480 0x7f992806a940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f993800bb10 tx=0x7f9938008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:56.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.089+0000 7f659e600640 1 Processor -- start 2024-05-28T06:05:56.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.089+0000 7f659e600640 1 -- start start 2024-05-28T06:05:56.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.089+0000 7f659e600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6598072520 0x7f6598142020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7fbe52a00640 1 -- 172.21.15.122:0/974157427 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe480b2070 con 0x7fbe540dafd0 2024-05-28T06:05:56.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f659e600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6598147e00 0x7f6598161790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f993e000640 1 -- 172.21.15.122:0/2797784680 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f994814e420 con 0x7f99480b1bc0 2024-05-28T06:05:56.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7fbe52a00640 1 -- 172.21.15.122:0/974157427 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe480be070 con 0x7fbe540dafd0 2024-05-28T06:05:56.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7fbe52a00640 1 -- 172.21.15.122:0/974157427 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe480096b0 con 0x7fbe540dafd0 2024-05-28T06:05:56.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7fbe5be00640 1 -- 172.21.15.122:0/974157427 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe5404a060 con 0x7fbe540dafd0 2024-05-28T06:05:56.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f659e600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65981481e0 0x7f659815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f6597400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6598072520 0x7f6598142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7fbe5be00640 1 -- 172.21.15.122:0/974157427 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe5404a620 con 0x7fbe540dafd0 2024-05-28T06:05:56.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f6596a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6598147e00 0x7f6598161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f6596a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6598147e00 0x7f6598161790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:50368/0 (socket says 172.21.15.122:50368) 2024-05-28T06:05:56.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f6597400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6598072520 0x7f6598142020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:37422/0 (socket says 172.21.15.122:37422) 2024-05-28T06:05:56.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f6597e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65981481e0 0x7f659815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f6596a00640 1 -- 172.21.15.122:0/2817318 learned_addr learned my addr 172.21.15.122:0/2817318 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:56.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f659e600640 1 -- 172.21.15.122:0/2817318 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f65980ceca0 con 0x7f65981481e0 2024-05-28T06:05:56.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f659e600640 1 -- 172.21.15.122:0/2817318 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f65980ceb20 con 0x7f6598072520 2024-05-28T06:05:56.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f659e600640 1 -- 172.21.15.122:0/2817318 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f65980cee20 con 0x7f6598147e00 2024-05-28T06:05:56.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f6596a00640 1 -- 172.21.15.122:0/2817318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6598072520 msgr2=0x7f6598142020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f6596a00640 1 --2- 172.21.15.122:0/2817318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6598072520 0x7f6598142020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f6596a00640 1 -- 172.21.15.122:0/2817318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65981481e0 msgr2=0x7f659815dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.097+0000 7fbe52a00640 1 -- 172.21.15.122:0/974157427 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbe480b8690 con 0x7fbe540dafd0 2024-05-28T06:05:56.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.097+0000 7fbe52a00640 1 --2- 172.21.15.122:0/974157427 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fbe3c068400 0x7fbe3c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f6596a00640 1 --2- 172.21.15.122:0/2817318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65981481e0 0x7f659815dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f6596a00640 1 -- 172.21.15.122:0/2817318 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6598142fc0 con 0x7f6598147e00 2024-05-28T06:05:56.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f6597e00640 1 --2- 172.21.15.122:0/2817318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65981481e0 0x7f659815dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:05:56.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f6596a00640 1 --2- 172.21.15.122:0/2817318 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6598147e00 0x7f6598161790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f658c019f60 tx=0x7f658c0190d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:56.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f658b400640 1 -- 172.21.15.122:0/2817318 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658c0b0040 con 0x7f6598147e00 2024-05-28T06:05:56.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f658b400640 1 -- 172.21.15.122:0/2817318 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f658c0ba070 con 0x7f6598147e00 2024-05-28T06:05:56.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f658b400640 1 -- 172.21.15.122:0/2817318 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658c0b4b50 con 0x7f6598147e00 2024-05-28T06:05:56.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f659e600640 1 -- 172.21.15.122:0/2817318 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65981432a0 con 0x7f6598147e00 2024-05-28T06:05:56.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.093+0000 7f659e600640 1 -- 172.21.15.122:0/2817318 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6598143860 con 0x7f6598147e00 2024-05-28T06:05:56.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.097+0000 7f6588c00640 1 -- 172.21.15.122:0/2817318 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6598075620 con 0x7f6598147e00 2024-05-28T06:05:56.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.097+0000 7fbe5aa00640 1 --2- 172.21.15.122:0/974157427 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fbe3c068400 0x7fbe3c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.097+0000 7fbe52a00640 1 -- 172.21.15.122:0/974157427 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbe480ef1c0 con 0x7fbe540dafd0 2024-05-28T06:05:56.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.101+0000 7fbe5be00640 1 -- 172.21.15.122:0/974157427 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe340052a0 con 0x7fbe540dafd0 2024-05-28T06:05:56.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.097+0000 7f658b400640 1 -- 172.21.15.122:0/2817318 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f658c0b3070 con 0x7f6598147e00 2024-05-28T06:05:56.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.101+0000 7f658b400640 1 --2- 172.21.15.122:0/2817318 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6578068380 0x7f657806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:56.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.101+0000 7f658b400640 1 -- 172.21.15.122:0/2817318 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f658c120510 con 0x7f6598147e00 2024-05-28T06:05:56.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.101+0000 7f6597400640 1 --2- 172.21.15.122:0/2817318 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6578068380 0x7f657806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:56.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.101+0000 7fbe5aa00640 1 --2- 172.21.15.122:0/974157427 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fbe3c068400 0x7fbe3c06a8c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c000c10 tx=0x7fbe4c000fe0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:56.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.101+0000 7f6597400640 1 --2- 172.21.15.122:0/2817318 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6578068380 0x7f657806a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6590000b70 tx=0x7f6590009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:56.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.105+0000 7f658b400640 1 -- 172.21.15.122:0/2817318 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f658c015fb0 con 0x7f6598147e00 2024-05-28T06:05:56.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.113+0000 7fbe52a00640 1 -- 172.21.15.122:0/974157427 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbe480167a0 con 0x7fbe540dafd0 2024-05-28T06:05:56.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.337+0000 7f918fe00640 1 -- 172.21.15.122:0/3125991998 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f91881e7ff0 con 0x7f918815d370 2024-05-28T06:05:56.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.337+0000 7f9185600640 1 -- 172.21.15.122:0/3125991998 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f917405a530 con 0x7f918815d370 2024-05-28T06:05:56.342 INFO:teuthology.orchestra.run.smithi122.stdout:55834574854 2024-05-28T06:05:56.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.341+0000 7f9907200640 1 -- 172.21.15.122:0/4045422199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f98e0005860 con 0x7f9900005ea0 2024-05-28T06:05:56.345 INFO:teuthology.orchestra.run.smithi122.stdout:55834574854 2024-05-28T06:05:56.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.341+0000 7f98fe000640 1 -- 172.21.15.122:0/4045422199 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f98f805cd10 con 0x7f9900005ea0 2024-05-28T06:05:56.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f918fe00640 1 -- 172.21.15.122:0/3125991998 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9168068480 msgr2=0x7f916806a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f918fe00640 1 --2- 172.21.15.122:0/3125991998 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9168068480 0x7f916806a940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f917c01c670 tx=0x7f917c0af040 comp rx=0 tx=0).stop 2024-05-28T06:05:56.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f918fe00640 1 -- 172.21.15.122:0/3125991998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f918815d370 msgr2=0x7f918813fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f918fe00640 1 --2- 172.21.15.122:0/3125991998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f918815d370 0x7f918813fb70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f91740107e0 tx=0x7f9174010ca0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f9907200640 1 -- 172.21.15.122:0/4045422199 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f98e80683d0 msgr2=0x7f98e806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f0b96a00640 1 -- 172.21.15.122:0/2418107373 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0b80005590 con 0x7f0b9c0df2b0 2024-05-28T06:05:56.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f9907200640 1 --2- 172.21.15.122:0/4045422199 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f98e80683d0 0x7f98e806a890 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f98f40af000 tx=0x7f98f4004740 comp rx=0 tx=0).stop 2024-05-28T06:05:56.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f9907200640 1 -- 172.21.15.122:0/4045422199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9900005ea0 msgr2=0x7f9900185a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f9907200640 1 --2- 172.21.15.122:0/4045422199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9900005ea0 0x7f9900185a30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f98f800e410 tx=0x7f98f800e8d0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f918fe00640 1 -- 172.21.15.122:0/3125991998 shutdown_connections 2024-05-28T06:05:56.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f918fe00640 1 --2- 172.21.15.122:0/3125991998 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9168068480 0x7f916806a940 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f918fe00640 1 --2- 172.21.15.122:0/3125991998 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91881f3590 0x7f91881f3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f0ba1600640 1 -- 172.21.15.122:0/2418107373 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0ba409a6c0 con 0x7f0b9c0df2b0 2024-05-28T06:05:56.349 INFO:teuthology.orchestra.run.smithi122.stdout:55834574853 2024-05-28T06:05:56.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f918fe00640 1 --2- 172.21.15.122:0/3125991998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f918815d370 0x7f918813fb70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f918fe00640 1 --2- 172.21.15.122:0/3125991998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9170006dc0 0x7f9188156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f918fe00640 1 -- 172.21.15.122:0/3125991998 >> 172.21.15.122:0/3125991998 conn(0x7f918806df90 msgr2=0x7f9188158fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:56.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f918fe00640 1 -- 172.21.15.122:0/3125991998 shutdown_connections 2024-05-28T06:05:56.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f918fe00640 1 -- 172.21.15.122:0/3125991998 wait complete. 2024-05-28T06:05:56.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f9907200640 1 -- 172.21.15.122:0/4045422199 shutdown_connections 2024-05-28T06:05:56.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f9907200640 1 --2- 172.21.15.122:0/4045422199 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f98e80683d0 0x7f98e806a890 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f9907200640 1 --2- 172.21.15.122:0/4045422199 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9900047c20 0x7f99000dd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f9907200640 1 --2- 172.21.15.122:0/4045422199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9900033e40 0x7f99000e8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f9907200640 1 --2- 172.21.15.122:0/4045422199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9900005ea0 0x7f9900185a30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.345+0000 7f9907200640 1 -- 172.21.15.122:0/4045422199 >> 172.21.15.122:0/4045422199 conn(0x7f9900009fc0 msgr2=0x7f99000e5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:56.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.349+0000 7f9907200640 1 -- 172.21.15.122:0/4045422199 shutdown_connections 2024-05-28T06:05:56.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.349+0000 7f9907200640 1 -- 172.21.15.122:0/4045422199 wait complete. 2024-05-28T06:05:56.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.349+0000 7f0b96a00640 1 -- 172.21.15.122:0/2418107373 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0b84068450 msgr2=0x7f0b8406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.349+0000 7f0b96a00640 1 --2- 172.21.15.122:0/2418107373 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0b84068450 0x7f0b8406a910 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0b98005890 tx=0x7f0b98009040 comp rx=0 tx=0).stop 2024-05-28T06:05:56.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.349+0000 7f0b96a00640 1 -- 172.21.15.122:0/2418107373 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b9c0df2b0 msgr2=0x7f0b9c0daa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.349+0000 7f0b96a00640 1 --2- 172.21.15.122:0/2418107373 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b9c0df2b0 0x7f0b9c0daa30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0ba402db60 tx=0x7f0ba409f0a0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.349+0000 7f0b96a00640 1 -- 172.21.15.122:0/2418107373 shutdown_connections 2024-05-28T06:05:56.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.349+0000 7f0b96a00640 1 --2- 172.21.15.122:0/2418107373 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0b84068450 0x7f0b8406a910 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.349+0000 7f0b96a00640 1 --2- 172.21.15.122:0/2418107373 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b9c0df2b0 0x7f0b9c0daa30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.349+0000 7f0b96a00640 1 --2- 172.21.15.122:0/2418107373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b9c0501b0 0x7f0b9c0d3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.349+0000 7f0b96a00640 1 --2- 172.21.15.122:0/2418107373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b9c00aae0 0x7f0b9c04e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.349+0000 7f0b96a00640 1 -- 172.21.15.122:0/2418107373 >> 172.21.15.122:0/2418107373 conn(0x7f0b9c009fc0 msgr2=0x7f0b9c00a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:56.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.357+0000 7f0b96a00640 1 -- 172.21.15.122:0/2418107373 shutdown_connections 2024-05-28T06:05:56.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.357+0000 7f0b96a00640 1 -- 172.21.15.122:0/2418107373 wait complete. 2024-05-28T06:05:56.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.357+0000 7f6b2c600640 1 -- 172.21.15.122:0/2373478157 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f6b00005590 con 0x7f6b1c03a610 2024-05-28T06:05:56.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.361+0000 7f6b21600640 1 -- 172.21.15.122:0/2373478157 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6b18016070 con 0x7f6b1c03a610 2024-05-28T06:05:56.365 INFO:teuthology.orchestra.run.smithi122.stdout:55834574853 2024-05-28T06:05:56.370 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.369+0000 7f6b2c600640 1 -- 172.21.15.122:0/2373478157 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6b04068380 msgr2=0x7f6b0406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.370 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.369+0000 7f6b2c600640 1 --2- 172.21.15.122:0/2373478157 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6b04068380 0x7f6b0406a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000c900 tx=0x7f6b10008040 comp rx=0 tx=0).stop 2024-05-28T06:05:56.371 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.369+0000 7f6b2c600640 1 -- 172.21.15.122:0/2373478157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b1c03a610 msgr2=0x7f6b1c04e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.369+0000 7f6b2c600640 1 --2- 172.21.15.122:0/2373478157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b1c03a610 0x7f6b1c04e580 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6b180af040 tx=0x7f6b18019220 comp rx=0 tx=0).stop 2024-05-28T06:05:56.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.369+0000 7f6b2c600640 1 -- 172.21.15.122:0/2373478157 shutdown_connections 2024-05-28T06:05:56.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.369+0000 7f6b2c600640 1 --2- 172.21.15.122:0/2373478157 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6b04068380 0x7f6b0406a840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.369+0000 7f6b2c600640 1 --2- 172.21.15.122:0/2373478157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b1c0e00d0 0x7f6b1c0c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.369+0000 7f6b2c600640 1 --2- 172.21.15.122:0/2373478157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b1c03a610 0x7f6b1c04e580 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.369+0000 7f6b2c600640 1 --2- 172.21.15.122:0/2373478157 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b1c033a10 0x7f6b1c17f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.369+0000 7f6b2c600640 1 -- 172.21.15.122:0/2373478157 >> 172.21.15.122:0/2373478157 conn(0x7f6b1c054b00 msgr2=0x7f6b1c0e0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:56.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.369+0000 7f6b2c600640 1 -- 172.21.15.122:0/2373478157 shutdown_connections 2024-05-28T06:05:56.373 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.369+0000 7f6b2c600640 1 -- 172.21.15.122:0/2373478157 wait complete. 2024-05-28T06:05:56.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2024-05-28T06:05:56.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2024-05-28T06:05:56.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2024-05-28T06:05:56.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.401+0000 7ff12bc00640 1 -- 172.21.15.122:0/2505191047 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff124068bd0 con 0x7ff12414bb90 2024-05-28T06:05:56.406 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.405+0000 7ff120c00640 1 -- 172.21.15.122:0/2505191047 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff11c0165a0 con 0x7ff12414bb90 2024-05-28T06:05:56.406 INFO:teuthology.orchestra.run.smithi122.stdout:55834574854 2024-05-28T06:05:56.407 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-05-28T06:05:56.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.405+0000 7ff12bc00640 1 -- 172.21.15.122:0/2505191047 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff104068450 msgr2=0x7ff10406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.405+0000 7ff12bc00640 1 --2- 172.21.15.122:0/2505191047 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff104068450 0x7ff10406a910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff110000f70 tx=0x7ff110007e90 comp rx=0 tx=0).stop 2024-05-28T06:05:56.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.405+0000 7ff12bc00640 1 -- 172.21.15.122:0/2505191047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff12414bb90 msgr2=0x7ff1241605e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.405+0000 7ff12bc00640 1 --2- 172.21.15.122:0/2505191047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff12414bb90 0x7ff1241605e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff11c0ac000 tx=0x7ff11c0196c0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.405+0000 7ff12bc00640 1 -- 172.21.15.122:0/2505191047 shutdown_connections 2024-05-28T06:05:56.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.405+0000 7ff12bc00640 1 --2- 172.21.15.122:0/2505191047 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff104068450 0x7ff10406a910 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.405+0000 7ff12bc00640 1 --2- 172.21.15.122:0/2505191047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff124167420 0x7ff12413e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.405+0000 7ff12bc00640 1 --2- 172.21.15.122:0/2505191047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff12414bb90 0x7ff1241605e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.405+0000 7ff12bc00640 1 --2- 172.21.15.122:0/2505191047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1240b47f0 0x7ff1241659c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.405+0000 7ff12bc00640 1 -- 172.21.15.122:0/2505191047 >> 172.21.15.122:0/2505191047 conn(0x7ff124062610 msgr2=0x7ff124145250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:56.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.405+0000 7ff12bc00640 1 -- 172.21.15.122:0/2505191047 shutdown_connections 2024-05-28T06:05:56.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.405+0000 7ff12bc00640 1 -- 172.21.15.122:0/2505191047 wait complete. 2024-05-28T06:05:56.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.425+0000 7fbe5be00640 1 -- 172.21.15.122:0/974157427 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fbe34005860 con 0x7fbe540dafd0 2024-05-28T06:05:56.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.425+0000 7fbe52a00640 1 -- 172.21.15.122:0/974157427 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbe480f1120 con 0x7fbe540dafd0 2024-05-28T06:05:56.429 INFO:teuthology.orchestra.run.smithi122.stdout:55834574855 2024-05-28T06:05:56.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2024-05-28T06:05:56.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.429+0000 7fbe5be00640 1 -- 172.21.15.122:0/974157427 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fbe3c068400 msgr2=0x7fbe3c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.429+0000 7fbe5be00640 1 --2- 172.21.15.122:0/974157427 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fbe3c068400 0x7fbe3c06a8c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c000c10 tx=0x7fbe4c000fe0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.429+0000 7fbe5be00640 1 -- 172.21.15.122:0/974157427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe540dafd0 msgr2=0x7fbe5404ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.429+0000 7fbe5be00640 1 --2- 172.21.15.122:0/974157427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe540dafd0 0x7fbe5404ae20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbe480ac000 tx=0x7fbe48019800 comp rx=0 tx=0).stop 2024-05-28T06:05:56.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.429+0000 7fbe5be00640 1 -- 172.21.15.122:0/974157427 shutdown_connections 2024-05-28T06:05:56.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.429+0000 7fbe5be00640 1 --2- 172.21.15.122:0/974157427 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fbe3c068400 0x7fbe3c06a8c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.429+0000 7fbe5be00640 1 --2- 172.21.15.122:0/974157427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe5404b360 0x7fbe540e1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.429+0000 7fbe5be00640 1 --2- 172.21.15.122:0/974157427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe540dafd0 0x7fbe5404ae20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.429+0000 7fbe5be00640 1 --2- 172.21.15.122:0/974157427 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbe40003e20 0x7fbe54035540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.429+0000 7fbe5be00640 1 -- 172.21.15.122:0/974157427 >> 172.21.15.122:0/974157427 conn(0x7fbe54054ca0 msgr2=0x7fbe5404dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:56.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.429+0000 7fbe5be00640 1 -- 172.21.15.122:0/974157427 shutdown_connections 2024-05-28T06:05:56.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.429+0000 7fbe5be00640 1 -- 172.21.15.122:0/974157427 wait complete. 2024-05-28T06:05:56.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.433+0000 7f9947200640 1 -- 172.21.15.122:0/2797784680 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9920005590 con 0x7f99480b1bc0 2024-05-28T06:05:56.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.433+0000 7f993e000640 1 -- 172.21.15.122:0/2797784680 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9934005480 con 0x7f99480b1bc0 2024-05-28T06:05:56.437 INFO:teuthology.orchestra.run.smithi122.stdout:55834574854 2024-05-28T06:05:56.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.437+0000 7f9947200640 1 -- 172.21.15.122:0/2797784680 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9928068480 msgr2=0x7f992806a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.437+0000 7f9947200640 1 --2- 172.21.15.122:0/2797784680 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9928068480 0x7f992806a940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f993800bb10 tx=0x7f9938008040 comp rx=0 tx=0).stop 2024-05-28T06:05:56.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.437+0000 7f9947200640 1 -- 172.21.15.122:0/2797784680 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99480b1bc0 msgr2=0x7f994814b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.437+0000 7f9947200640 1 --2- 172.21.15.122:0/2797784680 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99480b1bc0 0x7f994814b340 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f993400c3f0 tx=0x7f993400c8b0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.437+0000 7f9947200640 1 -- 172.21.15.122:0/2797784680 shutdown_connections 2024-05-28T06:05:56.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.437+0000 7f9947200640 1 --2- 172.21.15.122:0/2797784680 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9928068480 0x7f992806a940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.437+0000 7f9947200640 1 --2- 172.21.15.122:0/2797784680 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f99480b3880 0x7f99480b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.437+0000 7f9947200640 1 --2- 172.21.15.122:0/2797784680 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99480b1bc0 0x7f994814b340 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.437+0000 7f9947200640 1 --2- 172.21.15.122:0/2797784680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f992c0052f0 0x7f994814bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.437+0000 7f9947200640 1 -- 172.21.15.122:0/2797784680 >> 172.21.15.122:0/2797784680 conn(0x7f994809aa40 msgr2=0x7f9948158350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:56.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.437+0000 7f9947200640 1 -- 172.21.15.122:0/2797784680 shutdown_connections 2024-05-28T06:05:56.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.437+0000 7f9947200640 1 -- 172.21.15.122:0/2797784680 wait complete. 2024-05-28T06:05:56.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.437+0000 7f6588c00640 1 -- 172.21.15.122:0/2817318 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f65981452d0 con 0x7f6598147e00 2024-05-28T06:05:56.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.437+0000 7f658b400640 1 -- 172.21.15.122:0/2817318 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f658c0f03e0 con 0x7f6598147e00 2024-05-28T06:05:56.442 INFO:teuthology.orchestra.run.smithi122.stdout:55834574852 2024-05-28T06:05:56.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.441+0000 7f6588c00640 1 -- 172.21.15.122:0/2817318 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6578068380 msgr2=0x7f657806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.441+0000 7f6588c00640 1 --2- 172.21.15.122:0/2817318 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6578068380 0x7f657806a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6590000b70 tx=0x7f6590009040 comp rx=0 tx=0).stop 2024-05-28T06:05:56.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.441+0000 7f6588c00640 1 -- 172.21.15.122:0/2817318 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6598147e00 msgr2=0x7f6598161790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:56.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.441+0000 7f6588c00640 1 --2- 172.21.15.122:0/2817318 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6598147e00 0x7f6598161790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f658c019f60 tx=0x7f658c0190d0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.441+0000 7f6588c00640 1 -- 172.21.15.122:0/2817318 shutdown_connections 2024-05-28T06:05:56.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.441+0000 7f6588c00640 1 --2- 172.21.15.122:0/2817318 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6578068380 0x7f657806a840 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.441+0000 7f6588c00640 1 --2- 172.21.15.122:0/2817318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65981481e0 0x7f659815dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.441+0000 7f6588c00640 1 --2- 172.21.15.122:0/2817318 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6598147e00 0x7f6598161790 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.441+0000 7f6588c00640 1 --2- 172.21.15.122:0/2817318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6598072520 0x7f6598142020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:56.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.441+0000 7f6588c00640 1 -- 172.21.15.122:0/2817318 >> 172.21.15.122:0/2817318 conn(0x7f6598062610 msgr2=0x7f65980ca910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:56.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.441+0000 7f6588c00640 1 -- 172.21.15.122:0/2817318 shutdown_connections 2024-05-28T06:05:56.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:56.441+0000 7f6588c00640 1 -- 172.21.15.122:0/2817318 wait complete. 2024-05-28T06:05:56.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2024-05-28T06:05:56.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-05-28T06:05:56.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-05-28T06:05:57.385 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-28T06:05:57.388 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-28T06:05:57.393 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-28T06:05:57.408 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-28T06:05:57.431 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-28T06:05:57.454 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-28T06:05:57.465 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-28T06:05:57.466 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-28T06:05:57.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.561+0000 7fc22be00640 1 Processor -- start 2024-05-28T06:05:57.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.561+0000 7fc22be00640 1 -- start start 2024-05-28T06:05:57.566 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.565+0000 7fc22be00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc22c0d12d0 0x7fc22c0cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.568 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.565+0000 7fc22be00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc22c0d2d70 con 0x7fc22c0d16b0 2024-05-28T06:05:57.568 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.565+0000 7fc22be00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc22c0d3050 con 0x7fc22c0d50e0 2024-05-28T06:05:57.568 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.565+0000 7fc22be00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fc22c0cfb70 con 0x7fc22c0d12d0 2024-05-28T06:05:57.568 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.565+0000 7fc22a000640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc22c0d50e0 0x7fc22c0b7850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:36648/0 (socket says 172.21.15.122:36648) 2024-05-28T06:05:57.568 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.565+0000 7fc22a000640 1 -- 172.21.15.122:0/622770913 learned_addr learned my addr 172.21.15.122:0/622770913 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:57.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.565+0000 7fc229600640 1 -- 172.21.15.122:0/622770913 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3359128892 0 0) 0x7fc22c0d3050 con 0x7fc22c0d50e0 2024-05-28T06:05:57.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.565+0000 7fc229600640 1 -- 172.21.15.122:0/622770913 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc210003530 con 0x7fc22c0d50e0 2024-05-28T06:05:57.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.565+0000 7fc229600640 1 -- 172.21.15.122:0/622770913 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3255745569 0 0) 0x7fc210003530 con 0x7fc22c0d50e0 2024-05-28T06:05:57.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.565+0000 7fc229600640 1 -- 172.21.15.122:0/622770913 >> v2:172.21.15.122:3300/0 conn(0x7fc22c0d12d0 msgr2=0x7fc22c0cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:57.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.565+0000 7fc229600640 1 --2- 172.21.15.122:0/622770913 >> v2:172.21.15.122:3300/0 conn(0x7fc22c0d12d0 0x7fc22c0cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.565+0000 7fc229600640 1 -- 172.21.15.122:0/622770913 >> v1:172.21.15.122:6789/0 conn(0x7fc22c0d16b0 legacy=0x7fc22c162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.565+0000 7fc229600640 1 -- 172.21.15.122:0/622770913 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22c0d3330 con 0x7fc22c0d50e0 2024-05-28T06:05:57.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.565+0000 7fc229600640 1 -- 172.21.15.122:0/622770913 <== mon.1 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7fc21c001680 con 0x7fc22c0d50e0 2024-05-28T06:05:57.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.565+0000 7fc229600640 1 -- 172.21.15.122:0/622770913 >> v1:172.21.15.153:6789/0 conn(0x7fc22c0d50e0 legacy=0x7fc22c0b7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.565+0000 7fc229600640 1 --2- 172.21.15.122:0/622770913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2100039c0 0x7fc210003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.565+0000 7fc229600640 1 --2- 172.21.15.122:0/622770913 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc210004810 0x7fc210004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.565+0000 7fc229600640 1 --2- 172.21.15.122:0/622770913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2100051d0 0x7fc2100141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.565+0000 7fc229600640 1 -- 172.21.15.122:0/622770913 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc210014900 con 0x7fc2100051d0 2024-05-28T06:05:57.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.565+0000 7fc229600640 1 -- 172.21.15.122:0/622770913 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc210014ab0 con 0x7fc2100039c0 2024-05-28T06:05:57.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.565+0000 7fc229600640 1 -- 172.21.15.122:0/622770913 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc210014cb0 con 0x7fc210004810 2024-05-28T06:05:57.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.569+0000 7fc22a000640 1 --2- 172.21.15.122:0/622770913 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc210004810 0x7fc210004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.569+0000 7fc22b400640 1 --2- 172.21.15.122:0/622770913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2100051d0 0x7fc2100141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.569+0000 7fc22aa00640 1 --2- 172.21.15.122:0/622770913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2100039c0 0x7fc210003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.569+0000 7fc22a000640 1 -- 172.21.15.122:0/622770913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2100039c0 msgr2=0x7fc210003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:57.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.569+0000 7fc22a000640 1 --2- 172.21.15.122:0/622770913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2100039c0 0x7fc210003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.569+0000 7fc22a000640 1 -- 172.21.15.122:0/622770913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2100051d0 msgr2=0x7fc2100141e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:57.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.569+0000 7fc22a000640 1 --2- 172.21.15.122:0/622770913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2100051d0 0x7fc2100141e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.569+0000 7fc22a000640 1 -- 172.21.15.122:0/622770913 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22c0d3330 con 0x7fc210004810 2024-05-28T06:05:57.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.573+0000 7fc22b400640 1 -- 172.21.15.122:0/622770913 reap_dead start 2024-05-28T06:05:57.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.573+0000 7fc22a000640 1 --2- 172.21.15.122:0/622770913 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc210004810 0x7fc210004c90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00c370 tx=0x7fc21c01f4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ebe024f9e1bfc50 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.573+0000 7fc229600640 1 -- 172.21.15.122:0/622770913 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21c007e00 con 0x7fc210004810 2024-05-28T06:05:57.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.573+0000 7fc229600640 1 -- 172.21.15.122:0/622770913 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc21c0058e0 con 0x7fc210004810 2024-05-28T06:05:57.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.573+0000 7fc229600640 1 -- 172.21.15.122:0/622770913 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21c005cd0 con 0x7fc210004810 2024-05-28T06:05:57.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.573+0000 7fc22be00640 1 -- 172.21.15.122:0/622770913 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc210004810 msgr2=0x7fc210004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.573+0000 7fc22be00640 1 --2- 172.21.15.122:0/622770913 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc210004810 0x7fc210004c90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00c370 tx=0x7fc21c01f4f0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.578 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.573+0000 7fc22be00640 1 -- 172.21.15.122:0/622770913 shutdown_connections 2024-05-28T06:05:57.578 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.573+0000 7fc22be00640 1 --2- 172.21.15.122:0/622770913 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc210004810 0x7fc210004c90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.578 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.573+0000 7fc22be00640 1 -- 172.21.15.122:0/622770913 >> 172.21.15.122:0/622770913 conn(0x7fc22c062840 msgr2=0x7fc22c062c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:57.578 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.573+0000 7fc22be00640 1 -- 172.21.15.122:0/622770913 shutdown_connections 2024-05-28T06:05:57.578 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.573+0000 7fc22be00640 1 -- 172.21.15.122:0/622770913 wait complete. 2024-05-28T06:05:57.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.577+0000 7fc22be00640 1 Processor -- start 2024-05-28T06:05:57.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.577+0000 7fc22be00640 1 -- start start 2024-05-28T06:05:57.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.581+0000 7fc22be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc210004810 0x7fc22c06ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.581+0000 7fc22be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc22c143be0 0x7fc22c144060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.581+0000 7fc22aa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc210004810 0x7fc22c06ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.581+0000 7fc22aa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc210004810 0x7fc22c06ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41446/0 (socket says 172.21.15.122:41446) 2024-05-28T06:05:57.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.581+0000 7fc22be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc22c142190 0x7fc22c142610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.581+0000 7fc22be00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c0cf9c0 con 0x7fc210004810 2024-05-28T06:05:57.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.581+0000 7fc22be00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c0cf840 con 0x7fc22c143be0 2024-05-28T06:05:57.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.581+0000 7fc22be00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc22c0cfda0 con 0x7fc22c142190 2024-05-28T06:05:57.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.581+0000 7fc22aa00640 1 -- 172.21.15.122:0/1321678873 learned_addr learned my addr 172.21.15.122:0/1321678873 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:57.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.581+0000 7fc22a000640 1 --2- 172.21.15.122:0/1321678873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc22c143be0 0x7fc22c144060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.581+0000 7fc22b400640 1 --2- 172.21.15.122:0/1321678873 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc22c142190 0x7fc22c142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.581+0000 7fc22a000640 1 -- 172.21.15.122:0/1321678873 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc22c142190 msgr2=0x7fc22c142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.581+0000 7fc22a000640 1 --2- 172.21.15.122:0/1321678873 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc22c142190 0x7fc22c142610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.581+0000 7fc22a000640 1 -- 172.21.15.122:0/1321678873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc210004810 msgr2=0x7fc22c06ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.581+0000 7fc22a000640 1 --2- 172.21.15.122:0/1321678873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc210004810 0x7fc22c06ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.581+0000 7fc22a000640 1 -- 172.21.15.122:0/1321678873 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22c0cec50 con 0x7fc22c143be0 2024-05-28T06:05:57.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.581+0000 7fc22a000640 1 --2- 172.21.15.122:0/1321678873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc22c143be0 0x7fc22c144060 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc21c0ac000 tx=0x7fc21c01c290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.581+0000 7fc222a00640 1 -- 172.21.15.122:0/1321678873 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21c005a90 con 0x7fc22c143be0 2024-05-28T06:05:57.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.581+0000 7fc222a00640 1 -- 172.21.15.122:0/1321678873 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc21c005c30 con 0x7fc22c143be0 2024-05-28T06:05:57.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.581+0000 7fc222a00640 1 -- 172.21.15.122:0/1321678873 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21c007070 con 0x7fc22c143be0 2024-05-28T06:05:57.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.581+0000 7fc22be00640 1 -- 172.21.15.122:0/1321678873 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc22c0ce970 con 0x7fc22c143be0 2024-05-28T06:05:57.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.581+0000 7fc22be00640 1 -- 172.21.15.122:0/1321678873 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc22c141990 con 0x7fc22c143be0 2024-05-28T06:05:57.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.585+0000 7fc222a00640 1 -- 172.21.15.122:0/1321678873 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc21c007210 con 0x7fc22c143be0 2024-05-28T06:05:57.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.589+0000 7fc222a00640 1 --2- 172.21.15.122:0/1321678873 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc20c068480 0x7fc20c06a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.589+0000 7fc217e00640 1 -- 172.21.15.122:0/1321678873 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc22c075620 con 0x7fc22c143be0 2024-05-28T06:05:57.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.589+0000 7fc222a00640 1 -- 172.21.15.122:0/1321678873 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc21c1239f0 con 0x7fc22c143be0 2024-05-28T06:05:57.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.593+0000 7fc22aa00640 1 --2- 172.21.15.122:0/1321678873 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc20c068480 0x7fc20c06a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.593+0000 7fc22aa00640 1 --2- 172.21.15.122:0/1321678873 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc20c068480 0x7fc20c06a940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc218006ca0 tx=0x7fc218009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.593+0000 7fc222a00640 1 -- 172.21.15.122:0/1321678873 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc21c019200 con 0x7fc22c143be0 2024-05-28T06:05:57.650 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.649+0000 7f6abae00640 1 Processor -- start 2024-05-28T06:05:57.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.649+0000 7f6abae00640 1 -- start start 2024-05-28T06:05:57.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.649+0000 7f6abae00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6ab40d4690 0x7f6ab40d4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.649+0000 7f6abae00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ab40d4fb0 con 0x7f6ab40d2af0 2024-05-28T06:05:57.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.649+0000 7f6abae00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ab40ba690 con 0x7f6ab40d4140 2024-05-28T06:05:57.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.649+0000 7f6abae00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f6ab4162510 con 0x7f6ab40d4690 2024-05-28T06:05:57.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.653+0000 7f6ab3e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6ab40d4690 0x7f6ab40d4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.653+0000 7f6ab3e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6ab40d4690 0x7f6ab40d4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41452/0 (socket says 172.21.15.122:41452) 2024-05-28T06:05:57.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.653+0000 7f6ab3e00640 1 -- 172.21.15.122:0/3979202619 learned_addr learned my addr 172.21.15.122:0/3979202619 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:57.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.653+0000 7f6ab3e00640 1 -- 172.21.15.122:0/3979202619 >> v1:172.21.15.153:6789/0 conn(0x7f6ab40d4140 legacy=0x7f6ab40b9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:57.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.653+0000 7f6ab3e00640 1 -- 172.21.15.122:0/3979202619 >> v1:172.21.15.122:6789/0 conn(0x7f6ab40d2af0 legacy=0x7f6ab40d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.653+0000 7f6ab3e00640 1 -- 172.21.15.122:0/3979202619 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab41627f0 con 0x7f6ab40d4690 2024-05-28T06:05:57.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.657+0000 7f58db600640 1 Processor -- start 2024-05-28T06:05:57.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.657+0000 7f6ab3e00640 1 --2- 172.21.15.122:0/3979202619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ab40d4690 0x7f6ab40d4a70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6aac009870 tx=0x7f6aac01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9092eb8cf9035c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.657+0000 7f58db600640 1 -- start start 2024-05-28T06:05:57.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.657+0000 7f58db600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f58d41491a0 0x7f58d41633e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.657+0000 7f58db600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d4164150 con 0x7f58d4148dc0 2024-05-28T06:05:57.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.657+0000 7f58db600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d40b3660 con 0x7f58d40b23c0 2024-05-28T06:05:57.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.657+0000 7f58db600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f58d40b5980 con 0x7f58d41491a0 2024-05-28T06:05:57.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.657+0000 7f58d3e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f58d41491a0 0x7f58d41633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.657+0000 7f6ab2a00640 1 -- 172.21.15.122:0/3979202619 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac0ab610 con 0x7f6ab40d4690 2024-05-28T06:05:57.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.657+0000 7f58d3e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f58d41491a0 0x7f58d41633e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:37452/0 (socket says 172.21.15.122:37452) 2024-05-28T06:05:57.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.661+0000 7f58d3e00640 1 -- 172.21.15.122:0/3664852945 learned_addr learned my addr 172.21.15.122:0/3664852945 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:57.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.661+0000 7f6ab2a00640 1 -- 172.21.15.122:0/3979202619 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aac0b0070 con 0x7f6ab40d4690 2024-05-28T06:05:57.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.661+0000 7f6a15e00640 1 Processor -- start 2024-05-28T06:05:57.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.661+0000 7f6ab2a00640 1 -- 172.21.15.122:0/3979202619 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac0ab9d0 con 0x7f6ab40d4690 2024-05-28T06:05:57.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.661+0000 7f58d3e00640 1 -- 172.21.15.122:0/3664852945 >> v1:172.21.15.153:6789/0 conn(0x7f58d40b23c0 legacy=0x7f58d4163920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-28T06:05:57.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.661+0000 7f58d3e00640 1 -- 172.21.15.122:0/3664852945 >> v1:172.21.15.122:6789/0 conn(0x7f58d4148dc0 legacy=0x7f58d40b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.661+0000 7f58d3e00640 1 -- 172.21.15.122:0/3664852945 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d40b3940 con 0x7f58d41491a0 2024-05-28T06:05:57.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.661+0000 7f6abae00640 1 -- 172.21.15.122:0/3979202619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ab40d4690 msgr2=0x7f6ab40d4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.661+0000 7f6abae00640 1 --2- 172.21.15.122:0/3979202619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ab40d4690 0x7f6ab40d4a70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6aac009870 tx=0x7f6aac01c520 comp rx=0 tx=0).stop 2024-05-28T06:05:57.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.661+0000 7f6a15e00640 1 -- start start 2024-05-28T06:05:57.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.661+0000 7f6a15e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6a0804f500 0x7f6a0804f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.661+0000 7f6a15e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a080482b0 0x7f6a08038d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.661+0000 7f6abae00640 1 -- 172.21.15.122:0/3979202619 shutdown_connections 2024-05-28T06:05:57.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.661+0000 7f6abae00640 1 --2- 172.21.15.122:0/3979202619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ab40d4690 0x7f6ab40d4a70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.661+0000 7f6abae00640 1 -- 172.21.15.122:0/3979202619 >> 172.21.15.122:0/3979202619 conn(0x7f6ab406cc80 msgr2=0x7f6ab406d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:57.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.661+0000 7f6a0ea00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6a0804f500 0x7f6a0804f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.661+0000 7f6a0ea00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6a0804f500 0x7f6a0804f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:37458/0 (socket says 172.21.15.122:37458) 2024-05-28T06:05:57.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.661+0000 7f6a0fe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a080482b0 0x7f6a08038d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.661+0000 7f6a0fe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a080482b0 0x7f6a08038d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:50396/0 (socket says 172.21.15.122:50396) 2024-05-28T06:05:57.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.661+0000 7f6a0e000640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6a08047d60 0x7f6a08052e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:36660/0 (socket says 172.21.15.122:36660) 2024-05-28T06:05:57.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.661+0000 7f6a0ea00640 1 -- 172.21.15.122:0/3496848197 learned_addr learned my addr 172.21.15.122:0/3496848197 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:57.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.661+0000 7f6abae00640 1 -- 172.21.15.122:0/3979202619 shutdown_connections 2024-05-28T06:05:57.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.665+0000 7f6a15e00640 1 -- 172.21.15.122:0/3496848197 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a0804fe20 con 0x7f6a08047d60 2024-05-28T06:05:57.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.665+0000 7f6a15e00640 1 -- 172.21.15.122:0/3496848197 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6a08006b20 con 0x7f6a0804f500 2024-05-28T06:05:57.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.665+0000 7f6a15e00640 1 -- 172.21.15.122:0/3496848197 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6a08006e00 con 0x7f6a080482b0 2024-05-28T06:05:57.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.665+0000 7f6a0d600640 1 -- 172.21.15.122:0/3496848197 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3818524280 0 0) 0x7f6a0804fe20 con 0x7f6a08047d60 2024-05-28T06:05:57.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.665+0000 7f6a0d600640 1 -- 172.21.15.122:0/3496848197 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69f4003530 con 0x7f6a08047d60 2024-05-28T06:05:57.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.665+0000 7f6a0fe00640 1 -- 172.21.15.122:0/3496848197 >> v2:172.21.15.153:3300/0 conn(0x7f6a0804f500 msgr2=0x7f6a0804f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:57.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.665+0000 7f58d3e00640 1 --2- 172.21.15.122:0/3664852945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58d41491a0 0x7f58d41633e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009e50 tx=0x7f58cc01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ffebba839aaf1af server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.661+0000 7f6abae00640 1 -- 172.21.15.122:0/3979202619 wait complete. 2024-05-28T06:05:57.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.665+0000 7f6abae00640 1 Processor -- start 2024-05-28T06:05:57.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.665+0000 7f6a0fe00640 1 --2- 172.21.15.122:0/3496848197 >> v2:172.21.15.153:3300/0 conn(0x7f6a0804f500 0x7f6a0804f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.665+0000 7f6a0fe00640 1 -- 172.21.15.122:0/3496848197 >> v1:172.21.15.153:6789/0 conn(0x7f6a08047d60 legacy=0x7f6a08052e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.665+0000 7f6a0d600640 1 -- 172.21.15.122:0/3496848197 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2456997899 0 0) 0x7f69f4003530 con 0x7f6a08047d60 2024-05-28T06:05:57.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.665+0000 7f6a0fe00640 1 -- 172.21.15.122:0/3496848197 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a080070e0 con 0x7f6a080482b0 2024-05-28T06:05:57.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.665+0000 7f6abae00640 1 -- start start 2024-05-28T06:05:57.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.665+0000 7f58d3400640 1 -- 172.21.15.122:0/3664852945 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc0a5810 con 0x7f58d41491a0 2024-05-28T06:05:57.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.665+0000 7f58d3400640 1 -- 172.21.15.122:0/3664852945 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58cc0a59b0 con 0x7f58d41491a0 2024-05-28T06:05:57.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.665+0000 7f58d3400640 1 -- 172.21.15.122:0/3664852945 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc0a5dc0 con 0x7f58d41491a0 2024-05-28T06:05:57.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f58db600640 1 -- 172.21.15.122:0/3664852945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58d41491a0 msgr2=0x7f58d41633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f58db600640 1 --2- 172.21.15.122:0/3664852945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58d41491a0 0x7f58d41633e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009e50 tx=0x7f58cc01c950 comp rx=0 tx=0).stop 2024-05-28T06:05:57.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f58db600640 1 -- 172.21.15.122:0/3664852945 shutdown_connections 2024-05-28T06:05:57.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f58db600640 1 --2- 172.21.15.122:0/3664852945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58d41491a0 0x7f58d41633e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f58db600640 1 -- 172.21.15.122:0/3664852945 >> 172.21.15.122:0/3664852945 conn(0x7f58d4062840 msgr2=0x7f58d406b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:57.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f58db600640 1 -- 172.21.15.122:0/3664852945 shutdown_connections 2024-05-28T06:05:57.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f58db600640 1 -- 172.21.15.122:0/3664852945 wait complete. 2024-05-28T06:05:57.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f6abae00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab40d2af0 0x7f6ab415d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f6abae00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ab40d4140 0x7f6ab40c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f6abae00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6ab40d4690 0x7f6ab40c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f6abae00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab416c940 con 0x7f6ab40d4140 2024-05-28T06:05:57.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f6a0fe00640 1 --2- 172.21.15.122:0/3496848197 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a080482b0 0x7f6a08038d40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0097c0 tx=0x7f69fc01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7c7d79f431e70d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f6abae00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab416c7c0 con 0x7f6ab40d2af0 2024-05-28T06:05:57.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f6abae00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab416cac0 con 0x7f6ab40d4690 2024-05-28T06:05:57.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f6ab3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab40d2af0 0x7f6ab415d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f6ab8e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6ab40d4690 0x7f6ab40c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f6ab8e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6ab40d4690 0x7f6ab40c9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:50410/0 (socket says 172.21.15.122:50410) 2024-05-28T06:05:57.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f6ab8e00640 1 -- 172.21.15.122:0/3692765201 learned_addr learned my addr 172.21.15.122:0/3692765201 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:57.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f6ab8e00640 1 -- 172.21.15.122:0/3692765201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab40d2af0 msgr2=0x7f6ab415d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f6ab8e00640 1 --2- 172.21.15.122:0/3692765201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab40d2af0 0x7f6ab415d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f6ab8e00640 1 -- 172.21.15.122:0/3692765201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ab40d4140 msgr2=0x7f6ab40c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f6ab3400640 1 --2- 172.21.15.122:0/3692765201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ab40d4140 0x7f6ab40c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f6ab8e00640 1 --2- 172.21.15.122:0/3692765201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ab40d4140 0x7f6ab40c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f6ab8e00640 1 -- 172.21.15.122:0/3692765201 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab40ccd00 con 0x7f6ab40d4690 2024-05-28T06:05:57.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f6ab3400640 1 --2- 172.21.15.122:0/3692765201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ab40d4140 0x7f6ab40c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:05:57.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f6ab8e00640 1 --2- 172.21.15.122:0/3692765201 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6ab40d4690 0x7f6ab40c9910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6aa400c730 tx=0x7f6aa400cb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f6aabe00640 1 -- 172.21.15.122:0/3692765201 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4016020 con 0x7f6ab40d4690 2024-05-28T06:05:57.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f6aabe00640 1 -- 172.21.15.122:0/3692765201 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa4006d60 con 0x7f6ab40d4690 2024-05-28T06:05:57.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f6aabe00640 1 -- 172.21.15.122:0/3692765201 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4003bc0 con 0x7f6ab40d4690 2024-05-28T06:05:57.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f6abae00640 1 -- 172.21.15.122:0/3692765201 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab40ccfe0 con 0x7f6ab40d4690 2024-05-28T06:05:57.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f6abae00640 1 -- 172.21.15.122:0/3692765201 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab40cd5a0 con 0x7f6ab40d4690 2024-05-28T06:05:57.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f6a0d600640 1 -- 172.21.15.122:0/3496848197 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc0b0070 con 0x7f6a080482b0 2024-05-28T06:05:57.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f6a0d600640 1 -- 172.21.15.122:0/3496848197 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69fc0ab400 con 0x7f6a080482b0 2024-05-28T06:05:57.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f6a0d600640 1 -- 172.21.15.122:0/3496848197 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00001680 con 0x7f6a080482b0 2024-05-28T06:05:57.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f6a15e00640 1 -- 172.21.15.122:0/3496848197 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a080482b0 msgr2=0x7f6a08038d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f6a15e00640 1 --2- 172.21.15.122:0/3496848197 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a080482b0 0x7f6a08038d40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0097c0 tx=0x7f69fc01c3c0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f6a15e00640 1 -- 172.21.15.122:0/3496848197 shutdown_connections 2024-05-28T06:05:57.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f6a15e00640 1 --2- 172.21.15.122:0/3496848197 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a080482b0 0x7f6a08038d40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f6a15e00640 1 --2- 172.21.15.122:0/3496848197 >> v2:172.21.15.153:3300/0 conn(0x7f6a0804f500 0x7f6a0804f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f6a15e00640 1 -- 172.21.15.122:0/3496848197 >> 172.21.15.122:0/3496848197 conn(0x7f6a08054ca0 msgr2=0x7f6a080550b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:57.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f58db600640 1 Processor -- start 2024-05-28T06:05:57.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.669+0000 7f58db600640 1 -- start start 2024-05-28T06:05:57.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f58db600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58d40b23c0 0x7f58d413a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f58db600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58d4148dc0 0x7f58d414a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f58db600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58d41491a0 0x7f58d41fed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f58d3e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58d4148dc0 0x7f58d414a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f58d3e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58d4148dc0 0x7f58d414a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:50418/0 (socket says 172.21.15.122:50418) 2024-05-28T06:05:57.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f58d8c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58d40b23c0 0x7f58d413a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f58d8c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58d40b23c0 0x7f58d413a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:37464/0 (socket says 172.21.15.122:37464) 2024-05-28T06:05:57.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f58d3e00640 1 -- 172.21.15.122:0/2179490036 learned_addr learned my addr 172.21.15.122:0/2179490036 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:57.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f58db600640 1 -- 172.21.15.122:0/2179490036 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f58d41708e0 con 0x7f58d41491a0 2024-05-28T06:05:57.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f58db600640 1 -- 172.21.15.122:0/2179490036 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f58d4170760 con 0x7f58d40b23c0 2024-05-28T06:05:57.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f58db600640 1 -- 172.21.15.122:0/2179490036 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f58d4170a60 con 0x7f58d4148dc0 2024-05-28T06:05:57.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f58d9600640 1 --2- 172.21.15.122:0/2179490036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58d41491a0 0x7f58d41fed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f6a15e00640 1 -- 172.21.15.122:0/3496848197 shutdown_connections 2024-05-28T06:05:57.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f6a15e00640 1 -- 172.21.15.122:0/3496848197 wait complete. 2024-05-28T06:05:57.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f58d3e00640 1 -- 172.21.15.122:0/2179490036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58d40b23c0 msgr2=0x7f58d413a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f58d3e00640 1 --2- 172.21.15.122:0/2179490036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58d40b23c0 0x7f58d413a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f58d3e00640 1 -- 172.21.15.122:0/2179490036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58d41491a0 msgr2=0x7f58d41fed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f58d3e00640 1 --2- 172.21.15.122:0/2179490036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58d41491a0 0x7f58d41fed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f58d3e00640 1 -- 172.21.15.122:0/2179490036 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d4149790 con 0x7f58d4148dc0 2024-05-28T06:05:57.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f58d3e00640 1 --2- 172.21.15.122:0/2179490036 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58d4148dc0 0x7f58d414a550 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f58cc01a580 tx=0x7f58cc0196f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f58d0c00640 1 -- 172.21.15.122:0/2179490036 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc0bc020 con 0x7f58d4148dc0 2024-05-28T06:05:57.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f58d0c00640 1 -- 172.21.15.122:0/2179490036 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58cc0b8880 con 0x7f58d4148dc0 2024-05-28T06:05:57.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.673+0000 7f58d0c00640 1 -- 172.21.15.122:0/2179490036 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc0b8c70 con 0x7f58d4148dc0 2024-05-28T06:05:57.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.677+0000 7f6a15e00640 1 Processor -- start 2024-05-28T06:05:57.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.677+0000 7f6aabe00640 1 -- 172.21.15.122:0/3692765201 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6aa40050d0 con 0x7f6ab40d4690 2024-05-28T06:05:57.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.677+0000 7f58db600640 1 -- 172.21.15.122:0/2179490036 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d4149a70 con 0x7f58d4148dc0 2024-05-28T06:05:57.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.677+0000 7f58db600640 1 -- 172.21.15.122:0/2179490036 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d414aa90 con 0x7f58d4148dc0 2024-05-28T06:05:57.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.677+0000 7f6a15e00640 1 -- start start 2024-05-28T06:05:57.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.677+0000 7f58ca000640 1 -- 172.21.15.122:0/2179490036 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58a40052a0 con 0x7f58d4148dc0 2024-05-28T06:05:57.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.677+0000 7f6aabe00640 1 --2- 172.21.15.122:0/3692765201 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6a900683b0 0x7f6a9006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f6a15e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a08047d60 0x7f6a08033cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f3eebe00640 1 Processor -- start 2024-05-28T06:05:57.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.677+0000 7f6aa9600640 1 -- 172.21.15.122:0/3692765201 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a840052a0 con 0x7f6ab40d4690 2024-05-28T06:05:57.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f6a15e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a080482b0 0x7f6a0804e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f6aabe00640 1 -- 172.21.15.122:0/3692765201 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6aa40865a0 con 0x7f6ab40d4690 2024-05-28T06:05:57.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f6a0ea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a08047d60 0x7f6a08033cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f6a0ea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a08047d60 0x7f6a08033cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:50422/0 (socket says 172.21.15.122:50422) 2024-05-28T06:05:57.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f6a0ea00640 1 -- 172.21.15.122:0/2635448184 learned_addr learned my addr 172.21.15.122:0/2635448184 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:57.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f6a15e00640 1 --2- 172.21.15.122:0/2635448184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a0804f500 0x7f6a08188600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f6ab3e00640 1 --2- 172.21.15.122:0/3692765201 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6a900683b0 0x7f6a9006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f6a15e00640 1 -- 172.21.15.122:0/2635448184 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6a080f3fe0 con 0x7f6a080482b0 2024-05-28T06:05:57.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f6a15e00640 1 -- 172.21.15.122:0/2635448184 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6a080f3e60 con 0x7f6a0804f500 2024-05-28T06:05:57.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f6a15e00640 1 -- 172.21.15.122:0/2635448184 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6a080f4160 con 0x7f6a08047d60 2024-05-28T06:05:57.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f6a0fe00640 1 --2- 172.21.15.122:0/2635448184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a0804f500 0x7f6a08188600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f3eebe00640 1 -- start start 2024-05-28T06:05:57.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f3eebe00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3ee415a940 0x7f3ee40cd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f58d0c00640 1 -- 172.21.15.122:0/2179490036 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f58cc0bf020 con 0x7f58d4148dc0 2024-05-28T06:05:57.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f58d0c00640 1 --2- 172.21.15.122:0/2179490036 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f58b0068450 0x7f58b006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f58d0c00640 1 -- 172.21.15.122:0/2179490036 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f58cc121e20 con 0x7f58d4148dc0 2024-05-28T06:05:57.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f6ab3e00640 1 --2- 172.21.15.122:0/3692765201 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6a900683b0 0x7f6a9006a870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0af000 tx=0x7f6aac0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f6a0fe00640 1 -- 172.21.15.122:0/2635448184 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a08047d60 msgr2=0x7f6a08033cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f6a0fe00640 1 --2- 172.21.15.122:0/2635448184 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a08047d60 0x7f6a08033cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f6a0fe00640 1 -- 172.21.15.122:0/2635448184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a080482b0 msgr2=0x7f6a0804e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f6a0e000640 1 --2- 172.21.15.122:0/2635448184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a080482b0 0x7f6a0804e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f6a0fe00640 1 --2- 172.21.15.122:0/2635448184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a080482b0 0x7f6a0804e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f6a0fe00640 1 -- 172.21.15.122:0/2635448184 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0804d060 con 0x7f6a0804f500 2024-05-28T06:05:57.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f58d8c00640 1 --2- 172.21.15.122:0/2179490036 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f58b0068450 0x7f58b006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f3ee9400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3ee415a940 0x7f3ee40cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f3ee9400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3ee415a940 0x7f3ee40cd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41478/0 (socket says 172.21.15.122:41478) 2024-05-28T06:05:57.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f3ee9400640 1 -- 172.21.15.122:0/2392864852 learned_addr learned my addr 172.21.15.122:0/2392864852 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:57.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.681+0000 7f6a0fe00640 1 --2- 172.21.15.122:0/2635448184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a0804f500 0x7f6a08188600 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0ab000 tx=0x7f69fc019160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3eebe00640 1 --2- 172.21.15.122:0/2392864852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ee4071f30 0x7f3ee40723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f58d8c00640 1 --2- 172.21.15.122:0/2179490036 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f58b0068450 0x7f58b006a910 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f58c4000f70 tx=0x7f58c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f6a07400640 1 -- 172.21.15.122:0/2635448184 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc0b0040 con 0x7f6a0804f500 2024-05-28T06:05:57.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f6a0e000640 1 --2- 172.21.15.122:0/2635448184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a080482b0 0x7f6a0804e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:05:57.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3eebe00640 1 -- 172.21.15.122:0/2392864852 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ee40cc870 con 0x7f3ee40af8d0 2024-05-28T06:05:57.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f6a07400640 1 -- 172.21.15.122:0/2635448184 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69fc0b9070 con 0x7f6a0804f500 2024-05-28T06:05:57.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f6a07400640 1 -- 172.21.15.122:0/2635448184 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc0b4870 con 0x7f6a0804f500 2024-05-28T06:05:57.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3eebe00640 1 -- 172.21.15.122:0/2392864852 --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f3ee40b5330 con 0x7f3ee415a940 2024-05-28T06:05:57.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3eebe00640 1 -- 172.21.15.122:0/2392864852 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3ee40b5550 con 0x7f3ee4071f30 2024-05-28T06:05:57.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee9e00640 1 --2- 172.21.15.122:0/2392864852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ee4071f30 0x7f3ee40723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f6a15e00640 1 -- 172.21.15.122:0/2635448184 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a0804d340 con 0x7f6a0804f500 2024-05-28T06:05:57.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f6a15e00640 1 -- 172.21.15.122:0/2635448184 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a0804d900 con 0x7f6a0804f500 2024-05-28T06:05:57.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee3e00640 1 -- 172.21.15.122:0/2392864852 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1802117373 0 0) 0x7f3ee40cc870 con 0x7f3ee40af8d0 2024-05-28T06:05:57.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee3e00640 1 -- 172.21.15.122:0/2392864852 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ecc003530 con 0x7f3ee40af8d0 2024-05-28T06:05:57.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee3e00640 1 -- 172.21.15.122:0/2392864852 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2955736236 0 0) 0x7f3ecc003530 con 0x7f3ee40af8d0 2024-05-28T06:05:57.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee3e00640 1 -- 172.21.15.122:0/2392864852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ee4071f30 msgr2=0x7f3ee40723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:57.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee3e00640 1 --2- 172.21.15.122:0/2392864852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ee4071f30 0x7f3ee40723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee3e00640 1 -- 172.21.15.122:0/2392864852 >> v2:172.21.15.122:3300/0 conn(0x7f3ee415a940 msgr2=0x7f3ee40cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:57.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee3e00640 1 --2- 172.21.15.122:0/2392864852 >> v2:172.21.15.122:3300/0 conn(0x7f3ee415a940 0x7f3ee40cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee3e00640 1 -- 172.21.15.122:0/2392864852 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee40ccb50 con 0x7f3ee40af8d0 2024-05-28T06:05:57.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee3e00640 1 -- 172.21.15.122:0/2392864852 <== mon.1 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f3ed0001680 con 0x7f3ee40af8d0 2024-05-28T06:05:57.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee3e00640 1 -- 172.21.15.122:0/2392864852 >> v1:172.21.15.153:6789/0 conn(0x7f3ee40af8d0 legacy=0x7f3ee40b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee3e00640 1 --2- 172.21.15.122:0/2392864852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ee4071f30 0x7f3ecc0037b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee3e00640 1 --2- 172.21.15.122:0/2392864852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ecc003cf0 0x7f3ecc004170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee3e00640 1 --2- 172.21.15.122:0/2392864852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ecc00b020 0x7f3ecc00d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee3e00640 1 -- 172.21.15.122:0/2392864852 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee40b5330 con 0x7f3ecc003cf0 2024-05-28T06:05:57.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee3e00640 1 -- 172.21.15.122:0/2392864852 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee40b5550 con 0x7f3ecc00b020 2024-05-28T06:05:57.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee3e00640 1 -- 172.21.15.122:0/2392864852 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3ecc00dc60 con 0x7f3ee4071f30 2024-05-28T06:05:57.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee9400640 1 --2- 172.21.15.122:0/2392864852 >> v2:172.21.15.122:3300/0 conn(0x7f3ee415a940 0x7f3ee40cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:05:57.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f58d0c00640 1 -- 172.21.15.122:0/2179490036 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f58cc0c6030 con 0x7f58d4148dc0 2024-05-28T06:05:57.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee9e00640 1 --2- 172.21.15.122:0/2392864852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ecc00b020 0x7f3ecc00d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee8a00640 1 --2- 172.21.15.122:0/2392864852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ecc003cf0 0x7f3ecc004170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee9400640 1 --2- 172.21.15.122:0/2392864852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ee4071f30 0x7f3ecc0037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f6a04c00640 1 -- 172.21.15.122:0/2635448184 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a08005570 con 0x7f6a0804f500 2024-05-28T06:05:57.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee9e00640 1 -- 172.21.15.122:0/2392864852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ee4071f30 msgr2=0x7f3ecc0037b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:57.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee9e00640 1 --2- 172.21.15.122:0/2392864852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ee4071f30 0x7f3ecc0037b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee9e00640 1 -- 172.21.15.122:0/2392864852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ecc003cf0 msgr2=0x7f3ecc004170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:57.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee9e00640 1 --2- 172.21.15.122:0/2392864852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ecc003cf0 0x7f3ecc004170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.685+0000 7f3ee9e00640 1 -- 172.21.15.122:0/2392864852 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee40ccb50 con 0x7f3ecc00b020 2024-05-28T06:05:57.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.689+0000 7f3ee9400640 1 --2- 172.21.15.122:0/2392864852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ee4071f30 0x7f3ecc0037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:05:57.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.689+0000 7f3ee8a00640 1 --2- 172.21.15.122:0/2392864852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ecc003cf0 0x7f3ecc004170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:05:57.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.689+0000 7f6a07400640 1 -- 172.21.15.122:0/2635448184 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f69fc0daab0 con 0x7f6a0804f500 2024-05-28T06:05:57.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.693+0000 7f3ee9e00640 1 --2- 172.21.15.122:0/2392864852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ecc00b020 0x7f3ecc00d410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009fc0 tx=0x7f3edc01cce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=379f7b2eb02364f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.693+0000 7f6aabe00640 1 -- 172.21.15.122:0/3692765201 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6aa4020020 con 0x7f6ab40d4690 2024-05-28T06:05:57.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.693+0000 7f6a07400640 1 --2- 172.21.15.122:0/2635448184 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f69f0068450 0x7f69f006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.693+0000 7f6a07400640 1 -- 172.21.15.122:0/2635448184 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f69fc120a90 con 0x7f6a0804f500 2024-05-28T06:05:57.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.693+0000 7f3ee3e00640 1 -- 172.21.15.122:0/2392864852 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3edc0b2070 con 0x7f3ecc00b020 2024-05-28T06:05:57.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.693+0000 7f6a0ea00640 1 --2- 172.21.15.122:0/2635448184 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f69f0068450 0x7f69f006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.693+0000 7f6a07400640 1 -- 172.21.15.122:0/2635448184 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f69fc015fb0 con 0x7f6a0804f500 2024-05-28T06:05:57.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.693+0000 7f3ee3e00640 1 -- 172.21.15.122:0/2392864852 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3edc0a5c70 con 0x7f3ecc00b020 2024-05-28T06:05:57.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.693+0000 7f3eebe00640 1 -- 172.21.15.122:0/2392864852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ecc00b020 msgr2=0x7f3ecc00d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.693+0000 7f3ee3e00640 1 -- 172.21.15.122:0/2392864852 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3edc0b2070 con 0x7f3ecc00b020 2024-05-28T06:05:57.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.693+0000 7f3eebe00640 1 --2- 172.21.15.122:0/2392864852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ecc00b020 0x7f3ecc00d410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009fc0 tx=0x7f3edc01cce0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.693+0000 7f6a0ea00640 1 --2- 172.21.15.122:0/2635448184 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f69f0068450 0x7f69f006a910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6a10065520 tx=0x7f6a10068930 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.693+0000 7f3ee9e00640 1 -- 172.21.15.122:0/2392864852 reap_dead start 2024-05-28T06:05:57.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.693+0000 7f3eebe00640 1 -- 172.21.15.122:0/2392864852 shutdown_connections 2024-05-28T06:05:57.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.693+0000 7f3eebe00640 1 -- 172.21.15.122:0/2392864852 >> 172.21.15.122:0/2392864852 conn(0x7f3ee4062610 msgr2=0x7f3ee406b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:57.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.693+0000 7f3eebe00640 1 -- 172.21.15.122:0/2392864852 shutdown_connections 2024-05-28T06:05:57.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.693+0000 7f3eebe00640 1 -- 172.21.15.122:0/2392864852 wait complete. 2024-05-28T06:05:57.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.697+0000 7f3eebe00640 1 Processor -- start 2024-05-28T06:05:57.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.697+0000 7f3eebe00640 1 -- start start 2024-05-28T06:05:57.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.701+0000 7f3eebe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ecc00b020 0x7f3ee413d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.701+0000 7f3eebe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee414af60 0x7f3ee413dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.701+0000 7f3eebe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ee41581a0 0x7f3ee4158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.701+0000 7f3eebe00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee40728a0 con 0x7f3ecc00b020 2024-05-28T06:05:57.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.701+0000 7f3eebe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee4072720 con 0x7f3ee414af60 2024-05-28T06:05:57.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.701+0000 7f3eebe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3ee406e7a0 con 0x7f3ee41581a0 2024-05-28T06:05:57.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.701+0000 7f3ee8a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee414af60 0x7f3ee413dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.701+0000 7f3ee8a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee414af60 0x7f3ee413dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:37490/0 (socket says 172.21.15.122:37490) 2024-05-28T06:05:57.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.701+0000 7f3ee8a00640 1 -- 172.21.15.122:0/1951154844 learned_addr learned my addr 172.21.15.122:0/1951154844 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:57.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.701+0000 7f3ee9e00640 1 --2- 172.21.15.122:0/1951154844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ee41581a0 0x7f3ee4158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.701+0000 7f3ee8a00640 1 -- 172.21.15.122:0/1951154844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ee41581a0 msgr2=0x7f3ee4158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.701+0000 7f3ee8a00640 1 --2- 172.21.15.122:0/1951154844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ee41581a0 0x7f3ee4158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.701+0000 7f3ee8a00640 1 -- 172.21.15.122:0/1951154844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ecc00b020 msgr2=0x7f3ee413d9a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-28T06:05:57.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.701+0000 7f3ee8a00640 1 --2- 172.21.15.122:0/1951154844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ecc00b020 0x7f3ee413d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.701+0000 7f3ee8a00640 1 -- 172.21.15.122:0/1951154844 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee414cf40 con 0x7f3ee414af60 2024-05-28T06:05:57.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.701+0000 7f3ee9e00640 1 --2- 172.21.15.122:0/1951154844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ee41581a0 0x7f3ee4158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:05:57.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.701+0000 7f3ee8a00640 1 --2- 172.21.15.122:0/1951154844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee414af60 0x7f3ee413dee0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3ed000d900 tx=0x7f3ed000ddc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.701+0000 7f3ee1600640 1 -- 172.21.15.122:0/1951154844 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0005480 con 0x7f3ee414af60 2024-05-28T06:05:57.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.705+0000 7f3ee1600640 1 -- 172.21.15.122:0/1951154844 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed0017070 con 0x7f3ee414af60 2024-05-28T06:05:57.707 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.705+0000 7f3eebe00640 1 -- 172.21.15.122:0/1951154844 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ee414d360 con 0x7f3ee414af60 2024-05-28T06:05:57.707 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.705+0000 7f3ee1600640 1 -- 172.21.15.122:0/1951154844 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed000b9b0 con 0x7f3ee414af60 2024-05-28T06:05:57.707 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.705+0000 7f3eebe00640 1 -- 172.21.15.122:0/1951154844 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ee414d600 con 0x7f3ee414af60 2024-05-28T06:05:57.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.709+0000 7f3ee1600640 1 -- 172.21.15.122:0/1951154844 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3ed000bb50 con 0x7f3ee414af60 2024-05-28T06:05:57.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.709+0000 7f3eebe00640 1 -- 172.21.15.122:0/1951154844 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ee4068bd0 con 0x7f3ee414af60 2024-05-28T06:05:57.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.709+0000 7f3ee1600640 1 --2- 172.21.15.122:0/1951154844 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3ec4068380 0x7f3ec406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.709+0000 7f3ee1600640 1 -- 172.21.15.122:0/1951154844 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3ed0086b80 con 0x7f3ee414af60 2024-05-28T06:05:57.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.709+0000 7f3ee9400640 1 --2- 172.21.15.122:0/1951154844 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3ec4068380 0x7f3ec406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.713+0000 7f3ee9400640 1 --2- 172.21.15.122:0/1951154844 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3ec4068380 0x7f3ec406a840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8009c00 tx=0x7f3ed8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.717+0000 7f3ee1600640 1 -- 172.21.15.122:0/1951154844 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3ed0057130 con 0x7f3ee414af60 2024-05-28T06:05:57.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.725+0000 7fa358400640 1 Processor -- start 2024-05-28T06:05:57.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.725+0000 7fa358400640 1 -- start start 2024-05-28T06:05:57.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.725+0000 7fa358400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa35015a940 0x7fa3500cd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.725+0000 7fa358400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa3500af8d0 0x7fa3500b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.729+0000 7fa355a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa35015a940 0x7fa3500cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.729+0000 7fa355a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa35015a940 0x7fa3500cd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:37504/0 (socket says 172.21.15.122:37504) 2024-05-28T06:05:57.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.729+0000 7fa355a00640 1 -- 172.21.15.122:0/1549360476 learned_addr learned my addr 172.21.15.122:0/1549360476 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:57.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.729+0000 7fa358400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3500cc870 con 0x7fa350071f30 2024-05-28T06:05:57.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.729+0000 7fa358400640 1 -- 172.21.15.122:0/1549360476 --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fa3500b5550 con 0x7fa3500af8d0 2024-05-28T06:05:57.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.729+0000 7fa358400640 1 -- 172.21.15.122:0/1549360476 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa3500ccb50 con 0x7fa35015a940 2024-05-28T06:05:57.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.729+0000 7fa355a00640 1 -- 172.21.15.122:0/1549360476 >> v2:172.21.15.122:3300/0 conn(0x7fa3500af8d0 msgr2=0x7fa3500b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:57.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.729+0000 7fa355a00640 1 --2- 172.21.15.122:0/1549360476 >> v2:172.21.15.122:3300/0 conn(0x7fa3500af8d0 0x7fa3500b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.729+0000 7fa355a00640 1 -- 172.21.15.122:0/1549360476 >> v1:172.21.15.153:6789/0 conn(0x7fa350071f30 legacy=0x7fa35006df90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-28T06:05:57.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.729+0000 7fa355a00640 1 -- 172.21.15.122:0/1549360476 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3500cce30 con 0x7fa35015a940 2024-05-28T06:05:57.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.733+0000 7fa355a00640 1 --2- 172.21.15.122:0/1549360476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa35015a940 0x7fa3500cd630 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa3500743d0 tx=0x7fa344020780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59c83d8e6b631962 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.733+0000 7fa34fe00640 1 -- 172.21.15.122:0/1549360476 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34400d2d0 con 0x7fa35015a940 2024-05-28T06:05:57.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.733+0000 7fa34fe00640 1 -- 172.21.15.122:0/1549360476 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3440a9650 con 0x7fa35015a940 2024-05-28T06:05:57.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.733+0000 7fa34fe00640 1 -- 172.21.15.122:0/1549360476 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3440a9a20 con 0x7fa35015a940 2024-05-28T06:05:57.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.737+0000 7fa358400640 1 -- 172.21.15.122:0/1549360476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa35015a940 msgr2=0x7fa3500cd630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.737+0000 7fa358400640 1 --2- 172.21.15.122:0/1549360476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa35015a940 0x7fa3500cd630 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa3500743d0 tx=0x7fa344020780 comp rx=0 tx=0).stop 2024-05-28T06:05:57.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.737+0000 7fa358400640 1 -- 172.21.15.122:0/1549360476 shutdown_connections 2024-05-28T06:05:57.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.737+0000 7fa358400640 1 --2- 172.21.15.122:0/1549360476 >> v2:172.21.15.122:3300/0 conn(0x7fa3500af8d0 0x7fa3500b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.737+0000 7fa358400640 1 --2- 172.21.15.122:0/1549360476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa35015a940 0x7fa3500cd630 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.737+0000 7fa358400640 1 -- 172.21.15.122:0/1549360476 >> 172.21.15.122:0/1549360476 conn(0x7fa350062610 msgr2=0x7fa35006b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:57.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.737+0000 7fa358400640 1 -- 172.21.15.122:0/1549360476 shutdown_connections 2024-05-28T06:05:57.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.737+0000 7fa358400640 1 -- 172.21.15.122:0/1549360476 wait complete. 2024-05-28T06:05:57.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.737+0000 7f1c4ca00640 1 Processor -- start 2024-05-28T06:05:57.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.737+0000 7f1c4ca00640 1 -- start start 2024-05-28T06:05:57.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.741+0000 7f3b62c00640 1 Processor -- start 2024-05-28T06:05:57.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.741+0000 7fa358400640 1 Processor -- start 2024-05-28T06:05:57.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.741+0000 7f3b62c00640 1 -- start start 2024-05-28T06:05:57.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.741+0000 7fa358400640 1 -- start start 2024-05-28T06:05:57.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.741+0000 7f1c4ca00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c480ceb90 0x7f1c480cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.741+0000 7f1c4ca00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1c4816b9d0 0x7f1c480ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.741+0000 7fa358400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa350071f30 0x7fa350140c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.741+0000 7fa358400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3500af8d0 0x7fa35015f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.741+0000 7f1c4ca00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1c4816be50 0x7f1c4816e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.741+0000 7fa358400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa35015a940 0x7fa3500cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.741+0000 7fa358400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa3500b52e0 con 0x7fa350071f30 2024-05-28T06:05:57.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.741+0000 7f3b62c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3b5c15b4d0 0x7f3b5c06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.741+0000 7f3b62c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b5c15f8a0 0x7f3b5c06f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.741+0000 7f3b62c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b5c15fe50 con 0x7f3b5c0b5260 2024-05-28T06:05:57.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.741+0000 7f3b62c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f3b5c0b4dd0 con 0x7f3b5c15b4d0 2024-05-28T06:05:57.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.741+0000 7f3b62c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5c0b4780 con 0x7f3b5c15f8a0 2024-05-28T06:05:57.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.741+0000 7f3b5be00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3b5c15b4d0 0x7f3b5c06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.741+0000 7f3b5be00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3b5c15b4d0 0x7f3b5c06f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:37514/0 (socket says 172.21.15.122:37514) 2024-05-28T06:05:57.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.741+0000 7f3b5be00640 1 -- 172.21.15.122:0/2241666385 learned_addr learned my addr 172.21.15.122:0/2241666385 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:57.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.741+0000 7fa358400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa3500b5160 con 0x7fa35015a940 2024-05-28T06:05:57.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.741+0000 7fa358400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa35006e6a0 con 0x7fa3500af8d0 2024-05-28T06:05:57.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7f3b60c00640 1 --2- 172.21.15.122:0/2241666385 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b5c15f8a0 0x7f3b5c06f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7f1c45400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1c4816b9d0 0x7f1c480ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7f1c45400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1c4816b9d0 0x7f1c480ccef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41516/0 (socket says 172.21.15.122:41516) 2024-05-28T06:05:57.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7f1c45400640 1 -- 172.21.15.122:0/3386316400 learned_addr learned my addr 172.21.15.122:0/3386316400 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:57.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7f1c4ca00640 1 -- 172.21.15.122:0/3386316400 --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f1c480b3cc0 con 0x7f1c4816b9d0 2024-05-28T06:05:57.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7f1c4ca00640 1 -- 172.21.15.122:0/3386316400 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1c480cf4b0 con 0x7f1c4816be50 2024-05-28T06:05:57.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7f1c4ca00640 1 -- 172.21.15.122:0/3386316400 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1c480b3f40 con 0x7f1c480ceb90 2024-05-28T06:05:57.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7f1c46800640 1 --2- 172.21.15.122:0/3386316400 >> v2:172.21.15.153:3300/0 conn(0x7f1c4816be50 0x7f1c4816e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7fa355000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3500af8d0 0x7fa35015f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7f3b5be00640 1 -- 172.21.15.122:0/2241666385 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b5c15f8a0 msgr2=0x7f3b5c06f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:57.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7f3b5be00640 1 --2- 172.21.15.122:0/2241666385 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b5c15f8a0 0x7f3b5c06f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7f3b5be00640 1 -- 172.21.15.122:0/2241666385 >> v1:172.21.15.122:6789/0 conn(0x7f3b5c0b5260 legacy=0x7f3b5c15f190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-28T06:05:57.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7fa355000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3500af8d0 0x7fa35015f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:50474/0 (socket says 172.21.15.122:50474) 2024-05-28T06:05:57.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7fa355000640 1 -- 172.21.15.122:0/2379791621 learned_addr learned my addr 172.21.15.122:0/2379791621 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:57.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7fa355a00640 1 --2- 172.21.15.122:0/2379791621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa350071f30 0x7fa350140c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7fa356400640 1 --2- 172.21.15.122:0/2379791621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa35015a940 0x7fa3500cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7fa356400640 1 -- 172.21.15.122:0/2379791621 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3500af8d0 msgr2=0x7fa35015f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7f1c46800640 1 -- 172.21.15.122:0/3386316400 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c480ceb90 msgr2=0x7f1c480cef70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-28T06:05:57.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7f1c46800640 1 --2- 172.21.15.122:0/3386316400 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c480ceb90 0x7f1c480cef70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7f1c46800640 1 -- 172.21.15.122:0/3386316400 >> v2:172.21.15.122:3300/0 conn(0x7f1c4816b9d0 msgr2=0x7f1c480ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:57.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7f1c46800640 1 --2- 172.21.15.122:0/3386316400 >> v2:172.21.15.122:3300/0 conn(0x7f1c4816b9d0 0x7f1c480ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7f1c46800640 1 -- 172.21.15.122:0/3386316400 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c480b4200 con 0x7f1c4816be50 2024-05-28T06:05:57.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7f3b5be00640 1 -- 172.21.15.122:0/2241666385 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c0b4a60 con 0x7f3b5c15b4d0 2024-05-28T06:05:57.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7fa356400640 1 --2- 172.21.15.122:0/2379791621 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3500af8d0 0x7fa35015f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7fa356400640 1 -- 172.21.15.122:0/2379791621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa350071f30 msgr2=0x7fa350140c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7fa356400640 1 --2- 172.21.15.122:0/2379791621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa350071f30 0x7fa350140c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.753 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7fa356400640 1 -- 172.21.15.122:0/2379791621 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3501536f0 con 0x7fa35015a940 2024-05-28T06:05:57.753 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7fa356400640 1 --2- 172.21.15.122:0/2379791621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa35015a940 0x7fa3500cf3f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa3480133b0 tx=0x7fa348013870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.753 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7fa34d600640 1 -- 172.21.15.122:0/2379791621 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa348014e50 con 0x7fa35015a940 2024-05-28T06:05:57.753 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7fa34d600640 1 -- 172.21.15.122:0/2379791621 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa34801f070 con 0x7fa35015a940 2024-05-28T06:05:57.753 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7fa34d600640 1 -- 172.21.15.122:0/2379791621 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3480110d0 con 0x7fa35015a940 2024-05-28T06:05:57.753 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7fa358400640 1 -- 172.21.15.122:0/2379791621 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa350153b80 con 0x7fa35015a940 2024-05-28T06:05:57.753 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.745+0000 7fa358400640 1 -- 172.21.15.122:0/2379791621 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa350152650 con 0x7fa35015a940 2024-05-28T06:05:57.753 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.749+0000 7fa34d600640 1 -- 172.21.15.122:0/2379791621 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa348011270 con 0x7fa35015a940 2024-05-28T06:05:57.753 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.749+0000 7f1c45400640 1 --2- 172.21.15.122:0/3386316400 >> v2:172.21.15.122:3300/0 conn(0x7f1c4816b9d0 0x7f1c480ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:05:57.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.749+0000 7fa358400640 1 -- 172.21.15.122:0/2379791621 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa32c0052a0 con 0x7fa35015a940 2024-05-28T06:05:57.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.749+0000 7f3b5be00640 1 --2- 172.21.15.122:0/2241666385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b5c15b4d0 0x7f3b5c06f440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c009870 tx=0x7f3b4c01c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71718666629909bd server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.753+0000 7fa34d600640 1 --2- 172.21.15.122:0/2379791621 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa3300685f0 0x7fa33006aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.749+0000 7f1c46800640 1 --2- 172.21.15.122:0/3386316400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c4816be50 0x7f1c4816e330 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1c4806c8c0 tx=0x7f1c4001c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc3ca8bcf3e55280 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.753+0000 7f1c44a00640 1 -- 172.21.15.122:0/3386316400 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c400b2070 con 0x7f1c4816be50 2024-05-28T06:05:57.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.753+0000 7f1c44a00640 1 -- 172.21.15.122:0/3386316400 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c400a5870 con 0x7f1c4816be50 2024-05-28T06:05:57.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.753+0000 7fa34d600640 1 -- 172.21.15.122:0/2379791621 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa34808f130 con 0x7fa35015a940 2024-05-28T06:05:57.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.753+0000 7fa355a00640 1 --2- 172.21.15.122:0/2379791621 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa3300685f0 0x7fa33006aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.753+0000 7f1c4ca00640 1 -- 172.21.15.122:0/3386316400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c4816be50 msgr2=0x7f1c4816e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.753+0000 7f1c4ca00640 1 --2- 172.21.15.122:0/3386316400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c4816be50 0x7f1c4816e330 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1c4806c8c0 tx=0x7f1c4001c8e0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.753+0000 7f1c4ca00640 1 -- 172.21.15.122:0/3386316400 shutdown_connections 2024-05-28T06:05:57.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.753+0000 7f1c4ca00640 1 --2- 172.21.15.122:0/3386316400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c4816be50 0x7f1c4816e330 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.753+0000 7f1c4ca00640 1 --2- 172.21.15.122:0/3386316400 >> v2:172.21.15.122:3300/0 conn(0x7f1c4816b9d0 0x7f1c480ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.753+0000 7f1c4ca00640 1 --2- 172.21.15.122:0/3386316400 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c480ceb90 0x7f1c480cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.753+0000 7f1c4ca00640 1 -- 172.21.15.122:0/3386316400 >> 172.21.15.122:0/3386316400 conn(0x7f1c48062610 msgr2=0x7f1c4806b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:57.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.753+0000 7f1c4ca00640 1 -- 172.21.15.122:0/3386316400 shutdown_connections 2024-05-28T06:05:57.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.753+0000 7f1c4ca00640 1 -- 172.21.15.122:0/3386316400 wait complete. 2024-05-28T06:05:57.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.753+0000 7fa355a00640 1 --2- 172.21.15.122:0/2379791621 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa3300685f0 0x7fa33006aab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa3500743d0 tx=0x7fa344008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f1c4ca00640 1 Processor -- start 2024-05-28T06:05:57.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f1c4ca00640 1 -- start start 2024-05-28T06:05:57.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f3b5b400640 1 -- 172.21.15.122:0/2241666385 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0ab5f0 con 0x7f3b5c15b4d0 2024-05-28T06:05:57.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7fa34d600640 1 -- 172.21.15.122:0/2379791621 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa3501536f0 con 0x7fa35015a940 2024-05-28T06:05:57.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f3b5b400640 1 -- 172.21.15.122:0/2241666385 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b4c0b0070 con 0x7f3b5c15b4d0 2024-05-28T06:05:57.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f3b5b400640 1 -- 172.21.15.122:0/2241666385 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0ab9b0 con 0x7f3b5c15b4d0 2024-05-28T06:05:57.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f3b62c00640 1 -- 172.21.15.122:0/2241666385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b5c15b4d0 msgr2=0x7f3b5c06f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f3b62c00640 1 --2- 172.21.15.122:0/2241666385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b5c15b4d0 0x7f3b5c06f440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c009870 tx=0x7f3b4c01c540 comp rx=0 tx=0).stop 2024-05-28T06:05:57.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f1c4ca00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c480ceb90 0x7f1c48177d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f1c4ca00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c4816b9d0 0x7f1c480c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f1c4ca00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c4816be50 0x7f1c48163f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f3b62c00640 1 -- 172.21.15.122:0/2241666385 shutdown_connections 2024-05-28T06:05:57.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f3b62c00640 1 --2- 172.21.15.122:0/2241666385 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b5c15f8a0 0x7f3b5c06f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f3b62c00640 1 --2- 172.21.15.122:0/2241666385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b5c15b4d0 0x7f3b5c06f440 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f3b62c00640 1 -- 172.21.15.122:0/2241666385 >> 172.21.15.122:0/2241666385 conn(0x7f3b5c0b6b20 msgr2=0x7f3b5c0b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:57.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f3b62c00640 1 -- 172.21.15.122:0/2241666385 shutdown_connections 2024-05-28T06:05:57.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f1c45e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c480ceb90 0x7f1c48177d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f1c45e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c480ceb90 0x7f1c48177d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:37534/0 (socket says 172.21.15.122:37534) 2024-05-28T06:05:57.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f1c45e00640 1 -- 172.21.15.122:0/3122234492 learned_addr learned my addr 172.21.15.122:0/3122234492 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:57.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f1c4ca00640 1 -- 172.21.15.122:0/3122234492 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1c480b4ce0 con 0x7f1c4816b9d0 2024-05-28T06:05:57.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f1c4ca00640 1 -- 172.21.15.122:0/3122234492 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4816f080 con 0x7f1c480ceb90 2024-05-28T06:05:57.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f1c4ca00640 1 -- 172.21.15.122:0/3122234492 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1c480b4e60 con 0x7f1c4816be50 2024-05-28T06:05:57.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f1c46800640 1 --2- 172.21.15.122:0/3122234492 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c4816be50 0x7f1c48163f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f1c45e00640 1 -- 172.21.15.122:0/3122234492 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c4816be50 msgr2=0x7f1c48163f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f1c45e00640 1 --2- 172.21.15.122:0/3122234492 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c4816be50 0x7f1c48163f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f1c45e00640 1 -- 172.21.15.122:0/3122234492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c4816b9d0 msgr2=0x7f1c480c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f1c45400640 1 --2- 172.21.15.122:0/3122234492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c4816b9d0 0x7f1c480c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.761+0000 7f1c45e00640 1 --2- 172.21.15.122:0/3122234492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c4816b9d0 0x7f1c480c9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.761+0000 7f1c45e00640 1 -- 172.21.15.122:0/3122234492 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c480ca4b0 con 0x7f1c480ceb90 2024-05-28T06:05:57.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.761+0000 7f1c45400640 1 --2- 172.21.15.122:0/3122234492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c4816b9d0 0x7f1c480c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:05:57.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.761+0000 7f1c45e00640 1 --2- 172.21.15.122:0/3122234492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c480ceb90 0x7f1c48177d60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400b4a0 tx=0x7f1c3400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.761+0000 7f1c3e000640 1 -- 172.21.15.122:0/3122234492 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c34014070 con 0x7f1c480ceb90 2024-05-28T06:05:57.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.761+0000 7f1c3e000640 1 -- 172.21.15.122:0/3122234492 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c34010610 con 0x7f1c480ceb90 2024-05-28T06:05:57.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.761+0000 7f1c3e000640 1 -- 172.21.15.122:0/3122234492 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c34010a20 con 0x7f1c480ceb90 2024-05-28T06:05:57.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.761+0000 7f1c4ca00640 1 -- 172.21.15.122:0/3122234492 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c480ca750 con 0x7f1c480ceb90 2024-05-28T06:05:57.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.761+0000 7f1c4ca00640 1 -- 172.21.15.122:0/3122234492 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c4816c560 con 0x7f1c480ceb90 2024-05-28T06:05:57.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.757+0000 7f3b62c00640 1 -- 172.21.15.122:0/2241666385 wait complete. 2024-05-28T06:05:57.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.761+0000 7f3b62c00640 1 Processor -- start 2024-05-28T06:05:57.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.761+0000 7f1c4ca00640 1 -- 172.21.15.122:0/3122234492 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c48068bd0 con 0x7f1c480ceb90 2024-05-28T06:05:57.768 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.765+0000 7f1c3e000640 1 -- 172.21.15.122:0/3122234492 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1c34017070 con 0x7f1c480ceb90 2024-05-28T06:05:57.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.765+0000 7f1c3e000640 1 --2- 172.21.15.122:0/3122234492 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1c28068380 0x7f1c2806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.765+0000 7f1c3e000640 1 -- 172.21.15.122:0/3122234492 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1c340863a0 con 0x7f1c480ceb90 2024-05-28T06:05:57.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.765+0000 7f3b62c00640 1 -- start start 2024-05-28T06:05:57.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.765+0000 7f1c45400640 1 --2- 172.21.15.122:0/3122234492 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1c28068380 0x7f1c2806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f3b62c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b5c0b5260 0x7f3b5c160350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f3b5be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b5c0b5260 0x7f3b5c160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f3b5be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b5c0b5260 0x7f3b5c160350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41540/0 (socket says 172.21.15.122:41540) 2024-05-28T06:05:57.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f3b62c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b5c15b4d0 0x7f3b5c1658d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f3b62c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b5c15f8a0 0x7f3b5c1581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f3b62c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c15d890 con 0x7f3b5c0b5260 2024-05-28T06:05:57.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f3b62c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c15d710 con 0x7f3b5c15b4d0 2024-05-28T06:05:57.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f3b62c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5c15da10 con 0x7f3b5c15f8a0 2024-05-28T06:05:57.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f3b53e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b5c15b4d0 0x7f3b5c1658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f3b53e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b5c15b4d0 0x7f3b5c1658d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:37536/0 (socket says 172.21.15.122:37536) 2024-05-28T06:05:57.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f3b53e00640 1 -- 172.21.15.122:0/3394075907 learned_addr learned my addr 172.21.15.122:0/3394075907 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:57.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f3b60c00640 1 --2- 172.21.15.122:0/3394075907 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b5c15f8a0 0x7f3b5c1581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f1c45400640 1 --2- 172.21.15.122:0/3122234492 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1c28068380 0x7f1c2806a840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1c480cd230 tx=0x7f1c38008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f1c3e000640 1 -- 172.21.15.122:0/3122234492 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1c340569f0 con 0x7f1c480ceb90 2024-05-28T06:05:57.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f3b53e00640 1 -- 172.21.15.122:0/3394075907 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b5c15f8a0 msgr2=0x7f3b5c1581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f3b53e00640 1 --2- 172.21.15.122:0/3394075907 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b5c15f8a0 0x7f3b5c1581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f3b53e00640 1 -- 172.21.15.122:0/3394075907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b5c0b5260 msgr2=0x7f3b5c160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f3b53e00640 1 --2- 172.21.15.122:0/3394075907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b5c0b5260 0x7f3b5c160350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f3b53e00640 1 -- 172.21.15.122:0/3394075907 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c154a20 con 0x7f3b5c15b4d0 2024-05-28T06:05:57.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f3b5be00640 1 --2- 172.21.15.122:0/3394075907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b5c0b5260 0x7f3b5c160350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:05:57.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f3b53e00640 1 --2- 172.21.15.122:0/3394075907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b5c15b4d0 0x7f3b5c1658d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400b3e0 tx=0x7f3b4400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f3b58c00640 1 -- 172.21.15.122:0/3394075907 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b44015020 con 0x7f3b5c15b4d0 2024-05-28T06:05:57.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f3b58c00640 1 -- 172.21.15.122:0/3394075907 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b44011850 con 0x7f3b5c15b4d0 2024-05-28T06:05:57.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f3b58c00640 1 -- 172.21.15.122:0/3394075907 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b44011c40 con 0x7f3b5c15b4d0 2024-05-28T06:05:57.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.769+0000 7f3b62c00640 1 -- 172.21.15.122:0/3394075907 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b5c0cf310 con 0x7f3b5c15b4d0 2024-05-28T06:05:57.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.773+0000 7f3b62c00640 1 -- 172.21.15.122:0/3394075907 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b5c0cf8d0 con 0x7f3b5c15b4d0 2024-05-28T06:05:57.777 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.773+0000 7f3b58c00640 1 -- 172.21.15.122:0/3394075907 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3b44018020 con 0x7f3b5c15b4d0 2024-05-28T06:05:57.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.773+0000 7f3b62c00640 1 -- 172.21.15.122:0/3394075907 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b5c068bd0 con 0x7f3b5c15b4d0 2024-05-28T06:05:57.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.777+0000 7f3b58c00640 1 --2- 172.21.15.122:0/3394075907 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3b380683d0 0x7f3b3806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:57.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.777+0000 7f3b58c00640 1 -- 172.21.15.122:0/3394075907 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3b44086850 con 0x7f3b5c15b4d0 2024-05-28T06:05:57.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.781+0000 7f3b5be00640 1 --2- 172.21.15.122:0/3394075907 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3b380683d0 0x7f3b3806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:57.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.781+0000 7f3b5be00640 1 --2- 172.21.15.122:0/3394075907 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3b380683d0 0x7f3b3806a890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0af000 tx=0x7f3b4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:57.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.781+0000 7f3b58c00640 1 -- 172.21.15.122:0/3394075907 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3b4401f020 con 0x7f3b5c15b4d0 2024-05-28T06:05:57.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.945+0000 7fc217e00640 1 -- 172.21.15.122:0/1321678873 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc22c0cf200 con 0x7fc22c143be0 2024-05-28T06:05:57.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.945+0000 7fc222a00640 1 -- 172.21.15.122:0/1321678873 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc21c0f38b0 con 0x7fc22c143be0 2024-05-28T06:05:57.949 INFO:teuthology.orchestra.run.smithi122.stdout:55834574855 2024-05-28T06:05:57.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.949+0000 7fc217e00640 1 -- 172.21.15.122:0/1321678873 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc20c068480 msgr2=0x7fc20c06a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.949+0000 7fc217e00640 1 --2- 172.21.15.122:0/1321678873 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc20c068480 0x7fc20c06a940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc218006ca0 tx=0x7fc218009060 comp rx=0 tx=0).stop 2024-05-28T06:05:57.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.949+0000 7fc217e00640 1 -- 172.21.15.122:0/1321678873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc22c143be0 msgr2=0x7fc22c144060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:57.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.949+0000 7fc217e00640 1 --2- 172.21.15.122:0/1321678873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc22c143be0 0x7fc22c144060 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc21c0ac000 tx=0x7fc21c01c290 comp rx=0 tx=0).stop 2024-05-28T06:05:57.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.949+0000 7fc217e00640 1 -- 172.21.15.122:0/1321678873 shutdown_connections 2024-05-28T06:05:57.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.949+0000 7fc217e00640 1 --2- 172.21.15.122:0/1321678873 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc20c068480 0x7fc20c06a940 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.949+0000 7fc217e00640 1 --2- 172.21.15.122:0/1321678873 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc22c142190 0x7fc22c142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.949+0000 7fc217e00640 1 --2- 172.21.15.122:0/1321678873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc22c143be0 0x7fc22c144060 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.949+0000 7fc217e00640 1 --2- 172.21.15.122:0/1321678873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc210004810 0x7fc22c06ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:57.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.949+0000 7fc217e00640 1 -- 172.21.15.122:0/1321678873 >> 172.21.15.122:0/1321678873 conn(0x7fc22c062840 msgr2=0x7fc22c0b9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:57.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.953+0000 7fc217e00640 1 -- 172.21.15.122:0/1321678873 shutdown_connections 2024-05-28T06:05:57.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:57.953+0000 7fc217e00640 1 -- 172.21.15.122:0/1321678873 wait complete. 2024-05-28T06:05:57.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2024-05-28T06:05:57.986 DEBUG:teuthology.parallel:result is None 2024-05-28T06:05:58.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.009+0000 7f58ca000640 1 -- 172.21.15.122:0/2179490036 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f58a4005590 con 0x7f58d4148dc0 2024-05-28T06:05:58.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.009+0000 7f58d0c00640 1 -- 172.21.15.122:0/2179490036 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f58cc016600 con 0x7f58d4148dc0 2024-05-28T06:05:58.014 INFO:teuthology.orchestra.run.smithi122.stdout:55834574854 2024-05-28T06:05:58.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.013+0000 7f58ca000640 1 -- 172.21.15.122:0/2179490036 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f58b0068450 msgr2=0x7f58b006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.013+0000 7f58ca000640 1 --2- 172.21.15.122:0/2179490036 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f58b0068450 0x7f58b006a910 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f58c4000f70 tx=0x7f58c4009040 comp rx=0 tx=0).stop 2024-05-28T06:05:58.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.013+0000 7f58ca000640 1 -- 172.21.15.122:0/2179490036 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58d4148dc0 msgr2=0x7f58d414a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.013+0000 7f58ca000640 1 --2- 172.21.15.122:0/2179490036 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58d4148dc0 0x7f58d414a550 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f58cc01a580 tx=0x7f58cc0196f0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.013+0000 7f58ca000640 1 -- 172.21.15.122:0/2179490036 shutdown_connections 2024-05-28T06:05:58.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.013+0000 7f58ca000640 1 --2- 172.21.15.122:0/2179490036 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f58b0068450 0x7f58b006a910 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f58c4000f70 tx=0x7f58c4009040 comp rx=0 tx=0).stop 2024-05-28T06:05:58.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.013+0000 7f58ca000640 1 --2- 172.21.15.122:0/2179490036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58d41491a0 0x7f58d41fed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.013+0000 7f58ca000640 1 --2- 172.21.15.122:0/2179490036 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58d4148dc0 0x7f58d414a550 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.013+0000 7f58ca000640 1 --2- 172.21.15.122:0/2179490036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58d40b23c0 0x7f58d413a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.013+0000 7f58ca000640 1 -- 172.21.15.122:0/2179490036 >> 172.21.15.122:0/2179490036 conn(0x7f58d4062840 msgr2=0x7f58d40b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:58.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.013+0000 7f58ca000640 1 -- 172.21.15.122:0/2179490036 shutdown_connections 2024-05-28T06:05:58.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.013+0000 7f58ca000640 1 -- 172.21.15.122:0/2179490036 wait complete. 2024-05-28T06:05:58.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.021+0000 7f3eebe00640 1 -- 172.21.15.122:0/1951154844 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f3ee4152f20 con 0x7f3ee414af60 2024-05-28T06:05:58.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.021+0000 7f3ee1600640 1 -- 172.21.15.122:0/1951154844 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3ed0056a30 con 0x7f3ee414af60 2024-05-28T06:05:58.025 INFO:teuthology.orchestra.run.smithi122.stdout:55834574855 2024-05-28T06:05:58.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.025+0000 7f3eebe00640 1 -- 172.21.15.122:0/1951154844 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3ec4068380 msgr2=0x7f3ec406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.025+0000 7f3eebe00640 1 --2- 172.21.15.122:0/1951154844 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3ec4068380 0x7f3ec406a840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8009c00 tx=0x7f3ed8008040 comp rx=0 tx=0).stop 2024-05-28T06:05:58.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.025+0000 7f3eebe00640 1 -- 172.21.15.122:0/1951154844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee414af60 msgr2=0x7f3ee413dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.025+0000 7f3eebe00640 1 --2- 172.21.15.122:0/1951154844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee414af60 0x7f3ee413dee0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3ed000d900 tx=0x7f3ed000ddc0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.025+0000 7f3eebe00640 1 -- 172.21.15.122:0/1951154844 shutdown_connections 2024-05-28T06:05:58.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.025+0000 7f3eebe00640 1 --2- 172.21.15.122:0/1951154844 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3ec4068380 0x7f3ec406a840 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.025+0000 7f3eebe00640 1 --2- 172.21.15.122:0/1951154844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ee41581a0 0x7f3ee4158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.025+0000 7f3eebe00640 1 --2- 172.21.15.122:0/1951154844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee414af60 0x7f3ee413dee0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.025+0000 7f3eebe00640 1 --2- 172.21.15.122:0/1951154844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ecc00b020 0x7f3ee413d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.025+0000 7f3eebe00640 1 -- 172.21.15.122:0/1951154844 >> 172.21.15.122:0/1951154844 conn(0x7f3ee4062610 msgr2=0x7f3ee4153e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:58.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.025+0000 7f3eebe00640 1 -- 172.21.15.122:0/1951154844 shutdown_connections 2024-05-28T06:05:58.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.025+0000 7f3eebe00640 1 -- 172.21.15.122:0/1951154844 wait complete. 2024-05-28T06:05:58.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-05-28T06:05:58.050 DEBUG:teuthology.parallel:result is None 2024-05-28T06:05:58.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-05-28T06:05:58.051 DEBUG:teuthology.parallel:result is None 2024-05-28T06:05:58.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.049+0000 7f6aa9600640 1 -- 172.21.15.122:0/3692765201 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6a84005590 con 0x7f6ab40d4690 2024-05-28T06:05:58.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.049+0000 7f6aabe00640 1 -- 172.21.15.122:0/3692765201 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6aa4056b50 con 0x7f6ab40d4690 2024-05-28T06:05:58.053 INFO:teuthology.orchestra.run.smithi122.stdout:55834574855 2024-05-28T06:05:58.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.053+0000 7f6aa9600640 1 -- 172.21.15.122:0/3692765201 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6a900683b0 msgr2=0x7f6a9006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.053+0000 7f6aa9600640 1 --2- 172.21.15.122:0/3692765201 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6a900683b0 0x7f6a9006a870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0af000 tx=0x7f6aac0a7000 comp rx=0 tx=0).stop 2024-05-28T06:05:58.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.053+0000 7f6aa9600640 1 -- 172.21.15.122:0/3692765201 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6ab40d4690 msgr2=0x7f6ab40c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.053+0000 7f6aa9600640 1 --2- 172.21.15.122:0/3692765201 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6ab40d4690 0x7f6ab40c9910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6aa400c730 tx=0x7f6aa400cb30 comp rx=0 tx=0).stop 2024-05-28T06:05:58.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.053+0000 7f6aa9600640 1 -- 172.21.15.122:0/3692765201 shutdown_connections 2024-05-28T06:05:58.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.053+0000 7f6aa9600640 1 --2- 172.21.15.122:0/3692765201 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6a900683b0 0x7f6a9006a870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.053+0000 7f6aa9600640 1 --2- 172.21.15.122:0/3692765201 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6ab40d4690 0x7f6ab40c9910 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.053+0000 7f6aa9600640 1 --2- 172.21.15.122:0/3692765201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ab40d4140 0x7f6ab40c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.053+0000 7f6aa9600640 1 --2- 172.21.15.122:0/3692765201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ab40d2af0 0x7f6ab415d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.053+0000 7f6aa9600640 1 -- 172.21.15.122:0/3692765201 >> 172.21.15.122:0/3692765201 conn(0x7f6ab406cc80 msgr2=0x7f6ab40cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:58.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.057+0000 7f6aa9600640 1 -- 172.21.15.122:0/3692765201 shutdown_connections 2024-05-28T06:05:58.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.057+0000 7f6aa9600640 1 -- 172.21.15.122:0/3692765201 wait complete. 2024-05-28T06:05:58.067 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.065+0000 7f6a04c00640 1 -- 172.21.15.122:0/2635448184 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6a080e16e0 con 0x7f6a0804f500 2024-05-28T06:05:58.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.065+0000 7f6a07400640 1 -- 172.21.15.122:0/2635448184 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f69fc0f1030 con 0x7f6a0804f500 2024-05-28T06:05:58.068 INFO:teuthology.orchestra.run.smithi122.stdout:55834574854 2024-05-28T06:05:58.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.069+0000 7f6a04c00640 1 -- 172.21.15.122:0/2635448184 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f69f0068450 msgr2=0x7f69f006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.069+0000 7f6a04c00640 1 --2- 172.21.15.122:0/2635448184 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f69f0068450 0x7f69f006a910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6a10065520 tx=0x7f6a10068930 comp rx=0 tx=0).stop 2024-05-28T06:05:58.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.069+0000 7f6a04c00640 1 -- 172.21.15.122:0/2635448184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a0804f500 msgr2=0x7f6a08188600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.069+0000 7f6a04c00640 1 --2- 172.21.15.122:0/2635448184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a0804f500 0x7f6a08188600 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0ab000 tx=0x7f69fc019160 comp rx=0 tx=0).stop 2024-05-28T06:05:58.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.069+0000 7f6a04c00640 1 -- 172.21.15.122:0/2635448184 shutdown_connections 2024-05-28T06:05:58.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.069+0000 7f6a04c00640 1 --2- 172.21.15.122:0/2635448184 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f69f0068450 0x7f69f006a910 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.069+0000 7f6a04c00640 1 --2- 172.21.15.122:0/2635448184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a0804f500 0x7f6a08188600 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.069+0000 7f6a04c00640 1 --2- 172.21.15.122:0/2635448184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a080482b0 0x7f6a0804e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.069+0000 7f6a04c00640 1 --2- 172.21.15.122:0/2635448184 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a08047d60 0x7f6a08033cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.069+0000 7f6a04c00640 1 -- 172.21.15.122:0/2635448184 >> 172.21.15.122:0/2635448184 conn(0x7f6a08054ca0 msgr2=0x7f6a08035bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:58.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.069+0000 7f6a04c00640 1 -- 172.21.15.122:0/2635448184 shutdown_connections 2024-05-28T06:05:58.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.069+0000 7f6a04c00640 1 -- 172.21.15.122:0/2635448184 wait complete. 2024-05-28T06:05:58.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.073+0000 7fa358400640 1 -- 172.21.15.122:0/2379791621 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa32c005590 con 0x7fa35015a940 2024-05-28T06:05:58.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.077+0000 7fa34d600640 1 -- 172.21.15.122:0/2379791621 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa34805f710 con 0x7fa35015a940 2024-05-28T06:05:58.079 INFO:teuthology.orchestra.run.smithi122.stdout:55834574856 2024-05-28T06:05:58.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-05-28T06:05:58.082 DEBUG:teuthology.parallel:result is None 2024-05-28T06:05:58.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.081+0000 7fa358400640 1 -- 172.21.15.122:0/2379791621 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa3300685f0 msgr2=0x7fa33006aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.081+0000 7fa358400640 1 --2- 172.21.15.122:0/2379791621 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa3300685f0 0x7fa33006aab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa3500743d0 tx=0x7fa344008040 comp rx=0 tx=0).stop 2024-05-28T06:05:58.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.081+0000 7fa358400640 1 -- 172.21.15.122:0/2379791621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa35015a940 msgr2=0x7fa3500cf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.081+0000 7fa358400640 1 --2- 172.21.15.122:0/2379791621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa35015a940 0x7fa3500cf3f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa3480133b0 tx=0x7fa348013870 comp rx=0 tx=0).stop 2024-05-28T06:05:58.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.081+0000 7fa358400640 1 -- 172.21.15.122:0/2379791621 shutdown_connections 2024-05-28T06:05:58.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.081+0000 7fa358400640 1 --2- 172.21.15.122:0/2379791621 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa3300685f0 0x7fa33006aab0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.081+0000 7fa358400640 1 --2- 172.21.15.122:0/2379791621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa35015a940 0x7fa3500cf3f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.081+0000 7fa358400640 1 --2- 172.21.15.122:0/2379791621 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3500af8d0 0x7fa35015f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.081+0000 7fa358400640 1 --2- 172.21.15.122:0/2379791621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa350071f30 0x7fa350140c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.081+0000 7fa358400640 1 -- 172.21.15.122:0/2379791621 >> 172.21.15.122:0/2379791621 conn(0x7fa350062610 msgr2=0x7fa3500b0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:58.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.081+0000 7fa358400640 1 -- 172.21.15.122:0/2379791621 shutdown_connections 2024-05-28T06:05:58.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.081+0000 7fa358400640 1 -- 172.21.15.122:0/2379791621 wait complete. 2024-05-28T06:05:58.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-05-28T06:05:58.097 DEBUG:teuthology.parallel:result is None 2024-05-28T06:05:58.105 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.101+0000 7f1c4ca00640 1 -- 172.21.15.122:0/3122234492 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f1c480cef70 con 0x7f1c480ceb90 2024-05-28T06:05:58.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.101+0000 7f1c3e000640 1 -- 172.21.15.122:0/3122234492 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1c340562f0 con 0x7f1c480ceb90 2024-05-28T06:05:58.106 INFO:teuthology.orchestra.run.smithi122.stdout:55834574855 2024-05-28T06:05:58.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.105+0000 7f1c4ca00640 1 -- 172.21.15.122:0/3122234492 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1c28068380 msgr2=0x7f1c2806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.105+0000 7f1c4ca00640 1 --2- 172.21.15.122:0/3122234492 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1c28068380 0x7f1c2806a840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1c480cd230 tx=0x7f1c38008040 comp rx=0 tx=0).stop 2024-05-28T06:05:58.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.105+0000 7f1c4ca00640 1 -- 172.21.15.122:0/3122234492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c480ceb90 msgr2=0x7f1c48177d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.105+0000 7f1c4ca00640 1 --2- 172.21.15.122:0/3122234492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c480ceb90 0x7f1c48177d60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400b4a0 tx=0x7f1c3400b960 comp rx=0 tx=0).stop 2024-05-28T06:05:58.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.105+0000 7f1c4ca00640 1 -- 172.21.15.122:0/3122234492 shutdown_connections 2024-05-28T06:05:58.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.105+0000 7f1c4ca00640 1 --2- 172.21.15.122:0/3122234492 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1c28068380 0x7f1c2806a840 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.105+0000 7f1c4ca00640 1 --2- 172.21.15.122:0/3122234492 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c4816be50 0x7f1c48163f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.105+0000 7f1c4ca00640 1 --2- 172.21.15.122:0/3122234492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c4816b9d0 0x7f1c480c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.105+0000 7f1c4ca00640 1 --2- 172.21.15.122:0/3122234492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c480ceb90 0x7f1c48177d60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.105+0000 7f1c4ca00640 1 -- 172.21.15.122:0/3122234492 >> 172.21.15.122:0/3122234492 conn(0x7f1c48062610 msgr2=0x7f1c4806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:58.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.105+0000 7f1c4ca00640 1 -- 172.21.15.122:0/3122234492 shutdown_connections 2024-05-28T06:05:58.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.105+0000 7f1c4ca00640 1 -- 172.21.15.122:0/3122234492 wait complete. 2024-05-28T06:05:58.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.105+0000 7f3b62c00640 1 -- 172.21.15.122:0/3394075907 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f3b5c15e1e0 con 0x7f3b5c15b4d0 2024-05-28T06:05:58.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.109+0000 7f3b58c00640 1 -- 172.21.15.122:0/3394075907 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3b5c154a20 con 0x7f3b5c15b4d0 2024-05-28T06:05:58.111 INFO:teuthology.orchestra.run.smithi122.stdout:55834574853 2024-05-28T06:05:58.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2024-05-28T06:05:58.112 DEBUG:teuthology.parallel:result is None 2024-05-28T06:05:58.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.109+0000 7f3b62c00640 1 -- 172.21.15.122:0/3394075907 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3b380683d0 msgr2=0x7f3b3806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.109+0000 7f3b62c00640 1 --2- 172.21.15.122:0/3394075907 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3b380683d0 0x7f3b3806a890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0af000 tx=0x7f3b4c008040 comp rx=0 tx=0).stop 2024-05-28T06:05:58.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.109+0000 7f3b62c00640 1 -- 172.21.15.122:0/3394075907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b5c15b4d0 msgr2=0x7f3b5c1658d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.109+0000 7f3b62c00640 1 --2- 172.21.15.122:0/3394075907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b5c15b4d0 0x7f3b5c1658d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400b3e0 tx=0x7f3b4400b8a0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.109+0000 7f3b62c00640 1 -- 172.21.15.122:0/3394075907 shutdown_connections 2024-05-28T06:05:58.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.109+0000 7f3b62c00640 1 --2- 172.21.15.122:0/3394075907 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3b380683d0 0x7f3b3806a890 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.109+0000 7f3b62c00640 1 --2- 172.21.15.122:0/3394075907 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b5c15f8a0 0x7f3b5c1581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.109+0000 7f3b62c00640 1 --2- 172.21.15.122:0/3394075907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b5c15b4d0 0x7f3b5c1658d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.109+0000 7f3b62c00640 1 --2- 172.21.15.122:0/3394075907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b5c0b5260 0x7f3b5c160350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.109+0000 7f3b62c00640 1 -- 172.21.15.122:0/3394075907 >> 172.21.15.122:0/3394075907 conn(0x7f3b5c0b6b20 msgr2=0x7f3b5c0b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:58.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.109+0000 7f3b62c00640 1 -- 172.21.15.122:0/3394075907 shutdown_connections 2024-05-28T06:05:58.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.109+0000 7f3b62c00640 1 -- 172.21.15.122:0/3394075907 wait complete. 2024-05-28T06:05:58.130 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-05-28T06:05:58.130 DEBUG:teuthology.parallel:result is None 2024-05-28T06:05:58.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-05-28T06:05:58.135 DEBUG:teuthology.parallel:result is None 2024-05-28T06:05:58.135 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-28T06:05:58.135 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-28T06:05:58.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.309+0000 7f8400200640 1 Processor -- start 2024-05-28T06:05:58.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.309+0000 7f8400200640 1 -- start start 2024-05-28T06:05:58.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f8400200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f83f80b42d0 0x7f83f80add80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:58.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f8400200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83f806be00 con 0x7f83f806cea0 2024-05-28T06:05:58.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f8400200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83f806c0e0 con 0x7f83f815e7a0 2024-05-28T06:05:58.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f8400200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f83f806c3c0 con 0x7f83f80b42d0 2024-05-28T06:05:58.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83fce00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f83f806cea0 0x7f83f80b3bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38622/0 (socket says 172.21.15.122:38622) 2024-05-28T06:05:58.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83fce00640 1 -- 172.21.15.122:0/787102397 learned_addr learned my addr 172.21.15.122:0/787102397 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:58.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83fe200640 1 --2- 172.21.15.122:0/787102397 >> v2:172.21.15.153:3300/0 conn(0x7f83f80b42d0 0x7f83f80add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:58.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83f7e00640 1 -- 172.21.15.122:0/787102397 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3404564381 0 0) 0x7f83f806be00 con 0x7f83f806cea0 2024-05-28T06:05:58.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83f7e00640 1 -- 172.21.15.122:0/787102397 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83e0003530 con 0x7f83f806cea0 2024-05-28T06:05:58.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83f7e00640 1 -- 172.21.15.122:0/787102397 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2045515552 0 0) 0x7f83f806c0e0 con 0x7f83f815e7a0 2024-05-28T06:05:58.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83f7e00640 1 -- 172.21.15.122:0/787102397 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83f806be00 con 0x7f83f815e7a0 2024-05-28T06:05:58.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83f7e00640 1 -- 172.21.15.122:0/787102397 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3149894334 0 0) 0x7f83e0003530 con 0x7f83f806cea0 2024-05-28T06:05:58.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83f7e00640 1 -- 172.21.15.122:0/787102397 >> v2:172.21.15.153:3300/0 conn(0x7f83f80b42d0 msgr2=0x7f83f80add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:58.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83f7e00640 1 --2- 172.21.15.122:0/787102397 >> v2:172.21.15.153:3300/0 conn(0x7f83f80b42d0 0x7f83f80add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83f7e00640 1 -- 172.21.15.122:0/787102397 >> v1:172.21.15.153:6789/0 conn(0x7f83f815e7a0 legacy=0x7f83f8162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83f7e00640 1 -- 172.21.15.122:0/787102397 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f806c6a0 con 0x7f83f806cea0 2024-05-28T06:05:58.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83f7e00640 1 -- 172.21.15.122:0/787102397 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f83e4001680 con 0x7f83f806cea0 2024-05-28T06:05:58.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83fe200640 1 --2- 172.21.15.122:0/787102397 >> v2:172.21.15.153:3300/0 conn(0x7f83f80b42d0 0x7f83f80add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:05:58.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83f7e00640 1 -- 172.21.15.122:0/787102397 >> v1:172.21.15.122:6789/0 conn(0x7f83f806cea0 legacy=0x7f83f80b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83f7e00640 1 --2- 172.21.15.122:0/787102397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83e0003b50 0x7f83e0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:58.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83f7e00640 1 --2- 172.21.15.122:0/787102397 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f83e0004810 0x7f83e0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:58.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83f7e00640 1 --2- 172.21.15.122:0/787102397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e00051d0 0x7f83e000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:58.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83f7e00640 1 -- 172.21.15.122:0/787102397 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f83f806c3c0 con 0x7f83e0003b50 2024-05-28T06:05:58.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83f7e00640 1 -- 172.21.15.122:0/787102397 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f83e000c100 con 0x7f83e00051d0 2024-05-28T06:05:58.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83f7e00640 1 -- 172.21.15.122:0/787102397 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f83e000c300 con 0x7f83e0004810 2024-05-28T06:05:58.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83fd800640 1 --2- 172.21.15.122:0/787102397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83e0003b50 0x7f83e0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:58.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83fe200640 1 --2- 172.21.15.122:0/787102397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e00051d0 0x7f83e000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:58.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83fce00640 1 --2- 172.21.15.122:0/787102397 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f83e0004810 0x7f83e0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:58.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83fd800640 1 -- 172.21.15.122:0/787102397 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f83e0004810 msgr2=0x7f83e0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:58.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83fd800640 1 --2- 172.21.15.122:0/787102397 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f83e0004810 0x7f83e0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83fd800640 1 -- 172.21.15.122:0/787102397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e00051d0 msgr2=0x7f83e000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:58.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83fd800640 1 --2- 172.21.15.122:0/787102397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e00051d0 0x7f83e000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83fe200640 1 -- 172.21.15.122:0/787102397 reap_dead start 2024-05-28T06:05:58.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.313+0000 7f83fd800640 1 -- 172.21.15.122:0/787102397 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e0003530 con 0x7f83e0003b50 2024-05-28T06:05:58.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.317+0000 7f83fd800640 1 --2- 172.21.15.122:0/787102397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83e0003b50 0x7f83e0003f50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0018d0 tx=0x7f83ec01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a82e1cc23614776 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:58.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.317+0000 7f83f7e00640 1 -- 172.21.15.122:0/787102397 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ec001520 con 0x7f83e0003b50 2024-05-28T06:05:58.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.317+0000 7f83f7e00640 1 -- 172.21.15.122:0/787102397 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ec0052f0 con 0x7f83e0003b50 2024-05-28T06:05:58.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.317+0000 7f83f7e00640 1 -- 172.21.15.122:0/787102397 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ec003840 con 0x7f83e0003b50 2024-05-28T06:05:58.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.317+0000 7f8400200640 1 -- 172.21.15.122:0/787102397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83e0003b50 msgr2=0x7f83e0003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.317+0000 7f8400200640 1 --2- 172.21.15.122:0/787102397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83e0003b50 0x7f83e0003f50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0018d0 tx=0x7f83ec01c520 comp rx=0 tx=0).stop 2024-05-28T06:05:58.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.317+0000 7f8400200640 1 -- 172.21.15.122:0/787102397 shutdown_connections 2024-05-28T06:05:58.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.317+0000 7f8400200640 1 --2- 172.21.15.122:0/787102397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83e0003b50 0x7f83e0003f50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.317+0000 7f8400200640 1 -- 172.21.15.122:0/787102397 >> 172.21.15.122:0/787102397 conn(0x7f83f80b3130 msgr2=0x7f83f80d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:58.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.317+0000 7f8400200640 1 -- 172.21.15.122:0/787102397 shutdown_connections 2024-05-28T06:05:58.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.317+0000 7f8400200640 1 -- 172.21.15.122:0/787102397 wait complete. 2024-05-28T06:05:58.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.317+0000 7f8400200640 1 Processor -- start 2024-05-28T06:05:58.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.317+0000 7f8400200640 1 -- start start 2024-05-28T06:05:58.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f8400200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f83e0003b50 0x7f83f80b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:58.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f8400200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83f8159ab0 0x7f83f8149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:58.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f8400200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83f80cf7e0 0x7f83f80cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:58.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f8400200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f83f8163420 con 0x7f83f8159ab0 2024-05-28T06:05:58.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f8400200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f83f81632a0 con 0x7f83f80cf7e0 2024-05-28T06:05:58.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f8400200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f83f815eb80 con 0x7f83e0003b50 2024-05-28T06:05:58.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f83fce00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83f8159ab0 0x7f83f8149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:58.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f83fce00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83f8159ab0 0x7f83f8149670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41554/0 (socket says 172.21.15.122:41554) 2024-05-28T06:05:58.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f83fce00640 1 -- 172.21.15.122:0/3189485783 learned_addr learned my addr 172.21.15.122:0/3189485783 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:58.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f83fd800640 1 --2- 172.21.15.122:0/3189485783 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f83e0003b50 0x7f83f80b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:58.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f83fe200640 1 --2- 172.21.15.122:0/3189485783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83f80cf7e0 0x7f83f80cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:58.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f83fce00640 1 -- 172.21.15.122:0/3189485783 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f83e0003b50 msgr2=0x7f83f80b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f83fce00640 1 --2- 172.21.15.122:0/3189485783 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f83e0003b50 0x7f83f80b2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f83fce00640 1 -- 172.21.15.122:0/3189485783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83f80cf7e0 msgr2=0x7f83f80cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f83fce00640 1 --2- 172.21.15.122:0/3189485783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83f80cf7e0 0x7f83f80cfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f83fce00640 1 -- 172.21.15.122:0/3189485783 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f815aa90 con 0x7f83f8159ab0 2024-05-28T06:05:58.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f83fd800640 1 --2- 172.21.15.122:0/3189485783 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f83e0003b50 0x7f83f80b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:05:58.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f83fce00640 1 --2- 172.21.15.122:0/3189485783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83f8159ab0 0x7f83f8149670 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f83e400e780 tx=0x7f83e400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:58.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f83f5600640 1 -- 172.21.15.122:0/3189485783 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e400c660 con 0x7f83f8159ab0 2024-05-28T06:05:58.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f83f5600640 1 -- 172.21.15.122:0/3189485783 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e4018070 con 0x7f83f8159ab0 2024-05-28T06:05:58.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f83f5600640 1 -- 172.21.15.122:0/3189485783 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e400ca60 con 0x7f83f8159ab0 2024-05-28T06:05:58.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f8400200640 1 -- 172.21.15.122:0/3189485783 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83f8159f30 con 0x7f83f8159ab0 2024-05-28T06:05:58.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f8400200640 1 -- 172.21.15.122:0/3189485783 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83f815a4d0 con 0x7f83f8159ab0 2024-05-28T06:05:58.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f8400200640 1 -- 172.21.15.122:0/3189485783 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83f8068c40 con 0x7f83f8159ab0 2024-05-28T06:05:58.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.321+0000 7f83f5600640 1 -- 172.21.15.122:0/3189485783 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f83e400cc00 con 0x7f83f8159ab0 2024-05-28T06:05:58.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.325+0000 7f83f5600640 1 --2- 172.21.15.122:0/3189485783 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f83d80683b0 0x7f83d806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:58.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.325+0000 7f83f5600640 1 -- 172.21.15.122:0/3189485783 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f83e40862c0 con 0x7f83f8159ab0 2024-05-28T06:05:58.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.325+0000 7f83fd800640 1 --2- 172.21.15.122:0/3189485783 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f83d80683b0 0x7f83d806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:58.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.325+0000 7f83fd800640 1 --2- 172.21.15.122:0/3189485783 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f83d80683b0 0x7f83d806a870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0ac000 tx=0x7f83ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:58.330 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.329+0000 7f83f5600640 1 -- 172.21.15.122:0/3189485783 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f83e40567e0 con 0x7f83f8159ab0 2024-05-28T06:05:58.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.481+0000 7f8400200640 1 -- 172.21.15.122:0/3189485783 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f83f8076020 con 0x7f83d80683b0 2024-05-28T06:05:58.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.489+0000 7f83f5600640 1 -- 172.21.15.122:0/3189485783 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f83ec005150 con 0x7f83d80683b0 2024-05-28T06:05:58.494 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:05:58.496 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-05-28T06:05:58.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.493+0000 7f8400200640 1 -- 172.21.15.122:0/3189485783 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f83d80683b0 msgr2=0x7f83d806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.493+0000 7f8400200640 1 --2- 172.21.15.122:0/3189485783 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f83d80683b0 0x7f83d806a870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0ac000 tx=0x7f83ec009040 comp rx=0 tx=0).stop 2024-05-28T06:05:58.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.493+0000 7f8400200640 1 -- 172.21.15.122:0/3189485783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83f8159ab0 msgr2=0x7f83f8149670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.493+0000 7f8400200640 1 --2- 172.21.15.122:0/3189485783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83f8159ab0 0x7f83f8149670 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f83e400e780 tx=0x7f83e400ec40 comp rx=0 tx=0).stop 2024-05-28T06:05:58.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.493+0000 7f8400200640 1 -- 172.21.15.122:0/3189485783 shutdown_connections 2024-05-28T06:05:58.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.493+0000 7f8400200640 1 --2- 172.21.15.122:0/3189485783 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f83d80683b0 0x7f83d806a870 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.493+0000 7f8400200640 1 --2- 172.21.15.122:0/3189485783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83f80cf7e0 0x7f83f80cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.493+0000 7f8400200640 1 --2- 172.21.15.122:0/3189485783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83f8159ab0 0x7f83f8149670 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.493+0000 7f8400200640 1 --2- 172.21.15.122:0/3189485783 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f83e0003b50 0x7f83f80b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.493+0000 7f8400200640 1 -- 172.21.15.122:0/3189485783 >> 172.21.15.122:0/3189485783 conn(0x7f83f80b3130 msgr2=0x7f83f806fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:58.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.493+0000 7f8400200640 1 -- 172.21.15.122:0/3189485783 shutdown_connections 2024-05-28T06:05:58.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.493+0000 7f8400200640 1 -- 172.21.15.122:0/3189485783 wait complete. 2024-05-28T06:05:58.514 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-05-28T06:05:57.245325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219008,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755712,"statfs":{"total":773094113280,"available":772869849088,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001531"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619807+0000","last_change":"2024-05-28T06:05:49.850357+0000","last_active":"2024-05-28T06:05:51.619807+0000","last_peered":"2024-05-28T06:05:51.619807+0000","last_clean":"2024-05-28T06:05:51.619807+0000","last_became_active":"2024-05-28T06:05:49.850082+0000","last_became_peered":"2024-05-28T06:05:49.850082+0000","last_unstale":"2024-05-28T06:05:51.619807+0000","last_undegraded":"2024-05-28T06:05:51.619807+0000","last_fullsized":"2024-05-28T06:05:51.619807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:58:07.996206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.847064+0000","last_change":"2024-05-28T06:05:49.836997+0000","last_active":"2024-05-28T06:05:50.847064+0000","last_peered":"2024-05-28T06:05:50.847064+0000","last_clean":"2024-05-28T06:05:50.847064+0000","last_became_active":"2024-05-28T06:05:49.836057+0000","last_became_peered":"2024-05-28T06:05:49.836057+0000","last_unstale":"2024-05-28T06:05:50.847064+0000","last_undegraded":"2024-05-28T06:05:50.847064+0000","last_fullsized":"2024-05-28T06:05:50.847064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:05.258933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620342+0000","last_change":"2024-05-28T06:05:49.842388+0000","last_active":"2024-05-28T06:05:51.620342+0000","last_peered":"2024-05-28T06:05:51.620342+0000","last_clean":"2024-05-28T06:05:51.620342+0000","last_became_active":"2024-05-28T06:05:49.833739+0000","last_became_peered":"2024-05-28T06:05:49.833739+0000","last_unstale":"2024-05-28T06:05:51.620342+0000","last_undegraded":"2024-05-28T06:05:51.620342+0000","last_fullsized":"2024-05-28T06:05:51.620342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:45:56.563383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830740+0000","last_change":"2024-05-28T06:05:49.836000+0000","last_active":"2024-05-28T06:05:50.830740+0000","last_peered":"2024-05-28T06:05:50.830740+0000","last_clean":"2024-05-28T06:05:50.830740+0000","last_became_active":"2024-05-28T06:05:49.835023+0000","last_became_peered":"2024-05-28T06:05:49.835023+0000","last_unstale":"2024-05-28T06:05:50.830740+0000","last_undegraded":"2024-05-28T06:05:50.830740+0000","last_fullsized":"2024-05-28T06:05:50.830740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:47:59.969773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619431+0000","last_change":"2024-05-28T06:05:49.842728+0000","last_active":"2024-05-28T06:05:51.619431+0000","last_peered":"2024-05-28T06:05:51.619431+0000","last_clean":"2024-05-28T06:05:51.619431+0000","last_became_active":"2024-05-28T06:05:49.842348+0000","last_became_peered":"2024-05-28T06:05:49.842348+0000","last_unstale":"2024-05-28T06:05:51.619431+0000","last_undegraded":"2024-05-28T06:05:51.619431+0000","last_fullsized":"2024-05-28T06:05:51.619431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:57:50.858798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830496+0000","last_change":"2024-05-28T06:05:49.831551+0000","last_active":"2024-05-28T06:05:50.830496+0000","last_peered":"2024-05-28T06:05:50.830496+0000","last_clean":"2024-05-28T06:05:50.830496+0000","last_became_active":"2024-05-28T06:05:49.831275+0000","last_became_peered":"2024-05-28T06:05:49.831275+0000","last_unstale":"2024-05-28T06:05:50.830496+0000","last_undegraded":"2024-05-28T06:05:50.830496+0000","last_fullsized":"2024-05-28T06:05:50.830496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:05.258933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619374+0000","last_change":"2024-05-28T06:05:49.833865+0000","last_active":"2024-05-28T06:05:51.619374+0000","last_peered":"2024-05-28T06:05:51.619374+0000","last_clean":"2024-05-28T06:05:51.619374+0000","last_became_active":"2024-05-28T06:05:49.833613+0000","last_became_peered":"2024-05-28T06:05:49.833613+0000","last_unstale":"2024-05-28T06:05:51.619374+0000","last_undegraded":"2024-05-28T06:05:51.619374+0000","last_fullsized":"2024-05-28T06:05:51.619374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:47:59.969773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619570+0000","last_change":"2024-05-28T06:05:49.832366+0000","last_active":"2024-05-28T06:05:51.619570+0000","last_peered":"2024-05-28T06:05:51.619570+0000","last_clean":"2024-05-28T06:05:51.619570+0000","last_became_active":"2024-05-28T06:05:49.832055+0000","last_became_peered":"2024-05-28T06:05:49.832055+0000","last_unstale":"2024-05-28T06:05:51.619570+0000","last_undegraded":"2024-05-28T06:05:51.619570+0000","last_fullsized":"2024-05-28T06:05:51.619570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:45:56.563383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619839+0000","last_change":"2024-05-28T06:05:49.845929+0000","last_active":"2024-05-28T06:05:51.619839+0000","last_peered":"2024-05-28T06:05:51.619839+0000","last_clean":"2024-05-28T06:05:51.619839+0000","last_became_active":"2024-05-28T06:05:49.845642+0000","last_became_peered":"2024-05-28T06:05:49.845642+0000","last_unstale":"2024-05-28T06:05:51.619839+0000","last_undegraded":"2024-05-28T06:05:51.619839+0000","last_fullsized":"2024-05-28T06:05:51.619839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:25:16.860803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849143+0000","last_change":"2024-05-28T06:05:49.840616+0000","last_active":"2024-05-28T06:05:50.849143+0000","last_peered":"2024-05-28T06:05:50.849143+0000","last_clean":"2024-05-28T06:05:50.849143+0000","last_became_active":"2024-05-28T06:05:49.840364+0000","last_became_peered":"2024-05-28T06:05:49.840364+0000","last_unstale":"2024-05-28T06:05:50.849143+0000","last_undegraded":"2024-05-28T06:05:50.849143+0000","last_fullsized":"2024-05-28T06:05:50.849143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:39.576444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849043+0000","last_change":"2024-05-28T06:05:49.838656+0000","last_active":"2024-05-28T06:05:50.849043+0000","last_peered":"2024-05-28T06:05:50.849043+0000","last_clean":"2024-05-28T06:05:50.849043+0000","last_became_active":"2024-05-28T06:05:49.838227+0000","last_became_peered":"2024-05-28T06:05:49.838227+0000","last_unstale":"2024-05-28T06:05:50.849043+0000","last_undegraded":"2024-05-28T06:05:50.849043+0000","last_fullsized":"2024-05-28T06:05:50.849043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:39:57.417861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832049+0000","last_change":"2024-05-28T06:05:49.839298+0000","last_active":"2024-05-28T06:05:50.832049+0000","last_peered":"2024-05-28T06:05:50.832049+0000","last_clean":"2024-05-28T06:05:50.832049+0000","last_became_active":"2024-05-28T06:05:49.839024+0000","last_became_peered":"2024-05-28T06:05:49.839024+0000","last_unstale":"2024-05-28T06:05:50.832049+0000","last_undegraded":"2024-05-28T06:05:50.832049+0000","last_fullsized":"2024-05-28T06:05:50.832049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:24:17.481208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619981+0000","last_change":"2024-05-28T06:05:49.852183+0000","last_active":"2024-05-28T06:05:51.619981+0000","last_peered":"2024-05-28T06:05:51.619981+0000","last_clean":"2024-05-28T06:05:51.619981+0000","last_became_active":"2024-05-28T06:05:49.851929+0000","last_became_peered":"2024-05-28T06:05:49.851929+0000","last_unstale":"2024-05-28T06:05:51.619981+0000","last_undegraded":"2024-05-28T06:05:51.619981+0000","last_fullsized":"2024-05-28T06:05:51.619981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:40:46.277733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620009+0000","last_change":"2024-05-28T06:05:49.830872+0000","last_active":"2024-05-28T06:05:51.620009+0000","last_peered":"2024-05-28T06:05:51.620009+0000","last_clean":"2024-05-28T06:05:51.620009+0000","last_became_active":"2024-05-28T06:05:49.829663+0000","last_became_peered":"2024-05-28T06:05:49.829663+0000","last_unstale":"2024-05-28T06:05:51.620009+0000","last_undegraded":"2024-05-28T06:05:51.620009+0000","last_fullsized":"2024-05-28T06:05:51.620009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:45:45.914430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846818+0000","last_change":"2024-05-28T06:05:49.841218+0000","last_active":"2024-05-28T06:05:50.846818+0000","last_peered":"2024-05-28T06:05:50.846818+0000","last_clean":"2024-05-28T06:05:50.846818+0000","last_became_active":"2024-05-28T06:05:49.839685+0000","last_became_peered":"2024-05-28T06:05:49.839685+0000","last_unstale":"2024-05-28T06:05:50.846818+0000","last_undegraded":"2024-05-28T06:05:50.846818+0000","last_fullsized":"2024-05-28T06:05:50.846818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:45:56.563383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830436+0000","last_change":"2024-05-28T06:05:49.834469+0000","last_active":"2024-05-28T06:05:50.830436+0000","last_peered":"2024-05-28T06:05:50.830436+0000","last_clean":"2024-05-28T06:05:50.830436+0000","last_became_active":"2024-05-28T06:05:49.834129+0000","last_became_peered":"2024-05-28T06:05:49.834129+0000","last_unstale":"2024-05-28T06:05:50.830436+0000","last_undegraded":"2024-05-28T06:05:50.830436+0000","last_fullsized":"2024-05-28T06:05:50.830436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:39.576444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832847+0000","last_change":"2024-05-28T06:05:49.836984+0000","last_active":"2024-05-28T06:05:50.832847+0000","last_peered":"2024-05-28T06:05:50.832847+0000","last_clean":"2024-05-28T06:05:50.832847+0000","last_became_active":"2024-05-28T06:05:49.836754+0000","last_became_peered":"2024-05-28T06:05:49.836754+0000","last_unstale":"2024-05-28T06:05:50.832847+0000","last_undegraded":"2024-05-28T06:05:50.832847+0000","last_fullsized":"2024-05-28T06:05:50.832847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:25:16.860803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275303+0000","last_change":"2024-05-28T06:05:49.843255+0000","last_active":"2024-05-28T06:05:51.275303+0000","last_peered":"2024-05-28T06:05:51.275303+0000","last_clean":"2024-05-28T06:05:51.275303+0000","last_became_active":"2024-05-28T06:05:49.841453+0000","last_became_peered":"2024-05-28T06:05:49.841453+0000","last_unstale":"2024-05-28T06:05:51.275303+0000","last_undegraded":"2024-05-28T06:05:51.275303+0000","last_fullsized":"2024-05-28T06:05:51.275303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:47:11.938003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619672+0000","last_change":"2024-05-28T06:05:49.850933+0000","last_active":"2024-05-28T06:05:51.619672+0000","last_peered":"2024-05-28T06:05:51.619672+0000","last_clean":"2024-05-28T06:05:51.619672+0000","last_became_active":"2024-05-28T06:05:49.850659+0000","last_became_peered":"2024-05-28T06:05:49.850659+0000","last_unstale":"2024-05-28T06:05:51.619672+0000","last_undegraded":"2024-05-28T06:05:51.619672+0000","last_fullsized":"2024-05-28T06:05:51.619672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:54:25.520215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849165+0000","last_change":"2024-05-28T06:05:49.835678+0000","last_active":"2024-05-28T06:05:50.849165+0000","last_peered":"2024-05-28T06:05:50.849165+0000","last_clean":"2024-05-28T06:05:50.849165+0000","last_became_active":"2024-05-28T06:05:49.835404+0000","last_became_peered":"2024-05-28T06:05:49.835404+0000","last_unstale":"2024-05-28T06:05:50.849165+0000","last_undegraded":"2024-05-28T06:05:50.849165+0000","last_fullsized":"2024-05-28T06:05:50.849165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:05.258933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620237+0000","last_change":"2024-05-28T06:05:49.837644+0000","last_active":"2024-05-28T06:05:51.620237+0000","last_peered":"2024-05-28T06:05:51.620237+0000","last_clean":"2024-05-28T06:05:51.620237+0000","last_became_active":"2024-05-28T06:05:49.833254+0000","last_became_peered":"2024-05-28T06:05:49.833254+0000","last_unstale":"2024-05-28T06:05:51.620237+0000","last_undegraded":"2024-05-28T06:05:51.620237+0000","last_fullsized":"2024-05-28T06:05:51.620237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:37:35.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830664+0000","last_change":"2024-05-28T06:05:49.835830+0000","last_active":"2024-05-28T06:05:50.830664+0000","last_peered":"2024-05-28T06:05:50.830664+0000","last_clean":"2024-05-28T06:05:50.830664+0000","last_became_active":"2024-05-28T06:05:49.835539+0000","last_became_peered":"2024-05-28T06:05:49.835539+0000","last_unstale":"2024-05-28T06:05:50.830664+0000","last_undegraded":"2024-05-28T06:05:50.830664+0000","last_fullsized":"2024-05-28T06:05:50.830664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:40:46.277733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619508+0000","last_change":"2024-05-28T06:05:49.847289+0000","last_active":"2024-05-28T06:05:51.619508+0000","last_peered":"2024-05-28T06:05:51.619508+0000","last_clean":"2024-05-28T06:05:51.619508+0000","last_became_active":"2024-05-28T06:05:49.846943+0000","last_became_peered":"2024-05-28T06:05:49.846943+0000","last_unstale":"2024-05-28T06:05:51.619508+0000","last_undegraded":"2024-05-28T06:05:51.619508+0000","last_fullsized":"2024-05-28T06:05:51.619508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:46:50.877903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830612+0000","last_change":"2024-05-28T06:05:49.832701+0000","last_active":"2024-05-28T06:05:50.830612+0000","last_peered":"2024-05-28T06:05:50.830612+0000","last_clean":"2024-05-28T06:05:50.830612+0000","last_became_active":"2024-05-28T06:05:49.832339+0000","last_became_peered":"2024-05-28T06:05:49.832339+0000","last_unstale":"2024-05-28T06:05:50.830612+0000","last_undegraded":"2024-05-28T06:05:50.830612+0000","last_fullsized":"2024-05-28T06:05:50.830612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:19:32.041344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619788+0000","last_change":"2024-05-28T06:05:49.836126+0000","last_active":"2024-05-28T06:05:51.619788+0000","last_peered":"2024-05-28T06:05:51.619788+0000","last_clean":"2024-05-28T06:05:51.619788+0000","last_became_active":"2024-05-28T06:05:49.835875+0000","last_became_peered":"2024-05-28T06:05:49.835875+0000","last_unstale":"2024-05-28T06:05:51.619788+0000","last_undegraded":"2024-05-28T06:05:51.619788+0000","last_fullsized":"2024-05-28T06:05:51.619788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:39.576444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849191+0000","last_change":"2024-05-28T06:05:49.839809+0000","last_active":"2024-05-28T06:05:50.849191+0000","last_peered":"2024-05-28T06:05:50.849191+0000","last_clean":"2024-05-28T06:05:50.849191+0000","last_became_active":"2024-05-28T06:05:49.839063+0000","last_became_peered":"2024-05-28T06:05:49.839063+0000","last_unstale":"2024-05-28T06:05:50.849191+0000","last_undegraded":"2024-05-28T06:05:50.849191+0000","last_fullsized":"2024-05-28T06:05:50.849191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:19:32.041344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846997+0000","last_change":"2024-05-28T06:05:49.837449+0000","last_active":"2024-05-28T06:05:50.846997+0000","last_peered":"2024-05-28T06:05:50.846997+0000","last_clean":"2024-05-28T06:05:50.846997+0000","last_became_active":"2024-05-28T06:05:49.833358+0000","last_became_peered":"2024-05-28T06:05:49.833358+0000","last_unstale":"2024-05-28T06:05:50.846997+0000","last_undegraded":"2024-05-28T06:05:50.846997+0000","last_fullsized":"2024-05-28T06:05:50.846997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:39.576444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619737+0000","last_change":"2024-05-28T06:05:49.836384+0000","last_active":"2024-05-28T06:05:51.619737+0000","last_peered":"2024-05-28T06:05:51.619737+0000","last_clean":"2024-05-28T06:05:51.619737+0000","last_became_active":"2024-05-28T06:05:49.835821+0000","last_became_peered":"2024-05-28T06:05:49.835821+0000","last_unstale":"2024-05-28T06:05:51.619737+0000","last_undegraded":"2024-05-28T06:05:51.619737+0000","last_fullsized":"2024-05-28T06:05:51.619737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:32:22.883360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620320+0000","last_change":"2024-05-28T06:05:49.838410+0000","last_active":"2024-05-28T06:05:51.620320+0000","last_peered":"2024-05-28T06:05:51.620320+0000","last_clean":"2024-05-28T06:05:51.620320+0000","last_became_active":"2024-05-28T06:05:49.838053+0000","last_became_peered":"2024-05-28T06:05:49.838053+0000","last_unstale":"2024-05-28T06:05:51.620320+0000","last_undegraded":"2024-05-28T06:05:51.620320+0000","last_fullsized":"2024-05-28T06:05:51.620320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:46:50.877903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830834+0000","last_change":"2024-05-28T06:05:49.851329+0000","last_active":"2024-05-28T06:05:50.830834+0000","last_peered":"2024-05-28T06:05:50.830834+0000","last_clean":"2024-05-28T06:05:50.830834+0000","last_became_active":"2024-05-28T06:05:49.850771+0000","last_became_peered":"2024-05-28T06:05:49.850771+0000","last_unstale":"2024-05-28T06:05:50.830834+0000","last_undegraded":"2024-05-28T06:05:50.830834+0000","last_fullsized":"2024-05-28T06:05:50.830834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:57:50.858798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275129+0000","last_change":"2024-05-28T06:05:49.822523+0000","last_active":"2024-05-28T06:05:51.275129+0000","last_peered":"2024-05-28T06:05:51.275129+0000","last_clean":"2024-05-28T06:05:51.275129+0000","last_became_active":"2024-05-28T06:05:49.822143+0000","last_became_peered":"2024-05-28T06:05:49.822143+0000","last_unstale":"2024-05-28T06:05:51.275129+0000","last_undegraded":"2024-05-28T06:05:51.275129+0000","last_fullsized":"2024-05-28T06:05:51.275129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:24:17.481208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.848820+0000","last_change":"2024-05-28T06:05:49.840151+0000","last_active":"2024-05-28T06:05:50.848820+0000","last_peered":"2024-05-28T06:05:50.848820+0000","last_clean":"2024-05-28T06:05:50.848820+0000","last_became_active":"2024-05-28T06:05:49.839815+0000","last_became_peered":"2024-05-28T06:05:49.839815+0000","last_unstale":"2024-05-28T06:05:50.848820+0000","last_undegraded":"2024-05-28T06:05:50.848820+0000","last_fullsized":"2024-05-28T06:05:50.848820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:46:50.877903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832139+0000","last_change":"2024-05-28T06:05:49.834448+0000","last_active":"2024-05-28T06:05:50.832139+0000","last_peered":"2024-05-28T06:05:50.832139+0000","last_clean":"2024-05-28T06:05:50.832139+0000","last_became_active":"2024-05-28T06:05:49.833479+0000","last_became_peered":"2024-05-28T06:05:49.833479+0000","last_unstale":"2024-05-28T06:05:50.832139+0000","last_undegraded":"2024-05-28T06:05:50.832139+0000","last_fullsized":"2024-05-28T06:05:50.832139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:03:32.895368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620222+0000","last_change":"2024-05-28T06:05:48.832582+0000","last_active":"2024-05-28T06:05:51.620222+0000","last_peered":"2024-05-28T06:05:51.620222+0000","last_clean":"2024-05-28T06:05:51.620222+0000","last_became_active":"2024-05-28T06:05:48.828599+0000","last_became_peered":"2024-05-28T06:05:48.828599+0000","last_unstale":"2024-05-28T06:05:51.620222+0000","last_undegraded":"2024-05-28T06:05:51.620222+0000","last_fullsized":"2024-05-28T06:05:51.620222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:15:33.728795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620372+0000","last_change":"2024-05-28T06:05:49.838397+0000","last_active":"2024-05-28T06:05:51.620372+0000","last_peered":"2024-05-28T06:05:51.620372+0000","last_clean":"2024-05-28T06:05:51.620372+0000","last_became_active":"2024-05-28T06:05:49.838080+0000","last_became_peered":"2024-05-28T06:05:49.838080+0000","last_unstale":"2024-05-28T06:05:51.620372+0000","last_undegraded":"2024-05-28T06:05:51.620372+0000","last_fullsized":"2024-05-28T06:05:51.620372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:32:22.883360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.848958+0000","last_change":"2024-05-28T06:05:48.823837+0000","last_active":"2024-05-28T06:05:50.848958+0000","last_peered":"2024-05-28T06:05:50.848958+0000","last_clean":"2024-05-28T06:05:50.848958+0000","last_became_active":"2024-05-28T06:05:48.823531+0000","last_became_peered":"2024-05-28T06:05:48.823531+0000","last_unstale":"2024-05-28T06:05:50.848958+0000","last_undegraded":"2024-05-28T06:05:50.848958+0000","last_fullsized":"2024-05-28T06:05:50.848958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:30:03.706927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619568+0000","last_change":"2024-05-28T06:05:48.829331+0000","last_active":"2024-05-28T06:05:51.619568+0000","last_peered":"2024-05-28T06:05:51.619568+0000","last_clean":"2024-05-28T06:05:51.619568+0000","last_became_active":"2024-05-28T06:05:48.828618+0000","last_became_peered":"2024-05-28T06:05:48.828618+0000","last_unstale":"2024-05-28T06:05:51.619568+0000","last_undegraded":"2024-05-28T06:05:51.619568+0000","last_fullsized":"2024-05-28T06:05:51.619568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:41:15.562847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619431+0000","last_change":"2024-05-28T06:05:49.835162+0000","last_active":"2024-05-28T06:05:51.619431+0000","last_peered":"2024-05-28T06:05:51.619431+0000","last_clean":"2024-05-28T06:05:51.619431+0000","last_became_active":"2024-05-28T06:05:49.834914+0000","last_became_peered":"2024-05-28T06:05:49.834914+0000","last_unstale":"2024-05-28T06:05:51.619431+0000","last_undegraded":"2024-05-28T06:05:51.619431+0000","last_fullsized":"2024-05-28T06:05:51.619431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:37:35.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830705+0000","last_change":"2024-05-28T06:05:48.819148+0000","last_active":"2024-05-28T06:05:50.830705+0000","last_peered":"2024-05-28T06:05:50.830705+0000","last_clean":"2024-05-28T06:05:50.830705+0000","last_became_active":"2024-05-28T06:05:48.818867+0000","last_became_peered":"2024-05-28T06:05:48.818867+0000","last_unstale":"2024-05-28T06:05:50.830705+0000","last_undegraded":"2024-05-28T06:05:50.830705+0000","last_fullsized":"2024-05-28T06:05:50.830705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:54:54.655580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846821+0000","last_change":"2024-05-28T06:05:49.835117+0000","last_active":"2024-05-28T06:05:50.846821+0000","last_peered":"2024-05-28T06:05:50.846821+0000","last_clean":"2024-05-28T06:05:50.846821+0000","last_became_active":"2024-05-28T06:05:49.834862+0000","last_became_peered":"2024-05-28T06:05:49.834862+0000","last_unstale":"2024-05-28T06:05:50.846821+0000","last_undegraded":"2024-05-28T06:05:50.846821+0000","last_fullsized":"2024-05-28T06:05:50.846821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:46:50.877903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849118+0000","last_change":"2024-05-28T06:05:48.829871+0000","last_active":"2024-05-28T06:05:50.849118+0000","last_peered":"2024-05-28T06:05:50.849118+0000","last_clean":"2024-05-28T06:05:50.849118+0000","last_became_active":"2024-05-28T06:05:48.829598+0000","last_became_peered":"2024-05-28T06:05:48.829598+0000","last_unstale":"2024-05-28T06:05:50.849118+0000","last_undegraded":"2024-05-28T06:05:50.849118+0000","last_fullsized":"2024-05-28T06:05:50.849118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:18:51.804296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832692+0000","last_change":"2024-05-28T06:05:49.837126+0000","last_active":"2024-05-28T06:05:50.832692+0000","last_peered":"2024-05-28T06:05:50.832692+0000","last_clean":"2024-05-28T06:05:50.832692+0000","last_became_active":"2024-05-28T06:05:49.836676+0000","last_became_peered":"2024-05-28T06:05:49.836676+0000","last_unstale":"2024-05-28T06:05:50.832692+0000","last_undegraded":"2024-05-28T06:05:50.832692+0000","last_fullsized":"2024-05-28T06:05:50.832692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:58:07.996206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832655+0000","last_change":"2024-05-28T06:05:48.821859+0000","last_active":"2024-05-28T06:05:50.832655+0000","last_peered":"2024-05-28T06:05:50.832655+0000","last_clean":"2024-05-28T06:05:50.832655+0000","last_became_active":"2024-05-28T06:05:48.821297+0000","last_became_peered":"2024-05-28T06:05:48.821297+0000","last_unstale":"2024-05-28T06:05:50.832655+0000","last_undegraded":"2024-05-28T06:05:50.832655+0000","last_fullsized":"2024-05-28T06:05:50.832655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:35:04.180425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620652+0000","last_change":"2024-05-28T06:05:49.831784+0000","last_active":"2024-05-28T06:05:51.620652+0000","last_peered":"2024-05-28T06:05:51.620652+0000","last_clean":"2024-05-28T06:05:51.620652+0000","last_became_active":"2024-05-28T06:05:49.831487+0000","last_became_peered":"2024-05-28T06:05:49.831487+0000","last_unstale":"2024-05-28T06:05:51.620652+0000","last_undegraded":"2024-05-28T06:05:51.620652+0000","last_fullsized":"2024-05-28T06:05:51.620652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:05.258933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846970+0000","last_change":"2024-05-28T06:05:48.817642+0000","last_active":"2024-05-28T06:05:50.846970+0000","last_peered":"2024-05-28T06:05:50.846970+0000","last_clean":"2024-05-28T06:05:50.846970+0000","last_became_active":"2024-05-28T06:05:48.816830+0000","last_became_peered":"2024-05-28T06:05:48.816830+0000","last_unstale":"2024-05-28T06:05:50.846970+0000","last_undegraded":"2024-05-28T06:05:50.846970+0000","last_fullsized":"2024-05-28T06:05:50.846970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:30:03.706927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832103+0000","last_change":"2024-05-28T06:05:49.831624+0000","last_active":"2024-05-28T06:05:50.832103+0000","last_peered":"2024-05-28T06:05:50.832103+0000","last_clean":"2024-05-28T06:05:50.832103+0000","last_became_active":"2024-05-28T06:05:49.830861+0000","last_became_peered":"2024-05-28T06:05:49.830861+0000","last_unstale":"2024-05-28T06:05:50.832103+0000","last_undegraded":"2024-05-28T06:05:50.832103+0000","last_fullsized":"2024-05-28T06:05:50.832103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:47:11.938003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849091+0000","last_change":"2024-05-28T06:05:48.827308+0000","last_active":"2024-05-28T06:05:50.849091+0000","last_peered":"2024-05-28T06:05:50.849091+0000","last_clean":"2024-05-28T06:05:50.849091+0000","last_became_active":"2024-05-28T06:05:48.827058+0000","last_became_peered":"2024-05-28T06:05:48.827058+0000","last_unstale":"2024-05-28T06:05:50.849091+0000","last_undegraded":"2024-05-28T06:05:50.849091+0000","last_fullsized":"2024-05-28T06:05:50.849091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:03:31.889186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619356+0000","last_change":"2024-05-28T06:05:49.850742+0000","last_active":"2024-05-28T06:05:51.619356+0000","last_peered":"2024-05-28T06:05:51.619356+0000","last_clean":"2024-05-28T06:05:51.619356+0000","last_became_active":"2024-05-28T06:05:49.850284+0000","last_became_peered":"2024-05-28T06:05:49.850284+0000","last_unstale":"2024-05-28T06:05:51.619356+0000","last_undegraded":"2024-05-28T06:05:51.619356+0000","last_fullsized":"2024-05-28T06:05:51.619356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:19:32.041344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620430+0000","last_change":"2024-05-28T06:05:48.825087+0000","last_active":"2024-05-28T06:05:51.620430+0000","last_peered":"2024-05-28T06:05:51.620430+0000","last_clean":"2024-05-28T06:05:51.620430+0000","last_became_active":"2024-05-28T06:05:48.824790+0000","last_became_peered":"2024-05-28T06:05:48.824790+0000","last_unstale":"2024-05-28T06:05:51.620430+0000","last_undegraded":"2024-05-28T06:05:51.620430+0000","last_fullsized":"2024-05-28T06:05:51.620430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:41:15.562847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620110+0000","last_change":"2024-05-28T06:05:49.831857+0000","last_active":"2024-05-28T06:05:51.620110+0000","last_peered":"2024-05-28T06:05:51.620110+0000","last_clean":"2024-05-28T06:05:51.620110+0000","last_became_active":"2024-05-28T06:05:49.831461+0000","last_became_peered":"2024-05-28T06:05:49.831461+0000","last_unstale":"2024-05-28T06:05:51.620110+0000","last_undegraded":"2024-05-28T06:05:51.620110+0000","last_fullsized":"2024-05-28T06:05:51.620110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:02:07.375017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830945+0000","last_change":"2024-05-28T06:05:48.827406+0000","last_active":"2024-05-28T06:05:50.830945+0000","last_peered":"2024-05-28T06:05:50.830945+0000","last_clean":"2024-05-28T06:05:50.830945+0000","last_became_active":"2024-05-28T06:05:48.827095+0000","last_became_peered":"2024-05-28T06:05:48.827095+0000","last_unstale":"2024-05-28T06:05:50.830945+0000","last_undegraded":"2024-05-28T06:05:50.830945+0000","last_fullsized":"2024-05-28T06:05:50.830945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:18:51.804296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619606+0000","last_change":"2024-05-28T06:05:49.848867+0000","last_active":"2024-05-28T06:05:51.619606+0000","last_peered":"2024-05-28T06:05:51.619606+0000","last_clean":"2024-05-28T06:05:51.619606+0000","last_became_active":"2024-05-28T06:05:49.848544+0000","last_became_peered":"2024-05-28T06:05:49.848544+0000","last_unstale":"2024-05-28T06:05:51.619606+0000","last_undegraded":"2024-05-28T06:05:51.619606+0000","last_fullsized":"2024-05-28T06:05:51.619606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:54:32.928419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.848795+0000","last_change":"2024-05-28T06:05:48.823850+0000","last_active":"2024-05-28T06:05:50.848795+0000","last_peered":"2024-05-28T06:05:50.848795+0000","last_clean":"2024-05-28T06:05:50.848795+0000","last_became_active":"2024-05-28T06:05:48.823565+0000","last_became_peered":"2024-05-28T06:05:48.823565+0000","last_unstale":"2024-05-28T06:05:50.848795+0000","last_undegraded":"2024-05-28T06:05:50.848795+0000","last_fullsized":"2024-05-28T06:05:50.848795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:54:54.655580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.848867+0000","last_change":"2024-05-28T06:05:49.833197+0000","last_active":"2024-05-28T06:05:50.848867+0000","last_peered":"2024-05-28T06:05:50.848867+0000","last_clean":"2024-05-28T06:05:50.848867+0000","last_became_active":"2024-05-28T06:05:49.832937+0000","last_became_peered":"2024-05-28T06:05:49.832937+0000","last_unstale":"2024-05-28T06:05:50.848867+0000","last_undegraded":"2024-05-28T06:05:50.848867+0000","last_fullsized":"2024-05-28T06:05:50.848867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:32:22.883360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275013+0000","last_change":"2024-05-28T06:05:48.826780+0000","last_active":"2024-05-28T06:05:51.275013+0000","last_peered":"2024-05-28T06:05:51.275013+0000","last_clean":"2024-05-28T06:05:51.275013+0000","last_became_active":"2024-05-28T06:05:48.824955+0000","last_became_peered":"2024-05-28T06:05:48.824955+0000","last_unstale":"2024-05-28T06:05:51.275013+0000","last_undegraded":"2024-05-28T06:05:51.275013+0000","last_fullsized":"2024-05-28T06:05:51.275013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:41:15.562847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619355+0000","last_change":"2024-05-28T06:05:49.841278+0000","last_active":"2024-05-28T06:05:51.619355+0000","last_peered":"2024-05-28T06:05:51.619355+0000","last_clean":"2024-05-28T06:05:51.619355+0000","last_became_active":"2024-05-28T06:05:49.840945+0000","last_became_peered":"2024-05-28T06:05:49.840945+0000","last_unstale":"2024-05-28T06:05:51.619355+0000","last_undegraded":"2024-05-28T06:05:51.619355+0000","last_fullsized":"2024-05-28T06:05:51.619355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:40:46.277733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832319+0000","last_change":"2024-05-28T06:05:48.825832+0000","last_active":"2024-05-28T06:05:50.832319+0000","last_peered":"2024-05-28T06:05:50.832319+0000","last_clean":"2024-05-28T06:05:50.832319+0000","last_became_active":"2024-05-28T06:05:48.825446+0000","last_became_peered":"2024-05-28T06:05:48.825446+0000","last_unstale":"2024-05-28T06:05:50.832319+0000","last_undegraded":"2024-05-28T06:05:50.832319+0000","last_fullsized":"2024-05-28T06:05:50.832319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:09:22.855060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619710+0000","last_change":"2024-05-28T06:05:49.854377+0000","last_active":"2024-05-28T06:05:51.619710+0000","last_peered":"2024-05-28T06:05:51.619710+0000","last_clean":"2024-05-28T06:05:51.619710+0000","last_became_active":"2024-05-28T06:05:49.853287+0000","last_became_peered":"2024-05-28T06:05:49.853287+0000","last_unstale":"2024-05-28T06:05:51.619710+0000","last_undegraded":"2024-05-28T06:05:51.619710+0000","last_fullsized":"2024-05-28T06:05:51.619710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:54:47.876861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275258+0000","last_change":"2024-05-28T06:05:48.828277+0000","last_active":"2024-05-28T06:05:51.275258+0000","last_peered":"2024-05-28T06:05:51.275258+0000","last_clean":"2024-05-28T06:05:51.275258+0000","last_became_active":"2024-05-28T06:05:48.828066+0000","last_became_peered":"2024-05-28T06:05:48.828066+0000","last_unstale":"2024-05-28T06:05:51.275258+0000","last_undegraded":"2024-05-28T06:05:51.275258+0000","last_fullsized":"2024-05-28T06:05:51.275258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:54:54.655580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619958+0000","last_change":"2024-05-28T06:05:49.852523+0000","last_active":"2024-05-28T06:05:51.619958+0000","last_peered":"2024-05-28T06:05:51.619958+0000","last_clean":"2024-05-28T06:05:51.619958+0000","last_became_active":"2024-05-28T06:05:49.852170+0000","last_became_peered":"2024-05-28T06:05:49.852170+0000","last_unstale":"2024-05-28T06:05:51.619958+0000","last_undegraded":"2024-05-28T06:05:51.619958+0000","last_fullsized":"2024-05-28T06:05:51.619958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:30:15.652435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.847045+0000","last_change":"2024-05-28T06:05:48.825987+0000","last_active":"2024-05-28T06:05:50.847045+0000","last_peered":"2024-05-28T06:05:50.847045+0000","last_clean":"2024-05-28T06:05:50.847045+0000","last_became_active":"2024-05-28T06:05:48.824571+0000","last_became_peered":"2024-05-28T06:05:48.824571+0000","last_unstale":"2024-05-28T06:05:50.847045+0000","last_undegraded":"2024-05-28T06:05:50.847045+0000","last_fullsized":"2024-05-28T06:05:50.847045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:24:16.475026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830941+0000","last_change":"2024-05-28T06:05:49.835359+0000","last_active":"2024-05-28T06:05:50.830941+0000","last_peered":"2024-05-28T06:05:50.830941+0000","last_clean":"2024-05-28T06:05:50.830941+0000","last_became_active":"2024-05-28T06:05:49.834666+0000","last_became_peered":"2024-05-28T06:05:49.834666+0000","last_unstale":"2024-05-28T06:05:50.830941+0000","last_undegraded":"2024-05-28T06:05:50.830941+0000","last_fullsized":"2024-05-28T06:05:50.830941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:54:32.928419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275152+0000","last_change":"2024-05-28T06:05:48.826646+0000","last_active":"2024-05-28T06:05:51.275152+0000","last_peered":"2024-05-28T06:05:51.275152+0000","last_clean":"2024-05-28T06:05:51.275152+0000","last_became_active":"2024-05-28T06:05:48.825673+0000","last_became_peered":"2024-05-28T06:05:48.825673+0000","last_unstale":"2024-05-28T06:05:51.275152+0000","last_undegraded":"2024-05-28T06:05:51.275152+0000","last_fullsized":"2024-05-28T06:05:51.275152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:35:04.180425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619481+0000","last_change":"2024-05-28T06:05:49.846068+0000","last_active":"2024-05-28T06:05:51.619481+0000","last_peered":"2024-05-28T06:05:51.619481+0000","last_clean":"2024-05-28T06:05:51.619481+0000","last_became_active":"2024-05-28T06:05:49.845797+0000","last_became_peered":"2024-05-28T06:05:49.845797+0000","last_unstale":"2024-05-28T06:05:51.619481+0000","last_undegraded":"2024-05-28T06:05:51.619481+0000","last_fullsized":"2024-05-28T06:05:51.619481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:58:36.770938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619274+0000","last_change":"2024-05-28T06:05:38.517922+0000","last_active":"2024-05-28T06:05:51.619274+0000","last_peered":"2024-05-28T06:05:51.619274+0000","last_clean":"2024-05-28T06:05:51.619274+0000","last_became_active":"2024-05-28T06:05:38.514745+0000","last_became_peered":"2024-05-28T06:05:38.514745+0000","last_unstale":"2024-05-28T06:05:51.619274+0000","last_undegraded":"2024-05-28T06:05:51.619274+0000","last_fullsized":"2024-05-28T06:05:51.619274+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_clean_scrub_stamp":"2024-05-28T06:05:37.485018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:23:27.978203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830398+0000","last_change":"2024-05-28T06:05:48.821497+0000","last_active":"2024-05-28T06:05:50.830398+0000","last_peered":"2024-05-28T06:05:50.830398+0000","last_clean":"2024-05-28T06:05:50.830398+0000","last_became_active":"2024-05-28T06:05:48.821092+0000","last_became_peered":"2024-05-28T06:05:48.821092+0000","last_unstale":"2024-05-28T06:05:50.830398+0000","last_undegraded":"2024-05-28T06:05:50.830398+0000","last_fullsized":"2024-05-28T06:05:50.830398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:15:33.728795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620353+0000","last_change":"2024-05-28T06:05:49.841257+0000","last_active":"2024-05-28T06:05:51.620353+0000","last_peered":"2024-05-28T06:05:51.620353+0000","last_clean":"2024-05-28T06:05:51.620353+0000","last_became_active":"2024-05-28T06:05:49.840922+0000","last_became_peered":"2024-05-28T06:05:49.840922+0000","last_unstale":"2024-05-28T06:05:51.620353+0000","last_undegraded":"2024-05-28T06:05:51.620353+0000","last_fullsized":"2024-05-28T06:05:51.620353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:57:50.858798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619054+0000","last_change":"2024-05-28T06:05:48.829694+0000","last_active":"2024-05-28T06:05:51.619054+0000","last_peered":"2024-05-28T06:05:51.619054+0000","last_clean":"2024-05-28T06:05:51.619054+0000","last_became_active":"2024-05-28T06:05:48.829470+0000","last_became_peered":"2024-05-28T06:05:48.829470+0000","last_unstale":"2024-05-28T06:05:51.619054+0000","last_undegraded":"2024-05-28T06:05:51.619054+0000","last_fullsized":"2024-05-28T06:05:51.619054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:03:31.889186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619991+0000","last_change":"2024-05-28T06:05:49.842825+0000","last_active":"2024-05-28T06:05:51.619991+0000","last_peered":"2024-05-28T06:05:51.619991+0000","last_clean":"2024-05-28T06:05:51.619991+0000","last_became_active":"2024-05-28T06:05:49.842497+0000","last_became_peered":"2024-05-28T06:05:49.842497+0000","last_unstale":"2024-05-28T06:05:51.619991+0000","last_undegraded":"2024-05-28T06:05:51.619991+0000","last_fullsized":"2024-05-28T06:05:51.619991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:30:16.017763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275109+0000","last_change":"2024-05-28T06:05:48.824739+0000","last_active":"2024-05-28T06:05:51.275109+0000","last_peered":"2024-05-28T06:05:51.275109+0000","last_clean":"2024-05-28T06:05:51.275109+0000","last_became_active":"2024-05-28T06:05:48.824425+0000","last_became_peered":"2024-05-28T06:05:48.824425+0000","last_unstale":"2024-05-28T06:05:51.275109+0000","last_undegraded":"2024-05-28T06:05:51.275109+0000","last_fullsized":"2024-05-28T06:05:51.275109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:15:33.728795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846831+0000","last_change":"2024-05-28T06:05:49.832900+0000","last_active":"2024-05-28T06:05:50.846831+0000","last_peered":"2024-05-28T06:05:50.846831+0000","last_clean":"2024-05-28T06:05:50.846831+0000","last_became_active":"2024-05-28T06:05:49.832648+0000","last_became_peered":"2024-05-28T06:05:49.832648+0000","last_unstale":"2024-05-28T06:05:50.846831+0000","last_undegraded":"2024-05-28T06:05:50.846831+0000","last_fullsized":"2024-05-28T06:05:50.846831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:32:22.883360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.831036+0000","last_change":"2024-05-28T06:05:48.809280+0000","last_active":"2024-05-28T06:05:50.831036+0000","last_peered":"2024-05-28T06:05:50.831036+0000","last_clean":"2024-05-28T06:05:50.831036+0000","last_became_active":"2024-05-28T06:05:48.808937+0000","last_became_peered":"2024-05-28T06:05:48.808937+0000","last_unstale":"2024-05-28T06:05:50.831036+0000","last_undegraded":"2024-05-28T06:05:50.831036+0000","last_fullsized":"2024-05-28T06:05:50.831036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:03:31.889186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832022+0000","last_change":"2024-05-28T06:05:49.840563+0000","last_active":"2024-05-28T06:05:50.832022+0000","last_peered":"2024-05-28T06:05:50.832022+0000","last_clean":"2024-05-28T06:05:50.832022+0000","last_became_active":"2024-05-28T06:05:49.840221+0000","last_became_peered":"2024-05-28T06:05:49.840221+0000","last_unstale":"2024-05-28T06:05:50.832022+0000","last_undegraded":"2024-05-28T06:05:50.832022+0000","last_fullsized":"2024-05-28T06:05:50.832022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:53:43.751639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.847057+0000","last_change":"2024-05-28T06:05:48.819109+0000","last_active":"2024-05-28T06:05:50.847057+0000","last_peered":"2024-05-28T06:05:50.847057+0000","last_clean":"2024-05-28T06:05:50.847057+0000","last_became_active":"2024-05-28T06:05:48.818859+0000","last_became_peered":"2024-05-28T06:05:48.818859+0000","last_unstale":"2024-05-28T06:05:50.847057+0000","last_undegraded":"2024-05-28T06:05:50.847057+0000","last_fullsized":"2024-05-28T06:05:50.847057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:54:54.655580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.831618+0000","last_change":"2024-05-28T06:05:49.835770+0000","last_active":"2024-05-28T06:05:50.831618+0000","last_peered":"2024-05-28T06:05:50.831618+0000","last_clean":"2024-05-28T06:05:50.831618+0000","last_became_active":"2024-05-28T06:05:49.835041+0000","last_became_peered":"2024-05-28T06:05:49.835041+0000","last_unstale":"2024-05-28T06:05:50.831618+0000","last_undegraded":"2024-05-28T06:05:50.831618+0000","last_fullsized":"2024-05-28T06:05:50.831618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:54:47.876861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619634+0000","last_change":"2024-05-28T06:05:48.832048+0000","last_active":"2024-05-28T06:05:51.619634+0000","last_peered":"2024-05-28T06:05:51.619634+0000","last_clean":"2024-05-28T06:05:51.619634+0000","last_became_active":"2024-05-28T06:05:48.831810+0000","last_became_peered":"2024-05-28T06:05:48.831810+0000","last_unstale":"2024-05-28T06:05:51.619634+0000","last_undegraded":"2024-05-28T06:05:51.619634+0000","last_fullsized":"2024-05-28T06:05:51.619634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:47:10.931821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846971+0000","last_change":"2024-05-28T06:05:49.830201+0000","last_active":"2024-05-28T06:05:50.846971+0000","last_peered":"2024-05-28T06:05:50.846971+0000","last_clean":"2024-05-28T06:05:50.846971+0000","last_became_active":"2024-05-28T06:05:49.829999+0000","last_became_peered":"2024-05-28T06:05:49.829999+0000","last_unstale":"2024-05-28T06:05:50.846971+0000","last_undegraded":"2024-05-28T06:05:50.846971+0000","last_fullsized":"2024-05-28T06:05:50.846971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:39:57.417861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849020+0000","last_change":"2024-05-28T06:05:48.822728+0000","last_active":"2024-05-28T06:05:50.849020+0000","last_peered":"2024-05-28T06:05:50.849020+0000","last_clean":"2024-05-28T06:05:50.849020+0000","last_became_active":"2024-05-28T06:05:48.822411+0000","last_became_peered":"2024-05-28T06:05:48.822411+0000","last_unstale":"2024-05-28T06:05:50.849020+0000","last_undegraded":"2024-05-28T06:05:50.849020+0000","last_fullsized":"2024-05-28T06:05:50.849020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:53:42.745457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619778+0000","last_change":"2024-05-28T06:05:49.833123+0000","last_active":"2024-05-28T06:05:51.619778+0000","last_peered":"2024-05-28T06:05:51.619778+0000","last_clean":"2024-05-28T06:05:51.619778+0000","last_became_active":"2024-05-28T06:05:49.832802+0000","last_became_peered":"2024-05-28T06:05:49.832802+0000","last_unstale":"2024-05-28T06:05:51.619778+0000","last_undegraded":"2024-05-28T06:05:51.619778+0000","last_fullsized":"2024-05-28T06:05:51.619778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:39:57.417861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849200+0000","last_change":"2024-05-28T06:05:48.828295+0000","last_active":"2024-05-28T06:05:50.849200+0000","last_peered":"2024-05-28T06:05:50.849200+0000","last_clean":"2024-05-28T06:05:50.849200+0000","last_became_active":"2024-05-28T06:05:48.827978+0000","last_became_peered":"2024-05-28T06:05:48.827978+0000","last_unstale":"2024-05-28T06:05:50.849200+0000","last_undegraded":"2024-05-28T06:05:50.849200+0000","last_fullsized":"2024-05-28T06:05:50.849200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:35:04.180425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620520+0000","last_change":"2024-05-28T06:05:49.838136+0000","last_active":"2024-05-28T06:05:51.620520+0000","last_peered":"2024-05-28T06:05:51.620520+0000","last_clean":"2024-05-28T06:05:51.620520+0000","last_became_active":"2024-05-28T06:05:49.837836+0000","last_became_peered":"2024-05-28T06:05:49.837836+0000","last_unstale":"2024-05-28T06:05:51.620520+0000","last_undegraded":"2024-05-28T06:05:51.620520+0000","last_fullsized":"2024-05-28T06:05:51.620520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:39:57.417861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619057+0000","last_change":"2024-05-28T06:05:48.832109+0000","last_active":"2024-05-28T06:05:51.619057+0000","last_peered":"2024-05-28T06:05:51.619057+0000","last_clean":"2024-05-28T06:05:51.619057+0000","last_became_active":"2024-05-28T06:05:48.831767+0000","last_became_peered":"2024-05-28T06:05:48.831767+0000","last_unstale":"2024-05-28T06:05:51.619057+0000","last_undegraded":"2024-05-28T06:05:51.619057+0000","last_fullsized":"2024-05-28T06:05:51.619057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:18:51.804296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.831881+0000","last_change":"2024-05-28T06:05:49.833942+0000","last_active":"2024-05-28T06:05:50.831881+0000","last_peered":"2024-05-28T06:05:50.831881+0000","last_clean":"2024-05-28T06:05:50.831881+0000","last_became_active":"2024-05-28T06:05:49.833670+0000","last_became_peered":"2024-05-28T06:05:49.833670+0000","last_unstale":"2024-05-28T06:05:50.831881+0000","last_undegraded":"2024-05-28T06:05:50.831881+0000","last_fullsized":"2024-05-28T06:05:50.831881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:30:04.713109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846913+0000","last_change":"2024-05-28T06:05:48.829088+0000","last_active":"2024-05-28T06:05:50.846913+0000","last_peered":"2024-05-28T06:05:50.846913+0000","last_clean":"2024-05-28T06:05:50.846913+0000","last_became_active":"2024-05-28T06:05:48.827450+0000","last_became_peered":"2024-05-28T06:05:48.827450+0000","last_unstale":"2024-05-28T06:05:50.846913+0000","last_undegraded":"2024-05-28T06:05:50.846913+0000","last_fullsized":"2024-05-28T06:05:50.846913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:18:51.804296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619940+0000","last_change":"2024-05-28T06:05:49.833747+0000","last_active":"2024-05-28T06:05:51.619940+0000","last_peered":"2024-05-28T06:05:51.619940+0000","last_clean":"2024-05-28T06:05:51.619940+0000","last_became_active":"2024-05-28T06:05:49.833491+0000","last_became_peered":"2024-05-28T06:05:49.833491+0000","last_unstale":"2024-05-28T06:05:51.619940+0000","last_undegraded":"2024-05-28T06:05:51.619940+0000","last_fullsized":"2024-05-28T06:05:51.619940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:05.258933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846855+0000","last_change":"2024-05-28T06:05:48.833870+0000","last_active":"2024-05-28T06:05:50.846855+0000","last_peered":"2024-05-28T06:05:50.846855+0000","last_clean":"2024-05-28T06:05:50.846855+0000","last_became_active":"2024-05-28T06:05:48.833568+0000","last_became_peered":"2024-05-28T06:05:48.833568+0000","last_unstale":"2024-05-28T06:05:50.846855+0000","last_undegraded":"2024-05-28T06:05:50.846855+0000","last_fullsized":"2024-05-28T06:05:50.846855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:03:31.889186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620136+0000","last_change":"2024-05-28T06:05:49.843381+0000","last_active":"2024-05-28T06:05:51.620136+0000","last_peered":"2024-05-28T06:05:51.620136+0000","last_clean":"2024-05-28T06:05:51.620136+0000","last_became_active":"2024-05-28T06:05:49.843084+0000","last_became_peered":"2024-05-28T06:05:49.843084+0000","last_unstale":"2024-05-28T06:05:51.620136+0000","last_undegraded":"2024-05-28T06:05:51.620136+0000","last_fullsized":"2024-05-28T06:05:51.620136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:47:59.969773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619556+0000","last_change":"2024-05-28T06:05:48.835110+0000","last_active":"2024-05-28T06:05:51.619556+0000","last_peered":"2024-05-28T06:05:51.619556+0000","last_clean":"2024-05-28T06:05:51.619556+0000","last_became_active":"2024-05-28T06:05:48.834798+0000","last_became_peered":"2024-05-28T06:05:48.834798+0000","last_unstale":"2024-05-28T06:05:51.619556+0000","last_undegraded":"2024-05-28T06:05:51.619556+0000","last_fullsized":"2024-05-28T06:05:51.619556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:30:03.706927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.848840+0000","last_change":"2024-05-28T06:05:49.843875+0000","last_active":"2024-05-28T06:05:50.848840+0000","last_peered":"2024-05-28T06:05:50.848840+0000","last_clean":"2024-05-28T06:05:50.848840+0000","last_became_active":"2024-05-28T06:05:49.843563+0000","last_became_peered":"2024-05-28T06:05:49.843563+0000","last_unstale":"2024-05-28T06:05:50.848840+0000","last_undegraded":"2024-05-28T06:05:50.848840+0000","last_fullsized":"2024-05-28T06:05:50.848840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:45:56.563383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.831457+0000","last_change":"2024-05-28T06:05:49.836054+0000","last_active":"2024-05-28T06:05:50.831457+0000","last_peered":"2024-05-28T06:05:50.831457+0000","last_clean":"2024-05-28T06:05:50.831457+0000","last_became_active":"2024-05-28T06:05:49.835419+0000","last_became_peered":"2024-05-28T06:05:49.835419+0000","last_unstale":"2024-05-28T06:05:50.831457+0000","last_undegraded":"2024-05-28T06:05:50.831457+0000","last_fullsized":"2024-05-28T06:05:50.831457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:54:25.520215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619437+0000","last_change":"2024-05-28T06:05:48.834583+0000","last_active":"2024-05-28T06:05:51.619437+0000","last_peered":"2024-05-28T06:05:51.619437+0000","last_clean":"2024-05-28T06:05:51.619437+0000","last_became_active":"2024-05-28T06:05:48.834258+0000","last_became_peered":"2024-05-28T06:05:48.834258+0000","last_unstale":"2024-05-28T06:05:51.619437+0000","last_undegraded":"2024-05-28T06:05:51.619437+0000","last_fullsized":"2024-05-28T06:05:51.619437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:53:42.745457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830842+0000","last_change":"2024-05-28T06:05:49.836273+0000","last_active":"2024-05-28T06:05:50.830842+0000","last_peered":"2024-05-28T06:05:50.830842+0000","last_clean":"2024-05-28T06:05:50.830842+0000","last_became_active":"2024-05-28T06:05:49.835705+0000","last_became_peered":"2024-05-28T06:05:49.835705+0000","last_unstale":"2024-05-28T06:05:50.830842+0000","last_undegraded":"2024-05-28T06:05:50.830842+0000","last_fullsized":"2024-05-28T06:05:50.830842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:58:36.770938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619503+0000","last_change":"2024-05-28T06:05:48.833771+0000","last_active":"2024-05-28T06:05:51.619503+0000","last_peered":"2024-05-28T06:05:51.619503+0000","last_clean":"2024-05-28T06:05:51.619503+0000","last_became_active":"2024-05-28T06:05:48.833473+0000","last_became_peered":"2024-05-28T06:05:48.833473+0000","last_unstale":"2024-05-28T06:05:51.619503+0000","last_undegraded":"2024-05-28T06:05:51.619503+0000","last_fullsized":"2024-05-28T06:05:51.619503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:24:16.475026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620560+0000","last_change":"2024-05-28T06:05:49.831923+0000","last_active":"2024-05-28T06:05:51.620560+0000","last_peered":"2024-05-28T06:05:51.620560+0000","last_clean":"2024-05-28T06:05:51.620560+0000","last_became_active":"2024-05-28T06:05:49.830965+0000","last_became_peered":"2024-05-28T06:05:49.830965+0000","last_unstale":"2024-05-28T06:05:51.620560+0000","last_undegraded":"2024-05-28T06:05:51.620560+0000","last_fullsized":"2024-05-28T06:05:51.620560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:39.576444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620118+0000","last_change":"2024-05-28T06:05:48.828378+0000","last_active":"2024-05-28T06:05:51.620118+0000","last_peered":"2024-05-28T06:05:51.620118+0000","last_clean":"2024-05-28T06:05:51.620118+0000","last_became_active":"2024-05-28T06:05:48.827986+0000","last_became_peered":"2024-05-28T06:05:48.827986+0000","last_unstale":"2024-05-28T06:05:51.620118+0000","last_undegraded":"2024-05-28T06:05:51.620118+0000","last_fullsized":"2024-05-28T06:05:51.620118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:35:04.180425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619943+0000","last_change":"2024-05-28T06:05:49.852871+0000","last_active":"2024-05-28T06:05:51.619943+0000","last_peered":"2024-05-28T06:05:51.619943+0000","last_clean":"2024-05-28T06:05:51.619943+0000","last_became_active":"2024-05-28T06:05:49.852559+0000","last_became_peered":"2024-05-28T06:05:49.852559+0000","last_unstale":"2024-05-28T06:05:51.619943+0000","last_undegraded":"2024-05-28T06:05:51.619943+0000","last_fullsized":"2024-05-28T06:05:51.619943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:19:32.041344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620707+0000","last_change":"2024-05-28T06:05:48.832472+0000","last_active":"2024-05-28T06:05:51.620707+0000","last_peered":"2024-05-28T06:05:51.620707+0000","last_clean":"2024-05-28T06:05:51.620707+0000","last_became_active":"2024-05-28T06:05:48.831490+0000","last_became_peered":"2024-05-28T06:05:48.831490+0000","last_unstale":"2024-05-28T06:05:51.620707+0000","last_undegraded":"2024-05-28T06:05:51.620707+0000","last_fullsized":"2024-05-28T06:05:51.620707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:36:39.127901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-28T06:05:58.518 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-28T06:05:58.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.693+0000 7f6320400640 1 Processor -- start 2024-05-28T06:05:58.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.693+0000 7f6320400640 1 -- start start 2024-05-28T06:05:58.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.693+0000 7f6320400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f631815ea50 0x7f631815ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:58.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.693+0000 7f6320400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f631815f370 0x7f631815f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:58.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.693+0000 7f6320400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6318162510 con 0x7f631806caa0 2024-05-28T06:05:58.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.693+0000 7f6320400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f6318163120 con 0x7f631815ea50 2024-05-28T06:05:58.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.693+0000 7f6320400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f63181627f0 con 0x7f631815f370 2024-05-28T06:05:58.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.693+0000 7f631da00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f631815ea50 0x7f631815ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:58.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.693+0000 7f631da00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f631815ea50 0x7f631815ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41560/0 (socket says 172.21.15.122:41560) 2024-05-28T06:05:58.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.693+0000 7f631da00640 1 -- 172.21.15.122:0/512031810 learned_addr learned my addr 172.21.15.122:0/512031810 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:58.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.693+0000 7f631d000640 1 --2- 172.21.15.122:0/512031810 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f631815f370 0x7f631815f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:58.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.693+0000 7f631da00640 1 -- 172.21.15.122:0/512031810 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f631815f370 msgr2=0x7f631815f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:58.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.693+0000 7f631da00640 1 --2- 172.21.15.122:0/512031810 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f631815f370 0x7f631815f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.693+0000 7f631da00640 1 -- 172.21.15.122:0/512031810 >> v1:172.21.15.153:6789/0 conn(0x7f631806caa0 legacy=0x7f631806cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:58.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.693+0000 7f631da00640 1 -- 172.21.15.122:0/512031810 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6318162ad0 con 0x7f631815ea50 2024-05-28T06:05:58.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.693+0000 7f631d000640 1 --2- 172.21.15.122:0/512031810 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f631815f370 0x7f631815f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:05:58.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.697+0000 7f631da00640 1 --2- 172.21.15.122:0/512031810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f631815ea50 0x7f631815ee30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f630c009e50 tx=0x7f630c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69356ca9400d9803 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:58.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.697+0000 7f6317e00640 1 -- 172.21.15.122:0/512031810 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c0a5750 con 0x7f631815ea50 2024-05-28T06:05:58.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.697+0000 7f6317e00640 1 -- 172.21.15.122:0/512031810 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f630c0a58f0 con 0x7f631815ea50 2024-05-28T06:05:58.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.697+0000 7f6317e00640 1 -- 172.21.15.122:0/512031810 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c0a5cc0 con 0x7f631815ea50 2024-05-28T06:05:58.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.697+0000 7f6320400640 1 -- 172.21.15.122:0/512031810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f631815ea50 msgr2=0x7f631815ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.697+0000 7f6320400640 1 --2- 172.21.15.122:0/512031810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f631815ea50 0x7f631815ee30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f630c009e50 tx=0x7f630c01c9c0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.697+0000 7f6320400640 1 -- 172.21.15.122:0/512031810 shutdown_connections 2024-05-28T06:05:58.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.697+0000 7f6320400640 1 --2- 172.21.15.122:0/512031810 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f631815f370 0x7f631815f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.697+0000 7f6320400640 1 --2- 172.21.15.122:0/512031810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f631815ea50 0x7f631815ee30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.697+0000 7f6320400640 1 -- 172.21.15.122:0/512031810 >> 172.21.15.122:0/512031810 conn(0x7f63180b4190 msgr2=0x7f63180b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:58.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.697+0000 7f6320400640 1 -- 172.21.15.122:0/512031810 shutdown_connections 2024-05-28T06:05:58.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.697+0000 7f6320400640 1 -- 172.21.15.122:0/512031810 wait complete. 2024-05-28T06:05:58.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f6320400640 1 Processor -- start 2024-05-28T06:05:58.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f6320400640 1 -- start start 2024-05-28T06:05:58.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f6320400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f631806caa0 0x7f63180cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:58.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f6320400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f631815ea50 0x7f63180b7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:58.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f6320400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f631815f370 0x7f6318153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:58.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f6320400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f631816b990 con 0x7f631806caa0 2024-05-28T06:05:58.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f6320400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f631816b810 con 0x7f631815f370 2024-05-28T06:05:58.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f6320400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f631816bb10 con 0x7f631815ea50 2024-05-28T06:05:58.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f631da00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f631806caa0 0x7f63180cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:58.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f631da00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f631806caa0 0x7f63180cf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41574/0 (socket says 172.21.15.122:41574) 2024-05-28T06:05:58.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f631da00640 1 -- 172.21.15.122:0/1750882605 learned_addr learned my addr 172.21.15.122:0/1750882605 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:58.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f631e400640 1 --2- 172.21.15.122:0/1750882605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f631815f370 0x7f6318153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:58.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f631d000640 1 --2- 172.21.15.122:0/1750882605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f631815ea50 0x7f63180b7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:58.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f631da00640 1 -- 172.21.15.122:0/1750882605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f631815ea50 msgr2=0x7f63180b7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f631da00640 1 --2- 172.21.15.122:0/1750882605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f631815ea50 0x7f63180b7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f631da00640 1 -- 172.21.15.122:0/1750882605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f631815f370 msgr2=0x7f6318153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f631da00640 1 --2- 172.21.15.122:0/1750882605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f631815f370 0x7f6318153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f631da00640 1 -- 172.21.15.122:0/1750882605 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6318153fa0 con 0x7f631806caa0 2024-05-28T06:05:58.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f631d000640 1 --2- 172.21.15.122:0/1750882605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f631815ea50 0x7f63180b7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:05:58.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f631da00640 1 --2- 172.21.15.122:0/1750882605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f631806caa0 0x7f63180cf8c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f630c01b070 tx=0x7f630c019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:58.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f6315600640 1 -- 172.21.15.122:0/1750882605 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c0b8470 con 0x7f631806caa0 2024-05-28T06:05:58.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f6315600640 1 -- 172.21.15.122:0/1750882605 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f630c0b8610 con 0x7f631806caa0 2024-05-28T06:05:58.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f6320400640 1 -- 172.21.15.122:0/1750882605 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6318154280 con 0x7f631806caa0 2024-05-28T06:05:58.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f6315600640 1 -- 172.21.15.122:0/1750882605 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c0b8a00 con 0x7f631806caa0 2024-05-28T06:05:58.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f6320400640 1 -- 172.21.15.122:0/1750882605 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6318154840 con 0x7f631806caa0 2024-05-28T06:05:58.707 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.701+0000 7f6320400640 1 -- 172.21.15.122:0/1750882605 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6318068c40 con 0x7f631806caa0 2024-05-28T06:05:58.707 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.705+0000 7f6315600640 1 -- 172.21.15.122:0/1750882605 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f630c0c0020 con 0x7f631806caa0 2024-05-28T06:05:58.707 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.705+0000 7f6315600640 1 --2- 172.21.15.122:0/1750882605 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f62f8068380 0x7f62f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:58.708 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.705+0000 7f6315600640 1 -- 172.21.15.122:0/1750882605 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f630c1213c0 con 0x7f631806caa0 2024-05-28T06:05:58.708 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.705+0000 7f631d000640 1 --2- 172.21.15.122:0/1750882605 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f62f8068380 0x7f62f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:58.708 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.705+0000 7f631d000640 1 --2- 172.21.15.122:0/1750882605 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f62f8068380 0x7f62f806a840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6318161cd0 tx=0x7f6304008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:58.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.709+0000 7f6315600640 1 -- 172.21.15.122:0/1750882605 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f630c0c7020 con 0x7f631806caa0 2024-05-28T06:05:58.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.865+0000 7f6320400640 1 -- 172.21.15.122:0/1750882605 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f63180b3c90 con 0x7f62f8068380 2024-05-28T06:05:58.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.873+0000 7f6315600640 1 -- 172.21.15.122:0/1750882605 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f63180b3c90 con 0x7f62f8068380 2024-05-28T06:05:58.877 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:05:58.879 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-05-28T06:05:58.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.873+0000 7f6320400640 1 -- 172.21.15.122:0/1750882605 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f62f8068380 msgr2=0x7f62f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.873+0000 7f6320400640 1 --2- 172.21.15.122:0/1750882605 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f62f8068380 0x7f62f806a840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6318161cd0 tx=0x7f6304008040 comp rx=0 tx=0).stop 2024-05-28T06:05:58.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.873+0000 7f6320400640 1 -- 172.21.15.122:0/1750882605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f631806caa0 msgr2=0x7f63180cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:58.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.873+0000 7f6320400640 1 --2- 172.21.15.122:0/1750882605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f631806caa0 0x7f63180cf8c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f630c01b070 tx=0x7f630c019760 comp rx=0 tx=0).stop 2024-05-28T06:05:58.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.873+0000 7f6320400640 1 -- 172.21.15.122:0/1750882605 shutdown_connections 2024-05-28T06:05:58.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.873+0000 7f6320400640 1 --2- 172.21.15.122:0/1750882605 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f62f8068380 0x7f62f806a840 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.873+0000 7f6320400640 1 --2- 172.21.15.122:0/1750882605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f631815f370 0x7f6318153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.873+0000 7f6320400640 1 --2- 172.21.15.122:0/1750882605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f631815ea50 0x7f63180b7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.873+0000 7f6320400640 1 --2- 172.21.15.122:0/1750882605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f631806caa0 0x7f63180cf8c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:58.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.873+0000 7f6320400640 1 -- 172.21.15.122:0/1750882605 >> 172.21.15.122:0/1750882605 conn(0x7f63180b4190 msgr2=0x7f63180b2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:58.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.877+0000 7f6320400640 1 -- 172.21.15.122:0/1750882605 shutdown_connections 2024-05-28T06:05:58.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:58.877+0000 7f6320400640 1 -- 172.21.15.122:0/1750882605 wait complete. 2024-05-28T06:05:58.897 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-05-28T06:05:57.245325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219008,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755712,"statfs":{"total":773094113280,"available":772869849088,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001531"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619807+0000","last_change":"2024-05-28T06:05:49.850357+0000","last_active":"2024-05-28T06:05:51.619807+0000","last_peered":"2024-05-28T06:05:51.619807+0000","last_clean":"2024-05-28T06:05:51.619807+0000","last_became_active":"2024-05-28T06:05:49.850082+0000","last_became_peered":"2024-05-28T06:05:49.850082+0000","last_unstale":"2024-05-28T06:05:51.619807+0000","last_undegraded":"2024-05-28T06:05:51.619807+0000","last_fullsized":"2024-05-28T06:05:51.619807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:58:07.996206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.847064+0000","last_change":"2024-05-28T06:05:49.836997+0000","last_active":"2024-05-28T06:05:50.847064+0000","last_peered":"2024-05-28T06:05:50.847064+0000","last_clean":"2024-05-28T06:05:50.847064+0000","last_became_active":"2024-05-28T06:05:49.836057+0000","last_became_peered":"2024-05-28T06:05:49.836057+0000","last_unstale":"2024-05-28T06:05:50.847064+0000","last_undegraded":"2024-05-28T06:05:50.847064+0000","last_fullsized":"2024-05-28T06:05:50.847064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:05.258933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620342+0000","last_change":"2024-05-28T06:05:49.842388+0000","last_active":"2024-05-28T06:05:51.620342+0000","last_peered":"2024-05-28T06:05:51.620342+0000","last_clean":"2024-05-28T06:05:51.620342+0000","last_became_active":"2024-05-28T06:05:49.833739+0000","last_became_peered":"2024-05-28T06:05:49.833739+0000","last_unstale":"2024-05-28T06:05:51.620342+0000","last_undegraded":"2024-05-28T06:05:51.620342+0000","last_fullsized":"2024-05-28T06:05:51.620342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:45:56.563383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830740+0000","last_change":"2024-05-28T06:05:49.836000+0000","last_active":"2024-05-28T06:05:50.830740+0000","last_peered":"2024-05-28T06:05:50.830740+0000","last_clean":"2024-05-28T06:05:50.830740+0000","last_became_active":"2024-05-28T06:05:49.835023+0000","last_became_peered":"2024-05-28T06:05:49.835023+0000","last_unstale":"2024-05-28T06:05:50.830740+0000","last_undegraded":"2024-05-28T06:05:50.830740+0000","last_fullsized":"2024-05-28T06:05:50.830740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:47:59.969773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619431+0000","last_change":"2024-05-28T06:05:49.842728+0000","last_active":"2024-05-28T06:05:51.619431+0000","last_peered":"2024-05-28T06:05:51.619431+0000","last_clean":"2024-05-28T06:05:51.619431+0000","last_became_active":"2024-05-28T06:05:49.842348+0000","last_became_peered":"2024-05-28T06:05:49.842348+0000","last_unstale":"2024-05-28T06:05:51.619431+0000","last_undegraded":"2024-05-28T06:05:51.619431+0000","last_fullsized":"2024-05-28T06:05:51.619431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:57:50.858798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830496+0000","last_change":"2024-05-28T06:05:49.831551+0000","last_active":"2024-05-28T06:05:50.830496+0000","last_peered":"2024-05-28T06:05:50.830496+0000","last_clean":"2024-05-28T06:05:50.830496+0000","last_became_active":"2024-05-28T06:05:49.831275+0000","last_became_peered":"2024-05-28T06:05:49.831275+0000","last_unstale":"2024-05-28T06:05:50.830496+0000","last_undegraded":"2024-05-28T06:05:50.830496+0000","last_fullsized":"2024-05-28T06:05:50.830496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:05.258933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619374+0000","last_change":"2024-05-28T06:05:49.833865+0000","last_active":"2024-05-28T06:05:51.619374+0000","last_peered":"2024-05-28T06:05:51.619374+0000","last_clean":"2024-05-28T06:05:51.619374+0000","last_became_active":"2024-05-28T06:05:49.833613+0000","last_became_peered":"2024-05-28T06:05:49.833613+0000","last_unstale":"2024-05-28T06:05:51.619374+0000","last_undegraded":"2024-05-28T06:05:51.619374+0000","last_fullsized":"2024-05-28T06:05:51.619374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:47:59.969773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619570+0000","last_change":"2024-05-28T06:05:49.832366+0000","last_active":"2024-05-28T06:05:51.619570+0000","last_peered":"2024-05-28T06:05:51.619570+0000","last_clean":"2024-05-28T06:05:51.619570+0000","last_became_active":"2024-05-28T06:05:49.832055+0000","last_became_peered":"2024-05-28T06:05:49.832055+0000","last_unstale":"2024-05-28T06:05:51.619570+0000","last_undegraded":"2024-05-28T06:05:51.619570+0000","last_fullsized":"2024-05-28T06:05:51.619570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:45:56.563383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619839+0000","last_change":"2024-05-28T06:05:49.845929+0000","last_active":"2024-05-28T06:05:51.619839+0000","last_peered":"2024-05-28T06:05:51.619839+0000","last_clean":"2024-05-28T06:05:51.619839+0000","last_became_active":"2024-05-28T06:05:49.845642+0000","last_became_peered":"2024-05-28T06:05:49.845642+0000","last_unstale":"2024-05-28T06:05:51.619839+0000","last_undegraded":"2024-05-28T06:05:51.619839+0000","last_fullsized":"2024-05-28T06:05:51.619839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:25:16.860803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849143+0000","last_change":"2024-05-28T06:05:49.840616+0000","last_active":"2024-05-28T06:05:50.849143+0000","last_peered":"2024-05-28T06:05:50.849143+0000","last_clean":"2024-05-28T06:05:50.849143+0000","last_became_active":"2024-05-28T06:05:49.840364+0000","last_became_peered":"2024-05-28T06:05:49.840364+0000","last_unstale":"2024-05-28T06:05:50.849143+0000","last_undegraded":"2024-05-28T06:05:50.849143+0000","last_fullsized":"2024-05-28T06:05:50.849143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:39.576444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849043+0000","last_change":"2024-05-28T06:05:49.838656+0000","last_active":"2024-05-28T06:05:50.849043+0000","last_peered":"2024-05-28T06:05:50.849043+0000","last_clean":"2024-05-28T06:05:50.849043+0000","last_became_active":"2024-05-28T06:05:49.838227+0000","last_became_peered":"2024-05-28T06:05:49.838227+0000","last_unstale":"2024-05-28T06:05:50.849043+0000","last_undegraded":"2024-05-28T06:05:50.849043+0000","last_fullsized":"2024-05-28T06:05:50.849043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:39:57.417861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832049+0000","last_change":"2024-05-28T06:05:49.839298+0000","last_active":"2024-05-28T06:05:50.832049+0000","last_peered":"2024-05-28T06:05:50.832049+0000","last_clean":"2024-05-28T06:05:50.832049+0000","last_became_active":"2024-05-28T06:05:49.839024+0000","last_became_peered":"2024-05-28T06:05:49.839024+0000","last_unstale":"2024-05-28T06:05:50.832049+0000","last_undegraded":"2024-05-28T06:05:50.832049+0000","last_fullsized":"2024-05-28T06:05:50.832049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:24:17.481208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619981+0000","last_change":"2024-05-28T06:05:49.852183+0000","last_active":"2024-05-28T06:05:51.619981+0000","last_peered":"2024-05-28T06:05:51.619981+0000","last_clean":"2024-05-28T06:05:51.619981+0000","last_became_active":"2024-05-28T06:05:49.851929+0000","last_became_peered":"2024-05-28T06:05:49.851929+0000","last_unstale":"2024-05-28T06:05:51.619981+0000","last_undegraded":"2024-05-28T06:05:51.619981+0000","last_fullsized":"2024-05-28T06:05:51.619981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:40:46.277733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620009+0000","last_change":"2024-05-28T06:05:49.830872+0000","last_active":"2024-05-28T06:05:51.620009+0000","last_peered":"2024-05-28T06:05:51.620009+0000","last_clean":"2024-05-28T06:05:51.620009+0000","last_became_active":"2024-05-28T06:05:49.829663+0000","last_became_peered":"2024-05-28T06:05:49.829663+0000","last_unstale":"2024-05-28T06:05:51.620009+0000","last_undegraded":"2024-05-28T06:05:51.620009+0000","last_fullsized":"2024-05-28T06:05:51.620009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:45:45.914430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846818+0000","last_change":"2024-05-28T06:05:49.841218+0000","last_active":"2024-05-28T06:05:50.846818+0000","last_peered":"2024-05-28T06:05:50.846818+0000","last_clean":"2024-05-28T06:05:50.846818+0000","last_became_active":"2024-05-28T06:05:49.839685+0000","last_became_peered":"2024-05-28T06:05:49.839685+0000","last_unstale":"2024-05-28T06:05:50.846818+0000","last_undegraded":"2024-05-28T06:05:50.846818+0000","last_fullsized":"2024-05-28T06:05:50.846818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:45:56.563383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830436+0000","last_change":"2024-05-28T06:05:49.834469+0000","last_active":"2024-05-28T06:05:50.830436+0000","last_peered":"2024-05-28T06:05:50.830436+0000","last_clean":"2024-05-28T06:05:50.830436+0000","last_became_active":"2024-05-28T06:05:49.834129+0000","last_became_peered":"2024-05-28T06:05:49.834129+0000","last_unstale":"2024-05-28T06:05:50.830436+0000","last_undegraded":"2024-05-28T06:05:50.830436+0000","last_fullsized":"2024-05-28T06:05:50.830436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:39.576444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832847+0000","last_change":"2024-05-28T06:05:49.836984+0000","last_active":"2024-05-28T06:05:50.832847+0000","last_peered":"2024-05-28T06:05:50.832847+0000","last_clean":"2024-05-28T06:05:50.832847+0000","last_became_active":"2024-05-28T06:05:49.836754+0000","last_became_peered":"2024-05-28T06:05:49.836754+0000","last_unstale":"2024-05-28T06:05:50.832847+0000","last_undegraded":"2024-05-28T06:05:50.832847+0000","last_fullsized":"2024-05-28T06:05:50.832847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:25:16.860803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275303+0000","last_change":"2024-05-28T06:05:49.843255+0000","last_active":"2024-05-28T06:05:51.275303+0000","last_peered":"2024-05-28T06:05:51.275303+0000","last_clean":"2024-05-28T06:05:51.275303+0000","last_became_active":"2024-05-28T06:05:49.841453+0000","last_became_peered":"2024-05-28T06:05:49.841453+0000","last_unstale":"2024-05-28T06:05:51.275303+0000","last_undegraded":"2024-05-28T06:05:51.275303+0000","last_fullsized":"2024-05-28T06:05:51.275303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:47:11.938003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619672+0000","last_change":"2024-05-28T06:05:49.850933+0000","last_active":"2024-05-28T06:05:51.619672+0000","last_peered":"2024-05-28T06:05:51.619672+0000","last_clean":"2024-05-28T06:05:51.619672+0000","last_became_active":"2024-05-28T06:05:49.850659+0000","last_became_peered":"2024-05-28T06:05:49.850659+0000","last_unstale":"2024-05-28T06:05:51.619672+0000","last_undegraded":"2024-05-28T06:05:51.619672+0000","last_fullsized":"2024-05-28T06:05:51.619672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:54:25.520215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849165+0000","last_change":"2024-05-28T06:05:49.835678+0000","last_active":"2024-05-28T06:05:50.849165+0000","last_peered":"2024-05-28T06:05:50.849165+0000","last_clean":"2024-05-28T06:05:50.849165+0000","last_became_active":"2024-05-28T06:05:49.835404+0000","last_became_peered":"2024-05-28T06:05:49.835404+0000","last_unstale":"2024-05-28T06:05:50.849165+0000","last_undegraded":"2024-05-28T06:05:50.849165+0000","last_fullsized":"2024-05-28T06:05:50.849165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:05.258933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620237+0000","last_change":"2024-05-28T06:05:49.837644+0000","last_active":"2024-05-28T06:05:51.620237+0000","last_peered":"2024-05-28T06:05:51.620237+0000","last_clean":"2024-05-28T06:05:51.620237+0000","last_became_active":"2024-05-28T06:05:49.833254+0000","last_became_peered":"2024-05-28T06:05:49.833254+0000","last_unstale":"2024-05-28T06:05:51.620237+0000","last_undegraded":"2024-05-28T06:05:51.620237+0000","last_fullsized":"2024-05-28T06:05:51.620237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:37:35.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830664+0000","last_change":"2024-05-28T06:05:49.835830+0000","last_active":"2024-05-28T06:05:50.830664+0000","last_peered":"2024-05-28T06:05:50.830664+0000","last_clean":"2024-05-28T06:05:50.830664+0000","last_became_active":"2024-05-28T06:05:49.835539+0000","last_became_peered":"2024-05-28T06:05:49.835539+0000","last_unstale":"2024-05-28T06:05:50.830664+0000","last_undegraded":"2024-05-28T06:05:50.830664+0000","last_fullsized":"2024-05-28T06:05:50.830664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:40:46.277733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619508+0000","last_change":"2024-05-28T06:05:49.847289+0000","last_active":"2024-05-28T06:05:51.619508+0000","last_peered":"2024-05-28T06:05:51.619508+0000","last_clean":"2024-05-28T06:05:51.619508+0000","last_became_active":"2024-05-28T06:05:49.846943+0000","last_became_peered":"2024-05-28T06:05:49.846943+0000","last_unstale":"2024-05-28T06:05:51.619508+0000","last_undegraded":"2024-05-28T06:05:51.619508+0000","last_fullsized":"2024-05-28T06:05:51.619508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:46:50.877903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830612+0000","last_change":"2024-05-28T06:05:49.832701+0000","last_active":"2024-05-28T06:05:50.830612+0000","last_peered":"2024-05-28T06:05:50.830612+0000","last_clean":"2024-05-28T06:05:50.830612+0000","last_became_active":"2024-05-28T06:05:49.832339+0000","last_became_peered":"2024-05-28T06:05:49.832339+0000","last_unstale":"2024-05-28T06:05:50.830612+0000","last_undegraded":"2024-05-28T06:05:50.830612+0000","last_fullsized":"2024-05-28T06:05:50.830612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:19:32.041344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619788+0000","last_change":"2024-05-28T06:05:49.836126+0000","last_active":"2024-05-28T06:05:51.619788+0000","last_peered":"2024-05-28T06:05:51.619788+0000","last_clean":"2024-05-28T06:05:51.619788+0000","last_became_active":"2024-05-28T06:05:49.835875+0000","last_became_peered":"2024-05-28T06:05:49.835875+0000","last_unstale":"2024-05-28T06:05:51.619788+0000","last_undegraded":"2024-05-28T06:05:51.619788+0000","last_fullsized":"2024-05-28T06:05:51.619788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:39.576444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849191+0000","last_change":"2024-05-28T06:05:49.839809+0000","last_active":"2024-05-28T06:05:50.849191+0000","last_peered":"2024-05-28T06:05:50.849191+0000","last_clean":"2024-05-28T06:05:50.849191+0000","last_became_active":"2024-05-28T06:05:49.839063+0000","last_became_peered":"2024-05-28T06:05:49.839063+0000","last_unstale":"2024-05-28T06:05:50.849191+0000","last_undegraded":"2024-05-28T06:05:50.849191+0000","last_fullsized":"2024-05-28T06:05:50.849191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:19:32.041344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846997+0000","last_change":"2024-05-28T06:05:49.837449+0000","last_active":"2024-05-28T06:05:50.846997+0000","last_peered":"2024-05-28T06:05:50.846997+0000","last_clean":"2024-05-28T06:05:50.846997+0000","last_became_active":"2024-05-28T06:05:49.833358+0000","last_became_peered":"2024-05-28T06:05:49.833358+0000","last_unstale":"2024-05-28T06:05:50.846997+0000","last_undegraded":"2024-05-28T06:05:50.846997+0000","last_fullsized":"2024-05-28T06:05:50.846997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:39.576444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619737+0000","last_change":"2024-05-28T06:05:49.836384+0000","last_active":"2024-05-28T06:05:51.619737+0000","last_peered":"2024-05-28T06:05:51.619737+0000","last_clean":"2024-05-28T06:05:51.619737+0000","last_became_active":"2024-05-28T06:05:49.835821+0000","last_became_peered":"2024-05-28T06:05:49.835821+0000","last_unstale":"2024-05-28T06:05:51.619737+0000","last_undegraded":"2024-05-28T06:05:51.619737+0000","last_fullsized":"2024-05-28T06:05:51.619737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:32:22.883360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620320+0000","last_change":"2024-05-28T06:05:49.838410+0000","last_active":"2024-05-28T06:05:51.620320+0000","last_peered":"2024-05-28T06:05:51.620320+0000","last_clean":"2024-05-28T06:05:51.620320+0000","last_became_active":"2024-05-28T06:05:49.838053+0000","last_became_peered":"2024-05-28T06:05:49.838053+0000","last_unstale":"2024-05-28T06:05:51.620320+0000","last_undegraded":"2024-05-28T06:05:51.620320+0000","last_fullsized":"2024-05-28T06:05:51.620320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:46:50.877903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830834+0000","last_change":"2024-05-28T06:05:49.851329+0000","last_active":"2024-05-28T06:05:50.830834+0000","last_peered":"2024-05-28T06:05:50.830834+0000","last_clean":"2024-05-28T06:05:50.830834+0000","last_became_active":"2024-05-28T06:05:49.850771+0000","last_became_peered":"2024-05-28T06:05:49.850771+0000","last_unstale":"2024-05-28T06:05:50.830834+0000","last_undegraded":"2024-05-28T06:05:50.830834+0000","last_fullsized":"2024-05-28T06:05:50.830834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:57:50.858798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275129+0000","last_change":"2024-05-28T06:05:49.822523+0000","last_active":"2024-05-28T06:05:51.275129+0000","last_peered":"2024-05-28T06:05:51.275129+0000","last_clean":"2024-05-28T06:05:51.275129+0000","last_became_active":"2024-05-28T06:05:49.822143+0000","last_became_peered":"2024-05-28T06:05:49.822143+0000","last_unstale":"2024-05-28T06:05:51.275129+0000","last_undegraded":"2024-05-28T06:05:51.275129+0000","last_fullsized":"2024-05-28T06:05:51.275129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:24:17.481208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.848820+0000","last_change":"2024-05-28T06:05:49.840151+0000","last_active":"2024-05-28T06:05:50.848820+0000","last_peered":"2024-05-28T06:05:50.848820+0000","last_clean":"2024-05-28T06:05:50.848820+0000","last_became_active":"2024-05-28T06:05:49.839815+0000","last_became_peered":"2024-05-28T06:05:49.839815+0000","last_unstale":"2024-05-28T06:05:50.848820+0000","last_undegraded":"2024-05-28T06:05:50.848820+0000","last_fullsized":"2024-05-28T06:05:50.848820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:46:50.877903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832139+0000","last_change":"2024-05-28T06:05:49.834448+0000","last_active":"2024-05-28T06:05:50.832139+0000","last_peered":"2024-05-28T06:05:50.832139+0000","last_clean":"2024-05-28T06:05:50.832139+0000","last_became_active":"2024-05-28T06:05:49.833479+0000","last_became_peered":"2024-05-28T06:05:49.833479+0000","last_unstale":"2024-05-28T06:05:50.832139+0000","last_undegraded":"2024-05-28T06:05:50.832139+0000","last_fullsized":"2024-05-28T06:05:50.832139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:03:32.895368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620222+0000","last_change":"2024-05-28T06:05:48.832582+0000","last_active":"2024-05-28T06:05:51.620222+0000","last_peered":"2024-05-28T06:05:51.620222+0000","last_clean":"2024-05-28T06:05:51.620222+0000","last_became_active":"2024-05-28T06:05:48.828599+0000","last_became_peered":"2024-05-28T06:05:48.828599+0000","last_unstale":"2024-05-28T06:05:51.620222+0000","last_undegraded":"2024-05-28T06:05:51.620222+0000","last_fullsized":"2024-05-28T06:05:51.620222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:15:33.728795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620372+0000","last_change":"2024-05-28T06:05:49.838397+0000","last_active":"2024-05-28T06:05:51.620372+0000","last_peered":"2024-05-28T06:05:51.620372+0000","last_clean":"2024-05-28T06:05:51.620372+0000","last_became_active":"2024-05-28T06:05:49.838080+0000","last_became_peered":"2024-05-28T06:05:49.838080+0000","last_unstale":"2024-05-28T06:05:51.620372+0000","last_undegraded":"2024-05-28T06:05:51.620372+0000","last_fullsized":"2024-05-28T06:05:51.620372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:32:22.883360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.848958+0000","last_change":"2024-05-28T06:05:48.823837+0000","last_active":"2024-05-28T06:05:50.848958+0000","last_peered":"2024-05-28T06:05:50.848958+0000","last_clean":"2024-05-28T06:05:50.848958+0000","last_became_active":"2024-05-28T06:05:48.823531+0000","last_became_peered":"2024-05-28T06:05:48.823531+0000","last_unstale":"2024-05-28T06:05:50.848958+0000","last_undegraded":"2024-05-28T06:05:50.848958+0000","last_fullsized":"2024-05-28T06:05:50.848958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:30:03.706927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619568+0000","last_change":"2024-05-28T06:05:48.829331+0000","last_active":"2024-05-28T06:05:51.619568+0000","last_peered":"2024-05-28T06:05:51.619568+0000","last_clean":"2024-05-28T06:05:51.619568+0000","last_became_active":"2024-05-28T06:05:48.828618+0000","last_became_peered":"2024-05-28T06:05:48.828618+0000","last_unstale":"2024-05-28T06:05:51.619568+0000","last_undegraded":"2024-05-28T06:05:51.619568+0000","last_fullsized":"2024-05-28T06:05:51.619568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:41:15.562847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619431+0000","last_change":"2024-05-28T06:05:49.835162+0000","last_active":"2024-05-28T06:05:51.619431+0000","last_peered":"2024-05-28T06:05:51.619431+0000","last_clean":"2024-05-28T06:05:51.619431+0000","last_became_active":"2024-05-28T06:05:49.834914+0000","last_became_peered":"2024-05-28T06:05:49.834914+0000","last_unstale":"2024-05-28T06:05:51.619431+0000","last_undegraded":"2024-05-28T06:05:51.619431+0000","last_fullsized":"2024-05-28T06:05:51.619431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:37:35.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830705+0000","last_change":"2024-05-28T06:05:48.819148+0000","last_active":"2024-05-28T06:05:50.830705+0000","last_peered":"2024-05-28T06:05:50.830705+0000","last_clean":"2024-05-28T06:05:50.830705+0000","last_became_active":"2024-05-28T06:05:48.818867+0000","last_became_peered":"2024-05-28T06:05:48.818867+0000","last_unstale":"2024-05-28T06:05:50.830705+0000","last_undegraded":"2024-05-28T06:05:50.830705+0000","last_fullsized":"2024-05-28T06:05:50.830705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:54:54.655580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846821+0000","last_change":"2024-05-28T06:05:49.835117+0000","last_active":"2024-05-28T06:05:50.846821+0000","last_peered":"2024-05-28T06:05:50.846821+0000","last_clean":"2024-05-28T06:05:50.846821+0000","last_became_active":"2024-05-28T06:05:49.834862+0000","last_became_peered":"2024-05-28T06:05:49.834862+0000","last_unstale":"2024-05-28T06:05:50.846821+0000","last_undegraded":"2024-05-28T06:05:50.846821+0000","last_fullsized":"2024-05-28T06:05:50.846821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:46:50.877903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849118+0000","last_change":"2024-05-28T06:05:48.829871+0000","last_active":"2024-05-28T06:05:50.849118+0000","last_peered":"2024-05-28T06:05:50.849118+0000","last_clean":"2024-05-28T06:05:50.849118+0000","last_became_active":"2024-05-28T06:05:48.829598+0000","last_became_peered":"2024-05-28T06:05:48.829598+0000","last_unstale":"2024-05-28T06:05:50.849118+0000","last_undegraded":"2024-05-28T06:05:50.849118+0000","last_fullsized":"2024-05-28T06:05:50.849118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:18:51.804296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832692+0000","last_change":"2024-05-28T06:05:49.837126+0000","last_active":"2024-05-28T06:05:50.832692+0000","last_peered":"2024-05-28T06:05:50.832692+0000","last_clean":"2024-05-28T06:05:50.832692+0000","last_became_active":"2024-05-28T06:05:49.836676+0000","last_became_peered":"2024-05-28T06:05:49.836676+0000","last_unstale":"2024-05-28T06:05:50.832692+0000","last_undegraded":"2024-05-28T06:05:50.832692+0000","last_fullsized":"2024-05-28T06:05:50.832692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:58:07.996206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832655+0000","last_change":"2024-05-28T06:05:48.821859+0000","last_active":"2024-05-28T06:05:50.832655+0000","last_peered":"2024-05-28T06:05:50.832655+0000","last_clean":"2024-05-28T06:05:50.832655+0000","last_became_active":"2024-05-28T06:05:48.821297+0000","last_became_peered":"2024-05-28T06:05:48.821297+0000","last_unstale":"2024-05-28T06:05:50.832655+0000","last_undegraded":"2024-05-28T06:05:50.832655+0000","last_fullsized":"2024-05-28T06:05:50.832655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:35:04.180425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620652+0000","last_change":"2024-05-28T06:05:49.831784+0000","last_active":"2024-05-28T06:05:51.620652+0000","last_peered":"2024-05-28T06:05:51.620652+0000","last_clean":"2024-05-28T06:05:51.620652+0000","last_became_active":"2024-05-28T06:05:49.831487+0000","last_became_peered":"2024-05-28T06:05:49.831487+0000","last_unstale":"2024-05-28T06:05:51.620652+0000","last_undegraded":"2024-05-28T06:05:51.620652+0000","last_fullsized":"2024-05-28T06:05:51.620652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:05.258933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846970+0000","last_change":"2024-05-28T06:05:48.817642+0000","last_active":"2024-05-28T06:05:50.846970+0000","last_peered":"2024-05-28T06:05:50.846970+0000","last_clean":"2024-05-28T06:05:50.846970+0000","last_became_active":"2024-05-28T06:05:48.816830+0000","last_became_peered":"2024-05-28T06:05:48.816830+0000","last_unstale":"2024-05-28T06:05:50.846970+0000","last_undegraded":"2024-05-28T06:05:50.846970+0000","last_fullsized":"2024-05-28T06:05:50.846970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:30:03.706927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832103+0000","last_change":"2024-05-28T06:05:49.831624+0000","last_active":"2024-05-28T06:05:50.832103+0000","last_peered":"2024-05-28T06:05:50.832103+0000","last_clean":"2024-05-28T06:05:50.832103+0000","last_became_active":"2024-05-28T06:05:49.830861+0000","last_became_peered":"2024-05-28T06:05:49.830861+0000","last_unstale":"2024-05-28T06:05:50.832103+0000","last_undegraded":"2024-05-28T06:05:50.832103+0000","last_fullsized":"2024-05-28T06:05:50.832103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:47:11.938003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849091+0000","last_change":"2024-05-28T06:05:48.827308+0000","last_active":"2024-05-28T06:05:50.849091+0000","last_peered":"2024-05-28T06:05:50.849091+0000","last_clean":"2024-05-28T06:05:50.849091+0000","last_became_active":"2024-05-28T06:05:48.827058+0000","last_became_peered":"2024-05-28T06:05:48.827058+0000","last_unstale":"2024-05-28T06:05:50.849091+0000","last_undegraded":"2024-05-28T06:05:50.849091+0000","last_fullsized":"2024-05-28T06:05:50.849091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:03:31.889186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619356+0000","last_change":"2024-05-28T06:05:49.850742+0000","last_active":"2024-05-28T06:05:51.619356+0000","last_peered":"2024-05-28T06:05:51.619356+0000","last_clean":"2024-05-28T06:05:51.619356+0000","last_became_active":"2024-05-28T06:05:49.850284+0000","last_became_peered":"2024-05-28T06:05:49.850284+0000","last_unstale":"2024-05-28T06:05:51.619356+0000","last_undegraded":"2024-05-28T06:05:51.619356+0000","last_fullsized":"2024-05-28T06:05:51.619356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:19:32.041344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620430+0000","last_change":"2024-05-28T06:05:48.825087+0000","last_active":"2024-05-28T06:05:51.620430+0000","last_peered":"2024-05-28T06:05:51.620430+0000","last_clean":"2024-05-28T06:05:51.620430+0000","last_became_active":"2024-05-28T06:05:48.824790+0000","last_became_peered":"2024-05-28T06:05:48.824790+0000","last_unstale":"2024-05-28T06:05:51.620430+0000","last_undegraded":"2024-05-28T06:05:51.620430+0000","last_fullsized":"2024-05-28T06:05:51.620430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:41:15.562847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620110+0000","last_change":"2024-05-28T06:05:49.831857+0000","last_active":"2024-05-28T06:05:51.620110+0000","last_peered":"2024-05-28T06:05:51.620110+0000","last_clean":"2024-05-28T06:05:51.620110+0000","last_became_active":"2024-05-28T06:05:49.831461+0000","last_became_peered":"2024-05-28T06:05:49.831461+0000","last_unstale":"2024-05-28T06:05:51.620110+0000","last_undegraded":"2024-05-28T06:05:51.620110+0000","last_fullsized":"2024-05-28T06:05:51.620110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:02:07.375017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830945+0000","last_change":"2024-05-28T06:05:48.827406+0000","last_active":"2024-05-28T06:05:50.830945+0000","last_peered":"2024-05-28T06:05:50.830945+0000","last_clean":"2024-05-28T06:05:50.830945+0000","last_became_active":"2024-05-28T06:05:48.827095+0000","last_became_peered":"2024-05-28T06:05:48.827095+0000","last_unstale":"2024-05-28T06:05:50.830945+0000","last_undegraded":"2024-05-28T06:05:50.830945+0000","last_fullsized":"2024-05-28T06:05:50.830945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:18:51.804296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619606+0000","last_change":"2024-05-28T06:05:49.848867+0000","last_active":"2024-05-28T06:05:51.619606+0000","last_peered":"2024-05-28T06:05:51.619606+0000","last_clean":"2024-05-28T06:05:51.619606+0000","last_became_active":"2024-05-28T06:05:49.848544+0000","last_became_peered":"2024-05-28T06:05:49.848544+0000","last_unstale":"2024-05-28T06:05:51.619606+0000","last_undegraded":"2024-05-28T06:05:51.619606+0000","last_fullsized":"2024-05-28T06:05:51.619606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:54:32.928419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.848795+0000","last_change":"2024-05-28T06:05:48.823850+0000","last_active":"2024-05-28T06:05:50.848795+0000","last_peered":"2024-05-28T06:05:50.848795+0000","last_clean":"2024-05-28T06:05:50.848795+0000","last_became_active":"2024-05-28T06:05:48.823565+0000","last_became_peered":"2024-05-28T06:05:48.823565+0000","last_unstale":"2024-05-28T06:05:50.848795+0000","last_undegraded":"2024-05-28T06:05:50.848795+0000","last_fullsized":"2024-05-28T06:05:50.848795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:54:54.655580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.848867+0000","last_change":"2024-05-28T06:05:49.833197+0000","last_active":"2024-05-28T06:05:50.848867+0000","last_peered":"2024-05-28T06:05:50.848867+0000","last_clean":"2024-05-28T06:05:50.848867+0000","last_became_active":"2024-05-28T06:05:49.832937+0000","last_became_peered":"2024-05-28T06:05:49.832937+0000","last_unstale":"2024-05-28T06:05:50.848867+0000","last_undegraded":"2024-05-28T06:05:50.848867+0000","last_fullsized":"2024-05-28T06:05:50.848867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:32:22.883360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275013+0000","last_change":"2024-05-28T06:05:48.826780+0000","last_active":"2024-05-28T06:05:51.275013+0000","last_peered":"2024-05-28T06:05:51.275013+0000","last_clean":"2024-05-28T06:05:51.275013+0000","last_became_active":"2024-05-28T06:05:48.824955+0000","last_became_peered":"2024-05-28T06:05:48.824955+0000","last_unstale":"2024-05-28T06:05:51.275013+0000","last_undegraded":"2024-05-28T06:05:51.275013+0000","last_fullsized":"2024-05-28T06:05:51.275013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:41:15.562847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619355+0000","last_change":"2024-05-28T06:05:49.841278+0000","last_active":"2024-05-28T06:05:51.619355+0000","last_peered":"2024-05-28T06:05:51.619355+0000","last_clean":"2024-05-28T06:05:51.619355+0000","last_became_active":"2024-05-28T06:05:49.840945+0000","last_became_peered":"2024-05-28T06:05:49.840945+0000","last_unstale":"2024-05-28T06:05:51.619355+0000","last_undegraded":"2024-05-28T06:05:51.619355+0000","last_fullsized":"2024-05-28T06:05:51.619355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:40:46.277733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832319+0000","last_change":"2024-05-28T06:05:48.825832+0000","last_active":"2024-05-28T06:05:50.832319+0000","last_peered":"2024-05-28T06:05:50.832319+0000","last_clean":"2024-05-28T06:05:50.832319+0000","last_became_active":"2024-05-28T06:05:48.825446+0000","last_became_peered":"2024-05-28T06:05:48.825446+0000","last_unstale":"2024-05-28T06:05:50.832319+0000","last_undegraded":"2024-05-28T06:05:50.832319+0000","last_fullsized":"2024-05-28T06:05:50.832319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:09:22.855060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619710+0000","last_change":"2024-05-28T06:05:49.854377+0000","last_active":"2024-05-28T06:05:51.619710+0000","last_peered":"2024-05-28T06:05:51.619710+0000","last_clean":"2024-05-28T06:05:51.619710+0000","last_became_active":"2024-05-28T06:05:49.853287+0000","last_became_peered":"2024-05-28T06:05:49.853287+0000","last_unstale":"2024-05-28T06:05:51.619710+0000","last_undegraded":"2024-05-28T06:05:51.619710+0000","last_fullsized":"2024-05-28T06:05:51.619710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:54:47.876861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275258+0000","last_change":"2024-05-28T06:05:48.828277+0000","last_active":"2024-05-28T06:05:51.275258+0000","last_peered":"2024-05-28T06:05:51.275258+0000","last_clean":"2024-05-28T06:05:51.275258+0000","last_became_active":"2024-05-28T06:05:48.828066+0000","last_became_peered":"2024-05-28T06:05:48.828066+0000","last_unstale":"2024-05-28T06:05:51.275258+0000","last_undegraded":"2024-05-28T06:05:51.275258+0000","last_fullsized":"2024-05-28T06:05:51.275258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:54:54.655580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619958+0000","last_change":"2024-05-28T06:05:49.852523+0000","last_active":"2024-05-28T06:05:51.619958+0000","last_peered":"2024-05-28T06:05:51.619958+0000","last_clean":"2024-05-28T06:05:51.619958+0000","last_became_active":"2024-05-28T06:05:49.852170+0000","last_became_peered":"2024-05-28T06:05:49.852170+0000","last_unstale":"2024-05-28T06:05:51.619958+0000","last_undegraded":"2024-05-28T06:05:51.619958+0000","last_fullsized":"2024-05-28T06:05:51.619958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:30:15.652435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.847045+0000","last_change":"2024-05-28T06:05:48.825987+0000","last_active":"2024-05-28T06:05:50.847045+0000","last_peered":"2024-05-28T06:05:50.847045+0000","last_clean":"2024-05-28T06:05:50.847045+0000","last_became_active":"2024-05-28T06:05:48.824571+0000","last_became_peered":"2024-05-28T06:05:48.824571+0000","last_unstale":"2024-05-28T06:05:50.847045+0000","last_undegraded":"2024-05-28T06:05:50.847045+0000","last_fullsized":"2024-05-28T06:05:50.847045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:24:16.475026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830941+0000","last_change":"2024-05-28T06:05:49.835359+0000","last_active":"2024-05-28T06:05:50.830941+0000","last_peered":"2024-05-28T06:05:50.830941+0000","last_clean":"2024-05-28T06:05:50.830941+0000","last_became_active":"2024-05-28T06:05:49.834666+0000","last_became_peered":"2024-05-28T06:05:49.834666+0000","last_unstale":"2024-05-28T06:05:50.830941+0000","last_undegraded":"2024-05-28T06:05:50.830941+0000","last_fullsized":"2024-05-28T06:05:50.830941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:54:32.928419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275152+0000","last_change":"2024-05-28T06:05:48.826646+0000","last_active":"2024-05-28T06:05:51.275152+0000","last_peered":"2024-05-28T06:05:51.275152+0000","last_clean":"2024-05-28T06:05:51.275152+0000","last_became_active":"2024-05-28T06:05:48.825673+0000","last_became_peered":"2024-05-28T06:05:48.825673+0000","last_unstale":"2024-05-28T06:05:51.275152+0000","last_undegraded":"2024-05-28T06:05:51.275152+0000","last_fullsized":"2024-05-28T06:05:51.275152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:35:04.180425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619481+0000","last_change":"2024-05-28T06:05:49.846068+0000","last_active":"2024-05-28T06:05:51.619481+0000","last_peered":"2024-05-28T06:05:51.619481+0000","last_clean":"2024-05-28T06:05:51.619481+0000","last_became_active":"2024-05-28T06:05:49.845797+0000","last_became_peered":"2024-05-28T06:05:49.845797+0000","last_unstale":"2024-05-28T06:05:51.619481+0000","last_undegraded":"2024-05-28T06:05:51.619481+0000","last_fullsized":"2024-05-28T06:05:51.619481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:58:36.770938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619274+0000","last_change":"2024-05-28T06:05:38.517922+0000","last_active":"2024-05-28T06:05:51.619274+0000","last_peered":"2024-05-28T06:05:51.619274+0000","last_clean":"2024-05-28T06:05:51.619274+0000","last_became_active":"2024-05-28T06:05:38.514745+0000","last_became_peered":"2024-05-28T06:05:38.514745+0000","last_unstale":"2024-05-28T06:05:51.619274+0000","last_undegraded":"2024-05-28T06:05:51.619274+0000","last_fullsized":"2024-05-28T06:05:51.619274+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_clean_scrub_stamp":"2024-05-28T06:05:37.485018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:23:27.978203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830398+0000","last_change":"2024-05-28T06:05:48.821497+0000","last_active":"2024-05-28T06:05:50.830398+0000","last_peered":"2024-05-28T06:05:50.830398+0000","last_clean":"2024-05-28T06:05:50.830398+0000","last_became_active":"2024-05-28T06:05:48.821092+0000","last_became_peered":"2024-05-28T06:05:48.821092+0000","last_unstale":"2024-05-28T06:05:50.830398+0000","last_undegraded":"2024-05-28T06:05:50.830398+0000","last_fullsized":"2024-05-28T06:05:50.830398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:15:33.728795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620353+0000","last_change":"2024-05-28T06:05:49.841257+0000","last_active":"2024-05-28T06:05:51.620353+0000","last_peered":"2024-05-28T06:05:51.620353+0000","last_clean":"2024-05-28T06:05:51.620353+0000","last_became_active":"2024-05-28T06:05:49.840922+0000","last_became_peered":"2024-05-28T06:05:49.840922+0000","last_unstale":"2024-05-28T06:05:51.620353+0000","last_undegraded":"2024-05-28T06:05:51.620353+0000","last_fullsized":"2024-05-28T06:05:51.620353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:57:50.858798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619054+0000","last_change":"2024-05-28T06:05:48.829694+0000","last_active":"2024-05-28T06:05:51.619054+0000","last_peered":"2024-05-28T06:05:51.619054+0000","last_clean":"2024-05-28T06:05:51.619054+0000","last_became_active":"2024-05-28T06:05:48.829470+0000","last_became_peered":"2024-05-28T06:05:48.829470+0000","last_unstale":"2024-05-28T06:05:51.619054+0000","last_undegraded":"2024-05-28T06:05:51.619054+0000","last_fullsized":"2024-05-28T06:05:51.619054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:03:31.889186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619991+0000","last_change":"2024-05-28T06:05:49.842825+0000","last_active":"2024-05-28T06:05:51.619991+0000","last_peered":"2024-05-28T06:05:51.619991+0000","last_clean":"2024-05-28T06:05:51.619991+0000","last_became_active":"2024-05-28T06:05:49.842497+0000","last_became_peered":"2024-05-28T06:05:49.842497+0000","last_unstale":"2024-05-28T06:05:51.619991+0000","last_undegraded":"2024-05-28T06:05:51.619991+0000","last_fullsized":"2024-05-28T06:05:51.619991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:30:16.017763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.275109+0000","last_change":"2024-05-28T06:05:48.824739+0000","last_active":"2024-05-28T06:05:51.275109+0000","last_peered":"2024-05-28T06:05:51.275109+0000","last_clean":"2024-05-28T06:05:51.275109+0000","last_became_active":"2024-05-28T06:05:48.824425+0000","last_became_peered":"2024-05-28T06:05:48.824425+0000","last_unstale":"2024-05-28T06:05:51.275109+0000","last_undegraded":"2024-05-28T06:05:51.275109+0000","last_fullsized":"2024-05-28T06:05:51.275109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:15:33.728795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846831+0000","last_change":"2024-05-28T06:05:49.832900+0000","last_active":"2024-05-28T06:05:50.846831+0000","last_peered":"2024-05-28T06:05:50.846831+0000","last_clean":"2024-05-28T06:05:50.846831+0000","last_became_active":"2024-05-28T06:05:49.832648+0000","last_became_peered":"2024-05-28T06:05:49.832648+0000","last_unstale":"2024-05-28T06:05:50.846831+0000","last_undegraded":"2024-05-28T06:05:50.846831+0000","last_fullsized":"2024-05-28T06:05:50.846831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:32:22.883360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.831036+0000","last_change":"2024-05-28T06:05:48.809280+0000","last_active":"2024-05-28T06:05:50.831036+0000","last_peered":"2024-05-28T06:05:50.831036+0000","last_clean":"2024-05-28T06:05:50.831036+0000","last_became_active":"2024-05-28T06:05:48.808937+0000","last_became_peered":"2024-05-28T06:05:48.808937+0000","last_unstale":"2024-05-28T06:05:50.831036+0000","last_undegraded":"2024-05-28T06:05:50.831036+0000","last_fullsized":"2024-05-28T06:05:50.831036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:03:31.889186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.832022+0000","last_change":"2024-05-28T06:05:49.840563+0000","last_active":"2024-05-28T06:05:50.832022+0000","last_peered":"2024-05-28T06:05:50.832022+0000","last_clean":"2024-05-28T06:05:50.832022+0000","last_became_active":"2024-05-28T06:05:49.840221+0000","last_became_peered":"2024-05-28T06:05:49.840221+0000","last_unstale":"2024-05-28T06:05:50.832022+0000","last_undegraded":"2024-05-28T06:05:50.832022+0000","last_fullsized":"2024-05-28T06:05:50.832022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:53:43.751639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.847057+0000","last_change":"2024-05-28T06:05:48.819109+0000","last_active":"2024-05-28T06:05:50.847057+0000","last_peered":"2024-05-28T06:05:50.847057+0000","last_clean":"2024-05-28T06:05:50.847057+0000","last_became_active":"2024-05-28T06:05:48.818859+0000","last_became_peered":"2024-05-28T06:05:48.818859+0000","last_unstale":"2024-05-28T06:05:50.847057+0000","last_undegraded":"2024-05-28T06:05:50.847057+0000","last_fullsized":"2024-05-28T06:05:50.847057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:54:54.655580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.831618+0000","last_change":"2024-05-28T06:05:49.835770+0000","last_active":"2024-05-28T06:05:50.831618+0000","last_peered":"2024-05-28T06:05:50.831618+0000","last_clean":"2024-05-28T06:05:50.831618+0000","last_became_active":"2024-05-28T06:05:49.835041+0000","last_became_peered":"2024-05-28T06:05:49.835041+0000","last_unstale":"2024-05-28T06:05:50.831618+0000","last_undegraded":"2024-05-28T06:05:50.831618+0000","last_fullsized":"2024-05-28T06:05:50.831618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:54:47.876861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619634+0000","last_change":"2024-05-28T06:05:48.832048+0000","last_active":"2024-05-28T06:05:51.619634+0000","last_peered":"2024-05-28T06:05:51.619634+0000","last_clean":"2024-05-28T06:05:51.619634+0000","last_became_active":"2024-05-28T06:05:48.831810+0000","last_became_peered":"2024-05-28T06:05:48.831810+0000","last_unstale":"2024-05-28T06:05:51.619634+0000","last_undegraded":"2024-05-28T06:05:51.619634+0000","last_fullsized":"2024-05-28T06:05:51.619634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:47:10.931821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846971+0000","last_change":"2024-05-28T06:05:49.830201+0000","last_active":"2024-05-28T06:05:50.846971+0000","last_peered":"2024-05-28T06:05:50.846971+0000","last_clean":"2024-05-28T06:05:50.846971+0000","last_became_active":"2024-05-28T06:05:49.829999+0000","last_became_peered":"2024-05-28T06:05:49.829999+0000","last_unstale":"2024-05-28T06:05:50.846971+0000","last_undegraded":"2024-05-28T06:05:50.846971+0000","last_fullsized":"2024-05-28T06:05:50.846971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:39:57.417861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849020+0000","last_change":"2024-05-28T06:05:48.822728+0000","last_active":"2024-05-28T06:05:50.849020+0000","last_peered":"2024-05-28T06:05:50.849020+0000","last_clean":"2024-05-28T06:05:50.849020+0000","last_became_active":"2024-05-28T06:05:48.822411+0000","last_became_peered":"2024-05-28T06:05:48.822411+0000","last_unstale":"2024-05-28T06:05:50.849020+0000","last_undegraded":"2024-05-28T06:05:50.849020+0000","last_fullsized":"2024-05-28T06:05:50.849020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:53:42.745457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619778+0000","last_change":"2024-05-28T06:05:49.833123+0000","last_active":"2024-05-28T06:05:51.619778+0000","last_peered":"2024-05-28T06:05:51.619778+0000","last_clean":"2024-05-28T06:05:51.619778+0000","last_became_active":"2024-05-28T06:05:49.832802+0000","last_became_peered":"2024-05-28T06:05:49.832802+0000","last_unstale":"2024-05-28T06:05:51.619778+0000","last_undegraded":"2024-05-28T06:05:51.619778+0000","last_fullsized":"2024-05-28T06:05:51.619778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:39:57.417861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.849200+0000","last_change":"2024-05-28T06:05:48.828295+0000","last_active":"2024-05-28T06:05:50.849200+0000","last_peered":"2024-05-28T06:05:50.849200+0000","last_clean":"2024-05-28T06:05:50.849200+0000","last_became_active":"2024-05-28T06:05:48.827978+0000","last_became_peered":"2024-05-28T06:05:48.827978+0000","last_unstale":"2024-05-28T06:05:50.849200+0000","last_undegraded":"2024-05-28T06:05:50.849200+0000","last_fullsized":"2024-05-28T06:05:50.849200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:35:04.180425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620520+0000","last_change":"2024-05-28T06:05:49.838136+0000","last_active":"2024-05-28T06:05:51.620520+0000","last_peered":"2024-05-28T06:05:51.620520+0000","last_clean":"2024-05-28T06:05:51.620520+0000","last_became_active":"2024-05-28T06:05:49.837836+0000","last_became_peered":"2024-05-28T06:05:49.837836+0000","last_unstale":"2024-05-28T06:05:51.620520+0000","last_undegraded":"2024-05-28T06:05:51.620520+0000","last_fullsized":"2024-05-28T06:05:51.620520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:39:57.417861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619057+0000","last_change":"2024-05-28T06:05:48.832109+0000","last_active":"2024-05-28T06:05:51.619057+0000","last_peered":"2024-05-28T06:05:51.619057+0000","last_clean":"2024-05-28T06:05:51.619057+0000","last_became_active":"2024-05-28T06:05:48.831767+0000","last_became_peered":"2024-05-28T06:05:48.831767+0000","last_unstale":"2024-05-28T06:05:51.619057+0000","last_undegraded":"2024-05-28T06:05:51.619057+0000","last_fullsized":"2024-05-28T06:05:51.619057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:18:51.804296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.831881+0000","last_change":"2024-05-28T06:05:49.833942+0000","last_active":"2024-05-28T06:05:50.831881+0000","last_peered":"2024-05-28T06:05:50.831881+0000","last_clean":"2024-05-28T06:05:50.831881+0000","last_became_active":"2024-05-28T06:05:49.833670+0000","last_became_peered":"2024-05-28T06:05:49.833670+0000","last_unstale":"2024-05-28T06:05:50.831881+0000","last_undegraded":"2024-05-28T06:05:50.831881+0000","last_fullsized":"2024-05-28T06:05:50.831881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:30:04.713109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846913+0000","last_change":"2024-05-28T06:05:48.829088+0000","last_active":"2024-05-28T06:05:50.846913+0000","last_peered":"2024-05-28T06:05:50.846913+0000","last_clean":"2024-05-28T06:05:50.846913+0000","last_became_active":"2024-05-28T06:05:48.827450+0000","last_became_peered":"2024-05-28T06:05:48.827450+0000","last_unstale":"2024-05-28T06:05:50.846913+0000","last_undegraded":"2024-05-28T06:05:50.846913+0000","last_fullsized":"2024-05-28T06:05:50.846913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:18:51.804296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619940+0000","last_change":"2024-05-28T06:05:49.833747+0000","last_active":"2024-05-28T06:05:51.619940+0000","last_peered":"2024-05-28T06:05:51.619940+0000","last_clean":"2024-05-28T06:05:51.619940+0000","last_became_active":"2024-05-28T06:05:49.833491+0000","last_became_peered":"2024-05-28T06:05:49.833491+0000","last_unstale":"2024-05-28T06:05:51.619940+0000","last_undegraded":"2024-05-28T06:05:51.619940+0000","last_fullsized":"2024-05-28T06:05:51.619940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:05.258933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.846855+0000","last_change":"2024-05-28T06:05:48.833870+0000","last_active":"2024-05-28T06:05:50.846855+0000","last_peered":"2024-05-28T06:05:50.846855+0000","last_clean":"2024-05-28T06:05:50.846855+0000","last_became_active":"2024-05-28T06:05:48.833568+0000","last_became_peered":"2024-05-28T06:05:48.833568+0000","last_unstale":"2024-05-28T06:05:50.846855+0000","last_undegraded":"2024-05-28T06:05:50.846855+0000","last_fullsized":"2024-05-28T06:05:50.846855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:03:31.889186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620136+0000","last_change":"2024-05-28T06:05:49.843381+0000","last_active":"2024-05-28T06:05:51.620136+0000","last_peered":"2024-05-28T06:05:51.620136+0000","last_clean":"2024-05-28T06:05:51.620136+0000","last_became_active":"2024-05-28T06:05:49.843084+0000","last_became_peered":"2024-05-28T06:05:49.843084+0000","last_unstale":"2024-05-28T06:05:51.620136+0000","last_undegraded":"2024-05-28T06:05:51.620136+0000","last_fullsized":"2024-05-28T06:05:51.620136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:47:59.969773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619556+0000","last_change":"2024-05-28T06:05:48.835110+0000","last_active":"2024-05-28T06:05:51.619556+0000","last_peered":"2024-05-28T06:05:51.619556+0000","last_clean":"2024-05-28T06:05:51.619556+0000","last_became_active":"2024-05-28T06:05:48.834798+0000","last_became_peered":"2024-05-28T06:05:48.834798+0000","last_unstale":"2024-05-28T06:05:51.619556+0000","last_undegraded":"2024-05-28T06:05:51.619556+0000","last_fullsized":"2024-05-28T06:05:51.619556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:30:03.706927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.848840+0000","last_change":"2024-05-28T06:05:49.843875+0000","last_active":"2024-05-28T06:05:50.848840+0000","last_peered":"2024-05-28T06:05:50.848840+0000","last_clean":"2024-05-28T06:05:50.848840+0000","last_became_active":"2024-05-28T06:05:49.843563+0000","last_became_peered":"2024-05-28T06:05:49.843563+0000","last_unstale":"2024-05-28T06:05:50.848840+0000","last_undegraded":"2024-05-28T06:05:50.848840+0000","last_fullsized":"2024-05-28T06:05:50.848840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:45:56.563383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.831457+0000","last_change":"2024-05-28T06:05:49.836054+0000","last_active":"2024-05-28T06:05:50.831457+0000","last_peered":"2024-05-28T06:05:50.831457+0000","last_clean":"2024-05-28T06:05:50.831457+0000","last_became_active":"2024-05-28T06:05:49.835419+0000","last_became_peered":"2024-05-28T06:05:49.835419+0000","last_unstale":"2024-05-28T06:05:50.831457+0000","last_undegraded":"2024-05-28T06:05:50.831457+0000","last_fullsized":"2024-05-28T06:05:50.831457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:54:25.520215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619437+0000","last_change":"2024-05-28T06:05:48.834583+0000","last_active":"2024-05-28T06:05:51.619437+0000","last_peered":"2024-05-28T06:05:51.619437+0000","last_clean":"2024-05-28T06:05:51.619437+0000","last_became_active":"2024-05-28T06:05:48.834258+0000","last_became_peered":"2024-05-28T06:05:48.834258+0000","last_unstale":"2024-05-28T06:05:51.619437+0000","last_undegraded":"2024-05-28T06:05:51.619437+0000","last_fullsized":"2024-05-28T06:05:51.619437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:53:42.745457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:50.830842+0000","last_change":"2024-05-28T06:05:49.836273+0000","last_active":"2024-05-28T06:05:50.830842+0000","last_peered":"2024-05-28T06:05:50.830842+0000","last_clean":"2024-05-28T06:05:50.830842+0000","last_became_active":"2024-05-28T06:05:49.835705+0000","last_became_peered":"2024-05-28T06:05:49.835705+0000","last_unstale":"2024-05-28T06:05:50.830842+0000","last_undegraded":"2024-05-28T06:05:50.830842+0000","last_fullsized":"2024-05-28T06:05:50.830842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:58:36.770938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619503+0000","last_change":"2024-05-28T06:05:48.833771+0000","last_active":"2024-05-28T06:05:51.619503+0000","last_peered":"2024-05-28T06:05:51.619503+0000","last_clean":"2024-05-28T06:05:51.619503+0000","last_became_active":"2024-05-28T06:05:48.833473+0000","last_became_peered":"2024-05-28T06:05:48.833473+0000","last_unstale":"2024-05-28T06:05:51.619503+0000","last_undegraded":"2024-05-28T06:05:51.619503+0000","last_fullsized":"2024-05-28T06:05:51.619503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:24:16.475026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620560+0000","last_change":"2024-05-28T06:05:49.831923+0000","last_active":"2024-05-28T06:05:51.620560+0000","last_peered":"2024-05-28T06:05:51.620560+0000","last_clean":"2024-05-28T06:05:51.620560+0000","last_became_active":"2024-05-28T06:05:49.830965+0000","last_became_peered":"2024-05-28T06:05:49.830965+0000","last_unstale":"2024-05-28T06:05:51.620560+0000","last_undegraded":"2024-05-28T06:05:51.620560+0000","last_fullsized":"2024-05-28T06:05:51.620560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:39.576444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620118+0000","last_change":"2024-05-28T06:05:48.828378+0000","last_active":"2024-05-28T06:05:51.620118+0000","last_peered":"2024-05-28T06:05:51.620118+0000","last_clean":"2024-05-28T06:05:51.620118+0000","last_became_active":"2024-05-28T06:05:48.827986+0000","last_became_peered":"2024-05-28T06:05:48.827986+0000","last_unstale":"2024-05-28T06:05:51.620118+0000","last_undegraded":"2024-05-28T06:05:51.620118+0000","last_fullsized":"2024-05-28T06:05:51.620118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:35:04.180425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.619943+0000","last_change":"2024-05-28T06:05:49.852871+0000","last_active":"2024-05-28T06:05:51.619943+0000","last_peered":"2024-05-28T06:05:51.619943+0000","last_clean":"2024-05-28T06:05:51.619943+0000","last_became_active":"2024-05-28T06:05:49.852559+0000","last_became_peered":"2024-05-28T06:05:49.852559+0000","last_unstale":"2024-05-28T06:05:51.619943+0000","last_undegraded":"2024-05-28T06:05:51.619943+0000","last_fullsized":"2024-05-28T06:05:51.619943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:48.793476+0000","last_clean_scrub_stamp":"2024-05-28T06:05:48.793476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:19:32.041344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-28T06:05:51.620707+0000","last_change":"2024-05-28T06:05:48.832472+0000","last_active":"2024-05-28T06:05:51.620707+0000","last_peered":"2024-05-28T06:05:51.620707+0000","last_clean":"2024-05-28T06:05:51.620707+0000","last_became_active":"2024-05-28T06:05:48.831490+0000","last_became_peered":"2024-05-28T06:05:48.831490+0000","last_unstale":"2024-05-28T06:05:51.620707+0000","last_undegraded":"2024-05-28T06:05:51.620707+0000","last_fullsized":"2024-05-28T06:05:51.620707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:47.787294+0000","last_clean_scrub_stamp":"2024-05-28T06:05:47.787294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:36:39.127901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-28T06:05:58.901 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-28T06:05:58.901 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-28T06:05:58.901 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-28T06:05:58.901 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-28T06:05:59.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.069+0000 7f49e8200640 1 Processor -- start 2024-05-28T06:05:59.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.069+0000 7f49e8200640 1 -- start start 2024-05-28T06:05:59.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.073+0000 7f49e8200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f49e015ea50 0x7f49e015ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:59.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.073+0000 7f49e8200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49e006dab0 0x7f49e00d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:59.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.073+0000 7f49e8200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49e0162510 con 0x7f49e015f370 2024-05-28T06:05:59.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.073+0000 7f49e8200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f49e0163120 con 0x7f49e015ea50 2024-05-28T06:05:59.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.073+0000 7f49e8200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f49e01627f0 con 0x7f49e006dab0 2024-05-28T06:05:59.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.073+0000 7f49e5800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f49e015ea50 0x7f49e015ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:59.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.073+0000 7f49e4e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f49e015f370 0x7f49e015f790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38636/0 (socket says 172.21.15.122:38636) 2024-05-28T06:05:59.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.073+0000 7f49e4e00640 1 -- 172.21.15.122:0/2433690570 learned_addr learned my addr 172.21.15.122:0/2433690570 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:59.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.073+0000 7f49e5800640 1 -- 172.21.15.122:0/2433690570 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49e006dab0 msgr2=0x7f49e00d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:05:59.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.073+0000 7f49e5800640 1 --2- 172.21.15.122:0/2433690570 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49e006dab0 0x7f49e00d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.073+0000 7f49e5800640 1 -- 172.21.15.122:0/2433690570 >> v1:172.21.15.122:6789/0 conn(0x7f49e015f370 legacy=0x7f49e015f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:59.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.073+0000 7f49e5800640 1 -- 172.21.15.122:0/2433690570 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e0162ad0 con 0x7f49e015ea50 2024-05-28T06:05:59.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.077+0000 7f49e5800640 1 --2- 172.21.15.122:0/2433690570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49e015ea50 0x7f49e015ee30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f49d40097c0 tx=0x7f49d401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7ab5657c4d26be server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:59.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.077+0000 7f49dfe00640 1 -- 172.21.15.122:0/2433690570 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d40b2070 con 0x7f49e015ea50 2024-05-28T06:05:59.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.077+0000 7f49dfe00640 1 -- 172.21.15.122:0/2433690570 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49d40ad640 con 0x7f49e015ea50 2024-05-28T06:05:59.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.077+0000 7f49dfe00640 1 -- 172.21.15.122:0/2433690570 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d40ada10 con 0x7f49e015ea50 2024-05-28T06:05:59.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.077+0000 7f49e8200640 1 -- 172.21.15.122:0/2433690570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49e015ea50 msgr2=0x7f49e015ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:59.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.077+0000 7f49e8200640 1 --2- 172.21.15.122:0/2433690570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49e015ea50 0x7f49e015ee30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f49d40097c0 tx=0x7f49d401c470 comp rx=0 tx=0).stop 2024-05-28T06:05:59.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.077+0000 7f49e8200640 1 -- 172.21.15.122:0/2433690570 shutdown_connections 2024-05-28T06:05:59.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.077+0000 7f49e8200640 1 --2- 172.21.15.122:0/2433690570 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49e006dab0 0x7f49e00d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.077+0000 7f49e8200640 1 --2- 172.21.15.122:0/2433690570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49e015ea50 0x7f49e015ee30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.077+0000 7f49e8200640 1 -- 172.21.15.122:0/2433690570 >> 172.21.15.122:0/2433690570 conn(0x7f49e00b4190 msgr2=0x7f49e00b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:59.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.077+0000 7f49e8200640 1 -- 172.21.15.122:0/2433690570 shutdown_connections 2024-05-28T06:05:59.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.077+0000 7f49e8200640 1 -- 172.21.15.122:0/2433690570 wait complete. 2024-05-28T06:05:59.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.077+0000 7f49e8200640 1 Processor -- start 2024-05-28T06:05:59.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.077+0000 7f49e8200640 1 -- start start 2024-05-28T06:05:59.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.077+0000 7f49e8200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e006dab0 0x7f49e01571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:59.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.077+0000 7f49e8200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49e015ea50 0x7f49e01553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:59.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.077+0000 7f49e8200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49e015f370 0x7f49e01558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:59.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.077+0000 7f49e8200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f49e00d19c0 con 0x7f49e015ea50 2024-05-28T06:05:59.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.077+0000 7f49e8200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f49e00d1840 con 0x7f49e006dab0 2024-05-28T06:05:59.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.077+0000 7f49e8200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f49e00d1b40 con 0x7f49e015f370 2024-05-28T06:05:59.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.081+0000 7f49e4e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49e015ea50 0x7f49e01553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:59.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.081+0000 7f49e4e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49e015ea50 0x7f49e01553a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41606/0 (socket says 172.21.15.122:41606) 2024-05-28T06:05:59.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.081+0000 7f49e4e00640 1 -- 172.21.15.122:0/4152770033 learned_addr learned my addr 172.21.15.122:0/4152770033 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:59.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.081+0000 7f49e5800640 1 --2- 172.21.15.122:0/4152770033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e006dab0 0x7f49e01571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:59.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.081+0000 7f49e6200640 1 --2- 172.21.15.122:0/4152770033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49e015f370 0x7f49e01558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:59.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.081+0000 7f49e4e00640 1 -- 172.21.15.122:0/4152770033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49e015f370 msgr2=0x7f49e01558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:59.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.081+0000 7f49e4e00640 1 --2- 172.21.15.122:0/4152770033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49e015f370 0x7f49e01558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.081+0000 7f49e4e00640 1 -- 172.21.15.122:0/4152770033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e006dab0 msgr2=0x7f49e01571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:59.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.081+0000 7f49e4e00640 1 --2- 172.21.15.122:0/4152770033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e006dab0 0x7f49e01571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.081+0000 7f49e4e00640 1 -- 172.21.15.122:0/4152770033 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e01603a0 con 0x7f49e015ea50 2024-05-28T06:05:59.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.081+0000 7f49e6200640 1 --2- 172.21.15.122:0/4152770033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49e015f370 0x7f49e01558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:05:59.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.081+0000 7f49e4e00640 1 --2- 172.21.15.122:0/4152770033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49e015ea50 0x7f49e01553a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00c370 tx=0x7f49cc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:59.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.081+0000 7f49dd600640 1 -- 172.21.15.122:0/4152770033 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc017070 con 0x7f49e015ea50 2024-05-28T06:05:59.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.081+0000 7f49dd600640 1 -- 172.21.15.122:0/4152770033 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49cc005cf0 con 0x7f49e015ea50 2024-05-28T06:05:59.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.081+0000 7f49dd600640 1 -- 172.21.15.122:0/4152770033 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc0072f0 con 0x7f49e015ea50 2024-05-28T06:05:59.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.081+0000 7f49e8200640 1 -- 172.21.15.122:0/4152770033 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e0160680 con 0x7f49e015ea50 2024-05-28T06:05:59.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.081+0000 7f49e8200640 1 -- 172.21.15.122:0/4152770033 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e0160c40 con 0x7f49e015ea50 2024-05-28T06:05:59.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.081+0000 7f49e8200640 1 -- 172.21.15.122:0/4152770033 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49e0068c40 con 0x7f49e015ea50 2024-05-28T06:05:59.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.081+0000 7f49dd600640 1 -- 172.21.15.122:0/4152770033 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f49cc01a070 con 0x7f49e015ea50 2024-05-28T06:05:59.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.085+0000 7f49dd600640 1 --2- 172.21.15.122:0/4152770033 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f49c00683b0 0x7f49c006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:59.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.085+0000 7f49dd600640 1 -- 172.21.15.122:0/4152770033 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f49cc085c70 con 0x7f49e015ea50 2024-05-28T06:05:59.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.085+0000 7f49e5800640 1 --2- 172.21.15.122:0/4152770033 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f49c00683b0 0x7f49c006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:59.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.085+0000 7f49e5800640 1 --2- 172.21.15.122:0/4152770033 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f49c00683b0 0x7f49c006a870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f49d40af000 tx=0x7f49d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:59.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.089+0000 7f49dd600640 1 -- 172.21.15.122:0/4152770033 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f49cc055bd0 con 0x7f49e015ea50 2024-05-28T06:05:59.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.281+0000 7f49e8200640 1 -- 172.21.15.122:0/4152770033 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f49e00b4ea0 con 0x7f49e015ea50 2024-05-28T06:05:59.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.281+0000 7f49dd600640 1 -- 172.21.15.122:0/4152770033 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f49cc059ed0 con 0x7f49e015ea50 2024-05-28T06:05:59.283 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:05:59.283 INFO:teuthology.orchestra.run.smithi122.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-28T06:05:59.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.281+0000 7f49e8200640 1 -- 172.21.15.122:0/4152770033 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f49c00683b0 msgr2=0x7f49c006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:59.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.281+0000 7f49e8200640 1 --2- 172.21.15.122:0/4152770033 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f49c00683b0 0x7f49c006a870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f49d40af000 tx=0x7f49d4008040 comp rx=0 tx=0).stop 2024-05-28T06:05:59.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.281+0000 7f49e8200640 1 -- 172.21.15.122:0/4152770033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49e015ea50 msgr2=0x7f49e01553a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:59.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.281+0000 7f49e8200640 1 --2- 172.21.15.122:0/4152770033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49e015ea50 0x7f49e01553a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00c370 tx=0x7f49cc00c830 comp rx=0 tx=0).stop 2024-05-28T06:05:59.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.281+0000 7f49e8200640 1 -- 172.21.15.122:0/4152770033 shutdown_connections 2024-05-28T06:05:59.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.281+0000 7f49e8200640 1 --2- 172.21.15.122:0/4152770033 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f49c00683b0 0x7f49c006a870 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.281+0000 7f49e8200640 1 --2- 172.21.15.122:0/4152770033 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49e015f370 0x7f49e01558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.281+0000 7f49e8200640 1 --2- 172.21.15.122:0/4152770033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49e015ea50 0x7f49e01553a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.281+0000 7f49e8200640 1 --2- 172.21.15.122:0/4152770033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e006dab0 0x7f49e01571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.281+0000 7f49e8200640 1 -- 172.21.15.122:0/4152770033 >> 172.21.15.122:0/4152770033 conn(0x7f49e00b4190 msgr2=0x7f49e015f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:59.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.281+0000 7f49e8200640 1 -- 172.21.15.122:0/4152770033 shutdown_connections 2024-05-28T06:05:59.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.281+0000 7f49e8200640 1 -- 172.21.15.122:0/4152770033 wait complete. 2024-05-28T06:05:59.305 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-28T06:05:59.305 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:05:59.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.437+0000 7f3d92000640 1 Processor -- start 2024-05-28T06:05:59.442 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.437+0000 7f3d92000640 1 -- start start 2024-05-28T06:05:59.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.441+0000 7f3d92000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d8c0b59c0 0x7f3d8c0cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:59.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.441+0000 7f3d92000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d8c0d0310 con 0x7f3d8c06f890 2024-05-28T06:05:59.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.441+0000 7f3d92000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d8c15be20 con 0x7f3d8c0cff30 2024-05-28T06:05:59.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.441+0000 7f3d92000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3d8c15c100 con 0x7f3d8c0b59c0 2024-05-28T06:05:59.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.441+0000 7f3d82a00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f3d8c06f890 0x7f3d8c0cd3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38652/0 (socket says 172.21.15.122:38652) 2024-05-28T06:05:59.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.441+0000 7f3d82a00640 1 -- 172.21.15.122:0/1094558580 learned_addr learned my addr 172.21.15.122:0/1094558580 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:59.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.441+0000 7f3d8be00640 1 --2- 172.21.15.122:0/1094558580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d8c0b59c0 0x7f3d8c0cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:59.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.441+0000 7f3d8aa00640 1 -- 172.21.15.122:0/1094558580 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1183541384 0 0) 0x7f3d8c0d0310 con 0x7f3d8c06f890 2024-05-28T06:05:59.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.441+0000 7f3d8aa00640 1 -- 172.21.15.122:0/1094558580 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d70003530 con 0x7f3d8c06f890 2024-05-28T06:05:59.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.441+0000 7f3d8be00640 1 -- 172.21.15.122:0/1094558580 >> v1:172.21.15.153:6789/0 conn(0x7f3d8c0cff30 legacy=0x7f3d8c06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:59.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.441+0000 7f3d8aa00640 1 -- 172.21.15.122:0/1094558580 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3677090864 0 0) 0x7f3d8c15be20 con 0x7f3d8c0cff30 2024-05-28T06:05:59.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.441+0000 7f3d8be00640 1 -- 172.21.15.122:0/1094558580 >> v1:172.21.15.122:6789/0 conn(0x7f3d8c06f890 legacy=0x7f3d8c0cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:59.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.441+0000 7f3d8be00640 1 -- 172.21.15.122:0/1094558580 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8c15c3e0 con 0x7f3d8c0b59c0 2024-05-28T06:05:59.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.445+0000 7f3d8be00640 1 --2- 172.21.15.122:0/1094558580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d8c0b59c0 0x7f3d8c0cdb00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009dc0 tx=0x7f3d8401c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e51bba8d6a87d13 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:59.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.445+0000 7f3d8aa00640 1 -- 172.21.15.122:0/1094558580 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d840b2070 con 0x7f3d8c0b59c0 2024-05-28T06:05:59.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.445+0000 7f3d8aa00640 1 -- 172.21.15.122:0/1094558580 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d840a59c0 con 0x7f3d8c0b59c0 2024-05-28T06:05:59.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.445+0000 7f3d8aa00640 1 -- 172.21.15.122:0/1094558580 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d840a5d90 con 0x7f3d8c0b59c0 2024-05-28T06:05:59.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.445+0000 7f3d92000640 1 -- 172.21.15.122:0/1094558580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d8c0b59c0 msgr2=0x7f3d8c0cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:59.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.445+0000 7f3d92000640 1 --2- 172.21.15.122:0/1094558580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d8c0b59c0 0x7f3d8c0cdb00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009dc0 tx=0x7f3d8401c960 comp rx=0 tx=0).stop 2024-05-28T06:05:59.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.445+0000 7f3d92000640 1 -- 172.21.15.122:0/1094558580 shutdown_connections 2024-05-28T06:05:59.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.445+0000 7f3d92000640 1 --2- 172.21.15.122:0/1094558580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d8c0b59c0 0x7f3d8c0cdb00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.445+0000 7f3d92000640 1 -- 172.21.15.122:0/1094558580 >> 172.21.15.122:0/1094558580 conn(0x7f3d8c06bd90 msgr2=0x7f3d8c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:59.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.445+0000 7f3d92000640 1 -- 172.21.15.122:0/1094558580 shutdown_connections 2024-05-28T06:05:59.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.445+0000 7f3d92000640 1 -- 172.21.15.122:0/1094558580 wait complete. 2024-05-28T06:05:59.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.445+0000 7f3d92000640 1 Processor -- start 2024-05-28T06:05:59.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.445+0000 7f3d92000640 1 -- start start 2024-05-28T06:05:59.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d92000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d8c06f890 0x7f3d8c15aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:59.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d92000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d8c0b59c0 0x7f3d8c072270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:59.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d92000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d8c0cff30 0x7f3d8c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:59.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d92000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c168cd0 con 0x7f3d8c0cff30 2024-05-28T06:05:59.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d92000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c168b50 con 0x7f3d8c0b59c0 2024-05-28T06:05:59.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d92000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3d8c168e50 con 0x7f3d8c06f890 2024-05-28T06:05:59.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d8be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d8c0cff30 0x7f3d8c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:59.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d8be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d8c0cff30 0x7f3d8c0727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41612/0 (socket says 172.21.15.122:41612) 2024-05-28T06:05:59.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d8be00640 1 -- 172.21.15.122:0/2556750039 learned_addr learned my addr 172.21.15.122:0/2556750039 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:59.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d8b400640 1 --2- 172.21.15.122:0/2556750039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d8c06f890 0x7f3d8c15aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:59.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d82a00640 1 --2- 172.21.15.122:0/2556750039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d8c0b59c0 0x7f3d8c072270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:59.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d8be00640 1 -- 172.21.15.122:0/2556750039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d8c06f890 msgr2=0x7f3d8c15aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:59.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d8be00640 1 --2- 172.21.15.122:0/2556750039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d8c06f890 0x7f3d8c15aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d8be00640 1 -- 172.21.15.122:0/2556750039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d8c0b59c0 msgr2=0x7f3d8c072270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:59.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d8be00640 1 --2- 172.21.15.122:0/2556750039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d8c0b59c0 0x7f3d8c072270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d8be00640 1 -- 172.21.15.122:0/2556750039 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8c15afe0 con 0x7f3d8c0cff30 2024-05-28T06:05:59.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d8b400640 1 --2- 172.21.15.122:0/2556750039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d8c06f890 0x7f3d8c15aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:05:59.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d8be00640 1 --2- 172.21.15.122:0/2556750039 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d8c0cff30 0x7f3d8c0727b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3d840b0040 tx=0x7f3d84019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:59.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d83e00640 1 -- 172.21.15.122:0/2556750039 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d840c0070 con 0x7f3d8c0cff30 2024-05-28T06:05:59.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d83e00640 1 -- 172.21.15.122:0/2556750039 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d84003bc0 con 0x7f3d8c0cff30 2024-05-28T06:05:59.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d83e00640 1 -- 172.21.15.122:0/2556750039 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d840b2040 con 0x7f3d8c0cff30 2024-05-28T06:05:59.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d92000640 1 -- 172.21.15.122:0/2556750039 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d8c14d000 con 0x7f3d8c0cff30 2024-05-28T06:05:59.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d92000640 1 -- 172.21.15.122:0/2556750039 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d8c14d5c0 con 0x7f3d8c0cff30 2024-05-28T06:05:59.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d92000640 1 -- 172.21.15.122:0/2556750039 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d8c068c40 con 0x7f3d8c0cff30 2024-05-28T06:05:59.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.449+0000 7f3d83e00640 1 -- 172.21.15.122:0/2556750039 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3d84004030 con 0x7f3d8c0cff30 2024-05-28T06:05:59.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.453+0000 7f3d83e00640 1 --2- 172.21.15.122:0/2556750039 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3d680683b0 0x7f3d6806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:59.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.453+0000 7f3d83e00640 1 -- 172.21.15.122:0/2556750039 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3d841210e0 con 0x7f3d8c0cff30 2024-05-28T06:05:59.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.453+0000 7f3d8b400640 1 --2- 172.21.15.122:0/2556750039 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3d680683b0 0x7f3d6806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:59.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.453+0000 7f3d8b400640 1 --2- 172.21.15.122:0/2556750039 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3d680683b0 0x7f3d6806a870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c000f70 tx=0x7f3d7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:59.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.457+0000 7f3d83e00640 1 -- 172.21.15.122:0/2556750039 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3d84016580 con 0x7f3d8c0cff30 2024-05-28T06:05:59.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.617+0000 7f3d92000640 1 -- 172.21.15.122:0/2556750039 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d8c156980 con 0x7f3d8c0cff30 2024-05-28T06:05:59.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.617+0000 7f3d83e00640 1 -- 172.21.15.122:0/2556750039 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f3d840f1570 con 0x7f3d8c0cff30 2024-05-28T06:05:59.620 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:05:59.620 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":20,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:05:50.822555+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:05:47.441193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-28T06:05:48.148164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:05:59.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.617+0000 7f3d92000640 1 -- 172.21.15.122:0/2556750039 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3d680683b0 msgr2=0x7f3d6806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:59.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.617+0000 7f3d92000640 1 --2- 172.21.15.122:0/2556750039 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3d680683b0 0x7f3d6806a870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c000f70 tx=0x7f3d7c009040 comp rx=0 tx=0).stop 2024-05-28T06:05:59.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.617+0000 7f3d92000640 1 -- 172.21.15.122:0/2556750039 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d8c0cff30 msgr2=0x7f3d8c0727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:59.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.617+0000 7f3d92000640 1 --2- 172.21.15.122:0/2556750039 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d8c0cff30 0x7f3d8c0727b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3d840b0040 tx=0x7f3d84019700 comp rx=0 tx=0).stop 2024-05-28T06:05:59.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.621+0000 7f3d92000640 1 -- 172.21.15.122:0/2556750039 shutdown_connections 2024-05-28T06:05:59.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.621+0000 7f3d92000640 1 --2- 172.21.15.122:0/2556750039 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3d680683b0 0x7f3d6806a870 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.621+0000 7f3d92000640 1 --2- 172.21.15.122:0/2556750039 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d8c0cff30 0x7f3d8c0727b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.621+0000 7f3d92000640 1 --2- 172.21.15.122:0/2556750039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d8c0b59c0 0x7f3d8c072270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.621+0000 7f3d92000640 1 --2- 172.21.15.122:0/2556750039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d8c06f890 0x7f3d8c15aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.621+0000 7f3d92000640 1 -- 172.21.15.122:0/2556750039 >> 172.21.15.122:0/2556750039 conn(0x7f3d8c06bd90 msgr2=0x7f3d8c0aeda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:59.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.621+0000 7f3d92000640 1 -- 172.21.15.122:0/2556750039 shutdown_connections 2024-05-28T06:05:59.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.621+0000 7f3d92000640 1 -- 172.21.15.122:0/2556750039 wait complete. 2024-05-28T06:05:59.642 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-28T06:05:47.441193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-28T06:05:48.148164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:05:59.642 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:05:59.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.777+0000 7f4f80e00640 1 Processor -- start 2024-05-28T06:05:59.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.777+0000 7f4f80e00640 1 -- start start 2024-05-28T06:05:59.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.777+0000 7f4f80e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f7c0b42d0 0x7f4f7c0add80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:59.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.777+0000 7f4f80e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f7c06be00 con 0x7f4f7c06cea0 2024-05-28T06:05:59.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.777+0000 7f4f80e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f7c06c0e0 con 0x7f4f7c15e7a0 2024-05-28T06:05:59.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.777+0000 7f4f80e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4f7c06c3c0 con 0x7f4f7c0b42d0 2024-05-28T06:05:59.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.781+0000 7f4f71400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f4f7c06cea0 0x7f4f7c0b3bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38658/0 (socket says 172.21.15.122:38658) 2024-05-28T06:05:59.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.781+0000 7f4f71400640 1 -- 172.21.15.122:0/3171174712 learned_addr learned my addr 172.21.15.122:0/3171174712 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:05:59.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.781+0000 7f4f7a800640 1 --2- 172.21.15.122:0/3171174712 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f7c0b42d0 0x7f4f7c0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:59.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.781+0000 7f4f79400640 1 -- 172.21.15.122:0/3171174712 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3483430333 0 0) 0x7f4f7c06be00 con 0x7f4f7c06cea0 2024-05-28T06:05:59.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.781+0000 7f4f79400640 1 -- 172.21.15.122:0/3171174712 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f60003530 con 0x7f4f7c06cea0 2024-05-28T06:05:59.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.781+0000 7f4f79400640 1 -- 172.21.15.122:0/3171174712 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1773660040 0 0) 0x7f4f7c06c0e0 con 0x7f4f7c15e7a0 2024-05-28T06:05:59.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.781+0000 7f4f79400640 1 -- 172.21.15.122:0/3171174712 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f7c06be00 con 0x7f4f7c15e7a0 2024-05-28T06:05:59.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.781+0000 7f4f7a800640 1 -- 172.21.15.122:0/3171174712 >> v1:172.21.15.153:6789/0 conn(0x7f4f7c15e7a0 legacy=0x7f4f7c162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:59.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.781+0000 7f4f7a800640 1 -- 172.21.15.122:0/3171174712 >> v1:172.21.15.122:6789/0 conn(0x7f4f7c06cea0 legacy=0x7f4f7c0b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:59.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.781+0000 7f4f7a800640 1 -- 172.21.15.122:0/3171174712 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7c06c6a0 con 0x7f4f7c0b42d0 2024-05-28T06:05:59.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.781+0000 7f4f7a800640 1 --2- 172.21.15.122:0/3171174712 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f7c0b42d0 0x7f4f7c0add80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009dc0 tx=0x7f4f7401c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=353a9945df5fda22 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:59.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.781+0000 7f4f79400640 1 -- 172.21.15.122:0/3171174712 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f740b2070 con 0x7f4f7c0b42d0 2024-05-28T06:05:59.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f79400640 1 -- 172.21.15.122:0/3171174712 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f740a5960 con 0x7f4f7c0b42d0 2024-05-28T06:05:59.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f79400640 1 -- 172.21.15.122:0/3171174712 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f740a5d30 con 0x7f4f7c0b42d0 2024-05-28T06:05:59.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f80e00640 1 -- 172.21.15.122:0/3171174712 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f7c0b42d0 msgr2=0x7f4f7c0add80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:59.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f80e00640 1 --2- 172.21.15.122:0/3171174712 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f7c0b42d0 0x7f4f7c0add80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009dc0 tx=0x7f4f7401c990 comp rx=0 tx=0).stop 2024-05-28T06:05:59.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f80e00640 1 -- 172.21.15.122:0/3171174712 shutdown_connections 2024-05-28T06:05:59.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f80e00640 1 --2- 172.21.15.122:0/3171174712 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f7c0b42d0 0x7f4f7c0add80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f80e00640 1 -- 172.21.15.122:0/3171174712 >> 172.21.15.122:0/3171174712 conn(0x7f4f7c0b3130 msgr2=0x7f4f7c0d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:59.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f80e00640 1 -- 172.21.15.122:0/3171174712 shutdown_connections 2024-05-28T06:05:59.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f80e00640 1 -- 172.21.15.122:0/3171174712 wait complete. 2024-05-28T06:05:59.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f80e00640 1 Processor -- start 2024-05-28T06:05:59.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f80e00640 1 -- start start 2024-05-28T06:05:59.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f80e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f7c06cea0 0x7f4f7c15fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:59.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f80e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f7c0b42d0 0x7f4f7c154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:59.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f80e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f7c15e7a0 0x7f4f7c0af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:59.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f80e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c06bb10 con 0x7f4f7c06cea0 2024-05-28T06:05:59.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f80e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c06b990 con 0x7f4f7c0b42d0 2024-05-28T06:05:59.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f80e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4f7c16c830 con 0x7f4f7c15e7a0 2024-05-28T06:05:59.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f79e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f7c06cea0 0x7f4f7c15fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:59.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f79e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f7c06cea0 0x7f4f7c15fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41624/0 (socket says 172.21.15.122:41624) 2024-05-28T06:05:59.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f79e00640 1 -- 172.21.15.122:0/1520986327 learned_addr learned my addr 172.21.15.122:0/1520986327 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:05:59.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f71400640 1 --2- 172.21.15.122:0/1520986327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f7c0b42d0 0x7f4f7c154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:59.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f7a800640 1 --2- 172.21.15.122:0/1520986327 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f7c15e7a0 0x7f4f7c0af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:59.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f79e00640 1 -- 172.21.15.122:0/1520986327 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f7c15e7a0 msgr2=0x7f4f7c0af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:59.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f79e00640 1 --2- 172.21.15.122:0/1520986327 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f7c15e7a0 0x7f4f7c0af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f79e00640 1 -- 172.21.15.122:0/1520986327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f7c0b42d0 msgr2=0x7f4f7c154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:59.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f79e00640 1 --2- 172.21.15.122:0/1520986327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f7c0b42d0 0x7f4f7c154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f79e00640 1 -- 172.21.15.122:0/1520986327 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7c0ce060 con 0x7f4f7c06cea0 2024-05-28T06:05:59.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.785+0000 7f4f7a800640 1 --2- 172.21.15.122:0/1520986327 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f7c15e7a0 0x7f4f7c0af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:05:59.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.789+0000 7f4f79e00640 1 --2- 172.21.15.122:0/1520986327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f7c06cea0 0x7f4f7c15fc60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00c430 tx=0x7f4f6c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:59.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.789+0000 7f4f72a00640 1 -- 172.21.15.122:0/1520986327 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c017070 con 0x7f4f7c06cea0 2024-05-28T06:05:59.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.789+0000 7f4f72a00640 1 -- 172.21.15.122:0/1520986327 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f6c0052f0 con 0x7f4f7c06cea0 2024-05-28T06:05:59.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.789+0000 7f4f80e00640 1 -- 172.21.15.122:0/1520986327 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f7c15f180 con 0x7f4f7c06cea0 2024-05-28T06:05:59.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.789+0000 7f4f72a00640 1 -- 172.21.15.122:0/1520986327 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c003840 con 0x7f4f7c06cea0 2024-05-28T06:05:59.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.789+0000 7f4f80e00640 1 -- 172.21.15.122:0/1520986327 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f7c15f740 con 0x7f4f7c06cea0 2024-05-28T06:05:59.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.789+0000 7f4f80e00640 1 -- 172.21.15.122:0/1520986327 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f7c068c40 con 0x7f4f7c06cea0 2024-05-28T06:05:59.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.789+0000 7f4f72a00640 1 -- 172.21.15.122:0/1520986327 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4f6c01a070 con 0x7f4f7c06cea0 2024-05-28T06:05:59.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.789+0000 7f4f72a00640 1 --2- 172.21.15.122:0/1520986327 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4f58068380 0x7f4f5806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:05:59.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.789+0000 7f4f72a00640 1 -- 172.21.15.122:0/1520986327 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4f6c085c40 con 0x7f4f7c06cea0 2024-05-28T06:05:59.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.789+0000 7f4f71400640 1 --2- 172.21.15.122:0/1520986327 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4f58068380 0x7f4f5806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:05:59.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.793+0000 7f4f71400640 1 --2- 172.21.15.122:0/1520986327 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4f58068380 0x7f4f5806a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c0ce990 tx=0x7f4f64007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:05:59.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.793+0000 7f4f72a00640 1 -- 172.21.15.122:0/1520986327 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4f6c055c40 con 0x7f4f7c06cea0 2024-05-28T06:05:59.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.953+0000 7f4f80e00640 1 -- 172.21.15.122:0/1520986327 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4f7c0d18e0 con 0x7f4f7c06cea0 2024-05-28T06:05:59.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.953+0000 7f4f72a00640 1 -- 172.21.15.122:0/1520986327 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f4f6c059f40 con 0x7f4f7c06cea0 2024-05-28T06:05:59.957 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:05:59.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.957+0000 7f4f80e00640 1 -- 172.21.15.122:0/1520986327 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4f58068380 msgr2=0x7f4f5806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:59.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.957+0000 7f4f80e00640 1 --2- 172.21.15.122:0/1520986327 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4f58068380 0x7f4f5806a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c0ce990 tx=0x7f4f64007d40 comp rx=0 tx=0).stop 2024-05-28T06:05:59.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.957+0000 7f4f80e00640 1 -- 172.21.15.122:0/1520986327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f7c06cea0 msgr2=0x7f4f7c15fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:05:59.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.957+0000 7f4f80e00640 1 --2- 172.21.15.122:0/1520986327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f7c06cea0 0x7f4f7c15fc60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00c430 tx=0x7f4f6c00c8f0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.957+0000 7f4f80e00640 1 -- 172.21.15.122:0/1520986327 shutdown_connections 2024-05-28T06:05:59.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.957+0000 7f4f80e00640 1 --2- 172.21.15.122:0/1520986327 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4f58068380 0x7f4f5806a840 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.957+0000 7f4f80e00640 1 --2- 172.21.15.122:0/1520986327 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f7c15e7a0 0x7f4f7c0af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.957+0000 7f4f80e00640 1 --2- 172.21.15.122:0/1520986327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f7c0b42d0 0x7f4f7c154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.957+0000 7f4f80e00640 1 --2- 172.21.15.122:0/1520986327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f7c06cea0 0x7f4f7c15fc60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:05:59.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.957+0000 7f4f80e00640 1 -- 172.21.15.122:0/1520986327 >> 172.21.15.122:0/1520986327 conn(0x7f4f7c0b3130 msgr2=0x7f4f7c0b1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:05:59.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.957+0000 7f4f80e00640 1 -- 172.21.15.122:0/1520986327 shutdown_connections 2024-05-28T06:05:59.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:05:59.957+0000 7f4f80e00640 1 -- 172.21.15.122:0/1520986327 wait complete. 2024-05-28T06:05:59.978 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-28T06:06:00.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.113+0000 7f61c5c00640 1 Processor -- start 2024-05-28T06:06:00.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.113+0000 7f61c5c00640 1 -- start start 2024-05-28T06:06:00.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.117+0000 7f61c5c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61c009aca0 0x7f61c00b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:00.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.117+0000 7f61c5c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f61c009b080 0x7f61c009b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:00.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.117+0000 7f61c5c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f61c015fb30 0x7f61c015ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:00.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.117+0000 7f61c5c00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f61c00b5460 con 0x7f61c015fb30 2024-05-28T06:06:00.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.117+0000 7f61c5c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f61c01604c0 con 0x7f61c009b080 2024-05-28T06:06:00.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.117+0000 7f61c5c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f61c00d0bf0 con 0x7f61c009aca0 2024-05-28T06:06:00.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.117+0000 7f61bf400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f61c015fb30 0x7f61c015ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:00.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.117+0000 7f61bf400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f61c015fb30 0x7f61c015ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41626/0 (socket says 172.21.15.122:41626) 2024-05-28T06:06:00.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.117+0000 7f61bf400640 1 -- 172.21.15.122:0/4023195717 learned_addr learned my addr 172.21.15.122:0/4023195717 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:00.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.117+0000 7f61b7e00640 1 --2- 172.21.15.122:0/4023195717 >> v2:172.21.15.153:3300/0 conn(0x7f61c009b080 0x7f61c009b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:00.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.117+0000 7f61bea00640 1 --2- 172.21.15.122:0/4023195717 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61c009aca0 0x7f61c00b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:00.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.117+0000 7f61bf400640 1 -- 172.21.15.122:0/4023195717 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61c009aca0 msgr2=0x7f61c00b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:00.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.117+0000 7f61bf400640 1 --2- 172.21.15.122:0/4023195717 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61c009aca0 0x7f61c00b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:00.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.117+0000 7f61bf400640 1 -- 172.21.15.122:0/4023195717 >> v2:172.21.15.153:3300/0 conn(0x7f61c009b080 msgr2=0x7f61c009b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:00.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.117+0000 7f61bf400640 1 --2- 172.21.15.122:0/4023195717 >> v2:172.21.15.153:3300/0 conn(0x7f61c009b080 0x7f61c009b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:00.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.117+0000 7f61bf400640 1 -- 172.21.15.122:0/4023195717 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c00d0eb0 con 0x7f61c015fb30 2024-05-28T06:06:00.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.121+0000 7f61bf400640 1 --2- 172.21.15.122:0/4023195717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61c015fb30 0x7f61c015ff80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f61c00732d0 tx=0x7f61b801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a771bef59b9b8c69 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:00.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.121+0000 7f61be000640 1 -- 172.21.15.122:0/4023195717 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b80a55f0 con 0x7f61c015fb30 2024-05-28T06:06:00.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.121+0000 7f61be000640 1 -- 172.21.15.122:0/4023195717 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61b80a5790 con 0x7f61c015fb30 2024-05-28T06:06:00.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.121+0000 7f61be000640 1 -- 172.21.15.122:0/4023195717 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b80a5b60 con 0x7f61c015fb30 2024-05-28T06:06:00.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.121+0000 7f61c5c00640 1 -- 172.21.15.122:0/4023195717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61c015fb30 msgr2=0x7f61c015ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:00.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.121+0000 7f61c5c00640 1 --2- 172.21.15.122:0/4023195717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61c015fb30 0x7f61c015ff80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f61c00732d0 tx=0x7f61b801c960 comp rx=0 tx=0).stop 2024-05-28T06:06:00.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.121+0000 7f61c5c00640 1 -- 172.21.15.122:0/4023195717 shutdown_connections 2024-05-28T06:06:00.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.121+0000 7f61c5c00640 1 --2- 172.21.15.122:0/4023195717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61c015fb30 0x7f61c015ff80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:00.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.121+0000 7f61c5c00640 1 --2- 172.21.15.122:0/4023195717 >> v2:172.21.15.153:3300/0 conn(0x7f61c009b080 0x7f61c009b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:00.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.121+0000 7f61c5c00640 1 --2- 172.21.15.122:0/4023195717 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61c009aca0 0x7f61c00b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:00.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.121+0000 7f61c5c00640 1 -- 172.21.15.122:0/4023195717 >> 172.21.15.122:0/4023195717 conn(0x7f61c00b4100 msgr2=0x7f61c00b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:00.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.121+0000 7f61c5c00640 1 -- 172.21.15.122:0/4023195717 shutdown_connections 2024-05-28T06:06:00.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.121+0000 7f61c5c00640 1 -- 172.21.15.122:0/4023195717 wait complete. 2024-05-28T06:06:00.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61c5c00640 1 Processor -- start 2024-05-28T06:06:00.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61c5c00640 1 -- start start 2024-05-28T06:06:00.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61c5c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61c009aca0 0x7f61c0156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:00.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61c5c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61c009b080 0x7f61c00cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:00.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61c5c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61c015fb30 0x7f61c015d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:00.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61c5c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f61c00cde00 con 0x7f61c015fb30 2024-05-28T06:06:00.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61c5c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f61c00cdc80 con 0x7f61c009aca0 2024-05-28T06:06:00.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61c5c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f61c00cdf80 con 0x7f61c009b080 2024-05-28T06:06:00.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61bf400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61c015fb30 0x7f61c015d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:00.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61bf400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61c015fb30 0x7f61c015d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41628/0 (socket says 172.21.15.122:41628) 2024-05-28T06:06:00.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61bea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61c009aca0 0x7f61c0156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:00.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61bf400640 1 -- 172.21.15.122:0/1472753264 learned_addr learned my addr 172.21.15.122:0/1472753264 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:00.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61b7e00640 1 --2- 172.21.15.122:0/1472753264 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61c009b080 0x7f61c00cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:00.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61bf400640 1 -- 172.21.15.122:0/1472753264 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61c009b080 msgr2=0x7f61c00cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:00.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61bf400640 1 --2- 172.21.15.122:0/1472753264 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61c009b080 0x7f61c00cac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:00.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61bf400640 1 -- 172.21.15.122:0/1472753264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61c009aca0 msgr2=0x7f61c0156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:00.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61bf400640 1 --2- 172.21.15.122:0/1472753264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61c009aca0 0x7f61c0156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:00.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61bf400640 1 -- 172.21.15.122:0/1472753264 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c00717e0 con 0x7f61c015fb30 2024-05-28T06:06:00.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61bf400640 1 --2- 172.21.15.122:0/1472753264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61c015fb30 0x7f61c015d3a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f61b801b010 tx=0x7f61b8019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:00.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61b6a00640 1 -- 172.21.15.122:0/1472753264 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b80bc020 con 0x7f61c015fb30 2024-05-28T06:06:00.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61b6a00640 1 -- 172.21.15.122:0/1472753264 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61b80b8690 con 0x7f61c015fb30 2024-05-28T06:06:00.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61b6a00640 1 -- 172.21.15.122:0/1472753264 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b80a55f0 con 0x7f61c015fb30 2024-05-28T06:06:00.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61c5c00640 1 -- 172.21.15.122:0/1472753264 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61c00c9be0 con 0x7f61c015fb30 2024-05-28T06:06:00.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.125+0000 7f61c5c00640 1 -- 172.21.15.122:0/1472753264 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61c00ca480 con 0x7f61c015fb30 2024-05-28T06:06:00.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.129+0000 7f61c5c00640 1 -- 172.21.15.122:0/1472753264 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61c0068c40 con 0x7f61c015fb30 2024-05-28T06:06:00.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.129+0000 7f61b6a00640 1 -- 172.21.15.122:0/1472753264 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f61b80bf020 con 0x7f61c015fb30 2024-05-28T06:06:00.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.129+0000 7f61b6a00640 1 --2- 172.21.15.122:0/1472753264 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f619c068380 0x7f619c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:00.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.129+0000 7f61b6a00640 1 -- 172.21.15.122:0/1472753264 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f61b8121610 con 0x7f61c015fb30 2024-05-28T06:06:00.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.129+0000 7f61bea00640 1 --2- 172.21.15.122:0/1472753264 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f619c068380 0x7f619c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:00.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.129+0000 7f61bea00640 1 --2- 172.21.15.122:0/1472753264 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f619c068380 0x7f619c06a840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009ac0 tx=0x7f61b0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:00.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.133+0000 7f61b6a00640 1 -- 172.21.15.122:0/1472753264 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f61b80c6030 con 0x7f61c015fb30 2024-05-28T06:06:00.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.293+0000 7f61c5c00640 1 -- 172.21.15.122:0/1472753264 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f61c0157340 con 0x7f61c015fb30 2024-05-28T06:06:00.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.293+0000 7f61b6a00640 1 -- 172.21.15.122:0/1472753264 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f61b80165e0 con 0x7f61c015fb30 2024-05-28T06:06:00.296 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 32 2024-05-28T06:06:00.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.293+0000 7f61c5c00640 1 -- 172.21.15.122:0/1472753264 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f619c068380 msgr2=0x7f619c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:00.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.293+0000 7f61c5c00640 1 --2- 172.21.15.122:0/1472753264 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f619c068380 0x7f619c06a840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009ac0 tx=0x7f61b0009190 comp rx=0 tx=0).stop 2024-05-28T06:06:00.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.297+0000 7f61c5c00640 1 -- 172.21.15.122:0/1472753264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61c015fb30 msgr2=0x7f61c015d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:00.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.297+0000 7f61c5c00640 1 --2- 172.21.15.122:0/1472753264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61c015fb30 0x7f61c015d3a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f61b801b010 tx=0x7f61b8019700 comp rx=0 tx=0).stop 2024-05-28T06:06:00.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.297+0000 7f61c5c00640 1 -- 172.21.15.122:0/1472753264 shutdown_connections 2024-05-28T06:06:00.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.297+0000 7f61c5c00640 1 --2- 172.21.15.122:0/1472753264 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f619c068380 0x7f619c06a840 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:00.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.297+0000 7f61c5c00640 1 --2- 172.21.15.122:0/1472753264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61c015fb30 0x7f61c015d3a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:00.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.297+0000 7f61c5c00640 1 --2- 172.21.15.122:0/1472753264 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61c009b080 0x7f61c00cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:00.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.297+0000 7f61c5c00640 1 --2- 172.21.15.122:0/1472753264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61c009aca0 0x7f61c0156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:00.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.297+0000 7f61c5c00640 1 -- 172.21.15.122:0/1472753264 >> 172.21.15.122:0/1472753264 conn(0x7f61c00b4100 msgr2=0x7f61c0074d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:00.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.297+0000 7f61c5c00640 1 -- 172.21.15.122:0/1472753264 shutdown_connections 2024-05-28T06:06:00.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.297+0000 7f61c5c00640 1 -- 172.21.15.122:0/1472753264 wait complete. 2024-05-28T06:06:00.327 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-28T06:06:00.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.465+0000 7f11e8200640 1 Processor -- start 2024-05-28T06:06:00.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.465+0000 7f11e8200640 1 -- start start 2024-05-28T06:06:00.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.465+0000 7f11e8200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e009aca0 0x7f11e00b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:00.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.465+0000 7f11e8200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11e00d0bf0 con 0x7f11e009b080 2024-05-28T06:06:00.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.465+0000 7f11e8200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11e00d0eb0 con 0x7f11e0160240 2024-05-28T06:06:00.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.465+0000 7f11e8200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f11e00b5460 con 0x7f11e009aca0 2024-05-28T06:06:00.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.465+0000 7f11e4e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f11e009b080 0x7f11e015fb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38670/0 (socket says 172.21.15.122:38670) 2024-05-28T06:06:00.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.465+0000 7f11e4e00640 1 -- 172.21.15.122:0/4108150634 learned_addr learned my addr 172.21.15.122:0/4108150634 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:00.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.465+0000 7f11e5800640 1 --2- 172.21.15.122:0/4108150634 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e009aca0 0x7f11e00b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:00.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.465+0000 7f11dfe00640 1 -- 172.21.15.122:0/4108150634 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3093308054 0 0) 0x7f11e00d0bf0 con 0x7f11e009b080 2024-05-28T06:06:00.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.465+0000 7f11dfe00640 1 -- 172.21.15.122:0/4108150634 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11c8003530 con 0x7f11e009b080 2024-05-28T06:06:00.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.465+0000 7f11dfe00640 1 -- 172.21.15.122:0/4108150634 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1069622799 0 0) 0x7f11e00d0eb0 con 0x7f11e0160240 2024-05-28T06:06:00.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.465+0000 7f11dfe00640 1 -- 172.21.15.122:0/4108150634 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11e00d0bf0 con 0x7f11e0160240 2024-05-28T06:06:00.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.465+0000 7f11e5800640 1 -- 172.21.15.122:0/4108150634 >> v1:172.21.15.153:6789/0 conn(0x7f11e0160240 legacy=0x7f11e00b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:00.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.465+0000 7f11e5800640 1 -- 172.21.15.122:0/4108150634 >> v1:172.21.15.122:6789/0 conn(0x7f11e009b080 legacy=0x7f11e015fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:00.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.465+0000 7f11e5800640 1 -- 172.21.15.122:0/4108150634 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e00d1190 con 0x7f11e009aca0 2024-05-28T06:06:00.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.469+0000 7f11e5800640 1 --2- 172.21.15.122:0/4108150634 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e009aca0 0x7f11e00b35b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f11d40097f0 tx=0x7f11d401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1c932b7591f5319 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:00.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.469+0000 7f11dfe00640 1 -- 172.21.15.122:0/4108150634 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d40b1070 con 0x7f11e009aca0 2024-05-28T06:06:00.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.469+0000 7f11dfe00640 1 -- 172.21.15.122:0/4108150634 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11d40a8050 con 0x7f11e009aca0 2024-05-28T06:06:00.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.469+0000 7f11dfe00640 1 -- 172.21.15.122:0/4108150634 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d40ac860 con 0x7f11e009aca0 2024-05-28T06:06:00.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.469+0000 7f11e8200640 1 -- 172.21.15.122:0/4108150634 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e009aca0 msgr2=0x7f11e00b35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:00.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.469+0000 7f11e8200640 1 --2- 172.21.15.122:0/4108150634 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e009aca0 0x7f11e00b35b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f11d40097f0 tx=0x7f11d401c450 comp rx=0 tx=0).stop 2024-05-28T06:06:00.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.469+0000 7f11e8200640 1 -- 172.21.15.122:0/4108150634 shutdown_connections 2024-05-28T06:06:00.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.469+0000 7f11e8200640 1 --2- 172.21.15.122:0/4108150634 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e009aca0 0x7f11e00b35b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:00.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.469+0000 7f11e8200640 1 -- 172.21.15.122:0/4108150634 >> 172.21.15.122:0/4108150634 conn(0x7f11e00b4100 msgr2=0x7f11e00b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:00.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.469+0000 7f11e8200640 1 -- 172.21.15.122:0/4108150634 shutdown_connections 2024-05-28T06:06:00.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.469+0000 7f11e8200640 1 -- 172.21.15.122:0/4108150634 wait complete. 2024-05-28T06:06:00.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11e8200640 1 Processor -- start 2024-05-28T06:06:00.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11e8200640 1 -- start start 2024-05-28T06:06:00.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11e8200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11e009aca0 0x7f11e00cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:00.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11e8200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e009b080 0x7f11e01681c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:00.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11e8200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11e0160240 0x7f11e0156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:00.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11e8200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f11e016a760 con 0x7f11e0160240 2024-05-28T06:06:00.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11e8200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f11e00b6ae0 con 0x7f11e009aca0 2024-05-28T06:06:00.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11e8200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f11e016a8e0 con 0x7f11e009b080 2024-05-28T06:06:00.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11e6200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11e0160240 0x7f11e0156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:00.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11e6200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11e0160240 0x7f11e0156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41644/0 (socket says 172.21.15.122:41644) 2024-05-28T06:06:00.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11e6200640 1 -- 172.21.15.122:0/2400116811 learned_addr learned my addr 172.21.15.122:0/2400116811 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:00.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11e5800640 1 --2- 172.21.15.122:0/2400116811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11e009aca0 0x7f11e00cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:00.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11e4e00640 1 --2- 172.21.15.122:0/2400116811 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e009b080 0x7f11e01681c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:00.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11e6200640 1 -- 172.21.15.122:0/2400116811 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e009b080 msgr2=0x7f11e01681c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:00.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11e6200640 1 --2- 172.21.15.122:0/2400116811 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e009b080 0x7f11e01681c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:00.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11e6200640 1 -- 172.21.15.122:0/2400116811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11e009aca0 msgr2=0x7f11e00cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:00.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11e6200640 1 --2- 172.21.15.122:0/2400116811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11e009aca0 0x7f11e00cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:00.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11e6200640 1 -- 172.21.15.122:0/2400116811 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e00c8ea0 con 0x7f11e0160240 2024-05-28T06:06:00.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11e6200640 1 --2- 172.21.15.122:0/2400116811 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11e0160240 0x7f11e0156250 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f11d800c790 tx=0x7f11d800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:00.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11dd600640 1 -- 172.21.15.122:0/2400116811 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d8003b80 con 0x7f11e0160240 2024-05-28T06:06:00.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11dd600640 1 -- 172.21.15.122:0/2400116811 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11d8003d20 con 0x7f11e0160240 2024-05-28T06:06:00.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11e8200640 1 -- 172.21.15.122:0/2400116811 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11e006e240 con 0x7f11e0160240 2024-05-28T06:06:00.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11dd600640 1 -- 172.21.15.122:0/2400116811 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d800aa50 con 0x7f11e0160240 2024-05-28T06:06:00.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11e8200640 1 -- 172.21.15.122:0/2400116811 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11e0156790 con 0x7f11e0160240 2024-05-28T06:06:00.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.473+0000 7f11e8200640 1 -- 172.21.15.122:0/2400116811 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11e0068c40 con 0x7f11e0160240 2024-05-28T06:06:00.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.477+0000 7f11dd600640 1 -- 172.21.15.122:0/2400116811 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f11d800abf0 con 0x7f11e0160240 2024-05-28T06:06:00.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.477+0000 7f11dd600640 1 --2- 172.21.15.122:0/2400116811 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f11c0068380 0x7f11c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:00.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.477+0000 7f11dd600640 1 -- 172.21.15.122:0/2400116811 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f11d80867a0 con 0x7f11e0160240 2024-05-28T06:06:00.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.477+0000 7f11e5800640 1 --2- 172.21.15.122:0/2400116811 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f11c0068380 0x7f11c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:00.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.477+0000 7f11e5800640 1 --2- 172.21.15.122:0/2400116811 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f11c0068380 0x7f11c006a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f11d40ae000 tx=0x7f11d40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:00.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.481+0000 7f11dd600640 1 -- 172.21.15.122:0/2400116811 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f11d8056780 con 0x7f11e0160240 2024-05-28T06:06:00.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.641+0000 7f11e8200640 1 -- 172.21.15.122:0/2400116811 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f11e00cf8b0 con 0x7f11e0160240 2024-05-28T06:06:00.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.641+0000 7f11dd600640 1 -- 172.21.15.122:0/2400116811 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f11d805aa80 con 0x7f11e0160240 2024-05-28T06:06:00.644 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 64 2024-05-28T06:06:00.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.641+0000 7f11e8200640 1 -- 172.21.15.122:0/2400116811 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f11c0068380 msgr2=0x7f11c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:00.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.641+0000 7f11e8200640 1 --2- 172.21.15.122:0/2400116811 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f11c0068380 0x7f11c006a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f11d40ae000 tx=0x7f11d40a7000 comp rx=0 tx=0).stop 2024-05-28T06:06:00.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.641+0000 7f11e8200640 1 -- 172.21.15.122:0/2400116811 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11e0160240 msgr2=0x7f11e0156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:00.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.641+0000 7f11e8200640 1 --2- 172.21.15.122:0/2400116811 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11e0160240 0x7f11e0156250 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f11d800c790 tx=0x7f11d800cc50 comp rx=0 tx=0).stop 2024-05-28T06:06:00.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.641+0000 7f11e8200640 1 -- 172.21.15.122:0/2400116811 shutdown_connections 2024-05-28T06:06:00.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.641+0000 7f11e8200640 1 --2- 172.21.15.122:0/2400116811 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f11c0068380 0x7f11c006a840 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:00.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.641+0000 7f11e8200640 1 --2- 172.21.15.122:0/2400116811 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11e0160240 0x7f11e0156250 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:00.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.641+0000 7f11e8200640 1 --2- 172.21.15.122:0/2400116811 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11e009b080 0x7f11e01681c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:00.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.641+0000 7f11e8200640 1 --2- 172.21.15.122:0/2400116811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11e009aca0 0x7f11e00cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:00.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.641+0000 7f11e8200640 1 -- 172.21.15.122:0/2400116811 >> 172.21.15.122:0/2400116811 conn(0x7f11e00b4100 msgr2=0x7f11e01573f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:00.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.641+0000 7f11e8200640 1 -- 172.21.15.122:0/2400116811 shutdown_connections 2024-05-28T06:06:00.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.641+0000 7f11e8200640 1 -- 172.21.15.122:0/2400116811 wait complete. 2024-05-28T06:06:00.665 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:06:00.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.797+0000 7f32a5400640 1 Processor -- start 2024-05-28T06:06:00.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.797+0000 7f32a5400640 1 -- start start 2024-05-28T06:06:00.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.797+0000 7f32a5400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32a00b58d0 0x7f32a00b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:00.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.797+0000 7f32a5400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f32a00ce4f0 0x7f32a00ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:00.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.797+0000 7f32a5400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32a00b61f0 con 0x7f32a00722a0 2024-05-28T06:06:00.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.797+0000 7f32a5400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f32a015d970 con 0x7f32a00ce4f0 2024-05-28T06:06:00.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.797+0000 7f32a5400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f32a015dc50 con 0x7f32a00b58d0 2024-05-28T06:06:00.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.797+0000 7f329de00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f32a00ce4f0 0x7f32a00ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:00.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.797+0000 7f329de00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f32a00ce4f0 0x7f32a00ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41656/0 (socket says 172.21.15.122:41656) 2024-05-28T06:06:00.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.797+0000 7f329de00640 1 -- 172.21.15.122:0/1008988790 learned_addr learned my addr 172.21.15.122:0/1008988790 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:00.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.797+0000 7f329e800640 1 --2- 172.21.15.122:0/1008988790 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32a00b58d0 0x7f32a00b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:00.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.797+0000 7f329de00640 1 -- 172.21.15.122:0/1008988790 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32a00b58d0 msgr2=0x7f32a00b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:00.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.797+0000 7f329de00640 1 --2- 172.21.15.122:0/1008988790 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32a00b58d0 0x7f32a00b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:00.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.797+0000 7f329de00640 1 -- 172.21.15.122:0/1008988790 >> v1:172.21.15.153:6789/0 conn(0x7f32a00722a0 legacy=0x7f32a0072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:00.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.797+0000 7f329de00640 1 -- 172.21.15.122:0/1008988790 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a015df30 con 0x7f32a00ce4f0 2024-05-28T06:06:00.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.801+0000 7f329de00640 1 --2- 172.21.15.122:0/1008988790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32a00ce4f0 0x7f32a00ce950 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f328c009870 tx=0x7f328c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e314c2b54639f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:00.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.801+0000 7f329d400640 1 -- 172.21.15.122:0/1008988790 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c0aa430 con 0x7f32a00ce4f0 2024-05-28T06:06:00.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.801+0000 7f329d400640 1 -- 172.21.15.122:0/1008988790 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f328c0af070 con 0x7f32a00ce4f0 2024-05-28T06:06:00.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.801+0000 7f329d400640 1 -- 172.21.15.122:0/1008988790 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c0aa7f0 con 0x7f32a00ce4f0 2024-05-28T06:06:00.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.801+0000 7f32a5400640 1 -- 172.21.15.122:0/1008988790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32a00ce4f0 msgr2=0x7f32a00ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:00.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.801+0000 7f32a5400640 1 --2- 172.21.15.122:0/1008988790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32a00ce4f0 0x7f32a00ce950 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f328c009870 tx=0x7f328c01c530 comp rx=0 tx=0).stop 2024-05-28T06:06:00.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.801+0000 7f32a5400640 1 -- 172.21.15.122:0/1008988790 shutdown_connections 2024-05-28T06:06:00.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.801+0000 7f32a5400640 1 --2- 172.21.15.122:0/1008988790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32a00ce4f0 0x7f32a00ce950 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:00.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.801+0000 7f32a5400640 1 --2- 172.21.15.122:0/1008988790 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32a00b58d0 0x7f32a00b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:00.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.801+0000 7f32a5400640 1 -- 172.21.15.122:0/1008988790 >> 172.21.15.122:0/1008988790 conn(0x7f32a006bd90 msgr2=0x7f32a006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:00.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.801+0000 7f32a5400640 1 -- 172.21.15.122:0/1008988790 shutdown_connections 2024-05-28T06:06:00.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.801+0000 7f32a5400640 1 -- 172.21.15.122:0/1008988790 wait complete. 2024-05-28T06:06:00.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.805+0000 7f32a5400640 1 Processor -- start 2024-05-28T06:06:00.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.805+0000 7f32a5400640 1 -- start start 2024-05-28T06:06:00.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.805+0000 7f32a5400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32a00722a0 0x7f32a0166a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:00.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.805+0000 7f32a5400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32a00b58d0 0x7f32a014a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:00.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.805+0000 7f32a5400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32a00ce4f0 0x7f32a00b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:00.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.805+0000 7f32a5400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f32a00cf010 con 0x7f32a00722a0 2024-05-28T06:06:00.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.805+0000 7f32a5400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f32a00cee90 con 0x7f32a00b58d0 2024-05-28T06:06:00.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.805+0000 7f32a5400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f32a0169a60 con 0x7f32a00ce4f0 2024-05-28T06:06:00.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.805+0000 7f329e800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32a00722a0 0x7f32a0166a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:00.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.805+0000 7f329e800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32a00722a0 0x7f32a0166a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41666/0 (socket says 172.21.15.122:41666) 2024-05-28T06:06:00.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.805+0000 7f329e800640 1 -- 172.21.15.122:0/4158081388 learned_addr learned my addr 172.21.15.122:0/4158081388 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:00.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.805+0000 7f329f200640 1 --2- 172.21.15.122:0/4158081388 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32a00ce4f0 0x7f32a00b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:00.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.805+0000 7f329e800640 1 -- 172.21.15.122:0/4158081388 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32a00ce4f0 msgr2=0x7f32a00b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:00.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.805+0000 7f329e800640 1 --2- 172.21.15.122:0/4158081388 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32a00ce4f0 0x7f32a00b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:00.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.805+0000 7f329e800640 1 -- 172.21.15.122:0/4158081388 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32a00b58d0 msgr2=0x7f32a014a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:00.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.805+0000 7f329e800640 1 --2- 172.21.15.122:0/4158081388 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32a00b58d0 0x7f32a014a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:00.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.805+0000 7f329e800640 1 -- 172.21.15.122:0/4158081388 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a014b410 con 0x7f32a00722a0 2024-05-28T06:06:00.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.805+0000 7f329e800640 1 --2- 172.21.15.122:0/4158081388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32a00722a0 0x7f32a0166a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3290007ef0 tx=0x7f329000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:00.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.805+0000 7f3296a00640 1 -- 172.21.15.122:0/4158081388 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3290014620 con 0x7f32a00722a0 2024-05-28T06:06:00.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.805+0000 7f3296a00640 1 -- 172.21.15.122:0/4158081388 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3290019070 con 0x7f32a00722a0 2024-05-28T06:06:00.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.805+0000 7f32a5400640 1 -- 172.21.15.122:0/4158081388 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a014b6f0 con 0x7f32a00722a0 2024-05-28T06:06:00.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.805+0000 7f3296a00640 1 -- 172.21.15.122:0/4158081388 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3290014a00 con 0x7f32a00722a0 2024-05-28T06:06:00.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.805+0000 7f32a5400640 1 -- 172.21.15.122:0/4158081388 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a0148d90 con 0x7f32a00722a0 2024-05-28T06:06:00.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.809+0000 7f32a5400640 1 -- 172.21.15.122:0/4158081388 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32a0068c40 con 0x7f32a00722a0 2024-05-28T06:06:00.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.809+0000 7f3296a00640 1 -- 172.21.15.122:0/4158081388 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3290014ba0 con 0x7f32a00722a0 2024-05-28T06:06:00.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.809+0000 7f3296a00640 1 --2- 172.21.15.122:0/4158081388 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3280068380 0x7f328006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:00.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.809+0000 7f3296a00640 1 -- 172.21.15.122:0/4158081388 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3290087310 con 0x7f32a00722a0 2024-05-28T06:06:00.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.809+0000 7f329de00640 1 --2- 172.21.15.122:0/4158081388 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3280068380 0x7f328006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:00.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.809+0000 7f329de00640 1 --2- 172.21.15.122:0/4158081388 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3280068380 0x7f328006a840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f328c0ae000 tx=0x7f328c004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:00.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:00.813+0000 7f3296a00640 1 -- 172.21.15.122:0/4158081388 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3290057830 con 0x7f32a00722a0 2024-05-28T06:06:01.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.005+0000 7f32a5400640 1 -- 172.21.15.122:0/4158081388 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32a01459b0 con 0x7f32a00722a0 2024-05-28T06:06:01.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.005+0000 7f3296a00640 1 -- 172.21.15.122:0/4158081388 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7f3290057130 con 0x7f32a00722a0 2024-05-28T06:06:01.008 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:01.008 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4177682646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4177682646},{"type":"v1","addr":"172.21.15.153:6835","nonce":4177682646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3318983491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3318983491},{"type":"v1","addr":"172.21.15.153:6834","nonce":3318983491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/360722760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":360722760},{"type":"v1","addr":"172.21.15.122:6836","nonce":360722760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-28T06:05:49.194771+0000","modified":"2024-05-28T06:05:52.203797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1474216380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1474216380},{"type":"v1","addr":"172.21.15.122:6837","nonce":1474216380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4270,"qdb_cluster":[4270]},"id":1}]} 2024-05-28T06:06:01.009 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 8 2024-05-28T06:06:01.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.005+0000 7f32a5400640 1 -- 172.21.15.122:0/4158081388 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3280068380 msgr2=0x7f328006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:01.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.005+0000 7f32a5400640 1 --2- 172.21.15.122:0/4158081388 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3280068380 0x7f328006a840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f328c0ae000 tx=0x7f328c004740 comp rx=0 tx=0).stop 2024-05-28T06:06:01.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.005+0000 7f32a5400640 1 -- 172.21.15.122:0/4158081388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32a00722a0 msgr2=0x7f32a0166a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:01.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.005+0000 7f32a5400640 1 --2- 172.21.15.122:0/4158081388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32a00722a0 0x7f32a0166a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3290007ef0 tx=0x7f329000e4b0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.005+0000 7f32a5400640 1 -- 172.21.15.122:0/4158081388 shutdown_connections 2024-05-28T06:06:01.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.005+0000 7f32a5400640 1 --2- 172.21.15.122:0/4158081388 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3280068380 0x7f328006a840 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.005+0000 7f32a5400640 1 --2- 172.21.15.122:0/4158081388 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f32a00ce4f0 0x7f32a00b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.005+0000 7f32a5400640 1 --2- 172.21.15.122:0/4158081388 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32a00b58d0 0x7f32a014a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.005+0000 7f32a5400640 1 --2- 172.21.15.122:0/4158081388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32a00722a0 0x7f32a0166a00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.005+0000 7f32a5400640 1 -- 172.21.15.122:0/4158081388 >> 172.21.15.122:0/4158081388 conn(0x7f32a006bd90 msgr2=0x7f32a00af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:01.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.005+0000 7f32a5400640 1 -- 172.21.15.122:0/4158081388 shutdown_connections 2024-05-28T06:06:01.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.009+0000 7f32a5400640 1 -- 172.21.15.122:0/4158081388 wait complete. 2024-05-28T06:06:01.029 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:06:01.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.161+0000 7f4e70a00640 1 Processor -- start 2024-05-28T06:06:01.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.161+0000 7f4e70a00640 1 -- start start 2024-05-28T06:06:01.167 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.165+0000 7f4e70a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4e6c06cea0 0x7f4e6c0b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:01.167 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.165+0000 7f4e70a00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e6c06be00 con 0x7f4e6c15e7a0 2024-05-28T06:06:01.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.165+0000 7f4e70a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e6c06c0e0 con 0x7f4e6c0b4100 2024-05-28T06:06:01.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.165+0000 7f4e70a00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f4e6c0b4550 con 0x7f4e6c06cea0 2024-05-28T06:06:01.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.165+0000 7f4e69400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4e6c06cea0 0x7f4e6c0b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:01.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.165+0000 7f4e69400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4e6c06cea0 0x7f4e6c0b3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41672/0 (socket says 172.21.15.122:41672) 2024-05-28T06:06:01.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.165+0000 7f4e69e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f4e6c15e7a0 0x7f4e6c162e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38680/0 (socket says 172.21.15.122:38680) 2024-05-28T06:06:01.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.165+0000 7f4e69400640 1 -- 172.21.15.122:0/642637931 learned_addr learned my addr 172.21.15.122:0/642637931 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:01.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.165+0000 7f4e69400640 1 -- 172.21.15.122:0/642637931 >> v1:172.21.15.153:6789/0 conn(0x7f4e6c0b4100 legacy=0x7f4e6c0add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:01.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.165+0000 7f4e69400640 1 -- 172.21.15.122:0/642637931 >> v1:172.21.15.122:6789/0 conn(0x7f4e6c15e7a0 legacy=0x7f4e6c162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:01.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.165+0000 7f4e69400640 1 -- 172.21.15.122:0/642637931 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e6c06c3c0 con 0x7f4e6c06cea0 2024-05-28T06:06:01.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.169+0000 7f4e69400640 1 --2- 172.21.15.122:0/642637931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e6c06cea0 0x7f4e6c0b3bc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009870 tx=0x7f4e5801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b316d16cf1c61566 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:01.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.169+0000 7f4e68a00640 1 -- 172.21.15.122:0/642637931 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e580ab650 con 0x7f4e6c06cea0 2024-05-28T06:06:01.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.169+0000 7f4e68a00640 1 -- 172.21.15.122:0/642637931 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e580b0070 con 0x7f4e6c06cea0 2024-05-28T06:06:01.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.169+0000 7f4e68a00640 1 -- 172.21.15.122:0/642637931 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e580aba10 con 0x7f4e6c06cea0 2024-05-28T06:06:01.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.169+0000 7f4e70a00640 1 -- 172.21.15.122:0/642637931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e6c06cea0 msgr2=0x7f4e6c0b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:01.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.169+0000 7f4e70a00640 1 --2- 172.21.15.122:0/642637931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e6c06cea0 0x7f4e6c0b3bc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009870 tx=0x7f4e5801c560 comp rx=0 tx=0).stop 2024-05-28T06:06:01.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.169+0000 7f4e70a00640 1 -- 172.21.15.122:0/642637931 shutdown_connections 2024-05-28T06:06:01.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.169+0000 7f4e70a00640 1 --2- 172.21.15.122:0/642637931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e6c06cea0 0x7f4e6c0b3bc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.169+0000 7f4e70a00640 1 -- 172.21.15.122:0/642637931 >> 172.21.15.122:0/642637931 conn(0x7f4e6c0b3130 msgr2=0x7f4e6c0d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:01.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.169+0000 7f4e70a00640 1 -- 172.21.15.122:0/642637931 shutdown_connections 2024-05-28T06:06:01.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.169+0000 7f4e70a00640 1 -- 172.21.15.122:0/642637931 wait complete. 2024-05-28T06:06:01.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.169+0000 7f4e70a00640 1 Processor -- start 2024-05-28T06:06:01.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.169+0000 7f4e70a00640 1 -- start start 2024-05-28T06:06:01.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.169+0000 7f4e70a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e6c06cea0 0x7f4e6c14c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:01.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.169+0000 7f4e70a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e6c0b4100 0x7f4e6c16a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:01.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.169+0000 7f4e70a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6c15e7a0 0x7f4e6c15c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:01.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.169+0000 7f4e70a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c15ed00 con 0x7f4e6c06cea0 2024-05-28T06:06:01.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.169+0000 7f4e70a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c15eb80 con 0x7f4e6c0b4100 2024-05-28T06:06:01.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.169+0000 7f4e70a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4e6c0ae8a0 con 0x7f4e6c15e7a0 2024-05-28T06:06:01.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.173+0000 7f4e69e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e6c06cea0 0x7f4e6c14c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:01.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.173+0000 7f4e69e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e6c06cea0 0x7f4e6c14c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41688/0 (socket says 172.21.15.122:41688) 2024-05-28T06:06:01.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.173+0000 7f4e69e00640 1 -- 172.21.15.122:0/3524425621 learned_addr learned my addr 172.21.15.122:0/3524425621 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:01.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.173+0000 7f4e69400640 1 --2- 172.21.15.122:0/3524425621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e6c0b4100 0x7f4e6c16a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:01.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.173+0000 7f4e6a800640 1 --2- 172.21.15.122:0/3524425621 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6c15e7a0 0x7f4e6c15c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:01.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.173+0000 7f4e69e00640 1 -- 172.21.15.122:0/3524425621 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6c15e7a0 msgr2=0x7f4e6c15c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:01.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.173+0000 7f4e69e00640 1 --2- 172.21.15.122:0/3524425621 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6c15e7a0 0x7f4e6c15c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.173+0000 7f4e69e00640 1 -- 172.21.15.122:0/3524425621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e6c0b4100 msgr2=0x7f4e6c16a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:01.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.173+0000 7f4e69e00640 1 --2- 172.21.15.122:0/3524425621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e6c0b4100 0x7f4e6c16a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.173+0000 7f4e69e00640 1 -- 172.21.15.122:0/3524425621 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e6c14ca80 con 0x7f4e6c06cea0 2024-05-28T06:06:01.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.173+0000 7f4e6a800640 1 --2- 172.21.15.122:0/3524425621 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6c15e7a0 0x7f4e6c15c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:01.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.173+0000 7f4e69e00640 1 --2- 172.21.15.122:0/3524425621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e6c06cea0 0x7f4e6c14c1a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00c780 tx=0x7f4e5c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:01.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.173+0000 7f4e62000640 1 -- 172.21.15.122:0/3524425621 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c017070 con 0x7f4e6c06cea0 2024-05-28T06:06:01.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.173+0000 7f4e62000640 1 -- 172.21.15.122:0/3524425621 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e5c00a640 con 0x7f4e6c06cea0 2024-05-28T06:06:01.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.173+0000 7f4e62000640 1 -- 172.21.15.122:0/3524425621 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c00a9f0 con 0x7f4e6c06cea0 2024-05-28T06:06:01.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.173+0000 7f4e70a00640 1 -- 172.21.15.122:0/3524425621 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e6c161600 con 0x7f4e6c06cea0 2024-05-28T06:06:01.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.173+0000 7f4e70a00640 1 -- 172.21.15.122:0/3524425621 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e6c15f2e0 con 0x7f4e6c06cea0 2024-05-28T06:06:01.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.173+0000 7f4e70a00640 1 -- 172.21.15.122:0/3524425621 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e6c068c40 con 0x7f4e6c06cea0 2024-05-28T06:06:01.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.173+0000 7f4e62000640 1 -- 172.21.15.122:0/3524425621 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4e5c01a070 con 0x7f4e6c06cea0 2024-05-28T06:06:01.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.173+0000 7f4e62000640 1 --2- 172.21.15.122:0/3524425621 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4e4c068380 0x7f4e4c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:01.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.173+0000 7f4e62000640 1 -- 172.21.15.122:0/3524425621 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4e5c085fb0 con 0x7f4e6c06cea0 2024-05-28T06:06:01.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.177+0000 7f4e69400640 1 --2- 172.21.15.122:0/3524425621 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4e4c068380 0x7f4e4c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:01.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.177+0000 7f4e69400640 1 --2- 172.21.15.122:0/3524425621 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4e4c068380 0x7f4e4c06a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4e580af000 tx=0x7f4e580a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:01.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.177+0000 7f4e62000640 1 -- 172.21.15.122:0/3524425621 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4e5c055e80 con 0x7f4e6c06cea0 2024-05-28T06:06:01.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.341+0000 7f4e70a00640 1 -- 172.21.15.122:0/3524425621 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e6c1618e0 con 0x7f4e6c06cea0 2024-05-28T06:06:01.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.341+0000 7f4e62000640 1 -- 172.21.15.122:0/3524425621 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f4e5c05a180 con 0x7f4e6c06cea0 2024-05-28T06:06:01.344 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:01.344 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":20,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:05:50.822555+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:05:47.441193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-28T06:05:48.148164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:06:01.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.341+0000 7f4e70a00640 1 -- 172.21.15.122:0/3524425621 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4e4c068380 msgr2=0x7f4e4c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:01.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.341+0000 7f4e70a00640 1 --2- 172.21.15.122:0/3524425621 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4e4c068380 0x7f4e4c06a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4e580af000 tx=0x7f4e580a7000 comp rx=0 tx=0).stop 2024-05-28T06:06:01.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.341+0000 7f4e70a00640 1 -- 172.21.15.122:0/3524425621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e6c06cea0 msgr2=0x7f4e6c14c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:01.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.341+0000 7f4e70a00640 1 --2- 172.21.15.122:0/3524425621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e6c06cea0 0x7f4e6c14c1a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00c780 tx=0x7f4e5c00cc40 comp rx=0 tx=0).stop 2024-05-28T06:06:01.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.341+0000 7f4e70a00640 1 -- 172.21.15.122:0/3524425621 shutdown_connections 2024-05-28T06:06:01.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.341+0000 7f4e70a00640 1 --2- 172.21.15.122:0/3524425621 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4e4c068380 0x7f4e4c06a840 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.341+0000 7f4e70a00640 1 --2- 172.21.15.122:0/3524425621 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6c15e7a0 0x7f4e6c15c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.341+0000 7f4e70a00640 1 --2- 172.21.15.122:0/3524425621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e6c0b4100 0x7f4e6c16a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.341+0000 7f4e70a00640 1 --2- 172.21.15.122:0/3524425621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e6c06cea0 0x7f4e6c14c1a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.341+0000 7f4e70a00640 1 -- 172.21.15.122:0/3524425621 >> 172.21.15.122:0/3524425621 conn(0x7f4e6c0b3130 msgr2=0x7f4e6c0b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:01.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.341+0000 7f4e70a00640 1 -- 172.21.15.122:0/3524425621 shutdown_connections 2024-05-28T06:06:01.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.341+0000 7f4e70a00640 1 -- 172.21.15.122:0/3524425621 wait complete. 2024-05-28T06:06:01.366 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-28T06:05:47.441193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-28T06:05:48.148164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:06:01.366 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:06:01.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.501+0000 7fb2da000640 1 Processor -- start 2024-05-28T06:06:01.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.501+0000 7fb2da000640 1 -- start start 2024-05-28T06:06:01.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.501+0000 7fb2da000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb2d4161ff0 0x7fb2d40d1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:01.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.501+0000 7fb2da000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2d406cc60 0x7fb2d409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:01.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.501+0000 7fb2da000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb2d409af80 0x7fb2d406d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:01.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.501+0000 7fb2da000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fb2d40ccb80 con 0x7fb2d409af80 2024-05-28T06:06:01.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.501+0000 7fb2da000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb2d40cce60 con 0x7fb2d4161ff0 2024-05-28T06:06:01.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.501+0000 7fb2da000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb2d40cd140 con 0x7fb2d406cc60 2024-05-28T06:06:01.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.505+0000 7fb2d9600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb2d409af80 0x7fb2d406d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:01.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.505+0000 7fb2d9600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb2d409af80 0x7fb2d406d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41696/0 (socket says 172.21.15.122:41696) 2024-05-28T06:06:01.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.505+0000 7fb2d9600640 1 -- 172.21.15.122:0/2209454808 learned_addr learned my addr 172.21.15.122:0/2209454808 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:01.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.505+0000 7fb2d8c00640 1 --2- 172.21.15.122:0/2209454808 >> v2:172.21.15.153:3300/0 conn(0x7fb2d4161ff0 0x7fb2d40d1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:01.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.505+0000 7fb2cbe00640 1 --2- 172.21.15.122:0/2209454808 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2d406cc60 0x7fb2d409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:01.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.505+0000 7fb2d9600640 1 -- 172.21.15.122:0/2209454808 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2d406cc60 msgr2=0x7fb2d409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:01.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.505+0000 7fb2d9600640 1 --2- 172.21.15.122:0/2209454808 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2d406cc60 0x7fb2d409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.505+0000 7fb2d9600640 1 -- 172.21.15.122:0/2209454808 >> v2:172.21.15.153:3300/0 conn(0x7fb2d4161ff0 msgr2=0x7fb2d40d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:01.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.505+0000 7fb2d9600640 1 --2- 172.21.15.122:0/2209454808 >> v2:172.21.15.153:3300/0 conn(0x7fb2d4161ff0 0x7fb2d40d1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.505+0000 7fb2d9600640 1 -- 172.21.15.122:0/2209454808 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d40cd420 con 0x7fb2d409af80 2024-05-28T06:06:01.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.505+0000 7fb2d9600640 1 --2- 172.21.15.122:0/2209454808 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2d409af80 0x7fb2d406d160 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40732b0 tx=0x7fb2cc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05876739e324b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:01.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.505+0000 7fb2d3e00640 1 -- 172.21.15.122:0/2209454808 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc0a5670 con 0x7fb2d409af80 2024-05-28T06:06:01.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.505+0000 7fb2d3e00640 1 -- 172.21.15.122:0/2209454808 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2cc0a5810 con 0x7fb2d409af80 2024-05-28T06:06:01.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.505+0000 7fb2d3e00640 1 -- 172.21.15.122:0/2209454808 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc0a5be0 con 0x7fb2d409af80 2024-05-28T06:06:01.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2da000640 1 -- 172.21.15.122:0/2209454808 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2d409af80 msgr2=0x7fb2d406d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:01.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2da000640 1 --2- 172.21.15.122:0/2209454808 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2d409af80 0x7fb2d406d160 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40732b0 tx=0x7fb2cc01c9f0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2da000640 1 -- 172.21.15.122:0/2209454808 shutdown_connections 2024-05-28T06:06:01.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2da000640 1 --2- 172.21.15.122:0/2209454808 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2d409af80 0x7fb2d406d160 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2da000640 1 --2- 172.21.15.122:0/2209454808 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2d406cc60 0x7fb2d409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2da000640 1 --2- 172.21.15.122:0/2209454808 >> v2:172.21.15.153:3300/0 conn(0x7fb2d4161ff0 0x7fb2d40d1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2da000640 1 -- 172.21.15.122:0/2209454808 >> 172.21.15.122:0/2209454808 conn(0x7fb2d40b3f80 msgr2=0x7fb2d40b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:01.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2da000640 1 -- 172.21.15.122:0/2209454808 shutdown_connections 2024-05-28T06:06:01.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2da000640 1 -- 172.21.15.122:0/2209454808 wait complete. 2024-05-28T06:06:01.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2da000640 1 Processor -- start 2024-05-28T06:06:01.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2da000640 1 -- start start 2024-05-28T06:06:01.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2da000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2d406cc60 0x7fb2d414f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:01.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2da000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2d409af80 0x7fb2d414dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:01.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2da000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2d4161ff0 0x7fb2d40c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:01.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2da000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d40cdcd0 con 0x7fb2d409af80 2024-05-28T06:06:01.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2da000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d40cdb50 con 0x7fb2d4161ff0 2024-05-28T06:06:01.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2da000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb2d40cde50 con 0x7fb2d406cc60 2024-05-28T06:06:01.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2cbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2d409af80 0x7fb2d414dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:01.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2cbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2d409af80 0x7fb2d414dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41712/0 (socket says 172.21.15.122:41712) 2024-05-28T06:06:01.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2cbe00640 1 -- 172.21.15.122:0/1589407299 learned_addr learned my addr 172.21.15.122:0/1589407299 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:01.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2d8c00640 1 --2- 172.21.15.122:0/1589407299 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2d406cc60 0x7fb2d414f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:01.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2d9600640 1 --2- 172.21.15.122:0/1589407299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2d4161ff0 0x7fb2d40c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:01.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2cbe00640 1 -- 172.21.15.122:0/1589407299 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2d406cc60 msgr2=0x7fb2d414f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:01.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2cbe00640 1 --2- 172.21.15.122:0/1589407299 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2d406cc60 0x7fb2d414f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2cbe00640 1 -- 172.21.15.122:0/1589407299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2d4161ff0 msgr2=0x7fb2d40c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:01.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2cbe00640 1 --2- 172.21.15.122:0/1589407299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2d4161ff0 0x7fb2d40c9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.516 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2cbe00640 1 -- 172.21.15.122:0/1589407299 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d40af760 con 0x7fb2d409af80 2024-05-28T06:06:01.516 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.509+0000 7fb2cbe00640 1 --2- 172.21.15.122:0/1589407299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2d409af80 0x7fb2d414dfb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc00d800 tx=0x7fb2bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:01.516 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.513+0000 7fb2d1600640 1 -- 172.21.15.122:0/1589407299 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc018020 con 0x7fb2d409af80 2024-05-28T06:06:01.516 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.513+0000 7fb2d1600640 1 -- 172.21.15.122:0/1589407299 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2bc0096a0 con 0x7fb2d409af80 2024-05-28T06:06:01.516 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.513+0000 7fb2d1600640 1 -- 172.21.15.122:0/1589407299 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc009a50 con 0x7fb2d409af80 2024-05-28T06:06:01.516 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.513+0000 7fb2da000640 1 -- 172.21.15.122:0/1589407299 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d40afa40 con 0x7fb2d409af80 2024-05-28T06:06:01.516 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.513+0000 7fb2da000640 1 -- 172.21.15.122:0/1589407299 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d40ca820 con 0x7fb2d409af80 2024-05-28T06:06:01.516 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.513+0000 7fb2da000640 1 -- 172.21.15.122:0/1589407299 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2d4075620 con 0x7fb2d409af80 2024-05-28T06:06:01.517 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.513+0000 7fb2d1600640 1 -- 172.21.15.122:0/1589407299 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb2bc01b020 con 0x7fb2d409af80 2024-05-28T06:06:01.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.513+0000 7fb2d1600640 1 --2- 172.21.15.122:0/1589407299 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb2b0068380 0x7fb2b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:01.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.513+0000 7fb2d1600640 1 -- 172.21.15.122:0/1589407299 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb2bc086ed0 con 0x7fb2d409af80 2024-05-28T06:06:01.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.513+0000 7fb2d8c00640 1 --2- 172.21.15.122:0/1589407299 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb2b0068380 0x7fb2b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:01.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.517+0000 7fb2d8c00640 1 --2- 172.21.15.122:0/1589407299 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb2b0068380 0x7fb2b006a840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4152710 tx=0x7fb2c4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:01.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.517+0000 7fb2d1600640 1 -- 172.21.15.122:0/1589407299 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb2bc022020 con 0x7fb2d409af80 2024-05-28T06:06:01.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.677+0000 7fb2da000640 1 -- 172.21.15.122:0/1589407299 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb2d40b1600 con 0x7fb2d409af80 2024-05-28T06:06:01.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.677+0000 7fb2d1600640 1 -- 172.21.15.122:0/1589407299 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fb2bc056da0 con 0x7fb2d409af80 2024-05-28T06:06:01.680 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:06:01.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.677+0000 7fb2da000640 1 -- 172.21.15.122:0/1589407299 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb2b0068380 msgr2=0x7fb2b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:01.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.677+0000 7fb2da000640 1 --2- 172.21.15.122:0/1589407299 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb2b0068380 0x7fb2b006a840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4152710 tx=0x7fb2c4009190 comp rx=0 tx=0).stop 2024-05-28T06:06:01.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.677+0000 7fb2da000640 1 -- 172.21.15.122:0/1589407299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2d409af80 msgr2=0x7fb2d414dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:01.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.677+0000 7fb2da000640 1 --2- 172.21.15.122:0/1589407299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2d409af80 0x7fb2d414dfb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc00d800 tx=0x7fb2bc00dcc0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.677+0000 7fb2da000640 1 -- 172.21.15.122:0/1589407299 shutdown_connections 2024-05-28T06:06:01.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.677+0000 7fb2da000640 1 --2- 172.21.15.122:0/1589407299 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb2b0068380 0x7fb2b006a840 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.677+0000 7fb2da000640 1 --2- 172.21.15.122:0/1589407299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2d4161ff0 0x7fb2d40c9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.677+0000 7fb2da000640 1 --2- 172.21.15.122:0/1589407299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2d409af80 0x7fb2d414dfb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.677+0000 7fb2da000640 1 --2- 172.21.15.122:0/1589407299 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2d406cc60 0x7fb2d414f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.677+0000 7fb2da000640 1 -- 172.21.15.122:0/1589407299 >> 172.21.15.122:0/1589407299 conn(0x7fb2d40b3f80 msgr2=0x7fb2d415c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:01.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.677+0000 7fb2da000640 1 -- 172.21.15.122:0/1589407299 shutdown_connections 2024-05-28T06:06:01.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.681+0000 7fb2da000640 1 -- 172.21.15.122:0/1589407299 wait complete. 2024-05-28T06:06:01.701 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-28T06:06:01.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7db6800640 1 Processor -- start 2024-05-28T06:06:01.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7db6800640 1 -- start start 2024-05-28T06:06:01.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7db6800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7db00b58d0 0x7f7db00b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:01.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7db6800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db00b61f0 con 0x7f7db00ce4f0 2024-05-28T06:06:01.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7db6800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db015d970 con 0x7f7db015e730 2024-05-28T06:06:01.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7db6800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7db015dc50 con 0x7f7db00b58d0 2024-05-28T06:06:01.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7da6a00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f7db00ce4f0 0x7f7db00ce980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38688/0 (socket says 172.21.15.122:38688) 2024-05-28T06:06:01.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7da6a00640 1 -- 172.21.15.122:0/1258802289 learned_addr learned my addr 172.21.15.122:0/1258802289 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:01.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7daf400640 1 --2- 172.21.15.122:0/1258802289 >> v2:172.21.15.153:3300/0 conn(0x7f7db00b58d0 0x7f7db00b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:01.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7daea00640 1 -- 172.21.15.122:0/1258802289 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1107585404 0 0) 0x7f7db00b61f0 con 0x7f7db00ce4f0 2024-05-28T06:06:01.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7daea00640 1 -- 172.21.15.122:0/1258802289 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d94003530 con 0x7f7db00ce4f0 2024-05-28T06:06:01.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7daea00640 1 -- 172.21.15.122:0/1258802289 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4165454983 0 0) 0x7f7d94003530 con 0x7f7db00ce4f0 2024-05-28T06:06:01.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7daea00640 1 -- 172.21.15.122:0/1258802289 >> v2:172.21.15.153:3300/0 conn(0x7f7db00b58d0 msgr2=0x7f7db00b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:01.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7daea00640 1 --2- 172.21.15.122:0/1258802289 >> v2:172.21.15.153:3300/0 conn(0x7f7db00b58d0 0x7f7db00b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7daea00640 1 -- 172.21.15.122:0/1258802289 >> v1:172.21.15.153:6789/0 conn(0x7f7db015e730 legacy=0x7f7db015eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:01.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7daea00640 1 -- 172.21.15.122:0/1258802289 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db015df30 con 0x7f7db00ce4f0 2024-05-28T06:06:01.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7daea00640 1 -- 172.21.15.122:0/1258802289 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f7d98001680 con 0x7f7db00ce4f0 2024-05-28T06:06:01.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7daea00640 1 -- 172.21.15.122:0/1258802289 >> v1:172.21.15.122:6789/0 conn(0x7f7db00ce4f0 legacy=0x7f7db00ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:01.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7daea00640 1 --2- 172.21.15.122:0/1258802289 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d940039c0 0x7f7d94003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:01.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7daea00640 1 --2- 172.21.15.122:0/1258802289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d94004810 0x7f7d94004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:01.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7daea00640 1 --2- 172.21.15.122:0/1258802289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d940051d0 0x7f7d9400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:01.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7daea00640 1 -- 172.21.15.122:0/1258802289 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7db015dc50 con 0x7f7d940051d0 2024-05-28T06:06:01.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7daea00640 1 -- 172.21.15.122:0/1258802289 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9400c070 con 0x7f7d94004810 2024-05-28T06:06:01.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7daea00640 1 -- 172.21.15.122:0/1258802289 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7d9400c270 con 0x7f7d940039c0 2024-05-28T06:06:01.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7dafe00640 1 --2- 172.21.15.122:0/1258802289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d940051d0 0x7f7d9400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:01.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7daf400640 1 --2- 172.21.15.122:0/1258802289 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d940039c0 0x7f7d94003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:01.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.837+0000 7f7da6a00640 1 --2- 172.21.15.122:0/1258802289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d94004810 0x7f7d94004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:01.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.841+0000 7f7dafe00640 1 -- 172.21.15.122:0/1258802289 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d940039c0 msgr2=0x7f7d94003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:01.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.841+0000 7f7dafe00640 1 --2- 172.21.15.122:0/1258802289 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d940039c0 0x7f7d94003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.841+0000 7f7dafe00640 1 -- 172.21.15.122:0/1258802289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d94004810 msgr2=0x7f7d94004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:01.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.841+0000 7f7dafe00640 1 --2- 172.21.15.122:0/1258802289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d94004810 0x7f7d94004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.841+0000 7f7dafe00640 1 -- 172.21.15.122:0/1258802289 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d94003530 con 0x7f7d940051d0 2024-05-28T06:06:01.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.841+0000 7f7dafe00640 1 -- 172.21.15.122:0/1258802289 reap_dead start 2024-05-28T06:06:01.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.841+0000 7f7dafe00640 1 --2- 172.21.15.122:0/1258802289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d940051d0 0x7f7d9400b9d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7da8001e70 tx=0x7f7da801c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8af4eedf8135504 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:01.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.841+0000 7f7daea00640 1 -- 172.21.15.122:0/1258802289 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8001a90 con 0x7f7d940051d0 2024-05-28T06:06:01.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.841+0000 7f7daea00640 1 -- 172.21.15.122:0/1258802289 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da8003ba0 con 0x7f7d940051d0 2024-05-28T06:06:01.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.841+0000 7f7daea00640 1 -- 172.21.15.122:0/1258802289 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8005020 con 0x7f7d940051d0 2024-05-28T06:06:01.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.841+0000 7f7db6800640 1 -- 172.21.15.122:0/1258802289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d940051d0 msgr2=0x7f7d9400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:01.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.841+0000 7f7db6800640 1 --2- 172.21.15.122:0/1258802289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d940051d0 0x7f7d9400b9d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7da8001e70 tx=0x7f7da801c780 comp rx=0 tx=0).stop 2024-05-28T06:06:01.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.841+0000 7f7db6800640 1 -- 172.21.15.122:0/1258802289 shutdown_connections 2024-05-28T06:06:01.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.841+0000 7f7db6800640 1 --2- 172.21.15.122:0/1258802289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d940051d0 0x7f7d9400b9d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.841+0000 7f7db6800640 1 -- 172.21.15.122:0/1258802289 >> 172.21.15.122:0/1258802289 conn(0x7f7db006bd90 msgr2=0x7f7db006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:01.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.841+0000 7f7db6800640 1 -- 172.21.15.122:0/1258802289 shutdown_connections 2024-05-28T06:06:01.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7db6800640 1 -- 172.21.15.122:0/1258802289 wait complete. 2024-05-28T06:06:01.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7db6800640 1 Processor -- start 2024-05-28T06:06:01.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7db6800640 1 -- start start 2024-05-28T06:06:01.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7db6800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d940051d0 0x7f7db01f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:01.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7db6800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7db00b45a0 0x7f7db0141b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:01.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7db6800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7db00b4a00 0x7f7db01420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:01.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7db6800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7db0146260 con 0x7f7db00b4a00 2024-05-28T06:06:01.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7db6800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7db015d640 con 0x7f7d940051d0 2024-05-28T06:06:01.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7db6800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7db0139960 con 0x7f7db00b45a0 2024-05-28T06:06:01.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7dafe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7db00b4a00 0x7f7db01420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:01.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7dafe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7db00b4a00 0x7f7db01420d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41730/0 (socket says 172.21.15.122:41730) 2024-05-28T06:06:01.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7dafe00640 1 -- 172.21.15.122:0/1392599532 learned_addr learned my addr 172.21.15.122:0/1392599532 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:01.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7da6a00640 1 --2- 172.21.15.122:0/1392599532 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7db00b45a0 0x7f7db0141b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:01.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7daf400640 1 --2- 172.21.15.122:0/1392599532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d940051d0 0x7f7db01f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:01.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7dafe00640 1 -- 172.21.15.122:0/1392599532 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7db00b45a0 msgr2=0x7f7db0141b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:01.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7dafe00640 1 --2- 172.21.15.122:0/1392599532 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7db00b45a0 0x7f7db0141b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7dafe00640 1 -- 172.21.15.122:0/1392599532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d940051d0 msgr2=0x7f7db01f47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:01.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7dafe00640 1 --2- 172.21.15.122:0/1392599532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d940051d0 0x7f7db01f47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:01.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7dafe00640 1 -- 172.21.15.122:0/1392599532 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db0139c40 con 0x7f7db00b4a00 2024-05-28T06:06:01.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7dafe00640 1 --2- 172.21.15.122:0/1392599532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7db00b4a00 0x7f7db01420d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7da801d020 tx=0x7f7d94005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:01.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7da7e00640 1 -- 172.21.15.122:0/1392599532 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8007dc0 con 0x7f7db00b4a00 2024-05-28T06:06:01.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7da7e00640 1 -- 172.21.15.122:0/1392599532 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da8005830 con 0x7f7db00b4a00 2024-05-28T06:06:01.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7db6800640 1 -- 172.21.15.122:0/1392599532 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7db0139f20 con 0x7f7db00b4a00 2024-05-28T06:06:01.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7da7e00640 1 -- 172.21.15.122:0/1392599532 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8001a90 con 0x7f7db00b4a00 2024-05-28T06:06:01.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.845+0000 7f7db6800640 1 -- 172.21.15.122:0/1392599532 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7db013a4e0 con 0x7f7db00b4a00 2024-05-28T06:06:01.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.849+0000 7f7db6800640 1 -- 172.21.15.122:0/1392599532 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7db0068c40 con 0x7f7db00b4a00 2024-05-28T06:06:01.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.849+0000 7f7da7e00640 1 -- 172.21.15.122:0/1392599532 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7da80a6480 con 0x7f7db00b4a00 2024-05-28T06:06:01.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.849+0000 7f7da7e00640 1 --2- 172.21.15.122:0/1392599532 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7d8c068380 0x7f7d8c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:01.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.849+0000 7f7da7e00640 1 -- 172.21.15.122:0/1392599532 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7da8120090 con 0x7f7db00b4a00 2024-05-28T06:06:01.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.849+0000 7f7daf400640 1 --2- 172.21.15.122:0/1392599532 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7d8c068380 0x7f7d8c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:01.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.849+0000 7f7daf400640 1 --2- 172.21.15.122:0/1392599532 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7d8c068380 0x7f7d8c06a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7da0009ac0 tx=0x7f7da0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:01.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:01.853+0000 7f7da7e00640 1 -- 172.21.15.122:0/1392599532 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7da80b7060 con 0x7f7db00b4a00 2024-05-28T06:06:02.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.013+0000 7f7db6800640 1 -- 172.21.15.122:0/1392599532 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7db01429d0 con 0x7f7db00b4a00 2024-05-28T06:06:02.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.013+0000 7f7da7e00640 1 -- 172.21.15.122:0/1392599532 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f7da8016490 con 0x7f7db00b4a00 2024-05-28T06:06:02.015 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 32 2024-05-28T06:06:02.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.013+0000 7f7db6800640 1 -- 172.21.15.122:0/1392599532 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7d8c068380 msgr2=0x7f7d8c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:02.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.013+0000 7f7db6800640 1 --2- 172.21.15.122:0/1392599532 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7d8c068380 0x7f7d8c06a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7da0009ac0 tx=0x7f7da0009190 comp rx=0 tx=0).stop 2024-05-28T06:06:02.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.013+0000 7f7db6800640 1 -- 172.21.15.122:0/1392599532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7db00b4a00 msgr2=0x7f7db01420d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:02.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.013+0000 7f7db6800640 1 --2- 172.21.15.122:0/1392599532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7db00b4a00 0x7f7db01420d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7da801d020 tx=0x7f7d94005840 comp rx=0 tx=0).stop 2024-05-28T06:06:02.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.013+0000 7f7db6800640 1 -- 172.21.15.122:0/1392599532 shutdown_connections 2024-05-28T06:06:02.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.013+0000 7f7db6800640 1 --2- 172.21.15.122:0/1392599532 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7d8c068380 0x7f7d8c06a840 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.013+0000 7f7db6800640 1 --2- 172.21.15.122:0/1392599532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7db00b4a00 0x7f7db01420d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.013+0000 7f7db6800640 1 --2- 172.21.15.122:0/1392599532 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7db00b45a0 0x7f7db0141b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.013+0000 7f7db6800640 1 --2- 172.21.15.122:0/1392599532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d940051d0 0x7f7db01f47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.013+0000 7f7db6800640 1 -- 172.21.15.122:0/1392599532 >> 172.21.15.122:0/1392599532 conn(0x7f7db006bd90 msgr2=0x7f7db01453f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:02.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.013+0000 7f7db6800640 1 -- 172.21.15.122:0/1392599532 shutdown_connections 2024-05-28T06:06:02.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.013+0000 7f7db6800640 1 -- 172.21.15.122:0/1392599532 wait complete. 2024-05-28T06:06:02.036 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-28T06:06:02.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.173+0000 7f815b600640 1 Processor -- start 2024-05-28T06:06:02.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.173+0000 7f815b600640 1 -- start start 2024-05-28T06:06:02.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.173+0000 7f815b600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f815415ea50 0x7f815415ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:02.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.173+0000 7f815b600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f815415f370 0x7f815415f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:02.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.173+0000 7f815b600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f815406caa0 0x7f815406cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:02.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.173+0000 7f815b600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f8154163120 con 0x7f815406caa0 2024-05-28T06:06:02.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.173+0000 7f815b600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8154162510 con 0x7f815415ea50 2024-05-28T06:06:02.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.173+0000 7f815b600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f81541627f0 con 0x7f815415f370 2024-05-28T06:06:02.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.173+0000 7f8159600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f815406caa0 0x7f815406cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:02.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.173+0000 7f8159600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f815406caa0 0x7f815406cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41736/0 (socket says 172.21.15.122:41736) 2024-05-28T06:06:02.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.173+0000 7f8159600640 1 -- 172.21.15.122:0/4135923893 learned_addr learned my addr 172.21.15.122:0/4135923893 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:02.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.173+0000 7f814be00640 1 --2- 172.21.15.122:0/4135923893 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f815415f370 0x7f815415f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:02.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.173+0000 7f8158c00640 1 --2- 172.21.15.122:0/4135923893 >> v2:172.21.15.153:3300/0 conn(0x7f815415ea50 0x7f815415ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:02.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.173+0000 7f8159600640 1 -- 172.21.15.122:0/4135923893 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f815415f370 msgr2=0x7f815415f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:02.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.173+0000 7f8159600640 1 --2- 172.21.15.122:0/4135923893 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f815415f370 0x7f815415f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.173+0000 7f8159600640 1 -- 172.21.15.122:0/4135923893 >> v2:172.21.15.153:3300/0 conn(0x7f815415ea50 msgr2=0x7f815415ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:02.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.173+0000 7f8159600640 1 --2- 172.21.15.122:0/4135923893 >> v2:172.21.15.153:3300/0 conn(0x7f815415ea50 0x7f815415ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.173+0000 7f8159600640 1 -- 172.21.15.122:0/4135923893 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8154162ad0 con 0x7f815406caa0 2024-05-28T06:06:02.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.173+0000 7f814be00640 1 --2- 172.21.15.122:0/4135923893 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f815415f370 0x7f815415f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:02.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.177+0000 7f8159600640 1 --2- 172.21.15.122:0/4135923893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f815406caa0 0x7f815406cf30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8154073060 tx=0x7f814c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb70c81c650441ca server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:02.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.177+0000 7f8153e00640 1 -- 172.21.15.122:0/4135923893 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814c0a5800 con 0x7f815406caa0 2024-05-28T06:06:02.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.177+0000 7f8153e00640 1 -- 172.21.15.122:0/4135923893 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f814c0a59a0 con 0x7f815406caa0 2024-05-28T06:06:02.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.177+0000 7f8153e00640 1 -- 172.21.15.122:0/4135923893 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814c0a5d70 con 0x7f815406caa0 2024-05-28T06:06:02.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.177+0000 7f815b600640 1 -- 172.21.15.122:0/4135923893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f815406caa0 msgr2=0x7f815406cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:02.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.177+0000 7f815b600640 1 --2- 172.21.15.122:0/4135923893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f815406caa0 0x7f815406cf30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8154073060 tx=0x7f814c01c9c0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.177+0000 7f815b600640 1 -- 172.21.15.122:0/4135923893 shutdown_connections 2024-05-28T06:06:02.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.177+0000 7f815b600640 1 --2- 172.21.15.122:0/4135923893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f815406caa0 0x7f815406cf30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.177+0000 7f815b600640 1 --2- 172.21.15.122:0/4135923893 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f815415f370 0x7f815415f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.177+0000 7f815b600640 1 --2- 172.21.15.122:0/4135923893 >> v2:172.21.15.153:3300/0 conn(0x7f815415ea50 0x7f815415ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.177+0000 7f815b600640 1 -- 172.21.15.122:0/4135923893 >> 172.21.15.122:0/4135923893 conn(0x7f81540b4190 msgr2=0x7f81540b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:02.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.177+0000 7f815b600640 1 -- 172.21.15.122:0/4135923893 shutdown_connections 2024-05-28T06:06:02.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.177+0000 7f815b600640 1 -- 172.21.15.122:0/4135923893 wait complete. 2024-05-28T06:06:02.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f815b600640 1 Processor -- start 2024-05-28T06:06:02.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f815b600640 1 -- start start 2024-05-28T06:06:02.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f815b600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f815406caa0 0x7f8154156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:02.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f815b600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f815415ea50 0x7f81540b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:02.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f815b600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f815415f370 0x7f81540b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:02.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f815b600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f81540d0a60 con 0x7f815406caa0 2024-05-28T06:06:02.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f815b600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f81540d08e0 con 0x7f815415f370 2024-05-28T06:06:02.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f815b600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f81540d0be0 con 0x7f815415ea50 2024-05-28T06:06:02.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f8158c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f815406caa0 0x7f8154156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:02.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f8158c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f815406caa0 0x7f8154156d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41746/0 (socket says 172.21.15.122:41746) 2024-05-28T06:06:02.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f8158c00640 1 -- 172.21.15.122:0/1405991856 learned_addr learned my addr 172.21.15.122:0/1405991856 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:02.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f8158c00640 1 -- 172.21.15.122:0/1405991856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f815415ea50 msgr2=0x7f81540b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:02.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f814be00640 1 --2- 172.21.15.122:0/1405991856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f815415ea50 0x7f81540b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:02.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f8159600640 1 --2- 172.21.15.122:0/1405991856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f815415f370 0x7f81540b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:02.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f8158c00640 1 --2- 172.21.15.122:0/1405991856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f815415ea50 0x7f81540b09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f8158c00640 1 -- 172.21.15.122:0/1405991856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f815415f370 msgr2=0x7f81540b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:02.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f8158c00640 1 --2- 172.21.15.122:0/1405991856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f815415f370 0x7f81540b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f8158c00640 1 -- 172.21.15.122:0/1405991856 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8154161670 con 0x7f815406caa0 2024-05-28T06:06:02.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f814be00640 1 --2- 172.21.15.122:0/1405991856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f815415ea50 0x7f81540b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:02.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f8159600640 1 --2- 172.21.15.122:0/1405991856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f815415f370 0x7f81540b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:02.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f8158c00640 1 --2- 172.21.15.122:0/1405991856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f815406caa0 0x7f8154156d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f813c00d800 tx=0x7f813c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:02.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f8151600640 1 -- 172.21.15.122:0/1405991856 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813c00b6c0 con 0x7f815406caa0 2024-05-28T06:06:02.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f8151600640 1 -- 172.21.15.122:0/1405991856 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f813c019070 con 0x7f815406caa0 2024-05-28T06:06:02.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f815b600640 1 -- 172.21.15.122:0/1405991856 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81541572d0 con 0x7f815406caa0 2024-05-28T06:06:02.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f8151600640 1 -- 172.21.15.122:0/1405991856 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813c00ba60 con 0x7f815406caa0 2024-05-28T06:06:02.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.181+0000 7f815b600640 1 -- 172.21.15.122:0/1405991856 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81540af3a0 con 0x7f815406caa0 2024-05-28T06:06:02.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.185+0000 7f815b600640 1 -- 172.21.15.122:0/1405991856 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8154068c40 con 0x7f815406caa0 2024-05-28T06:06:02.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.185+0000 7f8151600640 1 -- 172.21.15.122:0/1405991856 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f813c00bc00 con 0x7f815406caa0 2024-05-28T06:06:02.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.185+0000 7f8151600640 1 --2- 172.21.15.122:0/1405991856 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f812c068380 0x7f812c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:02.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.185+0000 7f8151600640 1 -- 172.21.15.122:0/1405991856 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f813c086ed0 con 0x7f815406caa0 2024-05-28T06:06:02.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.185+0000 7f814be00640 1 --2- 172.21.15.122:0/1405991856 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f812c068380 0x7f812c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:02.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.185+0000 7f814be00640 1 --2- 172.21.15.122:0/1405991856 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f812c068380 0x7f812c06a840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f815415e2e0 tx=0x7f8134008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:02.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.189+0000 7f8151600640 1 -- 172.21.15.122:0/1405991856 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f813c057400 con 0x7f815406caa0 2024-05-28T06:06:02.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.349+0000 7f815b600640 1 -- 172.21.15.122:0/1405991856 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f81540b4ea0 con 0x7f815406caa0 2024-05-28T06:06:02.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.349+0000 7f8151600640 1 -- 172.21.15.122:0/1405991856 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f813c056d00 con 0x7f815406caa0 2024-05-28T06:06:02.351 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 64 2024-05-28T06:06:02.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.349+0000 7f815b600640 1 -- 172.21.15.122:0/1405991856 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f812c068380 msgr2=0x7f812c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:02.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.349+0000 7f815b600640 1 --2- 172.21.15.122:0/1405991856 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f812c068380 0x7f812c06a840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f815415e2e0 tx=0x7f8134008040 comp rx=0 tx=0).stop 2024-05-28T06:06:02.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.349+0000 7f815b600640 1 -- 172.21.15.122:0/1405991856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f815406caa0 msgr2=0x7f8154156d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:02.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.349+0000 7f815b600640 1 --2- 172.21.15.122:0/1405991856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f815406caa0 0x7f8154156d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f813c00d800 tx=0x7f813c00dcc0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.349+0000 7f815b600640 1 -- 172.21.15.122:0/1405991856 shutdown_connections 2024-05-28T06:06:02.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.349+0000 7f815b600640 1 --2- 172.21.15.122:0/1405991856 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f812c068380 0x7f812c06a840 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.349+0000 7f815b600640 1 --2- 172.21.15.122:0/1405991856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f815415f370 0x7f81540b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.349+0000 7f815b600640 1 --2- 172.21.15.122:0/1405991856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f815415ea50 0x7f81540b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.349+0000 7f815b600640 1 --2- 172.21.15.122:0/1405991856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f815406caa0 0x7f8154156d90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.349+0000 7f815b600640 1 -- 172.21.15.122:0/1405991856 >> 172.21.15.122:0/1405991856 conn(0x7f81540b4190 msgr2=0x7f8154157cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:02.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.349+0000 7f815b600640 1 -- 172.21.15.122:0/1405991856 shutdown_connections 2024-05-28T06:06:02.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.349+0000 7f815b600640 1 -- 172.21.15.122:0/1405991856 wait complete. 2024-05-28T06:06:02.372 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:06:02.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.505+0000 7f1356a00640 1 Processor -- start 2024-05-28T06:06:02.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.505+0000 7f1356a00640 1 -- start start 2024-05-28T06:06:02.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.505+0000 7f1356a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f13500d0c80 0x7f135009b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:02.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.505+0000 7f1356a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f135015d7e0 0x7f13500cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:02.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.505+0000 7f1356a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f135015dc70 con 0x7f13500d0270 2024-05-28T06:06:02.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.505+0000 7f1356a00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f13500d0830 con 0x7f135015d7e0 2024-05-28T06:06:02.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.505+0000 7f1356a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f135009aa40 con 0x7f13500d0c80 2024-05-28T06:06:02.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.505+0000 7f1354a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f135015d7e0 0x7f13500cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:02.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.505+0000 7f1354a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f135015d7e0 0x7f13500cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41748/0 (socket says 172.21.15.122:41748) 2024-05-28T06:06:02.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.505+0000 7f1354a00640 1 -- 172.21.15.122:0/1000310974 learned_addr learned my addr 172.21.15.122:0/1000310974 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:02.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.505+0000 7f1354a00640 1 -- 172.21.15.122:0/1000310974 >> v2:172.21.15.153:3300/0 conn(0x7f13500d0c80 msgr2=0x7f135009b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:02.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.505+0000 7f1354a00640 1 --2- 172.21.15.122:0/1000310974 >> v2:172.21.15.153:3300/0 conn(0x7f13500d0c80 0x7f135009b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.505+0000 7f1354a00640 1 -- 172.21.15.122:0/1000310974 >> v1:172.21.15.153:6789/0 conn(0x7f13500d0270 legacy=0x7f13500d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:02.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.505+0000 7f1354a00640 1 -- 172.21.15.122:0/1000310974 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f135009ad20 con 0x7f135015d7e0 2024-05-28T06:06:02.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.509+0000 7f1354a00640 1 --2- 172.21.15.122:0/1000310974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f135015d7e0 0x7f13500cd1b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1350073060 tx=0x7f134801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe2206f6df8de46 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:02.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.509+0000 7f134f400640 1 -- 172.21.15.122:0/1000310974 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13480a5700 con 0x7f135015d7e0 2024-05-28T06:06:02.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.509+0000 7f134f400640 1 -- 172.21.15.122:0/1000310974 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13480a58a0 con 0x7f135015d7e0 2024-05-28T06:06:02.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.509+0000 7f134f400640 1 -- 172.21.15.122:0/1000310974 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13480a5c70 con 0x7f135015d7e0 2024-05-28T06:06:02.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.509+0000 7f1356a00640 1 -- 172.21.15.122:0/1000310974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f135015d7e0 msgr2=0x7f13500cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:02.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.509+0000 7f1356a00640 1 --2- 172.21.15.122:0/1000310974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f135015d7e0 0x7f13500cd1b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1350073060 tx=0x7f134801c930 comp rx=0 tx=0).stop 2024-05-28T06:06:02.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.509+0000 7f1356a00640 1 -- 172.21.15.122:0/1000310974 shutdown_connections 2024-05-28T06:06:02.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.509+0000 7f1356a00640 1 --2- 172.21.15.122:0/1000310974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f135015d7e0 0x7f13500cd1b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.509+0000 7f1356a00640 1 --2- 172.21.15.122:0/1000310974 >> v2:172.21.15.153:3300/0 conn(0x7f13500d0c80 0x7f135009b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.509+0000 7f1356a00640 1 -- 172.21.15.122:0/1000310974 >> 172.21.15.122:0/1000310974 conn(0x7f13500b4190 msgr2=0x7f13500b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:02.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.509+0000 7f1356a00640 1 -- 172.21.15.122:0/1000310974 shutdown_connections 2024-05-28T06:06:02.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.509+0000 7f1356a00640 1 -- 172.21.15.122:0/1000310974 wait complete. 2024-05-28T06:06:02.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f1356a00640 1 Processor -- start 2024-05-28T06:06:02.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f1356a00640 1 -- start start 2024-05-28T06:06:02.517 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f1356a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13500d0270 0x7f135015fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:02.517 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f1356a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13500d0c80 0x7f1350160670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:02.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f1356a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f135015d7e0 0x7f1350160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:02.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f1356a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f13501697c0 con 0x7f13500d0c80 2024-05-28T06:06:02.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f1356a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1350169640 con 0x7f13500d0270 2024-05-28T06:06:02.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f1356a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1350169940 con 0x7f135015d7e0 2024-05-28T06:06:02.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f1347400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13500d0c80 0x7f1350160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:02.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f1347400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13500d0c80 0x7f1350160670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41762/0 (socket says 172.21.15.122:41762) 2024-05-28T06:06:02.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f1347400640 1 -- 172.21.15.122:0/56845827 learned_addr learned my addr 172.21.15.122:0/56845827 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:02.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f134fe00640 1 --2- 172.21.15.122:0/56845827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13500d0270 0x7f135015fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:02.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f1354a00640 1 --2- 172.21.15.122:0/56845827 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f135015d7e0 0x7f1350160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:02.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f1347400640 1 -- 172.21.15.122:0/56845827 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f135015d7e0 msgr2=0x7f1350160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:02.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f1347400640 1 --2- 172.21.15.122:0/56845827 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f135015d7e0 0x7f1350160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f1347400640 1 -- 172.21.15.122:0/56845827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13500d0270 msgr2=0x7f135015fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:02.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f1347400640 1 --2- 172.21.15.122:0/56845827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13500d0270 0x7f135015fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f1347400640 1 -- 172.21.15.122:0/56845827 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13500b7ea0 con 0x7f13500d0c80 2024-05-28T06:06:02.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f1347400640 1 --2- 172.21.15.122:0/56845827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13500d0c80 0x7f1350160670 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f133800c370 tx=0x7f133800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:02.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f134cc00640 1 -- 172.21.15.122:0/56845827 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13380052d0 con 0x7f13500d0c80 2024-05-28T06:06:02.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f134cc00640 1 -- 172.21.15.122:0/56845827 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1338005470 con 0x7f13500d0c80 2024-05-28T06:06:02.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f1356a00640 1 -- 172.21.15.122:0/56845827 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13500b8180 con 0x7f13500d0c80 2024-05-28T06:06:02.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f134cc00640 1 -- 172.21.15.122:0/56845827 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1338007260 con 0x7f13500d0c80 2024-05-28T06:06:02.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.513+0000 7f1356a00640 1 -- 172.21.15.122:0/56845827 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f135015f3a0 con 0x7f13500d0c80 2024-05-28T06:06:02.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.517+0000 7f1356a00640 1 -- 172.21.15.122:0/56845827 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1350068c40 con 0x7f13500d0c80 2024-05-28T06:06:02.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.517+0000 7f134cc00640 1 -- 172.21.15.122:0/56845827 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1338007400 con 0x7f13500d0c80 2024-05-28T06:06:02.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.517+0000 7f134cc00640 1 --2- 172.21.15.122:0/56845827 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f132c068380 0x7f132c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:02.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.517+0000 7f134cc00640 1 -- 172.21.15.122:0/56845827 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1338085db0 con 0x7f13500d0c80 2024-05-28T06:06:02.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.517+0000 7f134fe00640 1 --2- 172.21.15.122:0/56845827 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f132c068380 0x7f132c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:02.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.517+0000 7f134fe00640 1 --2- 172.21.15.122:0/56845827 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f132c068380 0x7f132c06a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f13400098f0 tx=0x7f1340006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:02.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.521+0000 7f134cc00640 1 -- 172.21.15.122:0/56845827 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1338055d20 con 0x7f13500d0c80 2024-05-28T06:06:02.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.709+0000 7f1356a00640 1 -- 172.21.15.122:0/56845827 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13500ccad0 con 0x7f13500d0c80 2024-05-28T06:06:02.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.713+0000 7f134cc00640 1 -- 172.21.15.122:0/56845827 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7f133805c020 con 0x7f13500d0c80 2024-05-28T06:06:02.715 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:02.715 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4177682646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4177682646},{"type":"v1","addr":"172.21.15.153:6835","nonce":4177682646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3318983491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3318983491},{"type":"v1","addr":"172.21.15.153:6834","nonce":3318983491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/360722760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":360722760},{"type":"v1","addr":"172.21.15.122:6836","nonce":360722760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-28T06:05:49.194771+0000","modified":"2024-05-28T06:05:52.203797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1474216380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1474216380},{"type":"v1","addr":"172.21.15.122:6837","nonce":1474216380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4270,"qdb_cluster":[4270]},"id":1}]} 2024-05-28T06:06:02.715 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 8 2024-05-28T06:06:02.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.713+0000 7f1356a00640 1 -- 172.21.15.122:0/56845827 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f132c068380 msgr2=0x7f132c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:02.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.713+0000 7f1356a00640 1 --2- 172.21.15.122:0/56845827 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f132c068380 0x7f132c06a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f13400098f0 tx=0x7f1340006f90 comp rx=0 tx=0).stop 2024-05-28T06:06:02.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.713+0000 7f1356a00640 1 -- 172.21.15.122:0/56845827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13500d0c80 msgr2=0x7f1350160670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:02.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.713+0000 7f1356a00640 1 --2- 172.21.15.122:0/56845827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13500d0c80 0x7f1350160670 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f133800c370 tx=0x7f133800c830 comp rx=0 tx=0).stop 2024-05-28T06:06:02.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.713+0000 7f1356a00640 1 -- 172.21.15.122:0/56845827 shutdown_connections 2024-05-28T06:06:02.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.713+0000 7f1356a00640 1 --2- 172.21.15.122:0/56845827 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f132c068380 0x7f132c06a840 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.713+0000 7f1356a00640 1 --2- 172.21.15.122:0/56845827 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f135015d7e0 0x7f1350160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.713+0000 7f1356a00640 1 --2- 172.21.15.122:0/56845827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13500d0c80 0x7f1350160670 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.713+0000 7f1356a00640 1 --2- 172.21.15.122:0/56845827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13500d0270 0x7f135015fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.713+0000 7f1356a00640 1 -- 172.21.15.122:0/56845827 >> 172.21.15.122:0/56845827 conn(0x7f13500b4190 msgr2=0x7f13500b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:02.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.713+0000 7f1356a00640 1 -- 172.21.15.122:0/56845827 shutdown_connections 2024-05-28T06:06:02.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.713+0000 7f1356a00640 1 -- 172.21.15.122:0/56845827 wait complete. 2024-05-28T06:06:02.736 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:06:02.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.869+0000 7fc03be00640 1 Processor -- start 2024-05-28T06:06:02.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.869+0000 7fc03be00640 1 -- start start 2024-05-28T06:06:02.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.869+0000 7fc03be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0340cff30 0x7fc03406f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:02.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.869+0000 7fc03be00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0340d0310 con 0x7fc0340cdb00 2024-05-28T06:06:02.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.869+0000 7fc03be00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc03415be20 con 0x7fc03406f6c0 2024-05-28T06:06:02.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.869+0000 7fc03be00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc03406fb00 con 0x7fc0340cff30 2024-05-28T06:06:02.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc039e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fc0340cdb00 0x7fc0340b49b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38704/0 (socket says 172.21.15.122:38704) 2024-05-28T06:06:02.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc039e00640 1 -- 172.21.15.122:0/3402571761 learned_addr learned my addr 172.21.15.122:0/3402571761 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:02.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc039400640 1 --2- 172.21.15.122:0/3402571761 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0340cff30 0x7fc03406f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:02.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc033e00640 1 -- 172.21.15.122:0/3402571761 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4120931276 0 0) 0x7fc0340d0310 con 0x7fc0340cdb00 2024-05-28T06:06:02.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc033e00640 1 -- 172.21.15.122:0/3402571761 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc01c005740 con 0x7fc0340cdb00 2024-05-28T06:06:02.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc033e00640 1 -- 172.21.15.122:0/3402571761 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 424462700 0 0) 0x7fc01c005740 con 0x7fc0340cdb00 2024-05-28T06:06:02.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc033e00640 1 -- 172.21.15.122:0/3402571761 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0340cff30 msgr2=0x7fc03406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:02.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc033e00640 1 --2- 172.21.15.122:0/3402571761 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0340cff30 0x7fc03406f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc033e00640 1 -- 172.21.15.122:0/3402571761 >> v1:172.21.15.153:6789/0 conn(0x7fc03406f6c0 legacy=0x7fc0340cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:02.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc033e00640 1 -- 172.21.15.122:0/3402571761 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03415c100 con 0x7fc0340cdb00 2024-05-28T06:06:02.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc033e00640 1 -- 172.21.15.122:0/3402571761 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7fc02c001a20 con 0x7fc0340cdb00 2024-05-28T06:06:02.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc033e00640 1 -- 172.21.15.122:0/3402571761 >> v1:172.21.15.122:6789/0 conn(0x7fc0340cdb00 legacy=0x7fc0340b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:02.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc033e00640 1 --2- 172.21.15.122:0/3402571761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc01c005c00 0x7fc01c005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:02.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc033e00640 1 --2- 172.21.15.122:0/3402571761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc01c0065b0 0x7fc01c006a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:02.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc033e00640 1 --2- 172.21.15.122:0/3402571761 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0340cff30 0x7fc01c0072e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:02.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc033e00640 1 -- 172.21.15.122:0/3402571761 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc03406fb00 con 0x7fc01c005c00 2024-05-28T06:06:02.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc033e00640 1 -- 172.21.15.122:0/3402571761 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c00dbe0 con 0x7fc01c0065b0 2024-05-28T06:06:02.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc033e00640 1 -- 172.21.15.122:0/3402571761 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc01c00dde0 con 0x7fc0340cff30 2024-05-28T06:06:02.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc039400640 1 --2- 172.21.15.122:0/3402571761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc01c005c00 0x7fc01c005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:02.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc038a00640 1 --2- 172.21.15.122:0/3402571761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc01c0065b0 0x7fc01c006a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:02.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc039e00640 1 --2- 172.21.15.122:0/3402571761 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0340cff30 0x7fc01c0072e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:02.878 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc039400640 1 -- 172.21.15.122:0/3402571761 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0340cff30 msgr2=0x7fc01c0072e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:02.878 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc039400640 1 --2- 172.21.15.122:0/3402571761 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0340cff30 0x7fc01c0072e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.878 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc039400640 1 -- 172.21.15.122:0/3402571761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc01c0065b0 msgr2=0x7fc01c006a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:02.878 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc039400640 1 --2- 172.21.15.122:0/3402571761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc01c0065b0 0x7fc01c006a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.878 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.873+0000 7fc039400640 1 -- 172.21.15.122:0/3402571761 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc01c005740 con 0x7fc01c005c00 2024-05-28T06:06:02.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.877+0000 7fc039400640 1 --2- 172.21.15.122:0/3402571761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc01c005c00 0x7fc01c005fe0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc028009ae0 tx=0x7fc02801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463ab126d59f3743 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:02.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.877+0000 7fc033e00640 1 -- 172.21.15.122:0/3402571761 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0280b2070 con 0x7fc01c005c00 2024-05-28T06:06:02.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.877+0000 7fc033e00640 1 -- 172.21.15.122:0/3402571761 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0280a5660 con 0x7fc01c005c00 2024-05-28T06:06:02.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.877+0000 7fc033e00640 1 -- 172.21.15.122:0/3402571761 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0280096b0 con 0x7fc01c005c00 2024-05-28T06:06:02.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.877+0000 7fc03be00640 1 -- 172.21.15.122:0/3402571761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc01c005c00 msgr2=0x7fc01c005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:02.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.877+0000 7fc03be00640 1 --2- 172.21.15.122:0/3402571761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc01c005c00 0x7fc01c005fe0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc028009ae0 tx=0x7fc02801ca70 comp rx=0 tx=0).stop 2024-05-28T06:06:02.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.877+0000 7fc039e00640 1 -- 172.21.15.122:0/3402571761 reap_dead start 2024-05-28T06:06:02.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.877+0000 7fc03be00640 1 -- 172.21.15.122:0/3402571761 shutdown_connections 2024-05-28T06:06:02.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.877+0000 7fc03be00640 1 -- 172.21.15.122:0/3402571761 >> 172.21.15.122:0/3402571761 conn(0x7fc03406bd90 msgr2=0x7fc03406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:02.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.877+0000 7fc03be00640 1 -- 172.21.15.122:0/3402571761 shutdown_connections 2024-05-28T06:06:02.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.877+0000 7fc03be00640 1 -- 172.21.15.122:0/3402571761 wait complete. 2024-05-28T06:06:02.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.877+0000 7fc03be00640 1 Processor -- start 2024-05-28T06:06:02.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.877+0000 7fc03be00640 1 -- start start 2024-05-28T06:06:02.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc03be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc01c005c00 0x7fc0341576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:02.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc03be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc034158d70 0x7fc0341e3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:02.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc03be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc034142ce0 0x7fc0341e4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:02.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc03be00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc03415c6c0 con 0x7fc01c005c00 2024-05-28T06:06:02.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc03be00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc0340cdf30 con 0x7fc034142ce0 2024-05-28T06:06:02.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc03be00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc03415baf0 con 0x7fc034158d70 2024-05-28T06:06:02.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc039400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc01c005c00 0x7fc0341576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:02.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc039400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc01c005c00 0x7fc0341576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41778/0 (socket says 172.21.15.122:41778) 2024-05-28T06:06:02.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc039400640 1 -- 172.21.15.122:0/1063671478 learned_addr learned my addr 172.21.15.122:0/1063671478 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:02.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc038a00640 1 --2- 172.21.15.122:0/1063671478 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc034158d70 0x7fc0341e3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:02.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc039e00640 1 --2- 172.21.15.122:0/1063671478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc034142ce0 0x7fc0341e4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:02.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc039400640 1 -- 172.21.15.122:0/1063671478 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc034158d70 msgr2=0x7fc0341e3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:02.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc039400640 1 --2- 172.21.15.122:0/1063671478 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc034158d70 0x7fc0341e3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc039400640 1 -- 172.21.15.122:0/1063671478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc034142ce0 msgr2=0x7fc0341e4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:02.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc039400640 1 --2- 172.21.15.122:0/1063671478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc034142ce0 0x7fc0341e4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:02.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc039400640 1 -- 172.21.15.122:0/1063671478 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc034157cd0 con 0x7fc01c005c00 2024-05-28T06:06:02.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc039400640 1 --2- 172.21.15.122:0/1063671478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc01c005c00 0x7fc0341576f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc02801c8a0 tx=0x7fc01c007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:02.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc031600640 1 -- 172.21.15.122:0/1063671478 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0280b2040 con 0x7fc01c005c00 2024-05-28T06:06:02.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc031600640 1 -- 172.21.15.122:0/1063671478 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0280a5e10 con 0x7fc01c005c00 2024-05-28T06:06:02.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc03be00640 1 -- 172.21.15.122:0/1063671478 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc034157fb0 con 0x7fc01c005c00 2024-05-28T06:06:02.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc031600640 1 -- 172.21.15.122:0/1063671478 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc028004260 con 0x7fc01c005c00 2024-05-28T06:06:02.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc03be00640 1 -- 172.21.15.122:0/1063671478 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc034158570 con 0x7fc01c005c00 2024-05-28T06:06:02.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc03be00640 1 -- 172.21.15.122:0/1063671478 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc034068c40 con 0x7fc01c005c00 2024-05-28T06:06:02.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.881+0000 7fc031600640 1 -- 172.21.15.122:0/1063671478 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc0280c0060 con 0x7fc01c005c00 2024-05-28T06:06:02.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.885+0000 7fc031600640 1 --2- 172.21.15.122:0/1063671478 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc014068380 0x7fc01406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:02.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.885+0000 7fc031600640 1 -- 172.21.15.122:0/1063671478 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc0281204d0 con 0x7fc01c005c00 2024-05-28T06:06:02.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.885+0000 7fc038a00640 1 --2- 172.21.15.122:0/1063671478 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc014068380 0x7fc01406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:02.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.885+0000 7fc038a00640 1 --2- 172.21.15.122:0/1063671478 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc014068380 0x7fc01406a840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc0340af500 tx=0x7fc02000a9b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:02.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:02.889+0000 7fc031600640 1 -- 172.21.15.122:0/1063671478 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc028016780 con 0x7fc01c005c00 2024-05-28T06:06:03.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.049+0000 7fc03be00640 1 -- 172.21.15.122:0/1063671478 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc0340ccdf0 con 0x7fc01c005c00 2024-05-28T06:06:03.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.049+0000 7fc031600640 1 -- 172.21.15.122:0/1063671478 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fc0280f0960 con 0x7fc01c005c00 2024-05-28T06:06:03.052 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:03.052 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":20,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:05:50.822555+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:05:47.441193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-28T06:05:48.148164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:06:03.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.049+0000 7fc03be00640 1 -- 172.21.15.122:0/1063671478 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc014068380 msgr2=0x7fc01406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:03.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.049+0000 7fc03be00640 1 --2- 172.21.15.122:0/1063671478 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc014068380 0x7fc01406a840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc0340af500 tx=0x7fc02000a9b0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.049+0000 7fc03be00640 1 -- 172.21.15.122:0/1063671478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc01c005c00 msgr2=0x7fc0341576f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:03.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.049+0000 7fc03be00640 1 --2- 172.21.15.122:0/1063671478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc01c005c00 0x7fc0341576f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc02801c8a0 tx=0x7fc01c007a50 comp rx=0 tx=0).stop 2024-05-28T06:06:03.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.049+0000 7fc03be00640 1 -- 172.21.15.122:0/1063671478 shutdown_connections 2024-05-28T06:06:03.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.049+0000 7fc03be00640 1 --2- 172.21.15.122:0/1063671478 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc014068380 0x7fc01406a840 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.049+0000 7fc03be00640 1 --2- 172.21.15.122:0/1063671478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc034142ce0 0x7fc0341e4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.049+0000 7fc03be00640 1 --2- 172.21.15.122:0/1063671478 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc034158d70 0x7fc0341e3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.049+0000 7fc03be00640 1 --2- 172.21.15.122:0/1063671478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc01c005c00 0x7fc0341576f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.049+0000 7fc03be00640 1 -- 172.21.15.122:0/1063671478 >> 172.21.15.122:0/1063671478 conn(0x7fc03406bd90 msgr2=0x7fc03406eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:03.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.053+0000 7fc03be00640 1 -- 172.21.15.122:0/1063671478 shutdown_connections 2024-05-28T06:06:03.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.053+0000 7fc03be00640 1 -- 172.21.15.122:0/1063671478 wait complete. 2024-05-28T06:06:03.073 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:06:03.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.205+0000 7f43d6e00640 1 Processor -- start 2024-05-28T06:06:03.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.205+0000 7f43d6e00640 1 -- start start 2024-05-28T06:06:03.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.205+0000 7f43d6e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f43d00cff30 0x7f43d006f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:03.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.205+0000 7f43d6e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f43d006f6c0 0x7f43d00cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:03.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.205+0000 7f43d6e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43d00d0310 con 0x7f43d00cd930 2024-05-28T06:06:03.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.205+0000 7f43d6e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f43d006fb30 con 0x7f43d006f6c0 2024-05-28T06:06:03.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.205+0000 7f43d6e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f43d015be20 con 0x7f43d00cff30 2024-05-28T06:06:03.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.205+0000 7f43cf400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f43d006f6c0 0x7f43d00cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:03.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.205+0000 7f43cf400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f43d006f6c0 0x7f43d00cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41788/0 (socket says 172.21.15.122:41788) 2024-05-28T06:06:03.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.205+0000 7f43cf400640 1 -- 172.21.15.122:0/108740979 learned_addr learned my addr 172.21.15.122:0/108740979 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:03.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.205+0000 7f43cfe00640 1 --2- 172.21.15.122:0/108740979 >> v2:172.21.15.153:3300/0 conn(0x7f43d00cff30 0x7f43d006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:03.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.209+0000 7f43cf400640 1 -- 172.21.15.122:0/108740979 >> v2:172.21.15.153:3300/0 conn(0x7f43d00cff30 msgr2=0x7f43d006f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:03.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.209+0000 7f43cf400640 1 --2- 172.21.15.122:0/108740979 >> v2:172.21.15.153:3300/0 conn(0x7f43d00cff30 0x7f43d006f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.209+0000 7f43cf400640 1 -- 172.21.15.122:0/108740979 >> v1:172.21.15.153:6789/0 conn(0x7f43d00cd930 legacy=0x7f43d00722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:03.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.209+0000 7f43cf400640 1 -- 172.21.15.122:0/108740979 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d015c100 con 0x7f43d006f6c0 2024-05-28T06:06:03.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.209+0000 7f43cf400640 1 --2- 172.21.15.122:0/108740979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43d006f6c0 0x7f43d00cd3f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f43d00b3dc0 tx=0x7f43bc01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d62bd51656cc409 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:03.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.209+0000 7f43cea00640 1 -- 172.21.15.122:0/108740979 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0aa610 con 0x7f43d006f6c0 2024-05-28T06:06:03.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.209+0000 7f43cea00640 1 -- 172.21.15.122:0/108740979 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43bc0af070 con 0x7f43d006f6c0 2024-05-28T06:06:03.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.209+0000 7f43cea00640 1 -- 172.21.15.122:0/108740979 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0aa9d0 con 0x7f43d006f6c0 2024-05-28T06:06:03.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.209+0000 7f43d6e00640 1 -- 172.21.15.122:0/108740979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43d006f6c0 msgr2=0x7f43d00cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:03.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.209+0000 7f43d6e00640 1 --2- 172.21.15.122:0/108740979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43d006f6c0 0x7f43d00cd3f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f43d00b3dc0 tx=0x7f43bc01c4b0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.209+0000 7f43d6e00640 1 -- 172.21.15.122:0/108740979 shutdown_connections 2024-05-28T06:06:03.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.209+0000 7f43d6e00640 1 --2- 172.21.15.122:0/108740979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43d006f6c0 0x7f43d00cd3f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.209+0000 7f43d6e00640 1 --2- 172.21.15.122:0/108740979 >> v2:172.21.15.153:3300/0 conn(0x7f43d00cff30 0x7f43d006f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.209+0000 7f43d6e00640 1 -- 172.21.15.122:0/108740979 >> 172.21.15.122:0/108740979 conn(0x7f43d006bd90 msgr2=0x7f43d006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:03.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.209+0000 7f43d6e00640 1 -- 172.21.15.122:0/108740979 shutdown_connections 2024-05-28T06:06:03.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.209+0000 7f43d6e00640 1 -- 172.21.15.122:0/108740979 wait complete. 2024-05-28T06:06:03.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.213+0000 7f43d6e00640 1 Processor -- start 2024-05-28T06:06:03.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.213+0000 7f43d6e00640 1 -- start start 2024-05-28T06:06:03.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.213+0000 7f43d6e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43d006f6c0 0x7f43d00b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:03.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.213+0000 7f43d6e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43d00cd930 0x7f43d01fb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:03.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.213+0000 7f43d6e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43d00cff30 0x7f43d0158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:03.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.213+0000 7f43d6e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f43d00cdeb0 con 0x7f43d00cd930 2024-05-28T06:06:03.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.213+0000 7f43d6e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f43d00cdd30 con 0x7f43d00cff30 2024-05-28T06:06:03.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.213+0000 7f43d6e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f43d00b59c0 con 0x7f43d006f6c0 2024-05-28T06:06:03.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.213+0000 7f43cf400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43d00cd930 0x7f43d01fb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:03.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.213+0000 7f43cf400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43d00cd930 0x7f43d01fb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41804/0 (socket says 172.21.15.122:41804) 2024-05-28T06:06:03.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.213+0000 7f43cf400640 1 -- 172.21.15.122:0/3543840136 learned_addr learned my addr 172.21.15.122:0/3543840136 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:03.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.213+0000 7f43cf400640 1 -- 172.21.15.122:0/3543840136 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43d006f6c0 msgr2=0x7f43d00b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:03.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.213+0000 7f43cf400640 1 --2- 172.21.15.122:0/3543840136 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43d006f6c0 0x7f43d00b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.213+0000 7f43cf400640 1 -- 172.21.15.122:0/3543840136 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43d00cff30 msgr2=0x7f43d0158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:03.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.213+0000 7f43cf400640 1 --2- 172.21.15.122:0/3543840136 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43d00cff30 0x7f43d0158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.213+0000 7f43cf400640 1 -- 172.21.15.122:0/3543840136 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d00b0930 con 0x7f43d00cd930 2024-05-28T06:06:03.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.213+0000 7f43cf400640 1 --2- 172.21.15.122:0/3543840136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43d00cd930 0x7f43d01fb720 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0ac040 tx=0x7f43bc01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:03.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.217+0000 7f43c7e00640 1 -- 172.21.15.122:0/3543840136 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0bd5f0 con 0x7f43d00cd930 2024-05-28T06:06:03.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.217+0000 7f43c7e00640 1 -- 172.21.15.122:0/3543840136 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43bc0bd790 con 0x7f43d00cd930 2024-05-28T06:06:03.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.217+0000 7f43c7e00640 1 -- 172.21.15.122:0/3543840136 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0bdb60 con 0x7f43d00cd930 2024-05-28T06:06:03.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.217+0000 7f43d6e00640 1 -- 172.21.15.122:0/3543840136 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43d00b0c10 con 0x7f43d00cd930 2024-05-28T06:06:03.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.217+0000 7f43d6e00640 1 -- 172.21.15.122:0/3543840136 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43d01fb200 con 0x7f43d00cd930 2024-05-28T06:06:03.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.217+0000 7f43d6e00640 1 -- 172.21.15.122:0/3543840136 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43d0068c40 con 0x7f43d00cd930 2024-05-28T06:06:03.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.217+0000 7f43c7e00640 1 -- 172.21.15.122:0/3543840136 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f43bc0b33f0 con 0x7f43d00cd930 2024-05-28T06:06:03.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.217+0000 7f43c7e00640 1 --2- 172.21.15.122:0/3543840136 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f43b0068380 0x7f43b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:03.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.217+0000 7f43c7e00640 1 -- 172.21.15.122:0/3543840136 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f43bc121400 con 0x7f43d00cd930 2024-05-28T06:06:03.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.217+0000 7f43cfe00640 1 --2- 172.21.15.122:0/3543840136 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f43b0068380 0x7f43b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:03.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.217+0000 7f43cfe00640 1 --2- 172.21.15.122:0/3543840136 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f43b0068380 0x7f43b006a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f43c00070b0 tx=0x7f43c0007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:03.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.221+0000 7f43c7e00640 1 -- 172.21.15.122:0/3543840136 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f43bc0a7070 con 0x7f43d00cd930 2024-05-28T06:06:03.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.413+0000 7f43d6e00640 1 -- 172.21.15.122:0/3543840136 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43d00cd2f0 con 0x7f43d00cd930 2024-05-28T06:06:03.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.413+0000 7f43c7e00640 1 -- 172.21.15.122:0/3543840136 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7f43bc0160d0 con 0x7f43d00cd930 2024-05-28T06:06:03.416 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:03.416 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4177682646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4177682646},{"type":"v1","addr":"172.21.15.153:6835","nonce":4177682646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3318983491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3318983491},{"type":"v1","addr":"172.21.15.153:6834","nonce":3318983491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/360722760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":360722760},{"type":"v1","addr":"172.21.15.122:6836","nonce":360722760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-28T06:05:49.194771+0000","modified":"2024-05-28T06:05:52.203797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1474216380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1474216380},{"type":"v1","addr":"172.21.15.122:6837","nonce":1474216380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4270,"qdb_cluster":[4270]},"id":1}]} 2024-05-28T06:06:03.416 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 8 2024-05-28T06:06:03.418 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.413+0000 7f43d6e00640 1 -- 172.21.15.122:0/3543840136 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f43b0068380 msgr2=0x7f43b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:03.418 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.413+0000 7f43d6e00640 1 --2- 172.21.15.122:0/3543840136 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f43b0068380 0x7f43b006a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f43c00070b0 tx=0x7f43c0007040 comp rx=0 tx=0).stop 2024-05-28T06:06:03.418 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.413+0000 7f43d6e00640 1 -- 172.21.15.122:0/3543840136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43d00cd930 msgr2=0x7f43d01fb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:03.418 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.413+0000 7f43d6e00640 1 --2- 172.21.15.122:0/3543840136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43d00cd930 0x7f43d01fb720 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0ac040 tx=0x7f43bc01acf0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.418 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.413+0000 7f43d6e00640 1 -- 172.21.15.122:0/3543840136 shutdown_connections 2024-05-28T06:06:03.418 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.413+0000 7f43d6e00640 1 --2- 172.21.15.122:0/3543840136 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f43b0068380 0x7f43b006a840 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.418 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.413+0000 7f43d6e00640 1 --2- 172.21.15.122:0/3543840136 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43d00cff30 0x7f43d0158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.418 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.413+0000 7f43d6e00640 1 --2- 172.21.15.122:0/3543840136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43d00cd930 0x7f43d01fb720 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.413+0000 7f43d6e00640 1 --2- 172.21.15.122:0/3543840136 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43d006f6c0 0x7f43d00b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.413+0000 7f43d6e00640 1 -- 172.21.15.122:0/3543840136 >> 172.21.15.122:0/3543840136 conn(0x7f43d006bd90 msgr2=0x7f43d015a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:03.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.413+0000 7f43d6e00640 1 -- 172.21.15.122:0/3543840136 shutdown_connections 2024-05-28T06:06:03.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.413+0000 7f43d6e00640 1 -- 172.21.15.122:0/3543840136 wait complete. 2024-05-28T06:06:03.840 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-28T06:05:49.194771+0000', 'modified': '2024-05-28T06:05:52.203797+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4270': {'gid': 4270, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.122:6837/1474216380', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6835', 'nonce': 1474216380}, {'type': 'v1', 'addr': '172.21.15.122:6837', 'nonce': 1474216380}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4270, 'qdb_cluster': [4270]} 2024-05-28T06:06:03.840 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-28T06:06:03.841 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-28T06:06:03.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.977+0000 7f9615600640 1 Processor -- start 2024-05-28T06:06:03.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.977+0000 7f9615600640 1 -- start start 2024-05-28T06:06:03.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.977+0000 7f9615600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f961006c0a0 0x7f9610070d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:03.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.977+0000 7f9615600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f96100ae490 0x7f96100b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:03.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.977+0000 7f9615600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96100b6980 con 0x7f961015eb70 2024-05-28T06:06:03.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.977+0000 7f9615600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f96100b6190 con 0x7f96100ae490 2024-05-28T06:06:03.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.977+0000 7f9615600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f96100b4930 con 0x7f961006c0a0 2024-05-28T06:06:03.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.977+0000 7f960f400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f96100ae490 0x7f96100b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:03.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.977+0000 7f960e000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f961006c0a0 0x7f9610070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:03.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.977+0000 7f960f400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f96100ae490 0x7f96100b04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:37760/0 (socket says 172.21.15.122:37760) 2024-05-28T06:06:03.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.977+0000 7f960f400640 1 -- 172.21.15.122:0/307630608 learned_addr learned my addr 172.21.15.122:0/307630608 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:03.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.981+0000 7f960e000640 1 -- 172.21.15.122:0/307630608 >> v2:172.21.15.153:3300/0 conn(0x7f96100ae490 msgr2=0x7f96100b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:03.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.981+0000 7f960e000640 1 --2- 172.21.15.122:0/307630608 >> v2:172.21.15.153:3300/0 conn(0x7f96100ae490 0x7f96100b04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.981+0000 7f960e000640 1 -- 172.21.15.122:0/307630608 >> v1:172.21.15.153:6789/0 conn(0x7f961015eb70 legacy=0x7f961006b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:03.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.981+0000 7f960e000640 1 -- 172.21.15.122:0/307630608 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96100ae920 con 0x7f961006c0a0 2024-05-28T06:06:03.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.981+0000 7f960f400640 1 --2- 172.21.15.122:0/307630608 >> v2:172.21.15.153:3300/0 conn(0x7f96100ae490 0x7f96100b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:06:03.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.981+0000 7f960e000640 1 --2- 172.21.15.122:0/307630608 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f961006c0a0 0x7f9610070d90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f95fc0097c0 tx=0x7f95fc01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36308a3600c2507e server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:03.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.981+0000 7f960d600640 1 -- 172.21.15.122:0/307630608 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc0b2070 con 0x7f961006c0a0 2024-05-28T06:06:03.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.985+0000 7f960d600640 1 -- 172.21.15.122:0/307630608 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95fc0ad640 con 0x7f961006c0a0 2024-05-28T06:06:03.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.985+0000 7f960d600640 1 -- 172.21.15.122:0/307630608 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc0ada10 con 0x7f961006c0a0 2024-05-28T06:06:03.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.985+0000 7f9615600640 1 -- 172.21.15.122:0/307630608 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f961006c0a0 msgr2=0x7f9610070d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:03.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.985+0000 7f9615600640 1 --2- 172.21.15.122:0/307630608 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f961006c0a0 0x7f9610070d90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f95fc0097c0 tx=0x7f95fc01c4a0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.985+0000 7f9615600640 1 -- 172.21.15.122:0/307630608 shutdown_connections 2024-05-28T06:06:03.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.985+0000 7f9615600640 1 --2- 172.21.15.122:0/307630608 >> v2:172.21.15.153:3300/0 conn(0x7f96100ae490 0x7f96100b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.985+0000 7f9615600640 1 --2- 172.21.15.122:0/307630608 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f961006c0a0 0x7f9610070d90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.985+0000 7f9615600640 1 -- 172.21.15.122:0/307630608 >> 172.21.15.122:0/307630608 conn(0x7f9610073570 msgr2=0x7f961009aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:03.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.985+0000 7f9615600640 1 -- 172.21.15.122:0/307630608 shutdown_connections 2024-05-28T06:06:03.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.985+0000 7f9615600640 1 -- 172.21.15.122:0/307630608 wait complete. 2024-05-28T06:06:03.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.985+0000 7f9615600640 1 Processor -- start 2024-05-28T06:06:03.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.985+0000 7f9615600640 1 -- start start 2024-05-28T06:06:03.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.985+0000 7f9615600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f961006c0a0 0x7f961014d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:03.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.985+0000 7f9615600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96100ae490 0x7f9610074d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:03.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.985+0000 7f9615600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f961015eb70 0x7f96100752d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:03.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.985+0000 7f9615600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9610070470 con 0x7f96100ae490 2024-05-28T06:06:03.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.985+0000 7f9615600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f96100702f0 con 0x7f961006c0a0 2024-05-28T06:06:03.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.985+0000 7f9615600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f96100705f0 con 0x7f961015eb70 2024-05-28T06:06:03.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.985+0000 7f960e000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96100ae490 0x7f9610074d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:03.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.985+0000 7f960e000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96100ae490 0x7f9610074d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41818/0 (socket says 172.21.15.122:41818) 2024-05-28T06:06:03.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.985+0000 7f960e000640 1 -- 172.21.15.122:0/351507267 learned_addr learned my addr 172.21.15.122:0/351507267 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:03.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.985+0000 7f960ea00640 1 --2- 172.21.15.122:0/351507267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f961006c0a0 0x7f961014d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:03.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.985+0000 7f960f400640 1 --2- 172.21.15.122:0/351507267 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f961015eb70 0x7f96100752d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:03.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.989+0000 7f960e000640 1 -- 172.21.15.122:0/351507267 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f961015eb70 msgr2=0x7f96100752d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:03.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.989+0000 7f960e000640 1 --2- 172.21.15.122:0/351507267 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f961015eb70 0x7f96100752d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.989+0000 7f960e000640 1 -- 172.21.15.122:0/351507267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f961006c0a0 msgr2=0x7f961014d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:03.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.989+0000 7f960e000640 1 --2- 172.21.15.122:0/351507267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f961006c0a0 0x7f961014d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.989+0000 7f960e000640 1 -- 172.21.15.122:0/351507267 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96101fad50 con 0x7f96100ae490 2024-05-28T06:06:03.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.989+0000 7f960e000640 1 --2- 172.21.15.122:0/351507267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96100ae490 0x7f9610074d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f95fc01a0d0 tx=0x7f95fc019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:03.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.989+0000 7f9606a00640 1 -- 172.21.15.122:0/351507267 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc0ba020 con 0x7f96100ae490 2024-05-28T06:06:03.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.989+0000 7f9606a00640 1 -- 172.21.15.122:0/351507267 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95fc0b6410 con 0x7f96100ae490 2024-05-28T06:06:03.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.989+0000 7f9615600640 1 -- 172.21.15.122:0/351507267 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96101fb030 con 0x7f96100ae490 2024-05-28T06:06:03.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.989+0000 7f9606a00640 1 -- 172.21.15.122:0/351507267 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc0b2040 con 0x7f96100ae490 2024-05-28T06:06:03.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.989+0000 7f9615600640 1 -- 172.21.15.122:0/351507267 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96101fb5f0 con 0x7f96100ae490 2024-05-28T06:06:03.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.989+0000 7f9606a00640 1 -- 172.21.15.122:0/351507267 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f95fc0bd020 con 0x7f96100ae490 2024-05-28T06:06:03.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.989+0000 7f9606a00640 1 --2- 172.21.15.122:0/351507267 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f95f00683b0 0x7f95f006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:03.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.989+0000 7f9606a00640 1 -- 172.21.15.122:0/351507267 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f95fc120780 con 0x7f96100ae490 2024-05-28T06:06:03.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.989+0000 7f960ea00640 1 --2- 172.21.15.122:0/351507267 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f95f00683b0 0x7f95f006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:03.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f9618a02000 1 Processor -- start 2024-05-28T06:06:03.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f9618a02000 1 -- start start 2024-05-28T06:06:03.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f960ea00640 1 --2- 172.21.15.122:0/351507267 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f95f00683b0 0x7f95f006a870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9600001770 tx=0x7f9600009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:03.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f9618a02000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5555fa326120 0x5555fa326500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:03.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f9618a02000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326a40 0x5555fa2d9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:03.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f9618a02000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fa2d9650 0x5555fa2d9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:03.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f9618a02000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5555fa12a420 con 0x5555fa326a40 2024-05-28T06:06:03.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f9618a02000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5555fa0c4bf0 con 0x5555fa2d9650 2024-05-28T06:06:03.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f9618a02000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5555fa1263e0 con 0x5555fa326120 2024-05-28T06:06:03.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f960e000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326a40 0x5555fa2d9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:03.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f960ea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5555fa326120 0x5555fa326500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:03.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f960e000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326a40 0x5555fa2d9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41820/0 (socket says 172.21.15.122:41820) 2024-05-28T06:06:03.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f960e000640 1 -- 172.21.15.122:0/3708229950 learned_addr learned my addr 172.21.15.122:0/3708229950 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:03.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f960f400640 1 --2- 172.21.15.122:0/3708229950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fa2d9650 0x5555fa2d9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:03.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f960e000640 1 -- 172.21.15.122:0/3708229950 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5555fa326120 msgr2=0x5555fa326500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:03.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f960e000640 1 --2- 172.21.15.122:0/3708229950 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5555fa326120 0x5555fa326500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f960e000640 1 -- 172.21.15.122:0/3708229950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fa2d9650 msgr2=0x5555fa2d9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:03.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f960e000640 1 --2- 172.21.15.122:0/3708229950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fa2d9650 0x5555fa2d9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:03.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f960e000640 1 -- 172.21.15.122:0/3708229950 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555fa1d2450 con 0x5555fa326a40 2024-05-28T06:06:03.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f960e000640 1 --2- 172.21.15.122:0/3708229950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326a40 0x5555fa2d9110 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f95fc0f0670 tx=0x7f95fc0f0350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb64de7d49055630 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:03.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f95fb400640 1 -- 172.21.15.122:0/3708229950 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc0f49e0 con 0x5555fa326a40 2024-05-28T06:06:03.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f95fb400640 1 -- 172.21.15.122:0/3708229950 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95fc0f9210 con 0x5555fa326a40 2024-05-28T06:06:03.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f95fb400640 1 -- 172.21.15.122:0/3708229950 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc0ecd50 con 0x5555fa326a40 2024-05-28T06:06:03.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f9618a02000 1 -- 172.21.15.122:0/3708229950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326a40 msgr2=0x5555fa2d9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:03.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f9618a02000 1 --2- 172.21.15.122:0/3708229950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326a40 0x5555fa2d9110 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f95fc0f0670 tx=0x7f95fc0f0350 comp rx=0 tx=0).stop 2024-05-28T06:06:03.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f9618a02000 1 -- 172.21.15.122:0/3708229950 shutdown_connections 2024-05-28T06:06:03.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f9618a02000 1 --2- 172.21.15.122:0/3708229950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fa2d9650 0x5555fa2d9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f9618a02000 1 --2- 172.21.15.122:0/3708229950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326a40 0x5555fa2d9110 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f9618a02000 1 --2- 172.21.15.122:0/3708229950 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5555fa326120 0x5555fa326500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f9618a02000 1 -- 172.21.15.122:0/3708229950 >> 172.21.15.122:0/3708229950 conn(0x5555fa306ec0 msgr2=0x5555fa3092b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:04.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f9618a02000 1 -- 172.21.15.122:0/3708229950 shutdown_connections 2024-05-28T06:06:04.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f9618a02000 1 -- 172.21.15.122:0/3708229950 wait complete. 2024-05-28T06:06:04.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f9618a02000 1 -- start start 2024-05-28T06:06:04.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.993+0000 7f9618a02000 1 Processor -- start 2024-05-28T06:06:04.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f9618a02000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fa2d9650 0x5555fa2deb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:04.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f9618a02000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5555fa326120 0x5555fa2df080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:04.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f9618a02000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326a40 0x5555fa2df5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:04.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f9618a02000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5555fa0caec0 con 0x5555fa326a40 2024-05-28T06:06:04.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f9618a02000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5555fa1ab120 con 0x5555fa2d9650 2024-05-28T06:06:04.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f9618a02000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5555fa135350 con 0x5555fa326120 2024-05-28T06:06:04.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f9618a02000 10 client.0 _ll_register_callbacks cb 0x5555fa1074d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-28T06:06:04.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f960f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326a40 0x5555fa2df5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:04.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f960f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326a40 0x5555fa2df5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41826/0 (socket says 172.21.15.122:41826) 2024-05-28T06:06:04.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f960f400640 1 -- 172.21.15.122:0/2358322264 learned_addr learned my addr 172.21.15.122:0/2358322264 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:04.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f960ea00640 1 --2- 172.21.15.122:0/2358322264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fa2d9650 0x5555fa2deb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:04.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f960e000640 1 --2- 172.21.15.122:0/2358322264 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5555fa326120 0x5555fa2df080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:04.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f960f400640 1 -- 172.21.15.122:0/2358322264 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5555fa326120 msgr2=0x5555fa2df080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:04.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f960f400640 1 --2- 172.21.15.122:0/2358322264 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5555fa326120 0x5555fa2df080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f960f400640 1 -- 172.21.15.122:0/2358322264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fa2d9650 msgr2=0x5555fa2deb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:04.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f960f400640 1 --2- 172.21.15.122:0/2358322264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fa2d9650 0x5555fa2deb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f960f400640 1 -- 172.21.15.122:0/2358322264 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555fa16ff80 con 0x5555fa326a40 2024-05-28T06:06:04.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f960f400640 1 --2- 172.21.15.122:0/2358322264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326a40 0x5555fa2df5c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9608014df0 tx=0x7f9608012670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4e13e06ebff9ce server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:04.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f95efe00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-28T06:06:04.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f95efe00640 1 -- 172.21.15.122:0/2358322264 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960801f430 con 0x5555fa326a40 2024-05-28T06:06:04.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f95efe00640 1 -- 172.21.15.122:0/2358322264 <== mon.0 v2:172.21.15.122:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f960801f5d0 con 0x5555fa326a40 2024-05-28T06:06:04.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f9618a02000 1 -- 172.21.15.122:0/2358322264 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95fc0f9210 con 0x5555fa326a40 2024-05-28T06:06:04.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f95efe00640 1 -- 172.21.15.122:0/2358322264 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f9608026050 con 0x5555fa326a40 2024-05-28T06:06:04.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f9618a02000 10 client.4626 fetch_fsmap learned FSMap version 8 2024-05-28T06:06:04.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f9618a02000 1 -- 172.21.15.122:0/2358322264 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5555fa103f00 con 0x5555fa326a40 2024-05-28T06:06:04.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f95efe00640 1 -- 172.21.15.122:0/2358322264 <== mon.0 v2:172.21.15.122:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95fc0f9210 con 0x5555fa326a40 2024-05-28T06:06:04.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f95efe00640 1 -- 172.21.15.122:0/2358322264 <== mon.0 v2:172.21.15.122:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f9608029020 con 0x5555fa326a40 2024-05-28T06:06:04.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f9618a02000 10 client.4626 fetch_fsmap finished waiting for FSMap version 8 2024-05-28T06:06:04.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f9618a02000 10 client.4626 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-28T06:06:04.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f9618a02000 20 client.4626 populate_metadata read hostname 'smithi122' 2024-05-28T06:06:04.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f9618a02000 1 --2- 172.21.15.122:0/2358322264 >> [v2:172.21.15.122:6835/1474216380,v1:172.21.15.122:6837/1474216380] conn(0x5555fa3353c0 0x5555fa3377b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:04.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f9618a02000 4 client.4626 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-28T06:06:04.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f9618a02000 1 -- 172.21.15.122:0/2358322264 --> [v2:172.21.15.122:6835/1474216380,v1:172.21.15.122:6837/1474216380] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555fa0c3bc0 con 0x5555fa3353c0 2024-05-28T06:06:04.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f960ea00640 1 --2- 172.21.15.122:0/2358322264 >> [v2:172.21.15.122:6835/1474216380,v1:172.21.15.122:6837/1474216380] conn(0x5555fa3353c0 0x5555fa3377b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:04.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f95efe00640 10 client.4626 ms_handle_connect on v2:172.21.15.122:6835/1474216380 2024-05-28T06:06:04.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:03.997+0000 7f960ea00640 1 --2- 172.21.15.122:0/2358322264 >> [v2:172.21.15.122:6835/1474216380,v1:172.21.15.122:6837/1474216380] conn(0x5555fa3353c0 0x5555fa3377b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76f04ae0d7c88a49 server_cookie=b3e7b8841469a7e2 in_seq=0 out_seq=0 2024-05-28T06:06:04.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.001+0000 7f95efe00640 1 -- 172.21.15.122:0/2358322264 <== mds.0 v2:172.21.15.122:6835/1474216380 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5555fa0c3bc0 con 0x5555fa3353c0 2024-05-28T06:06:04.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.001+0000 7f95efe00640 10 client.4626 handle_command_reply: tid=0 2024-05-28T06:06:04.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.001+0000 7f9618a02000 1 client.4626 shutdown 2024-05-28T06:06:04.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.001+0000 7f9618a02000 1 -- 172.21.15.122:0/2358322264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326a40 msgr2=0x5555fa2df5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:04.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.001+0000 7f9618a02000 1 --2- 172.21.15.122:0/2358322264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326a40 0x5555fa2df5c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9608014df0 tx=0x7f9608012670 comp rx=0 tx=0).stop 2024-05-28T06:06:04.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.001+0000 7f9618a02000 1 -- 172.21.15.122:0/2358322264 shutdown_connections 2024-05-28T06:06:04.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.001+0000 7f9618a02000 1 --2- 172.21.15.122:0/2358322264 >> [v2:172.21.15.122:6835/1474216380,v1:172.21.15.122:6837/1474216380] conn(0x5555fa3353c0 0x5555fa3377b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.001+0000 7f9618a02000 1 --2- 172.21.15.122:0/2358322264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326a40 0x5555fa2df5c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.001+0000 7f9618a02000 1 --2- 172.21.15.122:0/2358322264 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5555fa326120 0x5555fa2df080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.001+0000 7f95efe00640 0 client.4626 ms_handle_reset on v2:172.21.15.122:6835/1474216380 2024-05-28T06:06:04.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.001+0000 7f9618a02000 1 --2- 172.21.15.122:0/2358322264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fa2d9650 0x5555fa2deb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.001+0000 7f9618a02000 1 -- 172.21.15.122:0/2358322264 >> 172.21.15.122:0/2358322264 conn(0x5555fa306ec0 msgr2=0x5555fa3092b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:04.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.001+0000 7f9618a02000 1 -- 172.21.15.122:0/2358322264 shutdown_connections 2024-05-28T06:06:04.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.001+0000 7f9618a02000 1 -- 172.21.15.122:0/2358322264 wait complete. 2024-05-28T06:06:04.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.001+0000 7f9618a02000 20 client.4626 trim_cache size 0 max 16384 2024-05-28T06:06:04.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.017+0000 7f9618a02000 1 Processor -- start 2024-05-28T06:06:04.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.017+0000 7f9618a02000 1 -- start start 2024-05-28T06:06:04.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.017+0000 7f9618a02000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fa2d9650 0x5555fa2d8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:04.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.017+0000 7f9618a02000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326120 0x5555fa2d8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:04.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.017+0000 7f9618a02000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5555fa326a40 0x5555fa3377b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:04.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.017+0000 7f9618a02000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9610153ed0 con 0x5555fa326120 2024-05-28T06:06:04.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.017+0000 7f9618a02000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9610153230 con 0x5555fa2d9650 2024-05-28T06:06:04.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.017+0000 7f9618a02000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9610153880 con 0x5555fa326a40 2024-05-28T06:06:04.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.017+0000 7f960e000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326120 0x5555fa2d8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:04.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.017+0000 7f960e000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326120 0x5555fa2d8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41838/0 (socket says 172.21.15.122:41838) 2024-05-28T06:06:04.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.017+0000 7f960e000640 1 -- 172.21.15.122:0/3903656409 learned_addr learned my addr 172.21.15.122:0/3903656409 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:04.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.017+0000 7f960ea00640 1 --2- 172.21.15.122:0/3903656409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fa2d9650 0x5555fa2d8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:04.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.017+0000 7f960f400640 1 --2- 172.21.15.122:0/3903656409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5555fa326a40 0x5555fa3377b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:04.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.017+0000 7f960e000640 1 -- 172.21.15.122:0/3903656409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5555fa326a40 msgr2=0x5555fa3377b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:04.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.017+0000 7f960e000640 1 --2- 172.21.15.122:0/3903656409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5555fa326a40 0x5555fa3377b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.017+0000 7f960e000640 1 -- 172.21.15.122:0/3903656409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fa2d9650 msgr2=0x5555fa2d8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:04.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.017+0000 7f960e000640 1 --2- 172.21.15.122:0/3903656409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fa2d9650 0x5555fa2d8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.017+0000 7f960e000640 1 -- 172.21.15.122:0/3903656409 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555fa0b0e80 con 0x5555fa326120 2024-05-28T06:06:04.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f960e000640 1 --2- 172.21.15.122:0/3903656409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326120 0x5555fa2d8d50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f95fc0f0670 tx=0x7f95fc0f4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6ed9593b440037 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:04.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f95faa00640 1 -- 172.21.15.122:0/3903656409 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc11d070 con 0x5555fa326120 2024-05-28T06:06:04.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f95faa00640 1 -- 172.21.15.122:0/3903656409 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95fc0f9210 con 0x5555fa326120 2024-05-28T06:06:04.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f95faa00640 1 -- 172.21.15.122:0/3903656409 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc0f49e0 con 0x5555fa326120 2024-05-28T06:06:04.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f9618a02000 1 -- 172.21.15.122:0/3903656409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326120 msgr2=0x5555fa2d8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:04.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f9618a02000 1 --2- 172.21.15.122:0/3903656409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326120 0x5555fa2d8d50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f95fc0f0670 tx=0x7f95fc0f4000 comp rx=0 tx=0).stop 2024-05-28T06:06:04.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f9618a02000 1 -- 172.21.15.122:0/3903656409 shutdown_connections 2024-05-28T06:06:04.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f9618a02000 1 --2- 172.21.15.122:0/3903656409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5555fa326a40 0x5555fa3377b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f9618a02000 1 --2- 172.21.15.122:0/3903656409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326120 0x5555fa2d8d50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f9618a02000 1 --2- 172.21.15.122:0/3903656409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fa2d9650 0x5555fa2d8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f9618a02000 1 -- 172.21.15.122:0/3903656409 >> 172.21.15.122:0/3903656409 conn(0x5555fa306ec0 msgr2=0x5555fa2d8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:04.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f9618a02000 1 -- 172.21.15.122:0/3903656409 shutdown_connections 2024-05-28T06:06:04.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f9618a02000 1 -- 172.21.15.122:0/3903656409 wait complete. 2024-05-28T06:06:04.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f9618a02000 1 -- start start 2024-05-28T06:06:04.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f9618a02000 1 Processor -- start 2024-05-28T06:06:04.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f9618a02000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5555fa2d9650 0x5555fa33a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:04.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f9618a02000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326120 0x5555fa359b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:04.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f9618a02000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fa326a40 0x5555fa35a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:04.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f9618a02000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5555fa129730 con 0x5555fa326120 2024-05-28T06:06:04.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f9618a02000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5555fa0f69e0 con 0x5555fa326a40 2024-05-28T06:06:04.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f9618a02000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5555fa12ea50 con 0x5555fa2d9650 2024-05-28T06:06:04.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f9618a02000 10 client.0 _ll_register_callbacks cb 0x7f9608009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-28T06:06:04.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f960e000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326120 0x5555fa359b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:04.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f960e000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326120 0x5555fa359b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41846/0 (socket says 172.21.15.122:41846) 2024-05-28T06:06:04.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f960e000640 1 -- 172.21.15.122:0/1217840245 learned_addr learned my addr 172.21.15.122:0/1217840245 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:04.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f960f400640 1 --2- 172.21.15.122:0/1217840245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fa326a40 0x5555fa35a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:04.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f960ea00640 1 --2- 172.21.15.122:0/1217840245 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5555fa2d9650 0x5555fa33a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:04.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f960e000640 1 -- 172.21.15.122:0/1217840245 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5555fa2d9650 msgr2=0x5555fa33a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:04.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f960e000640 1 --2- 172.21.15.122:0/1217840245 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5555fa2d9650 0x5555fa33a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f960e000640 1 -- 172.21.15.122:0/1217840245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fa326a40 msgr2=0x5555fa35a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:04.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f960e000640 1 --2- 172.21.15.122:0/1217840245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fa326a40 0x5555fa35a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f960e000640 1 -- 172.21.15.122:0/1217840245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555fa0f2b30 con 0x5555fa326120 2024-05-28T06:06:04.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f960e000640 1 --2- 172.21.15.122:0/1217840245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326120 0x5555fa359b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f95fc0f0670 tx=0x7f95fc008000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3e455bf37e7d2a server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:04.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f95efe00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-28T06:06:04.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.021+0000 7f95efe00640 1 -- 172.21.15.122:0/1217840245 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc11d070 con 0x5555fa326120 2024-05-28T06:06:04.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f95efe00640 1 -- 172.21.15.122:0/1217840245 <== mon.0 v2:172.21.15.122:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f95fc0f8f80 con 0x5555fa326120 2024-05-28T06:06:04.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9618a02000 1 -- 172.21.15.122:0/1217840245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95fc0f9210 con 0x5555fa326120 2024-05-28T06:06:04.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f95efe00640 1 -- 172.21.15.122:0/1217840245 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f95fc0f49e0 con 0x5555fa326120 2024-05-28T06:06:04.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9618a02000 10 client.4632 fetch_fsmap learned FSMap version 8 2024-05-28T06:06:04.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9618a02000 1 -- 172.21.15.122:0/1217840245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5555fa1ab5b0 con 0x5555fa326120 2024-05-28T06:06:04.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f95efe00640 1 -- 172.21.15.122:0/1217840245 <== mon.0 v2:172.21.15.122:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95fc0f9210 con 0x5555fa326120 2024-05-28T06:06:04.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f95efe00640 1 -- 172.21.15.122:0/1217840245 <== mon.0 v2:172.21.15.122:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f95fc0b5050 con 0x5555fa326120 2024-05-28T06:06:04.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9618a02000 10 client.4632 fetch_fsmap finished waiting for FSMap version 8 2024-05-28T06:06:04.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9618a02000 10 client.4632 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-28T06:06:04.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9618a02000 20 client.4632 populate_metadata read hostname 'smithi122' 2024-05-28T06:06:04.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9618a02000 1 --2- 172.21.15.122:0/1217840245 >> [v2:172.21.15.122:6835/1474216380,v1:172.21.15.122:6837/1474216380] conn(0x5555fa35a5d0 0x5555fa39d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:04.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9618a02000 4 client.4632 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-28T06:06:04.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9618a02000 1 -- 172.21.15.122:0/1217840245 --> [v2:172.21.15.122:6835/1474216380,v1:172.21.15.122:6837/1474216380] -- command(tid 0: {"prefix": "status"}) -- 0x5555fa137e40 con 0x5555fa35a5d0 2024-05-28T06:06:04.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f960ea00640 1 --2- 172.21.15.122:0/1217840245 >> [v2:172.21.15.122:6835/1474216380,v1:172.21.15.122:6837/1474216380] conn(0x5555fa35a5d0 0x5555fa39d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:04.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f960ea00640 1 --2- 172.21.15.122:0/1217840245 >> [v2:172.21.15.122:6835/1474216380,v1:172.21.15.122:6837/1474216380] conn(0x5555fa35a5d0 0x5555fa39d7c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d261486e1832a215 server_cookie=b3d3bfe4566a2b33 in_seq=0 out_seq=0 2024-05-28T06:06:04.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f95efe00640 10 client.4632 ms_handle_connect on v2:172.21.15.122:6835/1474216380 2024-05-28T06:06:04.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f95efe00640 1 -- 172.21.15.122:0/1217840245 <== mds.0 v2:172.21.15.122:6835/1474216380 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5555fa137e40 con 0x5555fa35a5d0 2024-05-28T06:06:04.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f95efe00640 10 client.4632 handle_command_reply: tid=0 2024-05-28T06:06:04.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9618a02000 1 client.4632 shutdown 2024-05-28T06:06:04.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9618a02000 1 -- 172.21.15.122:0/1217840245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326120 msgr2=0x5555fa359b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:04.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9618a02000 1 --2- 172.21.15.122:0/1217840245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326120 0x5555fa359b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f95fc0f0670 tx=0x7f95fc008000 comp rx=0 tx=0).stop 2024-05-28T06:06:04.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9618a02000 1 -- 172.21.15.122:0/1217840245 shutdown_connections 2024-05-28T06:06:04.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9618a02000 1 --2- 172.21.15.122:0/1217840245 >> [v2:172.21.15.122:6835/1474216380,v1:172.21.15.122:6837/1474216380] conn(0x5555fa35a5d0 0x5555fa39d7c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9618a02000 1 --2- 172.21.15.122:0/1217840245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fa326a40 0x5555fa35a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9618a02000 1 --2- 172.21.15.122:0/1217840245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5555fa326120 0x5555fa359b50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f95efe00640 0 client.4632 ms_handle_reset on v2:172.21.15.122:6835/1474216380 2024-05-28T06:06:04.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9618a02000 1 --2- 172.21.15.122:0/1217840245 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5555fa2d9650 0x5555fa33a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9618a02000 1 -- 172.21.15.122:0/1217840245 >> 172.21.15.122:0/1217840245 conn(0x5555fa306ec0 msgr2=0x5555fa2d8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:04.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9618a02000 1 -- 172.21.15.122:0/1217840245 shutdown_connections 2024-05-28T06:06:04.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9618a02000 1 -- 172.21.15.122:0/1217840245 wait complete. 2024-05-28T06:06:04.033 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9618a02000 20 client.4632 trim_cache size 0 max 16384 2024-05-28T06:06:04.033 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:06:04.033 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:06:04.033 INFO:teuthology.orchestra.run.smithi122.stdout: "whoami": 0, 2024-05-28T06:06:04.033 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 4270, 2024-05-28T06:06:04.033 INFO:teuthology.orchestra.run.smithi122.stdout: "want_state": "up:active", 2024-05-28T06:06:04.033 INFO:teuthology.orchestra.run.smithi122.stdout: "state": "up:active", 2024-05-28T06:06:04.033 INFO:teuthology.orchestra.run.smithi122.stdout: "fs_name": "cephfs", 2024-05-28T06:06:04.033 INFO:teuthology.orchestra.run.smithi122.stdout: "rank_uptime": 14.202289007999999, 2024-05-28T06:06:04.033 INFO:teuthology.orchestra.run.smithi122.stdout: "mdsmap_epoch": 8, 2024-05-28T06:06:04.034 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_epoch": 20, 2024-05-28T06:06:04.034 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_epoch_barrier": 20, 2024-05-28T06:06:04.034 INFO:teuthology.orchestra.run.smithi122.stdout: "uptime": 21.259592097999999 2024-05-28T06:06:04.034 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:06:04.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9615600640 1 -- 172.21.15.122:0/351507267 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f95f00683b0 msgr2=0x7f95f006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:04.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9615600640 1 --2- 172.21.15.122:0/351507267 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f95f00683b0 0x7f95f006a870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9600001770 tx=0x7f9600009040 comp rx=0 tx=0).stop 2024-05-28T06:06:04.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9615600640 1 -- 172.21.15.122:0/351507267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96100ae490 msgr2=0x7f9610074d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:04.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9615600640 1 --2- 172.21.15.122:0/351507267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96100ae490 0x7f9610074d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f95fc01a0d0 tx=0x7f95fc019240 comp rx=0 tx=0).stop 2024-05-28T06:06:04.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9615600640 1 -- 172.21.15.122:0/351507267 shutdown_connections 2024-05-28T06:06:04.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9615600640 1 --2- 172.21.15.122:0/351507267 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f95f00683b0 0x7f95f006a870 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9615600640 1 --2- 172.21.15.122:0/351507267 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f961015eb70 0x7f96100752d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9615600640 1 --2- 172.21.15.122:0/351507267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96100ae490 0x7f9610074d90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9615600640 1 --2- 172.21.15.122:0/351507267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f961006c0a0 0x7f961014d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9615600640 1 -- 172.21.15.122:0/351507267 >> 172.21.15.122:0/351507267 conn(0x7f9610073570 msgr2=0x7f9610159120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:04.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9615600640 1 -- 172.21.15.122:0/351507267 shutdown_connections 2024-05-28T06:06:04.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.025+0000 7f9615600640 1 -- 172.21.15.122:0/351507267 wait complete. 2024-05-28T06:06:04.048 INFO:teuthology.run_tasks:Running task sequential... 2024-05-28T06:06:04.059 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-28T06:06:04.059 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-28T06:06:04.060 INFO:teuthology.task.print:Enabling mgr modules 2024-05-28T06:06:04.060 INFO:teuthology.run_tasks:Running task kclient... 2024-05-28T06:06:04.160 INFO:tasks.kclient:Mounting kernel clients... 2024-05-28T06:06:04.161 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-28T06:06:04.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:04.161 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2024-05-28T06:06:04.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:04.171 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link delete ceph-brx 2024-05-28T06:06:04.235 INFO:teuthology.orchestra.run.smithi122.stderr:Cannot find device "ceph-brx" 2024-05-28T06:06:04.237 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-28T06:06:04.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:04.238 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2024-05-28T06:06:04.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:04.295 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link delete ceph-brx 2024-05-28T06:06:04.360 INFO:teuthology.orchestra.run.smithi122.stderr:Cannot find device "ceph-brx" 2024-05-28T06:06:04.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-28T06:06:04.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:04.362 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-05-28T06:06:04.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:04.372 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-05-28T06:06:04.440 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2024-05-28T06:06:04.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-28T06:06:04.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:04.443 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-05-28T06:06:04.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:04.493 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-05-28T06:06:04.560 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2024-05-28T06:06:04.562 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-28T06:06:04.562 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-05-28T06:06:04.563 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-28T06:06:04.563 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-28T06:06:04.563 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-28T06:06:04.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc37c600640 1 Processor -- start 2024-05-28T06:06:04.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc37c600640 1 -- start start 2024-05-28T06:06:04.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc37c600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc3740d0270 0x7fc37409b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:04.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc37c600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc37415dc70 con 0x7fc37415d7e0 2024-05-28T06:06:04.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc37c600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3740d0830 con 0x7fc3740d0c80 2024-05-28T06:06:04.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc37c600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc37409aa40 con 0x7fc3740d0270 2024-05-28T06:06:04.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc37a600640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fc37415d7e0 0x7fc3740cd1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38714/0 (socket says 172.21.15.122:38714) 2024-05-28T06:06:04.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc37a600640 1 -- 172.21.15.122:0/3893457891 learned_addr learned my addr 172.21.15.122:0/3893457891 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:04.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc379200640 1 --2- 172.21.15.122:0/3893457891 >> v2:172.21.15.153:3300/0 conn(0x7fc3740d0270 0x7fc37409b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:04.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc373e00640 1 -- 172.21.15.122:0/3893457891 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3843212841 0 0) 0x7fc37415dc70 con 0x7fc37415d7e0 2024-05-28T06:06:04.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc373e00640 1 -- 172.21.15.122:0/3893457891 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc35c003530 con 0x7fc37415d7e0 2024-05-28T06:06:04.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc373e00640 1 -- 172.21.15.122:0/3893457891 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2732055561 0 0) 0x7fc3740d0830 con 0x7fc3740d0c80 2024-05-28T06:06:04.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc373e00640 1 -- 172.21.15.122:0/3893457891 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc37415dc70 con 0x7fc3740d0c80 2024-05-28T06:06:04.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc373e00640 1 -- 172.21.15.122:0/3893457891 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1739559066 0 0) 0x7fc35c003530 con 0x7fc37415d7e0 2024-05-28T06:06:04.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc373e00640 1 -- 172.21.15.122:0/3893457891 >> v2:172.21.15.153:3300/0 conn(0x7fc3740d0270 msgr2=0x7fc37409b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:04.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc373e00640 1 --2- 172.21.15.122:0/3893457891 >> v2:172.21.15.153:3300/0 conn(0x7fc3740d0270 0x7fc37409b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc373e00640 1 -- 172.21.15.122:0/3893457891 >> v1:172.21.15.153:6789/0 conn(0x7fc3740d0c80 legacy=0x7fc3740d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:04.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc373e00640 1 -- 172.21.15.122:0/3893457891 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37409ad20 con 0x7fc37415d7e0 2024-05-28T06:06:04.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc373e00640 1 -- 172.21.15.122:0/3893457891 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7fc36c001680 con 0x7fc37415d7e0 2024-05-28T06:06:04.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc373e00640 1 -- 172.21.15.122:0/3893457891 >> v1:172.21.15.122:6789/0 conn(0x7fc37415d7e0 legacy=0x7fc3740cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:04.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc373e00640 1 --2- 172.21.15.122:0/3893457891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc35c003b50 0x7fc35c003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:04.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc373e00640 1 --2- 172.21.15.122:0/3893457891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc35c004810 0x7fc35c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:04.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc373e00640 1 --2- 172.21.15.122:0/3893457891 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc35c0051d0 0x7fc35c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:04.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc373e00640 1 -- 172.21.15.122:0/3893457891 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc37409aa40 con 0x7fc35c003b50 2024-05-28T06:06:04.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc373e00640 1 -- 172.21.15.122:0/3893457891 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc35c00c100 con 0x7fc35c004810 2024-05-28T06:06:04.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc373e00640 1 -- 172.21.15.122:0/3893457891 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc35c00c300 con 0x7fc35c0051d0 2024-05-28T06:06:04.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc379c00640 1 --2- 172.21.15.122:0/3893457891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc35c003b50 0x7fc35c003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:04.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc379200640 1 --2- 172.21.15.122:0/3893457891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc35c004810 0x7fc35c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:04.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc37a600640 1 --2- 172.21.15.122:0/3893457891 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc35c0051d0 0x7fc35c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:04.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc379c00640 1 -- 172.21.15.122:0/3893457891 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc35c0051d0 msgr2=0x7fc35c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:04.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc379c00640 1 --2- 172.21.15.122:0/3893457891 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc35c0051d0 0x7fc35c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc379c00640 1 -- 172.21.15.122:0/3893457891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc35c004810 msgr2=0x7fc35c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:04.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc379c00640 1 --2- 172.21.15.122:0/3893457891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc35c004810 0x7fc35c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc379c00640 1 -- 172.21.15.122:0/3893457891 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35c003530 con 0x7fc35c003b50 2024-05-28T06:06:04.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.697+0000 7fc37a600640 1 -- 172.21.15.122:0/3893457891 reap_dead start 2024-05-28T06:06:04.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.701+0000 7fc379c00640 1 --2- 172.21.15.122:0/3893457891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc35c003b50 0x7fc35c003f50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc368001fd0 tx=0x7fc36801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed55bca2fa53b5b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:04.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.701+0000 7fc373e00640 1 -- 172.21.15.122:0/3893457891 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368001c20 con 0x7fc35c003b50 2024-05-28T06:06:04.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.701+0000 7fc373e00640 1 -- 172.21.15.122:0/3893457891 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc368003ba0 con 0x7fc35c003b50 2024-05-28T06:06:04.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.701+0000 7fc373e00640 1 -- 172.21.15.122:0/3893457891 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3680050d0 con 0x7fc35c003b50 2024-05-28T06:06:04.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.701+0000 7fc37c600640 1 -- 172.21.15.122:0/3893457891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc35c003b50 msgr2=0x7fc35c003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:04.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.701+0000 7fc37c600640 1 --2- 172.21.15.122:0/3893457891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc35c003b50 0x7fc35c003f50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc368001fd0 tx=0x7fc36801c8b0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.701+0000 7fc37c600640 1 -- 172.21.15.122:0/3893457891 shutdown_connections 2024-05-28T06:06:04.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.701+0000 7fc37c600640 1 --2- 172.21.15.122:0/3893457891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc35c003b50 0x7fc35c003f50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.701+0000 7fc37c600640 1 -- 172.21.15.122:0/3893457891 >> 172.21.15.122:0/3893457891 conn(0x7fc3740b4190 msgr2=0x7fc3740b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:04.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.701+0000 7fc37c600640 1 -- 172.21.15.122:0/3893457891 shutdown_connections 2024-05-28T06:06:04.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.701+0000 7fc37c600640 1 -- 172.21.15.122:0/3893457891 wait complete. 2024-05-28T06:06:04.707 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.705+0000 7fc37c600640 1 Processor -- start 2024-05-28T06:06:04.707 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.705+0000 7fc37c600640 1 -- start start 2024-05-28T06:06:04.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.705+0000 7fc37c600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc35c003b50 0x7fc37414dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:04.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.705+0000 7fc37c600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc37409e600 0x7fc37409ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:04.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.705+0000 7fc37c600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc37414e5f0 0x7fc37414ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:04.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.705+0000 7fc37c600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc3740d15f0 con 0x7fc37409e600 2024-05-28T06:06:04.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.705+0000 7fc37c600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc3740d1470 con 0x7fc35c003b50 2024-05-28T06:06:04.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.705+0000 7fc37c600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc374160b10 con 0x7fc37414e5f0 2024-05-28T06:06:04.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.705+0000 7fc379200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc37409e600 0x7fc37409ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:04.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.705+0000 7fc379200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc37409e600 0x7fc37409ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:41860/0 (socket says 172.21.15.122:41860) 2024-05-28T06:06:04.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.705+0000 7fc379200640 1 -- 172.21.15.122:0/1820571634 learned_addr learned my addr 172.21.15.122:0/1820571634 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:04.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.705+0000 7fc379200640 1 -- 172.21.15.122:0/1820571634 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc37414e5f0 msgr2=0x7fc37414ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:04.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.705+0000 7fc379200640 1 --2- 172.21.15.122:0/1820571634 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc37414e5f0 0x7fc37414ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.705+0000 7fc379200640 1 -- 172.21.15.122:0/1820571634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc35c003b50 msgr2=0x7fc37414dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:04.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.705+0000 7fc379200640 1 --2- 172.21.15.122:0/1820571634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc35c003b50 0x7fc37414dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.705+0000 7fc379200640 1 -- 172.21.15.122:0/1820571634 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37409ffb0 con 0x7fc37409e600 2024-05-28T06:06:04.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.705+0000 7fc379200640 1 --2- 172.21.15.122:0/1820571634 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc37409e600 0x7fc37409ea80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc360011ad0 tx=0x7fc360011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:04.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.705+0000 7fc371600640 1 -- 172.21.15.122:0/1820571634 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36000fbb0 con 0x7fc37409e600 2024-05-28T06:06:04.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.705+0000 7fc371600640 1 -- 172.21.15.122:0/1820571634 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc36000fd50 con 0x7fc37409e600 2024-05-28T06:06:04.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.705+0000 7fc37c600640 1 -- 172.21.15.122:0/1820571634 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc37409f3a0 con 0x7fc37409e600 2024-05-28T06:06:04.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.705+0000 7fc371600640 1 -- 172.21.15.122:0/1820571634 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360014680 con 0x7fc37409e600 2024-05-28T06:06:04.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.705+0000 7fc37c600640 1 -- 172.21.15.122:0/1820571634 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc37409f960 con 0x7fc37409e600 2024-05-28T06:06:04.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.709+0000 7fc37c600640 1 -- 172.21.15.122:0/1820571634 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc374068c40 con 0x7fc37409e600 2024-05-28T06:06:04.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.709+0000 7fc371600640 1 -- 172.21.15.122:0/1820571634 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc360012040 con 0x7fc37409e600 2024-05-28T06:06:04.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.709+0000 7fc371600640 1 --2- 172.21.15.122:0/1820571634 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc354068380 0x7fc35406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:04.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.709+0000 7fc371600640 1 -- 172.21.15.122:0/1820571634 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc3600871e0 con 0x7fc37409e600 2024-05-28T06:06:04.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.709+0000 7fc379c00640 1 --2- 172.21.15.122:0/1820571634 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc354068380 0x7fc35406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:04.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.709+0000 7fc379c00640 1 --2- 172.21.15.122:0/1820571634 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc354068380 0x7fc35406a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc3680ac000 tx=0x7fc368001660 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:04.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.713+0000 7fc371600640 1 -- 172.21.15.122:0/1820571634 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc360019030 con 0x7fc37409e600 2024-05-28T06:06:04.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.905+0000 7fc37c600640 1 -- 172.21.15.122:0/1820571634 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc3740b8620 con 0x7fc37409e600 2024-05-28T06:06:04.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.905+0000 7fc371600640 1 -- 172.21.15.122:0/1820571634 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fc360057700 con 0x7fc37409e600 2024-05-28T06:06:04.910 INFO:teuthology.orchestra.run.smithi122.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-28T06:06:04.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.909+0000 7fc37c600640 1 -- 172.21.15.122:0/1820571634 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc354068380 msgr2=0x7fc35406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:04.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.909+0000 7fc37c600640 1 --2- 172.21.15.122:0/1820571634 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc354068380 0x7fc35406a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc3680ac000 tx=0x7fc368001660 comp rx=0 tx=0).stop 2024-05-28T06:06:04.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.909+0000 7fc37c600640 1 -- 172.21.15.122:0/1820571634 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc37409e600 msgr2=0x7fc37409ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:04.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.909+0000 7fc37c600640 1 --2- 172.21.15.122:0/1820571634 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc37409e600 0x7fc37409ea80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc360011ad0 tx=0x7fc360011f90 comp rx=0 tx=0).stop 2024-05-28T06:06:04.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.909+0000 7fc37c600640 1 -- 172.21.15.122:0/1820571634 shutdown_connections 2024-05-28T06:06:04.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.909+0000 7fc37c600640 1 --2- 172.21.15.122:0/1820571634 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc354068380 0x7fc35406a840 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.909+0000 7fc37c600640 1 --2- 172.21.15.122:0/1820571634 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc37414e5f0 0x7fc37414ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.909+0000 7fc37c600640 1 --2- 172.21.15.122:0/1820571634 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc37409e600 0x7fc37409ea80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.909+0000 7fc37c600640 1 --2- 172.21.15.122:0/1820571634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc35c003b50 0x7fc37414dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:04.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.909+0000 7fc37c600640 1 -- 172.21.15.122:0/1820571634 >> 172.21.15.122:0/1820571634 conn(0x7fc3740b4190 msgr2=0x7fc3740ce000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:04.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.909+0000 7fc37c600640 1 -- 172.21.15.122:0/1820571634 shutdown_connections 2024-05-28T06:06:04.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:04.909+0000 7fc37c600640 1 -- 172.21.15.122:0/1820571634 wait complete. 2024-05-28T06:06:04.931 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-28T06:06:04.931 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-28T06:06:04.931 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi122.front.sepia.ceph.com 2024-05-28T06:06:04.931 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-28T06:06:04.931 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-28T06:06:04.931 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-28T06:06:04.931 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-28T06:06:04.931 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-28T06:06:04.931 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-28T06:06:04.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:04.932 DEBUG:teuthology.orchestra.run.smithi122:> ip addr 2024-05-28T06:06:04.940 INFO:teuthology.orchestra.run.smithi122.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-28T06:06:04.940 INFO:teuthology.orchestra.run.smithi122.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-28T06:06:04.940 INFO:teuthology.orchestra.run.smithi122.stdout: inet 127.0.0.1/8 scope host lo 2024-05-28T06:06:04.940 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:04.940 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 ::1/128 scope host 2024-05-28T06:06:04.940 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:04.940 INFO:teuthology.orchestra.run.smithi122.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-28T06:06:04.941 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e4 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:04.941 INFO:teuthology.orchestra.run.smithi122.stdout: altname enp7s0f0 2024-05-28T06:06:04.941 INFO:teuthology.orchestra.run.smithi122.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-28T06:06:04.941 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e5 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:04.941 INFO:teuthology.orchestra.run.smithi122.stdout: altname enp7s0f1 2024-05-28T06:06:04.941 INFO:teuthology.orchestra.run.smithi122.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-28T06:06:04.941 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:14 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:04.941 INFO:teuthology.orchestra.run.smithi122.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-28T06:06:04.941 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:15 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:04.941 INFO:teuthology.orchestra.run.smithi122.stdout: inet 172.21.15.122/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-28T06:06:04.941 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft 42457sec preferred_lft 42457sec 2024-05-28T06:06:04.941 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::ec4:7aff:fe8f:d515/64 scope link 2024-05-28T06:06:04.941 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:04.942 INFO:teuthology.orchestra.run.smithi122.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-28T06:06:04.942 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 02:42:4d:d8:1b:5f brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:04.942 INFO:teuthology.orchestra.run.smithi122.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-28T06:06:04.942 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:04.943 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-28T06:06:04.943 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-28T06:06:04.943 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-05-28T06:06:04.943 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link add name ceph-brx type bridge 2024-05-28T06:06:04.943 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip addr flush dev ceph-brx 2024-05-28T06:06:04.943 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set ceph-brx up 2024-05-28T06:06:04.943 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-28T06:06:04.943 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-05-28T06:06:05.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:06:05.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:05.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:05.099 DEBUG:teuthology.orchestra.run.smithi122:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-28T06:06:05.116 INFO:teuthology.orchestra.run.smithi122.stdout:1 2024-05-28T06:06:05.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:05.119 DEBUG:teuthology.orchestra.run.smithi122:> route 2024-05-28T06:06:05.218 INFO:teuthology.orchestra.run.smithi122.stdout:Kernel IP routing table 2024-05-28T06:06:05.219 INFO:teuthology.orchestra.run.smithi122.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-28T06:06:05.219 INFO:teuthology.orchestra.run.smithi122.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-28T06:06:05.219 INFO:teuthology.orchestra.run.smithi122.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-28T06:06:05.219 INFO:teuthology.orchestra.run.smithi122.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-28T06:06:05.219 INFO:teuthology.orchestra.run.smithi122.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-28T06:06:05.219 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-28T06:06:05.219 INFO:teuthology.orchestra.run.smithi122.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-28T06:06:05.219 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-28T06:06:05.219 INFO:teuthology.orchestra.run.smithi122.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-28T06:06:05.219 INFO:teuthology.orchestra.run.smithi122.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-28T06:06:05.220 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-28T06:06:05.220 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-05-28T06:06:05.220 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-28T06:06:05.220 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-28T06:06:05.220 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-28T06:06:05.220 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-05-28T06:06:05.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:06:05.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:05.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:05.315 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2024-05-28T06:06:05.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:05.367 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list-id 2024-05-28T06:06:05.418 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-28T06:06:05.418 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-05-28T06:06:05.418 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-28T06:06:05.419 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-28T06:06:05.419 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-05-28T06:06:05.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:06:05.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:05.546 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-28T06:06:05.547 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-28T06:06:05.547 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-05-28T06:06:05.547 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-28T06:06:05.547 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-28T06:06:05.547 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-28T06:06:05.547 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-28T06:06:05.547 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-28T06:06:05.547 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-05-28T06:06:05.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:06:05.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:05.756 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-28T06:06:05.756 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-05-28T06:06:05.756 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set brx.0 up 2024-05-28T06:06:05.756 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set dev brx.0 master ceph-brx 2024-05-28T06:06:05.756 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-05-28T06:06:05.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:06:05.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:05.844 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-28T06:06:05.845 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-28T06:06:05.853 INFO:teuthology.orchestra.run.smithi122.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-28T06:06:05.854 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-28T06:06:05.854 DEBUG:teuthology.orchestra.run.smithi122:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-28T06:06:05.905 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-28T06:06:05.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:05.905 DEBUG:teuthology.orchestra.run.smithi122:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-28T06:06:05.994 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-28T06:06:05.994 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-28T06:06:05.994 INFO:teuthology.orchestra.run.smithi122.stdout:invalid new device string format 2024-05-28T06:06:06.593 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-28T06:06:06.593 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-28T06:06:06.593 INFO:teuthology.orchestra.run.smithi122.stdout:invalid new device string format 2024-05-28T06:06:06.593 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.122:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-05-28T06:06:06.593 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-28T06:06:06.605 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-28T06:06:06.606 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-28T06:06:06.606 INFO:teuthology.orchestra.run.smithi122.stdout:invalid new device string format 2024-05-28T06:06:06.606 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.122:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-05-28T06:06:06.606 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-28T06:06:06.606 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.122:6789,172.21.15.153:6789,172.21.15.153:6790" 2024-05-28T06:06:06.606 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.122:6789,172.21.15.153:6789,172.21.15.153:6790:/ 2024-05-28T06:06:06.606 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=e63a9349-baf2-4247-95d1-eb8599fad84f" will pass to kernel 2024-05-28T06:06:06.610 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-28T06:06:06.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:06.610 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-28T06:06:06.631 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-28T06:06:06.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-28T06:06:06.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:06.759 INFO:teuthology.orchestra.run.smithi122.stdout:client4651 2024-05-28T06:06:06.759 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:06:06.759 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:06:06.769 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-28T06:06:06.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-28T06:06:06.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:06.875 INFO:teuthology.orchestra.run.smithi122.stdout:client4651 2024-05-28T06:06:06.875 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-28T06:06:06.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-28T06:06:06.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:06.983 INFO:teuthology.orchestra.run.smithi122.stdout:client4651 2024-05-28T06:06:06.984 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/e63a9349-baf2-4247-95d1-eb8599fad84f.client4651/status') 2024-05-28T06:06:07.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:06:07.090 INFO:teuthology.orchestra.run.smithi122.stdout:instance: client.4651 (3)172.21.15.122:0/4091650262 2024-05-28T06:06:07.091 INFO:teuthology.orchestra.run.smithi122.stdout:blocklisted: false 2024-05-28T06:06:07.091 INFO:teuthology.orchestra.run.smithi122.stderr:0+1 records in 2024-05-28T06:06:07.091 INFO:teuthology.orchestra.run.smithi122.stderr:0+1 records out 2024-05-28T06:06:07.091 INFO:teuthology.orchestra.run.smithi122.stderr:71 bytes copied, 5.1117e-05 s, 1.4 MB/s 2024-05-28T06:06:07.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:07.098 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-05-28T06:06:07.098 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-28T06:06:07.098 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-28T06:06:07.099 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-28T06:06:07.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.233+0000 7f36a2a00640 1 Processor -- start 2024-05-28T06:06:07.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.233+0000 7f36a2a00640 1 -- start start 2024-05-28T06:06:07.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.233+0000 7f36a2a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f369c0b0d90 0x7f369c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:07.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.233+0000 7f36a2a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f369c06f0c0 0x7f369c06f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:07.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.233+0000 7f36a2a00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f369c15bd70 con 0x7f369c159280 2024-05-28T06:06:07.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.233+0000 7f36a2a00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f369c159660 con 0x7f369c0b0d90 2024-05-28T06:06:07.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.233+0000 7f36a2a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f369c073e20 con 0x7f369c06f0c0 2024-05-28T06:06:07.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.233+0000 7f369b400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f369c0b0d90 0x7f369c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:07.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.233+0000 7f369be00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f369c159280 0x7f369c073710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47948/0 (socket says 172.21.15.122:47948) 2024-05-28T06:06:07.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.233+0000 7f369b400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f369c0b0d90 0x7f369c0cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:60344/0 (socket says 172.21.15.122:60344) 2024-05-28T06:06:07.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.233+0000 7f369be00640 1 -- 172.21.15.122:0/3125570085 learned_addr learned my addr 172.21.15.122:0/3125570085 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:07.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.233+0000 7f36a0a00640 1 --2- 172.21.15.122:0/3125570085 >> v2:172.21.15.153:3300/0 conn(0x7f369c06f0c0 0x7f369c06f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:07.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.233+0000 7f369b400640 1 -- 172.21.15.122:0/3125570085 >> v2:172.21.15.153:3300/0 conn(0x7f369c06f0c0 msgr2=0x7f369c06f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:07.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.233+0000 7f369b400640 1 --2- 172.21.15.122:0/3125570085 >> v2:172.21.15.153:3300/0 conn(0x7f369c06f0c0 0x7f369c06f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:07.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.233+0000 7f369b400640 1 -- 172.21.15.122:0/3125570085 >> v1:172.21.15.122:6789/0 conn(0x7f369c159280 legacy=0x7f369c073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:07.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.233+0000 7f369b400640 1 -- 172.21.15.122:0/3125570085 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f369c15c050 con 0x7f369c0b0d90 2024-05-28T06:06:07.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.237+0000 7f369b400640 1 --2- 172.21.15.122:0/3125570085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f369c0b0d90 0x7f369c0cf290 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f369c0cdfa0 tx=0x7f368801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2156e9271c6effc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:07.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.237+0000 7f369aa00640 1 -- 172.21.15.122:0/3125570085 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36880b0070 con 0x7f369c0b0d90 2024-05-28T06:06:07.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.237+0000 7f369aa00640 1 -- 172.21.15.122:0/3125570085 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36880ab600 con 0x7f369c0b0d90 2024-05-28T06:06:07.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.237+0000 7f369aa00640 1 -- 172.21.15.122:0/3125570085 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36880ab9d0 con 0x7f369c0b0d90 2024-05-28T06:06:07.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.237+0000 7f36a2a00640 1 -- 172.21.15.122:0/3125570085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f369c0b0d90 msgr2=0x7f369c0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:07.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.237+0000 7f36a2a00640 1 --2- 172.21.15.122:0/3125570085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f369c0b0d90 0x7f369c0cf290 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f369c0cdfa0 tx=0x7f368801c460 comp rx=0 tx=0).stop 2024-05-28T06:06:07.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.237+0000 7f36a2a00640 1 -- 172.21.15.122:0/3125570085 shutdown_connections 2024-05-28T06:06:07.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.237+0000 7f36a2a00640 1 --2- 172.21.15.122:0/3125570085 >> v2:172.21.15.153:3300/0 conn(0x7f369c06f0c0 0x7f369c06f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:07.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.237+0000 7f36a2a00640 1 --2- 172.21.15.122:0/3125570085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f369c0b0d90 0x7f369c0cf290 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:07.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.237+0000 7f36a2a00640 1 -- 172.21.15.122:0/3125570085 >> 172.21.15.122:0/3125570085 conn(0x7f369c0b6c10 msgr2=0x7f369c0b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:07.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.237+0000 7f36a2a00640 1 -- 172.21.15.122:0/3125570085 shutdown_connections 2024-05-28T06:06:07.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.237+0000 7f36a2a00640 1 -- 172.21.15.122:0/3125570085 wait complete. 2024-05-28T06:06:07.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f36a2a00640 1 Processor -- start 2024-05-28T06:06:07.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f36a2a00640 1 -- start start 2024-05-28T06:06:07.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f36a2a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f369c06f0c0 0x7f369c146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:07.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f36a2a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f369c159280 0x7f369c14f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:07.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f36a2a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f369c15a0e0 0x7f369c15a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:07.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f36a2a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f369c0d1fc0 con 0x7f369c06f0c0 2024-05-28T06:06:07.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f36a2a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f369c0d1e40 con 0x7f369c159280 2024-05-28T06:06:07.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f36a2a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f369c0d2140 con 0x7f369c15a0e0 2024-05-28T06:06:07.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f369be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f369c06f0c0 0x7f369c146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:07.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f369be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f369c06f0c0 0x7f369c146dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:60348/0 (socket says 172.21.15.122:60348) 2024-05-28T06:06:07.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f369be00640 1 -- 172.21.15.122:0/3405802674 learned_addr learned my addr 172.21.15.122:0/3405802674 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:07.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f369be00640 1 -- 172.21.15.122:0/3405802674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f369c15a0e0 msgr2=0x7f369c15a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:07.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f369be00640 1 --2- 172.21.15.122:0/3405802674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f369c15a0e0 0x7f369c15a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:07.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f369b400640 1 --2- 172.21.15.122:0/3405802674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f369c159280 0x7f369c14f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:07.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f369be00640 1 -- 172.21.15.122:0/3405802674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f369c159280 msgr2=0x7f369c14f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:07.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f369be00640 1 --2- 172.21.15.122:0/3405802674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f369c159280 0x7f369c14f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:07.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f369be00640 1 -- 172.21.15.122:0/3405802674 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f369c15d560 con 0x7f369c06f0c0 2024-05-28T06:06:07.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f369b400640 1 --2- 172.21.15.122:0/3405802674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f369c159280 0x7f369c14f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:07.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f369be00640 1 --2- 172.21.15.122:0/3405802674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f369c06f0c0 0x7f369c146dc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f368c00c3a0 tx=0x7f368c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:07.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f3693e00640 1 -- 172.21.15.122:0/3405802674 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368c017070 con 0x7f369c06f0c0 2024-05-28T06:06:07.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f3693e00640 1 -- 172.21.15.122:0/3405802674 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f368c005cf0 con 0x7f369c06f0c0 2024-05-28T06:06:07.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f36a2a00640 1 -- 172.21.15.122:0/3405802674 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f369c15d840 con 0x7f369c06f0c0 2024-05-28T06:06:07.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f3693e00640 1 -- 172.21.15.122:0/3405802674 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368c0072f0 con 0x7f369c06f0c0 2024-05-28T06:06:07.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f36a2a00640 1 -- 172.21.15.122:0/3405802674 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f369c15de00 con 0x7f369c06f0c0 2024-05-28T06:06:07.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.241+0000 7f36a2a00640 1 -- 172.21.15.122:0/3405802674 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f369c068c40 con 0x7f369c06f0c0 2024-05-28T06:06:07.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.244+0000 7f3693e00640 1 -- 172.21.15.122:0/3405802674 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f368c01a070 con 0x7f369c06f0c0 2024-05-28T06:06:07.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.244+0000 7f3693e00640 1 --2- 172.21.15.122:0/3405802674 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f367c068380 0x7f367c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:07.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.244+0000 7f3693e00640 1 -- 172.21.15.122:0/3405802674 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f368c085e00 con 0x7f369c06f0c0 2024-05-28T06:06:07.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.244+0000 7f369b400640 1 --2- 172.21.15.122:0/3405802674 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f367c068380 0x7f367c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:07.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.244+0000 7f369b400640 1 --2- 172.21.15.122:0/3405802674 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f367c068380 0x7f367c06a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f36880ad000 tx=0x7f3688008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:07.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.248+0000 7f3693e00640 1 -- 172.21.15.122:0/3405802674 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f368c056290 con 0x7f369c06f0c0 2024-05-28T06:06:07.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.444+0000 7f36a2a00640 1 -- 172.21.15.122:0/3405802674 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f369c150b60 con 0x7f369c06f0c0 2024-05-28T06:06:07.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.444+0000 7f3693e00640 1 -- 172.21.15.122:0/3405802674 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f368c055b90 con 0x7f369c06f0c0 2024-05-28T06:06:07.447 INFO:teuthology.orchestra.run.smithi122.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-28T06:06:07.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.444+0000 7f36a2a00640 1 -- 172.21.15.122:0/3405802674 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f367c068380 msgr2=0x7f367c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:07.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.444+0000 7f36a2a00640 1 --2- 172.21.15.122:0/3405802674 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f367c068380 0x7f367c06a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f36880ad000 tx=0x7f3688008040 comp rx=0 tx=0).stop 2024-05-28T06:06:07.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.444+0000 7f36a2a00640 1 -- 172.21.15.122:0/3405802674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f369c06f0c0 msgr2=0x7f369c146dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:07.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.444+0000 7f36a2a00640 1 --2- 172.21.15.122:0/3405802674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f369c06f0c0 0x7f369c146dc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f368c00c3a0 tx=0x7f368c00c860 comp rx=0 tx=0).stop 2024-05-28T06:06:07.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.444+0000 7f36a2a00640 1 -- 172.21.15.122:0/3405802674 shutdown_connections 2024-05-28T06:06:07.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.444+0000 7f36a2a00640 1 --2- 172.21.15.122:0/3405802674 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f367c068380 0x7f367c06a840 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:07.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.444+0000 7f36a2a00640 1 --2- 172.21.15.122:0/3405802674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f369c15a0e0 0x7f369c15a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:07.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.444+0000 7f36a2a00640 1 --2- 172.21.15.122:0/3405802674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f369c159280 0x7f369c14f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:07.450 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.444+0000 7f36a2a00640 1 --2- 172.21.15.122:0/3405802674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f369c06f0c0 0x7f369c146dc0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:07.450 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.444+0000 7f36a2a00640 1 -- 172.21.15.122:0/3405802674 >> 172.21.15.122:0/3405802674 conn(0x7f369c0b6c10 msgr2=0x7f369c151360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:07.450 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.444+0000 7f36a2a00640 1 -- 172.21.15.122:0/3405802674 shutdown_connections 2024-05-28T06:06:07.450 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07.444+0000 7f36a2a00640 1 -- 172.21.15.122:0/3405802674 wait complete. 2024-05-28T06:06:07.468 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-28T06:06:07.468 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-28T06:06:07.468 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi122.front.sepia.ceph.com 2024-05-28T06:06:07.468 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-28T06:06:07.469 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-28T06:06:07.469 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-28T06:06:07.469 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-28T06:06:07.469 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-28T06:06:07.469 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-28T06:06:07.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:07.469 DEBUG:teuthology.orchestra.run.smithi122:> ip addr 2024-05-28T06:06:07.478 INFO:teuthology.orchestra.run.smithi122.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-28T06:06:07.478 INFO:teuthology.orchestra.run.smithi122.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-28T06:06:07.478 INFO:teuthology.orchestra.run.smithi122.stdout: inet 127.0.0.1/8 scope host lo 2024-05-28T06:06:07.478 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:07.478 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 ::1/128 scope host 2024-05-28T06:06:07.478 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:07.478 INFO:teuthology.orchestra.run.smithi122.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-28T06:06:07.478 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e4 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:07.479 INFO:teuthology.orchestra.run.smithi122.stdout: altname enp7s0f0 2024-05-28T06:06:07.479 INFO:teuthology.orchestra.run.smithi122.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-28T06:06:07.479 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e5 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:07.479 INFO:teuthology.orchestra.run.smithi122.stdout: altname enp7s0f1 2024-05-28T06:06:07.479 INFO:teuthology.orchestra.run.smithi122.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-28T06:06:07.479 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:14 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:07.479 INFO:teuthology.orchestra.run.smithi122.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-28T06:06:07.479 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:15 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:07.479 INFO:teuthology.orchestra.run.smithi122.stdout: inet 172.21.15.122/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-28T06:06:07.479 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft 42455sec preferred_lft 42455sec 2024-05-28T06:06:07.479 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::ec4:7aff:fe8f:d515/64 scope link 2024-05-28T06:06:07.479 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:07.479 INFO:teuthology.orchestra.run.smithi122.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-28T06:06:07.479 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 02:42:4d:d8:1b:5f brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:07.480 INFO:teuthology.orchestra.run.smithi122.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-28T06:06:07.480 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:07.480 INFO:teuthology.orchestra.run.smithi122.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-28T06:06:07.480 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:07.480 INFO:teuthology.orchestra.run.smithi122.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-28T06:06:07.480 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:07.480 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-28T06:06:07.480 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:07.480 INFO:teuthology.orchestra.run.smithi122.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-28T06:06:07.480 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-28T06:06:07.480 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-28T06:06:07.480 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:07.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:07.481 DEBUG:teuthology.orchestra.run.smithi122:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-28T06:06:07.543 INFO:teuthology.orchestra.run.smithi122.stdout:1 2024-05-28T06:06:07.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:07.545 DEBUG:teuthology.orchestra.run.smithi122:> route 2024-05-28T06:06:07.601 INFO:teuthology.orchestra.run.smithi122.stdout:Kernel IP routing table 2024-05-28T06:06:07.601 INFO:teuthology.orchestra.run.smithi122.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-28T06:06:07.601 INFO:teuthology.orchestra.run.smithi122.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-28T06:06:07.601 INFO:teuthology.orchestra.run.smithi122.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-28T06:06:07.601 INFO:teuthology.orchestra.run.smithi122.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-28T06:06:07.601 INFO:teuthology.orchestra.run.smithi122.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-28T06:06:07.601 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-28T06:06:07.601 INFO:teuthology.orchestra.run.smithi122.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-28T06:06:07.602 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-28T06:06:07.602 INFO:teuthology.orchestra.run.smithi122.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-28T06:06:07.602 INFO:teuthology.orchestra.run.smithi122.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-28T06:06:07.603 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-28T06:06:07.603 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-05-28T06:06:07.603 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-28T06:06:07.603 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-28T06:06:07.603 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-28T06:06:07.603 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-05-28T06:06:07.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:06:07.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:07.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:07.752 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2024-05-28T06:06:07.816 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-28T06:06:07.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:07.817 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list-id 2024-05-28T06:06:07.879 INFO:teuthology.orchestra.run.smithi122.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-28T06:06:07.879 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-28T06:06:07.880 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-05-28T06:06:07.880 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-28T06:06:07.880 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-28T06:06:07.880 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-05-28T06:06:07.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:06:08.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:08.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:08.010 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-28T06:06:08.079 INFO:teuthology.orchestra.run.smithi122.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-28T06:06:08.079 INFO:teuthology.orchestra.run.smithi122.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-28T06:06:08.079 INFO:teuthology.orchestra.run.smithi122.stdout: inet 127.0.0.1/8 scope host lo 2024-05-28T06:06:08.079 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:08.079 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 ::1/128 scope host 2024-05-28T06:06:08.079 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:08.079 INFO:teuthology.orchestra.run.smithi122.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-28T06:06:08.079 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0e:d5:34:ec:74:f5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-28T06:06:08.079 INFO:teuthology.orchestra.run.smithi122.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-28T06:06:08.080 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:08.080 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::cd5:34ff:feec:74f5/64 scope link 2024-05-28T06:06:08.080 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:08.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:08.081 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-28T06:06:08.144 INFO:teuthology.orchestra.run.smithi122.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-28T06:06:08.144 INFO:teuthology.orchestra.run.smithi122.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-28T06:06:08.144 INFO:teuthology.orchestra.run.smithi122.stdout: inet 127.0.0.1/8 scope host lo 2024-05-28T06:06:08.144 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:08.144 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 ::1/128 scope host 2024-05-28T06:06:08.144 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:08.144 INFO:teuthology.orchestra.run.smithi122.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-28T06:06:08.144 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0e:d5:34:ec:74:f5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-28T06:06:08.144 INFO:teuthology.orchestra.run.smithi122.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-28T06:06:08.145 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:08.145 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::cd5:34ff:feec:74f5/64 scope link 2024-05-28T06:06:08.145 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:08.146 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-28T06:06:08.146 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-28T06:06:08.146 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-05-28T06:06:08.146 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-28T06:06:08.146 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-28T06:06:08.146 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-28T06:06:08.147 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-28T06:06:08.147 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-28T06:06:08.147 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-05-28T06:06:08.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:06:08.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:08.328 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-28T06:06:08.328 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-05-28T06:06:08.328 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set brx.1 up 2024-05-28T06:06:08.328 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set dev brx.1 master ceph-brx 2024-05-28T06:06:08.328 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-05-28T06:06:08.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:06:08.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:08.414 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-28T06:06:08.415 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-28T06:06:08.467 INFO:teuthology.orchestra.run.smithi122.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-28T06:06:08.467 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-28T06:06:08.467 DEBUG:teuthology.orchestra.run.smithi122:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-28T06:06:08.521 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-28T06:06:08.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:08.522 DEBUG:teuthology.orchestra.run.smithi122:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-28T06:06:08.609 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-28T06:06:08.610 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-28T06:06:08.610 INFO:teuthology.orchestra.run.smithi122.stdout:invalid new device string format 2024-05-28T06:06:08.625 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-28T06:06:08.625 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-28T06:06:08.625 INFO:teuthology.orchestra.run.smithi122.stdout:invalid new device string format 2024-05-28T06:06:08.625 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.122:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-05-28T06:06:08.625 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-28T06:06:08.635 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-28T06:06:08.635 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-28T06:06:08.635 INFO:teuthology.orchestra.run.smithi122.stdout:invalid new device string format 2024-05-28T06:06:08.635 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.122:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-05-28T06:06:08.635 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-28T06:06:08.635 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.122:6789,172.21.15.153:6789,172.21.15.153:6790" 2024-05-28T06:06:08.636 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.122:6789,172.21.15.153:6789,172.21.15.153:6790:/ 2024-05-28T06:06:08.636 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=e63a9349-baf2-4247-95d1-eb8599fad84f" will pass to kernel 2024-05-28T06:06:08.639 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-28T06:06:08.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:08.639 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-28T06:06:08.702 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-28T06:06:08.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-28T06:06:08.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:08.808 INFO:teuthology.orchestra.run.smithi122.stdout:client4657 2024-05-28T06:06:08.808 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:06:08.808 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:06:08.863 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-28T06:06:08.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-28T06:06:08.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:08.963 INFO:teuthology.orchestra.run.smithi122.stdout:client4657 2024-05-28T06:06:08.963 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-28T06:06:09.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-28T06:06:09.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:09.067 INFO:teuthology.orchestra.run.smithi122.stdout:client4657 2024-05-28T06:06:09.068 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/e63a9349-baf2-4247-95d1-eb8599fad84f.client4657/status') 2024-05-28T06:06:09.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:06:09.170 INFO:teuthology.orchestra.run.smithi122.stdout:instance: client.4657 (3)172.21.15.122:0/1794598992 2024-05-28T06:06:09.170 INFO:teuthology.orchestra.run.smithi122.stdout:blocklisted: false 2024-05-28T06:06:09.171 INFO:teuthology.orchestra.run.smithi122.stderr:0+1 records in 2024-05-28T06:06:09.171 INFO:teuthology.orchestra.run.smithi122.stderr:0+1 records out 2024-05-28T06:06:09.171 INFO:teuthology.orchestra.run.smithi122.stderr:71 bytes copied, 4.9601e-05 s, 1.4 MB/s 2024-05-28T06:06:09.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:09.179 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-05-28T06:06:09.180 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-28T06:06:09.180 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-28T06:06:09.180 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-28T06:06:09.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.368+0000 7ffbc6600640 1 Processor -- start 2024-05-28T06:06:09.373 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.368+0000 7ffbc6600640 1 -- start start 2024-05-28T06:06:09.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.368+0000 7ffbc6600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffbc00cff30 0x7ffbc006f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:09.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.368+0000 7ffbc6600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc00cdf00 con 0x7ffbc00cdb00 2024-05-28T06:06:09.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.368+0000 7ffbc6600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc00d0310 con 0x7ffbc006f6c0 2024-05-28T06:06:09.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.368+0000 7ffbc6600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ffbc006fb30 con 0x7ffbc00cff30 2024-05-28T06:06:09.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.368+0000 7ffbbfe00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7ffbc00cdb00 0x7ffbc00b49b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47950/0 (socket says 172.21.15.122:47950) 2024-05-28T06:06:09.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.368+0000 7ffbbfe00640 1 -- 172.21.15.122:0/886805641 learned_addr learned my addr 172.21.15.122:0/886805641 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:09.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.368+0000 7ffbbf400640 1 --2- 172.21.15.122:0/886805641 >> v2:172.21.15.153:3300/0 conn(0x7ffbc00cff30 0x7ffbc006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:09.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.372+0000 7ffbbe000640 1 -- 172.21.15.122:0/886805641 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 686036564 0 0) 0x7ffbb80014a0 con 0x7ffbc00cdb00 2024-05-28T06:06:09.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.372+0000 7ffbbe000640 1 -- 172.21.15.122:0/886805641 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffba4003530 con 0x7ffbc00cdb00 2024-05-28T06:06:09.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.372+0000 7ffbbf400640 1 -- 172.21.15.122:0/886805641 >> v1:172.21.15.153:6789/0 conn(0x7ffbc006f6c0 legacy=0x7ffbc00cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:09.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.372+0000 7ffbbf400640 1 -- 172.21.15.122:0/886805641 >> v1:172.21.15.122:6789/0 conn(0x7ffbc00cdb00 legacy=0x7ffbc00b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:09.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.372+0000 7ffbbf400640 1 -- 172.21.15.122:0/886805641 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc015be20 con 0x7ffbc00cff30 2024-05-28T06:06:09.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.372+0000 7ffbbf400640 1 --2- 172.21.15.122:0/886805641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbc00cff30 0x7ffbc006f180 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffba80097c0 tx=0x7ffba801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d91674f93e5cebca server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:09.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.372+0000 7ffbbe000640 1 -- 172.21.15.122:0/886805641 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba80a7070 con 0x7ffbc00cff30 2024-05-28T06:06:09.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.372+0000 7ffbbe000640 1 -- 172.21.15.122:0/886805641 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffba80b0070 con 0x7ffbc00cff30 2024-05-28T06:06:09.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.372+0000 7ffbbe000640 1 -- 172.21.15.122:0/886805641 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba80ab890 con 0x7ffbc00cff30 2024-05-28T06:06:09.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.376+0000 7ffbc6600640 1 -- 172.21.15.122:0/886805641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbc00cff30 msgr2=0x7ffbc006f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:09.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.376+0000 7ffbc6600640 1 --2- 172.21.15.122:0/886805641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbc00cff30 0x7ffbc006f180 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffba80097c0 tx=0x7ffba801c470 comp rx=0 tx=0).stop 2024-05-28T06:06:09.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.376+0000 7ffbc6600640 1 -- 172.21.15.122:0/886805641 shutdown_connections 2024-05-28T06:06:09.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.376+0000 7ffbc6600640 1 --2- 172.21.15.122:0/886805641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbc00cff30 0x7ffbc006f180 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:09.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.376+0000 7ffbc6600640 1 -- 172.21.15.122:0/886805641 >> 172.21.15.122:0/886805641 conn(0x7ffbc006bd90 msgr2=0x7ffbc006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:09.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.376+0000 7ffbc6600640 1 -- 172.21.15.122:0/886805641 shutdown_connections 2024-05-28T06:06:09.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.376+0000 7ffbc6600640 1 -- 172.21.15.122:0/886805641 wait complete. 2024-05-28T06:06:09.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.376+0000 7ffbc6600640 1 Processor -- start 2024-05-28T06:06:09.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.376+0000 7ffbc6600640 1 -- start start 2024-05-28T06:06:09.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.376+0000 7ffbc6600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbc006f6c0 0x7ffbc0150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:09.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.376+0000 7ffbc6600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbc00cdb00 0x7ffbc0144e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:09.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.376+0000 7ffbc6600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbc00cff30 0x7ffbc015d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:09.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.376+0000 7ffbc6600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc00b58d0 con 0x7ffbc00cff30 2024-05-28T06:06:09.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.376+0000 7ffbc6600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc015baf0 con 0x7ffbc006f6c0 2024-05-28T06:06:09.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.376+0000 7ffbc6600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ffbc00b5a50 con 0x7ffbc00cdb00 2024-05-28T06:06:09.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.376+0000 7ffbbfe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbc00cff30 0x7ffbc015d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:09.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.376+0000 7ffbbfe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbc00cff30 0x7ffbc015d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:60358/0 (socket says 172.21.15.122:60358) 2024-05-28T06:06:09.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.376+0000 7ffbbfe00640 1 -- 172.21.15.122:0/1103169777 learned_addr learned my addr 172.21.15.122:0/1103169777 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:09.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.376+0000 7ffbbfe00640 1 -- 172.21.15.122:0/1103169777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbc00cdb00 msgr2=0x7ffbc0144e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:09.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.376+0000 7ffbbfe00640 1 --2- 172.21.15.122:0/1103169777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbc00cdb00 0x7ffbc0144e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:09.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.376+0000 7ffbbfe00640 1 -- 172.21.15.122:0/1103169777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbc006f6c0 msgr2=0x7ffbc0150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:09.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.376+0000 7ffbbfe00640 1 --2- 172.21.15.122:0/1103169777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbc006f6c0 0x7ffbc0150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:09.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.376+0000 7ffbbfe00640 1 -- 172.21.15.122:0/1103169777 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc00adc90 con 0x7ffbc00cff30 2024-05-28T06:06:09.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.380+0000 7ffbbfe00640 1 --2- 172.21.15.122:0/1103169777 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbc00cff30 0x7ffbc015d110 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800cb50 tx=0x7ffbb800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:09.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.380+0000 7ffbb7400640 1 -- 172.21.15.122:0/1103169777 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8017070 con 0x7ffbc00cff30 2024-05-28T06:06:09.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.380+0000 7ffbb7400640 1 -- 172.21.15.122:0/1103169777 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb800ad40 con 0x7ffbc00cff30 2024-05-28T06:06:09.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.380+0000 7ffbb7400640 1 -- 172.21.15.122:0/1103169777 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8012620 con 0x7ffbc00cff30 2024-05-28T06:06:09.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.380+0000 7ffbc6600640 1 -- 172.21.15.122:0/1103169777 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc00adf70 con 0x7ffbc00cff30 2024-05-28T06:06:09.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.380+0000 7ffbc6600640 1 -- 172.21.15.122:0/1103169777 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc00ae530 con 0x7ffbc00cff30 2024-05-28T06:06:09.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.380+0000 7ffbc6600640 1 -- 172.21.15.122:0/1103169777 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc0068c40 con 0x7ffbc00cff30 2024-05-28T06:06:09.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.380+0000 7ffbb7400640 1 -- 172.21.15.122:0/1103169777 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffbb801a070 con 0x7ffbc00cff30 2024-05-28T06:06:09.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.380+0000 7ffbb7400640 1 --2- 172.21.15.122:0/1103169777 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffb9c068380 0x7ffb9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:09.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.380+0000 7ffbb7400640 1 -- 172.21.15.122:0/1103169777 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ffbb8086820 con 0x7ffbc00cff30 2024-05-28T06:06:09.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.380+0000 7ffbbf400640 1 --2- 172.21.15.122:0/1103169777 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffb9c068380 0x7ffb9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:09.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.384+0000 7ffbbf400640 1 --2- 172.21.15.122:0/1103169777 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffb9c068380 0x7ffb9c06a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffba80af000 tx=0x7ffba8004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:09.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.384+0000 7ffbb7400640 1 -- 172.21.15.122:0/1103169777 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffbc00cdf00 con 0x7ffbc00cff30 2024-05-28T06:06:09.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.576+0000 7ffbc6600640 1 -- 172.21.15.122:0/1103169777 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ffbc00ccdf0 con 0x7ffbc00cff30 2024-05-28T06:06:09.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.576+0000 7ffbb7400640 1 -- 172.21.15.122:0/1103169777 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7ffbb8056dd0 con 0x7ffbc00cff30 2024-05-28T06:06:09.581 INFO:teuthology.orchestra.run.smithi122.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-28T06:06:09.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.580+0000 7ffbc6600640 1 -- 172.21.15.122:0/1103169777 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffb9c068380 msgr2=0x7ffb9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:09.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.580+0000 7ffbc6600640 1 --2- 172.21.15.122:0/1103169777 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffb9c068380 0x7ffb9c06a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffba80af000 tx=0x7ffba8004740 comp rx=0 tx=0).stop 2024-05-28T06:06:09.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.580+0000 7ffbc6600640 1 -- 172.21.15.122:0/1103169777 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbc00cff30 msgr2=0x7ffbc015d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:09.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.580+0000 7ffbc6600640 1 --2- 172.21.15.122:0/1103169777 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbc00cff30 0x7ffbc015d110 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800cb50 tx=0x7ffbb800a430 comp rx=0 tx=0).stop 2024-05-28T06:06:09.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.580+0000 7ffbc6600640 1 -- 172.21.15.122:0/1103169777 shutdown_connections 2024-05-28T06:06:09.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.580+0000 7ffbc6600640 1 --2- 172.21.15.122:0/1103169777 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffb9c068380 0x7ffb9c06a840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:09.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.580+0000 7ffbc6600640 1 --2- 172.21.15.122:0/1103169777 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbc00cff30 0x7ffbc015d110 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:09.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.580+0000 7ffbc6600640 1 --2- 172.21.15.122:0/1103169777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbc00cdb00 0x7ffbc0144e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:09.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.580+0000 7ffbc6600640 1 --2- 172.21.15.122:0/1103169777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbc006f6c0 0x7ffbc0150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:09.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.580+0000 7ffbc6600640 1 -- 172.21.15.122:0/1103169777 >> 172.21.15.122:0/1103169777 conn(0x7ffbc006bd90 msgr2=0x7ffbc00af030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:09.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.580+0000 7ffbc6600640 1 -- 172.21.15.122:0/1103169777 shutdown_connections 2024-05-28T06:06:09.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:09.580+0000 7ffbc6600640 1 -- 172.21.15.122:0/1103169777 wait complete. 2024-05-28T06:06:09.602 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-28T06:06:09.602 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-28T06:06:09.602 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-05-28T06:06:09.602 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-28T06:06:09.602 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-28T06:06:09.602 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-28T06:06:09.602 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-28T06:06:09.602 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-28T06:06:09.603 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-28T06:06:09.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:09.603 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-05-28T06:06:09.613 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-28T06:06:09.613 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-28T06:06:09.613 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-05-28T06:06:09.613 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:09.613 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-05-28T06:06:09.613 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:09.613 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-28T06:06:09.613 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2024-05-28T06:06:09.614 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-28T06:06:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2024-05-28T06:06:09.614 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-28T06:06:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:09.614 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-28T06:06:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-28T06:06:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42453sec preferred_lft 42453sec 2024-05-28T06:06:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2024-05-28T06:06:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:09.614 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-28T06:06:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:e1:69:64:67 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-28T06:06:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:09.615 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-28T06:06:09.616 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-28T06:06:09.616 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-05-28T06:06:09.616 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add name ceph-brx type bridge 2024-05-28T06:06:09.616 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr flush dev ceph-brx 2024-05-28T06:06:09.616 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set ceph-brx up 2024-05-28T06:06:09.616 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-28T06:06:09.616 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-05-28T06:06:09.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:06:09.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:09.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:09.784 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-28T06:06:09.804 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-05-28T06:06:09.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:09.806 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-05-28T06:06:09.874 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-05-28T06:06:09.875 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-28T06:06:09.875 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-28T06:06:09.875 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-28T06:06:09.875 INFO:teuthology.orchestra.run.smithi153.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-28T06:06:09.875 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-28T06:06:09.875 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-28T06:06:09.875 INFO:teuthology.orchestra.run.smithi153.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-28T06:06:09.875 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-28T06:06:09.875 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-28T06:06:09.875 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-28T06:06:09.876 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-28T06:06:09.876 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-05-28T06:06:09.876 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-28T06:06:09.876 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-28T06:06:09.876 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-28T06:06:09.876 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-05-28T06:06:09.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:06:10.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:10.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:10.018 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-05-28T06:06:10.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:10.073 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2024-05-28T06:06:10.124 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-28T06:06:10.124 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-05-28T06:06:10.124 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-28T06:06:10.124 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-28T06:06:10.124 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-05-28T06:06:10.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:06:10.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:10.249 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-28T06:06:10.250 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-28T06:06:10.250 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-05-28T06:06:10.250 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-28T06:06:10.250 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-28T06:06:10.250 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-28T06:06:10.250 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-28T06:06:10.250 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-28T06:06:10.250 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-05-28T06:06:10.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:06:10.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:10.428 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-28T06:06:10.428 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-05-28T06:06:10.428 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2024-05-28T06:06:10.428 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.0 master ceph-brx 2024-05-28T06:06:10.428 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-05-28T06:06:10.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:06:10.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:10.513 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-28T06:06:10.513 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-28T06:06:10.565 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-28T06:06:10.565 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-28T06:06:10.565 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-28T06:06:10.614 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-28T06:06:10.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:10.615 DEBUG:teuthology.orchestra.run.smithi153:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-28T06:06:10.702 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-28T06:06:10.702 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-28T06:06:10.702 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-05-28T06:06:11.299 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-28T06:06:11.299 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-28T06:06:11.299 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-05-28T06:06:11.299 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.122:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-05-28T06:06:11.299 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-28T06:06:11.312 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-28T06:06:11.312 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-28T06:06:11.312 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-05-28T06:06:11.312 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.122:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-05-28T06:06:11.312 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-28T06:06:11.312 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.122:6789,172.21.15.153:6789,172.21.15.153:6790" 2024-05-28T06:06:11.312 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.122:6789,172.21.15.153:6789,172.21.15.153:6790:/ 2024-05-28T06:06:11.312 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=e63a9349-baf2-4247-95d1-eb8599fad84f" will pass to kernel 2024-05-28T06:06:11.316 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-28T06:06:11.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:11.316 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-28T06:06:11.382 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-28T06:06:11.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-28T06:06:11.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:11.494 INFO:teuthology.orchestra.run.smithi153.stdout:client4484 2024-05-28T06:06:11.494 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:06:11.494 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:06:11.503 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-28T06:06:11.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-28T06:06:11.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:11.603 INFO:teuthology.orchestra.run.smithi153.stdout:client4484 2024-05-28T06:06:11.603 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-28T06:06:11.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-28T06:06:11.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:11.658 INFO:teuthology.orchestra.run.smithi153.stdout:client4484 2024-05-28T06:06:11.659 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/e63a9349-baf2-4247-95d1-eb8599fad84f.client4484/status') 2024-05-28T06:06:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:06:11.758 INFO:teuthology.orchestra.run.smithi153.stdout:instance: client.4484 (3)192.168.0.1:0/807547319 2024-05-28T06:06:11.758 INFO:teuthology.orchestra.run.smithi153.stdout:blocklisted: false 2024-05-28T06:06:11.758 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records in 2024-05-28T06:06:11.758 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records out 2024-05-28T06:06:11.758 INFO:teuthology.orchestra.run.smithi153.stderr:68 bytes copied, 6.7206e-05 s, 1.0 MB/s 2024-05-28T06:06:11.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:11.766 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-05-28T06:06:11.766 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-28T06:06:11.766 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-28T06:06:11.766 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-28T06:06:11.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.904+0000 7f9686200640 1 Processor -- start 2024-05-28T06:06:11.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.904+0000 7f9686200640 1 -- start start 2024-05-28T06:06:11.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.908+0000 7f9686200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f968015b430 0x7f96800cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:11.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.908+0000 7f9686200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f968015b810 0x7f96800b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:11.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.908+0000 7f9686200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f968015bdb0 con 0x7f96800ccc10 2024-05-28T06:06:11.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.908+0000 7f9686200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f968015c090 con 0x7f968015b430 2024-05-28T06:06:11.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.908+0000 7f9686200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f968015c370 con 0x7f968015b810 2024-05-28T06:06:11.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.908+0000 7f9684e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f968015b430 0x7f96800cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:11.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.908+0000 7f9685800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f96800ccc10 0x7f96800ce6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47960/0 (socket says 172.21.15.122:47960) 2024-05-28T06:06:11.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.908+0000 7f9684e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f968015b430 0x7f96800cf890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:60368/0 (socket says 172.21.15.122:60368) 2024-05-28T06:06:11.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.908+0000 7f9685800640 1 -- 172.21.15.122:0/3137587516 learned_addr learned my addr 172.21.15.122:0/3137587516 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:11.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.908+0000 7f967fe00640 1 --2- 172.21.15.122:0/3137587516 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f968015b810 0x7f96800b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:11.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.908+0000 7f9684e00640 1 -- 172.21.15.122:0/3137587516 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f968015b810 msgr2=0x7f96800b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:11.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.908+0000 7f9684e00640 1 --2- 172.21.15.122:0/3137587516 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f968015b810 0x7f96800b31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:11.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.908+0000 7f9684e00640 1 -- 172.21.15.122:0/3137587516 >> v1:172.21.15.122:6789/0 conn(0x7f96800ccc10 legacy=0x7f96800ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:11.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.908+0000 7f9684e00640 1 -- 172.21.15.122:0/3137587516 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968015c650 con 0x7f968015b430 2024-05-28T06:06:11.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.908+0000 7f967f400640 1 -- 172.21.15.122:0/3137587516 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 34675240 0 0) 0x7f968015bdb0 con 0x7f96800ccc10 2024-05-28T06:06:11.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.908+0000 7f9684e00640 1 --2- 172.21.15.122:0/3137587516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f968015b430 0x7f96800cf890 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f96700097c0 tx=0x7f967001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c954581c5b9138e server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:11.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f967f400640 1 -- 172.21.15.122:0/3137587516 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96700aa5f0 con 0x7f968015b430 2024-05-28T06:06:11.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f967f400640 1 -- 172.21.15.122:0/3137587516 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96700af070 con 0x7f968015b430 2024-05-28T06:06:11.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f967f400640 1 -- 172.21.15.122:0/3137587516 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96700aa9b0 con 0x7f968015b430 2024-05-28T06:06:11.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f9686200640 1 -- 172.21.15.122:0/3137587516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f968015b430 msgr2=0x7f96800cf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:11.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f9686200640 1 --2- 172.21.15.122:0/3137587516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f968015b430 0x7f96800cf890 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f96700097c0 tx=0x7f967001c470 comp rx=0 tx=0).stop 2024-05-28T06:06:11.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f9686200640 1 -- 172.21.15.122:0/3137587516 shutdown_connections 2024-05-28T06:06:11.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f9686200640 1 --2- 172.21.15.122:0/3137587516 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f968015b810 0x7f96800b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:11.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f9686200640 1 --2- 172.21.15.122:0/3137587516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f968015b430 0x7f96800cf890 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:11.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f9686200640 1 -- 172.21.15.122:0/3137587516 >> 172.21.15.122:0/3137587516 conn(0x7f96800b20a0 msgr2=0x7f96800b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:11.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f9686200640 1 -- 172.21.15.122:0/3137587516 shutdown_connections 2024-05-28T06:06:11.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f9686200640 1 -- 172.21.15.122:0/3137587516 wait complete. 2024-05-28T06:06:11.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f9686200640 1 Processor -- start 2024-05-28T06:06:11.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f9686200640 1 -- start start 2024-05-28T06:06:11.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f9686200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96800ccc10 0x7f9680156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:11.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f9686200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f968015b430 0x7f9680154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:11.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f9686200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f968015b810 0x7f968015cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:11.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f9686200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f96800b3890 con 0x7f968015b430 2024-05-28T06:06:11.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f9686200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f96800b3710 con 0x7f96800ccc10 2024-05-28T06:06:11.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f9686200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f968006b990 con 0x7f968015b810 2024-05-28T06:06:11.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f967fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f968015b430 0x7f9680154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:11.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f967fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f968015b430 0x7f9680154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:60376/0 (socket says 172.21.15.122:60376) 2024-05-28T06:06:11.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f967fe00640 1 -- 172.21.15.122:0/877595057 learned_addr learned my addr 172.21.15.122:0/877595057 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:11.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f9685800640 1 --2- 172.21.15.122:0/877595057 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f968015b810 0x7f968015cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:11.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f9684e00640 1 --2- 172.21.15.122:0/877595057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96800ccc10 0x7f9680156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:11.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f967fe00640 1 -- 172.21.15.122:0/877595057 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f968015b810 msgr2=0x7f968015cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:11.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.912+0000 7f967fe00640 1 --2- 172.21.15.122:0/877595057 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f968015b810 0x7f968015cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:11.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.916+0000 7f967fe00640 1 -- 172.21.15.122:0/877595057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96800ccc10 msgr2=0x7f9680156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:11.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.916+0000 7f967fe00640 1 --2- 172.21.15.122:0/877595057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96800ccc10 0x7f9680156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:11.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.916+0000 7f967fe00640 1 -- 172.21.15.122:0/877595057 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96801568c0 con 0x7f968015b430 2024-05-28T06:06:11.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.916+0000 7f9685800640 1 --2- 172.21.15.122:0/877595057 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f968015b810 0x7f968015cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:11.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.916+0000 7f9684e00640 1 --2- 172.21.15.122:0/877595057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96800ccc10 0x7f9680156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:11.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.916+0000 7f967fe00640 1 --2- 172.21.15.122:0/877595057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f968015b430 0x7f9680154630 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f966c00d5f0 tx=0x7f966c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:11.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.916+0000 7f967cc00640 1 -- 172.21.15.122:0/877595057 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966c0125f0 con 0x7f968015b430 2024-05-28T06:06:11.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.916+0000 7f967cc00640 1 -- 172.21.15.122:0/877595057 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f966c019070 con 0x7f968015b430 2024-05-28T06:06:11.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.916+0000 7f967cc00640 1 -- 172.21.15.122:0/877595057 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966c0129b0 con 0x7f968015b430 2024-05-28T06:06:11.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.916+0000 7f9686200640 1 -- 172.21.15.122:0/877595057 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9680156ba0 con 0x7f968015b430 2024-05-28T06:06:11.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.916+0000 7f9686200640 1 -- 172.21.15.122:0/877595057 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9680157160 con 0x7f968015b430 2024-05-28T06:06:11.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.916+0000 7f9686200640 1 -- 172.21.15.122:0/877595057 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9680075620 con 0x7f968015b430 2024-05-28T06:06:11.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.916+0000 7f967cc00640 1 -- 172.21.15.122:0/877595057 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f966c012b50 con 0x7f968015b430 2024-05-28T06:06:11.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.916+0000 7f967cc00640 1 --2- 172.21.15.122:0/877595057 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9660068380 0x7f966006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:11.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.916+0000 7f967cc00640 1 -- 172.21.15.122:0/877595057 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f966c086ea0 con 0x7f968015b430 2024-05-28T06:06:11.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.916+0000 7f9684e00640 1 --2- 172.21.15.122:0/877595057 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9660068380 0x7f966006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:11.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.920+0000 7f9684e00640 1 --2- 172.21.15.122:0/877595057 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9660068380 0x7f966006a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f96700ae000 tx=0x7f96700a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:11.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:11.920+0000 7f967cc00640 1 -- 172.21.15.122:0/877595057 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f966c0573c0 con 0x7f968015b430 2024-05-28T06:06:12.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:12.112+0000 7f9686200640 1 -- 172.21.15.122:0/877595057 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f96800cc320 con 0x7f968015b430 2024-05-28T06:06:12.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:12.112+0000 7f967cc00640 1 -- 172.21.15.122:0/877595057 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f966c056cc0 con 0x7f968015b430 2024-05-28T06:06:12.118 INFO:teuthology.orchestra.run.smithi122.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-28T06:06:12.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:12.116+0000 7f9686200640 1 -- 172.21.15.122:0/877595057 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9660068380 msgr2=0x7f966006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:12.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:12.116+0000 7f9686200640 1 --2- 172.21.15.122:0/877595057 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9660068380 0x7f966006a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f96700ae000 tx=0x7f96700a7000 comp rx=0 tx=0).stop 2024-05-28T06:06:12.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:12.116+0000 7f9686200640 1 -- 172.21.15.122:0/877595057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f968015b430 msgr2=0x7f9680154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:12.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:12.116+0000 7f9686200640 1 --2- 172.21.15.122:0/877595057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f968015b430 0x7f9680154630 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f966c00d5f0 tx=0x7f966c00dab0 comp rx=0 tx=0).stop 2024-05-28T06:06:12.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:12.116+0000 7f9686200640 1 -- 172.21.15.122:0/877595057 shutdown_connections 2024-05-28T06:06:12.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:12.116+0000 7f9686200640 1 --2- 172.21.15.122:0/877595057 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9660068380 0x7f966006a840 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:12.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:12.116+0000 7f9686200640 1 --2- 172.21.15.122:0/877595057 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f968015b810 0x7f968015cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:12.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:12.116+0000 7f9686200640 1 --2- 172.21.15.122:0/877595057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f968015b430 0x7f9680154630 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:12.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:12.116+0000 7f9686200640 1 --2- 172.21.15.122:0/877595057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96800ccc10 0x7f9680156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:12.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:12.116+0000 7f9686200640 1 -- 172.21.15.122:0/877595057 >> 172.21.15.122:0/877595057 conn(0x7f96800b20a0 msgr2=0x7f9680165010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:12.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:12.116+0000 7f9686200640 1 -- 172.21.15.122:0/877595057 shutdown_connections 2024-05-28T06:06:12.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:12.116+0000 7f9686200640 1 -- 172.21.15.122:0/877595057 wait complete. 2024-05-28T06:06:12.138 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-28T06:06:12.138 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-28T06:06:12.138 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-05-28T06:06:12.138 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-28T06:06:12.138 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-28T06:06:12.138 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-28T06:06:12.138 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-28T06:06:12.138 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-28T06:06:12.138 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-28T06:06:12.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:12.139 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-05-28T06:06:12.147 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-28T06:06:12.148 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-28T06:06:12.148 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-05-28T06:06:12.148 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:12.148 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-05-28T06:06:12.148 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:12.148 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-28T06:06:12.148 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:12.148 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2024-05-28T06:06:12.148 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-28T06:06:12.148 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:12.148 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2024-05-28T06:06:12.148 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-28T06:06:12.149 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:12.149 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-28T06:06:12.149 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:12.149 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-28T06:06:12.149 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42450sec preferred_lft 42450sec 2024-05-28T06:06:12.149 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2024-05-28T06:06:12.149 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:12.149 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-28T06:06:12.149 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:e1:69:64:67 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:12.149 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-28T06:06:12.149 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:12.149 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-28T06:06:12.149 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:12.149 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-28T06:06:12.150 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:12.150 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-05-28T06:06:12.150 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:12.150 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-28T06:06:12.150 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-28T06:06:12.150 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-28T06:06:12.150 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:12.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:12.151 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-28T06:06:12.209 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-05-28T06:06:12.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:12.211 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-05-28T06:06:12.263 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-05-28T06:06:12.263 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-28T06:06:12.263 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-28T06:06:12.263 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-28T06:06:12.263 INFO:teuthology.orchestra.run.smithi153.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-28T06:06:12.263 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-28T06:06:12.263 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-28T06:06:12.264 INFO:teuthology.orchestra.run.smithi153.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-28T06:06:12.264 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-28T06:06:12.264 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-28T06:06:12.264 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-28T06:06:12.264 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-28T06:06:12.264 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-05-28T06:06:12.264 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-28T06:06:12.264 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-28T06:06:12.264 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-28T06:06:12.264 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-05-28T06:06:12.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:06:12.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:12.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:12.402 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-05-28T06:06:12.456 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-28T06:06:12.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:12.457 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2024-05-28T06:06:12.511 INFO:teuthology.orchestra.run.smithi153.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-28T06:06:12.512 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-28T06:06:12.512 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-05-28T06:06:12.512 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-28T06:06:12.512 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-28T06:06:12.513 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-05-28T06:06:12.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:06:12.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:12.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:12.637 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-28T06:06:12.657 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-28T06:06:12.657 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-28T06:06:12.657 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-05-28T06:06:12.657 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:12.657 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-05-28T06:06:12.657 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:12.657 INFO:teuthology.orchestra.run.smithi153.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-28T06:06:12.657 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 12:8e:33:3e:ff:5a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-28T06:06:12.657 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-28T06:06:12.658 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:12.658 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::108e:33ff:fe3e:ff5a/64 scope link 2024-05-28T06:06:12.658 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:12.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:12.659 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-28T06:06:12.720 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-28T06:06:12.721 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-28T06:06:12.721 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-05-28T06:06:12.721 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:12.721 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-05-28T06:06:12.721 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:12.721 INFO:teuthology.orchestra.run.smithi153.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-28T06:06:12.721 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 12:8e:33:3e:ff:5a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-28T06:06:12.721 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-28T06:06:12.721 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:12.722 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::108e:33ff:fe3e:ff5a/64 scope link 2024-05-28T06:06:12.722 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:12.723 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-28T06:06:12.723 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-28T06:06:12.723 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-05-28T06:06:12.723 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-28T06:06:12.723 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-28T06:06:12.724 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-28T06:06:12.724 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-28T06:06:12.724 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-28T06:06:12.724 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-05-28T06:06:12.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:06:12.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:12.904 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-28T06:06:12.904 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-05-28T06:06:12.904 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.1 up 2024-05-28T06:06:12.904 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.1 master ceph-brx 2024-05-28T06:06:12.904 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-05-28T06:06:12.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:06:12.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:12.989 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-28T06:06:12.989 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-28T06:06:12.998 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-28T06:06:12.998 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-28T06:06:12.998 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-28T06:06:13.053 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-28T06:06:13.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:13.053 DEBUG:teuthology.orchestra.run.smithi153:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-28T06:06:13.144 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-28T06:06:13.144 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-28T06:06:13.144 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-05-28T06:06:13.159 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-28T06:06:13.159 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-28T06:06:13.159 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-05-28T06:06:13.159 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.122:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-05-28T06:06:13.159 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-28T06:06:13.169 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-28T06:06:13.169 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-28T06:06:13.169 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-05-28T06:06:13.170 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.122:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-05-28T06:06:13.170 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-28T06:06:13.170 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.122:6789,172.21.15.153:6789,172.21.15.153:6790" 2024-05-28T06:06:13.170 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.122:6789,172.21.15.153:6789,172.21.15.153:6790:/ 2024-05-28T06:06:13.170 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=e63a9349-baf2-4247-95d1-eb8599fad84f" will pass to kernel 2024-05-28T06:06:13.173 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-28T06:06:13.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:13.173 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-28T06:06:13.192 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-28T06:06:13.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-28T06:06:13.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:13.294 INFO:teuthology.orchestra.run.smithi153.stdout:client4669 2024-05-28T06:06:13.294 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:06:13.294 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:06:13.347 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-28T06:06:13.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-28T06:06:13.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:13.447 INFO:teuthology.orchestra.run.smithi153.stdout:client4669 2024-05-28T06:06:13.447 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-28T06:06:13.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-28T06:06:13.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:13.547 INFO:teuthology.orchestra.run.smithi153.stdout:client4669 2024-05-28T06:06:13.548 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/e63a9349-baf2-4247-95d1-eb8599fad84f.client4669/status') 2024-05-28T06:06:13.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:06:13.606 INFO:teuthology.orchestra.run.smithi153.stdout:instance: client.4669 (3)192.168.0.2:0/1025253423 2024-05-28T06:06:13.606 INFO:teuthology.orchestra.run.smithi153.stdout:blocklisted: false 2024-05-28T06:06:13.607 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records in 2024-05-28T06:06:13.607 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records out 2024-05-28T06:06:13.607 INFO:teuthology.orchestra.run.smithi153.stderr:69 bytes copied, 4.9082e-05 s, 1.4 MB/s 2024-05-28T06:06:13.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-05-28T06:06:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:13.614 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-28T06:06:13.630 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:06:13.777 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.772+0000 7f02d9800640 1 Processor -- start 2024-05-28T06:06:13.777 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.772+0000 7f02d9800640 1 -- start start 2024-05-28T06:06:13.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.772+0000 7f02d9800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02d4147410 0x7f02d40afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:13.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.772+0000 7f02d9800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f02d40adac0 0x7f02d406e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:13.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.772+0000 7f02d9800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02d40adf20 con 0x7f02d40722a0 2024-05-28T06:06:13.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.772+0000 7f02d9800640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f02d40b5310 con 0x7f02d40adac0 2024-05-28T06:06:13.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.772+0000 7f02d9800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f02d406e5b0 con 0x7f02d4147410 2024-05-28T06:06:13.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.776+0000 7f02ca000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f02d40adac0 0x7f02d406e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:13.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.776+0000 7f02d3400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f02d40722a0 0x7f02d40b5a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47974/0 (socket says 172.21.15.122:47974) 2024-05-28T06:06:13.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.776+0000 7f02d3400640 1 -- 172.21.15.122:0/2541045722 learned_addr learned my addr 172.21.15.122:0/2541045722 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:13.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.776+0000 7f02d2a00640 1 --2- 172.21.15.122:0/2541045722 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02d4147410 0x7f02d40afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:13.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.776+0000 7f02ca000640 1 -- 172.21.15.122:0/2541045722 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02d4147410 msgr2=0x7f02d40afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:13.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.776+0000 7f02ca000640 1 --2- 172.21.15.122:0/2541045722 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02d4147410 0x7f02d40afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:13.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.776+0000 7f02ca000640 1 -- 172.21.15.122:0/2541045722 >> v1:172.21.15.122:6789/0 conn(0x7f02d40722a0 legacy=0x7f02d40b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:13.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.776+0000 7f02ca000640 1 -- 172.21.15.122:0/2541045722 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d406e7f0 con 0x7f02d40adac0 2024-05-28T06:06:13.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.776+0000 7f02d2000640 1 -- 172.21.15.122:0/2541045722 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3353259634 0 0) 0x7f02cc001120 con 0x7f02d40722a0 2024-05-28T06:06:13.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.776+0000 7f02ca000640 1 --2- 172.21.15.122:0/2541045722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02d40adac0 0x7f02d406e070 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f02bc009d90 tx=0x7f02bc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f594298bce1ed09 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:13.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.776+0000 7f02d2000640 1 -- 172.21.15.122:0/2541045722 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc0b2070 con 0x7f02d40adac0 2024-05-28T06:06:13.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.776+0000 7f02d2000640 1 -- 172.21.15.122:0/2541045722 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02bc0a5830 con 0x7f02d40adac0 2024-05-28T06:06:13.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.776+0000 7f02d2000640 1 -- 172.21.15.122:0/2541045722 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc0a5c00 con 0x7f02d40adac0 2024-05-28T06:06:13.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02d9800640 1 -- 172.21.15.122:0/2541045722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02d40adac0 msgr2=0x7f02d406e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:13.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02d9800640 1 --2- 172.21.15.122:0/2541045722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02d40adac0 0x7f02d406e070 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f02bc009d90 tx=0x7f02bc01c970 comp rx=0 tx=0).stop 2024-05-28T06:06:13.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02d9800640 1 -- 172.21.15.122:0/2541045722 shutdown_connections 2024-05-28T06:06:13.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02d9800640 1 --2- 172.21.15.122:0/2541045722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02d40adac0 0x7f02d406e070 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:13.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02d9800640 1 --2- 172.21.15.122:0/2541045722 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02d4147410 0x7f02d40afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:13.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02d9800640 1 -- 172.21.15.122:0/2541045722 >> 172.21.15.122:0/2541045722 conn(0x7f02d406bd90 msgr2=0x7f02d406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:13.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02d9800640 1 -- 172.21.15.122:0/2541045722 shutdown_connections 2024-05-28T06:06:13.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02d9800640 1 -- 172.21.15.122:0/2541045722 wait complete. 2024-05-28T06:06:13.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02d9800640 1 Processor -- start 2024-05-28T06:06:13.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02d9800640 1 -- start start 2024-05-28T06:06:13.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02d9800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02d40722a0 0x7f02d4137ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:13.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02d9800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02d40adac0 0x7f02d413e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:13.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02d9800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02d4147410 0x7f02d4141600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:13.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02d9800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f02d41477f0 con 0x7f02d40adac0 2024-05-28T06:06:13.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02d9800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f02d4072b00 con 0x7f02d4147410 2024-05-28T06:06:13.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02d9800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f02d4147970 con 0x7f02d40722a0 2024-05-28T06:06:13.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02ca000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02d40adac0 0x7f02d413e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:13.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02ca000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02d40adac0 0x7f02d413e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:60402/0 (socket says 172.21.15.122:60402) 2024-05-28T06:06:13.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02ca000640 1 -- 172.21.15.122:0/418509299 learned_addr learned my addr 172.21.15.122:0/418509299 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:13.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02d2a00640 1 --2- 172.21.15.122:0/418509299 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02d40722a0 0x7f02d4137ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:13.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02d3400640 1 --2- 172.21.15.122:0/418509299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02d4147410 0x7f02d4141600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:13.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02ca000640 1 -- 172.21.15.122:0/418509299 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02d40722a0 msgr2=0x7f02d4137ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:13.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02ca000640 1 --2- 172.21.15.122:0/418509299 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02d40722a0 0x7f02d4137ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:13.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02ca000640 1 -- 172.21.15.122:0/418509299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02d4147410 msgr2=0x7f02d4141600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:13.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02ca000640 1 --2- 172.21.15.122:0/418509299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02d4147410 0x7f02d4141600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:13.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02ca000640 1 -- 172.21.15.122:0/418509299 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d4138530 con 0x7f02d40adac0 2024-05-28T06:06:13.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.780+0000 7f02d3400640 1 --2- 172.21.15.122:0/418509299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02d4147410 0x7f02d4141600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:13.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.784+0000 7f02ca000640 1 --2- 172.21.15.122:0/418509299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02d40adac0 0x7f02d413e770 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f02bc0b0040 tx=0x7f02bc019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:13.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.784+0000 7f02cb400640 1 -- 172.21.15.122:0/418509299 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc0bd020 con 0x7f02d40adac0 2024-05-28T06:06:13.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.784+0000 7f02cb400640 1 -- 172.21.15.122:0/418509299 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02bc0b8670 con 0x7f02d40adac0 2024-05-28T06:06:13.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.784+0000 7f02d9800640 1 -- 172.21.15.122:0/418509299 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d415f670 con 0x7f02d40adac0 2024-05-28T06:06:13.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.784+0000 7f02cb400640 1 -- 172.21.15.122:0/418509299 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc0b2040 con 0x7f02d40adac0 2024-05-28T06:06:13.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.784+0000 7f02d9800640 1 -- 172.21.15.122:0/418509299 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d415fc30 con 0x7f02d40adac0 2024-05-28T06:06:13.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.784+0000 7f02d9800640 1 -- 172.21.15.122:0/418509299 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02d4068c40 con 0x7f02d40adac0 2024-05-28T06:06:13.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.784+0000 7f02cb400640 1 -- 172.21.15.122:0/418509299 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f02bc0c0020 con 0x7f02d40adac0 2024-05-28T06:06:13.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.784+0000 7f02cb400640 1 --2- 172.21.15.122:0/418509299 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f02b0068380 0x7f02b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:13.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.784+0000 7f02cb400640 1 -- 172.21.15.122:0/418509299 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f02bc121940 con 0x7f02d40adac0 2024-05-28T06:06:13.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.784+0000 7f02d2a00640 1 --2- 172.21.15.122:0/418509299 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f02b0068380 0x7f02b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:13.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.788+0000 7f02d2a00640 1 --2- 172.21.15.122:0/418509299 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f02b0068380 0x7f02b006a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f02c40079c0 tx=0x7f02c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:13.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.788+0000 7f02cb400640 1 -- 172.21.15.122:0/418509299 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f02bc0c7070 con 0x7f02d40adac0 2024-05-28T06:06:13.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.952+0000 7f02d9800640 1 -- 172.21.15.122:0/418509299 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f02d406fbb0 con 0x7f02d40adac0 2024-05-28T06:06:13.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.952+0000 7f02cb400640 1 -- 172.21.15.122:0/418509299 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f02bc016560 con 0x7f02d40adac0 2024-05-28T06:06:13.957 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:13.957 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":20,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:05:50.822555+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:05:47.441193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-28T06:05:48.148164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:06:13.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.956+0000 7f02d9800640 1 -- 172.21.15.122:0/418509299 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f02b0068380 msgr2=0x7f02b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:13.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.956+0000 7f02d9800640 1 --2- 172.21.15.122:0/418509299 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f02b0068380 0x7f02b006a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f02c40079c0 tx=0x7f02c4008040 comp rx=0 tx=0).stop 2024-05-28T06:06:13.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.956+0000 7f02d9800640 1 -- 172.21.15.122:0/418509299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02d40adac0 msgr2=0x7f02d413e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:13.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.956+0000 7f02d9800640 1 --2- 172.21.15.122:0/418509299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02d40adac0 0x7f02d413e770 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f02bc0b0040 tx=0x7f02bc019710 comp rx=0 tx=0).stop 2024-05-28T06:06:13.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.956+0000 7f02d9800640 1 -- 172.21.15.122:0/418509299 shutdown_connections 2024-05-28T06:06:13.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.956+0000 7f02d9800640 1 --2- 172.21.15.122:0/418509299 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f02b0068380 0x7f02b006a840 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:13.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.956+0000 7f02d9800640 1 --2- 172.21.15.122:0/418509299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02d4147410 0x7f02d4141600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:13.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.956+0000 7f02d9800640 1 --2- 172.21.15.122:0/418509299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02d40adac0 0x7f02d413e770 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:13.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.956+0000 7f02d9800640 1 --2- 172.21.15.122:0/418509299 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02d40722a0 0x7f02d4137ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:13.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.956+0000 7f02d9800640 1 -- 172.21.15.122:0/418509299 >> 172.21.15.122:0/418509299 conn(0x7f02d406bd90 msgr2=0x7f02d40b24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:13.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.956+0000 7f02d9800640 1 -- 172.21.15.122:0/418509299 shutdown_connections 2024-05-28T06:06:13.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:13.956+0000 7f02d9800640 1 -- 172.21.15.122:0/418509299 wait complete. 2024-05-28T06:06:13.978 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-28T06:05:47.441193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-28T06:05:48.148164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:06:13.979 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:06:14.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.112+0000 7f9c25200640 1 Processor -- start 2024-05-28T06:06:14.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.112+0000 7f9c25200640 1 -- start start 2024-05-28T06:06:14.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.116+0000 7f9c25200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9c2006ee40 0x7f9c2006f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:14.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.116+0000 7f9c25200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9c200705c0 0x7f9c200ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:14.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.116+0000 7f9c25200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c20070050 con 0x7f9c200ae700 2024-05-28T06:06:14.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.116+0000 7f9c25200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f9c200cbe50 con 0x7f9c200705c0 2024-05-28T06:06:14.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.116+0000 7f9c25200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9c2006f760 con 0x7f9c2006ee40 2024-05-28T06:06:14.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.116+0000 7f9c1ea00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9c200705c0 0x7f9c200ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:14.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.116+0000 7f9c1ea00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9c200705c0 0x7f9c200ae1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:60414/0 (socket says 172.21.15.122:60414) 2024-05-28T06:06:14.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.116+0000 7f9c1ea00640 1 -- 172.21.15.122:0/2441604621 learned_addr learned my addr 172.21.15.122:0/2441604621 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:14.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.116+0000 7f9c1f400640 1 --2- 172.21.15.122:0/2441604621 >> v2:172.21.15.153:3300/0 conn(0x7f9c2006ee40 0x7f9c2006f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:14.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.116+0000 7f9c1ea00640 1 -- 172.21.15.122:0/2441604621 >> v2:172.21.15.153:3300/0 conn(0x7f9c2006ee40 msgr2=0x7f9c2006f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:14.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.116+0000 7f9c1ea00640 1 --2- 172.21.15.122:0/2441604621 >> v2:172.21.15.153:3300/0 conn(0x7f9c2006ee40 0x7f9c2006f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.116+0000 7f9c1ea00640 1 -- 172.21.15.122:0/2441604621 >> v1:172.21.15.153:6789/0 conn(0x7f9c200ae700 legacy=0x7f9c200aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:14.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.116+0000 7f9c1ea00640 1 -- 172.21.15.122:0/2441604621 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c200cf6c0 con 0x7f9c200705c0 2024-05-28T06:06:14.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.120+0000 7f9c1ea00640 1 --2- 172.21.15.122:0/2441604621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c200705c0 0x7f9c200ae1c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9c20071790 tx=0x7f9c0c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b08522a1275a8b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:14.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.120+0000 7f9c1e000640 1 -- 172.21.15.122:0/2441604621 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c0ab610 con 0x7f9c200705c0 2024-05-28T06:06:14.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.120+0000 7f9c1e000640 1 -- 172.21.15.122:0/2441604621 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c0c0b0070 con 0x7f9c200705c0 2024-05-28T06:06:14.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.120+0000 7f9c1e000640 1 -- 172.21.15.122:0/2441604621 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c0ab9d0 con 0x7f9c200705c0 2024-05-28T06:06:14.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.120+0000 7f9c25200640 1 -- 172.21.15.122:0/2441604621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c200705c0 msgr2=0x7f9c200ae1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:14.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.120+0000 7f9c25200640 1 --2- 172.21.15.122:0/2441604621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c200705c0 0x7f9c200ae1c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9c20071790 tx=0x7f9c0c01c520 comp rx=0 tx=0).stop 2024-05-28T06:06:14.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.120+0000 7f9c25200640 1 -- 172.21.15.122:0/2441604621 shutdown_connections 2024-05-28T06:06:14.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.120+0000 7f9c25200640 1 --2- 172.21.15.122:0/2441604621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c200705c0 0x7f9c200ae1c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.120+0000 7f9c25200640 1 --2- 172.21.15.122:0/2441604621 >> v2:172.21.15.153:3300/0 conn(0x7f9c2006ee40 0x7f9c2006f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.120+0000 7f9c25200640 1 -- 172.21.15.122:0/2441604621 >> 172.21.15.122:0/2441604621 conn(0x7f9c2009aa40 msgr2=0x7f9c200b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:14.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.120+0000 7f9c25200640 1 -- 172.21.15.122:0/2441604621 shutdown_connections 2024-05-28T06:06:14.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.120+0000 7f9c25200640 1 -- 172.21.15.122:0/2441604621 wait complete. 2024-05-28T06:06:14.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.120+0000 7f9c25200640 1 Processor -- start 2024-05-28T06:06:14.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.120+0000 7f9c25200640 1 -- start start 2024-05-28T06:06:14.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.120+0000 7f9c25200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c2006ee40 0x7f9c20157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:14.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.124+0000 7f9c25200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c200705c0 0x7f9c2014d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:14.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.124+0000 7f9c25200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c200ae700 0x7f9c200c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:14.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.124+0000 7f9c25200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9c200b0bd0 con 0x7f9c200ae700 2024-05-28T06:06:14.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.124+0000 7f9c25200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9c200b0a50 con 0x7f9c200705c0 2024-05-28T06:06:14.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.124+0000 7f9c25200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9c20070cf0 con 0x7f9c2006ee40 2024-05-28T06:06:14.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.124+0000 7f9c1fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c200ae700 0x7f9c200c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:14.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.124+0000 7f9c1f400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c2006ee40 0x7f9c20157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:14.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.124+0000 7f9c1fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c200ae700 0x7f9c200c63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:60430/0 (socket says 172.21.15.122:60430) 2024-05-28T06:06:14.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.124+0000 7f9c1fe00640 1 -- 172.21.15.122:0/25616150 learned_addr learned my addr 172.21.15.122:0/25616150 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:14.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.124+0000 7f9c1ea00640 1 --2- 172.21.15.122:0/25616150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c200705c0 0x7f9c2014d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:14.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.124+0000 7f9c1fe00640 1 -- 172.21.15.122:0/25616150 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c2006ee40 msgr2=0x7f9c20157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:14.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.124+0000 7f9c1fe00640 1 --2- 172.21.15.122:0/25616150 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c2006ee40 0x7f9c20157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.124+0000 7f9c1fe00640 1 -- 172.21.15.122:0/25616150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c200705c0 msgr2=0x7f9c2014d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:14.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.124+0000 7f9c1fe00640 1 --2- 172.21.15.122:0/25616150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c200705c0 0x7f9c2014d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.124+0000 7f9c1fe00640 1 -- 172.21.15.122:0/25616150 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c200c5910 con 0x7f9c200ae700 2024-05-28T06:06:14.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.124+0000 7f9c1fe00640 1 --2- 172.21.15.122:0/25616150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c200ae700 0x7f9c200c63b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800c730 tx=0x7f9c1800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:14.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.124+0000 7f9c17400640 1 -- 172.21.15.122:0/25616150 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18003b80 con 0x7f9c200ae700 2024-05-28T06:06:14.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.124+0000 7f9c17400640 1 -- 172.21.15.122:0/25616150 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c18003d20 con 0x7f9c200ae700 2024-05-28T06:06:14.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.124+0000 7f9c17400640 1 -- 172.21.15.122:0/25616150 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1800aa30 con 0x7f9c200ae700 2024-05-28T06:06:14.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.124+0000 7f9c25200640 1 -- 172.21.15.122:0/25616150 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c20156a80 con 0x7f9c200ae700 2024-05-28T06:06:14.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.124+0000 7f9c25200640 1 -- 172.21.15.122:0/25616150 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c200c5bb0 con 0x7f9c200ae700 2024-05-28T06:06:14.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.124+0000 7f9c25200640 1 -- 172.21.15.122:0/25616150 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c20075620 con 0x7f9c200ae700 2024-05-28T06:06:14.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.124+0000 7f9c17400640 1 -- 172.21.15.122:0/25616150 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9c1800abd0 con 0x7f9c200ae700 2024-05-28T06:06:14.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.128+0000 7f9c17400640 1 --2- 172.21.15.122:0/25616150 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9c00068380 0x7f9c0006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:14.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.128+0000 7f9c17400640 1 -- 172.21.15.122:0/25616150 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9c180867a0 con 0x7f9c200ae700 2024-05-28T06:06:14.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.128+0000 7f9c1f400640 1 --2- 172.21.15.122:0/25616150 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9c00068380 0x7f9c0006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:14.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.128+0000 7f9c1f400640 1 --2- 172.21.15.122:0/25616150 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9c00068380 0x7f9c0006a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9c10009b60 tx=0x7f9c10009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:14.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.132+0000 7f9c17400640 1 -- 172.21.15.122:0/25616150 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9c18056670 con 0x7f9c200ae700 2024-05-28T06:06:14.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.288+0000 7f9c25200640 1 -- 172.21.15.122:0/25616150 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9c200ceaa0 con 0x7f9c200ae700 2024-05-28T06:06:14.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.288+0000 7f9c17400640 1 -- 172.21.15.122:0/25616150 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f9c1805a970 con 0x7f9c200ae700 2024-05-28T06:06:14.292 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:06:14.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.288+0000 7f9c25200640 1 -- 172.21.15.122:0/25616150 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9c00068380 msgr2=0x7f9c0006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:14.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.288+0000 7f9c25200640 1 --2- 172.21.15.122:0/25616150 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9c00068380 0x7f9c0006a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9c10009b60 tx=0x7f9c10009190 comp rx=0 tx=0).stop 2024-05-28T06:06:14.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.288+0000 7f9c25200640 1 -- 172.21.15.122:0/25616150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c200ae700 msgr2=0x7f9c200c63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:14.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.288+0000 7f9c25200640 1 --2- 172.21.15.122:0/25616150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c200ae700 0x7f9c200c63b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800c730 tx=0x7f9c1800cbf0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.288+0000 7f9c25200640 1 -- 172.21.15.122:0/25616150 shutdown_connections 2024-05-28T06:06:14.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.288+0000 7f9c25200640 1 --2- 172.21.15.122:0/25616150 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9c00068380 0x7f9c0006a840 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.288+0000 7f9c25200640 1 --2- 172.21.15.122:0/25616150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c200ae700 0x7f9c200c63b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.288+0000 7f9c25200640 1 --2- 172.21.15.122:0/25616150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c200705c0 0x7f9c2014d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.288+0000 7f9c25200640 1 --2- 172.21.15.122:0/25616150 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c2006ee40 0x7f9c20157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.288+0000 7f9c25200640 1 -- 172.21.15.122:0/25616150 >> 172.21.15.122:0/25616150 conn(0x7f9c2009aa40 msgr2=0x7f9c200aeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:14.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.288+0000 7f9c25200640 1 -- 172.21.15.122:0/25616150 shutdown_connections 2024-05-28T06:06:14.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.288+0000 7f9c25200640 1 -- 172.21.15.122:0/25616150 wait complete. 2024-05-28T06:06:14.313 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-28T06:06:14.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.448+0000 7f2916800640 1 Processor -- start 2024-05-28T06:06:14.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.448+0000 7f2916800640 1 -- start start 2024-05-28T06:06:14.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.448+0000 7f2916800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f29100cf620 0x7f29100cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:14.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.448+0000 7f2916800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f29100ce050 0x7f29100ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:14.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.448+0000 7f2916800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2910073180 con 0x7f291006f5e0 2024-05-28T06:06:14.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.448+0000 7f2916800640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f2910073d90 con 0x7f29100cf620 2024-05-28T06:06:14.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.448+0000 7f2916800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2910073460 con 0x7f29100ce050 2024-05-28T06:06:14.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.448+0000 7f290ea00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f29100cf620 0x7f29100cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:14.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.448+0000 7f290ea00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f29100cf620 0x7f29100cfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:60434/0 (socket says 172.21.15.122:60434) 2024-05-28T06:06:14.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.448+0000 7f290f400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f291006f5e0 0x7f291006f9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47978/0 (socket says 172.21.15.122:47978) 2024-05-28T06:06:14.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.448+0000 7f290ea00640 1 -- 172.21.15.122:0/4116878206 learned_addr learned my addr 172.21.15.122:0/4116878206 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:14.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.448+0000 7f290fe00640 1 --2- 172.21.15.122:0/4116878206 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f29100ce050 0x7f29100ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:14.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.448+0000 7f290ea00640 1 -- 172.21.15.122:0/4116878206 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f29100ce050 msgr2=0x7f29100ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:14.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.448+0000 7f290ea00640 1 --2- 172.21.15.122:0/4116878206 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f29100ce050 0x7f29100ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.448+0000 7f290ea00640 1 -- 172.21.15.122:0/4116878206 >> v1:172.21.15.122:6789/0 conn(0x7f291006f5e0 legacy=0x7f291006f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:14.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.448+0000 7f290ea00640 1 -- 172.21.15.122:0/4116878206 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2910073740 con 0x7f29100cf620 2024-05-28T06:06:14.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.448+0000 7f290e000640 1 -- 172.21.15.122:0/4116878206 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 328048602 0 0) 0x7f2910073180 con 0x7f291006f5e0 2024-05-28T06:06:14.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.452+0000 7f290ea00640 1 --2- 172.21.15.122:0/4116878206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29100cf620 0x7f29100cfa80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009870 tx=0x7f28f801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1593b2bed16686b server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:14.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.452+0000 7f290e000640 1 -- 172.21.15.122:0/4116878206 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f80ab650 con 0x7f29100cf620 2024-05-28T06:06:14.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.452+0000 7f290e000640 1 -- 172.21.15.122:0/4116878206 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f80b0070 con 0x7f29100cf620 2024-05-28T06:06:14.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.452+0000 7f290e000640 1 -- 172.21.15.122:0/4116878206 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f80aba10 con 0x7f29100cf620 2024-05-28T06:06:14.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.452+0000 7f2916800640 1 -- 172.21.15.122:0/4116878206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29100cf620 msgr2=0x7f29100cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:14.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.452+0000 7f2916800640 1 --2- 172.21.15.122:0/4116878206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29100cf620 0x7f29100cfa80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009870 tx=0x7f28f801c500 comp rx=0 tx=0).stop 2024-05-28T06:06:14.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.452+0000 7f2916800640 1 -- 172.21.15.122:0/4116878206 shutdown_connections 2024-05-28T06:06:14.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.452+0000 7f2916800640 1 --2- 172.21.15.122:0/4116878206 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f29100ce050 0x7f29100ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.452+0000 7f2916800640 1 --2- 172.21.15.122:0/4116878206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29100cf620 0x7f29100cfa80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.452+0000 7f2916800640 1 -- 172.21.15.122:0/4116878206 >> 172.21.15.122:0/4116878206 conn(0x7f29100b6d60 msgr2=0x7f29100b7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:14.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.452+0000 7f2916800640 1 -- 172.21.15.122:0/4116878206 shutdown_connections 2024-05-28T06:06:14.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.452+0000 7f2916800640 1 -- 172.21.15.122:0/4116878206 wait complete. 2024-05-28T06:06:14.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f2916800640 1 Processor -- start 2024-05-28T06:06:14.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f2916800640 1 -- start start 2024-05-28T06:06:14.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f2916800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f291006f5e0 0x7f2910157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:14.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f2916800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29100ce050 0x7f291015ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:14.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f2916800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29100cf620 0x7f29100b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:14.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f2916800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2910146440 con 0x7f29100ce050 2024-05-28T06:06:14.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f2916800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f29101462c0 con 0x7f29100cf620 2024-05-28T06:06:14.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f2916800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f29101692b0 con 0x7f291006f5e0 2024-05-28T06:06:14.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f290ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29100ce050 0x7f291015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:14.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f290ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29100ce050 0x7f291015ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:60442/0 (socket says 172.21.15.122:60442) 2024-05-28T06:06:14.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f290ea00640 1 -- 172.21.15.122:0/33338422 learned_addr learned my addr 172.21.15.122:0/33338422 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:14.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f290fe00640 1 --2- 172.21.15.122:0/33338422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29100cf620 0x7f29100b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:14.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f290f400640 1 --2- 172.21.15.122:0/33338422 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f291006f5e0 0x7f2910157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:14.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f290ea00640 1 -- 172.21.15.122:0/33338422 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f291006f5e0 msgr2=0x7f2910157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:14.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f290ea00640 1 --2- 172.21.15.122:0/33338422 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f291006f5e0 0x7f2910157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f290ea00640 1 -- 172.21.15.122:0/33338422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29100cf620 msgr2=0x7f29100b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:14.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f290ea00640 1 --2- 172.21.15.122:0/33338422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29100cf620 0x7f29100b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f290ea00640 1 -- 172.21.15.122:0/33338422 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2910158530 con 0x7f29100ce050 2024-05-28T06:06:14.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f290fe00640 1 --2- 172.21.15.122:0/33338422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29100cf620 0x7f29100b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:14.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f290f400640 1 --2- 172.21.15.122:0/33338422 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f291006f5e0 0x7f2910157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:14.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f290ea00640 1 --2- 172.21.15.122:0/33338422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29100ce050 0x7f291015ce00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f28f80ad040 tx=0x7f28f80192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:14.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f2907400640 1 -- 172.21.15.122:0/33338422 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f80bf610 con 0x7f29100ce050 2024-05-28T06:06:14.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f2907400640 1 -- 172.21.15.122:0/33338422 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f80bf7d0 con 0x7f29100ce050 2024-05-28T06:06:14.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f2907400640 1 -- 172.21.15.122:0/33338422 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f80bfbc0 con 0x7f29100ce050 2024-05-28T06:06:14.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f2916800640 1 -- 172.21.15.122:0/33338422 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2910158810 con 0x7f29100ce050 2024-05-28T06:06:14.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.456+0000 7f2916800640 1 -- 172.21.15.122:0/33338422 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2910158dd0 con 0x7f29100ce050 2024-05-28T06:06:14.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.460+0000 7f2916800640 1 -- 172.21.15.122:0/33338422 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2910068c40 con 0x7f29100ce050 2024-05-28T06:06:14.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.460+0000 7f2907400640 1 -- 172.21.15.122:0/33338422 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f28f80bd020 con 0x7f29100ce050 2024-05-28T06:06:14.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.460+0000 7f2907400640 1 --2- 172.21.15.122:0/33338422 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f28ec068380 0x7f28ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:14.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.460+0000 7f2907400640 1 -- 172.21.15.122:0/33338422 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f28f8120e50 con 0x7f29100ce050 2024-05-28T06:06:14.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.460+0000 7f290f400640 1 --2- 172.21.15.122:0/33338422 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f28ec068380 0x7f28ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:14.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.460+0000 7f290f400640 1 --2- 172.21.15.122:0/33338422 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f28ec068380 0x7f28ec06a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f29000012f0 tx=0x7f2900009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:14.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.464+0000 7f2907400640 1 -- 172.21.15.122:0/33338422 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f28f80c6030 con 0x7f29100ce050 2024-05-28T06:06:14.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.620+0000 7f2916800640 1 -- 172.21.15.122:0/33338422 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f291015ee80 con 0x7f29100ce050 2024-05-28T06:06:14.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.620+0000 7f2907400640 1 -- 172.21.15.122:0/33338422 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f28f8016150 con 0x7f29100ce050 2024-05-28T06:06:14.625 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 32 2024-05-28T06:06:14.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.624+0000 7f2916800640 1 -- 172.21.15.122:0/33338422 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f28ec068380 msgr2=0x7f28ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:14.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.624+0000 7f2916800640 1 --2- 172.21.15.122:0/33338422 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f28ec068380 0x7f28ec06a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f29000012f0 tx=0x7f2900009040 comp rx=0 tx=0).stop 2024-05-28T06:06:14.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.624+0000 7f2916800640 1 -- 172.21.15.122:0/33338422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29100ce050 msgr2=0x7f291015ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:14.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.624+0000 7f2916800640 1 --2- 172.21.15.122:0/33338422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29100ce050 0x7f291015ce00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f28f80ad040 tx=0x7f28f80192a0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.624+0000 7f2916800640 1 -- 172.21.15.122:0/33338422 shutdown_connections 2024-05-28T06:06:14.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.624+0000 7f2916800640 1 --2- 172.21.15.122:0/33338422 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f28ec068380 0x7f28ec06a840 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.624+0000 7f2916800640 1 --2- 172.21.15.122:0/33338422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29100cf620 0x7f29100b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.624+0000 7f2916800640 1 --2- 172.21.15.122:0/33338422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29100ce050 0x7f291015ce00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.624+0000 7f2916800640 1 --2- 172.21.15.122:0/33338422 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f291006f5e0 0x7f2910157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.624+0000 7f2916800640 1 -- 172.21.15.122:0/33338422 >> 172.21.15.122:0/33338422 conn(0x7f29100b6d60 msgr2=0x7f291006f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:14.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.624+0000 7f2916800640 1 -- 172.21.15.122:0/33338422 shutdown_connections 2024-05-28T06:06:14.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.624+0000 7f2916800640 1 -- 172.21.15.122:0/33338422 wait complete. 2024-05-28T06:06:14.646 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-28T06:06:14.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.780+0000 7f9357e00640 1 Processor -- start 2024-05-28T06:06:14.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.780+0000 7f9357e00640 1 -- start start 2024-05-28T06:06:14.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f9357e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f935006f890 0x7f93500cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:14.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f9357e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93500d0310 con 0x7f93500cff30 2024-05-28T06:06:14.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f9357e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f935015be20 con 0x7f93500cd930 2024-05-28T06:06:14.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f9357e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f935015c100 con 0x7f935006f890 2024-05-28T06:06:14.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f9355400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f93500cff30 0x7f935006f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47986/0 (socket says 172.21.15.122:47986) 2024-05-28T06:06:14.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f9355400640 1 -- 172.21.15.122:0/1555186892 learned_addr learned my addr 172.21.15.122:0/1555186892 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:14.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f934fe00640 1 -- 172.21.15.122:0/1555186892 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 236296413 0 0) 0x7f93500d0310 con 0x7f93500cff30 2024-05-28T06:06:14.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f934fe00640 1 -- 172.21.15.122:0/1555186892 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9338003530 con 0x7f93500cff30 2024-05-28T06:06:14.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f9354a00640 1 --2- 172.21.15.122:0/1555186892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f935006f890 0x7f93500cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:14.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f934fe00640 1 -- 172.21.15.122:0/1555186892 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1435797314 0 0) 0x7f9338003530 con 0x7f93500cff30 2024-05-28T06:06:14.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f934fe00640 1 -- 172.21.15.122:0/1555186892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f935006f890 msgr2=0x7f93500cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:14.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f934fe00640 1 --2- 172.21.15.122:0/1555186892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f935006f890 0x7f93500cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f934fe00640 1 -- 172.21.15.122:0/1555186892 >> v1:172.21.15.153:6789/0 conn(0x7f93500cd930 legacy=0x7f93500b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:14.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f934fe00640 1 -- 172.21.15.122:0/1555186892 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935015c3e0 con 0x7f93500cff30 2024-05-28T06:06:14.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f934fe00640 1 -- 172.21.15.122:0/1555186892 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f93440016a0 con 0x7f93500cff30 2024-05-28T06:06:14.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f934fe00640 1 -- 172.21.15.122:0/1555186892 >> v1:172.21.15.122:6789/0 conn(0x7f93500cff30 legacy=0x7f935006f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:14.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f934fe00640 1 --2- 172.21.15.122:0/1555186892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93380039f0 0x7f9338003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:14.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f934fe00640 1 --2- 172.21.15.122:0/1555186892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9338004810 0x7f9338004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:14.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f934fe00640 1 --2- 172.21.15.122:0/1555186892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f935006f890 0x7f9338005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:14.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f934fe00640 1 -- 172.21.15.122:0/1555186892 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f935015c100 con 0x7f93380039f0 2024-05-28T06:06:14.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f934fe00640 1 -- 172.21.15.122:0/1555186892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f933800bb30 con 0x7f9338004810 2024-05-28T06:06:14.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f934fe00640 1 -- 172.21.15.122:0/1555186892 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f933800df40 con 0x7f935006f890 2024-05-28T06:06:14.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f9355400640 1 --2- 172.21.15.122:0/1555186892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93380039f0 0x7f9338003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:14.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f9354a00640 1 --2- 172.21.15.122:0/1555186892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9338004810 0x7f9338004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:14.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f9355e00640 1 --2- 172.21.15.122:0/1555186892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f935006f890 0x7f9338005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:14.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f9355400640 1 -- 172.21.15.122:0/1555186892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f935006f890 msgr2=0x7f9338005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:14.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f9355400640 1 --2- 172.21.15.122:0/1555186892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f935006f890 0x7f9338005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f9355400640 1 -- 172.21.15.122:0/1555186892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9338004810 msgr2=0x7f9338004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:14.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f9355400640 1 --2- 172.21.15.122:0/1555186892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9338004810 0x7f9338004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f9355400640 1 -- 172.21.15.122:0/1555186892 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9338003530 con 0x7f93380039f0 2024-05-28T06:06:14.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.784+0000 7f9354a00640 1 --2- 172.21.15.122:0/1555186892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9338004810 0x7f9338004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:14.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.788+0000 7f9355400640 1 --2- 172.21.15.122:0/1555186892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93380039f0 0x7f9338003e10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f934400c210 tx=0x7f934401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8004064d10a1cb8 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:14.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.788+0000 7f934fe00640 1 -- 172.21.15.122:0/1555186892 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344007d40 con 0x7f93380039f0 2024-05-28T06:06:14.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.788+0000 7f934fe00640 1 -- 172.21.15.122:0/1555186892 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93440a9070 con 0x7f93380039f0 2024-05-28T06:06:14.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.788+0000 7f934fe00640 1 -- 172.21.15.122:0/1555186892 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344005d40 con 0x7f93380039f0 2024-05-28T06:06:14.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.788+0000 7f9357e00640 1 -- 172.21.15.122:0/1555186892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93380039f0 msgr2=0x7f9338003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:14.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.788+0000 7f9357e00640 1 --2- 172.21.15.122:0/1555186892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93380039f0 0x7f9338003e10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f934400c210 tx=0x7f934401cc30 comp rx=0 tx=0).stop 2024-05-28T06:06:14.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.788+0000 7f9355e00640 1 -- 172.21.15.122:0/1555186892 reap_dead start 2024-05-28T06:06:14.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.788+0000 7f9357e00640 1 -- 172.21.15.122:0/1555186892 shutdown_connections 2024-05-28T06:06:14.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.788+0000 7f9357e00640 1 -- 172.21.15.122:0/1555186892 >> 172.21.15.122:0/1555186892 conn(0x7f935006bd90 msgr2=0x7f935006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:14.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.788+0000 7f9357e00640 1 -- 172.21.15.122:0/1555186892 shutdown_connections 2024-05-28T06:06:14.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.788+0000 7f9357e00640 1 -- 172.21.15.122:0/1555186892 wait complete. 2024-05-28T06:06:14.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.788+0000 7f9357e00640 1 Processor -- start 2024-05-28T06:06:14.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.788+0000 7f9357e00640 1 -- start start 2024-05-28T06:06:14.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.792+0000 7f9357e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93380039f0 0x7f93501619f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:14.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.792+0000 7f9357e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93500b0460 0x7f93501416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:14.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.792+0000 7f9357e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f93500b1ce0 0x7f93500b2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:14.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.792+0000 7f9357e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f93500b58d0 con 0x7f93500b0460 2024-05-28T06:06:14.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.792+0000 7f9357e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f93500b5a50 con 0x7f93380039f0 2024-05-28T06:06:14.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.792+0000 7f9357e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f93500b5bd0 con 0x7f93500b1ce0 2024-05-28T06:06:14.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.792+0000 7f9354a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93500b0460 0x7f93501416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:14.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.792+0000 7f9355400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93380039f0 0x7f93501619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:14.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.792+0000 7f9354a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93500b0460 0x7f93501416f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:60452/0 (socket says 172.21.15.122:60452) 2024-05-28T06:06:14.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.792+0000 7f9354a00640 1 -- 172.21.15.122:0/1771944017 learned_addr learned my addr 172.21.15.122:0/1771944017 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:14.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.792+0000 7f9355e00640 1 --2- 172.21.15.122:0/1771944017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f93500b1ce0 0x7f93500b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:14.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.792+0000 7f9354a00640 1 -- 172.21.15.122:0/1771944017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f93500b1ce0 msgr2=0x7f93500b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:14.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.792+0000 7f9354a00640 1 --2- 172.21.15.122:0/1771944017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f93500b1ce0 0x7f93500b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.792+0000 7f9354a00640 1 -- 172.21.15.122:0/1771944017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93380039f0 msgr2=0x7f93501619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:14.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.792+0000 7f9354a00640 1 --2- 172.21.15.122:0/1771944017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93380039f0 0x7f93501619f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.792+0000 7f9354a00640 1 -- 172.21.15.122:0/1771944017 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9350151a00 con 0x7f93500b0460 2024-05-28T06:06:14.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.792+0000 7f9354a00640 1 --2- 172.21.15.122:0/1771944017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93500b0460 0x7f93501416f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f933c00f510 tx=0x7f933c00f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:14.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.792+0000 7f934d600640 1 -- 172.21.15.122:0/1771944017 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c019020 con 0x7f93500b0460 2024-05-28T06:06:14.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.792+0000 7f934d600640 1 -- 172.21.15.122:0/1771944017 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f933c014870 con 0x7f93500b0460 2024-05-28T06:06:14.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.792+0000 7f934d600640 1 -- 172.21.15.122:0/1771944017 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c014c40 con 0x7f93500b0460 2024-05-28T06:06:14.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.792+0000 7f9357e00640 1 -- 172.21.15.122:0/1771944017 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9350151ce0 con 0x7f93500b0460 2024-05-28T06:06:14.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.792+0000 7f9357e00640 1 -- 172.21.15.122:0/1771944017 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9350141c30 con 0x7f93500b0460 2024-05-28T06:06:14.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.792+0000 7f9357e00640 1 -- 172.21.15.122:0/1771944017 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9350068c40 con 0x7f93500b0460 2024-05-28T06:06:14.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.796+0000 7f934d600640 1 -- 172.21.15.122:0/1771944017 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f933c01c020 con 0x7f93500b0460 2024-05-28T06:06:14.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.796+0000 7f934d600640 1 --2- 172.21.15.122:0/1771944017 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9330068380 0x7f933006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:14.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.796+0000 7f934d600640 1 -- 172.21.15.122:0/1771944017 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f933c086f60 con 0x7f93500b0460 2024-05-28T06:06:14.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.796+0000 7f9355400640 1 --2- 172.21.15.122:0/1771944017 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9330068380 0x7f933006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:14.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.796+0000 7f9355400640 1 --2- 172.21.15.122:0/1771944017 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9330068380 0x7f933006a840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f93440ab000 tx=0x7f93440b1040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:14.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.800+0000 7f934d600640 1 -- 172.21.15.122:0/1771944017 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f933c023020 con 0x7f93500b0460 2024-05-28T06:06:14.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.956+0000 7f9357e00640 1 -- 172.21.15.122:0/1771944017 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9350155f70 con 0x7f93500b0460 2024-05-28T06:06:14.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.956+0000 7f934d600640 1 -- 172.21.15.122:0/1771944017 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f933c056ec0 con 0x7f93500b0460 2024-05-28T06:06:14.960 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 64 2024-05-28T06:06:14.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.956+0000 7f9357e00640 1 -- 172.21.15.122:0/1771944017 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9330068380 msgr2=0x7f933006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:14.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.956+0000 7f9357e00640 1 --2- 172.21.15.122:0/1771944017 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9330068380 0x7f933006a840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f93440ab000 tx=0x7f93440b1040 comp rx=0 tx=0).stop 2024-05-28T06:06:14.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.956+0000 7f9357e00640 1 -- 172.21.15.122:0/1771944017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93500b0460 msgr2=0x7f93501416f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:14.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.956+0000 7f9357e00640 1 --2- 172.21.15.122:0/1771944017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93500b0460 0x7f93501416f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f933c00f510 tx=0x7f933c00f9d0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.956+0000 7f9357e00640 1 -- 172.21.15.122:0/1771944017 shutdown_connections 2024-05-28T06:06:14.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.956+0000 7f9357e00640 1 --2- 172.21.15.122:0/1771944017 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9330068380 0x7f933006a840 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.956+0000 7f9357e00640 1 --2- 172.21.15.122:0/1771944017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f93500b1ce0 0x7f93500b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.956+0000 7f9357e00640 1 --2- 172.21.15.122:0/1771944017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93500b0460 0x7f93501416f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.956+0000 7f9357e00640 1 --2- 172.21.15.122:0/1771944017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93380039f0 0x7f93501619f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:14.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.956+0000 7f9357e00640 1 -- 172.21.15.122:0/1771944017 >> 172.21.15.122:0/1771944017 conn(0x7f935006bd90 msgr2=0x7f9350154270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:14.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.956+0000 7f9357e00640 1 -- 172.21.15.122:0/1771944017 shutdown_connections 2024-05-28T06:06:14.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:14.956+0000 7f9357e00640 1 -- 172.21.15.122:0/1771944017 wait complete. 2024-05-28T06:06:14.982 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:06:15.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.116+0000 7f520ca00640 1 Processor -- start 2024-05-28T06:06:15.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.116+0000 7f520ca00640 1 -- start start 2024-05-28T06:06:15.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.116+0000 7f520ca00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f52080d0170 0x7f520806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:15.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.116+0000 7f520ca00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f52080cfc20 0x7f520806cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:15.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.116+0000 7f520ca00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5208073900 con 0x7f520815b4a0 2024-05-28T06:06:15.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.116+0000 7f520ca00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f52080ae0f0 con 0x7f52080d0170 2024-05-28T06:06:15.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.116+0000 7f520ca00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5208073340 con 0x7f52080cfc20 2024-05-28T06:06:15.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.116+0000 7f5205e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f52080d0170 0x7f520806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:15.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.116+0000 7f5205e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f52080d0170 0x7f520806c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:60458/0 (socket says 172.21.15.122:60458) 2024-05-28T06:06:15.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.116+0000 7f5205e00640 1 -- 172.21.15.122:0/659319690 learned_addr learned my addr 172.21.15.122:0/659319690 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:15.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.116+0000 7f5207200640 1 --2- 172.21.15.122:0/659319690 >> v2:172.21.15.153:3300/0 conn(0x7f52080cfc20 0x7f520806cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:15.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.116+0000 7f5205e00640 1 -- 172.21.15.122:0/659319690 >> v2:172.21.15.153:3300/0 conn(0x7f52080cfc20 msgr2=0x7f520806cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:15.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.116+0000 7f5205e00640 1 --2- 172.21.15.122:0/659319690 >> v2:172.21.15.153:3300/0 conn(0x7f52080cfc20 0x7f520806cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.116+0000 7f5205e00640 1 -- 172.21.15.122:0/659319690 >> v1:172.21.15.153:6789/0 conn(0x7f520815b4a0 legacy=0x7f520806e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:15.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.116+0000 7f5205e00640 1 -- 172.21.15.122:0/659319690 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5208073620 con 0x7f52080d0170 2024-05-28T06:06:15.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.120+0000 7f5205e00640 1 --2- 172.21.15.122:0/659319690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52080d0170 0x7f520806c9a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f52080cd6a0 tx=0x7f51f401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8506b7f96417ecf8 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:15.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.120+0000 7f5205400640 1 -- 172.21.15.122:0/659319690 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f40ab5f0 con 0x7f52080d0170 2024-05-28T06:06:15.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.120+0000 7f5205400640 1 -- 172.21.15.122:0/659319690 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51f40b0070 con 0x7f52080d0170 2024-05-28T06:06:15.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.120+0000 7f5205400640 1 -- 172.21.15.122:0/659319690 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f40ab9b0 con 0x7f52080d0170 2024-05-28T06:06:15.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.120+0000 7f520ca00640 1 -- 172.21.15.122:0/659319690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52080d0170 msgr2=0x7f520806c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:15.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.120+0000 7f520ca00640 1 --2- 172.21.15.122:0/659319690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52080d0170 0x7f520806c9a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f52080cd6a0 tx=0x7f51f401c3d0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.120+0000 7f520ca00640 1 -- 172.21.15.122:0/659319690 shutdown_connections 2024-05-28T06:06:15.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.120+0000 7f520ca00640 1 --2- 172.21.15.122:0/659319690 >> v2:172.21.15.153:3300/0 conn(0x7f52080cfc20 0x7f520806cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.120+0000 7f520ca00640 1 --2- 172.21.15.122:0/659319690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52080d0170 0x7f520806c9a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.120+0000 7f520ca00640 1 -- 172.21.15.122:0/659319690 >> 172.21.15.122:0/659319690 conn(0x7f5208072680 msgr2=0x7f5208072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:15.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.120+0000 7f520ca00640 1 -- 172.21.15.122:0/659319690 shutdown_connections 2024-05-28T06:06:15.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.120+0000 7f520ca00640 1 -- 172.21.15.122:0/659319690 wait complete. 2024-05-28T06:06:15.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.120+0000 7f520ca00640 1 Processor -- start 2024-05-28T06:06:15.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.120+0000 7f520ca00640 1 -- start start 2024-05-28T06:06:15.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f520ca00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52080cfc20 0x7f520814b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:15.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f520ca00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52080d0170 0x7f520813d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:15.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f520ca00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f520815b4a0 0x7f52081f5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:15.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f520ca00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f52080b4c30 con 0x7f52080cfc20 2024-05-28T06:06:15.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f520ca00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f52080b4ab0 con 0x7f520815b4a0 2024-05-28T06:06:15.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f520ca00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f52081681d0 con 0x7f52080d0170 2024-05-28T06:06:15.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f5206800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52080cfc20 0x7f520814b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:15.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f5206800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52080cfc20 0x7f520814b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:60460/0 (socket says 172.21.15.122:60460) 2024-05-28T06:06:15.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f5206800640 1 -- 172.21.15.122:0/2750430022 learned_addr learned my addr 172.21.15.122:0/2750430022 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:15.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f5207200640 1 --2- 172.21.15.122:0/2750430022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f520815b4a0 0x7f52081f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:15.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f5205e00640 1 --2- 172.21.15.122:0/2750430022 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52080d0170 0x7f520813d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:15.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f5206800640 1 -- 172.21.15.122:0/2750430022 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52080d0170 msgr2=0x7f520813d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:15.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f5206800640 1 --2- 172.21.15.122:0/2750430022 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52080d0170 0x7f520813d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f5206800640 1 -- 172.21.15.122:0/2750430022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f520815b4a0 msgr2=0x7f52081f5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:15.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f5206800640 1 --2- 172.21.15.122:0/2750430022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f520815b4a0 0x7f52081f5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f5206800640 1 -- 172.21.15.122:0/2750430022 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f520815cf50 con 0x7f52080cfc20 2024-05-28T06:06:15.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f5207200640 1 --2- 172.21.15.122:0/2750430022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f520815b4a0 0x7f52081f5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:15.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f5206800640 1 --2- 172.21.15.122:0/2750430022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52080cfc20 0x7f520814b8c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f51f800c420 tx=0x7f51f800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:15.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f51fea00640 1 -- 172.21.15.122:0/2750430022 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f80052d0 con 0x7f52080cfc20 2024-05-28T06:06:15.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f51fea00640 1 -- 172.21.15.122:0/2750430022 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51f8005470 con 0x7f52080cfc20 2024-05-28T06:06:15.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f520ca00640 1 -- 172.21.15.122:0/2750430022 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f520815d230 con 0x7f52080cfc20 2024-05-28T06:06:15.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f51fea00640 1 -- 172.21.15.122:0/2750430022 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f8007260 con 0x7f52080cfc20 2024-05-28T06:06:15.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f520ca00640 1 -- 172.21.15.122:0/2750430022 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f520815d7f0 con 0x7f52080cfc20 2024-05-28T06:06:15.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f520ca00640 1 -- 172.21.15.122:0/2750430022 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5208075620 con 0x7f52080cfc20 2024-05-28T06:06:15.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.124+0000 7f51fea00640 1 -- 172.21.15.122:0/2750430022 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f51f8007400 con 0x7f52080cfc20 2024-05-28T06:06:15.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.128+0000 7f51fea00640 1 --2- 172.21.15.122:0/2750430022 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f51e8068380 0x7f51e806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:15.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.128+0000 7f51fea00640 1 -- 172.21.15.122:0/2750430022 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f51f8085ff0 con 0x7f52080cfc20 2024-05-28T06:06:15.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.128+0000 7f5205e00640 1 --2- 172.21.15.122:0/2750430022 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f51e8068380 0x7f51e806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:15.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.128+0000 7f5205e00640 1 --2- 172.21.15.122:0/2750430022 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f51e8068380 0x7f51e806a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f51f40af000 tx=0x7f51f40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:15.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.132+0000 7f51fea00640 1 -- 172.21.15.122:0/2750430022 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f51f8056480 con 0x7f52080cfc20 2024-05-28T06:06:15.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.292+0000 7f520ca00640 1 -- 172.21.15.122:0/2750430022 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f520806bda0 con 0x7f52080cfc20 2024-05-28T06:06:15.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.292+0000 7f51fea00640 1 -- 172.21.15.122:0/2750430022 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f51f8055d80 con 0x7f52080cfc20 2024-05-28T06:06:15.297 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:15.297 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":20,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:05:50.822555+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:05:47.441193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-28T06:05:48.148164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:06:15.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.296+0000 7f520ca00640 1 -- 172.21.15.122:0/2750430022 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f51e8068380 msgr2=0x7f51e806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:15.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.296+0000 7f520ca00640 1 --2- 172.21.15.122:0/2750430022 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f51e8068380 0x7f51e806a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f51f40af000 tx=0x7f51f40a7000 comp rx=0 tx=0).stop 2024-05-28T06:06:15.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.296+0000 7f520ca00640 1 -- 172.21.15.122:0/2750430022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52080cfc20 msgr2=0x7f520814b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:15.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.296+0000 7f520ca00640 1 --2- 172.21.15.122:0/2750430022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52080cfc20 0x7f520814b8c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f51f800c420 tx=0x7f51f800c8e0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.296+0000 7f520ca00640 1 -- 172.21.15.122:0/2750430022 shutdown_connections 2024-05-28T06:06:15.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.296+0000 7f520ca00640 1 --2- 172.21.15.122:0/2750430022 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f51e8068380 0x7f51e806a840 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.296+0000 7f520ca00640 1 --2- 172.21.15.122:0/2750430022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f520815b4a0 0x7f52081f5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.296+0000 7f520ca00640 1 --2- 172.21.15.122:0/2750430022 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52080d0170 0x7f520813d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.296+0000 7f520ca00640 1 --2- 172.21.15.122:0/2750430022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52080cfc20 0x7f520814b8c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.296+0000 7f520ca00640 1 -- 172.21.15.122:0/2750430022 >> 172.21.15.122:0/2750430022 conn(0x7f5208072680 msgr2=0x7f52080b4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:15.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.296+0000 7f520ca00640 1 -- 172.21.15.122:0/2750430022 shutdown_connections 2024-05-28T06:06:15.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.296+0000 7f520ca00640 1 -- 172.21.15.122:0/2750430022 wait complete. 2024-05-28T06:06:15.318 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-28T06:05:47.441193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-28T06:05:48.148164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:06:15.319 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:06:15.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.456+0000 7fac57e00640 1 Processor -- start 2024-05-28T06:06:15.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.456+0000 7fac57e00640 1 -- start start 2024-05-28T06:06:15.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.456+0000 7fac57e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fac500cff30 0x7fac5006f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:15.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.456+0000 7fac57e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fac5006f6c0 0x7fac500cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:15.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.456+0000 7fac57e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac500d0310 con 0x7fac500cd930 2024-05-28T06:06:15.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.456+0000 7fac57e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fac5006fb30 con 0x7fac5006f6c0 2024-05-28T06:06:15.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.456+0000 7fac57e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fac5015be20 con 0x7fac500cff30 2024-05-28T06:06:15.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.456+0000 7fac54a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fac5006f6c0 0x7fac500cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:15.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.456+0000 7fac55e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fac500cd930 0x7fac500722a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:48000/0 (socket says 172.21.15.122:48000) 2024-05-28T06:06:15.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.456+0000 7fac55e00640 1 -- 172.21.15.122:0/1272858927 learned_addr learned my addr 172.21.15.122:0/1272858927 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:15.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.456+0000 7fac54a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fac5006f6c0 0x7fac500cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:60474/0 (socket says 172.21.15.122:60474) 2024-05-28T06:06:15.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.456+0000 7fac55400640 1 --2- 172.21.15.122:0/1272858927 >> v2:172.21.15.153:3300/0 conn(0x7fac500cff30 0x7fac5006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:15.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.456+0000 7fac54a00640 1 -- 172.21.15.122:0/1272858927 >> v2:172.21.15.153:3300/0 conn(0x7fac500cff30 msgr2=0x7fac5006f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:15.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.456+0000 7fac54a00640 1 --2- 172.21.15.122:0/1272858927 >> v2:172.21.15.153:3300/0 conn(0x7fac500cff30 0x7fac5006f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.456+0000 7fac54a00640 1 -- 172.21.15.122:0/1272858927 >> v1:172.21.15.122:6789/0 conn(0x7fac500cd930 legacy=0x7fac500722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:15.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.456+0000 7fac4fe00640 1 -- 172.21.15.122:0/1272858927 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1738366136 0 0) 0x7fac500d0310 con 0x7fac500cd930 2024-05-28T06:06:15.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.456+0000 7fac54a00640 1 -- 172.21.15.122:0/1272858927 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5015c100 con 0x7fac5006f6c0 2024-05-28T06:06:15.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.460+0000 7fac54a00640 1 --2- 172.21.15.122:0/1272858927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac5006f6c0 0x7fac500cd3f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fac500b3dc0 tx=0x7fac3c01eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f279afc25c318a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:15.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.460+0000 7fac4fe00640 1 -- 172.21.15.122:0/1272858927 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3c0b4070 con 0x7fac5006f6c0 2024-05-28T06:06:15.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.460+0000 7fac4fe00640 1 -- 172.21.15.122:0/1272858927 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac3c0a7bf0 con 0x7fac5006f6c0 2024-05-28T06:06:15.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.460+0000 7fac4fe00640 1 -- 172.21.15.122:0/1272858927 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3c0af440 con 0x7fac5006f6c0 2024-05-28T06:06:15.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.460+0000 7fac57e00640 1 -- 172.21.15.122:0/1272858927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac5006f6c0 msgr2=0x7fac500cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:15.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.460+0000 7fac57e00640 1 --2- 172.21.15.122:0/1272858927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac5006f6c0 0x7fac500cd3f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fac500b3dc0 tx=0x7fac3c01eb20 comp rx=0 tx=0).stop 2024-05-28T06:06:15.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.460+0000 7fac57e00640 1 -- 172.21.15.122:0/1272858927 shutdown_connections 2024-05-28T06:06:15.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.460+0000 7fac57e00640 1 --2- 172.21.15.122:0/1272858927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac5006f6c0 0x7fac500cd3f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.460+0000 7fac57e00640 1 --2- 172.21.15.122:0/1272858927 >> v2:172.21.15.153:3300/0 conn(0x7fac500cff30 0x7fac5006f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.460+0000 7fac57e00640 1 -- 172.21.15.122:0/1272858927 >> 172.21.15.122:0/1272858927 conn(0x7fac5006bd90 msgr2=0x7fac5006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:15.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.460+0000 7fac57e00640 1 -- 172.21.15.122:0/1272858927 shutdown_connections 2024-05-28T06:06:15.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.460+0000 7fac57e00640 1 -- 172.21.15.122:0/1272858927 wait complete. 2024-05-28T06:06:15.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac57e00640 1 Processor -- start 2024-05-28T06:06:15.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac57e00640 1 -- start start 2024-05-28T06:06:15.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac57e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac5006f6c0 0x7fac50146930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:15.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac57e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac500cd930 0x7fac5015e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:15.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac57e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac500cff30 0x7fac5015eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:15.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac57e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fac500cde90 con 0x7fac500cd930 2024-05-28T06:06:15.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac57e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fac500cdd10 con 0x7fac500cff30 2024-05-28T06:06:15.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac57e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fac500b59c0 con 0x7fac5006f6c0 2024-05-28T06:06:15.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac54a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac500cd930 0x7fac5015e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:15.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac54a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac500cd930 0x7fac5015e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:60476/0 (socket says 172.21.15.122:60476) 2024-05-28T06:06:15.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac54a00640 1 -- 172.21.15.122:0/811412346 learned_addr learned my addr 172.21.15.122:0/811412346 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:15.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac55400640 1 --2- 172.21.15.122:0/811412346 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac5006f6c0 0x7fac50146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:15.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac55e00640 1 --2- 172.21.15.122:0/811412346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac500cff30 0x7fac5015eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:15.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac54a00640 1 -- 172.21.15.122:0/811412346 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac5006f6c0 msgr2=0x7fac50146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:15.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac54a00640 1 --2- 172.21.15.122:0/811412346 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac5006f6c0 0x7fac50146930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac54a00640 1 -- 172.21.15.122:0/811412346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac500cff30 msgr2=0x7fac5015eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:15.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac54a00640 1 --2- 172.21.15.122:0/811412346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac500cff30 0x7fac5015eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac54a00640 1 -- 172.21.15.122:0/811412346 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac50147080 con 0x7fac500cd930 2024-05-28T06:06:15.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac55e00640 1 --2- 172.21.15.122:0/811412346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac500cff30 0x7fac5015eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:15.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac54a00640 1 --2- 172.21.15.122:0/811412346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac500cd930 0x7fac5015e580 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fac3c01c750 tx=0x7fac3c01b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:15.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac4d600640 1 -- 172.21.15.122:0/811412346 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3c0bf070 con 0x7fac500cd930 2024-05-28T06:06:15.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac4d600640 1 -- 172.21.15.122:0/811412346 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac3c0afc20 con 0x7fac500cd930 2024-05-28T06:06:15.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac57e00640 1 -- 172.21.15.122:0/811412346 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac50147360 con 0x7fac500cd930 2024-05-28T06:06:15.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac4d600640 1 -- 172.21.15.122:0/811412346 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3c0b4040 con 0x7fac500cd930 2024-05-28T06:06:15.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.464+0000 7fac57e00640 1 -- 172.21.15.122:0/811412346 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac50147920 con 0x7fac500cd930 2024-05-28T06:06:15.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.468+0000 7fac57e00640 1 -- 172.21.15.122:0/811412346 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac50068c40 con 0x7fac500cd930 2024-05-28T06:06:15.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.468+0000 7fac4d600640 1 -- 172.21.15.122:0/811412346 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fac3c0c2070 con 0x7fac500cd930 2024-05-28T06:06:15.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.468+0000 7fac4d600640 1 --2- 172.21.15.122:0/811412346 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fac300683b0 0x7fac3006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:15.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.468+0000 7fac4d600640 1 -- 172.21.15.122:0/811412346 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fac3c120fb0 con 0x7fac500cd930 2024-05-28T06:06:15.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.468+0000 7fac55400640 1 --2- 172.21.15.122:0/811412346 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fac300683b0 0x7fac3006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:15.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.468+0000 7fac55400640 1 --2- 172.21.15.122:0/811412346 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fac300683b0 0x7fac3006a870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fac44003ab0 tx=0x7fac44009830 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:15.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.472+0000 7fac4d600640 1 -- 172.21.15.122:0/811412346 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fac3c018740 con 0x7fac500cd930 2024-05-28T06:06:15.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.632+0000 7fac57e00640 1 -- 172.21.15.122:0/811412346 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fac501483e0 con 0x7fac500cd930 2024-05-28T06:06:15.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.632+0000 7fac4d600640 1 -- 172.21.15.122:0/811412346 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fac3c0f0f10 con 0x7fac500cd930 2024-05-28T06:06:15.635 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:06:15.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.632+0000 7fac57e00640 1 -- 172.21.15.122:0/811412346 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fac300683b0 msgr2=0x7fac3006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:15.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.632+0000 7fac57e00640 1 --2- 172.21.15.122:0/811412346 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fac300683b0 0x7fac3006a870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fac44003ab0 tx=0x7fac44009830 comp rx=0 tx=0).stop 2024-05-28T06:06:15.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.632+0000 7fac57e00640 1 -- 172.21.15.122:0/811412346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac500cd930 msgr2=0x7fac5015e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:15.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.632+0000 7fac57e00640 1 --2- 172.21.15.122:0/811412346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac500cd930 0x7fac5015e580 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fac3c01c750 tx=0x7fac3c01b8c0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.632+0000 7fac57e00640 1 -- 172.21.15.122:0/811412346 shutdown_connections 2024-05-28T06:06:15.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.632+0000 7fac57e00640 1 --2- 172.21.15.122:0/811412346 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fac300683b0 0x7fac3006a870 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.632+0000 7fac57e00640 1 --2- 172.21.15.122:0/811412346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac500cff30 0x7fac5015eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.632+0000 7fac57e00640 1 --2- 172.21.15.122:0/811412346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac500cd930 0x7fac5015e580 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.632+0000 7fac57e00640 1 --2- 172.21.15.122:0/811412346 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac5006f6c0 0x7fac50146930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.632+0000 7fac57e00640 1 -- 172.21.15.122:0/811412346 >> 172.21.15.122:0/811412346 conn(0x7fac5006bd90 msgr2=0x7fac500b5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:15.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.632+0000 7fac57e00640 1 -- 172.21.15.122:0/811412346 shutdown_connections 2024-05-28T06:06:15.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.632+0000 7fac57e00640 1 -- 172.21.15.122:0/811412346 wait complete. 2024-05-28T06:06:15.658 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-28T06:06:15.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.792+0000 7efe52600640 1 Processor -- start 2024-05-28T06:06:15.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.792+0000 7efe52600640 1 -- start start 2024-05-28T06:06:15.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.796+0000 7efe52600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efe4c06f890 0x7efe4c0cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:15.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.796+0000 7efe52600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe4c0cd930 0x7efe4c0b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:15.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.796+0000 7efe52600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe4c0d0310 con 0x7efe4c0cff30 2024-05-28T06:06:15.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.796+0000 7efe52600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7efe4c15be20 con 0x7efe4c06f890 2024-05-28T06:06:15.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.796+0000 7efe52600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efe4c15c100 con 0x7efe4c0cd930 2024-05-28T06:06:15.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.796+0000 7efe42a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efe4c06f890 0x7efe4c0cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:15.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.796+0000 7efe4b400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7efe4c0cff30 0x7efe4c06f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:54138/0 (socket says 172.21.15.122:54138) 2024-05-28T06:06:15.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.796+0000 7efe4b400640 1 -- 172.21.15.122:0/2628979964 learned_addr learned my addr 172.21.15.122:0/2628979964 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:15.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.796+0000 7efe42a00640 1 -- 172.21.15.122:0/2628979964 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe4c0cd930 msgr2=0x7efe4c0b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:15.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.796+0000 7efe42a00640 1 --2- 172.21.15.122:0/2628979964 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe4c0cd930 0x7efe4c0b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.796+0000 7efe42a00640 1 -- 172.21.15.122:0/2628979964 >> v1:172.21.15.122:6789/0 conn(0x7efe4c0cff30 legacy=0x7efe4c06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:15.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.796+0000 7efe42a00640 1 -- 172.21.15.122:0/2628979964 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4c15c3e0 con 0x7efe4c06f890 2024-05-28T06:06:15.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.800+0000 7efe42a00640 1 --2- 172.21.15.122:0/2628979964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe4c06f890 0x7efe4c0cd3f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efe340097c0 tx=0x7efe3401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ec8939969974d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:15.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.800+0000 7efe4aa00640 1 -- 172.21.15.122:0/2628979964 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe340ab610 con 0x7efe4c06f890 2024-05-28T06:06:15.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.800+0000 7efe4aa00640 1 -- 172.21.15.122:0/2628979964 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe340b0070 con 0x7efe4c06f890 2024-05-28T06:06:15.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.800+0000 7efe4aa00640 1 -- 172.21.15.122:0/2628979964 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe340ab9d0 con 0x7efe4c06f890 2024-05-28T06:06:15.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.800+0000 7efe52600640 1 -- 172.21.15.122:0/2628979964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe4c06f890 msgr2=0x7efe4c0cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:15.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.800+0000 7efe52600640 1 --2- 172.21.15.122:0/2628979964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe4c06f890 0x7efe4c0cd3f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efe340097c0 tx=0x7efe3401c470 comp rx=0 tx=0).stop 2024-05-28T06:06:15.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.800+0000 7efe52600640 1 -- 172.21.15.122:0/2628979964 shutdown_connections 2024-05-28T06:06:15.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.800+0000 7efe52600640 1 --2- 172.21.15.122:0/2628979964 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe4c0cd930 0x7efe4c0b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.800+0000 7efe52600640 1 --2- 172.21.15.122:0/2628979964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe4c06f890 0x7efe4c0cd3f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.800+0000 7efe52600640 1 -- 172.21.15.122:0/2628979964 >> 172.21.15.122:0/2628979964 conn(0x7efe4c06bd90 msgr2=0x7efe4c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:15.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.800+0000 7efe52600640 1 -- 172.21.15.122:0/2628979964 shutdown_connections 2024-05-28T06:06:15.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.800+0000 7efe52600640 1 -- 172.21.15.122:0/2628979964 wait complete. 2024-05-28T06:06:15.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.800+0000 7efe52600640 1 Processor -- start 2024-05-28T06:06:15.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.800+0000 7efe52600640 1 -- start start 2024-05-28T06:06:15.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.800+0000 7efe52600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe4c06f890 0x7efe4c158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:15.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.800+0000 7efe52600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe4c0cd930 0x7efe4c1f7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:15.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.800+0000 7efe52600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe4c0cff30 0x7efe4c1506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:15.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.800+0000 7efe52600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efe4c0b5880 con 0x7efe4c06f890 2024-05-28T06:06:15.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.800+0000 7efe52600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efe4c0b5700 con 0x7efe4c0cff30 2024-05-28T06:06:15.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.800+0000 7efe52600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efe4c0b5a00 con 0x7efe4c0cd930 2024-05-28T06:06:15.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.800+0000 7efe4b400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe4c06f890 0x7efe4c158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:15.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.804+0000 7efe4b400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe4c06f890 0x7efe4c158b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51460/0 (socket says 172.21.15.122:51460) 2024-05-28T06:06:15.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.804+0000 7efe4b400640 1 -- 172.21.15.122:0/3364440341 learned_addr learned my addr 172.21.15.122:0/3364440341 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:15.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.804+0000 7efe4be00640 1 --2- 172.21.15.122:0/3364440341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe4c0cff30 0x7efe4c1506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:15.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.804+0000 7efe4b400640 1 -- 172.21.15.122:0/3364440341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe4c0cd930 msgr2=0x7efe4c1f7370 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-28T06:06:15.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.804+0000 7efe4b400640 1 --2- 172.21.15.122:0/3364440341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe4c0cd930 0x7efe4c1f7370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.804+0000 7efe4b400640 1 -- 172.21.15.122:0/3364440341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe4c0cff30 msgr2=0x7efe4c1506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:15.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.804+0000 7efe4b400640 1 --2- 172.21.15.122:0/3364440341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe4c0cff30 0x7efe4c1506f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.804+0000 7efe4b400640 1 -- 172.21.15.122:0/3364440341 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4c14fb30 con 0x7efe4c06f890 2024-05-28T06:06:15.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.804+0000 7efe4b400640 1 --2- 172.21.15.122:0/3364440341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe4c06f890 0x7efe4c158b90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efe3c00ca70 tx=0x7efe3c00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:15.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.804+0000 7efe43e00640 1 -- 172.21.15.122:0/3364440341 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c017070 con 0x7efe4c06f890 2024-05-28T06:06:15.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.804+0000 7efe43e00640 1 -- 172.21.15.122:0/3364440341 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe3c00abf0 con 0x7efe4c06f890 2024-05-28T06:06:15.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.804+0000 7efe43e00640 1 -- 172.21.15.122:0/3364440341 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c012400 con 0x7efe4c06f890 2024-05-28T06:06:15.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.804+0000 7efe52600640 1 -- 172.21.15.122:0/3364440341 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe4c0af490 con 0x7efe4c06f890 2024-05-28T06:06:15.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.804+0000 7efe52600640 1 -- 172.21.15.122:0/3364440341 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe4c1500b0 con 0x7efe4c06f890 2024-05-28T06:06:15.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.804+0000 7efe52600640 1 -- 172.21.15.122:0/3364440341 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe4c068c40 con 0x7efe4c06f890 2024-05-28T06:06:15.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.804+0000 7efe43e00640 1 -- 172.21.15.122:0/3364440341 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efe3c01a070 con 0x7efe4c06f890 2024-05-28T06:06:15.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.804+0000 7efe43e00640 1 --2- 172.21.15.122:0/3364440341 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe280683b0 0x7efe2806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:15.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.804+0000 7efe43e00640 1 -- 172.21.15.122:0/3364440341 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efe3c086660 con 0x7efe4c06f890 2024-05-28T06:06:15.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.808+0000 7efe42a00640 1 --2- 172.21.15.122:0/3364440341 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe280683b0 0x7efe2806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:15.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.808+0000 7efe42a00640 1 --2- 172.21.15.122:0/3364440341 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe280683b0 0x7efe2806a870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efe340af000 tx=0x7efe340a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:15.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.812+0000 7efe43e00640 1 -- 172.21.15.122:0/3364440341 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efe3c056c10 con 0x7efe4c06f890 2024-05-28T06:06:15.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.964+0000 7efe52600640 1 -- 172.21.15.122:0/3364440341 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7efe4c0ce7c0 con 0x7efe4c06f890 2024-05-28T06:06:15.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.968+0000 7efe43e00640 1 -- 172.21.15.122:0/3364440341 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7efe3c056510 con 0x7efe4c06f890 2024-05-28T06:06:15.971 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 32 2024-05-28T06:06:15.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.968+0000 7efe52600640 1 -- 172.21.15.122:0/3364440341 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe280683b0 msgr2=0x7efe2806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:15.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.968+0000 7efe52600640 1 --2- 172.21.15.122:0/3364440341 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe280683b0 0x7efe2806a870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efe340af000 tx=0x7efe340a7000 comp rx=0 tx=0).stop 2024-05-28T06:06:15.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.968+0000 7efe52600640 1 -- 172.21.15.122:0/3364440341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe4c06f890 msgr2=0x7efe4c158b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:15.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.968+0000 7efe52600640 1 --2- 172.21.15.122:0/3364440341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe4c06f890 0x7efe4c158b90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efe3c00ca70 tx=0x7efe3c00cf30 comp rx=0 tx=0).stop 2024-05-28T06:06:15.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.968+0000 7efe52600640 1 -- 172.21.15.122:0/3364440341 shutdown_connections 2024-05-28T06:06:15.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.968+0000 7efe52600640 1 --2- 172.21.15.122:0/3364440341 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe280683b0 0x7efe2806a870 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.968+0000 7efe52600640 1 --2- 172.21.15.122:0/3364440341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe4c0cff30 0x7efe4c1506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.968+0000 7efe52600640 1 --2- 172.21.15.122:0/3364440341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe4c0cd930 0x7efe4c1f7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.968+0000 7efe52600640 1 --2- 172.21.15.122:0/3364440341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe4c06f890 0x7efe4c158b90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:15.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.968+0000 7efe52600640 1 -- 172.21.15.122:0/3364440341 >> 172.21.15.122:0/3364440341 conn(0x7efe4c06bd90 msgr2=0x7efe4c072b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:15.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.968+0000 7efe52600640 1 -- 172.21.15.122:0/3364440341 shutdown_connections 2024-05-28T06:06:15.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:15.968+0000 7efe52600640 1 -- 172.21.15.122:0/3364440341 wait complete. 2024-05-28T06:06:15.992 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-28T06:06:16.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.124+0000 7f04abc00640 1 Processor -- start 2024-05-28T06:06:16.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.124+0000 7f04abc00640 1 -- start start 2024-05-28T06:06:16.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.128+0000 7f04abc00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f04a40ce4f0 0x7f04a40ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:16.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.128+0000 7f04abc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04a415e730 0x7f04a415ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:16.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.128+0000 7f04abc00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04a415d970 con 0x7f04a40b58d0 2024-05-28T06:06:16.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.128+0000 7f04abc00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f04a415dc50 con 0x7f04a40ce4f0 2024-05-28T06:06:16.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.128+0000 7f04abc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f04a415df30 con 0x7f04a415e730 2024-05-28T06:06:16.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.128+0000 7f04a3e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f04a40ce4f0 0x7f04a40ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:16.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.128+0000 7f04a3e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f04a40ce4f0 0x7f04a40ce980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51464/0 (socket says 172.21.15.122:51464) 2024-05-28T06:06:16.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.128+0000 7f04a3e00640 1 -- 172.21.15.122:0/3151919541 learned_addr learned my addr 172.21.15.122:0/3151919541 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:16.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.128+0000 7f04a9200640 1 --1- 172.21.15.122:0/3151919541 >> v1:172.21.15.122:6789/0 conn(0x7f04a40b58d0 0x7f04a40b5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:54144/0 (socket says 172.21.15.122:54144) 2024-05-28T06:06:16.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.128+0000 7f04a9c00640 1 --2- 172.21.15.122:0/3151919541 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04a415e730 0x7f04a415ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:16.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.128+0000 7f04a3e00640 1 -- 172.21.15.122:0/3151919541 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04a415e730 msgr2=0x7f04a415ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:16.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.128+0000 7f04a3e00640 1 --2- 172.21.15.122:0/3151919541 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04a415e730 0x7f04a415ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.128+0000 7f04a3e00640 1 -- 172.21.15.122:0/3151919541 >> v1:172.21.15.122:6789/0 conn(0x7f04a40b58d0 legacy=0x7f04a40b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:16.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.128+0000 7f04a3e00640 1 -- 172.21.15.122:0/3151919541 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a415e210 con 0x7f04a40ce4f0 2024-05-28T06:06:16.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.132+0000 7f04a3e00640 1 --2- 172.21.15.122:0/3151919541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04a40ce4f0 0x7f04a40ce980 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0490009870 tx=0x7f049001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad865089640c636e server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:16.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.132+0000 7f04a3400640 1 -- 172.21.15.122:0/3151919541 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04900ab610 con 0x7f04a40ce4f0 2024-05-28T06:06:16.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.132+0000 7f04a3400640 1 -- 172.21.15.122:0/3151919541 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04900b0070 con 0x7f04a40ce4f0 2024-05-28T06:06:16.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.132+0000 7f04a3400640 1 -- 172.21.15.122:0/3151919541 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04900ab9d0 con 0x7f04a40ce4f0 2024-05-28T06:06:16.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.132+0000 7f04abc00640 1 -- 172.21.15.122:0/3151919541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04a40ce4f0 msgr2=0x7f04a40ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:16.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.132+0000 7f04abc00640 1 --2- 172.21.15.122:0/3151919541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04a40ce4f0 0x7f04a40ce980 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0490009870 tx=0x7f049001c560 comp rx=0 tx=0).stop 2024-05-28T06:06:16.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.132+0000 7f04abc00640 1 -- 172.21.15.122:0/3151919541 shutdown_connections 2024-05-28T06:06:16.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.132+0000 7f04abc00640 1 --2- 172.21.15.122:0/3151919541 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04a415e730 0x7f04a415ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.132+0000 7f04abc00640 1 --2- 172.21.15.122:0/3151919541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04a40ce4f0 0x7f04a40ce980 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.132+0000 7f04abc00640 1 -- 172.21.15.122:0/3151919541 >> 172.21.15.122:0/3151919541 conn(0x7f04a406bd90 msgr2=0x7f04a406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:16.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.132+0000 7f04abc00640 1 -- 172.21.15.122:0/3151919541 shutdown_connections 2024-05-28T06:06:16.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.132+0000 7f04abc00640 1 -- 172.21.15.122:0/3151919541 wait complete. 2024-05-28T06:06:16.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.132+0000 7f04abc00640 1 Processor -- start 2024-05-28T06:06:16.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.132+0000 7f04abc00640 1 -- start start 2024-05-28T06:06:16.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04abc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04a40b58d0 0x7f04a4155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:16.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04abc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04a40ce4f0 0x7f04a415c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:16.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04abc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04a415e730 0x7f04a415c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:16.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04abc00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f04a41693d0 con 0x7f04a40b58d0 2024-05-28T06:06:16.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04abc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f04a4169250 con 0x7f04a40ce4f0 2024-05-28T06:06:16.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04abc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f04a4169550 con 0x7f04a415e730 2024-05-28T06:06:16.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04a9200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04a40b58d0 0x7f04a4155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:16.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04a9200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04a40b58d0 0x7f04a4155230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51468/0 (socket says 172.21.15.122:51468) 2024-05-28T06:06:16.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04a9200640 1 -- 172.21.15.122:0/1167292289 learned_addr learned my addr 172.21.15.122:0/1167292289 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:16.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04a3e00640 1 --2- 172.21.15.122:0/1167292289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04a40ce4f0 0x7f04a415c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:16.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04a9c00640 1 --2- 172.21.15.122:0/1167292289 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04a415e730 0x7f04a415c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:16.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04a9200640 1 -- 172.21.15.122:0/1167292289 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04a415e730 msgr2=0x7f04a415c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:16.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04a9200640 1 --2- 172.21.15.122:0/1167292289 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04a415e730 0x7f04a415c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04a9200640 1 -- 172.21.15.122:0/1167292289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04a40ce4f0 msgr2=0x7f04a415c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:16.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04a9200640 1 --2- 172.21.15.122:0/1167292289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04a40ce4f0 0x7f04a415c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04a9200640 1 -- 172.21.15.122:0/1167292289 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a4159780 con 0x7f04a40b58d0 2024-05-28T06:06:16.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04a9200640 1 --2- 172.21.15.122:0/1167292289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04a40b58d0 0x7f04a4155230 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f049800c3a0 tx=0x7f049800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:16.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04a0c00640 1 -- 172.21.15.122:0/1167292289 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04980074e0 con 0x7f04a40b58d0 2024-05-28T06:06:16.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04a0c00640 1 -- 172.21.15.122:0/1167292289 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0498007680 con 0x7f04a40b58d0 2024-05-28T06:06:16.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04a0c00640 1 -- 172.21.15.122:0/1167292289 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0498004a30 con 0x7f04a40b58d0 2024-05-28T06:06:16.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04abc00640 1 -- 172.21.15.122:0/1167292289 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a4159a60 con 0x7f04a40b58d0 2024-05-28T06:06:16.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04abc00640 1 -- 172.21.15.122:0/1167292289 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a415a020 con 0x7f04a40b58d0 2024-05-28T06:06:16.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04abc00640 1 -- 172.21.15.122:0/1167292289 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a4068c40 con 0x7f04a40b58d0 2024-05-28T06:06:16.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.136+0000 7f04a0c00640 1 -- 172.21.15.122:0/1167292289 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f049801a020 con 0x7f04a40b58d0 2024-05-28T06:06:16.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.140+0000 7f04a0c00640 1 --2- 172.21.15.122:0/1167292289 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f04840683b0 0x7f048406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:16.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.140+0000 7f04a0c00640 1 -- 172.21.15.122:0/1167292289 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f04980861f0 con 0x7f04a40b58d0 2024-05-28T06:06:16.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.140+0000 7f04a3e00640 1 --2- 172.21.15.122:0/1167292289 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f04840683b0 0x7f048406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:16.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.140+0000 7f04a3e00640 1 --2- 172.21.15.122:0/1167292289 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f04840683b0 0x7f048406a870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f04900af000 tx=0x7f04900a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:16.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.144+0000 7f04a0c00640 1 -- 172.21.15.122:0/1167292289 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0498056710 con 0x7f04a40b58d0 2024-05-28T06:06:16.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.300+0000 7f04abc00640 1 -- 172.21.15.122:0/1167292289 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f04a415a260 con 0x7f04a40b58d0 2024-05-28T06:06:16.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.300+0000 7f04a0c00640 1 -- 172.21.15.122:0/1167292289 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f0498056010 con 0x7f04a40b58d0 2024-05-28T06:06:16.304 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 64 2024-05-28T06:06:16.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.300+0000 7f04abc00640 1 -- 172.21.15.122:0/1167292289 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f04840683b0 msgr2=0x7f048406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:16.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.300+0000 7f04abc00640 1 --2- 172.21.15.122:0/1167292289 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f04840683b0 0x7f048406a870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f04900af000 tx=0x7f04900a7000 comp rx=0 tx=0).stop 2024-05-28T06:06:16.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.300+0000 7f04abc00640 1 -- 172.21.15.122:0/1167292289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04a40b58d0 msgr2=0x7f04a4155230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:16.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.300+0000 7f04abc00640 1 --2- 172.21.15.122:0/1167292289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04a40b58d0 0x7f04a4155230 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f049800c3a0 tx=0x7f049800c860 comp rx=0 tx=0).stop 2024-05-28T06:06:16.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.300+0000 7f04abc00640 1 -- 172.21.15.122:0/1167292289 shutdown_connections 2024-05-28T06:06:16.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.300+0000 7f04abc00640 1 --2- 172.21.15.122:0/1167292289 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f04840683b0 0x7f048406a870 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.300+0000 7f04abc00640 1 --2- 172.21.15.122:0/1167292289 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04a415e730 0x7f04a415c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.300+0000 7f04abc00640 1 --2- 172.21.15.122:0/1167292289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04a40ce4f0 0x7f04a415c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.300+0000 7f04abc00640 1 --2- 172.21.15.122:0/1167292289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04a40b58d0 0x7f04a4155230 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.300+0000 7f04abc00640 1 -- 172.21.15.122:0/1167292289 >> 172.21.15.122:0/1167292289 conn(0x7f04a406bd90 msgr2=0x7f04a413fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:16.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.300+0000 7f04abc00640 1 -- 172.21.15.122:0/1167292289 shutdown_connections 2024-05-28T06:06:16.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.300+0000 7f04abc00640 1 -- 172.21.15.122:0/1167292289 wait complete. 2024-05-28T06:06:16.325 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:06:16.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.456+0000 7fbab0000640 1 Processor -- start 2024-05-28T06:06:16.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.456+0000 7fbab0000640 1 -- start start 2024-05-28T06:06:16.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.460+0000 7fbab0000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaa80ce4f0 0x7fbaa80ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:16.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.460+0000 7fbab0000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbaa815e730 0x7fbaa815ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:16.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.460+0000 7fbab0000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa815d970 con 0x7fbaa80b58d0 2024-05-28T06:06:16.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.460+0000 7fbab0000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fbaa815dc50 con 0x7fbaa815e730 2024-05-28T06:06:16.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.460+0000 7fbab0000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa815df30 con 0x7fbaa80ce4f0 2024-05-28T06:06:16.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.460+0000 7fbaacc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaa80ce4f0 0x7fbaa80ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:16.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.460+0000 7fbaae000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbaa815e730 0x7fbaa815ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:16.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.460+0000 7fbaae000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbaa815e730 0x7fbaa815ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:47626/0 (socket says 172.21.15.122:47626) 2024-05-28T06:06:16.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.460+0000 7fbaae000640 1 -- 172.21.15.122:0/2965011294 learned_addr learned my addr 172.21.15.122:0/2965011294 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:16.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.460+0000 7fbaacc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaa80ce4f0 0x7fbaa80ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:50562/0 (socket says 172.21.15.122:50562) 2024-05-28T06:06:16.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.460+0000 7fbaad600640 1 --1- 172.21.15.122:0/2965011294 >> v1:172.21.15.153:6789/0 conn(0x7fbaa80b58d0 0x7fbaa80b5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:38890/0 (socket says 172.21.15.122:38890) 2024-05-28T06:06:16.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.460+0000 7fbaae000640 1 -- 172.21.15.122:0/2965011294 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaa80ce4f0 msgr2=0x7fbaa80ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:16.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.460+0000 7fbaae000640 1 --2- 172.21.15.122:0/2965011294 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaa80ce4f0 0x7fbaa80ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.460+0000 7fbaae000640 1 -- 172.21.15.122:0/2965011294 >> v1:172.21.15.153:6789/0 conn(0x7fbaa80b58d0 legacy=0x7fbaa80b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:16.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.460+0000 7fbaae000640 1 -- 172.21.15.122:0/2965011294 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa815e210 con 0x7fbaa815e730 2024-05-28T06:06:16.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.460+0000 7fbaacc00640 1 --2- 172.21.15.122:0/2965011294 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaa80ce4f0 0x7fbaa80ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:06:16.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.464+0000 7fbaae000640 1 --2- 172.21.15.122:0/2965011294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaa815e730 0x7fbaa815ebc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009e50 tx=0x7fbaa001ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2e8b61eac78f49c server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:16.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.464+0000 7fbaa7e00640 1 -- 172.21.15.122:0/2965011294 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa00a57a0 con 0x7fbaa815e730 2024-05-28T06:06:16.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.464+0000 7fbaa7e00640 1 -- 172.21.15.122:0/2965011294 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa00a5940 con 0x7fbaa815e730 2024-05-28T06:06:16.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.464+0000 7fbaa7e00640 1 -- 172.21.15.122:0/2965011294 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa00a5d10 con 0x7fbaa815e730 2024-05-28T06:06:16.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.464+0000 7fbab0000640 1 -- 172.21.15.122:0/2965011294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaa815e730 msgr2=0x7fbaa815ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:16.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.464+0000 7fbab0000640 1 --2- 172.21.15.122:0/2965011294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaa815e730 0x7fbaa815ebc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009e50 tx=0x7fbaa001ca30 comp rx=0 tx=0).stop 2024-05-28T06:06:16.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.464+0000 7fbab0000640 1 -- 172.21.15.122:0/2965011294 shutdown_connections 2024-05-28T06:06:16.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.464+0000 7fbab0000640 1 --2- 172.21.15.122:0/2965011294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaa815e730 0x7fbaa815ebc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.464+0000 7fbab0000640 1 --2- 172.21.15.122:0/2965011294 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaa80ce4f0 0x7fbaa80ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.464+0000 7fbab0000640 1 -- 172.21.15.122:0/2965011294 >> 172.21.15.122:0/2965011294 conn(0x7fbaa806bd90 msgr2=0x7fbaa806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:16.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.464+0000 7fbab0000640 1 -- 172.21.15.122:0/2965011294 shutdown_connections 2024-05-28T06:06:16.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.464+0000 7fbab0000640 1 -- 172.21.15.122:0/2965011294 wait complete. 2024-05-28T06:06:16.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbab0000640 1 Processor -- start 2024-05-28T06:06:16.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbab0000640 1 -- start start 2024-05-28T06:06:16.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbab0000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbaa80b58d0 0x7fbaa815ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:16.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbab0000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaa80ce4f0 0x7fbaa813cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:16.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbab0000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaa815e730 0x7fbaa80b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:16.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbab0000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa81693d0 con 0x7fbaa80b58d0 2024-05-28T06:06:16.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbab0000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa8169250 con 0x7fbaa815e730 2024-05-28T06:06:16.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbab0000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa8169550 con 0x7fbaa80ce4f0 2024-05-28T06:06:16.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbaad600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbaa80b58d0 0x7fbaa815ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:16.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbaad600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbaa80b58d0 0x7fbaa815ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51484/0 (socket says 172.21.15.122:51484) 2024-05-28T06:06:16.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbaad600640 1 -- 172.21.15.122:0/3299196062 learned_addr learned my addr 172.21.15.122:0/3299196062 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:16.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbaacc00640 1 --2- 172.21.15.122:0/3299196062 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaa80ce4f0 0x7fbaa813cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:16.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbaae000640 1 --2- 172.21.15.122:0/3299196062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaa815e730 0x7fbaa80b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:16.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbaad600640 1 -- 172.21.15.122:0/3299196062 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaa80ce4f0 msgr2=0x7fbaa813cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:16.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbaad600640 1 --2- 172.21.15.122:0/3299196062 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaa80ce4f0 0x7fbaa813cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbaad600640 1 -- 172.21.15.122:0/3299196062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaa815e730 msgr2=0x7fbaa80b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:16.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbaad600640 1 --2- 172.21.15.122:0/3299196062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaa815e730 0x7fbaa80b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbaad600640 1 -- 172.21.15.122:0/3299196062 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa813d610 con 0x7fbaa80b58d0 2024-05-28T06:06:16.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbaae000640 1 --2- 172.21.15.122:0/3299196062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaa815e730 0x7fbaa80b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:16.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbaad600640 1 --2- 172.21.15.122:0/3299196062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbaa80b58d0 0x7fbaa815ba30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fba9c00c420 tx=0x7fba9c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:16.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbaa5600640 1 -- 172.21.15.122:0/3299196062 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c0074e0 con 0x7fbaa80b58d0 2024-05-28T06:06:16.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbaa5600640 1 -- 172.21.15.122:0/3299196062 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba9c007680 con 0x7fbaa80b58d0 2024-05-28T06:06:16.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbaa5600640 1 -- 172.21.15.122:0/3299196062 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c004a30 con 0x7fbaa80b58d0 2024-05-28T06:06:16.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbab0000640 1 -- 172.21.15.122:0/3299196062 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa813d8f0 con 0x7fbaa80b58d0 2024-05-28T06:06:16.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.468+0000 7fbab0000640 1 -- 172.21.15.122:0/3299196062 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa813deb0 con 0x7fbaa80b58d0 2024-05-28T06:06:16.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.472+0000 7fbab0000640 1 -- 172.21.15.122:0/3299196062 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa8068c40 con 0x7fbaa80b58d0 2024-05-28T06:06:16.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.472+0000 7fbaa5600640 1 -- 172.21.15.122:0/3299196062 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fba9c01a020 con 0x7fbaa80b58d0 2024-05-28T06:06:16.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.472+0000 7fbaa5600640 1 --2- 172.21.15.122:0/3299196062 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fba88068380 0x7fba8806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:16.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.472+0000 7fbaa5600640 1 -- 172.21.15.122:0/3299196062 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fba9c086240 con 0x7fbaa80b58d0 2024-05-28T06:06:16.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.472+0000 7fbaacc00640 1 --2- 172.21.15.122:0/3299196062 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fba88068380 0x7fba8806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:16.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.472+0000 7fbaacc00640 1 --2- 172.21.15.122:0/3299196062 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fba88068380 0x7fba8806a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fba94009580 tx=0x7fba94009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:16.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.476+0000 7fbaa5600640 1 -- 172.21.15.122:0/3299196062 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fba9c056760 con 0x7fbaa80b58d0 2024-05-28T06:06:16.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.632+0000 7fbab0000640 1 -- 172.21.15.122:0/3299196062 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbaa806e7c0 con 0x7fbaa80b58d0 2024-05-28T06:06:16.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.632+0000 7fbaa5600640 1 -- 172.21.15.122:0/3299196062 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fba9c056060 con 0x7fbaa80b58d0 2024-05-28T06:06:16.638 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:16.639 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":20,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:05:50.822555+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:05:47.441193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-28T06:05:48.148164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:06:16.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.636+0000 7fbab0000640 1 -- 172.21.15.122:0/3299196062 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fba88068380 msgr2=0x7fba8806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:16.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.636+0000 7fbab0000640 1 --2- 172.21.15.122:0/3299196062 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fba88068380 0x7fba8806a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fba94009580 tx=0x7fba94009190 comp rx=0 tx=0).stop 2024-05-28T06:06:16.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.636+0000 7fbab0000640 1 -- 172.21.15.122:0/3299196062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbaa80b58d0 msgr2=0x7fbaa815ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:16.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.636+0000 7fbab0000640 1 --2- 172.21.15.122:0/3299196062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbaa80b58d0 0x7fbaa815ba30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fba9c00c420 tx=0x7fba9c00c8e0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.636+0000 7fbab0000640 1 -- 172.21.15.122:0/3299196062 shutdown_connections 2024-05-28T06:06:16.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.636+0000 7fbab0000640 1 --2- 172.21.15.122:0/3299196062 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fba88068380 0x7fba8806a840 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.636+0000 7fbab0000640 1 --2- 172.21.15.122:0/3299196062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaa815e730 0x7fbaa80b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.636+0000 7fbab0000640 1 --2- 172.21.15.122:0/3299196062 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaa80ce4f0 0x7fbaa813cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.636+0000 7fbab0000640 1 --2- 172.21.15.122:0/3299196062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbaa80b58d0 0x7fbaa815ba30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.636+0000 7fbab0000640 1 -- 172.21.15.122:0/3299196062 >> 172.21.15.122:0/3299196062 conn(0x7fbaa806bd90 msgr2=0x7fbaa813ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:16.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.636+0000 7fbab0000640 1 -- 172.21.15.122:0/3299196062 shutdown_connections 2024-05-28T06:06:16.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.636+0000 7fbab0000640 1 -- 172.21.15.122:0/3299196062 wait complete. 2024-05-28T06:06:16.659 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-28T06:05:47.441193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-28T06:05:48.148164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:06:16.660 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:06:16.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.796+0000 7f26d1400640 1 Processor -- start 2024-05-28T06:06:16.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.796+0000 7f26d1400640 1 -- start start 2024-05-28T06:06:16.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.796+0000 7f26d1400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f26cc0ce5c0 0x7f26cc09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:16.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.796+0000 7f26d1400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f26cc0b3180 0x7f26cc09af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:16.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.796+0000 7f26d1400640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26cc06d460 con 0x7f26cc0d2010 2024-05-28T06:06:16.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.796+0000 7f26d1400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f26cc0d05a0 con 0x7f26cc0ce5c0 2024-05-28T06:06:16.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.796+0000 7f26d1400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f26cc0b3ab0 con 0x7f26cc0b3180 2024-05-28T06:06:16.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.796+0000 7f26cbe00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f26cc0ce5c0 0x7f26cc09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:16.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.796+0000 7f26c3400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f26cc0d2010 0x7f26cc1624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:54154/0 (socket says 172.21.15.122:54154) 2024-05-28T06:06:16.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.796+0000 7f26c3400640 1 -- 172.21.15.122:0/1928455677 learned_addr learned my addr 172.21.15.122:0/1928455677 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:16.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.796+0000 7f26cbe00640 1 -- 172.21.15.122:0/1928455677 >> v2:172.21.15.153:3300/0 conn(0x7f26cc0b3180 msgr2=0x7f26cc09af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:16.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.796+0000 7f26cbe00640 1 --2- 172.21.15.122:0/1928455677 >> v2:172.21.15.153:3300/0 conn(0x7f26cc0b3180 0x7f26cc09af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.796+0000 7f26cbe00640 1 -- 172.21.15.122:0/1928455677 >> v1:172.21.15.122:6789/0 conn(0x7f26cc0d2010 legacy=0x7f26cc1624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:16.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.796+0000 7f26cbe00640 1 -- 172.21.15.122:0/1928455677 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26cc06d700 con 0x7f26cc0ce5c0 2024-05-28T06:06:16.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.796+0000 7f26cb400640 1 -- 172.21.15.122:0/1928455677 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1575602689 0 0) 0x7f26cc06d460 con 0x7f26cc0d2010 2024-05-28T06:06:16.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.800+0000 7f26cbe00640 1 --2- 172.21.15.122:0/1928455677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26cc0ce5c0 0x7f26cc09aa40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f26cc073e80 tx=0x7f26bc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db1794cc661927f server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:16.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.800+0000 7f26cb400640 1 -- 172.21.15.122:0/1928455677 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc0b0070 con 0x7f26cc0ce5c0 2024-05-28T06:06:16.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.800+0000 7f26cb400640 1 -- 172.21.15.122:0/1928455677 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26bc0ab600 con 0x7f26cc0ce5c0 2024-05-28T06:06:16.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.800+0000 7f26cb400640 1 -- 172.21.15.122:0/1928455677 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc0ab9d0 con 0x7f26cc0ce5c0 2024-05-28T06:06:16.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.800+0000 7f26d1400640 1 -- 172.21.15.122:0/1928455677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26cc0ce5c0 msgr2=0x7f26cc09aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:16.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.800+0000 7f26d1400640 1 --2- 172.21.15.122:0/1928455677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26cc0ce5c0 0x7f26cc09aa40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f26cc073e80 tx=0x7f26bc01c480 comp rx=0 tx=0).stop 2024-05-28T06:06:16.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.800+0000 7f26d1400640 1 -- 172.21.15.122:0/1928455677 shutdown_connections 2024-05-28T06:06:16.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.800+0000 7f26d1400640 1 --2- 172.21.15.122:0/1928455677 >> v2:172.21.15.153:3300/0 conn(0x7f26cc0b3180 0x7f26cc09af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.800+0000 7f26d1400640 1 --2- 172.21.15.122:0/1928455677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26cc0ce5c0 0x7f26cc09aa40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.800+0000 7f26d1400640 1 -- 172.21.15.122:0/1928455677 >> 172.21.15.122:0/1928455677 conn(0x7f26cc0b3f70 msgr2=0x7f26cc0b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:16.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.800+0000 7f26d1400640 1 -- 172.21.15.122:0/1928455677 shutdown_connections 2024-05-28T06:06:16.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.800+0000 7f26d1400640 1 -- 172.21.15.122:0/1928455677 wait complete. 2024-05-28T06:06:16.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26d1400640 1 Processor -- start 2024-05-28T06:06:16.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26d1400640 1 -- start start 2024-05-28T06:06:16.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26d1400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26cc0b3180 0x7f26cc0b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:16.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26d1400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26cc0ce5c0 0x7f26cc0c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:16.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26d1400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26cc0d2010 0x7f26cc15a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:16.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26d1400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc0d1b60 con 0x7f26cc0b3180 2024-05-28T06:06:16.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26d1400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc0d19e0 con 0x7f26cc0ce5c0 2024-05-28T06:06:16.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26d1400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f26cc16b9b0 con 0x7f26cc0d2010 2024-05-28T06:06:16.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26cbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26cc0b3180 0x7f26cc0b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:16.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26cbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26cc0b3180 0x7f26cc0b78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51502/0 (socket says 172.21.15.122:51502) 2024-05-28T06:06:16.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26cbe00640 1 -- 172.21.15.122:0/768751976 learned_addr learned my addr 172.21.15.122:0/768751976 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:16.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26c3400640 1 --2- 172.21.15.122:0/768751976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26cc0ce5c0 0x7f26cc0c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:16.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26d0a00640 1 --2- 172.21.15.122:0/768751976 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26cc0d2010 0x7f26cc15a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:16.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26cbe00640 1 -- 172.21.15.122:0/768751976 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26cc0d2010 msgr2=0x7f26cc15a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:16.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26cbe00640 1 --2- 172.21.15.122:0/768751976 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26cc0d2010 0x7f26cc15a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26cbe00640 1 -- 172.21.15.122:0/768751976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26cc0ce5c0 msgr2=0x7f26cc0c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:16.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26cbe00640 1 --2- 172.21.15.122:0/768751976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26cc0ce5c0 0x7f26cc0c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26cbe00640 1 -- 172.21.15.122:0/768751976 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26cc0c7920 con 0x7f26cc0b3180 2024-05-28T06:06:16.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26c3400640 1 --2- 172.21.15.122:0/768751976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26cc0ce5c0 0x7f26cc0c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:16.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26cbe00640 1 --2- 172.21.15.122:0/768751976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26cc0b3180 0x7f26cc0b78f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f26bc01a0b0 tx=0x7f26bc01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:16.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26c8c00640 1 -- 172.21.15.122:0/768751976 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc0b0050 con 0x7f26cc0b3180 2024-05-28T06:06:16.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26c8c00640 1 -- 172.21.15.122:0/768751976 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26bc0b1040 con 0x7f26cc0b3180 2024-05-28T06:06:16.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26c8c00640 1 -- 172.21.15.122:0/768751976 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc004220 con 0x7f26cc0b3180 2024-05-28T06:06:16.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26d1400640 1 -- 172.21.15.122:0/768751976 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26cc0c7c00 con 0x7f26cc0b3180 2024-05-28T06:06:16.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26d1400640 1 -- 172.21.15.122:0/768751976 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26cc0c81c0 con 0x7f26cc0b3180 2024-05-28T06:06:16.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.804+0000 7f26d1400640 1 -- 172.21.15.122:0/768751976 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26cc075620 con 0x7f26cc0b3180 2024-05-28T06:06:16.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.808+0000 7f26c8c00640 1 -- 172.21.15.122:0/768751976 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f26bc0be060 con 0x7f26cc0b3180 2024-05-28T06:06:16.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.808+0000 7f26c8c00640 1 --2- 172.21.15.122:0/768751976 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f26a8068380 0x7f26a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:16.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.808+0000 7f26c8c00640 1 -- 172.21.15.122:0/768751976 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f26bc120610 con 0x7f26cc0b3180 2024-05-28T06:06:16.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.808+0000 7f26c3400640 1 --2- 172.21.15.122:0/768751976 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f26a8068380 0x7f26a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:16.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.808+0000 7f26c3400640 1 --2- 172.21.15.122:0/768751976 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f26a8068380 0x7f26a806a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f26cc068da0 tx=0x7f26b4007cb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:16.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.812+0000 7f26c8c00640 1 -- 172.21.15.122:0/768751976 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f26bc016070 con 0x7f26cc0b3180 2024-05-28T06:06:16.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.968+0000 7f26d1400640 1 -- 172.21.15.122:0/768751976 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f26cc0ccfe0 con 0x7f26cc0b3180 2024-05-28T06:06:16.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.968+0000 7f26c8c00640 1 -- 172.21.15.122:0/768751976 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f26bc0f0b30 con 0x7f26cc0b3180 2024-05-28T06:06:16.974 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:06:16.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.972+0000 7f26d1400640 1 -- 172.21.15.122:0/768751976 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f26a8068380 msgr2=0x7f26a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:16.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.972+0000 7f26d1400640 1 --2- 172.21.15.122:0/768751976 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f26a8068380 0x7f26a806a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f26cc068da0 tx=0x7f26b4007cb0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.972+0000 7f26d1400640 1 -- 172.21.15.122:0/768751976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26cc0b3180 msgr2=0x7f26cc0b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:16.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.972+0000 7f26d1400640 1 --2- 172.21.15.122:0/768751976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26cc0b3180 0x7f26cc0b78f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f26bc01a0b0 tx=0x7f26bc01acc0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.972+0000 7f26d1400640 1 -- 172.21.15.122:0/768751976 shutdown_connections 2024-05-28T06:06:16.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.972+0000 7f26d1400640 1 --2- 172.21.15.122:0/768751976 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f26a8068380 0x7f26a806a840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.972+0000 7f26d1400640 1 --2- 172.21.15.122:0/768751976 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26cc0d2010 0x7f26cc15a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.972+0000 7f26d1400640 1 --2- 172.21.15.122:0/768751976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26cc0ce5c0 0x7f26cc0c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.972+0000 7f26d1400640 1 --2- 172.21.15.122:0/768751976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26cc0b3180 0x7f26cc0b78f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:16.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.972+0000 7f26d1400640 1 -- 172.21.15.122:0/768751976 >> 172.21.15.122:0/768751976 conn(0x7f26cc0b3f70 msgr2=0x7f26cc070830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:16.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.972+0000 7f26d1400640 1 -- 172.21.15.122:0/768751976 shutdown_connections 2024-05-28T06:06:16.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:16.972+0000 7f26d1400640 1 -- 172.21.15.122:0/768751976 wait complete. 2024-05-28T06:06:16.994 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-28T06:06:17.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.128+0000 7f4395a00640 1 Processor -- start 2024-05-28T06:06:17.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.128+0000 7f4395a00640 1 -- start start 2024-05-28T06:06:17.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.132+0000 7f4395a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f439015ea20 0x7f43900d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:17.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.132+0000 7f4395a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f43900b36b0 0x7f43900b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:17.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.132+0000 7f4395a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43900b46c0 con 0x7f4390073c80 2024-05-28T06:06:17.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.132+0000 7f4395a00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f43900b4040 con 0x7f439015ea20 2024-05-28T06:06:17.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.132+0000 7f4395a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f439015ee00 con 0x7f43900b36b0 2024-05-28T06:06:17.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.132+0000 7f438ea00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f439015ea20 0x7f43900d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:17.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.132+0000 7f438ea00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f439015ea20 0x7f43900d0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51514/0 (socket says 172.21.15.122:51514) 2024-05-28T06:06:17.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.132+0000 7f438ea00640 1 -- 172.21.15.122:0/2837813965 learned_addr learned my addr 172.21.15.122:0/2837813965 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:17.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.132+0000 7f438ea00640 1 -- 172.21.15.122:0/2837813965 >> v2:172.21.15.153:3300/0 conn(0x7f43900b36b0 msgr2=0x7f43900b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:17.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.132+0000 7f438ea00640 1 --2- 172.21.15.122:0/2837813965 >> v2:172.21.15.153:3300/0 conn(0x7f43900b36b0 0x7f43900b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.132+0000 7f438ea00640 1 -- 172.21.15.122:0/2837813965 >> v1:172.21.15.153:6789/0 conn(0x7f4390073c80 legacy=0x7f43900b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:17.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.132+0000 7f438ea00640 1 -- 172.21.15.122:0/2837813965 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43900b49a0 con 0x7f439015ea20 2024-05-28T06:06:17.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.132+0000 7f438ea00640 1 --2- 172.21.15.122:0/2837813965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f439015ea20 0x7f43900d0e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f43900d25f0 tx=0x7f438001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d30fc0bc14b3f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:17.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.132+0000 7f438e000640 1 -- 172.21.15.122:0/2837813965 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43800b1070 con 0x7f439015ea20 2024-05-28T06:06:17.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f438e000640 1 -- 172.21.15.122:0/2837813965 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43800ac630 con 0x7f439015ea20 2024-05-28T06:06:17.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f438e000640 1 -- 172.21.15.122:0/2837813965 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43800a8050 con 0x7f439015ea20 2024-05-28T06:06:17.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4395a00640 1 -- 172.21.15.122:0/2837813965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f439015ea20 msgr2=0x7f43900d0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:17.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4395a00640 1 --2- 172.21.15.122:0/2837813965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f439015ea20 0x7f43900d0e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f43900d25f0 tx=0x7f438001c4e0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4395a00640 1 -- 172.21.15.122:0/2837813965 shutdown_connections 2024-05-28T06:06:17.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4395a00640 1 --2- 172.21.15.122:0/2837813965 >> v2:172.21.15.153:3300/0 conn(0x7f43900b36b0 0x7f43900b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4395a00640 1 --2- 172.21.15.122:0/2837813965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f439015ea20 0x7f43900d0e10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4395a00640 1 -- 172.21.15.122:0/2837813965 >> 172.21.15.122:0/2837813965 conn(0x7f43900b6c10 msgr2=0x7f43900b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:17.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4395a00640 1 -- 172.21.15.122:0/2837813965 shutdown_connections 2024-05-28T06:06:17.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4395a00640 1 -- 172.21.15.122:0/2837813965 wait complete. 2024-05-28T06:06:17.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4395a00640 1 Processor -- start 2024-05-28T06:06:17.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4395a00640 1 -- start start 2024-05-28T06:06:17.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4395a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4390073c80 0x7f4390151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:17.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4395a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43900b36b0 0x7f43901478f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:17.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4395a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f439015ea20 0x7f439014f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:17.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4395a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f43900ce960 con 0x7f43900b36b0 2024-05-28T06:06:17.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4395a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f43900b56d0 con 0x7f4390073c80 2024-05-28T06:06:17.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4395a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f43900ceae0 con 0x7f439015ea20 2024-05-28T06:06:17.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4386000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43900b36b0 0x7f43901478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:17.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4386000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43900b36b0 0x7f43901478f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51530/0 (socket says 172.21.15.122:51530) 2024-05-28T06:06:17.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4386000640 1 -- 172.21.15.122:0/2761934300 learned_addr learned my addr 172.21.15.122:0/2761934300 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:17.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f438f400640 1 --2- 172.21.15.122:0/2761934300 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f439015ea20 0x7f439014f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:17.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f438ea00640 1 --2- 172.21.15.122:0/2761934300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4390073c80 0x7f4390151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:17.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4386000640 1 -- 172.21.15.122:0/2761934300 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f439015ea20 msgr2=0x7f439014f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:17.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4386000640 1 --2- 172.21.15.122:0/2761934300 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f439015ea20 0x7f439014f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4386000640 1 -- 172.21.15.122:0/2761934300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4390073c80 msgr2=0x7f4390151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:17.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4386000640 1 --2- 172.21.15.122:0/2761934300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4390073c80 0x7f4390151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f4386000640 1 -- 172.21.15.122:0/2761934300 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43901525f0 con 0x7f43900b36b0 2024-05-28T06:06:17.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f438f400640 1 --2- 172.21.15.122:0/2761934300 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f439015ea20 0x7f439014f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:17.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.136+0000 7f438ea00640 1 --2- 172.21.15.122:0/2761934300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4390073c80 0x7f4390151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:17.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.140+0000 7f4386000640 1 --2- 172.21.15.122:0/2761934300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43900b36b0 0x7f43901478f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f437800b410 tx=0x7f437800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:17.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.140+0000 7f4387400640 1 -- 172.21.15.122:0/2761934300 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4378015020 con 0x7f43900b36b0 2024-05-28T06:06:17.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.140+0000 7f4387400640 1 -- 172.21.15.122:0/2761934300 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4378011830 con 0x7f43900b36b0 2024-05-28T06:06:17.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.140+0000 7f4387400640 1 -- 172.21.15.122:0/2761934300 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4378011c20 con 0x7f43900b36b0 2024-05-28T06:06:17.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.140+0000 7f4395a00640 1 -- 172.21.15.122:0/2761934300 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4390151d50 con 0x7f43900b36b0 2024-05-28T06:06:17.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.140+0000 7f4395a00640 1 -- 172.21.15.122:0/2761934300 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4390152310 con 0x7f43900b36b0 2024-05-28T06:06:17.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.140+0000 7f4395a00640 1 -- 172.21.15.122:0/2761934300 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4390068c40 con 0x7f43900b36b0 2024-05-28T06:06:17.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.140+0000 7f4387400640 1 -- 172.21.15.122:0/2761934300 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4378018020 con 0x7f43900b36b0 2024-05-28T06:06:17.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.140+0000 7f4387400640 1 --2- 172.21.15.122:0/2761934300 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f436c0683b0 0x7f436c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:17.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.140+0000 7f4387400640 1 -- 172.21.15.122:0/2761934300 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4378086320 con 0x7f43900b36b0 2024-05-28T06:06:17.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.140+0000 7f438ea00640 1 --2- 172.21.15.122:0/2761934300 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f436c0683b0 0x7f436c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:17.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.140+0000 7f438ea00640 1 --2- 172.21.15.122:0/2761934300 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f436c0683b0 0x7f436c06a870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f43800ae000 tx=0x7f4380008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:17.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.144+0000 7f4387400640 1 -- 172.21.15.122:0/2761934300 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f437801f070 con 0x7f43900b36b0 2024-05-28T06:06:17.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.304+0000 7f4395a00640 1 -- 172.21.15.122:0/2761934300 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f439015df00 con 0x7f43900b36b0 2024-05-28T06:06:17.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.304+0000 7f4387400640 1 -- 172.21.15.122:0/2761934300 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f4378018310 con 0x7f43900b36b0 2024-05-28T06:06:17.309 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 32 2024-05-28T06:06:17.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.308+0000 7f4395a00640 1 -- 172.21.15.122:0/2761934300 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f436c0683b0 msgr2=0x7f436c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:17.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.308+0000 7f4395a00640 1 --2- 172.21.15.122:0/2761934300 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f436c0683b0 0x7f436c06a870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f43800ae000 tx=0x7f4380008040 comp rx=0 tx=0).stop 2024-05-28T06:06:17.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.308+0000 7f4395a00640 1 -- 172.21.15.122:0/2761934300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43900b36b0 msgr2=0x7f43901478f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:17.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.308+0000 7f4395a00640 1 --2- 172.21.15.122:0/2761934300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43900b36b0 0x7f43901478f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f437800b410 tx=0x7f437800b8d0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.308+0000 7f4395a00640 1 -- 172.21.15.122:0/2761934300 shutdown_connections 2024-05-28T06:06:17.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.308+0000 7f4395a00640 1 --2- 172.21.15.122:0/2761934300 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f436c0683b0 0x7f436c06a870 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.308+0000 7f4395a00640 1 --2- 172.21.15.122:0/2761934300 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f439015ea20 0x7f439014f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.308+0000 7f4395a00640 1 --2- 172.21.15.122:0/2761934300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43900b36b0 0x7f43901478f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.308+0000 7f4395a00640 1 --2- 172.21.15.122:0/2761934300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4390073c80 0x7f4390151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.308+0000 7f4395a00640 1 -- 172.21.15.122:0/2761934300 >> 172.21.15.122:0/2761934300 conn(0x7f43900b6c10 msgr2=0x7f439015cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:17.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.308+0000 7f4395a00640 1 -- 172.21.15.122:0/2761934300 shutdown_connections 2024-05-28T06:06:17.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.308+0000 7f4395a00640 1 -- 172.21.15.122:0/2761934300 wait complete. 2024-05-28T06:06:17.329 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-28T06:06:17.466 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:06:17.469 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:06:17.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.464+0000 7f2395200640 1 Processor -- start 2024-05-28T06:06:17.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.464+0000 7f2395200640 1 -- start start 2024-05-28T06:06:17.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.468+0000 7f2395200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f23901624f0 0x7f2390162950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:17.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.468+0000 7f2395200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f239015cc40 0x7f239015d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:17.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.468+0000 7f2395200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23900b2980 con 0x7f23900b1a90 2024-05-28T06:06:17.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.468+0000 7f2395200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f2390162e90 con 0x7f239015cc40 2024-05-28T06:06:17.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.468+0000 7f2395200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f23900b2730 con 0x7f23901624f0 2024-05-28T06:06:17.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.468+0000 7f238fe00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f239015cc40 0x7f239015d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:17.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.468+0000 7f238f400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f23900b1a90 0x7f23900b42c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:54160/0 (socket says 172.21.15.122:54160) 2024-05-28T06:06:17.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.468+0000 7f238f400640 1 -- 172.21.15.122:0/2126140780 learned_addr learned my addr 172.21.15.122:0/2126140780 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:17.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.468+0000 7f2386a00640 1 --2- 172.21.15.122:0/2126140780 >> v2:172.21.15.153:3300/0 conn(0x7f23901624f0 0x7f2390162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:17.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.468+0000 7f238fe00640 1 -- 172.21.15.122:0/2126140780 >> v2:172.21.15.153:3300/0 conn(0x7f23901624f0 msgr2=0x7f2390162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:17.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.468+0000 7f238fe00640 1 --2- 172.21.15.122:0/2126140780 >> v2:172.21.15.153:3300/0 conn(0x7f23901624f0 0x7f2390162950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.468+0000 7f238fe00640 1 -- 172.21.15.122:0/2126140780 >> v1:172.21.15.122:6789/0 conn(0x7f23900b1a90 legacy=0x7f23900b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:17.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.468+0000 7f238fe00640 1 -- 172.21.15.122:0/2126140780 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23900b2c60 con 0x7f239015cc40 2024-05-28T06:06:17.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.468+0000 7f238ea00640 1 -- 172.21.15.122:0/2126140780 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 395888048 0 0) 0x7f23900b2980 con 0x7f23900b1a90 2024-05-28T06:06:17.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.472+0000 7f238fe00640 1 --2- 172.21.15.122:0/2126140780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f239015cc40 0x7f239015d050 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f239006e770 tx=0x7f238801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce57cfa514a6d8d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:17.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.472+0000 7f238ea00640 1 -- 172.21.15.122:0/2126140780 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23880b2070 con 0x7f239015cc40 2024-05-28T06:06:17.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.472+0000 7f238ea00640 1 -- 172.21.15.122:0/2126140780 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23880a59c0 con 0x7f239015cc40 2024-05-28T06:06:17.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.472+0000 7f238ea00640 1 -- 172.21.15.122:0/2126140780 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23880a5d90 con 0x7f239015cc40 2024-05-28T06:06:17.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.472+0000 7f2395200640 1 -- 172.21.15.122:0/2126140780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f239015cc40 msgr2=0x7f239015d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:17.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.472+0000 7f2395200640 1 --2- 172.21.15.122:0/2126140780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f239015cc40 0x7f239015d050 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f239006e770 tx=0x7f238801c900 comp rx=0 tx=0).stop 2024-05-28T06:06:17.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.472+0000 7f2395200640 1 -- 172.21.15.122:0/2126140780 shutdown_connections 2024-05-28T06:06:17.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.472+0000 7f2395200640 1 --2- 172.21.15.122:0/2126140780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f239015cc40 0x7f239015d050 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.472+0000 7f2395200640 1 --2- 172.21.15.122:0/2126140780 >> v2:172.21.15.153:3300/0 conn(0x7f23901624f0 0x7f2390162950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.472+0000 7f2395200640 1 -- 172.21.15.122:0/2126140780 >> 172.21.15.122:0/2126140780 conn(0x7f23900b67e0 msgr2=0x7f23900b6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:17.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.472+0000 7f2395200640 1 -- 172.21.15.122:0/2126140780 shutdown_connections 2024-05-28T06:06:17.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.472+0000 7f2395200640 1 -- 172.21.15.122:0/2126140780 wait complete. 2024-05-28T06:06:17.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.472+0000 7f2395200640 1 Processor -- start 2024-05-28T06:06:17.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.472+0000 7f2395200640 1 -- start start 2024-05-28T06:06:17.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.472+0000 7f2395200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23900b1a90 0x7f2390145030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:17.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.472+0000 7f2395200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f239015cc40 0x7f2390145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:17.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.472+0000 7f2395200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23901624f0 0x7f2390146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:17.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.472+0000 7f2395200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f23900b1ff0 con 0x7f23901624f0 2024-05-28T06:06:17.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.472+0000 7f2395200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f23900b1e70 con 0x7f23900b1a90 2024-05-28T06:06:17.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.472+0000 7f2395200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2390163170 con 0x7f239015cc40 2024-05-28T06:06:17.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.472+0000 7f238fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23901624f0 0x7f2390146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:17.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.476+0000 7f238fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23901624f0 0x7f2390146150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51550/0 (socket says 172.21.15.122:51550) 2024-05-28T06:06:17.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.476+0000 7f238fe00640 1 -- 172.21.15.122:0/1128341062 learned_addr learned my addr 172.21.15.122:0/1128341062 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:17.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.476+0000 7f238f400640 1 --2- 172.21.15.122:0/1128341062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23900b1a90 0x7f2390145030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:17.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.476+0000 7f2386a00640 1 --2- 172.21.15.122:0/1128341062 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f239015cc40 0x7f2390145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:17.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.476+0000 7f238fe00640 1 -- 172.21.15.122:0/1128341062 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f239015cc40 msgr2=0x7f2390145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:17.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.476+0000 7f238fe00640 1 --2- 172.21.15.122:0/1128341062 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f239015cc40 0x7f2390145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.476+0000 7f238fe00640 1 -- 172.21.15.122:0/1128341062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23900b1a90 msgr2=0x7f2390145030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:17.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.476+0000 7f238fe00640 1 --2- 172.21.15.122:0/1128341062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23900b1a90 0x7f2390145030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.476+0000 7f238fe00640 1 -- 172.21.15.122:0/1128341062 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239015c290 con 0x7f23901624f0 2024-05-28T06:06:17.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.476+0000 7f238f400640 1 --2- 172.21.15.122:0/1128341062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23900b1a90 0x7f2390145030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:17.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.476+0000 7f238fe00640 1 --2- 172.21.15.122:0/1128341062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23901624f0 0x7f2390146150 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f23880b0040 tx=0x7f23880196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:17.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.476+0000 7f2387e00640 1 -- 172.21.15.122:0/1128341062 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23880b2050 con 0x7f23901624f0 2024-05-28T06:06:17.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.476+0000 7f2387e00640 1 -- 172.21.15.122:0/1128341062 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23880b3040 con 0x7f23901624f0 2024-05-28T06:06:17.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.476+0000 7f2387e00640 1 -- 172.21.15.122:0/1128341062 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23880ad850 con 0x7f23901624f0 2024-05-28T06:06:17.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.476+0000 7f2395200640 1 -- 172.21.15.122:0/1128341062 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23900ca6e0 con 0x7f23901624f0 2024-05-28T06:06:17.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.476+0000 7f2395200640 1 -- 172.21.15.122:0/1128341062 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23900caca0 con 0x7f23901624f0 2024-05-28T06:06:17.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.476+0000 7f2395200640 1 -- 172.21.15.122:0/1128341062 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2390075620 con 0x7f23901624f0 2024-05-28T06:06:17.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.476+0000 7f2387e00640 1 -- 172.21.15.122:0/1128341062 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f23880c0020 con 0x7f23901624f0 2024-05-28T06:06:17.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.476+0000 7f2387e00640 1 --2- 172.21.15.122:0/1128341062 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f236c068380 0x7f236c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:17.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.476+0000 7f2387e00640 1 -- 172.21.15.122:0/1128341062 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2388121570 con 0x7f23901624f0 2024-05-28T06:06:17.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.480+0000 7f238f400640 1 --2- 172.21.15.122:0/1128341062 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f236c068380 0x7f236c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:17.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.480+0000 7f238f400640 1 --2- 172.21.15.122:0/1128341062 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f236c068380 0x7f236c06a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2380007fd0 tx=0x7f2380007c20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:17.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.484+0000 7f2387e00640 1 -- 172.21.15.122:0/1128341062 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2388016520 con 0x7f23901624f0 2024-05-28T06:06:17.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.640+0000 7f2395200640 1 -- 172.21.15.122:0/1128341062 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f23900b74b0 con 0x7f23901624f0 2024-05-28T06:06:17.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.640+0000 7f2387e00640 1 -- 172.21.15.122:0/1128341062 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f238811fe20 con 0x7f23901624f0 2024-05-28T06:06:17.645 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 64 2024-05-28T06:06:17.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.644+0000 7f2395200640 1 -- 172.21.15.122:0/1128341062 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f236c068380 msgr2=0x7f236c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:17.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.644+0000 7f2395200640 1 --2- 172.21.15.122:0/1128341062 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f236c068380 0x7f236c06a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2380007fd0 tx=0x7f2380007c20 comp rx=0 tx=0).stop 2024-05-28T06:06:17.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.644+0000 7f2395200640 1 -- 172.21.15.122:0/1128341062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23901624f0 msgr2=0x7f2390146150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:17.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.644+0000 7f2395200640 1 --2- 172.21.15.122:0/1128341062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23901624f0 0x7f2390146150 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f23880b0040 tx=0x7f23880196a0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.644+0000 7f2395200640 1 -- 172.21.15.122:0/1128341062 shutdown_connections 2024-05-28T06:06:17.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.644+0000 7f2395200640 1 --2- 172.21.15.122:0/1128341062 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f236c068380 0x7f236c06a840 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.644+0000 7f2395200640 1 --2- 172.21.15.122:0/1128341062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23901624f0 0x7f2390146150 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.644+0000 7f2395200640 1 --2- 172.21.15.122:0/1128341062 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f239015cc40 0x7f2390145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.644+0000 7f2395200640 1 --2- 172.21.15.122:0/1128341062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23900b1a90 0x7f2390145030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.644+0000 7f2395200640 1 -- 172.21.15.122:0/1128341062 >> 172.21.15.122:0/1128341062 conn(0x7f23900b67e0 msgr2=0x7f239006b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:17.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.644+0000 7f2395200640 1 -- 172.21.15.122:0/1128341062 shutdown_connections 2024-05-28T06:06:17.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.644+0000 7f2395200640 1 -- 172.21.15.122:0/1128341062 wait complete. 2024-05-28T06:06:17.667 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:06:17.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.800+0000 7f786ae00640 1 Processor -- start 2024-05-28T06:06:17.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.800+0000 7f786ae00640 1 -- start start 2024-05-28T06:06:17.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.800+0000 7f786ae00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f78641460c0 0x7f78640ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:17.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.800+0000 7f786ae00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78640ce760 0x7f78640b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:17.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.800+0000 7f786ae00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f78640b3b30 0x7f786406b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:17.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.800+0000 7f786ae00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f78641464a0 con 0x7f78640b3b30 2024-05-28T06:06:17.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.800+0000 7f786ae00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f786415cbf0 con 0x7f78641460c0 2024-05-28T06:06:17.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.800+0000 7f786ae00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f78640cebe0 con 0x7f78640ce760 2024-05-28T06:06:17.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.800+0000 7f7868e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f78640b3b30 0x7f786406b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:17.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.800+0000 7f7868e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f78640b3b30 0x7f786406b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51562/0 (socket says 172.21.15.122:51562) 2024-05-28T06:06:17.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.800+0000 7f7868e00640 1 -- 172.21.15.122:0/3180580286 learned_addr learned my addr 172.21.15.122:0/3180580286 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:17.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.800+0000 7f7863400640 1 --2- 172.21.15.122:0/3180580286 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78640ce760 0x7f78640b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:17.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.800+0000 7f7863e00640 1 --2- 172.21.15.122:0/3180580286 >> v2:172.21.15.153:3300/0 conn(0x7f78641460c0 0x7f78640ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:17.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.800+0000 7f7868e00640 1 -- 172.21.15.122:0/3180580286 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78640ce760 msgr2=0x7f78640b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:17.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.800+0000 7f7868e00640 1 --2- 172.21.15.122:0/3180580286 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78640ce760 0x7f78640b35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.800+0000 7f7868e00640 1 -- 172.21.15.122:0/3180580286 >> v2:172.21.15.153:3300/0 conn(0x7f78641460c0 msgr2=0x7f78640ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:17.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.800+0000 7f7868e00640 1 --2- 172.21.15.122:0/3180580286 >> v2:172.21.15.153:3300/0 conn(0x7f78641460c0 0x7f78640ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.800+0000 7f7868e00640 1 -- 172.21.15.122:0/3180580286 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78640d05c0 con 0x7f78640b3b30 2024-05-28T06:06:17.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.804+0000 7f7868e00640 1 --2- 172.21.15.122:0/3180580286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78640b3b30 0x7f786406b990 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f786406fda0 tx=0x7f785c01c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8671061eb36058 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:17.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.804+0000 7f7862a00640 1 -- 172.21.15.122:0/3180580286 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785c0ac070 con 0x7f78640b3b30 2024-05-28T06:06:17.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.804+0000 7f7862a00640 1 -- 172.21.15.122:0/3180580286 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f785c0a8420 con 0x7f78640b3b30 2024-05-28T06:06:17.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.804+0000 7f7862a00640 1 -- 172.21.15.122:0/3180580286 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785c0a87f0 con 0x7f78640b3b30 2024-05-28T06:06:17.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.804+0000 7f786ae00640 1 -- 172.21.15.122:0/3180580286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78640b3b30 msgr2=0x7f786406b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:17.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.804+0000 7f786ae00640 1 --2- 172.21.15.122:0/3180580286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78640b3b30 0x7f786406b990 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f786406fda0 tx=0x7f785c01c730 comp rx=0 tx=0).stop 2024-05-28T06:06:17.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.804+0000 7f786ae00640 1 -- 172.21.15.122:0/3180580286 shutdown_connections 2024-05-28T06:06:17.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.804+0000 7f786ae00640 1 --2- 172.21.15.122:0/3180580286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78640b3b30 0x7f786406b990 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.804+0000 7f786ae00640 1 --2- 172.21.15.122:0/3180580286 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78640ce760 0x7f78640b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.804+0000 7f786ae00640 1 --2- 172.21.15.122:0/3180580286 >> v2:172.21.15.153:3300/0 conn(0x7f78641460c0 0x7f78640ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.804+0000 7f786ae00640 1 -- 172.21.15.122:0/3180580286 >> 172.21.15.122:0/3180580286 conn(0x7f78640b6c10 msgr2=0x7f78640b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:17.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.804+0000 7f786ae00640 1 -- 172.21.15.122:0/3180580286 shutdown_connections 2024-05-28T06:06:17.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.804+0000 7f786ae00640 1 -- 172.21.15.122:0/3180580286 wait complete. 2024-05-28T06:06:17.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.804+0000 7f786ae00640 1 Processor -- start 2024-05-28T06:06:17.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.804+0000 7f786ae00640 1 -- start start 2024-05-28T06:06:17.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f786ae00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78640b3b30 0x7f78641f7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:17.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f786ae00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78640ce760 0x7f78640b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:17.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f786ae00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78641460c0 0x7f786415c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:17.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f786ae00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f78640d10a0 con 0x7f78640b3b30 2024-05-28T06:06:17.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f786ae00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f78640cde50 con 0x7f78641460c0 2024-05-28T06:06:17.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f786ae00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7864137dd0 con 0x7f78640ce760 2024-05-28T06:06:17.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f7863e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78640b3b30 0x7f78641f7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:17.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f7863e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78640b3b30 0x7f78641f7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51572/0 (socket says 172.21.15.122:51572) 2024-05-28T06:06:17.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f7863e00640 1 -- 172.21.15.122:0/936562937 learned_addr learned my addr 172.21.15.122:0/936562937 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:17.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f7868e00640 1 --2- 172.21.15.122:0/936562937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78641460c0 0x7f786415c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:17.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f7863400640 1 --2- 172.21.15.122:0/936562937 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78640ce760 0x7f78640b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:17.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f7863e00640 1 -- 172.21.15.122:0/936562937 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78640ce760 msgr2=0x7f78640b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:17.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f7863e00640 1 --2- 172.21.15.122:0/936562937 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78640ce760 0x7f78640b61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f7863e00640 1 -- 172.21.15.122:0/936562937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78641460c0 msgr2=0x7f786415c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:17.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f7863e00640 1 --2- 172.21.15.122:0/936562937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78641460c0 0x7f786415c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f7863e00640 1 -- 172.21.15.122:0/936562937 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78641f8110 con 0x7f78640b3b30 2024-05-28T06:06:17.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f7863400640 1 --2- 172.21.15.122:0/936562937 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78640ce760 0x7f78640b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:17.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f7863e00640 1 --2- 172.21.15.122:0/936562937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78640b3b30 0x7f78641f7a90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f785400d5f0 tx=0x7f785400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:17.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f785be00640 1 -- 172.21.15.122:0/936562937 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78540125f0 con 0x7f78640b3b30 2024-05-28T06:06:17.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f785be00640 1 -- 172.21.15.122:0/936562937 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7854019070 con 0x7f78640b3b30 2024-05-28T06:06:17.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f786ae00640 1 -- 172.21.15.122:0/936562937 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78641f83f0 con 0x7f78640b3b30 2024-05-28T06:06:17.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f785be00640 1 -- 172.21.15.122:0/936562937 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78540129b0 con 0x7f78640b3b30 2024-05-28T06:06:17.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f786ae00640 1 -- 172.21.15.122:0/936562937 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78641f89b0 con 0x7f78640b3b30 2024-05-28T06:06:17.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.808+0000 7f786ae00640 1 -- 172.21.15.122:0/936562937 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7864068c40 con 0x7f78640b3b30 2024-05-28T06:06:17.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.812+0000 7f785be00640 1 -- 172.21.15.122:0/936562937 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7854012b50 con 0x7f78640b3b30 2024-05-28T06:06:17.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.812+0000 7f785be00640 1 --2- 172.21.15.122:0/936562937 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f78440683b0 0x7f784406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:17.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.812+0000 7f785be00640 1 -- 172.21.15.122:0/936562937 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7854086d00 con 0x7f78640b3b30 2024-05-28T06:06:17.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.812+0000 7f7863400640 1 --2- 172.21.15.122:0/936562937 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f78440683b0 0x7f784406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:17.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.812+0000 7f7863400640 1 --2- 172.21.15.122:0/936562937 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f78440683b0 0x7f784406a870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7864156130 tx=0x7f7850008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:17.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.816+0000 7f785be00640 1 -- 172.21.15.122:0/936562937 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7854057220 con 0x7f78640b3b30 2024-05-28T06:06:17.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.972+0000 7f786ae00640 1 -- 172.21.15.122:0/936562937 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7864144a50 con 0x7f78640b3b30 2024-05-28T06:06:17.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.972+0000 7f785be00640 1 -- 172.21.15.122:0/936562937 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f7854056b20 con 0x7f78640b3b30 2024-05-28T06:06:17.978 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:17.978 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":20,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:05:50.822555+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:05:47.441193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-28T06:05:48.148164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:06:17.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.976+0000 7f786ae00640 1 -- 172.21.15.122:0/936562937 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f78440683b0 msgr2=0x7f784406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:17.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.976+0000 7f786ae00640 1 --2- 172.21.15.122:0/936562937 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f78440683b0 0x7f784406a870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7864156130 tx=0x7f7850008040 comp rx=0 tx=0).stop 2024-05-28T06:06:17.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.976+0000 7f786ae00640 1 -- 172.21.15.122:0/936562937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78640b3b30 msgr2=0x7f78641f7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:17.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.976+0000 7f786ae00640 1 --2- 172.21.15.122:0/936562937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78640b3b30 0x7f78641f7a90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f785400d5f0 tx=0x7f785400dab0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.976+0000 7f786ae00640 1 -- 172.21.15.122:0/936562937 shutdown_connections 2024-05-28T06:06:17.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.976+0000 7f786ae00640 1 --2- 172.21.15.122:0/936562937 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f78440683b0 0x7f784406a870 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.976+0000 7f786ae00640 1 --2- 172.21.15.122:0/936562937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78641460c0 0x7f786415c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.976+0000 7f786ae00640 1 --2- 172.21.15.122:0/936562937 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78640ce760 0x7f78640b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.976+0000 7f786ae00640 1 --2- 172.21.15.122:0/936562937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78640b3b30 0x7f78641f7a90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:17.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.976+0000 7f786ae00640 1 -- 172.21.15.122:0/936562937 >> 172.21.15.122:0/936562937 conn(0x7f78640b6c10 msgr2=0x7f78640b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:17.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.976+0000 7f786ae00640 1 -- 172.21.15.122:0/936562937 shutdown_connections 2024-05-28T06:06:17.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:17.976+0000 7f786ae00640 1 -- 172.21.15.122:0/936562937 wait complete. 2024-05-28T06:06:17.999 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-28T06:05:47.441193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-28T06:05:48.148164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:06:18.000 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:06:18.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.136+0000 7efe44400640 1 Processor -- start 2024-05-28T06:06:18.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.136+0000 7efe44400640 1 -- start start 2024-05-28T06:06:18.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.136+0000 7efe44400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe3c073c80 0x7efe3c0d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:18.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.136+0000 7efe44400640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe3c0b46c0 con 0x7efe3c15ea20 2024-05-28T06:06:18.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.136+0000 7efe44400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe3c0b49a0 con 0x7efe3c0b36b0 2024-05-28T06:06:18.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.136+0000 7efe44400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efe3c15ee00 con 0x7efe3c073c80 2024-05-28T06:06:18.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.136+0000 7efe41a00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7efe3c15ea20 0x7efe3c0b4fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:54162/0 (socket says 172.21.15.122:54162) 2024-05-28T06:06:18.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.136+0000 7efe41a00640 1 -- 172.21.15.122:0/478533425 learned_addr learned my addr 172.21.15.122:0/478533425 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:18.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.136+0000 7efe41000640 1 --2- 172.21.15.122:0/478533425 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe3c073c80 0x7efe3c0d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:18.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.136+0000 7efe3be00640 1 -- 172.21.15.122:0/478533425 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 736068096 0 0) 0x7efe3c0b46c0 con 0x7efe3c15ea20 2024-05-28T06:06:18.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.136+0000 7efe3be00640 1 -- 172.21.15.122:0/478533425 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe24003530 con 0x7efe3c15ea20 2024-05-28T06:06:18.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.136+0000 7efe3be00640 1 -- 172.21.15.122:0/478533425 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3398324470 0 0) 0x7efe3c0b49a0 con 0x7efe3c0b36b0 2024-05-28T06:06:18.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.136+0000 7efe3be00640 1 -- 172.21.15.122:0/478533425 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe3c0b46c0 con 0x7efe3c0b36b0 2024-05-28T06:06:18.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.136+0000 7efe41000640 1 -- 172.21.15.122:0/478533425 >> v1:172.21.15.153:6789/0 conn(0x7efe3c0b36b0 legacy=0x7efe3c0ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:18.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.136+0000 7efe41000640 1 -- 172.21.15.122:0/478533425 >> v1:172.21.15.122:6789/0 conn(0x7efe3c15ea20 legacy=0x7efe3c0b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:18.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.136+0000 7efe3be00640 1 -- 172.21.15.122:0/478533425 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3585223635 0 0) 0x7efe24003530 con 0x7efe3c15ea20 2024-05-28T06:06:18.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.136+0000 7efe41000640 1 -- 172.21.15.122:0/478533425 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3c0d1e50 con 0x7efe3c073c80 2024-05-28T06:06:18.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.140+0000 7efe41000640 1 --2- 172.21.15.122:0/478533425 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe3c073c80 0x7efe3c0d0e10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efe280097f0 tx=0x7efe2801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dbdc168b2d40a1b server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:18.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.140+0000 7efe3be00640 1 -- 172.21.15.122:0/478533425 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe280b0070 con 0x7efe3c073c80 2024-05-28T06:06:18.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.140+0000 7efe3be00640 1 -- 172.21.15.122:0/478533425 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe280ab400 con 0x7efe3c073c80 2024-05-28T06:06:18.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.140+0000 7efe3be00640 1 -- 172.21.15.122:0/478533425 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe30001680 con 0x7efe3c073c80 2024-05-28T06:06:18.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.140+0000 7efe44400640 1 -- 172.21.15.122:0/478533425 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe3c073c80 msgr2=0x7efe3c0d0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:18.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.140+0000 7efe44400640 1 --2- 172.21.15.122:0/478533425 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe3c073c80 0x7efe3c0d0e10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efe280097f0 tx=0x7efe2801c400 comp rx=0 tx=0).stop 2024-05-28T06:06:18.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.140+0000 7efe44400640 1 -- 172.21.15.122:0/478533425 shutdown_connections 2024-05-28T06:06:18.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.140+0000 7efe44400640 1 --2- 172.21.15.122:0/478533425 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe3c073c80 0x7efe3c0d0e10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.140+0000 7efe44400640 1 -- 172.21.15.122:0/478533425 >> 172.21.15.122:0/478533425 conn(0x7efe3c0b6c10 msgr2=0x7efe3c0b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:18.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.140+0000 7efe44400640 1 -- 172.21.15.122:0/478533425 shutdown_connections 2024-05-28T06:06:18.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.140+0000 7efe44400640 1 -- 172.21.15.122:0/478533425 wait complete. 2024-05-28T06:06:18.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe44400640 1 Processor -- start 2024-05-28T06:06:18.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe44400640 1 -- start start 2024-05-28T06:06:18.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe44400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe3c073c80 0x7efe3c147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:18.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe44400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe3c0b36b0 0x7efe3c0ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:18.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe44400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe3c15ea20 0x7efe3c0cd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:18.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe44400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c0b3ed0 con 0x7efe3c15ea20 2024-05-28T06:06:18.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe44400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c16cd30 con 0x7efe3c073c80 2024-05-28T06:06:18.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe44400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efe3c0cb820 con 0x7efe3c0b36b0 2024-05-28T06:06:18.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe42400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe3c15ea20 0x7efe3c0cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:18.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe42400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe3c15ea20 0x7efe3c0cd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51584/0 (socket says 172.21.15.122:51584) 2024-05-28T06:06:18.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe42400640 1 -- 172.21.15.122:0/674022616 learned_addr learned my addr 172.21.15.122:0/674022616 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:18.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe41000640 1 --2- 172.21.15.122:0/674022616 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe3c0b36b0 0x7efe3c0ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:18.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe41a00640 1 --2- 172.21.15.122:0/674022616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe3c073c80 0x7efe3c147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:18.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe42400640 1 -- 172.21.15.122:0/674022616 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe3c0b36b0 msgr2=0x7efe3c0ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:18.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe42400640 1 --2- 172.21.15.122:0/674022616 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe3c0b36b0 0x7efe3c0ccd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe42400640 1 -- 172.21.15.122:0/674022616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe3c073c80 msgr2=0x7efe3c147e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:18.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe42400640 1 --2- 172.21.15.122:0/674022616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe3c073c80 0x7efe3c147e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe42400640 1 -- 172.21.15.122:0/674022616 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3c0cac10 con 0x7efe3c15ea20 2024-05-28T06:06:18.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe42400640 1 --2- 172.21.15.122:0/674022616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe3c15ea20 0x7efe3c0cd260 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efe3400c790 tx=0x7efe3400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:18.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe39600640 1 -- 172.21.15.122:0/674022616 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34003b80 con 0x7efe3c15ea20 2024-05-28T06:06:18.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe39600640 1 -- 172.21.15.122:0/674022616 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe34003d20 con 0x7efe3c15ea20 2024-05-28T06:06:18.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe39600640 1 -- 172.21.15.122:0/674022616 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3400aa50 con 0x7efe3c15ea20 2024-05-28T06:06:18.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe44400640 1 -- 172.21.15.122:0/674022616 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe3c0caef0 con 0x7efe3c15ea20 2024-05-28T06:06:18.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.144+0000 7efe44400640 1 -- 172.21.15.122:0/674022616 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe3c0cb4b0 con 0x7efe3c15ea20 2024-05-28T06:06:18.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.148+0000 7efe44400640 1 -- 172.21.15.122:0/674022616 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe3c0cb9a0 con 0x7efe3c15ea20 2024-05-28T06:06:18.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.148+0000 7efe39600640 1 -- 172.21.15.122:0/674022616 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efe3400abf0 con 0x7efe3c15ea20 2024-05-28T06:06:18.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.148+0000 7efe39600640 1 --2- 172.21.15.122:0/674022616 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe1c068380 0x7efe1c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:18.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.148+0000 7efe39600640 1 -- 172.21.15.122:0/674022616 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efe340868c0 con 0x7efe3c15ea20 2024-05-28T06:06:18.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.148+0000 7efe41a00640 1 --2- 172.21.15.122:0/674022616 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe1c068380 0x7efe1c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:18.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.148+0000 7efe41a00640 1 --2- 172.21.15.122:0/674022616 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe1c068380 0x7efe1c06a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efe300011f0 tx=0x7efe30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:18.157 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.152+0000 7efe39600640 1 -- 172.21.15.122:0/674022616 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efe34056e80 con 0x7efe3c15ea20 2024-05-28T06:06:18.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.308+0000 7efe44400640 1 -- 172.21.15.122:0/674022616 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efe3c068c40 con 0x7efe3c15ea20 2024-05-28T06:06:18.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.308+0000 7efe39600640 1 -- 172.21.15.122:0/674022616 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7efe34056780 con 0x7efe3c15ea20 2024-05-28T06:06:18.315 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:06:18.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.312+0000 7efe44400640 1 -- 172.21.15.122:0/674022616 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe1c068380 msgr2=0x7efe1c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:18.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.312+0000 7efe44400640 1 --2- 172.21.15.122:0/674022616 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe1c068380 0x7efe1c06a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efe300011f0 tx=0x7efe30009040 comp rx=0 tx=0).stop 2024-05-28T06:06:18.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.312+0000 7efe44400640 1 -- 172.21.15.122:0/674022616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe3c15ea20 msgr2=0x7efe3c0cd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:18.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.312+0000 7efe44400640 1 --2- 172.21.15.122:0/674022616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe3c15ea20 0x7efe3c0cd260 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efe3400c790 tx=0x7efe3400cc50 comp rx=0 tx=0).stop 2024-05-28T06:06:18.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.312+0000 7efe44400640 1 -- 172.21.15.122:0/674022616 shutdown_connections 2024-05-28T06:06:18.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.312+0000 7efe44400640 1 --2- 172.21.15.122:0/674022616 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe1c068380 0x7efe1c06a840 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.312+0000 7efe44400640 1 --2- 172.21.15.122:0/674022616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe3c15ea20 0x7efe3c0cd260 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.312+0000 7efe44400640 1 --2- 172.21.15.122:0/674022616 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe3c0b36b0 0x7efe3c0ccd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.312+0000 7efe44400640 1 --2- 172.21.15.122:0/674022616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe3c073c80 0x7efe3c147e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.312+0000 7efe44400640 1 -- 172.21.15.122:0/674022616 >> 172.21.15.122:0/674022616 conn(0x7efe3c0b6c10 msgr2=0x7efe3c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:18.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.312+0000 7efe44400640 1 -- 172.21.15.122:0/674022616 shutdown_connections 2024-05-28T06:06:18.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.312+0000 7efe44400640 1 -- 172.21.15.122:0/674022616 wait complete. 2024-05-28T06:06:18.335 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-28T06:06:18.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.472+0000 7fefbd400640 1 Processor -- start 2024-05-28T06:06:18.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.472+0000 7fefbd400640 1 -- start start 2024-05-28T06:06:18.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.472+0000 7fefbd400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fefb809aca0 0x7fefb80b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:18.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.472+0000 7fefbd400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefb809b080 0x7fefb809b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:18.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.472+0000 7fefbd400640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefb80d0bf0 con 0x7fefb815fb30 2024-05-28T06:06:18.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.472+0000 7fefbd400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fefb80b5460 con 0x7fefb809aca0 2024-05-28T06:06:18.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.472+0000 7fefbd400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fefb80d0eb0 con 0x7fefb809b080 2024-05-28T06:06:18.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.472+0000 7fefb6800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fefb809aca0 0x7fefb80b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:18.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.472+0000 7fefb7200640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fefb815fb30 0x7fefb815ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:54166/0 (socket says 172.21.15.122:54166) 2024-05-28T06:06:18.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.472+0000 7fefb7200640 1 -- 172.21.15.122:0/337695889 learned_addr learned my addr 172.21.15.122:0/337695889 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:18.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.472+0000 7fefb5e00640 1 --2- 172.21.15.122:0/337695889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefb809b080 0x7fefb809b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:18.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.472+0000 7fefb6800640 1 -- 172.21.15.122:0/337695889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefb809b080 msgr2=0x7fefb809b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:18.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.472+0000 7fefb6800640 1 --2- 172.21.15.122:0/337695889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefb809b080 0x7fefb809b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.472+0000 7fefb5400640 1 -- 172.21.15.122:0/337695889 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2763921520 0 0) 0x7fefb80d0bf0 con 0x7fefb815fb30 2024-05-28T06:06:18.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.472+0000 7fefb6800640 1 -- 172.21.15.122:0/337695889 >> v1:172.21.15.122:6789/0 conn(0x7fefb815fb30 legacy=0x7fefb815ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:18.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.472+0000 7fefb6800640 1 -- 172.21.15.122:0/337695889 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb80d1190 con 0x7fefb809aca0 2024-05-28T06:06:18.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.472+0000 7fefb5e00640 1 --2- 172.21.15.122:0/337695889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefb809b080 0x7fefb809b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:18.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.476+0000 7fefb6800640 1 --2- 172.21.15.122:0/337695889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefb809aca0 0x7fefb80b35b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fefa80097c0 tx=0x7fefa801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c5027ac33a11d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:18.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.476+0000 7fefb5400640 1 -- 172.21.15.122:0/337695889 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa80b0070 con 0x7fefb809aca0 2024-05-28T06:06:18.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.476+0000 7fefb5400640 1 -- 172.21.15.122:0/337695889 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa80ab600 con 0x7fefb809aca0 2024-05-28T06:06:18.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.476+0000 7fefb5400640 1 -- 172.21.15.122:0/337695889 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa80ab9d0 con 0x7fefb809aca0 2024-05-28T06:06:18.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.476+0000 7fefbd400640 1 -- 172.21.15.122:0/337695889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefb809aca0 msgr2=0x7fefb80b35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:18.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.476+0000 7fefbd400640 1 --2- 172.21.15.122:0/337695889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefb809aca0 0x7fefb80b35b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fefa80097c0 tx=0x7fefa801c410 comp rx=0 tx=0).stop 2024-05-28T06:06:18.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.476+0000 7fefbd400640 1 -- 172.21.15.122:0/337695889 shutdown_connections 2024-05-28T06:06:18.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.476+0000 7fefbd400640 1 --2- 172.21.15.122:0/337695889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefb809b080 0x7fefb809b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.476+0000 7fefbd400640 1 --2- 172.21.15.122:0/337695889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefb809aca0 0x7fefb80b35b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.476+0000 7fefbd400640 1 -- 172.21.15.122:0/337695889 >> 172.21.15.122:0/337695889 conn(0x7fefb80b4100 msgr2=0x7fefb80b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:18.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.476+0000 7fefbd400640 1 -- 172.21.15.122:0/337695889 shutdown_connections 2024-05-28T06:06:18.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.476+0000 7fefbd400640 1 -- 172.21.15.122:0/337695889 wait complete. 2024-05-28T06:06:18.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.476+0000 7fefbd400640 1 Processor -- start 2024-05-28T06:06:18.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefbd400640 1 -- start start 2024-05-28T06:06:18.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefbd400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefb809aca0 0x7fefb8151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:18.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefbd400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefb809b080 0x7fefb80c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:18.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefbd400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefb815fb30 0x7fefb81513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:18.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefbd400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fefb80b6490 con 0x7fefb809aca0 2024-05-28T06:06:18.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefbd400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fefb80b6310 con 0x7fefb815fb30 2024-05-28T06:06:18.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefbd400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fefb80b6610 con 0x7fefb809b080 2024-05-28T06:06:18.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefb6800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefb809aca0 0x7fefb8151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:18.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefb6800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefb809aca0 0x7fefb8151de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51606/0 (socket says 172.21.15.122:51606) 2024-05-28T06:06:18.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefb6800640 1 -- 172.21.15.122:0/3307778020 learned_addr learned my addr 172.21.15.122:0/3307778020 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:18.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefb5e00640 1 --2- 172.21.15.122:0/3307778020 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefb809b080 0x7fefb80c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:18.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefb7200640 1 --2- 172.21.15.122:0/3307778020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefb815fb30 0x7fefb81513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:18.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefb6800640 1 -- 172.21.15.122:0/3307778020 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefb809b080 msgr2=0x7fefb80c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:18.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefb6800640 1 --2- 172.21.15.122:0/3307778020 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefb809b080 0x7fefb80c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefb6800640 1 -- 172.21.15.122:0/3307778020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefb815fb30 msgr2=0x7fefb81513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:18.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefb6800640 1 --2- 172.21.15.122:0/3307778020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefb815fb30 0x7fefb81513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefb6800640 1 -- 172.21.15.122:0/3307778020 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb80ce280 con 0x7fefb809aca0 2024-05-28T06:06:18.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefb6800640 1 --2- 172.21.15.122:0/3307778020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefb809aca0 0x7fefb8151de0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fefa80ae040 tx=0x7fefa801ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:18.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefaea00640 1 -- 172.21.15.122:0/3307778020 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa80b0050 con 0x7fefb809aca0 2024-05-28T06:06:18.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefaea00640 1 -- 172.21.15.122:0/3307778020 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa80b1040 con 0x7fefb809aca0 2024-05-28T06:06:18.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefaea00640 1 -- 172.21.15.122:0/3307778020 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa80abe10 con 0x7fefb809aca0 2024-05-28T06:06:18.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefbd400640 1 -- 172.21.15.122:0/3307778020 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefb815c5e0 con 0x7fefb809aca0 2024-05-28T06:06:18.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefbd400640 1 -- 172.21.15.122:0/3307778020 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb815cb60 con 0x7fefb809aca0 2024-05-28T06:06:18.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.480+0000 7fefbd400640 1 -- 172.21.15.122:0/3307778020 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefb8068c40 con 0x7fefb809aca0 2024-05-28T06:06:18.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.484+0000 7fefaea00640 1 -- 172.21.15.122:0/3307778020 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fefa80be030 con 0x7fefb809aca0 2024-05-28T06:06:18.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.484+0000 7fefaea00640 1 --2- 172.21.15.122:0/3307778020 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fef98068380 0x7fef9806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:18.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.484+0000 7fefaea00640 1 -- 172.21.15.122:0/3307778020 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fefa8120a50 con 0x7fefb809aca0 2024-05-28T06:06:18.488 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.484+0000 7fefb5e00640 1 --2- 172.21.15.122:0/3307778020 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fef98068380 0x7fef9806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:18.488 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.484+0000 7fefb5e00640 1 --2- 172.21.15.122:0/3307778020 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fef98068380 0x7fef9806a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fefb81f8bb0 tx=0x7fefa4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:18.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.488+0000 7fefaea00640 1 -- 172.21.15.122:0/3307778020 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fefa80c5020 con 0x7fefb809aca0 2024-05-28T06:06:18.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.644+0000 7fefbd400640 1 -- 172.21.15.122:0/3307778020 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fefb8071760 con 0x7fefb809aca0 2024-05-28T06:06:18.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.644+0000 7fefaea00640 1 -- 172.21.15.122:0/3307778020 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fefa8016090 con 0x7fefb809aca0 2024-05-28T06:06:18.650 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 32 2024-05-28T06:06:18.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.648+0000 7fefbd400640 1 -- 172.21.15.122:0/3307778020 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fef98068380 msgr2=0x7fef9806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:18.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.648+0000 7fefbd400640 1 --2- 172.21.15.122:0/3307778020 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fef98068380 0x7fef9806a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fefb81f8bb0 tx=0x7fefa4008040 comp rx=0 tx=0).stop 2024-05-28T06:06:18.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.648+0000 7fefbd400640 1 -- 172.21.15.122:0/3307778020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefb809aca0 msgr2=0x7fefb8151de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:18.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.648+0000 7fefbd400640 1 --2- 172.21.15.122:0/3307778020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefb809aca0 0x7fefb8151de0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fefa80ae040 tx=0x7fefa801ac50 comp rx=0 tx=0).stop 2024-05-28T06:06:18.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.648+0000 7fefbd400640 1 -- 172.21.15.122:0/3307778020 shutdown_connections 2024-05-28T06:06:18.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.648+0000 7fefbd400640 1 --2- 172.21.15.122:0/3307778020 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fef98068380 0x7fef9806a840 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.648+0000 7fefbd400640 1 --2- 172.21.15.122:0/3307778020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefb815fb30 0x7fefb81513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.648+0000 7fefbd400640 1 --2- 172.21.15.122:0/3307778020 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefb809b080 0x7fefb80c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.648+0000 7fefbd400640 1 --2- 172.21.15.122:0/3307778020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefb809aca0 0x7fefb8151de0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.648+0000 7fefbd400640 1 -- 172.21.15.122:0/3307778020 >> 172.21.15.122:0/3307778020 conn(0x7fefb80b4100 msgr2=0x7fefb80702c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:18.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.648+0000 7fefbd400640 1 -- 172.21.15.122:0/3307778020 shutdown_connections 2024-05-28T06:06:18.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.648+0000 7fefbd400640 1 -- 172.21.15.122:0/3307778020 wait complete. 2024-05-28T06:06:18.671 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-28T06:06:18.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.804+0000 7f14f7600640 1 Processor -- start 2024-05-28T06:06:18.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.804+0000 7f14f7600640 1 -- start start 2024-05-28T06:06:18.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.808+0000 7f14f7600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f015ea20 0x7f14f00d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:18.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.808+0000 7f14f7600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f14f00b36b0 0x7f14f00b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:18.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.808+0000 7f14f7600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14f00b46c0 con 0x7f14f0073c80 2024-05-28T06:06:18.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.808+0000 7f14f7600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f14f00b4060 con 0x7f14f00b36b0 2024-05-28T06:06:18.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.808+0000 7f14f7600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f14f015ee00 con 0x7f14f015ea20 2024-05-28T06:06:18.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.808+0000 7f14efe00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f14f0073c80 0x7f14f00b4fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:54180/0 (socket says 172.21.15.122:54180) 2024-05-28T06:06:18.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.808+0000 7f14efe00640 1 -- 172.21.15.122:0/4072128448 learned_addr learned my addr 172.21.15.122:0/4072128448 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:18.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.808+0000 7f14f5600640 1 --2- 172.21.15.122:0/4072128448 >> v2:172.21.15.122:3300/0 conn(0x7f14f00b36b0 0x7f14f00b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:18.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.808+0000 7f14f4c00640 1 --2- 172.21.15.122:0/4072128448 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f015ea20 0x7f14f00d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:18.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.808+0000 7f14f5600640 1 -- 172.21.15.122:0/4072128448 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f015ea20 msgr2=0x7f14f00d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:18.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.808+0000 7f14f5600640 1 --2- 172.21.15.122:0/4072128448 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f015ea20 0x7f14f00d0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.808+0000 7f14f5600640 1 -- 172.21.15.122:0/4072128448 >> v1:172.21.15.122:6789/0 conn(0x7f14f0073c80 legacy=0x7f14f00b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:18.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.808+0000 7f14f5600640 1 -- 172.21.15.122:0/4072128448 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f00b49a0 con 0x7f14f00b36b0 2024-05-28T06:06:18.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.808+0000 7f14ef400640 1 -- 172.21.15.122:0/4072128448 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2614022201 0 0) 0x7f14f00b46c0 con 0x7f14f0073c80 2024-05-28T06:06:18.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.812+0000 7f14f5600640 1 --2- 172.21.15.122:0/4072128448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f14f00b36b0 0x7f14f00b3b20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f14e80097c0 tx=0x7f14e801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178027bfdf631742 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:18.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.812+0000 7f14ef400640 1 -- 172.21.15.122:0/4072128448 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e80b0070 con 0x7f14f00b36b0 2024-05-28T06:06:18.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.812+0000 7f14ef400640 1 -- 172.21.15.122:0/4072128448 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14e80ab600 con 0x7f14f00b36b0 2024-05-28T06:06:18.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.812+0000 7f14ef400640 1 -- 172.21.15.122:0/4072128448 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e80ab9d0 con 0x7f14f00b36b0 2024-05-28T06:06:18.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.812+0000 7f14f7600640 1 -- 172.21.15.122:0/4072128448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f14f00b36b0 msgr2=0x7f14f00b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:18.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.812+0000 7f14f7600640 1 --2- 172.21.15.122:0/4072128448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f14f00b36b0 0x7f14f00b3b20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f14e80097c0 tx=0x7f14e801c4a0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.812+0000 7f14f7600640 1 -- 172.21.15.122:0/4072128448 shutdown_connections 2024-05-28T06:06:18.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.812+0000 7f14f7600640 1 --2- 172.21.15.122:0/4072128448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f14f00b36b0 0x7f14f00b3b20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.812+0000 7f14f7600640 1 --2- 172.21.15.122:0/4072128448 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f015ea20 0x7f14f00d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.812+0000 7f14f7600640 1 -- 172.21.15.122:0/4072128448 >> 172.21.15.122:0/4072128448 conn(0x7f14f00b6c10 msgr2=0x7f14f00b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:18.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.812+0000 7f14f7600640 1 -- 172.21.15.122:0/4072128448 shutdown_connections 2024-05-28T06:06:18.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.812+0000 7f14f7600640 1 -- 172.21.15.122:0/4072128448 wait complete. 2024-05-28T06:06:18.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.812+0000 7f14f7600640 1 Processor -- start 2024-05-28T06:06:18.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.812+0000 7f14f7600640 1 -- start start 2024-05-28T06:06:18.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.812+0000 7f14f7600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14f0073c80 0x7f14f0160280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:18.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.812+0000 7f14f7600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f14f00b36b0 0x7f14f014e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:18.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.812+0000 7f14f7600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f015ea20 0x7f14f0159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:18.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.812+0000 7f14f7600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f14f00ce960 con 0x7f14f00b36b0 2024-05-28T06:06:18.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.812+0000 7f14f7600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f14f00b56d0 con 0x7f14f0073c80 2024-05-28T06:06:18.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.812+0000 7f14f7600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f14f00ceae0 con 0x7f14f015ea20 2024-05-28T06:06:18.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.816+0000 7f14efe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f14f00b36b0 0x7f14f014e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:18.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.816+0000 7f14efe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f14f00b36b0 0x7f14f014e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51636/0 (socket says 172.21.15.122:51636) 2024-05-28T06:06:18.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.816+0000 7f14efe00640 1 -- 172.21.15.122:0/1891751538 learned_addr learned my addr 172.21.15.122:0/1891751538 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:18.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.816+0000 7f14f4c00640 1 --2- 172.21.15.122:0/1891751538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14f0073c80 0x7f14f0160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:18.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.816+0000 7f14f5600640 1 --2- 172.21.15.122:0/1891751538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f015ea20 0x7f14f0159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:18.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.816+0000 7f14efe00640 1 -- 172.21.15.122:0/1891751538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f015ea20 msgr2=0x7f14f0159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:18.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.816+0000 7f14efe00640 1 --2- 172.21.15.122:0/1891751538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f015ea20 0x7f14f0159ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.816+0000 7f14efe00640 1 -- 172.21.15.122:0/1891751538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14f0073c80 msgr2=0x7f14f0160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:18.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.816+0000 7f14efe00640 1 --2- 172.21.15.122:0/1891751538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14f0073c80 0x7f14f0160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.816+0000 7f14efe00640 1 -- 172.21.15.122:0/1891751538 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f01607c0 con 0x7f14f00b36b0 2024-05-28T06:06:18.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.816+0000 7f14f4c00640 1 --2- 172.21.15.122:0/1891751538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14f0073c80 0x7f14f0160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:18.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.816+0000 7f14f5600640 1 --2- 172.21.15.122:0/1891751538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f015ea20 0x7f14f0159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:18.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.816+0000 7f14efe00640 1 --2- 172.21.15.122:0/1891751538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f14f00b36b0 0x7f14f014e1f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0011f0 tx=0x7f14dc00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:18.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.816+0000 7f14ecc00640 1 -- 172.21.15.122:0/1891751538 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc018070 con 0x7f14f00b36b0 2024-05-28T06:06:18.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.816+0000 7f14ecc00640 1 -- 172.21.15.122:0/1891751538 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14dc0074e0 con 0x7f14f00b36b0 2024-05-28T06:06:18.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.816+0000 7f14ecc00640 1 -- 172.21.15.122:0/1891751538 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc004a10 con 0x7f14f00b36b0 2024-05-28T06:06:18.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.816+0000 7f14f7600640 1 -- 172.21.15.122:0/1891751538 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f014ef00 con 0x7f14f00b36b0 2024-05-28T06:06:18.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.816+0000 7f14f7600640 1 -- 172.21.15.122:0/1891751538 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f014f4c0 con 0x7f14f00b36b0 2024-05-28T06:06:18.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.816+0000 7f14f7600640 1 -- 172.21.15.122:0/1891751538 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14f0068c40 con 0x7f14f00b36b0 2024-05-28T06:06:18.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.816+0000 7f14ecc00640 1 -- 172.21.15.122:0/1891751538 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f14dc004bb0 con 0x7f14f00b36b0 2024-05-28T06:06:18.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.816+0000 7f14ecc00640 1 --2- 172.21.15.122:0/1891751538 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f14d0068380 0x7f14d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:18.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.820+0000 7f14ecc00640 1 -- 172.21.15.122:0/1891751538 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f14dc085c40 con 0x7f14f00b36b0 2024-05-28T06:06:18.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.820+0000 7f14f4c00640 1 --2- 172.21.15.122:0/1891751538 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f14d0068380 0x7f14d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:18.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.820+0000 7f14f4c00640 1 --2- 172.21.15.122:0/1891751538 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f14d0068380 0x7f14d006a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f14e0009fd0 tx=0x7f14e000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:18.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.824+0000 7f14ecc00640 1 -- 172.21.15.122:0/1891751538 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f14f01607c0 con 0x7f14f00b36b0 2024-05-28T06:06:18.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.976+0000 7f14f7600640 1 -- 172.21.15.122:0/1891751538 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f14f00b53d0 con 0x7f14f00b36b0 2024-05-28T06:06:18.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.976+0000 7f14ecc00640 1 -- 172.21.15.122:0/1891751538 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f14dc0561f0 con 0x7f14f00b36b0 2024-05-28T06:06:18.982 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 64 2024-05-28T06:06:18.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.980+0000 7f14f7600640 1 -- 172.21.15.122:0/1891751538 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f14d0068380 msgr2=0x7f14d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:18.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.980+0000 7f14f7600640 1 --2- 172.21.15.122:0/1891751538 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f14d0068380 0x7f14d006a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f14e0009fd0 tx=0x7f14e000b040 comp rx=0 tx=0).stop 2024-05-28T06:06:18.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.980+0000 7f14f7600640 1 -- 172.21.15.122:0/1891751538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f14f00b36b0 msgr2=0x7f14f014e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:18.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.980+0000 7f14f7600640 1 --2- 172.21.15.122:0/1891751538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f14f00b36b0 0x7f14f014e1f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0011f0 tx=0x7f14dc00c9b0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.980+0000 7f14f7600640 1 -- 172.21.15.122:0/1891751538 shutdown_connections 2024-05-28T06:06:18.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.980+0000 7f14f7600640 1 --2- 172.21.15.122:0/1891751538 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f14d0068380 0x7f14d006a840 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.980+0000 7f14f7600640 1 --2- 172.21.15.122:0/1891751538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f015ea20 0x7f14f0159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.980+0000 7f14f7600640 1 --2- 172.21.15.122:0/1891751538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f14f00b36b0 0x7f14f014e1f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.980+0000 7f14f7600640 1 --2- 172.21.15.122:0/1891751538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14f0073c80 0x7f14f0160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:18.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.980+0000 7f14f7600640 1 -- 172.21.15.122:0/1891751538 >> 172.21.15.122:0/1891751538 conn(0x7f14f00b6c10 msgr2=0x7f14f015dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:18.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.980+0000 7f14f7600640 1 -- 172.21.15.122:0/1891751538 shutdown_connections 2024-05-28T06:06:18.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:18.980+0000 7f14f7600640 1 -- 172.21.15.122:0/1891751538 wait complete. 2024-05-28T06:06:19.087 INFO:tasks.cephfs_test_runner:Starting test: test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that when one clone is in progress, one progress bar is printed 2024-05-28T06:06:19.087 INFO:tasks.cephfs_test_runner:test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-28T06:06:19.087 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:06:19.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.220+0000 7fe2f3e00640 1 Processor -- start 2024-05-28T06:06:19.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.220+0000 7fe2f3e00640 1 -- start start 2024-05-28T06:06:19.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.220+0000 7fe2f3e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe2f40ce5e0 0x7fe2f4169620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:19.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.220+0000 7fe2f3e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2f409bfd0 con 0x7fe2f415ebe0 2024-05-28T06:06:19.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.220+0000 7fe2f3e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2f40c8c10 con 0x7fe2f40d0580 2024-05-28T06:06:19.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.220+0000 7fe2f3e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fe2f409b860 con 0x7fe2f40ce5e0 2024-05-28T06:06:19.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.220+0000 7fe2f3400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe2f40ce5e0 0x7fe2f4169620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:19.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.220+0000 7fe2f2a00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fe2f415ebe0 0x7fe2f409aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:54196/0 (socket says 172.21.15.122:54196) 2024-05-28T06:06:19.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.220+0000 7fe2f2a00640 1 -- 172.21.15.122:0/1344146341 learned_addr learned my addr 172.21.15.122:0/1344146341 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:19.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.220+0000 7fe2f3400640 1 -- 172.21.15.122:0/1344146341 >> v1:172.21.15.153:6789/0 conn(0x7fe2f40d0580 legacy=0x7fe2f409b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:19.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.220+0000 7fe2f3400640 1 -- 172.21.15.122:0/1344146341 >> v1:172.21.15.122:6789/0 conn(0x7fe2f415ebe0 legacy=0x7fe2f409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:19.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.220+0000 7fe2f3400640 1 -- 172.21.15.122:0/1344146341 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f40c8ef0 con 0x7fe2f40ce5e0 2024-05-28T06:06:19.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.220+0000 7fe2f1600640 1 -- 172.21.15.122:0/1344146341 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1372432928 0 0) 0x7fe2f409bfd0 con 0x7fe2f415ebe0 2024-05-28T06:06:19.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.224+0000 7fe2f3400640 1 --2- 172.21.15.122:0/1344146341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2f40ce5e0 0x7fe2f4169620 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009d90 tx=0x7fe2ec01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f93752ff5c41eb server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:19.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.224+0000 7fe2f1600640 1 -- 172.21.15.122:0/1344146341 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0b2070 con 0x7fe2f40ce5e0 2024-05-28T06:06:19.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.224+0000 7fe2f1600640 1 -- 172.21.15.122:0/1344146341 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ec0a5a50 con 0x7fe2f40ce5e0 2024-05-28T06:06:19.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.224+0000 7fe2f1600640 1 -- 172.21.15.122:0/1344146341 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0a5e20 con 0x7fe2f40ce5e0 2024-05-28T06:06:19.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.224+0000 7fe2f3e00640 1 -- 172.21.15.122:0/1344146341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2f40ce5e0 msgr2=0x7fe2f4169620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:19.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.224+0000 7fe2f3e00640 1 --2- 172.21.15.122:0/1344146341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2f40ce5e0 0x7fe2f4169620 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009d90 tx=0x7fe2ec01c970 comp rx=0 tx=0).stop 2024-05-28T06:06:19.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.224+0000 7fe2f3e00640 1 -- 172.21.15.122:0/1344146341 shutdown_connections 2024-05-28T06:06:19.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.224+0000 7fe2f3e00640 1 --2- 172.21.15.122:0/1344146341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2f40ce5e0 0x7fe2f4169620 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.224+0000 7fe2f3e00640 1 -- 172.21.15.122:0/1344146341 >> 172.21.15.122:0/1344146341 conn(0x7fe2f40d2470 msgr2=0x7fe2f40d2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:19.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.224+0000 7fe2f3e00640 1 -- 172.21.15.122:0/1344146341 shutdown_connections 2024-05-28T06:06:19.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.224+0000 7fe2f3e00640 1 -- 172.21.15.122:0/1344146341 wait complete. 2024-05-28T06:06:19.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.224+0000 7fe2f3e00640 1 Processor -- start 2024-05-28T06:06:19.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.224+0000 7fe2f3e00640 1 -- start start 2024-05-28T06:06:19.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2f3e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2f40ce5e0 0x7fe2f40ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:19.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2f3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2f40d0580 0x7fe2f4153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:19.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2f3e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2f415ebe0 0x7fe2f40cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:19.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2f3e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f416cb20 con 0x7fe2f415ebe0 2024-05-28T06:06:19.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2f3e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f416c9a0 con 0x7fe2f40d0580 2024-05-28T06:06:19.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2f3e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f416cca0 con 0x7fe2f40ce5e0 2024-05-28T06:06:19.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2f3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2f415ebe0 0x7fe2f40cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:19.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2f3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2f415ebe0 0x7fe2f40cb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51660/0 (socket says 172.21.15.122:51660) 2024-05-28T06:06:19.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2f3400640 1 -- 172.21.15.122:0/2675143608 learned_addr learned my addr 172.21.15.122:0/2675143608 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:19.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2f2000640 1 --2- 172.21.15.122:0/2675143608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2f40d0580 0x7fe2f4153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:19.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2f2a00640 1 --2- 172.21.15.122:0/2675143608 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2f40ce5e0 0x7fe2f40ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:19.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2f3400640 1 -- 172.21.15.122:0/2675143608 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2f40ce5e0 msgr2=0x7fe2f40ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:19.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2f3400640 1 --2- 172.21.15.122:0/2675143608 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2f40ce5e0 0x7fe2f40ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2f3400640 1 -- 172.21.15.122:0/2675143608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2f40d0580 msgr2=0x7fe2f4153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:19.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2f3400640 1 --2- 172.21.15.122:0/2675143608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2f40d0580 0x7fe2f4153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2f3400640 1 -- 172.21.15.122:0/2675143608 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f40cbff0 con 0x7fe2f415ebe0 2024-05-28T06:06:19.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2f3400640 1 --2- 172.21.15.122:0/2675143608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2f415ebe0 0x7fe2f40cb680 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0b0040 tx=0x7fe2ec019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:19.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2eb400640 1 -- 172.21.15.122:0/2675143608 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0b2040 con 0x7fe2f415ebe0 2024-05-28T06:06:19.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2eb400640 1 -- 172.21.15.122:0/2675143608 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ec0bf070 con 0x7fe2f415ebe0 2024-05-28T06:06:19.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2eb400640 1 -- 172.21.15.122:0/2675143608 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0b8470 con 0x7fe2f415ebe0 2024-05-28T06:06:19.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2f3e00640 1 -- 172.21.15.122:0/2675143608 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f40cc2d0 con 0x7fe2f415ebe0 2024-05-28T06:06:19.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2f3e00640 1 -- 172.21.15.122:0/2675143608 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f40c98c0 con 0x7fe2f415ebe0 2024-05-28T06:06:19.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2f3e00640 1 -- 172.21.15.122:0/2675143608 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2f4075620 con 0x7fe2f415ebe0 2024-05-28T06:06:19.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.228+0000 7fe2eb400640 1 -- 172.21.15.122:0/2675143608 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe2ec0b8610 con 0x7fe2f415ebe0 2024-05-28T06:06:19.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.232+0000 7fe2eb400640 1 --2- 172.21.15.122:0/2675143608 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe2d4068380 0x7fe2d406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:19.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.232+0000 7fe2eb400640 1 -- 172.21.15.122:0/2675143608 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe2ec121e00 con 0x7fe2f415ebe0 2024-05-28T06:06:19.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.232+0000 7fe2f2a00640 1 --2- 172.21.15.122:0/2675143608 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe2d4068380 0x7fe2d406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:19.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.232+0000 7fe2f2a00640 1 --2- 172.21.15.122:0/2675143608 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe2d4068380 0x7fe2d406a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4000f70 tx=0x7fe2e4007240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:19.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.236+0000 7fe2eb400640 1 -- 172.21.15.122:0/2675143608 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe2ec016560 con 0x7fe2f415ebe0 2024-05-28T06:06:19.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.396+0000 7fe2f3e00640 1 -- 172.21.15.122:0/2675143608 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2f40d19e0 con 0x7fe2f415ebe0 2024-05-28T06:06:19.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.396+0000 7fe2eb400640 1 -- 172.21.15.122:0/2675143608 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fe2ec0f1e20 con 0x7fe2f415ebe0 2024-05-28T06:06:19.402 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:19.402 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":20,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:05:50.822555+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:05:47.441193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-28T06:05:48.148164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:06:19.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.400+0000 7fe2f3e00640 1 -- 172.21.15.122:0/2675143608 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe2d4068380 msgr2=0x7fe2d406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:19.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.400+0000 7fe2f3e00640 1 --2- 172.21.15.122:0/2675143608 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe2d4068380 0x7fe2d406a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4000f70 tx=0x7fe2e4007240 comp rx=0 tx=0).stop 2024-05-28T06:06:19.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.400+0000 7fe2f3e00640 1 -- 172.21.15.122:0/2675143608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2f415ebe0 msgr2=0x7fe2f40cb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:19.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.400+0000 7fe2f3e00640 1 --2- 172.21.15.122:0/2675143608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2f415ebe0 0x7fe2f40cb680 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0b0040 tx=0x7fe2ec019710 comp rx=0 tx=0).stop 2024-05-28T06:06:19.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.400+0000 7fe2f3e00640 1 -- 172.21.15.122:0/2675143608 shutdown_connections 2024-05-28T06:06:19.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.400+0000 7fe2f3e00640 1 --2- 172.21.15.122:0/2675143608 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe2d4068380 0x7fe2d406a840 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.400+0000 7fe2f3e00640 1 --2- 172.21.15.122:0/2675143608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2f415ebe0 0x7fe2f40cb680 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.400+0000 7fe2f3e00640 1 --2- 172.21.15.122:0/2675143608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2f40d0580 0x7fe2f4153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.400+0000 7fe2f3e00640 1 --2- 172.21.15.122:0/2675143608 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2f40ce5e0 0x7fe2f40ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.400+0000 7fe2f3e00640 1 -- 172.21.15.122:0/2675143608 >> 172.21.15.122:0/2675143608 conn(0x7fe2f40d2470 msgr2=0x7fe2f40ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:19.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.400+0000 7fe2f3e00640 1 -- 172.21.15.122:0/2675143608 shutdown_connections 2024-05-28T06:06:19.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.400+0000 7fe2f3e00640 1 -- 172.21.15.122:0/2675143608 wait complete. 2024-05-28T06:06:19.423 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-28T06:05:47.441193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-28T06:05:48.148164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:06:19.424 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:06:19.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.560+0000 7fac09e00640 1 Processor -- start 2024-05-28T06:06:19.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.560+0000 7fac09e00640 1 -- start start 2024-05-28T06:06:19.564 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.560+0000 7fac09e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fac0415ea50 0x7fac0415ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:19.564 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.560+0000 7fac09e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac0406dab0 0x7fac040d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:19.564 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.560+0000 7fac09e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac04162510 con 0x7fac0415f370 2024-05-28T06:06:19.564 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.560+0000 7fac09e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fac04163120 con 0x7fac0415ea50 2024-05-28T06:06:19.564 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.560+0000 7fac09e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fac041627f0 con 0x7fac0406dab0 2024-05-28T06:06:19.564 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.560+0000 7fac02a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fac0415ea50 0x7fac0415ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:19.564 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.560+0000 7fabfa000640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fac0415f370 0x7fac0415f790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:54208/0 (socket says 172.21.15.122:54208) 2024-05-28T06:06:19.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.560+0000 7fabfa000640 1 -- 172.21.15.122:0/2311068904 learned_addr learned my addr 172.21.15.122:0/2311068904 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:19.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.560+0000 7fac03400640 1 --2- 172.21.15.122:0/2311068904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac0406dab0 0x7fac040d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:19.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.560+0000 7fac02a00640 1 -- 172.21.15.122:0/2311068904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac0406dab0 msgr2=0x7fac040d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:19.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.560+0000 7fac02a00640 1 --2- 172.21.15.122:0/2311068904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac0406dab0 0x7fac040d08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.560+0000 7fac02a00640 1 -- 172.21.15.122:0/2311068904 >> v1:172.21.15.122:6789/0 conn(0x7fac0415f370 legacy=0x7fac0415f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:19.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.560+0000 7fac02a00640 1 -- 172.21.15.122:0/2311068904 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac04162ad0 con 0x7fac0415ea50 2024-05-28T06:06:19.566 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.560+0000 7fac02000640 1 -- 172.21.15.122:0/2311068904 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1432221018 0 0) 0x7fac04162510 con 0x7fac0415f370 2024-05-28T06:06:19.567 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.564+0000 7fac02a00640 1 --2- 172.21.15.122:0/2311068904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac0415ea50 0x7fac0415ee30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fabf40097c0 tx=0x7fabf401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa2324eb2a46897 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:19.568 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.564+0000 7fac02000640 1 -- 172.21.15.122:0/2311068904 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf40b2070 con 0x7fac0415ea50 2024-05-28T06:06:19.568 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.564+0000 7fac02000640 1 -- 172.21.15.122:0/2311068904 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabf40ad640 con 0x7fac0415ea50 2024-05-28T06:06:19.568 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.564+0000 7fac02000640 1 -- 172.21.15.122:0/2311068904 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf40ada10 con 0x7fac0415ea50 2024-05-28T06:06:19.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.564+0000 7fac09e00640 1 -- 172.21.15.122:0/2311068904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac0415ea50 msgr2=0x7fac0415ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:19.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.564+0000 7fac09e00640 1 --2- 172.21.15.122:0/2311068904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac0415ea50 0x7fac0415ee30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fabf40097c0 tx=0x7fabf401c470 comp rx=0 tx=0).stop 2024-05-28T06:06:19.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.564+0000 7fac09e00640 1 -- 172.21.15.122:0/2311068904 shutdown_connections 2024-05-28T06:06:19.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.564+0000 7fac09e00640 1 --2- 172.21.15.122:0/2311068904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac0406dab0 0x7fac040d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.564+0000 7fac09e00640 1 --2- 172.21.15.122:0/2311068904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac0415ea50 0x7fac0415ee30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.564+0000 7fac09e00640 1 -- 172.21.15.122:0/2311068904 >> 172.21.15.122:0/2311068904 conn(0x7fac040b4190 msgr2=0x7fac040b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:19.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.564+0000 7fac09e00640 1 -- 172.21.15.122:0/2311068904 shutdown_connections 2024-05-28T06:06:19.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.564+0000 7fac09e00640 1 -- 172.21.15.122:0/2311068904 wait complete. 2024-05-28T06:06:19.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.564+0000 7fac09e00640 1 Processor -- start 2024-05-28T06:06:19.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.564+0000 7fac09e00640 1 -- start start 2024-05-28T06:06:19.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fac09e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac0406dab0 0x7fac0414d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:19.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fac09e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac0415ea50 0x7fac040b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:19.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fac09e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac0415f370 0x7fac04160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:19.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fac09e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fac040d19c0 con 0x7fac0415ea50 2024-05-28T06:06:19.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fac09e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fac040d1840 con 0x7fac0415f370 2024-05-28T06:06:19.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fac09e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fac040d1b40 con 0x7fac0406dab0 2024-05-28T06:06:19.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fabfa000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac0415ea50 0x7fac040b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:19.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fabfa000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac0415ea50 0x7fac040b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51680/0 (socket says 172.21.15.122:51680) 2024-05-28T06:06:19.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fabfa000640 1 -- 172.21.15.122:0/3243094961 learned_addr learned my addr 172.21.15.122:0/3243094961 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:19.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fac02a00640 1 --2- 172.21.15.122:0/3243094961 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac0406dab0 0x7fac0414d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:19.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fac03400640 1 --2- 172.21.15.122:0/3243094961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac0415f370 0x7fac04160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:19.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fabfa000640 1 -- 172.21.15.122:0/3243094961 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac0406dab0 msgr2=0x7fac0414d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:19.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fabfa000640 1 --2- 172.21.15.122:0/3243094961 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac0406dab0 0x7fac0414d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fabfa000640 1 -- 172.21.15.122:0/3243094961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac0415f370 msgr2=0x7fac04160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:19.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fabfa000640 1 --2- 172.21.15.122:0/3243094961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac0415f370 0x7fac04160ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fabfa000640 1 -- 172.21.15.122:0/3243094961 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac040b7ef0 con 0x7fac0415ea50 2024-05-28T06:06:19.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fac02a00640 1 --2- 172.21.15.122:0/3243094961 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac0406dab0 0x7fac0414d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:19.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fabfa000640 1 --2- 172.21.15.122:0/3243094961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac0415ea50 0x7fac040b54f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fabec00c520 tx=0x7fabec00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:19.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fabfbe00640 1 -- 172.21.15.122:0/3243094961 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabec018070 con 0x7fac0415ea50 2024-05-28T06:06:19.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fabfbe00640 1 -- 172.21.15.122:0/3243094961 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabec0074e0 con 0x7fac0415ea50 2024-05-28T06:06:19.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fac09e00640 1 -- 172.21.15.122:0/3243094961 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac040b81d0 con 0x7fac0415ea50 2024-05-28T06:06:19.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fabfbe00640 1 -- 172.21.15.122:0/3243094961 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabec0049f0 con 0x7fac0415ea50 2024-05-28T06:06:19.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fac09e00640 1 -- 172.21.15.122:0/3243094961 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac0414def0 con 0x7fac0415ea50 2024-05-28T06:06:19.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fac09e00640 1 -- 172.21.15.122:0/3243094961 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac04068c40 con 0x7fac0415ea50 2024-05-28T06:06:19.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.568+0000 7fabfbe00640 1 -- 172.21.15.122:0/3243094961 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fabec01b070 con 0x7fac0415ea50 2024-05-28T06:06:19.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.572+0000 7fabfbe00640 1 --2- 172.21.15.122:0/3243094961 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fabe0068380 0x7fabe006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:19.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.572+0000 7fabfbe00640 1 -- 172.21.15.122:0/3243094961 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fabec085e90 con 0x7fac0415ea50 2024-05-28T06:06:19.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.572+0000 7fac02a00640 1 --2- 172.21.15.122:0/3243094961 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fabe0068380 0x7fabe006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:19.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.572+0000 7fac02a00640 1 --2- 172.21.15.122:0/3243094961 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fabe0068380 0x7fabe006a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fabf40af000 tx=0x7fabf4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:19.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.576+0000 7fabfbe00640 1 -- 172.21.15.122:0/3243094961 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fabec0563b0 con 0x7fac0415ea50 2024-05-28T06:06:19.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.732+0000 7fac09e00640 1 -- 172.21.15.122:0/3243094961 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fac040b8620 con 0x7fac0415ea50 2024-05-28T06:06:19.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.732+0000 7fabfbe00640 1 -- 172.21.15.122:0/3243094961 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fabec087020 con 0x7fac0415ea50 2024-05-28T06:06:19.737 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:06:19.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.736+0000 7fac09e00640 1 -- 172.21.15.122:0/3243094961 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fabe0068380 msgr2=0x7fabe006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:19.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.736+0000 7fac09e00640 1 --2- 172.21.15.122:0/3243094961 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fabe0068380 0x7fabe006a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fabf40af000 tx=0x7fabf4008040 comp rx=0 tx=0).stop 2024-05-28T06:06:19.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.736+0000 7fac09e00640 1 -- 172.21.15.122:0/3243094961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac0415ea50 msgr2=0x7fac040b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:19.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.736+0000 7fac09e00640 1 --2- 172.21.15.122:0/3243094961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac0415ea50 0x7fac040b54f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fabec00c520 tx=0x7fabec00c9e0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.736+0000 7fac09e00640 1 -- 172.21.15.122:0/3243094961 shutdown_connections 2024-05-28T06:06:19.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.736+0000 7fac09e00640 1 --2- 172.21.15.122:0/3243094961 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fabe0068380 0x7fabe006a840 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.736+0000 7fac09e00640 1 --2- 172.21.15.122:0/3243094961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac0415f370 0x7fac04160ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.736+0000 7fac09e00640 1 --2- 172.21.15.122:0/3243094961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac0415ea50 0x7fac040b54f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.736+0000 7fac09e00640 1 --2- 172.21.15.122:0/3243094961 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac0406dab0 0x7fac0414d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.736+0000 7fac09e00640 1 -- 172.21.15.122:0/3243094961 >> 172.21.15.122:0/3243094961 conn(0x7fac040b4190 msgr2=0x7fac040b24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:19.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.736+0000 7fac09e00640 1 -- 172.21.15.122:0/3243094961 shutdown_connections 2024-05-28T06:06:19.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.736+0000 7fac09e00640 1 -- 172.21.15.122:0/3243094961 wait complete. 2024-05-28T06:06:19.758 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-28T06:06:19.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.892+0000 7f570ce00640 1 Processor -- start 2024-05-28T06:06:19.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.892+0000 7f570ce00640 1 -- start start 2024-05-28T06:06:19.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.892+0000 7f570ce00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f570806cea0 0x7f57080b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:19.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.892+0000 7f570ce00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f57080b4100 0x7f57080add80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:19.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.892+0000 7f570ce00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f570806be00 con 0x7f570815e7a0 2024-05-28T06:06:19.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.892+0000 7f570ce00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f570806c0e0 con 0x7f57080b4100 2024-05-28T06:06:19.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.892+0000 7f570ce00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f570806c3c0 con 0x7f570806cea0 2024-05-28T06:06:19.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.892+0000 7f5705e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f570815e7a0 0x7f5708162e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:54212/0 (socket says 172.21.15.122:54212) 2024-05-28T06:06:19.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.892+0000 7f5705e00640 1 -- 172.21.15.122:0/3016078938 learned_addr learned my addr 172.21.15.122:0/3016078938 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:19.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.892+0000 7f5705400640 1 --2- 172.21.15.122:0/3016078938 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f570806cea0 0x7f57080b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:19.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.892+0000 7f5706800640 1 --2- 172.21.15.122:0/3016078938 >> v2:172.21.15.153:3300/0 conn(0x7f57080b4100 0x7f57080add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:19.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.892+0000 7f5704a00640 1 -- 172.21.15.122:0/3016078938 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1444677565 0 0) 0x7f570806be00 con 0x7f570815e7a0 2024-05-28T06:06:19.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.892+0000 7f5704a00640 1 -- 172.21.15.122:0/3016078938 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56ec003530 con 0x7f570815e7a0 2024-05-28T06:06:19.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.892+0000 7f5704a00640 1 -- 172.21.15.122:0/3016078938 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 93435025 0 0) 0x7f56ec003530 con 0x7f570815e7a0 2024-05-28T06:06:19.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.892+0000 7f5704a00640 1 -- 172.21.15.122:0/3016078938 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f570806cea0 msgr2=0x7f57080b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:19.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.892+0000 7f5704a00640 1 --2- 172.21.15.122:0/3016078938 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f570806cea0 0x7f57080b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5704a00640 1 -- 172.21.15.122:0/3016078938 >> v2:172.21.15.153:3300/0 conn(0x7f57080b4100 msgr2=0x7f57080add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:19.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5704a00640 1 --2- 172.21.15.122:0/3016078938 >> v2:172.21.15.153:3300/0 conn(0x7f57080b4100 0x7f57080add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5704a00640 1 -- 172.21.15.122:0/3016078938 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f570806c6a0 con 0x7f570815e7a0 2024-05-28T06:06:19.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5704a00640 1 -- 172.21.15.122:0/3016078938 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f56f8001680 con 0x7f570815e7a0 2024-05-28T06:06:19.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5704a00640 1 -- 172.21.15.122:0/3016078938 >> v1:172.21.15.122:6789/0 conn(0x7f570815e7a0 legacy=0x7f5708162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:19.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5704a00640 1 --2- 172.21.15.122:0/3016078938 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56ec0039c0 0x7f56ec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:19.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5704a00640 1 --2- 172.21.15.122:0/3016078938 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56ec004810 0x7f56ec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:19.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5704a00640 1 --2- 172.21.15.122:0/3016078938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56ec0051d0 0x7f56ec00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:19.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5704a00640 1 -- 172.21.15.122:0/3016078938 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f570806c0e0 con 0x7f56ec0051d0 2024-05-28T06:06:19.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5704a00640 1 -- 172.21.15.122:0/3016078938 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f570806c3c0 con 0x7f56ec0039c0 2024-05-28T06:06:19.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5704a00640 1 -- 172.21.15.122:0/3016078938 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f56ec00bf10 con 0x7f56ec004810 2024-05-28T06:06:19.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5705400640 1 --2- 172.21.15.122:0/3016078938 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f570806cea0 0x7f57080b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:06:19.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5706800640 1 --2- 172.21.15.122:0/3016078938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56ec0051d0 0x7f56ec00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:19.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5705e00640 1 --2- 172.21.15.122:0/3016078938 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56ec0039c0 0x7f56ec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:19.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5705400640 1 --2- 172.21.15.122:0/3016078938 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56ec004810 0x7f56ec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:19.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5706800640 1 -- 172.21.15.122:0/3016078938 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56ec004810 msgr2=0x7f56ec004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:19.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5706800640 1 --2- 172.21.15.122:0/3016078938 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56ec004810 0x7f56ec004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5706800640 1 -- 172.21.15.122:0/3016078938 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56ec0039c0 msgr2=0x7f56ec003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:19.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5706800640 1 --2- 172.21.15.122:0/3016078938 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56ec0039c0 0x7f56ec003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5706800640 1 -- 172.21.15.122:0/3016078938 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ec003530 con 0x7f56ec0051d0 2024-05-28T06:06:19.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5706800640 1 --2- 172.21.15.122:0/3016078938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56ec0051d0 0x7f56ec00b9d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f570000e170 tx=0x7f570001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e5a087ed89c993 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:19.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5704a00640 1 -- 172.21.15.122:0/3016078938 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57000b2070 con 0x7f56ec0051d0 2024-05-28T06:06:19.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5704a00640 1 -- 172.21.15.122:0/3016078938 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57000a5cb0 con 0x7f56ec0051d0 2024-05-28T06:06:19.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.896+0000 7f5704a00640 1 -- 172.21.15.122:0/3016078938 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700009c10 con 0x7f56ec0051d0 2024-05-28T06:06:19.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.900+0000 7f570ce00640 1 -- 172.21.15.122:0/3016078938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56ec0051d0 msgr2=0x7f56ec00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:19.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.900+0000 7f570ce00640 1 --2- 172.21.15.122:0/3016078938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56ec0051d0 0x7f56ec00b9d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f570000e170 tx=0x7f570001cca0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.900+0000 7f5706800640 1 -- 172.21.15.122:0/3016078938 reap_dead start 2024-05-28T06:06:19.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.900+0000 7f570ce00640 1 -- 172.21.15.122:0/3016078938 shutdown_connections 2024-05-28T06:06:19.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.900+0000 7f570ce00640 1 -- 172.21.15.122:0/3016078938 >> 172.21.15.122:0/3016078938 conn(0x7f57080b3130 msgr2=0x7f57080d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:19.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.900+0000 7f570ce00640 1 -- 172.21.15.122:0/3016078938 shutdown_connections 2024-05-28T06:06:19.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.900+0000 7f570ce00640 1 -- 172.21.15.122:0/3016078938 wait complete. 2024-05-28T06:06:19.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.900+0000 7f570ce00640 1 Processor -- start 2024-05-28T06:06:19.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.900+0000 7f570ce00640 1 -- start start 2024-05-28T06:06:19.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.900+0000 7f570ce00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56ec0051d0 0x7f57080aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:19.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.900+0000 7f570ce00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57080af490 0x7f57080b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:19.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.900+0000 7f570ce00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57080b1190 0x7f57080b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:19.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.900+0000 7f570ce00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f570815eb80 con 0x7f56ec0051d0 2024-05-28T06:06:19.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.900+0000 7f570ce00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f57080b4a40 con 0x7f57080af490 2024-05-28T06:06:19.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.900+0000 7f570ce00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f570815ed00 con 0x7f57080b1190 2024-05-28T06:06:19.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.900+0000 7f5705e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56ec0051d0 0x7f57080aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:19.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.900+0000 7f5705e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56ec0051d0 0x7f57080aef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51690/0 (socket says 172.21.15.122:51690) 2024-05-28T06:06:19.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.900+0000 7f5705e00640 1 -- 172.21.15.122:0/337349125 learned_addr learned my addr 172.21.15.122:0/337349125 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:19.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.900+0000 7f5705400640 1 --2- 172.21.15.122:0/337349125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57080af490 0x7f57080b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:19.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.900+0000 7f5706800640 1 --2- 172.21.15.122:0/337349125 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57080b1190 0x7f57080b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:19.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.900+0000 7f5705e00640 1 -- 172.21.15.122:0/337349125 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57080b1190 msgr2=0x7f57080b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:19.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.904+0000 7f5705e00640 1 --2- 172.21.15.122:0/337349125 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57080b1190 0x7f57080b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.904+0000 7f5705e00640 1 -- 172.21.15.122:0/337349125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57080af490 msgr2=0x7f57080b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:19.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.904+0000 7f5705e00640 1 --2- 172.21.15.122:0/337349125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57080af490 0x7f57080b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:19.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.904+0000 7f5705e00640 1 -- 172.21.15.122:0/337349125 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57080b1b80 con 0x7f56ec0051d0 2024-05-28T06:06:19.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.904+0000 7f5706800640 1 --2- 172.21.15.122:0/337349125 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57080b1190 0x7f57080b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:19.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.904+0000 7f5705e00640 1 --2- 172.21.15.122:0/337349125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56ec0051d0 0x7f57080aef50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f56f8007340 tx=0x7f56f8007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:19.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.904+0000 7f56fe000640 1 -- 172.21.15.122:0/337349125 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f800f9c0 con 0x7f56ec0051d0 2024-05-28T06:06:19.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.904+0000 7f56fe000640 1 -- 172.21.15.122:0/337349125 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56f8018070 con 0x7f56ec0051d0 2024-05-28T06:06:19.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.904+0000 7f570ce00640 1 -- 172.21.15.122:0/337349125 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57081587e0 con 0x7f56ec0051d0 2024-05-28T06:06:19.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.904+0000 7f56fe000640 1 -- 172.21.15.122:0/337349125 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f800fdc0 con 0x7f56ec0051d0 2024-05-28T06:06:19.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.904+0000 7f570ce00640 1 -- 172.21.15.122:0/337349125 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5708158da0 con 0x7f56ec0051d0 2024-05-28T06:06:19.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.904+0000 7f570ce00640 1 -- 172.21.15.122:0/337349125 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5708068c40 con 0x7f56ec0051d0 2024-05-28T06:06:19.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.904+0000 7f56fe000640 1 -- 172.21.15.122:0/337349125 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f56f801d460 con 0x7f56ec0051d0 2024-05-28T06:06:19.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.904+0000 7f56fe000640 1 --2- 172.21.15.122:0/337349125 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f56e80683b0 0x7f56e806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:19.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.904+0000 7f56fe000640 1 -- 172.21.15.122:0/337349125 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f56f8086970 con 0x7f56ec0051d0 2024-05-28T06:06:19.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.904+0000 7f5705400640 1 --2- 172.21.15.122:0/337349125 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f56e80683b0 0x7f56e806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:19.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.908+0000 7f5705400640 1 --2- 172.21.15.122:0/337349125 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f56e80683b0 0x7f56e806a870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f570815d940 tx=0x7f56f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:19.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:19.908+0000 7f56fe000640 1 -- 172.21.15.122:0/337349125 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f57080b1b80 con 0x7f56ec0051d0 2024-05-28T06:06:20.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.068+0000 7f570ce00640 1 -- 172.21.15.122:0/337349125 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f57080d18e0 con 0x7f56ec0051d0 2024-05-28T06:06:20.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.068+0000 7f56fe000640 1 -- 172.21.15.122:0/337349125 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f56f8056fc0 con 0x7f56ec0051d0 2024-05-28T06:06:20.071 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 32 2024-05-28T06:06:20.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.068+0000 7f570ce00640 1 -- 172.21.15.122:0/337349125 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f56e80683b0 msgr2=0x7f56e806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:20.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.068+0000 7f570ce00640 1 --2- 172.21.15.122:0/337349125 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f56e80683b0 0x7f56e806a870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f570815d940 tx=0x7f56f4008040 comp rx=0 tx=0).stop 2024-05-28T06:06:20.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.068+0000 7f570ce00640 1 -- 172.21.15.122:0/337349125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56ec0051d0 msgr2=0x7f57080aef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:20.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.068+0000 7f570ce00640 1 --2- 172.21.15.122:0/337349125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56ec0051d0 0x7f57080aef50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f56f8007340 tx=0x7f56f8007800 comp rx=0 tx=0).stop 2024-05-28T06:06:20.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.068+0000 7f570ce00640 1 -- 172.21.15.122:0/337349125 shutdown_connections 2024-05-28T06:06:20.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.068+0000 7f570ce00640 1 --2- 172.21.15.122:0/337349125 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f56e80683b0 0x7f56e806a870 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:20.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.068+0000 7f570ce00640 1 --2- 172.21.15.122:0/337349125 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57080b1190 0x7f57080b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:20.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.068+0000 7f570ce00640 1 --2- 172.21.15.122:0/337349125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57080af490 0x7f57080b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:20.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.068+0000 7f570ce00640 1 --2- 172.21.15.122:0/337349125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56ec0051d0 0x7f57080aef50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:20.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.068+0000 7f570ce00640 1 -- 172.21.15.122:0/337349125 >> 172.21.15.122:0/337349125 conn(0x7f57080b3130 msgr2=0x7f57080ae0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:20.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.068+0000 7f570ce00640 1 -- 172.21.15.122:0/337349125 shutdown_connections 2024-05-28T06:06:20.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.068+0000 7f570ce00640 1 -- 172.21.15.122:0/337349125 wait complete. 2024-05-28T06:06:20.091 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-28T06:06:20.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.224+0000 7f9ce3c00640 1 Processor -- start 2024-05-28T06:06:20.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.224+0000 7f9ce3c00640 1 -- start start 2024-05-28T06:06:20.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.224+0000 7f9ce3c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cdc06cea0 0x7f9cdc0b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:20.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.224+0000 7f9ce3c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cdc06be00 con 0x7f9cdc0b4100 2024-05-28T06:06:20.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.228+0000 7f9ce3c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cdc06c0e0 con 0x7f9cdc15e7a0 2024-05-28T06:06:20.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.228+0000 7f9ce3c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9cdc06c3c0 con 0x7f9cdc06cea0 2024-05-28T06:06:20.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.228+0000 7f9ce1c00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f9cdc0b4100 0x7f9cdc0add80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:54222/0 (socket says 172.21.15.122:54222) 2024-05-28T06:06:20.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.228+0000 7f9ce1c00640 1 -- 172.21.15.122:0/165070690 learned_addr learned my addr 172.21.15.122:0/165070690 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:20.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.228+0000 7f9cdbe00640 1 --2- 172.21.15.122:0/165070690 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cdc06cea0 0x7f9cdc0b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:20.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.228+0000 7f9cdb400640 1 -- 172.21.15.122:0/165070690 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3031884285 0 0) 0x7f9cdc06be00 con 0x7f9cdc0b4100 2024-05-28T06:06:20.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.228+0000 7f9cdb400640 1 -- 172.21.15.122:0/165070690 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cc0003530 con 0x7f9cdc0b4100 2024-05-28T06:06:20.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.228+0000 7f9cdbe00640 1 -- 172.21.15.122:0/165070690 >> v1:172.21.15.153:6789/0 conn(0x7f9cdc15e7a0 legacy=0x7f9cdc162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:20.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.228+0000 7f9cdb400640 1 -- 172.21.15.122:0/165070690 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 430376052 0 0) 0x7f9cdc06c0e0 con 0x7f9cdc15e7a0 2024-05-28T06:06:20.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.228+0000 7f9cdbe00640 1 -- 172.21.15.122:0/165070690 >> v1:172.21.15.122:6789/0 conn(0x7f9cdc0b4100 legacy=0x7f9cdc0add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:20.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.228+0000 7f9cdbe00640 1 -- 172.21.15.122:0/165070690 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cdc06c6a0 con 0x7f9cdc06cea0 2024-05-28T06:06:20.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.228+0000 7f9cdbe00640 1 --2- 172.21.15.122:0/165070690 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cdc06cea0 0x7f9cdc0b3bc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9cc80097f0 tx=0x7f9cc801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcb82c6a8bfac92d server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:20.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.232+0000 7f9cdb400640 1 -- 172.21.15.122:0/165070690 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc80b0070 con 0x7f9cdc06cea0 2024-05-28T06:06:20.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.232+0000 7f9cdb400640 1 -- 172.21.15.122:0/165070690 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc80ab600 con 0x7f9cdc06cea0 2024-05-28T06:06:20.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.232+0000 7f9cdb400640 1 -- 172.21.15.122:0/165070690 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc80ab9d0 con 0x7f9cdc06cea0 2024-05-28T06:06:20.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.232+0000 7f9ce3c00640 1 -- 172.21.15.122:0/165070690 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cdc06cea0 msgr2=0x7f9cdc0b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:20.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.232+0000 7f9ce3c00640 1 --2- 172.21.15.122:0/165070690 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cdc06cea0 0x7f9cdc0b3bc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9cc80097f0 tx=0x7f9cc801c4e0 comp rx=0 tx=0).stop 2024-05-28T06:06:20.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.232+0000 7f9ce3c00640 1 -- 172.21.15.122:0/165070690 shutdown_connections 2024-05-28T06:06:20.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.232+0000 7f9ce3c00640 1 --2- 172.21.15.122:0/165070690 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cdc06cea0 0x7f9cdc0b3bc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:20.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.232+0000 7f9ce3c00640 1 -- 172.21.15.122:0/165070690 >> 172.21.15.122:0/165070690 conn(0x7f9cdc0b3130 msgr2=0x7f9cdc0d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:20.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.232+0000 7f9ce3c00640 1 -- 172.21.15.122:0/165070690 shutdown_connections 2024-05-28T06:06:20.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.232+0000 7f9ce3c00640 1 -- 172.21.15.122:0/165070690 wait complete. 2024-05-28T06:06:20.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.232+0000 7f9ce3c00640 1 Processor -- start 2024-05-28T06:06:20.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.232+0000 7f9ce3c00640 1 -- start start 2024-05-28T06:06:20.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.232+0000 7f9ce3c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cdc06cea0 0x7f9cdc14d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:20.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.232+0000 7f9ce3c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cdc0b4100 0x7f9cdc155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:20.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.232+0000 7f9ce3c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cdc15e7a0 0x7f9cdc156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:20.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.232+0000 7f9ce3c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9cdc0aea20 con 0x7f9cdc0b4100 2024-05-28T06:06:20.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.232+0000 7f9ce3c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9cdc0ae8a0 con 0x7f9cdc15e7a0 2024-05-28T06:06:20.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.232+0000 7f9ce3c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9cdc06b990 con 0x7f9cdc06cea0 2024-05-28T06:06:20.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.232+0000 7f9cdbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cdc0b4100 0x7f9cdc155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:20.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.232+0000 7f9cdbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cdc0b4100 0x7f9cdc155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51700/0 (socket says 172.21.15.122:51700) 2024-05-28T06:06:20.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.232+0000 7f9cdbe00640 1 -- 172.21.15.122:0/2891271541 learned_addr learned my addr 172.21.15.122:0/2891271541 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:20.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.232+0000 7f9ce1200640 1 --2- 172.21.15.122:0/2891271541 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cdc06cea0 0x7f9cdc14d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:20.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.232+0000 7f9ce1c00640 1 --2- 172.21.15.122:0/2891271541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cdc15e7a0 0x7f9cdc156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:20.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.236+0000 7f9cdbe00640 1 -- 172.21.15.122:0/2891271541 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cdc06cea0 msgr2=0x7f9cdc14d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:20.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.236+0000 7f9cdbe00640 1 --2- 172.21.15.122:0/2891271541 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cdc06cea0 0x7f9cdc14d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:20.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.236+0000 7f9cdbe00640 1 -- 172.21.15.122:0/2891271541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cdc15e7a0 msgr2=0x7f9cdc156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:20.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.236+0000 7f9cdbe00640 1 --2- 172.21.15.122:0/2891271541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cdc15e7a0 0x7f9cdc156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:20.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.236+0000 7f9cdbe00640 1 -- 172.21.15.122:0/2891271541 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cdc155530 con 0x7f9cdc0b4100 2024-05-28T06:06:20.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.236+0000 7f9ce1200640 1 --2- 172.21.15.122:0/2891271541 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cdc06cea0 0x7f9cdc14d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:20.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.236+0000 7f9cdbe00640 1 --2- 172.21.15.122:0/2891271541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cdc0b4100 0x7f9cdc155d20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9cc80190f0 tx=0x7f9cc801ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:20.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.236+0000 7f9cd8c00640 1 -- 172.21.15.122:0/2891271541 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc80b0050 con 0x7f9cdc0b4100 2024-05-28T06:06:20.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.236+0000 7f9cd8c00640 1 -- 172.21.15.122:0/2891271541 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc80b1040 con 0x7f9cdc0b4100 2024-05-28T06:06:20.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.236+0000 7f9ce3c00640 1 -- 172.21.15.122:0/2891271541 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cdc155810 con 0x7f9cdc0b4100 2024-05-28T06:06:20.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.236+0000 7f9cd8c00640 1 -- 172.21.15.122:0/2891271541 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8006e20 con 0x7f9cdc0b4100 2024-05-28T06:06:20.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.236+0000 7f9ce3c00640 1 -- 172.21.15.122:0/2891271541 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cdc14d660 con 0x7f9cdc0b4100 2024-05-28T06:06:20.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.236+0000 7f9ce3c00640 1 -- 172.21.15.122:0/2891271541 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cdc068c40 con 0x7f9cdc0b4100 2024-05-28T06:06:20.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.236+0000 7f9cd8c00640 1 -- 172.21.15.122:0/2891271541 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9cc80b5610 con 0x7f9cdc0b4100 2024-05-28T06:06:20.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.236+0000 7f9cd8c00640 1 --2- 172.21.15.122:0/2891271541 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9cbc0683b0 0x7f9cbc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:20.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.236+0000 7f9cd8c00640 1 -- 172.21.15.122:0/2891271541 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9cc8120650 con 0x7f9cdc0b4100 2024-05-28T06:06:20.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.236+0000 7f9ce1200640 1 --2- 172.21.15.122:0/2891271541 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9cbc0683b0 0x7f9cbc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:20.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.240+0000 7f9ce1200640 1 --2- 172.21.15.122:0/2891271541 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9cbc0683b0 0x7f9cbc06a870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc000f70 tx=0x7f9ccc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:20.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.240+0000 7f9cd8c00640 1 -- 172.21.15.122:0/2891271541 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9cc80160d0 con 0x7f9cdc0b4100 2024-05-28T06:06:20.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.400+0000 7f9ce3c00640 1 -- 172.21.15.122:0/2891271541 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9cdc161d10 con 0x7f9cdc0b4100 2024-05-28T06:06:20.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.400+0000 7f9cd8c00640 1 -- 172.21.15.122:0/2891271541 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f9cc80f0c10 con 0x7f9cdc0b4100 2024-05-28T06:06:20.403 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 64 2024-05-28T06:06:20.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.400+0000 7f9ce3c00640 1 -- 172.21.15.122:0/2891271541 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9cbc0683b0 msgr2=0x7f9cbc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:20.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.400+0000 7f9ce3c00640 1 --2- 172.21.15.122:0/2891271541 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9cbc0683b0 0x7f9cbc06a870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc000f70 tx=0x7f9ccc009040 comp rx=0 tx=0).stop 2024-05-28T06:06:20.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.400+0000 7f9ce3c00640 1 -- 172.21.15.122:0/2891271541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cdc0b4100 msgr2=0x7f9cdc155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:20.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.400+0000 7f9ce3c00640 1 --2- 172.21.15.122:0/2891271541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cdc0b4100 0x7f9cdc155d20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9cc80190f0 tx=0x7f9cc801ad20 comp rx=0 tx=0).stop 2024-05-28T06:06:20.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.400+0000 7f9ce3c00640 1 -- 172.21.15.122:0/2891271541 shutdown_connections 2024-05-28T06:06:20.406 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.400+0000 7f9ce3c00640 1 --2- 172.21.15.122:0/2891271541 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9cbc0683b0 0x7f9cbc06a870 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:20.406 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.400+0000 7f9ce3c00640 1 --2- 172.21.15.122:0/2891271541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cdc15e7a0 0x7f9cdc156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:20.406 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.400+0000 7f9ce3c00640 1 --2- 172.21.15.122:0/2891271541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cdc0b4100 0x7f9cdc155d20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:20.406 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.400+0000 7f9ce3c00640 1 --2- 172.21.15.122:0/2891271541 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cdc06cea0 0x7f9cdc14d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:20.406 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.400+0000 7f9ce3c00640 1 -- 172.21.15.122:0/2891271541 >> 172.21.15.122:0/2891271541 conn(0x7f9cdc0b3130 msgr2=0x7f9cdc0b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:20.406 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.400+0000 7f9ce3c00640 1 -- 172.21.15.122:0/2891271541 shutdown_connections 2024-05-28T06:06:20.406 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.400+0000 7f9ce3c00640 1 -- 172.21.15.122:0/2891271541 wait complete. 2024-05-28T06:06:20.424 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone' 2024-05-28T06:06:20.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.556+0000 7fc200800640 1 Processor -- start 2024-05-28T06:06:20.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.556+0000 7fc200800640 1 -- start start 2024-05-28T06:06:20.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.556+0000 7fc200800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc1f80cff30 0x7fc1f806f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:20.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.556+0000 7fc200800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc1f806f6c0 0x7fc1f80cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:20.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.556+0000 7fc200800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc1f80cd930 0x7fc1f80722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:20.564 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.556+0000 7fc200800640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fc1f806fb00 con 0x7fc1f806f6c0 2024-05-28T06:06:20.564 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.556+0000 7fc200800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc1f80d0310 con 0x7fc1f80cd930 2024-05-28T06:06:20.564 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.556+0000 7fc200800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc1f815be20 con 0x7fc1f80cff30 2024-05-28T06:06:20.564 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.556+0000 7fc1fd400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc1f806f6c0 0x7fc1f80cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:20.564 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.556+0000 7fc1fd400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc1f806f6c0 0x7fc1f80cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51702/0 (socket says 172.21.15.122:51702) 2024-05-28T06:06:20.564 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.556+0000 7fc1fd400640 1 -- 172.21.15.122:0/555435362 learned_addr learned my addr 172.21.15.122:0/555435362 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:20.564 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.560+0000 7fc1fde00640 1 --2- 172.21.15.122:0/555435362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc1f80cff30 0x7fc1f806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:20.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.560+0000 7fc1fe800640 1 --2- 172.21.15.122:0/555435362 >> v2:172.21.15.153:3300/0 conn(0x7fc1f80cd930 0x7fc1f80722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:20.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.560+0000 7fc1fd400640 1 -- 172.21.15.122:0/555435362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc1f80cff30 msgr2=0x7fc1f806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:20.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.560+0000 7fc1fd400640 1 --2- 172.21.15.122:0/555435362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc1f80cff30 0x7fc1f806f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:20.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.560+0000 7fc1fd400640 1 -- 172.21.15.122:0/555435362 >> v2:172.21.15.153:3300/0 conn(0x7fc1f80cd930 msgr2=0x7fc1f80722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:20.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.560+0000 7fc1fd400640 1 --2- 172.21.15.122:0/555435362 >> v2:172.21.15.153:3300/0 conn(0x7fc1f80cd930 0x7fc1f80722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:20.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.560+0000 7fc1fd400640 1 -- 172.21.15.122:0/555435362 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f815c100 con 0x7fc1f806f6c0 2024-05-28T06:06:20.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.560+0000 7fc1fe800640 1 --2- 172.21.15.122:0/555435362 >> v2:172.21.15.153:3300/0 conn(0x7fc1f80cd930 0x7fc1f80722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:20.566 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.560+0000 7fc1fd400640 1 --2- 172.21.15.122:0/555435362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1f806f6c0 0x7fc1f80cd3f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc1f80b3b00 tx=0x7fc1e801c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd62ec047d61e9f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:20.566 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.560+0000 7fc1fca00640 1 -- 172.21.15.122:0/555435362 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e80b0070 con 0x7fc1f806f6c0 2024-05-28T06:06:20.566 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.560+0000 7fc1fca00640 1 -- 172.21.15.122:0/555435362 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1e80ab600 con 0x7fc1f806f6c0 2024-05-28T06:06:20.566 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.560+0000 7fc1fca00640 1 -- 172.21.15.122:0/555435362 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e80ab9d0 con 0x7fc1f806f6c0 2024-05-28T06:06:20.567 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.560+0000 7fc200800640 1 -- 172.21.15.122:0/555435362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1f806f6c0 msgr2=0x7fc1f80cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:20.567 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.560+0000 7fc200800640 1 --2- 172.21.15.122:0/555435362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1f806f6c0 0x7fc1f80cd3f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc1f80b3b00 tx=0x7fc1e801c230 comp rx=0 tx=0).stop 2024-05-28T06:06:20.567 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc200800640 1 -- 172.21.15.122:0/555435362 shutdown_connections 2024-05-28T06:06:20.567 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc200800640 1 --2- 172.21.15.122:0/555435362 >> v2:172.21.15.153:3300/0 conn(0x7fc1f80cd930 0x7fc1f80722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:20.568 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc200800640 1 --2- 172.21.15.122:0/555435362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1f806f6c0 0x7fc1f80cd3f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:20.568 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc200800640 1 --2- 172.21.15.122:0/555435362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc1f80cff30 0x7fc1f806f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:20.568 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc200800640 1 -- 172.21.15.122:0/555435362 >> 172.21.15.122:0/555435362 conn(0x7fc1f806bd90 msgr2=0x7fc1f806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:20.568 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc200800640 1 -- 172.21.15.122:0/555435362 shutdown_connections 2024-05-28T06:06:20.568 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc200800640 1 -- 172.21.15.122:0/555435362 wait complete. 2024-05-28T06:06:20.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc200800640 1 Processor -- start 2024-05-28T06:06:20.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc200800640 1 -- start start 2024-05-28T06:06:20.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc200800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc1f806f6c0 0x7fc1f81577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:20.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc200800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1f80cd930 0x7fc1f814f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:20.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc200800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1f80cff30 0x7fc1f8158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:20.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc200800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f80cdec0 con 0x7fc1f80cd930 2024-05-28T06:06:20.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc200800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f80cdd40 con 0x7fc1f80cff30 2024-05-28T06:06:20.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc200800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc1f806e070 con 0x7fc1f806f6c0 2024-05-28T06:06:20.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc1fd400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1f80cd930 0x7fc1f814f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:20.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc1fd400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1f80cd930 0x7fc1f814f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51718/0 (socket says 172.21.15.122:51718) 2024-05-28T06:06:20.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc1fd400640 1 -- 172.21.15.122:0/2424279220 learned_addr learned my addr 172.21.15.122:0/2424279220 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:20.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc1fde00640 1 --2- 172.21.15.122:0/2424279220 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc1f806f6c0 0x7fc1f81577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:20.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc1fe800640 1 --2- 172.21.15.122:0/2424279220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1f80cff30 0x7fc1f8158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:20.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc1fd400640 1 -- 172.21.15.122:0/2424279220 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc1f806f6c0 msgr2=0x7fc1f81577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:20.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc1fd400640 1 --2- 172.21.15.122:0/2424279220 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc1f806f6c0 0x7fc1f81577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:20.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc1fd400640 1 -- 172.21.15.122:0/2424279220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1f80cff30 msgr2=0x7fc1f8158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:20.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc1fd400640 1 --2- 172.21.15.122:0/2424279220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1f80cff30 0x7fc1f8158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:20.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc1fd400640 1 -- 172.21.15.122:0/2424279220 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f814ed00 con 0x7fc1f80cd930 2024-05-28T06:06:20.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc1fd400640 1 --2- 172.21.15.122:0/2424279220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1f80cd930 0x7fc1f814f4f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc1e80ae040 tx=0x7fc1e8018fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:20.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc1f2000640 1 -- 172.21.15.122:0/2424279220 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e80b9070 con 0x7fc1f80cd930 2024-05-28T06:06:20.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc1f2000640 1 -- 172.21.15.122:0/2424279220 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1e80b4400 con 0x7fc1f80cd930 2024-05-28T06:06:20.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc200800640 1 -- 172.21.15.122:0/2424279220 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1f814e460 con 0x7fc1f80cd930 2024-05-28T06:06:20.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc1f2000640 1 -- 172.21.15.122:0/2424279220 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e80b0040 con 0x7fc1f80cd930 2024-05-28T06:06:20.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.564+0000 7fc200800640 1 -- 172.21.15.122:0/2424279220 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1f814ea20 con 0x7fc1f80cd930 2024-05-28T06:06:20.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.568+0000 7fc200800640 1 -- 172.21.15.122:0/2424279220 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1f8068c40 con 0x7fc1f80cd930 2024-05-28T06:06:20.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.568+0000 7fc1f2000640 1 -- 172.21.15.122:0/2424279220 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc1e80bc070 con 0x7fc1f80cd930 2024-05-28T06:06:20.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.568+0000 7fc1f2000640 1 --2- 172.21.15.122:0/2424279220 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc1dc068380 0x7fc1dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:20.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.568+0000 7fc1f2000640 1 -- 172.21.15.122:0/2424279220 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc1e811fa80 con 0x7fc1f80cd930 2024-05-28T06:06:20.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.568+0000 7fc1fde00640 1 --2- 172.21.15.122:0/2424279220 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc1dc068380 0x7fc1dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:20.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.568+0000 7fc1fde00640 1 --2- 172.21.15.122:0/2424279220 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc1dc068380 0x7fc1dc06a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8158190 tx=0x7fc1ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:20.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.572+0000 7fc1f2000640 1 -- 172.21.15.122:0/2424279220 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc1e8121e20 con 0x7fc1f80cd930 2024-05-28T06:06:20.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:20.784+0000 7fc200800640 1 -- 172.21.15.122:0/2424279220 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone"]} v 0) -- 0x7fc1f80ccdf0 con 0x7fc1f80cd930 2024-05-28T06:06:21.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.392+0000 7fc1f2000640 1 -- 172.21.15.122:0/2424279220 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone"]}]=0 v57) ==== 163+0+0 (secure 0 0 0) 0x7fc1e8016110 con 0x7fc1f80cd930 2024-05-28T06:06:21.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.396+0000 7fc200800640 1 -- 172.21.15.122:0/2424279220 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc1dc068380 msgr2=0x7fc1dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:21.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.396+0000 7fc200800640 1 --2- 172.21.15.122:0/2424279220 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc1dc068380 0x7fc1dc06a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8158190 tx=0x7fc1ec008040 comp rx=0 tx=0).stop 2024-05-28T06:06:21.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.396+0000 7fc200800640 1 -- 172.21.15.122:0/2424279220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1f80cd930 msgr2=0x7fc1f814f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:21.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.396+0000 7fc200800640 1 --2- 172.21.15.122:0/2424279220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1f80cd930 0x7fc1f814f4f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc1e80ae040 tx=0x7fc1e8018fd0 comp rx=0 tx=0).stop 2024-05-28T06:06:21.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.396+0000 7fc200800640 1 -- 172.21.15.122:0/2424279220 shutdown_connections 2024-05-28T06:06:21.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.396+0000 7fc200800640 1 --2- 172.21.15.122:0/2424279220 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc1dc068380 0x7fc1dc06a840 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:21.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.396+0000 7fc200800640 1 --2- 172.21.15.122:0/2424279220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1f80cff30 0x7fc1f8158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:21.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.396+0000 7fc200800640 1 --2- 172.21.15.122:0/2424279220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1f80cd930 0x7fc1f814f4f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:21.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.396+0000 7fc200800640 1 --2- 172.21.15.122:0/2424279220 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc1f806f6c0 0x7fc1f81577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:21.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.396+0000 7fc200800640 1 -- 172.21.15.122:0/2424279220 >> 172.21.15.122:0/2424279220 conn(0x7fc1f806bd90 msgr2=0x7fc1f814fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:21.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.396+0000 7fc200800640 1 -- 172.21.15.122:0/2424279220 shutdown_connections 2024-05-28T06:06:21.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.396+0000 7fc200800640 1 -- 172.21.15.122:0/2424279220 wait complete. 2024-05-28T06:06:21.423 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-28T06:06:21.564 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.560+0000 7f5802600640 1 Processor -- start 2024-05-28T06:06:21.564 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.560+0000 7f5802600640 1 -- start start 2024-05-28T06:06:21.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.560+0000 7f5802600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57fc0cff30 0x7f57fc06f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:21.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.560+0000 7f5802600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f57fc0cdb00 0x7f57fc0b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:21.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.560+0000 7f5802600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57fc0d0310 con 0x7f57fc06f6c0 2024-05-28T06:06:21.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.560+0000 7f5802600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f57fc06fb00 con 0x7f57fc0cdb00 2024-05-28T06:06:21.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.560+0000 7f5802600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f57fc0cdf30 con 0x7f57fc0cff30 2024-05-28T06:06:21.566 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.560+0000 7f57fbe00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f57fc0cdb00 0x7f57fc0b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:21.566 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.560+0000 7f57fbe00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f57fc0cdb00 0x7f57fc0b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51728/0 (socket says 172.21.15.122:51728) 2024-05-28T06:06:21.566 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.560+0000 7f57f2a00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f57fc06f6c0 0x7f57fc0cd3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:54226/0 (socket says 172.21.15.122:54226) 2024-05-28T06:06:21.566 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.560+0000 7f57fbe00640 1 -- 172.21.15.122:0/3940014084 learned_addr learned my addr 172.21.15.122:0/3940014084 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:21.567 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.560+0000 7f57fb400640 1 --2- 172.21.15.122:0/3940014084 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57fc0cff30 0x7f57fc06f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:21.567 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.560+0000 7f57fbe00640 1 -- 172.21.15.122:0/3940014084 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57fc0cff30 msgr2=0x7f57fc06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:21.567 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.560+0000 7f57fbe00640 1 --2- 172.21.15.122:0/3940014084 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57fc0cff30 0x7f57fc06f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:21.567 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.560+0000 7f57fbe00640 1 -- 172.21.15.122:0/3940014084 >> v1:172.21.15.122:6789/0 conn(0x7f57fc06f6c0 legacy=0x7f57fc0cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:21.567 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.560+0000 7f57fbe00640 1 -- 172.21.15.122:0/3940014084 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57fc15be20 con 0x7f57fc0cdb00 2024-05-28T06:06:21.567 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.560+0000 7f57faa00640 1 -- 172.21.15.122:0/3940014084 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 564583065 0 0) 0x7f57fc0d0310 con 0x7f57fc06f6c0 2024-05-28T06:06:21.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.564+0000 7f57fbe00640 1 --2- 172.21.15.122:0/3940014084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f57fc0cdb00 0x7f57fc0b49b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009e50 tx=0x7f57f401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c5b0453659f081 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:21.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.564+0000 7f57faa00640 1 -- 172.21.15.122:0/3940014084 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f40a58d0 con 0x7f57fc0cdb00 2024-05-28T06:06:21.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.564+0000 7f57faa00640 1 -- 172.21.15.122:0/3940014084 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57f40a5a70 con 0x7f57fc0cdb00 2024-05-28T06:06:21.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.564+0000 7f57faa00640 1 -- 172.21.15.122:0/3940014084 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f40a5e40 con 0x7f57fc0cdb00 2024-05-28T06:06:21.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.564+0000 7f5802600640 1 -- 172.21.15.122:0/3940014084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f57fc0cdb00 msgr2=0x7f57fc0b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:21.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.564+0000 7f5802600640 1 --2- 172.21.15.122:0/3940014084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f57fc0cdb00 0x7f57fc0b49b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009e50 tx=0x7f57f401ca00 comp rx=0 tx=0).stop 2024-05-28T06:06:21.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.564+0000 7f5802600640 1 -- 172.21.15.122:0/3940014084 shutdown_connections 2024-05-28T06:06:21.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.564+0000 7f5802600640 1 --2- 172.21.15.122:0/3940014084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f57fc0cdb00 0x7f57fc0b49b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:21.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.564+0000 7f5802600640 1 --2- 172.21.15.122:0/3940014084 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57fc0cff30 0x7f57fc06f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:21.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.564+0000 7f5802600640 1 -- 172.21.15.122:0/3940014084 >> 172.21.15.122:0/3940014084 conn(0x7f57fc06bd90 msgr2=0x7f57fc06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:21.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.564+0000 7f5802600640 1 -- 172.21.15.122:0/3940014084 shutdown_connections 2024-05-28T06:06:21.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.564+0000 7f5802600640 1 -- 172.21.15.122:0/3940014084 wait complete. 2024-05-28T06:06:21.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f5802600640 1 Processor -- start 2024-05-28T06:06:21.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f5802600640 1 -- start start 2024-05-28T06:06:21.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f5802600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57fc06f6c0 0x7f57fc13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:21.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f5802600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f57fc0cdb00 0x7f57fc0b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:21.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f5802600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc0cff30 0x7f57fc0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:21.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f5802600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc0b5700 con 0x7f57fc0cdb00 2024-05-28T06:06:21.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f5802600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc15baf0 con 0x7f57fc0cff30 2024-05-28T06:06:21.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f5802600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f57fc0b5880 con 0x7f57fc06f6c0 2024-05-28T06:06:21.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f57f2a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f57fc0cdb00 0x7f57fc0b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:21.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f57f2a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f57fc0cdb00 0x7f57fc0b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51742/0 (socket says 172.21.15.122:51742) 2024-05-28T06:06:21.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f57f2a00640 1 -- 172.21.15.122:0/653057421 learned_addr learned my addr 172.21.15.122:0/653057421 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:21.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f57fb400640 1 --2- 172.21.15.122:0/653057421 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57fc06f6c0 0x7f57fc13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:21.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f57fbe00640 1 --2- 172.21.15.122:0/653057421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc0cff30 0x7f57fc0b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:21.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f57f2a00640 1 -- 172.21.15.122:0/653057421 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57fc06f6c0 msgr2=0x7f57fc13bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:21.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f57f2a00640 1 --2- 172.21.15.122:0/653057421 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57fc06f6c0 0x7f57fc13bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:21.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f57f2a00640 1 -- 172.21.15.122:0/653057421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc0cff30 msgr2=0x7f57fc0b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:21.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f57f2a00640 1 --2- 172.21.15.122:0/653057421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc0cff30 0x7f57fc0b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:21.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f57f2a00640 1 -- 172.21.15.122:0/653057421 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57fc158ca0 con 0x7f57fc0cdb00 2024-05-28T06:06:21.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f57fb400640 1 --2- 172.21.15.122:0/653057421 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57fc06f6c0 0x7f57fc13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:21.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f57fbe00640 1 --2- 172.21.15.122:0/653057421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc0cff30 0x7f57fc0b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:21.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f57f2a00640 1 --2- 172.21.15.122:0/653057421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f57fc0cdb00 0x7f57fc0b0590 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f57e400c4b0 tx=0x7f57e400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:21.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f57f3e00640 1 -- 172.21.15.122:0/653057421 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e4018070 con 0x7f57fc0cdb00 2024-05-28T06:06:21.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f57f3e00640 1 -- 172.21.15.122:0/653057421 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57e4007480 con 0x7f57fc0cdb00 2024-05-28T06:06:21.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f57f3e00640 1 -- 172.21.15.122:0/653057421 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e40047f0 con 0x7f57fc0cdb00 2024-05-28T06:06:21.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f5802600640 1 -- 172.21.15.122:0/653057421 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57fc158f80 con 0x7f57fc0cdb00 2024-05-28T06:06:21.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.568+0000 7f5802600640 1 -- 172.21.15.122:0/653057421 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57fc14c4e0 con 0x7f57fc0cdb00 2024-05-28T06:06:21.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.572+0000 7f5802600640 1 -- 172.21.15.122:0/653057421 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57fc14c6e0 con 0x7f57fc0cdb00 2024-05-28T06:06:21.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.572+0000 7f57f3e00640 1 -- 172.21.15.122:0/653057421 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f57e4004990 con 0x7f57fc0cdb00 2024-05-28T06:06:21.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.572+0000 7f57f3e00640 1 --2- 172.21.15.122:0/653057421 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f57d8068380 0x7f57d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:21.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.572+0000 7f57f3e00640 1 -- 172.21.15.122:0/653057421 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f57e4085cf0 con 0x7f57fc0cdb00 2024-05-28T06:06:21.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.572+0000 7f57fb400640 1 --2- 172.21.15.122:0/653057421 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f57d8068380 0x7f57d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:21.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.572+0000 7f57fb400640 1 --2- 172.21.15.122:0/653057421 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f57d8068380 0x7f57d806a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f57fc1487e0 tx=0x7f57ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:21.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.576+0000 7f57f3e00640 1 -- 172.21.15.122:0/653057421 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f57fc14c6e0 con 0x7f57fc0cdb00 2024-05-28T06:06:21.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.732+0000 7f5802600640 1 -- 172.21.15.122:0/653057421 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f57fc068c40 con 0x7f57fc0cdb00 2024-05-28T06:06:21.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.736+0000 7f57f3e00640 1 -- 172.21.15.122:0/653057421 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f57e4056360 con 0x7f57fc0cdb00 2024-05-28T06:06:21.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.740+0000 7f5802600640 1 -- 172.21.15.122:0/653057421 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f57d8068380 msgr2=0x7f57d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:21.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.740+0000 7f5802600640 1 --2- 172.21.15.122:0/653057421 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f57d8068380 0x7f57d806a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f57fc1487e0 tx=0x7f57ec008040 comp rx=0 tx=0).stop 2024-05-28T06:06:21.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.740+0000 7f5802600640 1 -- 172.21.15.122:0/653057421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f57fc0cdb00 msgr2=0x7f57fc0b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:21.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.740+0000 7f5802600640 1 --2- 172.21.15.122:0/653057421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f57fc0cdb00 0x7f57fc0b0590 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f57e400c4b0 tx=0x7f57e400c970 comp rx=0 tx=0).stop 2024-05-28T06:06:21.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.740+0000 7f5802600640 1 -- 172.21.15.122:0/653057421 shutdown_connections 2024-05-28T06:06:21.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.740+0000 7f5802600640 1 --2- 172.21.15.122:0/653057421 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f57d8068380 0x7f57d806a840 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:21.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.740+0000 7f5802600640 1 --2- 172.21.15.122:0/653057421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc0cff30 0x7f57fc0b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:21.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.740+0000 7f5802600640 1 --2- 172.21.15.122:0/653057421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f57fc0cdb00 0x7f57fc0b0590 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:21.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.740+0000 7f5802600640 1 --2- 172.21.15.122:0/653057421 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57fc06f6c0 0x7f57fc13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:21.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.740+0000 7f5802600640 1 -- 172.21.15.122:0/653057421 >> 172.21.15.122:0/653057421 conn(0x7f57fc06bd90 msgr2=0x7f57fc15ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:21.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.740+0000 7f5802600640 1 -- 172.21.15.122:0/653057421 shutdown_connections 2024-05-28T06:06:21.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:21.740+0000 7f5802600640 1 -- 172.21.15.122:0/653057421 wait complete. 2024-05-28T06:06:21.763 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-28T06:06:21.763 DEBUG:teuthology.orchestra.run.smithi122:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-28T06:06:21.857 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-28T06:06:21.971 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-28T06:06:21.971 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:06:21.971 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:06:21.980 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:06:21.980 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:06:22.030 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:06:22.030 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:06:22.078 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:06:22.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.248+0000 7ff6cd400640 1 Processor -- start 2024-05-28T06:06:22.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.248+0000 7ff6cd400640 1 -- start start 2024-05-28T06:06:22.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.252+0000 7ff6cd400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6c815c930 0x7ff6c80cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:22.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.252+0000 7ff6cd400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff6c8073030 0x7ff6c80722f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:22.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.252+0000 7ff6cd400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6c80ce360 con 0x7ff6c8072830 2024-05-28T06:06:22.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.252+0000 7ff6cd400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff6c80cfe40 con 0x7ff6c8073030 2024-05-28T06:06:22.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.252+0000 7ff6cd400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff6c80d0070 con 0x7ff6c815c930 2024-05-28T06:06:22.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.252+0000 7ff6c5e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff6c8073030 0x7ff6c80722f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:22.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.252+0000 7ff6c7200640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff6c8072830 0x7ff6c81602a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:38950/0 (socket says 172.21.15.122:38950) 2024-05-28T06:06:22.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.252+0000 7ff6c7200640 1 -- 172.21.15.122:0/3802533700 learned_addr learned my addr 172.21.15.122:0/3802533700 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:22.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.252+0000 7ff6c6800640 1 --2- 172.21.15.122:0/3802533700 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6c815c930 0x7ff6c80cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:22.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.252+0000 7ff6c5e00640 1 -- 172.21.15.122:0/3802533700 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6c815c930 msgr2=0x7ff6c80cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:22.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.252+0000 7ff6c5e00640 1 --2- 172.21.15.122:0/3802533700 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6c815c930 0x7ff6c80cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.252+0000 7ff6c5e00640 1 -- 172.21.15.122:0/3802533700 >> v1:172.21.15.153:6789/0 conn(0x7ff6c8072830 legacy=0x7ff6c81602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:22.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.252+0000 7ff6c5e00640 1 -- 172.21.15.122:0/3802533700 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c80d0350 con 0x7ff6c8073030 2024-05-28T06:06:22.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.256+0000 7ff6c5e00640 1 --2- 172.21.15.122:0/3802533700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6c8073030 0x7ff6c80722f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40097f0 tx=0x7ff6b401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47438a282939b742 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:22.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.256+0000 7ff6c5400640 1 -- 172.21.15.122:0/3802533700 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b40b0070 con 0x7ff6c8073030 2024-05-28T06:06:22.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.256+0000 7ff6c5400640 1 -- 172.21.15.122:0/3802533700 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6b40ab600 con 0x7ff6c8073030 2024-05-28T06:06:22.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.256+0000 7ff6c5400640 1 -- 172.21.15.122:0/3802533700 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b40ab9d0 con 0x7ff6c8073030 2024-05-28T06:06:22.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.256+0000 7ff6cd400640 1 -- 172.21.15.122:0/3802533700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6c8073030 msgr2=0x7ff6c80722f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:22.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.256+0000 7ff6cd400640 1 --2- 172.21.15.122:0/3802533700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6c8073030 0x7ff6c80722f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40097f0 tx=0x7ff6b401c410 comp rx=0 tx=0).stop 2024-05-28T06:06:22.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.256+0000 7ff6cd400640 1 -- 172.21.15.122:0/3802533700 shutdown_connections 2024-05-28T06:06:22.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.256+0000 7ff6cd400640 1 --2- 172.21.15.122:0/3802533700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6c8073030 0x7ff6c80722f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.256+0000 7ff6cd400640 1 --2- 172.21.15.122:0/3802533700 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6c815c930 0x7ff6c80cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.256+0000 7ff6cd400640 1 -- 172.21.15.122:0/3802533700 >> 172.21.15.122:0/3802533700 conn(0x7ff6c80b26b0 msgr2=0x7ff6c80b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:22.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.256+0000 7ff6cd400640 1 -- 172.21.15.122:0/3802533700 shutdown_connections 2024-05-28T06:06:22.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.256+0000 7ff6cd400640 1 -- 172.21.15.122:0/3802533700 wait complete. 2024-05-28T06:06:22.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.256+0000 7ff6cd400640 1 Processor -- start 2024-05-28T06:06:22.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.256+0000 7ff6cd400640 1 -- start start 2024-05-28T06:06:22.263 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.256+0000 7ff6cd400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6c8072830 0x7ff6c81f7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:22.263 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.256+0000 7ff6cd400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6c8073030 0x7ff6c81490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:22.263 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.256+0000 7ff6cd400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6c815c930 0x7ff6c8149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:22.263 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.256+0000 7ff6cd400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c8169590 con 0x7ff6c8073030 2024-05-28T06:06:22.263 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.256+0000 7ff6cd400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c8169410 con 0x7ff6c8072830 2024-05-28T06:06:22.263 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.256+0000 7ff6cd400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff6c8169710 con 0x7ff6c815c930 2024-05-28T06:06:22.263 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.260+0000 7ff6c5e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6c8073030 0x7ff6c81490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:22.263 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.260+0000 7ff6c5e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6c8073030 0x7ff6c81490f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51744/0 (socket says 172.21.15.122:51744) 2024-05-28T06:06:22.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.260+0000 7ff6c5e00640 1 -- 172.21.15.122:0/979868158 learned_addr learned my addr 172.21.15.122:0/979868158 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:22.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.260+0000 7ff6c5e00640 1 -- 172.21.15.122:0/979868158 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6c815c930 msgr2=0x7ff6c8149630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:22.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.260+0000 7ff6c5e00640 1 --2- 172.21.15.122:0/979868158 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6c815c930 0x7ff6c8149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.260+0000 7ff6c5e00640 1 -- 172.21.15.122:0/979868158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6c8072830 msgr2=0x7ff6c81f7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:22.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.260+0000 7ff6c5e00640 1 --2- 172.21.15.122:0/979868158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6c8072830 0x7ff6c81f7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.260+0000 7ff6c5e00640 1 -- 172.21.15.122:0/979868158 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c81f82c0 con 0x7ff6c8073030 2024-05-28T06:06:22.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.260+0000 7ff6c5e00640 1 --2- 172.21.15.122:0/979868158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6c8073030 0x7ff6c81490f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40ae040 tx=0x7ff6b40191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:22.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.260+0000 7ff6bea00640 1 -- 172.21.15.122:0/979868158 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b40ba070 con 0x7ff6c8073030 2024-05-28T06:06:22.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.260+0000 7ff6bea00640 1 -- 172.21.15.122:0/979868158 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6b40b43f0 con 0x7ff6c8073030 2024-05-28T06:06:22.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.260+0000 7ff6cd400640 1 -- 172.21.15.122:0/979868158 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6c8157e40 con 0x7ff6c8073030 2024-05-28T06:06:22.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.260+0000 7ff6bea00640 1 -- 172.21.15.122:0/979868158 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b40b0040 con 0x7ff6c8073030 2024-05-28T06:06:22.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.260+0000 7ff6cd400640 1 -- 172.21.15.122:0/979868158 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6c8158400 con 0x7ff6c8073030 2024-05-28T06:06:22.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.260+0000 7ff6cd400640 1 -- 172.21.15.122:0/979868158 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6c8068c40 con 0x7ff6c8073030 2024-05-28T06:06:22.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.260+0000 7ff6bea00640 1 -- 172.21.15.122:0/979868158 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff6b40bd070 con 0x7ff6c8073030 2024-05-28T06:06:22.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.260+0000 7ff6bea00640 1 --2- 172.21.15.122:0/979868158 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff6a80683b0 0x7ff6a806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:22.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.264+0000 7ff6bea00640 1 -- 172.21.15.122:0/979868158 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff6b411f990 con 0x7ff6c8073030 2024-05-28T06:06:22.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.264+0000 7ff6c6800640 1 --2- 172.21.15.122:0/979868158 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff6a80683b0 0x7ff6a806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:22.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.264+0000 7ff6c6800640 1 --2- 172.21.15.122:0/979868158 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff6a80683b0 0x7ff6a806a870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8009fa0 tx=0x7ff6b800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:22.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.268+0000 7ff6bea00640 1 -- 172.21.15.122:0/979868158 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff6c81f82c0 con 0x7ff6c8073030 2024-05-28T06:06:22.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.428+0000 7ff6cd400640 1 -- 172.21.15.122:0/979868158 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6c80758e0 con 0x7ff6c8073030 2024-05-28T06:06:22.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.428+0000 7ff6bea00640 1 -- 172.21.15.122:0/979868158 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7ff6b4016090 con 0x7ff6c8073030 2024-05-28T06:06:22.432 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:22.432 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":20,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:05:50.822555+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:05:47.441193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-28T06:05:48.148164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:06:22.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.428+0000 7ff6cd400640 1 -- 172.21.15.122:0/979868158 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff6a80683b0 msgr2=0x7ff6a806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:22.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.428+0000 7ff6cd400640 1 --2- 172.21.15.122:0/979868158 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff6a80683b0 0x7ff6a806a870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8009fa0 tx=0x7ff6b800b040 comp rx=0 tx=0).stop 2024-05-28T06:06:22.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.428+0000 7ff6cd400640 1 -- 172.21.15.122:0/979868158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6c8073030 msgr2=0x7ff6c81490f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:22.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.428+0000 7ff6cd400640 1 --2- 172.21.15.122:0/979868158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6c8073030 0x7ff6c81490f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40ae040 tx=0x7ff6b40191b0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.428+0000 7ff6cd400640 1 -- 172.21.15.122:0/979868158 shutdown_connections 2024-05-28T06:06:22.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.428+0000 7ff6cd400640 1 --2- 172.21.15.122:0/979868158 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff6a80683b0 0x7ff6a806a870 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.428+0000 7ff6cd400640 1 --2- 172.21.15.122:0/979868158 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6c815c930 0x7ff6c8149630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.428+0000 7ff6cd400640 1 --2- 172.21.15.122:0/979868158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6c8073030 0x7ff6c81490f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.428+0000 7ff6cd400640 1 --2- 172.21.15.122:0/979868158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6c8072830 0x7ff6c81f7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.428+0000 7ff6cd400640 1 -- 172.21.15.122:0/979868158 >> 172.21.15.122:0/979868158 conn(0x7ff6c80b26b0 msgr2=0x7ff6c8166b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:22.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.428+0000 7ff6cd400640 1 -- 172.21.15.122:0/979868158 shutdown_connections 2024-05-28T06:06:22.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.428+0000 7ff6cd400640 1 -- 172.21.15.122:0/979868158 wait complete. 2024-05-28T06:06:22.453 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-28T06:05:47.441193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-28T06:05:48.148164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:06:22.453 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:06:22.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.588+0000 7fe981800640 1 Processor -- start 2024-05-28T06:06:22.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.588+0000 7fe981800640 1 -- start start 2024-05-28T06:06:22.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.588+0000 7fe981800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe97c0b58d0 0x7fe97c0b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:22.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.588+0000 7fe981800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe97c0ce4f0 0x7fe97c0ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:22.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.588+0000 7fe981800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe97c0b61f0 con 0x7fe97c0722a0 2024-05-28T06:06:22.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.588+0000 7fe981800640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fe97c15d970 con 0x7fe97c0ce4f0 2024-05-28T06:06:22.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.588+0000 7fe981800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe97c15dc50 con 0x7fe97c0b58d0 2024-05-28T06:06:22.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.588+0000 7fe97a000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe97c0ce4f0 0x7fe97c0ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:22.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.588+0000 7fe97b400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fe97c0722a0 0x7fe97c0726f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:54228/0 (socket says 172.21.15.122:54228) 2024-05-28T06:06:22.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.588+0000 7fe97b400640 1 -- 172.21.15.122:0/3681354943 learned_addr learned my addr 172.21.15.122:0/3681354943 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:22.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.588+0000 7fe97aa00640 1 --2- 172.21.15.122:0/3681354943 >> v2:172.21.15.153:3300/0 conn(0x7fe97c0b58d0 0x7fe97c0b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:22.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.592+0000 7fe97a000640 1 -- 172.21.15.122:0/3681354943 >> v2:172.21.15.153:3300/0 conn(0x7fe97c0b58d0 msgr2=0x7fe97c0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:22.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.592+0000 7fe97a000640 1 --2- 172.21.15.122:0/3681354943 >> v2:172.21.15.153:3300/0 conn(0x7fe97c0b58d0 0x7fe97c0b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.592+0000 7fe97a000640 1 -- 172.21.15.122:0/3681354943 >> v1:172.21.15.122:6789/0 conn(0x7fe97c0722a0 legacy=0x7fe97c0726f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:22.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.592+0000 7fe97a000640 1 -- 172.21.15.122:0/3681354943 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97c15df30 con 0x7fe97c0ce4f0 2024-05-28T06:06:22.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.592+0000 7fe97a000640 1 --2- 172.21.15.122:0/3681354943 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe97c0ce4f0 0x7fe97c0ce980 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe97c070130 tx=0x7fe96801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87dacdeb3ca11dd3 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:22.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.592+0000 7fe979600640 1 -- 172.21.15.122:0/3681354943 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9680ab5f0 con 0x7fe97c0ce4f0 2024-05-28T06:06:22.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.592+0000 7fe979600640 1 -- 172.21.15.122:0/3681354943 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9680b0070 con 0x7fe97c0ce4f0 2024-05-28T06:06:22.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.592+0000 7fe979600640 1 -- 172.21.15.122:0/3681354943 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9680ab9b0 con 0x7fe97c0ce4f0 2024-05-28T06:06:22.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.592+0000 7fe981800640 1 -- 172.21.15.122:0/3681354943 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe97c0ce4f0 msgr2=0x7fe97c0ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:22.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.592+0000 7fe981800640 1 --2- 172.21.15.122:0/3681354943 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe97c0ce4f0 0x7fe97c0ce980 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe97c070130 tx=0x7fe96801c450 comp rx=0 tx=0).stop 2024-05-28T06:06:22.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.592+0000 7fe981800640 1 -- 172.21.15.122:0/3681354943 shutdown_connections 2024-05-28T06:06:22.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.592+0000 7fe981800640 1 --2- 172.21.15.122:0/3681354943 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe97c0ce4f0 0x7fe97c0ce980 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.592+0000 7fe981800640 1 --2- 172.21.15.122:0/3681354943 >> v2:172.21.15.153:3300/0 conn(0x7fe97c0b58d0 0x7fe97c0b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.592+0000 7fe981800640 1 -- 172.21.15.122:0/3681354943 >> 172.21.15.122:0/3681354943 conn(0x7fe97c06bd90 msgr2=0x7fe97c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:22.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.596+0000 7fe981800640 1 -- 172.21.15.122:0/3681354943 shutdown_connections 2024-05-28T06:06:22.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.596+0000 7fe981800640 1 -- 172.21.15.122:0/3681354943 wait complete. 2024-05-28T06:06:22.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.596+0000 7fe981800640 1 Processor -- start 2024-05-28T06:06:22.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.596+0000 7fe981800640 1 -- start start 2024-05-28T06:06:22.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.596+0000 7fe981800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe97c0722a0 0x7fe97c13a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:22.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.596+0000 7fe981800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe97c0b58d0 0x7fe97c13a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:22.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.596+0000 7fe981800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe97c0ce4f0 0x7fe97c1597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:22.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.596+0000 7fe981800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c146260 con 0x7fe97c0b58d0 2024-05-28T06:06:22.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.596+0000 7fe981800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c169a60 con 0x7fe97c0ce4f0 2024-05-28T06:06:22.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.596+0000 7fe981800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe97c13c140 con 0x7fe97c0722a0 2024-05-28T06:06:22.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.596+0000 7fe97a000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe97c0b58d0 0x7fe97c13a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:22.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.596+0000 7fe97a000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe97c0b58d0 0x7fe97c13a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51762/0 (socket says 172.21.15.122:51762) 2024-05-28T06:06:22.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.596+0000 7fe97a000640 1 -- 172.21.15.122:0/3715378709 learned_addr learned my addr 172.21.15.122:0/3715378709 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:22.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.596+0000 7fe97aa00640 1 --2- 172.21.15.122:0/3715378709 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe97c0722a0 0x7fe97c13a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:22.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.596+0000 7fe97b400640 1 --2- 172.21.15.122:0/3715378709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe97c0ce4f0 0x7fe97c1597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:22.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.596+0000 7fe97a000640 1 -- 172.21.15.122:0/3715378709 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe97c0722a0 msgr2=0x7fe97c13a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:22.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.596+0000 7fe97a000640 1 --2- 172.21.15.122:0/3715378709 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe97c0722a0 0x7fe97c13a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.596+0000 7fe97a000640 1 -- 172.21.15.122:0/3715378709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe97c0ce4f0 msgr2=0x7fe97c1597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:22.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.596+0000 7fe97a000640 1 --2- 172.21.15.122:0/3715378709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe97c0ce4f0 0x7fe97c1597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.596+0000 7fe97a000640 1 -- 172.21.15.122:0/3715378709 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97c0b2700 con 0x7fe97c0b58d0 2024-05-28T06:06:22.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.596+0000 7fe97a000640 1 --2- 172.21.15.122:0/3715378709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe97c0b58d0 0x7fe97c13a8b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe96801a080 tx=0x7fe9680191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:22.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.596+0000 7fe972a00640 1 -- 172.21.15.122:0/3715378709 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9680b4bb0 con 0x7fe97c0b58d0 2024-05-28T06:06:22.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.596+0000 7fe972a00640 1 -- 172.21.15.122:0/3715378709 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9680b4d50 con 0x7fe97c0b58d0 2024-05-28T06:06:22.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.600+0000 7fe981800640 1 -- 172.21.15.122:0/3715378709 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe97c0b29e0 con 0x7fe97c0b58d0 2024-05-28T06:06:22.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.600+0000 7fe972a00640 1 -- 172.21.15.122:0/3715378709 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9680bf690 con 0x7fe97c0b58d0 2024-05-28T06:06:22.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.600+0000 7fe981800640 1 -- 172.21.15.122:0/3715378709 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe97c0b2fa0 con 0x7fe97c0b58d0 2024-05-28T06:06:22.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.600+0000 7fe981800640 1 -- 172.21.15.122:0/3715378709 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe97c068c40 con 0x7fe97c0b58d0 2024-05-28T06:06:22.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.600+0000 7fe972a00640 1 -- 172.21.15.122:0/3715378709 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe9680bf830 con 0x7fe97c0b58d0 2024-05-28T06:06:22.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.600+0000 7fe972a00640 1 --2- 172.21.15.122:0/3715378709 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe95c0683b0 0x7fe95c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:22.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.600+0000 7fe972a00640 1 -- 172.21.15.122:0/3715378709 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe968120ff0 con 0x7fe97c0b58d0 2024-05-28T06:06:22.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.600+0000 7fe97aa00640 1 --2- 172.21.15.122:0/3715378709 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe95c0683b0 0x7fe95c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:22.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.600+0000 7fe97aa00640 1 --2- 172.21.15.122:0/3715378709 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe95c0683b0 0x7fe95c06a870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe96c003fd0 tx=0x7fe96c0039a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:22.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.604+0000 7fe972a00640 1 -- 172.21.15.122:0/3715378709 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe968016070 con 0x7fe97c0b58d0 2024-05-28T06:06:22.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.760+0000 7fe981800640 1 -- 172.21.15.122:0/3715378709 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe97c13adf0 con 0x7fe97c0b58d0 2024-05-28T06:06:22.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.760+0000 7fe972a00640 1 -- 172.21.15.122:0/3715378709 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fe9680f15c0 con 0x7fe97c0b58d0 2024-05-28T06:06:22.767 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:06:22.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.764+0000 7fe981800640 1 -- 172.21.15.122:0/3715378709 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe95c0683b0 msgr2=0x7fe95c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:22.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.764+0000 7fe981800640 1 --2- 172.21.15.122:0/3715378709 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe95c0683b0 0x7fe95c06a870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe96c003fd0 tx=0x7fe96c0039a0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.764+0000 7fe981800640 1 -- 172.21.15.122:0/3715378709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe97c0b58d0 msgr2=0x7fe97c13a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:22.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.764+0000 7fe981800640 1 --2- 172.21.15.122:0/3715378709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe97c0b58d0 0x7fe97c13a8b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe96801a080 tx=0x7fe9680191f0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.764+0000 7fe981800640 1 -- 172.21.15.122:0/3715378709 shutdown_connections 2024-05-28T06:06:22.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.764+0000 7fe981800640 1 --2- 172.21.15.122:0/3715378709 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe95c0683b0 0x7fe95c06a870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.764+0000 7fe981800640 1 --2- 172.21.15.122:0/3715378709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe97c0ce4f0 0x7fe97c1597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.764+0000 7fe981800640 1 --2- 172.21.15.122:0/3715378709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe97c0b58d0 0x7fe97c13a8b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.764+0000 7fe981800640 1 --2- 172.21.15.122:0/3715378709 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe97c0722a0 0x7fe97c13a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.764+0000 7fe981800640 1 -- 172.21.15.122:0/3715378709 >> 172.21.15.122:0/3715378709 conn(0x7fe97c06bd90 msgr2=0x7fe97c06e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:22.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.764+0000 7fe981800640 1 -- 172.21.15.122:0/3715378709 shutdown_connections 2024-05-28T06:06:22.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.764+0000 7fe981800640 1 -- 172.21.15.122:0/3715378709 wait complete. 2024-05-28T06:06:22.788 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-28T06:06:22.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.920+0000 7f5968000640 1 Processor -- start 2024-05-28T06:06:22.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f5968000640 1 -- start start 2024-05-28T06:06:22.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f5968000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f59600b58d0 0x7f59600b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:22.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f5968000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f596015e730 0x7f596015ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:22.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f5968000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59600b61f0 con 0x7f59600ce4f0 2024-05-28T06:06:22.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f5968000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f596015d970 con 0x7f59600b58d0 2024-05-28T06:06:22.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f5968000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f596015dc50 con 0x7f596015e730 2024-05-28T06:06:22.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f5964c00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f59600ce4f0 0x7f59600ce980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:54244/0 (socket says 172.21.15.122:54244) 2024-05-28T06:06:22.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f5964c00640 1 -- 172.21.15.122:0/2265503099 learned_addr learned my addr 172.21.15.122:0/2265503099 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:22.930 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f5965600640 1 --2- 172.21.15.122:0/2265503099 >> v2:172.21.15.153:3300/0 conn(0x7f59600b58d0 0x7f59600b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:22.930 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f595fe00640 1 -- 172.21.15.122:0/2265503099 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1711521946 0 0) 0x7f59600b61f0 con 0x7f59600ce4f0 2024-05-28T06:06:22.930 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f5966000640 1 --2- 172.21.15.122:0/2265503099 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f596015e730 0x7f596015ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:22.930 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f595fe00640 1 -- 172.21.15.122:0/2265503099 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5948003530 con 0x7f59600ce4f0 2024-05-28T06:06:22.930 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f595fe00640 1 -- 172.21.15.122:0/2265503099 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3041699638 0 0) 0x7f5948003530 con 0x7f59600ce4f0 2024-05-28T06:06:22.930 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f595fe00640 1 -- 172.21.15.122:0/2265503099 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f596015e730 msgr2=0x7f596015ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:22.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f595fe00640 1 --2- 172.21.15.122:0/2265503099 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f596015e730 0x7f596015ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f595fe00640 1 -- 172.21.15.122:0/2265503099 >> v2:172.21.15.153:3300/0 conn(0x7f59600b58d0 msgr2=0x7f59600b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:22.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f595fe00640 1 --2- 172.21.15.122:0/2265503099 >> v2:172.21.15.153:3300/0 conn(0x7f59600b58d0 0x7f59600b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f595fe00640 1 -- 172.21.15.122:0/2265503099 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596015df30 con 0x7f59600ce4f0 2024-05-28T06:06:22.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f595fe00640 1 -- 172.21.15.122:0/2265503099 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f5954001680 con 0x7f59600ce4f0 2024-05-28T06:06:22.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f595fe00640 1 -- 172.21.15.122:0/2265503099 >> v1:172.21.15.122:6789/0 conn(0x7f59600ce4f0 legacy=0x7f59600ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:22.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f595fe00640 1 --2- 172.21.15.122:0/2265503099 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f596015e730 0x7f59480039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:22.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f595fe00640 1 --2- 172.21.15.122:0/2265503099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5948003f40 0x7f5948004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:22.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f595fe00640 1 --2- 172.21.15.122:0/2265503099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5948004d50 0x7f59480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:22.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f595fe00640 1 -- 172.21.15.122:0/2265503099 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f596015d970 con 0x7f5948004d50 2024-05-28T06:06:22.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f595fe00640 1 -- 172.21.15.122:0/2265503099 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f596015dc50 con 0x7f5948003f40 2024-05-28T06:06:22.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f595fe00640 1 -- 172.21.15.122:0/2265503099 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f594800ba20 con 0x7f596015e730 2024-05-28T06:06:22.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f5965600640 1 --2- 172.21.15.122:0/2265503099 >> v2:172.21.15.153:3300/0 conn(0x7f59600b58d0 0x7f59600b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:22.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f5966000640 1 --2- 172.21.15.122:0/2265503099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5948004d50 0x7f59480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:22.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f5964c00640 1 --2- 172.21.15.122:0/2265503099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5948003f40 0x7f5948004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:22.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f5965600640 1 --2- 172.21.15.122:0/2265503099 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f596015e730 0x7f59480039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:22.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f5966000640 1 -- 172.21.15.122:0/2265503099 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f596015e730 msgr2=0x7f59480039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:22.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f5966000640 1 --2- 172.21.15.122:0/2265503099 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f596015e730 0x7f59480039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f5966000640 1 -- 172.21.15.122:0/2265503099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5948003f40 msgr2=0x7f5948004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:22.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f5966000640 1 --2- 172.21.15.122:0/2265503099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5948003f40 0x7f5948004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.924+0000 7f5966000640 1 -- 172.21.15.122:0/2265503099 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5948003530 con 0x7f5948004d50 2024-05-28T06:06:22.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.928+0000 7f5966000640 1 --2- 172.21.15.122:0/2265503099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5948004d50 0x7f59480051d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5958009fc0 tx=0x7f595801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32cda4316a778238 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:22.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.928+0000 7f595fe00640 1 -- 172.21.15.122:0/2265503099 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59580b2070 con 0x7f5948004d50 2024-05-28T06:06:22.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.928+0000 7f595fe00640 1 -- 172.21.15.122:0/2265503099 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59580a5c90 con 0x7f5948004d50 2024-05-28T06:06:22.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.928+0000 7f595fe00640 1 -- 172.21.15.122:0/2265503099 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5958009c10 con 0x7f5948004d50 2024-05-28T06:06:22.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.928+0000 7f5968000640 1 -- 172.21.15.122:0/2265503099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5948004d50 msgr2=0x7f59480051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:22.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.928+0000 7f5968000640 1 --2- 172.21.15.122:0/2265503099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5948004d50 0x7f59480051d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5958009fc0 tx=0x7f595801cc80 comp rx=0 tx=0).stop 2024-05-28T06:06:22.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.928+0000 7f5966000640 1 -- 172.21.15.122:0/2265503099 reap_dead start 2024-05-28T06:06:22.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.928+0000 7f5968000640 1 -- 172.21.15.122:0/2265503099 shutdown_connections 2024-05-28T06:06:22.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.928+0000 7f5968000640 1 -- 172.21.15.122:0/2265503099 >> 172.21.15.122:0/2265503099 conn(0x7f596006bd90 msgr2=0x7f596006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:22.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.928+0000 7f5968000640 1 -- 172.21.15.122:0/2265503099 shutdown_connections 2024-05-28T06:06:22.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.928+0000 7f5968000640 1 -- 172.21.15.122:0/2265503099 wait complete. 2024-05-28T06:06:22.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f5968000640 1 Processor -- start 2024-05-28T06:06:22.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f5968000640 1 -- start start 2024-05-28T06:06:22.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f5968000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5948004d50 0x7f596013c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:22.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f5968000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f596015b940 0x7f5960138e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:22.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f5968000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f596015be90 0x7f596013e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:22.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f5968000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5960146260 con 0x7f5948004d50 2024-05-28T06:06:22.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f5968000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f596015d640 con 0x7f596015b940 2024-05-28T06:06:22.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f5968000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f596013c2d0 con 0x7f596015be90 2024-05-28T06:06:22.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f5965600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5948004d50 0x7f596013c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:22.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f5965600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5948004d50 0x7f596013c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51774/0 (socket says 172.21.15.122:51774) 2024-05-28T06:06:22.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f5965600640 1 -- 172.21.15.122:0/3264409925 learned_addr learned my addr 172.21.15.122:0/3264409925 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:22.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f5964c00640 1 --2- 172.21.15.122:0/3264409925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f596015b940 0x7f5960138e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:22.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f5966000640 1 --2- 172.21.15.122:0/3264409925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f596015be90 0x7f596013e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:22.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f5965600640 1 -- 172.21.15.122:0/3264409925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f596015be90 msgr2=0x7f596013e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:22.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f5965600640 1 --2- 172.21.15.122:0/3264409925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f596015be90 0x7f596013e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f5965600640 1 -- 172.21.15.122:0/3264409925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f596015b940 msgr2=0x7f5960138e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:22.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f5965600640 1 --2- 172.21.15.122:0/3264409925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f596015b940 0x7f5960138e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:22.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f5965600640 1 -- 172.21.15.122:0/3264409925 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59601393d0 con 0x7f5948004d50 2024-05-28T06:06:22.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f5965600640 1 --2- 172.21.15.122:0/3264409925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5948004d50 0x7f596013c760 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5950010810 tx=0x7f5950010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:22.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f595d600640 1 -- 172.21.15.122:0/3264409925 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595001a020 con 0x7f5948004d50 2024-05-28T06:06:22.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f595d600640 1 -- 172.21.15.122:0/3264409925 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f595000eb00 con 0x7f5948004d50 2024-05-28T06:06:22.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f595d600640 1 -- 172.21.15.122:0/3264409925 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595000f040 con 0x7f5948004d50 2024-05-28T06:06:22.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f5968000640 1 -- 172.21.15.122:0/3264409925 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f596013b6c0 con 0x7f5948004d50 2024-05-28T06:06:22.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f5968000640 1 -- 172.21.15.122:0/3264409925 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f596013bc80 con 0x7f5948004d50 2024-05-28T06:06:22.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.932+0000 7f5968000640 1 -- 172.21.15.122:0/3264409925 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5960068c40 con 0x7f5948004d50 2024-05-28T06:06:22.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.936+0000 7f595d600640 1 -- 172.21.15.122:0/3264409925 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f595001d020 con 0x7f5948004d50 2024-05-28T06:06:22.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.936+0000 7f595d600640 1 --2- 172.21.15.122:0/3264409925 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5944068380 0x7f594406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:22.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.936+0000 7f595d600640 1 -- 172.21.15.122:0/3264409925 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5950087430 con 0x7f5948004d50 2024-05-28T06:06:22.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.936+0000 7f5964c00640 1 --2- 172.21.15.122:0/3264409925 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5944068380 0x7f594406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:22.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.936+0000 7f5964c00640 1 --2- 172.21.15.122:0/3264409925 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5944068380 0x7f594406a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f596013e2d0 tx=0x7f5954009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:22.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:22.940+0000 7f595d600640 1 -- 172.21.15.122:0/3264409925 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5950024020 con 0x7f5948004d50 2024-05-28T06:06:23.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.096+0000 7f5968000640 1 -- 172.21.15.122:0/3264409925 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f59601425b0 con 0x7f5948004d50 2024-05-28T06:06:23.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.096+0000 7f595d600640 1 -- 172.21.15.122:0/3264409925 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f5950057950 con 0x7f5948004d50 2024-05-28T06:06:23.100 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 32 2024-05-28T06:06:23.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.096+0000 7f5968000640 1 -- 172.21.15.122:0/3264409925 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5944068380 msgr2=0x7f594406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:23.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.096+0000 7f5968000640 1 --2- 172.21.15.122:0/3264409925 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5944068380 0x7f594406a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f596013e2d0 tx=0x7f5954009040 comp rx=0 tx=0).stop 2024-05-28T06:06:23.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.096+0000 7f5968000640 1 -- 172.21.15.122:0/3264409925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5948004d50 msgr2=0x7f596013c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:23.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.096+0000 7f5968000640 1 --2- 172.21.15.122:0/3264409925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5948004d50 0x7f596013c760 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5950010810 tx=0x7f5950010cd0 comp rx=0 tx=0).stop 2024-05-28T06:06:23.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.096+0000 7f5968000640 1 -- 172.21.15.122:0/3264409925 shutdown_connections 2024-05-28T06:06:23.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.096+0000 7f5968000640 1 --2- 172.21.15.122:0/3264409925 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5944068380 0x7f594406a840 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:23.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.096+0000 7f5968000640 1 --2- 172.21.15.122:0/3264409925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f596015be90 0x7f596013e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:23.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.096+0000 7f5968000640 1 --2- 172.21.15.122:0/3264409925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f596015b940 0x7f5960138e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:23.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.096+0000 7f5968000640 1 --2- 172.21.15.122:0/3264409925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5948004d50 0x7f596013c760 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:23.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.096+0000 7f5968000640 1 -- 172.21.15.122:0/3264409925 >> 172.21.15.122:0/3264409925 conn(0x7f596006bd90 msgr2=0x7f5960074d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:23.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.096+0000 7f5968000640 1 -- 172.21.15.122:0/3264409925 shutdown_connections 2024-05-28T06:06:23.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.096+0000 7f5968000640 1 -- 172.21.15.122:0/3264409925 wait complete. 2024-05-28T06:06:23.121 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-28T06:06:23.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.256+0000 7efc39c00640 1 Processor -- start 2024-05-28T06:06:23.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.256+0000 7efc39c00640 1 -- start start 2024-05-28T06:06:23.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.256+0000 7efc39c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efc3415ea50 0x7efc3415ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:23.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.256+0000 7efc39c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc3406dab0 0x7efc340d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:23.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.256+0000 7efc39c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc34162510 con 0x7efc3415f370 2024-05-28T06:06:23.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.256+0000 7efc39c00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7efc34163120 con 0x7efc3415ea50 2024-05-28T06:06:23.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.256+0000 7efc39c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efc341627f0 con 0x7efc3406dab0 2024-05-28T06:06:23.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.256+0000 7efc32a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efc3415ea50 0x7efc3415ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:23.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.256+0000 7efc32000640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7efc3415f370 0x7efc3415f790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:54248/0 (socket says 172.21.15.122:54248) 2024-05-28T06:06:23.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.256+0000 7efc32000640 1 -- 172.21.15.122:0/4109087414 learned_addr learned my addr 172.21.15.122:0/4109087414 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:23.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.256+0000 7efc33400640 1 --2- 172.21.15.122:0/4109087414 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc3406dab0 0x7efc340d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:23.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.256+0000 7efc32a00640 1 -- 172.21.15.122:0/4109087414 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc3406dab0 msgr2=0x7efc340d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:23.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.256+0000 7efc32a00640 1 --2- 172.21.15.122:0/4109087414 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc3406dab0 0x7efc340d08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:23.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.256+0000 7efc32a00640 1 -- 172.21.15.122:0/4109087414 >> v1:172.21.15.122:6789/0 conn(0x7efc3415f370 legacy=0x7efc3415f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:23.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.256+0000 7efc32a00640 1 -- 172.21.15.122:0/4109087414 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc34162ad0 con 0x7efc3415ea50 2024-05-28T06:06:23.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.256+0000 7efc33400640 1 --2- 172.21.15.122:0/4109087414 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc3406dab0 0x7efc340d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:23.263 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.260+0000 7efc32a00640 1 --2- 172.21.15.122:0/4109087414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc3415ea50 0x7efc3415ee30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efc240097c0 tx=0x7efc2401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b88dd6e9ee03d65 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:23.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.260+0000 7efc31600640 1 -- 172.21.15.122:0/4109087414 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc240b2070 con 0x7efc3415ea50 2024-05-28T06:06:23.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.260+0000 7efc31600640 1 -- 172.21.15.122:0/4109087414 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc240ad640 con 0x7efc3415ea50 2024-05-28T06:06:23.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.260+0000 7efc31600640 1 -- 172.21.15.122:0/4109087414 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc240ada10 con 0x7efc3415ea50 2024-05-28T06:06:23.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.260+0000 7efc39c00640 1 -- 172.21.15.122:0/4109087414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc3415ea50 msgr2=0x7efc3415ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:23.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.260+0000 7efc39c00640 1 --2- 172.21.15.122:0/4109087414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc3415ea50 0x7efc3415ee30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efc240097c0 tx=0x7efc2401c470 comp rx=0 tx=0).stop 2024-05-28T06:06:23.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.260+0000 7efc39c00640 1 -- 172.21.15.122:0/4109087414 shutdown_connections 2024-05-28T06:06:23.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.260+0000 7efc39c00640 1 --2- 172.21.15.122:0/4109087414 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc3406dab0 0x7efc340d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:23.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.260+0000 7efc39c00640 1 --2- 172.21.15.122:0/4109087414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc3415ea50 0x7efc3415ee30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:23.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.260+0000 7efc39c00640 1 -- 172.21.15.122:0/4109087414 >> 172.21.15.122:0/4109087414 conn(0x7efc340b4190 msgr2=0x7efc340b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:23.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.260+0000 7efc39c00640 1 -- 172.21.15.122:0/4109087414 shutdown_connections 2024-05-28T06:06:23.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.260+0000 7efc39c00640 1 -- 172.21.15.122:0/4109087414 wait complete. 2024-05-28T06:06:23.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.260+0000 7efc39c00640 1 Processor -- start 2024-05-28T06:06:23.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.260+0000 7efc39c00640 1 -- start start 2024-05-28T06:06:23.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.264+0000 7efc39c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc3406dab0 0x7efc340b7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:23.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.264+0000 7efc39c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc3415ea50 0x7efc34150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:23.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.264+0000 7efc39c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc3415f370 0x7efc341549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:23.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.264+0000 7efc39c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efc340d19c0 con 0x7efc3415ea50 2024-05-28T06:06:23.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.264+0000 7efc39c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efc340d1840 con 0x7efc3415f370 2024-05-28T06:06:23.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.264+0000 7efc39c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efc340d1b40 con 0x7efc3406dab0 2024-05-28T06:06:23.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.264+0000 7efc32000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc3415ea50 0x7efc34150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:23.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.264+0000 7efc32000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc3415ea50 0x7efc34150230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51784/0 (socket says 172.21.15.122:51784) 2024-05-28T06:06:23.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.264+0000 7efc32000640 1 -- 172.21.15.122:0/2348893206 learned_addr learned my addr 172.21.15.122:0/2348893206 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:23.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.264+0000 7efc32000640 1 -- 172.21.15.122:0/2348893206 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc3406dab0 msgr2=0x7efc340b7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:23.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.264+0000 7efc32000640 1 --2- 172.21.15.122:0/2348893206 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc3406dab0 0x7efc340b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:23.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.264+0000 7efc32000640 1 -- 172.21.15.122:0/2348893206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc3415f370 msgr2=0x7efc341549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:23.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.264+0000 7efc32000640 1 --2- 172.21.15.122:0/2348893206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc3415f370 0x7efc341549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:23.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.264+0000 7efc32000640 1 -- 172.21.15.122:0/2348893206 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc340b66a0 con 0x7efc3415ea50 2024-05-28T06:06:23.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.264+0000 7efc32000640 1 --2- 172.21.15.122:0/2348893206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc3415ea50 0x7efc34150230 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efc2000c420 tx=0x7efc2000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:23.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.264+0000 7efc2aa00640 1 -- 172.21.15.122:0/2348893206 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc20017070 con 0x7efc3415ea50 2024-05-28T06:06:23.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.264+0000 7efc2aa00640 1 -- 172.21.15.122:0/2348893206 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc20005cf0 con 0x7efc3415ea50 2024-05-28T06:06:23.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.264+0000 7efc39c00640 1 -- 172.21.15.122:0/2348893206 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc340b6980 con 0x7efc3415ea50 2024-05-28T06:06:23.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.264+0000 7efc2aa00640 1 -- 172.21.15.122:0/2348893206 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc200072f0 con 0x7efc3415ea50 2024-05-28T06:06:23.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.264+0000 7efc39c00640 1 -- 172.21.15.122:0/2348893206 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc34150770 con 0x7efc3415ea50 2024-05-28T06:06:23.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.264+0000 7efc39c00640 1 -- 172.21.15.122:0/2348893206 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc34068c40 con 0x7efc3415ea50 2024-05-28T06:06:23.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.264+0000 7efc2aa00640 1 -- 172.21.15.122:0/2348893206 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efc2001a070 con 0x7efc3415ea50 2024-05-28T06:06:23.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.268+0000 7efc2aa00640 1 --2- 172.21.15.122:0/2348893206 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efc14068380 0x7efc1406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:23.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.268+0000 7efc2aa00640 1 -- 172.21.15.122:0/2348893206 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efc20085d90 con 0x7efc3415ea50 2024-05-28T06:06:23.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.268+0000 7efc32a00640 1 --2- 172.21.15.122:0/2348893206 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efc14068380 0x7efc1406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:23.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.268+0000 7efc32a00640 1 --2- 172.21.15.122:0/2348893206 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efc14068380 0x7efc1406a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efc240af000 tx=0x7efc24004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:23.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.272+0000 7efc2aa00640 1 -- 172.21.15.122:0/2348893206 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efc20056340 con 0x7efc3415ea50 2024-05-28T06:06:23.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.428+0000 7efc39c00640 1 -- 172.21.15.122:0/2348893206 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efc340b4b60 con 0x7efc3415ea50 2024-05-28T06:06:23.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.432+0000 7efc2aa00640 1 -- 172.21.15.122:0/2348893206 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7efc20055c40 con 0x7efc3415ea50 2024-05-28T06:06:23.435 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 64 2024-05-28T06:06:23.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.432+0000 7efc39c00640 1 -- 172.21.15.122:0/2348893206 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efc14068380 msgr2=0x7efc1406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:23.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.432+0000 7efc39c00640 1 --2- 172.21.15.122:0/2348893206 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efc14068380 0x7efc1406a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efc240af000 tx=0x7efc24004740 comp rx=0 tx=0).stop 2024-05-28T06:06:23.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.432+0000 7efc39c00640 1 -- 172.21.15.122:0/2348893206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc3415ea50 msgr2=0x7efc34150230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:23.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.432+0000 7efc39c00640 1 --2- 172.21.15.122:0/2348893206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc3415ea50 0x7efc34150230 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efc2000c420 tx=0x7efc2000c8e0 comp rx=0 tx=0).stop 2024-05-28T06:06:23.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.432+0000 7efc39c00640 1 -- 172.21.15.122:0/2348893206 shutdown_connections 2024-05-28T06:06:23.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.432+0000 7efc39c00640 1 --2- 172.21.15.122:0/2348893206 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efc14068380 0x7efc1406a840 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:23.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.432+0000 7efc39c00640 1 --2- 172.21.15.122:0/2348893206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc3415f370 0x7efc341549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:23.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.432+0000 7efc39c00640 1 --2- 172.21.15.122:0/2348893206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc3415ea50 0x7efc34150230 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:23.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.432+0000 7efc39c00640 1 --2- 172.21.15.122:0/2348893206 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc3406dab0 0x7efc340b7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:23.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.432+0000 7efc39c00640 1 -- 172.21.15.122:0/2348893206 >> 172.21.15.122:0/2348893206 conn(0x7efc340b4190 msgr2=0x7efc34156670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:23.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.432+0000 7efc39c00640 1 -- 172.21.15.122:0/2348893206 shutdown_connections 2024-05-28T06:06:23.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.432+0000 7efc39c00640 1 -- 172.21.15.122:0/2348893206 wait complete. 2024-05-28T06:06:23.456 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-28T06:06:23.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.588+0000 7fd2fea00640 1 Processor -- start 2024-05-28T06:06:23.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.588+0000 7fd2fea00640 1 -- start start 2024-05-28T06:06:23.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.588+0000 7fd2fea00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd2f80cec70 0x7fd2f8146010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:23.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.588+0000 7fd2fea00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f806f7e0 con 0x7fd2f8145b80 2024-05-28T06:06:23.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.588+0000 7fd2fea00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f806e030 con 0x7fd2f8142d30 2024-05-28T06:06:23.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.588+0000 7fd2fea00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd2f806ec40 con 0x7fd2f80cec70 2024-05-28T06:06:23.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.592+0000 7fd2ef400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fd2f8145b80 0x7fd2f80ce560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:54256/0 (socket says 172.21.15.122:54256) 2024-05-28T06:06:23.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.592+0000 7fd2ef400640 1 -- 172.21.15.122:0/3239336841 learned_addr learned my addr 172.21.15.122:0/3239336841 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:23.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.592+0000 7fd2fca00640 1 --2- 172.21.15.122:0/3239336841 >> v2:172.21.15.153:3300/0 conn(0x7fd2f80cec70 0x7fd2f8146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:23.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.592+0000 7fd2f7400640 1 -- 172.21.15.122:0/3239336841 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2424290991 0 0) 0x7fd2f806f7e0 con 0x7fd2f8145b80 2024-05-28T06:06:23.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.592+0000 7fd2f7400640 1 -- 172.21.15.122:0/3239336841 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2dc003530 con 0x7fd2f8145b80 2024-05-28T06:06:23.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.592+0000 7fd2fca00640 1 -- 172.21.15.122:0/3239336841 >> v1:172.21.15.153:6789/0 conn(0x7fd2f8142d30 legacy=0x7fd2f806f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:23.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.592+0000 7fd2fca00640 1 -- 172.21.15.122:0/3239336841 >> v1:172.21.15.122:6789/0 conn(0x7fd2f8145b80 legacy=0x7fd2f80ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:23.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.592+0000 7fd2fca00640 1 -- 172.21.15.122:0/3239336841 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f806e310 con 0x7fd2f80cec70 2024-05-28T06:06:23.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.592+0000 7fd2fca00640 1 --2- 172.21.15.122:0/3239336841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2f80cec70 0x7fd2f8146010 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009d90 tx=0x7fd2f001c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94184d503e98ee39 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:23.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.592+0000 7fd2f7400640 1 -- 172.21.15.122:0/3239336841 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f00b2070 con 0x7fd2f80cec70 2024-05-28T06:06:23.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2f7400640 1 -- 172.21.15.122:0/3239336841 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2f00a5970 con 0x7fd2f80cec70 2024-05-28T06:06:23.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2f7400640 1 -- 172.21.15.122:0/3239336841 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f00a5d20 con 0x7fd2f80cec70 2024-05-28T06:06:23.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2fea00640 1 -- 172.21.15.122:0/3239336841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2f80cec70 msgr2=0x7fd2f8146010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:23.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2fea00640 1 --2- 172.21.15.122:0/3239336841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2f80cec70 0x7fd2f8146010 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009d90 tx=0x7fd2f001c8b0 comp rx=0 tx=0).stop 2024-05-28T06:06:23.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2fea00640 1 -- 172.21.15.122:0/3239336841 shutdown_connections 2024-05-28T06:06:23.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2fea00640 1 --2- 172.21.15.122:0/3239336841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2f80cec70 0x7fd2f8146010 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:23.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2fea00640 1 -- 172.21.15.122:0/3239336841 >> 172.21.15.122:0/3239336841 conn(0x7fd2f8062a40 msgr2=0x7fd2f806b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:23.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2fea00640 1 -- 172.21.15.122:0/3239336841 shutdown_connections 2024-05-28T06:06:23.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2fea00640 1 -- 172.21.15.122:0/3239336841 wait complete. 2024-05-28T06:06:23.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2fea00640 1 Processor -- start 2024-05-28T06:06:23.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2fea00640 1 -- start start 2024-05-28T06:06:23.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2fea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2f80cec70 0x7fd2f8139690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:23.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2fea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2f8142d30 0x7fd2f815d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:23.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2fea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2f8145b80 0x7fd2f813ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:23.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2fea00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f8143290 con 0x7fd2f80cec70 2024-05-28T06:06:23.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2fea00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f8143110 con 0x7fd2f8142d30 2024-05-28T06:06:23.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2fea00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd2f816a840 con 0x7fd2f8145b80 2024-05-28T06:06:23.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2f7e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2f80cec70 0x7fd2f8139690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:23.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2f7e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2f80cec70 0x7fd2f8139690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51792/0 (socket says 172.21.15.122:51792) 2024-05-28T06:06:23.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2f7e00640 1 -- 172.21.15.122:0/1650602378 learned_addr learned my addr 172.21.15.122:0/1650602378 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:23.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2ef400640 1 --2- 172.21.15.122:0/1650602378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2f8142d30 0x7fd2f815d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:23.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2fca00640 1 --2- 172.21.15.122:0/1650602378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2f8145b80 0x7fd2f813ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:23.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2f7e00640 1 -- 172.21.15.122:0/1650602378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2f8145b80 msgr2=0x7fd2f813ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:23.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2f7e00640 1 --2- 172.21.15.122:0/1650602378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2f8145b80 0x7fd2f813ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:23.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2f7e00640 1 -- 172.21.15.122:0/1650602378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2f8142d30 msgr2=0x7fd2f815d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:23.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2f7e00640 1 --2- 172.21.15.122:0/1650602378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2f8142d30 0x7fd2f815d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:23.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2f7e00640 1 -- 172.21.15.122:0/1650602378 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f815dc80 con 0x7fd2f80cec70 2024-05-28T06:06:23.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2fca00640 1 --2- 172.21.15.122:0/1650602378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2f8145b80 0x7fd2f813ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:23.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.596+0000 7fd2ef400640 1 --2- 172.21.15.122:0/1650602378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2f8142d30 0x7fd2f815d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:23.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.600+0000 7fd2f7e00640 1 --2- 172.21.15.122:0/1650602378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2f80cec70 0x7fd2f8139690 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd2e800c450 tx=0x7fd2e800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:23.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.600+0000 7fd2f4c00640 1 -- 172.21.15.122:0/1650602378 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8016020 con 0x7fd2f80cec70 2024-05-28T06:06:23.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.600+0000 7fd2f4c00640 1 -- 172.21.15.122:0/1650602378 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e80052d0 con 0x7fd2f80cec70 2024-05-28T06:06:23.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.600+0000 7fd2f4c00640 1 -- 172.21.15.122:0/1650602378 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8007260 con 0x7fd2f80cec70 2024-05-28T06:06:23.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.600+0000 7fd2fea00640 1 -- 172.21.15.122:0/1650602378 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f815df60 con 0x7fd2f80cec70 2024-05-28T06:06:23.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.600+0000 7fd2fea00640 1 -- 172.21.15.122:0/1650602378 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f815e520 con 0x7fd2f80cec70 2024-05-28T06:06:23.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.600+0000 7fd2fea00640 1 -- 172.21.15.122:0/1650602378 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2f8068bd0 con 0x7fd2f80cec70 2024-05-28T06:06:23.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.600+0000 7fd2f4c00640 1 -- 172.21.15.122:0/1650602378 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd2e8007400 con 0x7fd2f80cec70 2024-05-28T06:06:23.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.604+0000 7fd2f4c00640 1 --2- 172.21.15.122:0/1650602378 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd2d4068380 0x7fd2d406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:23.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.604+0000 7fd2f4c00640 1 -- 172.21.15.122:0/1650602378 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd2e80863b0 con 0x7fd2f80cec70 2024-05-28T06:06:23.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.604+0000 7fd2ef400640 1 --2- 172.21.15.122:0/1650602378 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd2d4068380 0x7fd2d406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:23.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.604+0000 7fd2ef400640 1 --2- 172.21.15.122:0/1650602378 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd2d4068380 0x7fd2d406a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd2f815b8c0 tx=0x7fd2e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:23.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.608+0000 7fd2f4c00640 1 -- 172.21.15.122:0/1650602378 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd2e8020020 con 0x7fd2f80cec70 2024-05-28T06:06:23.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.780+0000 7fd2fea00640 1 -- 172.21.15.122:0/1650602378 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd2f8144980 con 0x7fd2f80cec70 2024-05-28T06:06:23.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.780+0000 7fd2f4c00640 1 -- 172.21.15.122:0/1650602378 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fd2e8005480 con 0x7fd2f80cec70 2024-05-28T06:06:23.784 INFO:teuthology.orchestra.run.smithi122.stderr:listed 0 entries 2024-05-28T06:06:23.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.780+0000 7fd2fea00640 1 -- 172.21.15.122:0/1650602378 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd2d4068380 msgr2=0x7fd2d406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:23.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.780+0000 7fd2fea00640 1 --2- 172.21.15.122:0/1650602378 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd2d4068380 0x7fd2d406a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd2f815b8c0 tx=0x7fd2e0009040 comp rx=0 tx=0).stop 2024-05-28T06:06:23.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.780+0000 7fd2fea00640 1 -- 172.21.15.122:0/1650602378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2f80cec70 msgr2=0x7fd2f8139690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:23.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.780+0000 7fd2fea00640 1 --2- 172.21.15.122:0/1650602378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2f80cec70 0x7fd2f8139690 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd2e800c450 tx=0x7fd2e800c910 comp rx=0 tx=0).stop 2024-05-28T06:06:23.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.780+0000 7fd2fea00640 1 -- 172.21.15.122:0/1650602378 shutdown_connections 2024-05-28T06:06:23.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.780+0000 7fd2fea00640 1 --2- 172.21.15.122:0/1650602378 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd2d4068380 0x7fd2d406a840 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:23.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.780+0000 7fd2fea00640 1 --2- 172.21.15.122:0/1650602378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd2f8145b80 0x7fd2f813ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:23.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.780+0000 7fd2fea00640 1 --2- 172.21.15.122:0/1650602378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2f8142d30 0x7fd2f815d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:23.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.780+0000 7fd2fea00640 1 --2- 172.21.15.122:0/1650602378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2f80cec70 0x7fd2f8139690 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:23.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.780+0000 7fd2fea00640 1 -- 172.21.15.122:0/1650602378 >> 172.21.15.122:0/1650602378 conn(0x7fd2f8062a40 msgr2=0x7fd2f80b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:23.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.780+0000 7fd2fea00640 1 -- 172.21.15.122:0/1650602378 shutdown_connections 2024-05-28T06:06:23.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:23.780+0000 7fd2fea00640 1 -- 172.21.15.122:0/1650602378 wait complete. 2024-05-28T06:06:23.805 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-28T06:06:23.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:23.805 DEBUG:teuthology.orchestra.run.smithi122:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-05-28T06:06:23.835 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2024-05-28T06:06:23.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:23.835 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-28T06:06:23.894 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:06:23.894 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:06:23.903 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:06:23.903 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:06:23.960 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:06:23.960 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:06:24.012 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:06:24.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.144+0000 7fd76c400640 1 Processor -- start 2024-05-28T06:06:24.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.144+0000 7fd76c400640 1 -- start start 2024-05-28T06:06:24.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.144+0000 7fd76c400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7640d0270 0x7fd76409b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:24.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.144+0000 7fd76c400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd76415d7e0 0x7fd7640cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:24.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.144+0000 7fd76c400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd76415dc70 con 0x7fd7640d0c80 2024-05-28T06:06:24.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.144+0000 7fd76c400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd7640d0830 con 0x7fd76415d7e0 2024-05-28T06:06:24.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.144+0000 7fd76c400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd76409aa40 con 0x7fd7640d0270 2024-05-28T06:06:24.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.144+0000 7fd76a400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd76415d7e0 0x7fd7640cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:24.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.144+0000 7fd769000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7640d0270 0x7fd76409b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:24.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.144+0000 7fd76a400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd76415d7e0 0x7fd7640cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:47968/0 (socket says 172.21.15.122:47968) 2024-05-28T06:06:24.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.144+0000 7fd76a400640 1 -- 172.21.15.122:0/984421355 learned_addr learned my addr 172.21.15.122:0/984421355 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:24.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.144+0000 7fd769a00640 1 --1- 172.21.15.122:0/984421355 >> v1:172.21.15.153:6789/0 conn(0x7fd7640d0c80 0x7fd7640d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:38966/0 (socket says 172.21.15.122:38966) 2024-05-28T06:06:24.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.144+0000 7fd76a400640 1 -- 172.21.15.122:0/984421355 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7640d0270 msgr2=0x7fd76409b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:24.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.144+0000 7fd76a400640 1 --2- 172.21.15.122:0/984421355 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7640d0270 0x7fd76409b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.144+0000 7fd76a400640 1 -- 172.21.15.122:0/984421355 >> v1:172.21.15.153:6789/0 conn(0x7fd7640d0c80 legacy=0x7fd7640d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:24.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.144+0000 7fd76a400640 1 -- 172.21.15.122:0/984421355 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76409ad20 con 0x7fd76415d7e0 2024-05-28T06:06:24.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.148+0000 7fd76a400640 1 --2- 172.21.15.122:0/984421355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd76415d7e0 0x7fd7640cd1b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009e50 tx=0x7fd75c01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=874e70b0c0593ada server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:24.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.148+0000 7fd763e00640 1 -- 172.21.15.122:0/984421355 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c0a5740 con 0x7fd76415d7e0 2024-05-28T06:06:24.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.148+0000 7fd763e00640 1 -- 172.21.15.122:0/984421355 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd75c0a58e0 con 0x7fd76415d7e0 2024-05-28T06:06:24.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.148+0000 7fd763e00640 1 -- 172.21.15.122:0/984421355 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c0a5cb0 con 0x7fd76415d7e0 2024-05-28T06:06:24.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.148+0000 7fd76c400640 1 -- 172.21.15.122:0/984421355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd76415d7e0 msgr2=0x7fd7640cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:24.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.148+0000 7fd76c400640 1 --2- 172.21.15.122:0/984421355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd76415d7e0 0x7fd7640cd1b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009e50 tx=0x7fd75c01c970 comp rx=0 tx=0).stop 2024-05-28T06:06:24.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.148+0000 7fd76c400640 1 -- 172.21.15.122:0/984421355 shutdown_connections 2024-05-28T06:06:24.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.148+0000 7fd76c400640 1 --2- 172.21.15.122:0/984421355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd76415d7e0 0x7fd7640cd1b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.148+0000 7fd76c400640 1 --2- 172.21.15.122:0/984421355 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7640d0270 0x7fd76409b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.148+0000 7fd76c400640 1 -- 172.21.15.122:0/984421355 >> 172.21.15.122:0/984421355 conn(0x7fd7640b4190 msgr2=0x7fd7640b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:24.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.148+0000 7fd76c400640 1 -- 172.21.15.122:0/984421355 shutdown_connections 2024-05-28T06:06:24.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.148+0000 7fd76c400640 1 -- 172.21.15.122:0/984421355 wait complete. 2024-05-28T06:06:24.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd76c400640 1 Processor -- start 2024-05-28T06:06:24.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd76c400640 1 -- start start 2024-05-28T06:06:24.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd76c400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7640d0270 0x7fd76415bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:24.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd76c400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7640d0c80 0x7fd7640c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:24.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd76c400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd76415d7e0 0x7fd7641faac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:24.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd76c400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd7641697c0 con 0x7fd7640d0270 2024-05-28T06:06:24.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd76c400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd764169640 con 0x7fd76415d7e0 2024-05-28T06:06:24.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd76c400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd764169940 con 0x7fd7640d0c80 2024-05-28T06:06:24.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd769a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7640d0270 0x7fd76415bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:24.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd769a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7640d0270 0x7fd76415bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51808/0 (socket says 172.21.15.122:51808) 2024-05-28T06:06:24.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd769a00640 1 -- 172.21.15.122:0/2930973437 learned_addr learned my addr 172.21.15.122:0/2930973437 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:24.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd769000640 1 --2- 172.21.15.122:0/2930973437 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7640d0c80 0x7fd7640c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:24.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd76a400640 1 --2- 172.21.15.122:0/2930973437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd76415d7e0 0x7fd7641faac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:24.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd769a00640 1 -- 172.21.15.122:0/2930973437 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7640d0c80 msgr2=0x7fd7640c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:24.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd769a00640 1 --2- 172.21.15.122:0/2930973437 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7640d0c80 0x7fd7640c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd769a00640 1 -- 172.21.15.122:0/2930973437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd76415d7e0 msgr2=0x7fd7641faac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:24.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd769a00640 1 --2- 172.21.15.122:0/2930973437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd76415d7e0 0x7fd7641faac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd769a00640 1 -- 172.21.15.122:0/2930973437 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7640c7820 con 0x7fd7640d0270 2024-05-28T06:06:24.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd769000640 1 --2- 172.21.15.122:0/2930973437 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7640d0c80 0x7fd7640c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:24.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd769a00640 1 --2- 172.21.15.122:0/2930973437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7640d0270 0x7fd76415bd90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd75800c370 tx=0x7fd75800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:24.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd761600640 1 -- 172.21.15.122:0/2930973437 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7580074e0 con 0x7fd7640d0270 2024-05-28T06:06:24.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd761600640 1 -- 172.21.15.122:0/2930973437 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd758007680 con 0x7fd7640d0270 2024-05-28T06:06:24.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd76c400640 1 -- 172.21.15.122:0/2930973437 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd764153420 con 0x7fd7640d0270 2024-05-28T06:06:24.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd761600640 1 -- 172.21.15.122:0/2930973437 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd758004a30 con 0x7fd7640d0270 2024-05-28T06:06:24.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.152+0000 7fd76c400640 1 -- 172.21.15.122:0/2930973437 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd76415b590 con 0x7fd7640d0270 2024-05-28T06:06:24.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.156+0000 7fd76c400640 1 -- 172.21.15.122:0/2930973437 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd76415b8c0 con 0x7fd7640d0270 2024-05-28T06:06:24.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.156+0000 7fd761600640 1 -- 172.21.15.122:0/2930973437 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd75801a020 con 0x7fd7640d0270 2024-05-28T06:06:24.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.156+0000 7fd761600640 1 --2- 172.21.15.122:0/2930973437 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd7440683b0 0x7fd74406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:24.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.156+0000 7fd761600640 1 -- 172.21.15.122:0/2930973437 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd758086140 con 0x7fd7640d0270 2024-05-28T06:06:24.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.156+0000 7fd769000640 1 --2- 172.21.15.122:0/2930973437 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd7440683b0 0x7fd74406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:24.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.156+0000 7fd769000640 1 --2- 172.21.15.122:0/2930973437 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd7440683b0 0x7fd74406a870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd764161370 tx=0x7fd750008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:24.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.160+0000 7fd761600640 1 -- 172.21.15.122:0/2930973437 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd758056660 con 0x7fd7640d0270 2024-05-28T06:06:24.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.320+0000 7fd76c400640 1 -- 172.21.15.122:0/2930973437 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd764068c40 con 0x7fd7640d0270 2024-05-28T06:06:24.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.320+0000 7fd761600640 1 -- 172.21.15.122:0/2930973437 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fd758055f60 con 0x7fd7640d0270 2024-05-28T06:06:24.325 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:24.326 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":20,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:05:50.822555+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:05:47.441193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-28T06:05:48.148164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:06:24.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.324+0000 7fd76c400640 1 -- 172.21.15.122:0/2930973437 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd7440683b0 msgr2=0x7fd74406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:24.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.324+0000 7fd76c400640 1 --2- 172.21.15.122:0/2930973437 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd7440683b0 0x7fd74406a870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd764161370 tx=0x7fd750008040 comp rx=0 tx=0).stop 2024-05-28T06:06:24.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.324+0000 7fd76c400640 1 -- 172.21.15.122:0/2930973437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7640d0270 msgr2=0x7fd76415bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:24.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.324+0000 7fd76c400640 1 --2- 172.21.15.122:0/2930973437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7640d0270 0x7fd76415bd90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd75800c370 tx=0x7fd75800c830 comp rx=0 tx=0).stop 2024-05-28T06:06:24.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.324+0000 7fd76c400640 1 -- 172.21.15.122:0/2930973437 shutdown_connections 2024-05-28T06:06:24.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.324+0000 7fd76c400640 1 --2- 172.21.15.122:0/2930973437 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd7440683b0 0x7fd74406a870 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.324+0000 7fd76c400640 1 --2- 172.21.15.122:0/2930973437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd76415d7e0 0x7fd7641faac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.324+0000 7fd76c400640 1 --2- 172.21.15.122:0/2930973437 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd7640d0c80 0x7fd7640c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.324+0000 7fd76c400640 1 --2- 172.21.15.122:0/2930973437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7640d0270 0x7fd76415bd90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.324+0000 7fd76c400640 1 -- 172.21.15.122:0/2930973437 >> 172.21.15.122:0/2930973437 conn(0x7fd7640b4190 msgr2=0x7fd7640c6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:24.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.324+0000 7fd76c400640 1 -- 172.21.15.122:0/2930973437 shutdown_connections 2024-05-28T06:06:24.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.324+0000 7fd76c400640 1 -- 172.21.15.122:0/2930973437 wait complete. 2024-05-28T06:06:24.346 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-28T06:05:47.441193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-28T06:05:48.148164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:06:24.347 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:06:24.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.484+0000 7f854fc00640 1 Processor -- start 2024-05-28T06:06:24.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.484+0000 7f854fc00640 1 -- start start 2024-05-28T06:06:24.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.484+0000 7f854fc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85480aff60 0x7f854815d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:24.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.484+0000 7f854fc00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f854806cbd0 0x7f854806e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:24.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.484+0000 7f854fc00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f854815db50 con 0x7f85480add80 2024-05-28T06:06:24.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.484+0000 7f854fc00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f854806bb30 con 0x7f854806cbd0 2024-05-28T06:06:24.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.484+0000 7f854fc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f854806be10 con 0x7f85480aff60 2024-05-28T06:06:24.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.484+0000 7f854d200640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f85480add80 0x7f85480ae160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:54266/0 (socket says 172.21.15.122:54266) 2024-05-28T06:06:24.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.484+0000 7f854d200640 1 -- 172.21.15.122:0/3755618345 learned_addr learned my addr 172.21.15.122:0/3755618345 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:24.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.484+0000 7f854dc00640 1 --2- 172.21.15.122:0/3755618345 >> v2:172.21.15.122:3300/0 conn(0x7f854806cbd0 0x7f854806e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:24.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.484+0000 7f854dc00640 1 -- 172.21.15.122:0/3755618345 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85480aff60 msgr2=0x7f854815d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:24.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.484+0000 7f8547e00640 1 --2- 172.21.15.122:0/3755618345 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85480aff60 0x7f854815d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:24.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.484+0000 7f854dc00640 1 --2- 172.21.15.122:0/3755618345 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85480aff60 0x7f854815d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.484+0000 7f8547400640 1 -- 172.21.15.122:0/3755618345 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3067519601 0 0) 0x7f854815db50 con 0x7f85480add80 2024-05-28T06:06:24.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.484+0000 7f854dc00640 1 -- 172.21.15.122:0/3755618345 >> v1:172.21.15.122:6789/0 conn(0x7f85480add80 legacy=0x7f85480ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:24.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.484+0000 7f854dc00640 1 -- 172.21.15.122:0/3755618345 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854806c0f0 con 0x7f854806cbd0 2024-05-28T06:06:24.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.484+0000 7f8547e00640 1 --2- 172.21.15.122:0/3755618345 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85480aff60 0x7f854815d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:24.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.488+0000 7f854dc00640 1 --2- 172.21.15.122:0/3755618345 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f854806cbd0 0x7f854806e6c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8540009d90 tx=0x7f854001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8609fe9cdc3003c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:24.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.488+0000 7f8547400640 1 -- 172.21.15.122:0/3755618345 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85400b2070 con 0x7f854806cbd0 2024-05-28T06:06:24.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.488+0000 7f8547400640 1 -- 172.21.15.122:0/3755618345 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85400a5890 con 0x7f854806cbd0 2024-05-28T06:06:24.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.488+0000 7f8547400640 1 -- 172.21.15.122:0/3755618345 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85400a5c60 con 0x7f854806cbd0 2024-05-28T06:06:24.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.488+0000 7f854fc00640 1 -- 172.21.15.122:0/3755618345 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f854806cbd0 msgr2=0x7f854806e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:24.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.488+0000 7f854fc00640 1 --2- 172.21.15.122:0/3755618345 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f854806cbd0 0x7f854806e6c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8540009d90 tx=0x7f854001c8e0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.488+0000 7f854fc00640 1 -- 172.21.15.122:0/3755618345 shutdown_connections 2024-05-28T06:06:24.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.488+0000 7f854fc00640 1 --2- 172.21.15.122:0/3755618345 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f854806cbd0 0x7f854806e6c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.488+0000 7f854fc00640 1 --2- 172.21.15.122:0/3755618345 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85480aff60 0x7f854815d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.488+0000 7f854fc00640 1 -- 172.21.15.122:0/3755618345 >> 172.21.15.122:0/3755618345 conn(0x7f85480b3130 msgr2=0x7f85480d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:24.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.488+0000 7f854fc00640 1 -- 172.21.15.122:0/3755618345 shutdown_connections 2024-05-28T06:06:24.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.488+0000 7f854fc00640 1 -- 172.21.15.122:0/3755618345 wait complete. 2024-05-28T06:06:24.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.488+0000 7f854fc00640 1 Processor -- start 2024-05-28T06:06:24.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f854fc00640 1 -- start start 2024-05-28T06:06:24.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f854fc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f854806cbd0 0x7f8548159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:24.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f854fc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85480add80 0x7f8548157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:24.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f854fc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85480aff60 0x7f8548166d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:24.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f854fc00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f85481570e0 con 0x7f85480add80 2024-05-28T06:06:24.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f854fc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8548156f60 con 0x7f854806cbd0 2024-05-28T06:06:24.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f854fc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8548169d80 con 0x7f85480aff60 2024-05-28T06:06:24.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f8547e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85480add80 0x7f8548157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:24.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f8547e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85480add80 0x7f8548157920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51824/0 (socket says 172.21.15.122:51824) 2024-05-28T06:06:24.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f8547e00640 1 -- 172.21.15.122:0/1807776093 learned_addr learned my addr 172.21.15.122:0/1807776093 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:24.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f854dc00640 1 --2- 172.21.15.122:0/1807776093 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85480aff60 0x7f8548166d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:24.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f854d200640 1 --2- 172.21.15.122:0/1807776093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f854806cbd0 0x7f8548159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:24.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f8547e00640 1 -- 172.21.15.122:0/1807776093 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85480aff60 msgr2=0x7f8548166d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:24.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f8547e00640 1 --2- 172.21.15.122:0/1807776093 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85480aff60 0x7f8548166d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f8547e00640 1 -- 172.21.15.122:0/1807776093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f854806cbd0 msgr2=0x7f8548159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:24.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f8547e00640 1 --2- 172.21.15.122:0/1807776093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f854806cbd0 0x7f8548159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f8547e00640 1 -- 172.21.15.122:0/1807776093 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85481f78d0 con 0x7f85480add80 2024-05-28T06:06:24.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f8547e00640 1 --2- 172.21.15.122:0/1807776093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85480add80 0x7f8548157920 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f853400c820 tx=0x7f853400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:24.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f8544c00640 1 -- 172.21.15.122:0/1807776093 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8534015070 con 0x7f85480add80 2024-05-28T06:06:24.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f8544c00640 1 -- 172.21.15.122:0/1807776093 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8534007a30 con 0x7f85480add80 2024-05-28T06:06:24.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f8544c00640 1 -- 172.21.15.122:0/1807776093 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8534007e40 con 0x7f85480add80 2024-05-28T06:06:24.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f854fc00640 1 -- 172.21.15.122:0/1807776093 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85481672a0 con 0x7f85480add80 2024-05-28T06:06:24.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f854fc00640 1 -- 172.21.15.122:0/1807776093 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8548159bb0 con 0x7f85480add80 2024-05-28T06:06:24.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.492+0000 7f854fc00640 1 -- 172.21.15.122:0/1807776093 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8548068c40 con 0x7f85480add80 2024-05-28T06:06:24.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.496+0000 7f8544c00640 1 -- 172.21.15.122:0/1807776093 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8534018070 con 0x7f85480add80 2024-05-28T06:06:24.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.496+0000 7f8544c00640 1 --2- 172.21.15.122:0/1807776093 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8528068380 0x7f852806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:24.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.496+0000 7f8544c00640 1 -- 172.21.15.122:0/1807776093 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8534086890 con 0x7f85480add80 2024-05-28T06:06:24.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.496+0000 7f854d200640 1 --2- 172.21.15.122:0/1807776093 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8528068380 0x7f852806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:24.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.496+0000 7f854d200640 1 --2- 172.21.15.122:0/1807776093 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8528068380 0x7f852806a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f853c000f70 tx=0x7f853c007df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:24.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.500+0000 7f8544c00640 1 -- 172.21.15.122:0/1807776093 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8534056760 con 0x7f85480add80 2024-05-28T06:06:24.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.660+0000 7f854fc00640 1 -- 172.21.15.122:0/1807776093 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f85480d17e0 con 0x7f85480add80 2024-05-28T06:06:24.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.660+0000 7f8544c00640 1 -- 172.21.15.122:0/1807776093 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f853405aa60 con 0x7f85480add80 2024-05-28T06:06:24.665 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:06:24.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.660+0000 7f854fc00640 1 -- 172.21.15.122:0/1807776093 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8528068380 msgr2=0x7f852806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:24.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.660+0000 7f854fc00640 1 --2- 172.21.15.122:0/1807776093 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8528068380 0x7f852806a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f853c000f70 tx=0x7f853c007df0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.660+0000 7f854fc00640 1 -- 172.21.15.122:0/1807776093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85480add80 msgr2=0x7f8548157920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:24.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.660+0000 7f854fc00640 1 --2- 172.21.15.122:0/1807776093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85480add80 0x7f8548157920 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f853400c820 tx=0x7f853400cce0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.660+0000 7f854fc00640 1 -- 172.21.15.122:0/1807776093 shutdown_connections 2024-05-28T06:06:24.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.660+0000 7f854fc00640 1 --2- 172.21.15.122:0/1807776093 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8528068380 0x7f852806a840 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.660+0000 7f854fc00640 1 --2- 172.21.15.122:0/1807776093 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85480aff60 0x7f8548166d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.660+0000 7f854fc00640 1 --2- 172.21.15.122:0/1807776093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85480add80 0x7f8548157920 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.660+0000 7f854fc00640 1 --2- 172.21.15.122:0/1807776093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f854806cbd0 0x7f8548159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.660+0000 7f854fc00640 1 -- 172.21.15.122:0/1807776093 >> 172.21.15.122:0/1807776093 conn(0x7f85480b3130 msgr2=0x7f854815f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:24.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.660+0000 7f854fc00640 1 -- 172.21.15.122:0/1807776093 shutdown_connections 2024-05-28T06:06:24.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.664+0000 7f854fc00640 1 -- 172.21.15.122:0/1807776093 wait complete. 2024-05-28T06:06:24.687 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-28T06:06:24.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.820+0000 7fdfb5e00640 1 Processor -- start 2024-05-28T06:06:24.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.820+0000 7fdfb5e00640 1 -- start start 2024-05-28T06:06:24.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.820+0000 7fdfb5e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdfb00b58d0 0x7fdfb00b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:24.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.820+0000 7fdfb5e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdfb015e730 0x7fdfb015ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:24.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.820+0000 7fdfb5e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfb00b61f0 con 0x7fdfb00ce4f0 2024-05-28T06:06:24.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.820+0000 7fdfb5e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fdfb015d970 con 0x7fdfb00b58d0 2024-05-28T06:06:24.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.820+0000 7fdfb5e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb015dc50 con 0x7fdfb015e730 2024-05-28T06:06:24.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.824+0000 7fdfaea00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdfb00b58d0 0x7fdfb00b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:24.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.824+0000 7fdfaf400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdfb015e730 0x7fdfb015ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:24.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.824+0000 7fdfaea00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdfb00b58d0 0x7fdfb00b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:47998/0 (socket says 172.21.15.122:47998) 2024-05-28T06:06:24.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.824+0000 7fdfaea00640 1 -- 172.21.15.122:0/299118611 learned_addr learned my addr 172.21.15.122:0/299118611 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:24.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.824+0000 7fdfaea00640 1 -- 172.21.15.122:0/299118611 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdfb015e730 msgr2=0x7fdfb015ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:24.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.824+0000 7fdfaea00640 1 --2- 172.21.15.122:0/299118611 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdfb015e730 0x7fdfb015ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.824+0000 7fdfaea00640 1 -- 172.21.15.122:0/299118611 >> v1:172.21.15.153:6789/0 conn(0x7fdfb00ce4f0 legacy=0x7fdfb00ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:24.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.824+0000 7fdfaea00640 1 -- 172.21.15.122:0/299118611 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb015df30 con 0x7fdfb00b58d0 2024-05-28T06:06:24.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.824+0000 7fdfaf400640 1 --2- 172.21.15.122:0/299118611 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdfb015e730 0x7fdfb015ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:06:24.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.824+0000 7fdfaea00640 1 --2- 172.21.15.122:0/299118611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfb00b58d0 0x7fdfb00b5cb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0009e50 tx=0x7fdfa001ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f256f2768b41bfd server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:24.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.824+0000 7fdfad600640 1 -- 172.21.15.122:0/299118611 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa00a5790 con 0x7fdfb00b58d0 2024-05-28T06:06:24.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.824+0000 7fdfad600640 1 -- 172.21.15.122:0/299118611 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa00a5930 con 0x7fdfb00b58d0 2024-05-28T06:06:24.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.824+0000 7fdfad600640 1 -- 172.21.15.122:0/299118611 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa00a5d00 con 0x7fdfb00b58d0 2024-05-28T06:06:24.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfb5e00640 1 -- 172.21.15.122:0/299118611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfb00b58d0 msgr2=0x7fdfb00b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:24.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfb5e00640 1 --2- 172.21.15.122:0/299118611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfb00b58d0 0x7fdfb00b5cb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0009e50 tx=0x7fdfa001ca30 comp rx=0 tx=0).stop 2024-05-28T06:06:24.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfb5e00640 1 -- 172.21.15.122:0/299118611 shutdown_connections 2024-05-28T06:06:24.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfb5e00640 1 --2- 172.21.15.122:0/299118611 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdfb015e730 0x7fdfb015ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfb5e00640 1 --2- 172.21.15.122:0/299118611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfb00b58d0 0x7fdfb00b5cb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfb5e00640 1 -- 172.21.15.122:0/299118611 >> 172.21.15.122:0/299118611 conn(0x7fdfb006bd90 msgr2=0x7fdfb006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:24.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfb5e00640 1 -- 172.21.15.122:0/299118611 shutdown_connections 2024-05-28T06:06:24.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfb5e00640 1 -- 172.21.15.122:0/299118611 wait complete. 2024-05-28T06:06:24.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfb5e00640 1 Processor -- start 2024-05-28T06:06:24.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfb5e00640 1 -- start start 2024-05-28T06:06:24.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfb5e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfb00b58d0 0x7fdfb0143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:24.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfb5e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdfb00ce4f0 0x7fdfb015aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:24.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfb5e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfb015e730 0x7fdfb0159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:24.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfb5e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb01693d0 con 0x7fdfb015e730 2024-05-28T06:06:24.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfb5e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb0169250 con 0x7fdfb00b58d0 2024-05-28T06:06:24.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfb5e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb0169550 con 0x7fdfb00ce4f0 2024-05-28T06:06:24.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfaf400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfb015e730 0x7fdfb0159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:24.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfaf400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfb015e730 0x7fdfb0159b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51828/0 (socket says 172.21.15.122:51828) 2024-05-28T06:06:24.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfaf400640 1 -- 172.21.15.122:0/1419828581 learned_addr learned my addr 172.21.15.122:0/1419828581 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:24.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfaea00640 1 --2- 172.21.15.122:0/1419828581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfb00b58d0 0x7fdfb0143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:24.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfae000640 1 --2- 172.21.15.122:0/1419828581 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdfb00ce4f0 0x7fdfb015aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:24.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfaf400640 1 -- 172.21.15.122:0/1419828581 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdfb00ce4f0 msgr2=0x7fdfb015aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:24.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfaf400640 1 --2- 172.21.15.122:0/1419828581 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdfb00ce4f0 0x7fdfb015aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfaf400640 1 -- 172.21.15.122:0/1419828581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfb00b58d0 msgr2=0x7fdfb0143d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:24.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.828+0000 7fdfaf400640 1 --2- 172.21.15.122:0/1419828581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfb00b58d0 0x7fdfb0143d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:24.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.832+0000 7fdfaf400640 1 -- 172.21.15.122:0/1419828581 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb0144690 con 0x7fdfb015e730 2024-05-28T06:06:24.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.832+0000 7fdfaf400640 1 --2- 172.21.15.122:0/1419828581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfb015e730 0x7fdfb0159b10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800e980 tx=0x7fdfa800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:24.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.832+0000 7fdfa7400640 1 -- 172.21.15.122:0/1419828581 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8017070 con 0x7fdfb015e730 2024-05-28T06:06:24.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.832+0000 7fdfa7400640 1 -- 172.21.15.122:0/1419828581 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa800ca00 con 0x7fdfb015e730 2024-05-28T06:06:24.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.832+0000 7fdfa7400640 1 -- 172.21.15.122:0/1419828581 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa800cdd0 con 0x7fdfb015e730 2024-05-28T06:06:24.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.832+0000 7fdfb5e00640 1 -- 172.21.15.122:0/1419828581 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb0144970 con 0x7fdfb015e730 2024-05-28T06:06:24.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.832+0000 7fdfb5e00640 1 -- 172.21.15.122:0/1419828581 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb00abc80 con 0x7fdfb015e730 2024-05-28T06:06:24.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.832+0000 7fdfb5e00640 1 -- 172.21.15.122:0/1419828581 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb00abe80 con 0x7fdfb015e730 2024-05-28T06:06:24.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.832+0000 7fdfa7400640 1 -- 172.21.15.122:0/1419828581 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdfa8013470 con 0x7fdfb015e730 2024-05-28T06:06:24.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.836+0000 7fdfa7400640 1 --2- 172.21.15.122:0/1419828581 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdf90068380 0x7fdf9006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:24.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.836+0000 7fdfa7400640 1 -- 172.21.15.122:0/1419828581 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdfa8086840 con 0x7fdfb015e730 2024-05-28T06:06:24.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.836+0000 7fdfaea00640 1 --2- 172.21.15.122:0/1419828581 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdf90068380 0x7fdf9006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:24.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.836+0000 7fdfaea00640 1 --2- 172.21.15.122:0/1419828581 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdf90068380 0x7fdf9006a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00ae000 tx=0x7fdfa00a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:24.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.840+0000 7fdfa7400640 1 -- 172.21.15.122:0/1419828581 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdfb00abe80 con 0x7fdfb015e730 2024-05-28T06:06:25.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.996+0000 7fdfb5e00640 1 -- 172.21.15.122:0/1419828581 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fdfb0068c40 con 0x7fdfb015e730 2024-05-28T06:06:25.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.996+0000 7fdfa7400640 1 -- 172.21.15.122:0/1419828581 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fdfa80567a0 con 0x7fdfb015e730 2024-05-28T06:06:25.001 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 32 2024-05-28T06:06:25.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.996+0000 7fdfb5e00640 1 -- 172.21.15.122:0/1419828581 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdf90068380 msgr2=0x7fdf9006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:25.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.996+0000 7fdfb5e00640 1 --2- 172.21.15.122:0/1419828581 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdf90068380 0x7fdf9006a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00ae000 tx=0x7fdfa00a7070 comp rx=0 tx=0).stop 2024-05-28T06:06:25.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.996+0000 7fdfb5e00640 1 -- 172.21.15.122:0/1419828581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfb015e730 msgr2=0x7fdfb0159b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:25.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.996+0000 7fdfb5e00640 1 --2- 172.21.15.122:0/1419828581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfb015e730 0x7fdfb0159b10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800e980 tx=0x7fdfa800ee40 comp rx=0 tx=0).stop 2024-05-28T06:06:25.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.996+0000 7fdfb5e00640 1 -- 172.21.15.122:0/1419828581 shutdown_connections 2024-05-28T06:06:25.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.996+0000 7fdfb5e00640 1 --2- 172.21.15.122:0/1419828581 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdf90068380 0x7fdf9006a840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:25.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.996+0000 7fdfb5e00640 1 --2- 172.21.15.122:0/1419828581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfb015e730 0x7fdfb0159b10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:25.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.996+0000 7fdfb5e00640 1 --2- 172.21.15.122:0/1419828581 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdfb00ce4f0 0x7fdfb015aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:25.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.996+0000 7fdfb5e00640 1 --2- 172.21.15.122:0/1419828581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfb00b58d0 0x7fdfb0143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:25.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.996+0000 7fdfb5e00640 1 -- 172.21.15.122:0/1419828581 >> 172.21.15.122:0/1419828581 conn(0x7fdfb006bd90 msgr2=0x7fdfb006c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:25.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.996+0000 7fdfb5e00640 1 -- 172.21.15.122:0/1419828581 shutdown_connections 2024-05-28T06:06:25.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:24.996+0000 7fdfb5e00640 1 -- 172.21.15.122:0/1419828581 wait complete. 2024-05-28T06:06:25.021 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-28T06:06:25.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.156+0000 7f8106000640 1 Processor -- start 2024-05-28T06:06:25.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.156+0000 7f8106000640 1 -- start start 2024-05-28T06:06:25.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.156+0000 7f8106000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f810015f740 0x7f8100167240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:25.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.156+0000 7f8106000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f810015d970 con 0x7f81000ce4f0 2024-05-28T06:06:25.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.156+0000 7f8106000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f810015dc50 con 0x7f81000b58d0 2024-05-28T06:06:25.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.156+0000 7f8106000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f810015df30 con 0x7f810015f740 2024-05-28T06:06:25.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.156+0000 7f80ffe00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f810015f740 0x7f8100167240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:25.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.156+0000 7f80f6a00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f81000ce4f0 0x7f81000ce980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:54270/0 (socket says 172.21.15.122:54270) 2024-05-28T06:06:25.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.156+0000 7f80f6a00640 1 -- 172.21.15.122:0/3483686597 learned_addr learned my addr 172.21.15.122:0/3483686597 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:25.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.156+0000 7f80ffe00640 1 -- 172.21.15.122:0/3483686597 >> v1:172.21.15.153:6789/0 conn(0x7f81000b58d0 legacy=0x7f81000b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:25.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.156+0000 7f80ffe00640 1 -- 172.21.15.122:0/3483686597 >> v1:172.21.15.122:6789/0 conn(0x7f81000ce4f0 legacy=0x7f81000ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:25.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.156+0000 7f80ffe00640 1 -- 172.21.15.122:0/3483686597 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f810015e210 con 0x7f810015f740 2024-05-28T06:06:25.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.160+0000 7f80ffe00640 1 --2- 172.21.15.122:0/3483686597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f810015f740 0x7f8100167240 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f80f8009d90 tx=0x7f80f801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890f344be62a5a1a server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:25.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.160+0000 7f80fea00640 1 -- 172.21.15.122:0/3483686597 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f80b2070 con 0x7f810015f740 2024-05-28T06:06:25.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.160+0000 7f80fea00640 1 -- 172.21.15.122:0/3483686597 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f80a5840 con 0x7f810015f740 2024-05-28T06:06:25.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.160+0000 7f80fea00640 1 -- 172.21.15.122:0/3483686597 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f80a5c10 con 0x7f810015f740 2024-05-28T06:06:25.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.160+0000 7f8106000640 1 -- 172.21.15.122:0/3483686597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f810015f740 msgr2=0x7f8100167240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:25.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.160+0000 7f8106000640 1 --2- 172.21.15.122:0/3483686597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f810015f740 0x7f8100167240 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f80f8009d90 tx=0x7f80f801c970 comp rx=0 tx=0).stop 2024-05-28T06:06:25.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.160+0000 7f8106000640 1 -- 172.21.15.122:0/3483686597 shutdown_connections 2024-05-28T06:06:25.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.160+0000 7f8106000640 1 --2- 172.21.15.122:0/3483686597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f810015f740 0x7f8100167240 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:25.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.160+0000 7f8106000640 1 -- 172.21.15.122:0/3483686597 >> 172.21.15.122:0/3483686597 conn(0x7f810006bd90 msgr2=0x7f810006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:25.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.160+0000 7f8106000640 1 -- 172.21.15.122:0/3483686597 shutdown_connections 2024-05-28T06:06:25.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.160+0000 7f8106000640 1 -- 172.21.15.122:0/3483686597 wait complete. 2024-05-28T06:06:25.167 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f8106000640 1 Processor -- start 2024-05-28T06:06:25.167 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f8106000640 1 -- start start 2024-05-28T06:06:25.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f8106000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81000b58d0 0x7f810013fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:25.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f8106000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81000ce4f0 0x7f81000b1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:25.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f8106000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f810015f740 0x7f81000b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:25.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f8106000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f810016a330 con 0x7f81000ce4f0 2024-05-28T06:06:25.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f8106000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f810016a1b0 con 0x7f810015f740 2024-05-28T06:06:25.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f8106000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f810016a4b0 con 0x7f81000b58d0 2024-05-28T06:06:25.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f80f6a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81000ce4f0 0x7f81000b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:25.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f80f6a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81000ce4f0 0x7f81000b1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51846/0 (socket says 172.21.15.122:51846) 2024-05-28T06:06:25.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f80f6a00640 1 -- 172.21.15.122:0/469491562 learned_addr learned my addr 172.21.15.122:0/469491562 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:25.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f80ffe00640 1 --2- 172.21.15.122:0/469491562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f810015f740 0x7f81000b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:25.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f80ff400640 1 --2- 172.21.15.122:0/469491562 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81000b58d0 0x7f810013fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:25.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f80f6a00640 1 -- 172.21.15.122:0/469491562 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81000b58d0 msgr2=0x7f810013fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:25.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f80f6a00640 1 --2- 172.21.15.122:0/469491562 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81000b58d0 0x7f810013fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:25.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f80f6a00640 1 -- 172.21.15.122:0/469491562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f810015f740 msgr2=0x7f81000b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:25.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f80f6a00640 1 --2- 172.21.15.122:0/469491562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f810015f740 0x7f81000b1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:25.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f80f6a00640 1 -- 172.21.15.122:0/469491562 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81001f5410 con 0x7f81000ce4f0 2024-05-28T06:06:25.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f80f6a00640 1 --2- 172.21.15.122:0/469491562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81000ce4f0 0x7f81000b1970 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f80e800c500 tx=0x7f80e800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:25.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f80f7e00640 1 -- 172.21.15.122:0/469491562 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e8017070 con 0x7f81000ce4f0 2024-05-28T06:06:25.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f80f7e00640 1 -- 172.21.15.122:0/469491562 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80e8005cf0 con 0x7f81000ce4f0 2024-05-28T06:06:25.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f80f7e00640 1 -- 172.21.15.122:0/469491562 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e80072f0 con 0x7f81000ce4f0 2024-05-28T06:06:25.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f8106000640 1 -- 172.21.15.122:0/469491562 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81000b27c0 con 0x7f81000ce4f0 2024-05-28T06:06:25.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f8106000640 1 -- 172.21.15.122:0/469491562 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81000b2d80 con 0x7f81000ce4f0 2024-05-28T06:06:25.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.164+0000 7f8106000640 1 -- 172.21.15.122:0/469491562 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81000b0d60 con 0x7f81000ce4f0 2024-05-28T06:06:25.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.168+0000 7f80f7e00640 1 -- 172.21.15.122:0/469491562 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f80e801a070 con 0x7f81000ce4f0 2024-05-28T06:06:25.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.168+0000 7f80f7e00640 1 --2- 172.21.15.122:0/469491562 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f80dc068380 0x7f80dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:25.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.168+0000 7f80f7e00640 1 -- 172.21.15.122:0/469491562 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f80e8085c50 con 0x7f81000ce4f0 2024-05-28T06:06:25.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.168+0000 7f80ff400640 1 --2- 172.21.15.122:0/469491562 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f80dc068380 0x7f80dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:25.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.168+0000 7f80ff400640 1 --2- 172.21.15.122:0/469491562 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f80dc068380 0x7f80dc06a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f80f0000f70 tx=0x7f80f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:25.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.172+0000 7f80f7e00640 1 -- 172.21.15.122:0/469491562 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f81001f5410 con 0x7f81000ce4f0 2024-05-28T06:06:25.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.328+0000 7f8106000640 1 -- 172.21.15.122:0/469491562 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8100068c40 con 0x7f81000ce4f0 2024-05-28T06:06:25.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.328+0000 7f80f7e00640 1 -- 172.21.15.122:0/469491562 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f80e8055bb0 con 0x7f81000ce4f0 2024-05-28T06:06:25.334 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 64 2024-05-28T06:06:25.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.332+0000 7f8106000640 1 -- 172.21.15.122:0/469491562 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f80dc068380 msgr2=0x7f80dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:25.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.332+0000 7f8106000640 1 --2- 172.21.15.122:0/469491562 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f80dc068380 0x7f80dc06a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f80f0000f70 tx=0x7f80f0009040 comp rx=0 tx=0).stop 2024-05-28T06:06:25.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.332+0000 7f8106000640 1 -- 172.21.15.122:0/469491562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81000ce4f0 msgr2=0x7f81000b1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:25.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.332+0000 7f8106000640 1 --2- 172.21.15.122:0/469491562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81000ce4f0 0x7f81000b1970 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f80e800c500 tx=0x7f80e800c9c0 comp rx=0 tx=0).stop 2024-05-28T06:06:25.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.332+0000 7f8106000640 1 -- 172.21.15.122:0/469491562 shutdown_connections 2024-05-28T06:06:25.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.332+0000 7f8106000640 1 --2- 172.21.15.122:0/469491562 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f80dc068380 0x7f80dc06a840 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:25.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.332+0000 7f8106000640 1 --2- 172.21.15.122:0/469491562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f810015f740 0x7f81000b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:25.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.332+0000 7f8106000640 1 --2- 172.21.15.122:0/469491562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81000ce4f0 0x7f81000b1970 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:25.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.332+0000 7f8106000640 1 --2- 172.21.15.122:0/469491562 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81000b58d0 0x7f810013fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:25.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.332+0000 7f8106000640 1 -- 172.21.15.122:0/469491562 >> 172.21.15.122:0/469491562 conn(0x7f810006bd90 msgr2=0x7f810015cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:25.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.332+0000 7f8106000640 1 -- 172.21.15.122:0/469491562 shutdown_connections 2024-05-28T06:06:25.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.332+0000 7f8106000640 1 -- 172.21.15.122:0/469491562 wait complete. 2024-05-28T06:06:25.356 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-28T06:06:25.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a8c00640 1 Processor -- start 2024-05-28T06:06:25.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a8c00640 1 -- start start 2024-05-28T06:06:25.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a8c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe0a415e8e0 0x7fe0a40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:25.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a8c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0a40b6620 0x7fe0a40d2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:25.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a8c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0a4071af0 con 0x7fe0a40d2b50 2024-05-28T06:06:25.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a8c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe0a40d2fc0 con 0x7fe0a415e8e0 2024-05-28T06:06:25.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a8c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe0a4071dd0 con 0x7fe0a40b6620 2024-05-28T06:06:25.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a2800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fe0a40d2b50 0x7fe0a41624c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47172/0 (socket says 172.21.15.122:47172) 2024-05-28T06:06:25.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a2800640 1 -- 172.21.15.122:0/3461307560 learned_addr learned my addr 172.21.15.122:0/3461307560 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:25.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a1e00640 1 --2- 172.21.15.122:0/3461307560 >> v2:172.21.15.153:3300/0 conn(0x7fe0a415e8e0 0x7fe0a40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:25.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a1400640 1 --2- 172.21.15.122:0/3461307560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0a40b6620 0x7fe0a40d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:25.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a0a00640 1 -- 172.21.15.122:0/3461307560 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3640266539 0 0) 0x7fe0a4071af0 con 0x7fe0a40d2b50 2024-05-28T06:06:25.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a0a00640 1 -- 172.21.15.122:0/3461307560 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe088003530 con 0x7fe0a40d2b50 2024-05-28T06:06:25.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a0a00640 1 -- 172.21.15.122:0/3461307560 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3103196145 0 0) 0x7fe088003530 con 0x7fe0a40d2b50 2024-05-28T06:06:25.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a0a00640 1 -- 172.21.15.122:0/3461307560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0a40b6620 msgr2=0x7fe0a40d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:25.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a0a00640 1 --2- 172.21.15.122:0/3461307560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0a40b6620 0x7fe0a40d2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:25.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a0a00640 1 -- 172.21.15.122:0/3461307560 >> v2:172.21.15.153:3300/0 conn(0x7fe0a415e8e0 msgr2=0x7fe0a40b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:25.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a0a00640 1 --2- 172.21.15.122:0/3461307560 >> v2:172.21.15.153:3300/0 conn(0x7fe0a415e8e0 0x7fe0a40b60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:25.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a0a00640 1 -- 172.21.15.122:0/3461307560 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a40720b0 con 0x7fe0a40d2b50 2024-05-28T06:06:25.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a0a00640 1 -- 172.21.15.122:0/3461307560 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7fe09c001a00 con 0x7fe0a40d2b50 2024-05-28T06:06:25.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a0a00640 1 -- 172.21.15.122:0/3461307560 >> v1:172.21.15.122:6789/0 conn(0x7fe0a40d2b50 legacy=0x7fe0a41624c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:25.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a0a00640 1 --2- 172.21.15.122:0/3461307560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0a40b6620 0x7fe0880039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:25.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a0a00640 1 --2- 172.21.15.122:0/3461307560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe088003f40 0x7fe088004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:25.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a0a00640 1 --2- 172.21.15.122:0/3461307560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe088004d50 0x7fe0880051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:25.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a0a00640 1 -- 172.21.15.122:0/3461307560 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a40d2fc0 con 0x7fe088003f40 2024-05-28T06:06:25.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a0a00640 1 -- 172.21.15.122:0/3461307560 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a4071dd0 con 0x7fe088004d50 2024-05-28T06:06:25.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a0a00640 1 -- 172.21.15.122:0/3461307560 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe08800b9d0 con 0x7fe0a40b6620 2024-05-28T06:06:25.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a1400640 1 --2- 172.21.15.122:0/3461307560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe088003f40 0x7fe088004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:25.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a1e00640 1 --2- 172.21.15.122:0/3461307560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0a40b6620 0x7fe0880039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:25.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a2800640 1 --2- 172.21.15.122:0/3461307560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe088004d50 0x7fe0880051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:25.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a1400640 1 -- 172.21.15.122:0/3461307560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0a40b6620 msgr2=0x7fe0880039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:25.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a1400640 1 --2- 172.21.15.122:0/3461307560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe0a40b6620 0x7fe0880039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:25.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a1400640 1 -- 172.21.15.122:0/3461307560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe088004d50 msgr2=0x7fe0880051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:25.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a1400640 1 --2- 172.21.15.122:0/3461307560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe088004d50 0x7fe0880051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:25.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a1400640 1 -- 172.21.15.122:0/3461307560 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe088003530 con 0x7fe088003f40 2024-05-28T06:06:25.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.492+0000 7fe0a2800640 1 --2- 172.21.15.122:0/3461307560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe088004d50 0x7fe0880051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:25.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.496+0000 7fe0a1400640 1 --2- 172.21.15.122:0/3461307560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe088003f40 0x7fe088004810 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe090009ae0 tx=0x7fe09001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf40ffa18bd922 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:25.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.496+0000 7fe0a0a00640 1 -- 172.21.15.122:0/3461307560 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0900b2070 con 0x7fe088003f40 2024-05-28T06:06:25.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.496+0000 7fe0a0a00640 1 -- 172.21.15.122:0/3461307560 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0900a5660 con 0x7fe088003f40 2024-05-28T06:06:25.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.496+0000 7fe0a0a00640 1 -- 172.21.15.122:0/3461307560 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0900096b0 con 0x7fe088003f40 2024-05-28T06:06:25.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.496+0000 7fe0a8c00640 1 -- 172.21.15.122:0/3461307560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe088003f40 msgr2=0x7fe088004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:25.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.496+0000 7fe0a8c00640 1 --2- 172.21.15.122:0/3461307560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe088003f40 0x7fe088004810 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe090009ae0 tx=0x7fe09001ca10 comp rx=0 tx=0).stop 2024-05-28T06:06:25.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.496+0000 7fe0a2800640 1 -- 172.21.15.122:0/3461307560 reap_dead start 2024-05-28T06:06:25.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.496+0000 7fe0a8c00640 1 -- 172.21.15.122:0/3461307560 shutdown_connections 2024-05-28T06:06:25.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.496+0000 7fe0a8c00640 1 -- 172.21.15.122:0/3461307560 >> 172.21.15.122:0/3461307560 conn(0x7fe0a40702f0 msgr2=0x7fe0a4070700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:25.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.496+0000 7fe0a8c00640 1 -- 172.21.15.122:0/3461307560 shutdown_connections 2024-05-28T06:06:25.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.496+0000 7fe0a8c00640 1 -- 172.21.15.122:0/3461307560 wait complete. 2024-05-28T06:06:25.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe0a8c00640 1 Processor -- start 2024-05-28T06:06:25.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe0a8c00640 1 -- start start 2024-05-28T06:06:25.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe0a8c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe088003f40 0x7fe0a4153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:25.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe0a8c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0a41e82e0 0x7fe0a41e8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:25.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe0a8c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0a41f81f0 0x7fe0a41f8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:25.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe0a8c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a406e970 con 0x7fe0a41e82e0 2024-05-28T06:06:25.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe0a8c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a406e050 con 0x7fe0a41f81f0 2024-05-28T06:06:25.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe0a8c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe0a415ecc0 con 0x7fe088003f40 2024-05-28T06:06:25.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe0a1400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0a41e82e0 0x7fe0a41e8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:25.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe0a1400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0a41e82e0 0x7fe0a41e8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37652/0 (socket says 172.21.15.122:37652) 2024-05-28T06:06:25.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe0a1400640 1 -- 172.21.15.122:0/3245770768 learned_addr learned my addr 172.21.15.122:0/3245770768 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:25.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe0a2800640 1 --2- 172.21.15.122:0/3245770768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0a41f81f0 0x7fe0a41f8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:25.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe0a1e00640 1 --2- 172.21.15.122:0/3245770768 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe088003f40 0x7fe0a4153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:25.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe0a1400640 1 -- 172.21.15.122:0/3245770768 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe088003f40 msgr2=0x7fe0a4153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:25.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe0a1400640 1 --2- 172.21.15.122:0/3245770768 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe088003f40 0x7fe0a4153d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:25.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe0a1400640 1 -- 172.21.15.122:0/3245770768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0a41f81f0 msgr2=0x7fe0a41f8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:25.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe0a1400640 1 --2- 172.21.15.122:0/3245770768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0a41f81f0 0x7fe0a41f8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:25.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe0a1400640 1 -- 172.21.15.122:0/3245770768 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a40cde90 con 0x7fe0a41e82e0 2024-05-28T06:06:25.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe0a2800640 1 --2- 172.21.15.122:0/3245770768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0a41f81f0 0x7fe0a41f8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:25.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe0a1e00640 1 --2- 172.21.15.122:0/3245770768 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe088003f40 0x7fe0a4153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:25.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe0a1400640 1 --2- 172.21.15.122:0/3245770768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0a41e82e0 0x7fe0a41e8760 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe09001c840 tx=0x7fe088005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:25.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe09a000640 1 -- 172.21.15.122:0/3245770768 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0900bd020 con 0x7fe0a41e82e0 2024-05-28T06:06:25.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe09a000640 1 -- 172.21.15.122:0/3245770768 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe090004020 con 0x7fe0a41e82e0 2024-05-28T06:06:25.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe0a8c00640 1 -- 172.21.15.122:0/3245770768 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a40ce170 con 0x7fe0a41e82e0 2024-05-28T06:06:25.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe09a000640 1 -- 172.21.15.122:0/3245770768 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0900b2040 con 0x7fe0a41e82e0 2024-05-28T06:06:25.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.500+0000 7fe0a8c00640 1 -- 172.21.15.122:0/3245770768 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a41542c0 con 0x7fe0a41e82e0 2024-05-28T06:06:25.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.504+0000 7fe0a8c00640 1 -- 172.21.15.122:0/3245770768 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0a40ce690 con 0x7fe0a41e82e0 2024-05-28T06:06:25.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.504+0000 7fe09a000640 1 -- 172.21.15.122:0/3245770768 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe090003620 con 0x7fe0a41e82e0 2024-05-28T06:06:25.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.504+0000 7fe09a000640 1 --2- 172.21.15.122:0/3245770768 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe084068380 0x7fe08406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:25.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.504+0000 7fe09a000640 1 -- 172.21.15.122:0/3245770768 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe090120790 con 0x7fe0a41e82e0 2024-05-28T06:06:25.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.504+0000 7fe0a1e00640 1 --2- 172.21.15.122:0/3245770768 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe084068380 0x7fe08406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:25.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.504+0000 7fe0a1e00640 1 --2- 172.21.15.122:0/3245770768 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe084068380 0x7fe08406a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe094009b50 tx=0x7fe094008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:25.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.508+0000 7fe09a000640 1 -- 172.21.15.122:0/3245770768 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe090016780 con 0x7fe0a41e82e0 2024-05-28T06:06:25.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.676+0000 7fe0a8c00640 1 -- 172.21.15.122:0/3245770768 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe0a406ec30 con 0x7fe0a41e82e0 2024-05-28T06:06:25.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.676+0000 7fe09a000640 1 -- 172.21.15.122:0/3245770768 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fe0900f0cb0 con 0x7fe0a41e82e0 2024-05-28T06:06:25.682 INFO:teuthology.orchestra.run.smithi122.stderr:listed 0 entries 2024-05-28T06:06:25.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.680+0000 7fe0a8c00640 1 -- 172.21.15.122:0/3245770768 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe084068380 msgr2=0x7fe08406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:25.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.680+0000 7fe0a8c00640 1 --2- 172.21.15.122:0/3245770768 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe084068380 0x7fe08406a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe094009b50 tx=0x7fe094008040 comp rx=0 tx=0).stop 2024-05-28T06:06:25.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.680+0000 7fe0a8c00640 1 -- 172.21.15.122:0/3245770768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0a41e82e0 msgr2=0x7fe0a41e8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:25.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.680+0000 7fe0a8c00640 1 --2- 172.21.15.122:0/3245770768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0a41e82e0 0x7fe0a41e8760 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe09001c840 tx=0x7fe088005840 comp rx=0 tx=0).stop 2024-05-28T06:06:25.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.680+0000 7fe0a8c00640 1 -- 172.21.15.122:0/3245770768 shutdown_connections 2024-05-28T06:06:25.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.680+0000 7fe0a8c00640 1 --2- 172.21.15.122:0/3245770768 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe084068380 0x7fe08406a840 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:25.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.680+0000 7fe0a8c00640 1 --2- 172.21.15.122:0/3245770768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0a41f81f0 0x7fe0a41f8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:25.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.680+0000 7fe0a8c00640 1 --2- 172.21.15.122:0/3245770768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0a41e82e0 0x7fe0a41e8760 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:25.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.680+0000 7fe0a8c00640 1 --2- 172.21.15.122:0/3245770768 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe088003f40 0x7fe0a4153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:25.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.680+0000 7fe0a8c00640 1 -- 172.21.15.122:0/3245770768 >> 172.21.15.122:0/3245770768 conn(0x7fe0a40702f0 msgr2=0x7fe0a40cf400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:25.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.680+0000 7fe0a8c00640 1 -- 172.21.15.122:0/3245770768 shutdown_connections 2024-05-28T06:06:25.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:25.680+0000 7fe0a8c00640 1 -- 172.21.15.122:0/3245770768 wait complete. 2024-05-28T06:06:25.703 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-28T06:06:25.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:25.703 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-05-28T06:06:25.740 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-05-28T06:06:25.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:25.740 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-28T06:06:25.809 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:06:25.809 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:06:25.818 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:06:25.818 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:06:25.870 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:06:25.870 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:06:25.923 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:06:26.105 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.100+0000 7f5afc800640 1 Processor -- start 2024-05-28T06:06:26.105 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.100+0000 7f5afc800640 1 -- start start 2024-05-28T06:06:26.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.100+0000 7f5afc800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5af40cff30 0x7f5af406f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:26.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.100+0000 7f5afc800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af40d0310 con 0x7f5af40cdb00 2024-05-28T06:06:26.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.100+0000 7f5afc800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af415be20 con 0x7f5af406f6c0 2024-05-28T06:06:26.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.100+0000 7f5afc800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5af406fb00 con 0x7f5af40cff30 2024-05-28T06:06:26.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.100+0000 7f5afa800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f5af40cdb00 0x7f5af40b49b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47176/0 (socket says 172.21.15.122:47176) 2024-05-28T06:06:26.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.100+0000 7f5afa800640 1 -- 172.21.15.122:0/3280877011 learned_addr learned my addr 172.21.15.122:0/3280877011 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:26.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.100+0000 7f5af9e00640 1 --2- 172.21.15.122:0/3280877011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5af40cff30 0x7f5af406f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:26.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.100+0000 7f5af8a00640 1 -- 172.21.15.122:0/3280877011 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 551413784 0 0) 0x7f5af40d0310 con 0x7f5af40cdb00 2024-05-28T06:06:26.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5af8a00640 1 -- 172.21.15.122:0/3280877011 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5adc005740 con 0x7f5af40cdb00 2024-05-28T06:06:26.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5af8a00640 1 -- 172.21.15.122:0/3280877011 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4283400894 0 0) 0x7f5af415be20 con 0x7f5af406f6c0 2024-05-28T06:06:26.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5af8a00640 1 -- 172.21.15.122:0/3280877011 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5af40d0310 con 0x7f5af406f6c0 2024-05-28T06:06:26.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5af8a00640 1 -- 172.21.15.122:0/3280877011 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3865816103 0 0) 0x7f5adc005740 con 0x7f5af40cdb00 2024-05-28T06:06:26.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5af8a00640 1 -- 172.21.15.122:0/3280877011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5af40cff30 msgr2=0x7f5af406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:26.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5af8a00640 1 --2- 172.21.15.122:0/3280877011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5af40cff30 0x7f5af406f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5af8a00640 1 -- 172.21.15.122:0/3280877011 >> v1:172.21.15.153:6789/0 conn(0x7f5af406f6c0 legacy=0x7f5af40cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:26.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5af8a00640 1 -- 172.21.15.122:0/3280877011 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af415c100 con 0x7f5af40cdb00 2024-05-28T06:06:26.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5af8a00640 1 -- 172.21.15.122:0/3280877011 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f5af0001a20 con 0x7f5af40cdb00 2024-05-28T06:06:26.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5af8a00640 1 -- 172.21.15.122:0/3280877011 >> v1:172.21.15.122:6789/0 conn(0x7f5af40cdb00 legacy=0x7f5af40b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:26.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5af8a00640 1 --2- 172.21.15.122:0/3280877011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5af40cff30 0x7f5adc005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:26.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5af8a00640 1 --2- 172.21.15.122:0/3280877011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5adc0062f0 0x7f5adc006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:26.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5af8a00640 1 --2- 172.21.15.122:0/3280877011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5adc006f60 0x7f5adc0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:26.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5af8a00640 1 -- 172.21.15.122:0/3280877011 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5af406fb00 con 0x7f5adc006f60 2024-05-28T06:06:26.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5af8a00640 1 -- 172.21.15.122:0/3280877011 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc00dcc0 con 0x7f5adc0062f0 2024-05-28T06:06:26.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5af8a00640 1 -- 172.21.15.122:0/3280877011 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5adc00dec0 con 0x7f5af40cff30 2024-05-28T06:06:26.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5afa800640 1 --2- 172.21.15.122:0/3280877011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5adc006f60 0x7f5adc0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:26.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5af9400640 1 --2- 172.21.15.122:0/3280877011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5adc0062f0 0x7f5adc006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:26.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5af9e00640 1 --2- 172.21.15.122:0/3280877011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5af40cff30 0x7f5adc005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:26.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5afa800640 1 -- 172.21.15.122:0/3280877011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5af40cff30 msgr2=0x7f5adc005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:26.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5afa800640 1 --2- 172.21.15.122:0/3280877011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5af40cff30 0x7f5adc005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5afa800640 1 -- 172.21.15.122:0/3280877011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5adc0062f0 msgr2=0x7f5adc006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:26.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5afa800640 1 --2- 172.21.15.122:0/3280877011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5adc0062f0 0x7f5adc006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5afa800640 1 -- 172.21.15.122:0/3280877011 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5adc005740 con 0x7f5adc006f60 2024-05-28T06:06:26.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5af9e00640 1 --2- 172.21.15.122:0/3280877011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5af40cff30 0x7f5adc005d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:26.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.104+0000 7f5afa800640 1 --2- 172.21.15.122:0/3280877011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5adc006f60 0x7f5adc0073e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5af000a7e0 tx=0x7f5af001fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372bbe47d50494b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:26.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.108+0000 7f5af8a00640 1 -- 172.21.15.122:0/3280877011 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af000a430 con 0x7f5adc006f60 2024-05-28T06:06:26.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.108+0000 7f5af8a00640 1 -- 172.21.15.122:0/3280877011 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5af00aa650 con 0x7f5adc006f60 2024-05-28T06:06:26.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.108+0000 7f5af8a00640 1 -- 172.21.15.122:0/3280877011 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af00aaa40 con 0x7f5adc006f60 2024-05-28T06:06:26.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.108+0000 7f5afc800640 1 -- 172.21.15.122:0/3280877011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5adc006f60 msgr2=0x7f5adc0073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:26.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.108+0000 7f5afc800640 1 --2- 172.21.15.122:0/3280877011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5adc006f60 0x7f5adc0073e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5af000a7e0 tx=0x7f5af001fa20 comp rx=0 tx=0).stop 2024-05-28T06:06:26.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.108+0000 7f5afa800640 1 -- 172.21.15.122:0/3280877011 reap_dead start 2024-05-28T06:06:26.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.108+0000 7f5afc800640 1 -- 172.21.15.122:0/3280877011 shutdown_connections 2024-05-28T06:06:26.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.108+0000 7f5afc800640 1 -- 172.21.15.122:0/3280877011 >> 172.21.15.122:0/3280877011 conn(0x7f5af406bd90 msgr2=0x7f5af406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:26.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.108+0000 7f5afc800640 1 -- 172.21.15.122:0/3280877011 shutdown_connections 2024-05-28T06:06:26.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.108+0000 7f5afc800640 1 -- 172.21.15.122:0/3280877011 wait complete. 2024-05-28T06:06:26.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.108+0000 7f5afc800640 1 Processor -- start 2024-05-28T06:06:26.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.108+0000 7f5afc800640 1 -- start start 2024-05-28T06:06:26.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.108+0000 7f5afc800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5af4157f10 0x7f5af4144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:26.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.108+0000 7f5afc800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5af4144fe0 0x7f5af414af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:26.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.108+0000 7f5afc800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5af414b490 0x7f5af41409b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:26.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.108+0000 7f5afc800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5af415c6c0 con 0x7f5af4157f10 2024-05-28T06:06:26.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.108+0000 7f5afc800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5af40cdf30 con 0x7f5af414b490 2024-05-28T06:06:26.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.108+0000 7f5afc800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5af415baf0 con 0x7f5af4144fe0 2024-05-28T06:06:26.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.108+0000 7f5af9e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5af4157f10 0x7f5af4144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:26.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.108+0000 7f5af9e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5af4157f10 0x7f5af4144aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37662/0 (socket says 172.21.15.122:37662) 2024-05-28T06:06:26.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.108+0000 7f5af9e00640 1 -- 172.21.15.122:0/3580443725 learned_addr learned my addr 172.21.15.122:0/3580443725 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:26.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.112+0000 7f5af9e00640 1 -- 172.21.15.122:0/3580443725 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5af4144fe0 msgr2=0x7f5af414af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:26.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.112+0000 7f5af9e00640 1 --2- 172.21.15.122:0/3580443725 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5af4144fe0 0x7f5af414af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.112+0000 7f5af9e00640 1 -- 172.21.15.122:0/3580443725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5af414b490 msgr2=0x7f5af41409b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:26.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.112+0000 7f5af9e00640 1 --2- 172.21.15.122:0/3580443725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5af414b490 0x7f5af41409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.112+0000 7f5af9e00640 1 -- 172.21.15.122:0/3580443725 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af414b9a0 con 0x7f5af4157f10 2024-05-28T06:06:26.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.112+0000 7f5af9e00640 1 --2- 172.21.15.122:0/3580443725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5af4157f10 0x7f5af4144aa0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009fd0 tx=0x7f5ae8011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:26.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.112+0000 7f5aee000640 1 -- 172.21.15.122:0/3580443725 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8004220 con 0x7f5af4157f10 2024-05-28T06:06:26.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.112+0000 7f5aee000640 1 -- 172.21.15.122:0/3580443725 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae80043c0 con 0x7f5af4157f10 2024-05-28T06:06:26.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.112+0000 7f5aee000640 1 -- 172.21.15.122:0/3580443725 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae800f960 con 0x7f5af4157f10 2024-05-28T06:06:26.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.112+0000 7f5afc800640 1 -- 172.21.15.122:0/3580443725 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af41503a0 con 0x7f5af4157f10 2024-05-28T06:06:26.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.112+0000 7f5afc800640 1 -- 172.21.15.122:0/3580443725 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af414e0f0 con 0x7f5af4157f10 2024-05-28T06:06:26.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.112+0000 7f5afc800640 1 -- 172.21.15.122:0/3580443725 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af4068c40 con 0x7f5af4157f10 2024-05-28T06:06:26.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.112+0000 7f5aee000640 1 -- 172.21.15.122:0/3580443725 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5ae800fb00 con 0x7f5af4157f10 2024-05-28T06:06:26.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.112+0000 7f5aee000640 1 --2- 172.21.15.122:0/3580443725 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5ad8068380 0x7f5ad806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:26.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.112+0000 7f5aee000640 1 -- 172.21.15.122:0/3580443725 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5ae80870a0 con 0x7f5af4157f10 2024-05-28T06:06:26.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.112+0000 7f5af9400640 1 --2- 172.21.15.122:0/3580443725 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5ad8068380 0x7f5ad806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:26.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.116+0000 7f5af9400640 1 --2- 172.21.15.122:0/3580443725 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5ad8068380 0x7f5ad806a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5af41453e0 tx=0x7f5ae4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:26.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.116+0000 7f5aee000640 1 -- 172.21.15.122:0/3580443725 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5ae8019030 con 0x7f5af4157f10 2024-05-28T06:06:26.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.276+0000 7f5afc800640 1 -- 172.21.15.122:0/3580443725 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5af4075800 con 0x7f5af4157f10 2024-05-28T06:06:26.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.276+0000 7f5aee000640 1 -- 172.21.15.122:0/3580443725 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f5ae8057650 con 0x7f5af4157f10 2024-05-28T06:06:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:26.282 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":20,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:05:50.822555+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:05:47.441193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-28T06:05:48.148164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:06:26.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.280+0000 7f5afc800640 1 -- 172.21.15.122:0/3580443725 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5ad8068380 msgr2=0x7f5ad806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:26.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.280+0000 7f5afc800640 1 --2- 172.21.15.122:0/3580443725 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5ad8068380 0x7f5ad806a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5af41453e0 tx=0x7f5ae4009040 comp rx=0 tx=0).stop 2024-05-28T06:06:26.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.280+0000 7f5afc800640 1 -- 172.21.15.122:0/3580443725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5af4157f10 msgr2=0x7f5af4144aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:26.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.280+0000 7f5afc800640 1 --2- 172.21.15.122:0/3580443725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5af4157f10 0x7f5af4144aa0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009fd0 tx=0x7f5ae8011b30 comp rx=0 tx=0).stop 2024-05-28T06:06:26.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.280+0000 7f5afc800640 1 -- 172.21.15.122:0/3580443725 shutdown_connections 2024-05-28T06:06:26.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.280+0000 7f5afc800640 1 --2- 172.21.15.122:0/3580443725 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5ad8068380 0x7f5ad806a840 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.280+0000 7f5afc800640 1 --2- 172.21.15.122:0/3580443725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5af414b490 0x7f5af41409b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.280+0000 7f5afc800640 1 --2- 172.21.15.122:0/3580443725 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5af4144fe0 0x7f5af414af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.280+0000 7f5afc800640 1 --2- 172.21.15.122:0/3580443725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5af4157f10 0x7f5af4144aa0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.280+0000 7f5afc800640 1 -- 172.21.15.122:0/3580443725 >> 172.21.15.122:0/3580443725 conn(0x7f5af406bd90 msgr2=0x7f5af406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:26.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.280+0000 7f5afc800640 1 -- 172.21.15.122:0/3580443725 shutdown_connections 2024-05-28T06:06:26.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.280+0000 7f5afc800640 1 -- 172.21.15.122:0/3580443725 wait complete. 2024-05-28T06:06:26.303 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-28T06:05:47.441193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-28T06:05:48.148164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:06:26.303 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:06:26.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.439+0000 7fe4fcc00640 1 Processor -- start 2024-05-28T06:06:26.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.439+0000 7fe4fcc00640 1 -- start start 2024-05-28T06:06:26.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.439+0000 7fe4fcc00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe4f80ce4f0 0x7fe4f80ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:26.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.439+0000 7fe4fcc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4f815e730 0x7fe4f815ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:26.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.439+0000 7fe4fcc00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4f815d970 con 0x7fe4f80b58d0 2024-05-28T06:06:26.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.439+0000 7fe4fcc00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe4f815dc50 con 0x7fe4f80ce4f0 2024-05-28T06:06:26.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.439+0000 7fe4fcc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f815df30 con 0x7fe4f815e730 2024-05-28T06:06:26.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.439+0000 7fe4f6800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4f815e730 0x7fe4f815ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:26.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.439+0000 7fe4f6800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4f815e730 0x7fe4f815ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:57500/0 (socket says 172.21.15.122:57500) 2024-05-28T06:06:26.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.439+0000 7fe4f6800640 1 -- 172.21.15.122:0/907526086 learned_addr learned my addr 172.21.15.122:0/907526086 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:26.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.439+0000 7fe4efe00640 1 --2- 172.21.15.122:0/907526086 >> v2:172.21.15.153:3300/0 conn(0x7fe4f80ce4f0 0x7fe4f80ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:26.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.439+0000 7fe4f6800640 1 -- 172.21.15.122:0/907526086 >> v2:172.21.15.153:3300/0 conn(0x7fe4f80ce4f0 msgr2=0x7fe4f80ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:26.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.439+0000 7fe4f6800640 1 --2- 172.21.15.122:0/907526086 >> v2:172.21.15.153:3300/0 conn(0x7fe4f80ce4f0 0x7fe4f80ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.439+0000 7fe4f6800640 1 -- 172.21.15.122:0/907526086 >> v1:172.21.15.153:6789/0 conn(0x7fe4f80b58d0 legacy=0x7fe4f80b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:26.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.439+0000 7fe4f6800640 1 -- 172.21.15.122:0/907526086 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f815e210 con 0x7fe4f815e730 2024-05-28T06:06:26.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.443+0000 7fe4f6800640 1 --2- 172.21.15.122:0/907526086 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4f815e730 0x7fe4f815ebc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009e50 tx=0x7fe4f001ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f49b68723b8368b server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:26.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.443+0000 7fe4f5400640 1 -- 172.21.15.122:0/907526086 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f00a57b0 con 0x7fe4f815e730 2024-05-28T06:06:26.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.443+0000 7fe4f5400640 1 -- 172.21.15.122:0/907526086 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4f00a5950 con 0x7fe4f815e730 2024-05-28T06:06:26.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.443+0000 7fe4f5400640 1 -- 172.21.15.122:0/907526086 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f00a5d20 con 0x7fe4f815e730 2024-05-28T06:06:26.450 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.443+0000 7fe4fcc00640 1 -- 172.21.15.122:0/907526086 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4f815e730 msgr2=0x7fe4f815ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:26.450 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.443+0000 7fe4fcc00640 1 --2- 172.21.15.122:0/907526086 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4f815e730 0x7fe4f815ebc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009e50 tx=0x7fe4f001ca30 comp rx=0 tx=0).stop 2024-05-28T06:06:26.450 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.443+0000 7fe4fcc00640 1 -- 172.21.15.122:0/907526086 shutdown_connections 2024-05-28T06:06:26.450 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.443+0000 7fe4fcc00640 1 --2- 172.21.15.122:0/907526086 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4f815e730 0x7fe4f815ebc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.450 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.443+0000 7fe4fcc00640 1 --2- 172.21.15.122:0/907526086 >> v2:172.21.15.153:3300/0 conn(0x7fe4f80ce4f0 0x7fe4f80ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.450 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.443+0000 7fe4fcc00640 1 -- 172.21.15.122:0/907526086 >> 172.21.15.122:0/907526086 conn(0x7fe4f806bd90 msgr2=0x7fe4f806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:26.450 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.443+0000 7fe4fcc00640 1 -- 172.21.15.122:0/907526086 shutdown_connections 2024-05-28T06:06:26.450 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.443+0000 7fe4fcc00640 1 -- 172.21.15.122:0/907526086 wait complete. 2024-05-28T06:06:26.451 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4fcc00640 1 Processor -- start 2024-05-28T06:06:26.451 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4fcc00640 1 -- start start 2024-05-28T06:06:26.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4fcc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4f80b58d0 0x7fe4f813bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:26.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4fcc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4f80ce4f0 0x7fe4f80b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:26.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4fcc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4f815e730 0x7fe4f80adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:26.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4fcc00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f81693d0 con 0x7fe4f815e730 2024-05-28T06:06:26.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4fcc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f8169250 con 0x7fe4f80ce4f0 2024-05-28T06:06:26.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4fcc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f8169550 con 0x7fe4f80b58d0 2024-05-28T06:06:26.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4f6800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4f815e730 0x7fe4f80adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:26.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4f6800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4f815e730 0x7fe4f80adad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37666/0 (socket says 172.21.15.122:37666) 2024-05-28T06:06:26.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4f6800640 1 -- 172.21.15.122:0/837575165 learned_addr learned my addr 172.21.15.122:0/837575165 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:26.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4f5e00640 1 --2- 172.21.15.122:0/837575165 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4f80b58d0 0x7fe4f813bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:26.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4efe00640 1 --2- 172.21.15.122:0/837575165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4f80ce4f0 0x7fe4f80b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:26.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4f6800640 1 -- 172.21.15.122:0/837575165 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4f80b58d0 msgr2=0x7fe4f813bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:26.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4f6800640 1 --2- 172.21.15.122:0/837575165 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4f80b58d0 0x7fe4f813bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4f6800640 1 -- 172.21.15.122:0/837575165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4f80ce4f0 msgr2=0x7fe4f80b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:26.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4f6800640 1 --2- 172.21.15.122:0/837575165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4f80ce4f0 0x7fe4f80b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4f6800640 1 -- 172.21.15.122:0/837575165 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f81fb420 con 0x7fe4f815e730 2024-05-28T06:06:26.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4f6800640 1 --2- 172.21.15.122:0/837575165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4f815e730 0x7fe4f80adad0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00af040 tx=0x7fe4f00197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:26.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4ee000640 1 -- 172.21.15.122:0/837575165 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f00bc070 con 0x7fe4f815e730 2024-05-28T06:06:26.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4ee000640 1 -- 172.21.15.122:0/837575165 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4f00b8640 con 0x7fe4f815e730 2024-05-28T06:06:26.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4fcc00640 1 -- 172.21.15.122:0/837575165 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f81fb700 con 0x7fe4f815e730 2024-05-28T06:06:26.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4ee000640 1 -- 172.21.15.122:0/837575165 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f00b89f0 con 0x7fe4f815e730 2024-05-28T06:06:26.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4fcc00640 1 -- 172.21.15.122:0/837575165 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f81fbcc0 con 0x7fe4f815e730 2024-05-28T06:06:26.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.447+0000 7fe4fcc00640 1 -- 172.21.15.122:0/837575165 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f8068c40 con 0x7fe4f815e730 2024-05-28T06:06:26.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.451+0000 7fe4ee000640 1 -- 172.21.15.122:0/837575165 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe4f815f910 con 0x7fe4f815e730 2024-05-28T06:06:26.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.451+0000 7fe4ee000640 1 --2- 172.21.15.122:0/837575165 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe4d4068380 0x7fe4d406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:26.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.451+0000 7fe4ee000640 1 -- 172.21.15.122:0/837575165 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe4f01216e0 con 0x7fe4f815e730 2024-05-28T06:06:26.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.451+0000 7fe4f5e00640 1 --2- 172.21.15.122:0/837575165 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe4d4068380 0x7fe4d406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:26.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.451+0000 7fe4f5e00640 1 --2- 172.21.15.122:0/837575165 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe4d4068380 0x7fe4d406a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8001810 tx=0x7fe4e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:26.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.455+0000 7fe4ee000640 1 -- 172.21.15.122:0/837575165 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe4f0016620 con 0x7fe4f815e730 2024-05-28T06:06:26.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.611+0000 7fe4fcc00640 1 -- 172.21.15.122:0/837575165 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe4f8144870 con 0x7fe4f815e730 2024-05-28T06:06:26.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.611+0000 7fe4ee000640 1 -- 172.21.15.122:0/837575165 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fe4f00f15c0 con 0x7fe4f815e730 2024-05-28T06:06:26.619 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:06:26.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.615+0000 7fe4fcc00640 1 -- 172.21.15.122:0/837575165 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe4d4068380 msgr2=0x7fe4d406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:26.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.615+0000 7fe4fcc00640 1 --2- 172.21.15.122:0/837575165 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe4d4068380 0x7fe4d406a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8001810 tx=0x7fe4e8009040 comp rx=0 tx=0).stop 2024-05-28T06:06:26.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.615+0000 7fe4fcc00640 1 -- 172.21.15.122:0/837575165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4f815e730 msgr2=0x7fe4f80adad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:26.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.615+0000 7fe4fcc00640 1 --2- 172.21.15.122:0/837575165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4f815e730 0x7fe4f80adad0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00af040 tx=0x7fe4f00197d0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.615+0000 7fe4fcc00640 1 -- 172.21.15.122:0/837575165 shutdown_connections 2024-05-28T06:06:26.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.615+0000 7fe4fcc00640 1 --2- 172.21.15.122:0/837575165 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe4d4068380 0x7fe4d406a840 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.615+0000 7fe4fcc00640 1 --2- 172.21.15.122:0/837575165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4f815e730 0x7fe4f80adad0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.615+0000 7fe4fcc00640 1 --2- 172.21.15.122:0/837575165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4f80ce4f0 0x7fe4f80b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.615+0000 7fe4fcc00640 1 --2- 172.21.15.122:0/837575165 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4f80b58d0 0x7fe4f813bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.615+0000 7fe4fcc00640 1 -- 172.21.15.122:0/837575165 >> 172.21.15.122:0/837575165 conn(0x7fe4f806bd90 msgr2=0x7fe4f80b1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:26.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.615+0000 7fe4fcc00640 1 -- 172.21.15.122:0/837575165 shutdown_connections 2024-05-28T06:06:26.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.615+0000 7fe4fcc00640 1 -- 172.21.15.122:0/837575165 wait complete. 2024-05-28T06:06:26.641 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-28T06:06:26.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.775+0000 7fc979400640 1 Processor -- start 2024-05-28T06:06:26.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.775+0000 7fc979400640 1 -- start start 2024-05-28T06:06:26.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.775+0000 7fc979400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc97409aca0 0x7fc9740b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:26.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.775+0000 7fc979400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc97409b080 0x7fc97409b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:26.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.775+0000 7fc979400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc97415fb30 0x7fc97415ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:26.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.775+0000 7fc979400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fc9740b5460 con 0x7fc97415fb30 2024-05-28T06:06:26.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.775+0000 7fc979400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc9741604c0 con 0x7fc97409b080 2024-05-28T06:06:26.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.775+0000 7fc979400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc9740d0bf0 con 0x7fc97409aca0 2024-05-28T06:06:26.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.775+0000 7fc973200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc97415fb30 0x7fc97415ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:26.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.775+0000 7fc973200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc97415fb30 0x7fc97415ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37672/0 (socket says 172.21.15.122:37672) 2024-05-28T06:06:26.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.775+0000 7fc973200640 1 -- 172.21.15.122:0/3320456524 learned_addr learned my addr 172.21.15.122:0/3320456524 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:26.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.775+0000 7fc972800640 1 --2- 172.21.15.122:0/3320456524 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc97409aca0 0x7fc9740b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:26.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.775+0000 7fc969e00640 1 --2- 172.21.15.122:0/3320456524 >> v2:172.21.15.153:3300/0 conn(0x7fc97409b080 0x7fc97409b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:26.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.775+0000 7fc973200640 1 -- 172.21.15.122:0/3320456524 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc97409aca0 msgr2=0x7fc9740b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:26.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.775+0000 7fc973200640 1 --2- 172.21.15.122:0/3320456524 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc97409aca0 0x7fc9740b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.775+0000 7fc973200640 1 -- 172.21.15.122:0/3320456524 >> v2:172.21.15.153:3300/0 conn(0x7fc97409b080 msgr2=0x7fc97409b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:26.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.775+0000 7fc973200640 1 --2- 172.21.15.122:0/3320456524 >> v2:172.21.15.153:3300/0 conn(0x7fc97409b080 0x7fc97409b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.775+0000 7fc973200640 1 -- 172.21.15.122:0/3320456524 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9740d0eb0 con 0x7fc97415fb30 2024-05-28T06:06:26.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.779+0000 7fc973200640 1 --2- 172.21.15.122:0/3320456524 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc97415fb30 0x7fc97415ff80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc9740732d0 tx=0x7fc96c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcff9ba76e8d8a91 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:26.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.779+0000 7fc971e00640 1 -- 172.21.15.122:0/3320456524 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c0a55f0 con 0x7fc97415fb30 2024-05-28T06:06:26.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.779+0000 7fc971e00640 1 -- 172.21.15.122:0/3320456524 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc96c0a5790 con 0x7fc97415fb30 2024-05-28T06:06:26.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.779+0000 7fc971e00640 1 -- 172.21.15.122:0/3320456524 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c0a5b60 con 0x7fc97415fb30 2024-05-28T06:06:26.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.779+0000 7fc979400640 1 -- 172.21.15.122:0/3320456524 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc97415fb30 msgr2=0x7fc97415ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:26.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.779+0000 7fc979400640 1 --2- 172.21.15.122:0/3320456524 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc97415fb30 0x7fc97415ff80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc9740732d0 tx=0x7fc96c01c960 comp rx=0 tx=0).stop 2024-05-28T06:06:26.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.779+0000 7fc979400640 1 -- 172.21.15.122:0/3320456524 shutdown_connections 2024-05-28T06:06:26.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.779+0000 7fc979400640 1 --2- 172.21.15.122:0/3320456524 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc97415fb30 0x7fc97415ff80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.779+0000 7fc979400640 1 --2- 172.21.15.122:0/3320456524 >> v2:172.21.15.153:3300/0 conn(0x7fc97409b080 0x7fc97409b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.779+0000 7fc979400640 1 --2- 172.21.15.122:0/3320456524 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc97409aca0 0x7fc9740b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.779+0000 7fc979400640 1 -- 172.21.15.122:0/3320456524 >> 172.21.15.122:0/3320456524 conn(0x7fc9740b4100 msgr2=0x7fc9740b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:26.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.779+0000 7fc979400640 1 -- 172.21.15.122:0/3320456524 shutdown_connections 2024-05-28T06:06:26.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.779+0000 7fc979400640 1 -- 172.21.15.122:0/3320456524 wait complete. 2024-05-28T06:06:26.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc979400640 1 Processor -- start 2024-05-28T06:06:26.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc979400640 1 -- start start 2024-05-28T06:06:26.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc979400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc97409aca0 0x7fc9740cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:26.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc979400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc97409b080 0x7fc97415e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:26.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc979400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc97415fb30 0x7fc97415ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:26.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc979400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc9740cde00 con 0x7fc97415fb30 2024-05-28T06:06:26.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc979400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc9740cdc80 con 0x7fc97409aca0 2024-05-28T06:06:26.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc979400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc9740cdf80 con 0x7fc97409b080 2024-05-28T06:06:26.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc973200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc97415fb30 0x7fc97415ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:26.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc973200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc97415fb30 0x7fc97415ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37678/0 (socket says 172.21.15.122:37678) 2024-05-28T06:06:26.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc973200640 1 -- 172.21.15.122:0/1093763901 learned_addr learned my addr 172.21.15.122:0/1093763901 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:26.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc972800640 1 --2- 172.21.15.122:0/1093763901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc97409aca0 0x7fc9740cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:26.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc969e00640 1 --2- 172.21.15.122:0/1093763901 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc97409b080 0x7fc97415e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:26.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc973200640 1 -- 172.21.15.122:0/1093763901 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc97409b080 msgr2=0x7fc97415e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:26.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc973200640 1 --2- 172.21.15.122:0/1093763901 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc97409b080 0x7fc97415e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc973200640 1 -- 172.21.15.122:0/1093763901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc97409aca0 msgr2=0x7fc9740cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:26.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc973200640 1 --2- 172.21.15.122:0/1093763901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc97409aca0 0x7fc9740cbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc973200640 1 -- 172.21.15.122:0/1093763901 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc974164bd0 con 0x7fc97415fb30 2024-05-28T06:06:26.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc973200640 1 --2- 172.21.15.122:0/1093763901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc97415fb30 0x7fc97415ea10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0af040 tx=0x7fc96c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:26.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc96b400640 1 -- 172.21.15.122:0/1093763901 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c0bc020 con 0x7fc97415fb30 2024-05-28T06:06:26.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc96b400640 1 -- 172.21.15.122:0/1093763901 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc96c0b8670 con 0x7fc97415fb30 2024-05-28T06:06:26.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc979400640 1 -- 172.21.15.122:0/1093763901 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc974164eb0 con 0x7fc97415fb30 2024-05-28T06:06:26.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc96b400640 1 -- 172.21.15.122:0/1093763901 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c009510 con 0x7fc97415fb30 2024-05-28T06:06:26.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc979400640 1 -- 172.21.15.122:0/1093763901 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc974165470 con 0x7fc97415fb30 2024-05-28T06:06:26.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.783+0000 7fc979400640 1 -- 172.21.15.122:0/1093763901 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc974068c40 con 0x7fc97415fb30 2024-05-28T06:06:26.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.787+0000 7fc96b400640 1 -- 172.21.15.122:0/1093763901 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc96c0bf020 con 0x7fc97415fb30 2024-05-28T06:06:26.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.787+0000 7fc96b400640 1 --2- 172.21.15.122:0/1093763901 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc950068380 0x7fc95006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:26.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.787+0000 7fc96b400640 1 -- 172.21.15.122:0/1093763901 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc96c121830 con 0x7fc97415fb30 2024-05-28T06:06:26.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.787+0000 7fc972800640 1 --2- 172.21.15.122:0/1093763901 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc950068380 0x7fc95006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:26.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.787+0000 7fc972800640 1 --2- 172.21.15.122:0/1093763901 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc950068380 0x7fc95006a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc96400b930 tx=0x7fc964008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:26.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.791+0000 7fc96b400640 1 -- 172.21.15.122:0/1093763901 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc96c0c6030 con 0x7fc97415fb30 2024-05-28T06:06:26.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.947+0000 7fc979400640 1 -- 172.21.15.122:0/1093763901 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc9740b64d0 con 0x7fc97415fb30 2024-05-28T06:06:26.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.947+0000 7fc96b400640 1 -- 172.21.15.122:0/1093763901 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fc96c0165e0 con 0x7fc97415fb30 2024-05-28T06:06:26.953 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 32 2024-05-28T06:06:26.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.947+0000 7fc979400640 1 -- 172.21.15.122:0/1093763901 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc950068380 msgr2=0x7fc95006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:26.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.947+0000 7fc979400640 1 --2- 172.21.15.122:0/1093763901 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc950068380 0x7fc95006a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc96400b930 tx=0x7fc964008040 comp rx=0 tx=0).stop 2024-05-28T06:06:26.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.947+0000 7fc979400640 1 -- 172.21.15.122:0/1093763901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc97415fb30 msgr2=0x7fc97415ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:26.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.947+0000 7fc979400640 1 --2- 172.21.15.122:0/1093763901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc97415fb30 0x7fc97415ea10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0af040 tx=0x7fc96c019700 comp rx=0 tx=0).stop 2024-05-28T06:06:26.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.947+0000 7fc979400640 1 -- 172.21.15.122:0/1093763901 shutdown_connections 2024-05-28T06:06:26.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.947+0000 7fc979400640 1 --2- 172.21.15.122:0/1093763901 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc950068380 0x7fc95006a840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.947+0000 7fc979400640 1 --2- 172.21.15.122:0/1093763901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc97415fb30 0x7fc97415ea10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.947+0000 7fc979400640 1 --2- 172.21.15.122:0/1093763901 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc97409b080 0x7fc97415e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.947+0000 7fc979400640 1 --2- 172.21.15.122:0/1093763901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc97409aca0 0x7fc9740cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:26.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.947+0000 7fc979400640 1 -- 172.21.15.122:0/1093763901 >> 172.21.15.122:0/1093763901 conn(0x7fc9740b4100 msgr2=0x7fc9740b5740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:26.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.947+0000 7fc979400640 1 -- 172.21.15.122:0/1093763901 shutdown_connections 2024-05-28T06:06:26.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:26.947+0000 7fc979400640 1 -- 172.21.15.122:0/1093763901 wait complete. 2024-05-28T06:06:26.973 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-28T06:06:27.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.107+0000 7f580e400640 1 Processor -- start 2024-05-28T06:06:27.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.107+0000 7f580e400640 1 -- start start 2024-05-28T06:06:27.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.107+0000 7f580e400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f58080b58d0 0x7f58080b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:27.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.107+0000 7f580e400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58080ce4f0 0x7f58080ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:27.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.107+0000 7f580e400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f58080722a0 0x7f5808072730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:27.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.107+0000 7f580e400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f58080b61f0 con 0x7f58080b58d0 2024-05-28T06:06:27.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.107+0000 7f580e400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f580815d970 con 0x7f58080722a0 2024-05-28T06:06:27.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.107+0000 7f580e400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f580815dc50 con 0x7f58080ce4f0 2024-05-28T06:06:27.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.107+0000 7f5807400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f58080b58d0 0x7f58080b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:27.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.107+0000 7f5807400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f58080b58d0 0x7f58080b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37680/0 (socket says 172.21.15.122:37680) 2024-05-28T06:06:27.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.107+0000 7f5807400640 1 -- 172.21.15.122:0/2826029440 learned_addr learned my addr 172.21.15.122:0/2826029440 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:27.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.107+0000 7f5807e00640 1 --2- 172.21.15.122:0/2826029440 >> v2:172.21.15.153:3300/0 conn(0x7f58080722a0 0x7f5808072730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:27.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.107+0000 7f57ffe00640 1 --2- 172.21.15.122:0/2826029440 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58080ce4f0 0x7f58080ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:27.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.107+0000 7f5807400640 1 -- 172.21.15.122:0/2826029440 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58080ce4f0 msgr2=0x7f58080ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:27.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.107+0000 7f5807400640 1 --2- 172.21.15.122:0/2826029440 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58080ce4f0 0x7f58080ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.107+0000 7f5807400640 1 -- 172.21.15.122:0/2826029440 >> v2:172.21.15.153:3300/0 conn(0x7f58080722a0 msgr2=0x7f5808072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:27.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.107+0000 7f5807400640 1 --2- 172.21.15.122:0/2826029440 >> v2:172.21.15.153:3300/0 conn(0x7f58080722a0 0x7f5808072730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.107+0000 7f5807400640 1 -- 172.21.15.122:0/2826029440 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f580815df30 con 0x7f58080b58d0 2024-05-28T06:06:27.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.111+0000 7f5807400640 1 --2- 172.21.15.122:0/2826029440 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58080b58d0 0x7f58080b5cb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f58080b6720 tx=0x7f57f801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720bcacf00324a10 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:27.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.111+0000 7f5806a00640 1 -- 172.21.15.122:0/2826029440 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f80aa610 con 0x7f58080b58d0 2024-05-28T06:06:27.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.111+0000 7f5806a00640 1 -- 172.21.15.122:0/2826029440 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57f80af070 con 0x7f58080b58d0 2024-05-28T06:06:27.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.111+0000 7f5806a00640 1 -- 172.21.15.122:0/2826029440 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f80aa9d0 con 0x7f58080b58d0 2024-05-28T06:06:27.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.111+0000 7f580e400640 1 -- 172.21.15.122:0/2826029440 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58080b58d0 msgr2=0x7f58080b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:27.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.111+0000 7f580e400640 1 --2- 172.21.15.122:0/2826029440 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58080b58d0 0x7f58080b5cb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f58080b6720 tx=0x7f57f801c4f0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.111+0000 7f580e400640 1 -- 172.21.15.122:0/2826029440 shutdown_connections 2024-05-28T06:06:27.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.111+0000 7f580e400640 1 --2- 172.21.15.122:0/2826029440 >> v2:172.21.15.153:3300/0 conn(0x7f58080722a0 0x7f5808072730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.111+0000 7f580e400640 1 --2- 172.21.15.122:0/2826029440 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58080ce4f0 0x7f58080ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.111+0000 7f580e400640 1 --2- 172.21.15.122:0/2826029440 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58080b58d0 0x7f58080b5cb0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.111+0000 7f580e400640 1 -- 172.21.15.122:0/2826029440 >> 172.21.15.122:0/2826029440 conn(0x7f580806bd90 msgr2=0x7f580806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:27.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.111+0000 7f580e400640 1 -- 172.21.15.122:0/2826029440 shutdown_connections 2024-05-28T06:06:27.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.111+0000 7f580e400640 1 -- 172.21.15.122:0/2826029440 wait complete. 2024-05-28T06:06:27.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.111+0000 7f580e400640 1 Processor -- start 2024-05-28T06:06:27.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.111+0000 7f580e400640 1 -- start start 2024-05-28T06:06:27.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f580e400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58080722a0 0x7f58080ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:27.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f580e400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58080b58d0 0x7f580813e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:27.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f580e400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58080ce4f0 0x7f580815bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:27.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f580e400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5808146260 con 0x7f58080ce4f0 2024-05-28T06:06:27.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f580e400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f58080cee90 con 0x7f58080722a0 2024-05-28T06:06:27.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f580e400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f58080aa8b0 con 0x7f58080b58d0 2024-05-28T06:06:27.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f5807e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58080ce4f0 0x7f580815bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:27.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f5807400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58080722a0 0x7f58080ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:27.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f57ffe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58080b58d0 0x7f580813e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:27.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f5807e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58080ce4f0 0x7f580815bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37692/0 (socket says 172.21.15.122:37692) 2024-05-28T06:06:27.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f5807e00640 1 -- 172.21.15.122:0/2694258898 learned_addr learned my addr 172.21.15.122:0/2694258898 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:27.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f5807400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58080722a0 0x7f58080ac4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:52324/0 (socket says 172.21.15.122:52324) 2024-05-28T06:06:27.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f5807e00640 1 -- 172.21.15.122:0/2694258898 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58080b58d0 msgr2=0x7f580813e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:27.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f5807e00640 1 --2- 172.21.15.122:0/2694258898 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58080b58d0 0x7f580813e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f5807e00640 1 -- 172.21.15.122:0/2694258898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58080722a0 msgr2=0x7f58080ac4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:27.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f5807e00640 1 --2- 172.21.15.122:0/2694258898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58080722a0 0x7f58080ac4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f5807e00640 1 -- 172.21.15.122:0/2694258898 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58080aab90 con 0x7f58080ce4f0 2024-05-28T06:06:27.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f5807e00640 1 --2- 172.21.15.122:0/2694258898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58080ce4f0 0x7f580815bbf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5800007e60 tx=0x7f580000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:27.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f57ff400640 1 -- 172.21.15.122:0/2694258898 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5800014420 con 0x7f58080ce4f0 2024-05-28T06:06:27.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f57ff400640 1 -- 172.21.15.122:0/2694258898 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5800019070 con 0x7f58080ce4f0 2024-05-28T06:06:27.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f580e400640 1 -- 172.21.15.122:0/2694258898 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5808143370 con 0x7f58080ce4f0 2024-05-28T06:06:27.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f57ff400640 1 -- 172.21.15.122:0/2694258898 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5800014820 con 0x7f58080ce4f0 2024-05-28T06:06:27.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f580e400640 1 -- 172.21.15.122:0/2694258898 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58080aae70 con 0x7f58080ce4f0 2024-05-28T06:06:27.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.115+0000 7f580e400640 1 -- 172.21.15.122:0/2694258898 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5808068c40 con 0x7f58080ce4f0 2024-05-28T06:06:27.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.119+0000 7f57ff400640 1 -- 172.21.15.122:0/2694258898 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f58000149c0 con 0x7f58080ce4f0 2024-05-28T06:06:27.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.119+0000 7f57ff400640 1 --2- 172.21.15.122:0/2694258898 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f57e4068380 0x7f57e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:27.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.119+0000 7f57ff400640 1 -- 172.21.15.122:0/2694258898 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5800087140 con 0x7f58080ce4f0 2024-05-28T06:06:27.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.119+0000 7f5807400640 1 --2- 172.21.15.122:0/2694258898 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f57e4068380 0x7f57e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:27.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.119+0000 7f5807400640 1 --2- 172.21.15.122:0/2694258898 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f57e4068380 0x7f57e406a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f57f80ae000 tx=0x7f57f80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:27.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.123+0000 7f57ff400640 1 -- 172.21.15.122:0/2694258898 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5800057010 con 0x7f58080ce4f0 2024-05-28T06:06:27.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.279+0000 7f580e400640 1 -- 172.21.15.122:0/2694258898 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f580813c910 con 0x7f58080ce4f0 2024-05-28T06:06:27.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.279+0000 7f57ff400640 1 -- 172.21.15.122:0/2694258898 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f580005b310 con 0x7f58080ce4f0 2024-05-28T06:06:27.285 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 64 2024-05-28T06:06:27.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.283+0000 7f580e400640 1 -- 172.21.15.122:0/2694258898 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f57e4068380 msgr2=0x7f57e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:27.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.283+0000 7f580e400640 1 --2- 172.21.15.122:0/2694258898 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f57e4068380 0x7f57e406a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f57f80ae000 tx=0x7f57f80a7000 comp rx=0 tx=0).stop 2024-05-28T06:06:27.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.283+0000 7f580e400640 1 -- 172.21.15.122:0/2694258898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58080ce4f0 msgr2=0x7f580815bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:27.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.283+0000 7f580e400640 1 --2- 172.21.15.122:0/2694258898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58080ce4f0 0x7f580815bbf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5800007e60 tx=0x7f580000e4b0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.283+0000 7f580e400640 1 -- 172.21.15.122:0/2694258898 shutdown_connections 2024-05-28T06:06:27.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.283+0000 7f580e400640 1 --2- 172.21.15.122:0/2694258898 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f57e4068380 0x7f57e406a840 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.283+0000 7f580e400640 1 --2- 172.21.15.122:0/2694258898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58080ce4f0 0x7f580815bbf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.283+0000 7f580e400640 1 --2- 172.21.15.122:0/2694258898 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58080b58d0 0x7f580813e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.283+0000 7f580e400640 1 --2- 172.21.15.122:0/2694258898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58080722a0 0x7f58080ac4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.283+0000 7f580e400640 1 -- 172.21.15.122:0/2694258898 >> 172.21.15.122:0/2694258898 conn(0x7f580806bd90 msgr2=0x7f58080b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:27.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.283+0000 7f580e400640 1 -- 172.21.15.122:0/2694258898 shutdown_connections 2024-05-28T06:06:27.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.283+0000 7f580e400640 1 -- 172.21.15.122:0/2694258898 wait complete. 2024-05-28T06:06:27.307 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-28T06:06:27.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.439+0000 7fb85c800640 1 Processor -- start 2024-05-28T06:06:27.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.439+0000 7fb85c800640 1 -- start start 2024-05-28T06:06:27.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.443+0000 7fb85c800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb854159280 0x7fb8540b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:27.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.443+0000 7fb85c800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb8540cced0 0x7fb8540cd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:27.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.443+0000 7fb85c800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8540b54d0 con 0x7fb85415c7a0 2024-05-28T06:06:27.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.443+0000 7fb85c800640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fb8540cd880 con 0x7fb8540cced0 2024-05-28T06:06:27.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.443+0000 7fb85c800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb85415c310 con 0x7fb854159280 2024-05-28T06:06:27.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.443+0000 7fb85a800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb8540cced0 0x7fb8540cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:27.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.443+0000 7fb85a800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb8540cced0 0x7fb8540cd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37704/0 (socket says 172.21.15.122:37704) 2024-05-28T06:06:27.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.443+0000 7fb85a800640 1 -- 172.21.15.122:0/2893891877 learned_addr learned my addr 172.21.15.122:0/2893891877 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:27.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.443+0000 7fb859400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fb85415c7a0 0x7fb85406f1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47180/0 (socket says 172.21.15.122:47180) 2024-05-28T06:06:27.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.443+0000 7fb859e00640 1 --2- 172.21.15.122:0/2893891877 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb854159280 0x7fb8540b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:27.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.443+0000 7fb85a800640 1 -- 172.21.15.122:0/2893891877 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb854159280 msgr2=0x7fb8540b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:27.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.443+0000 7fb85a800640 1 --2- 172.21.15.122:0/2893891877 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb854159280 0x7fb8540b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.443+0000 7fb85a800640 1 -- 172.21.15.122:0/2893891877 >> v1:172.21.15.122:6789/0 conn(0x7fb85415c7a0 legacy=0x7fb85406f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:27.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.443+0000 7fb85a800640 1 -- 172.21.15.122:0/2893891877 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8540b57b0 con 0x7fb8540cced0 2024-05-28T06:06:27.451 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.447+0000 7fb85a800640 1 --2- 172.21.15.122:0/2893891877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8540cced0 0x7fb8540cd340 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb850009e50 tx=0x7fb85001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30254a31ffbfbd23 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:27.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.447+0000 7fb858a00640 1 -- 172.21.15.122:0/2893891877 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8500a5700 con 0x7fb8540cced0 2024-05-28T06:06:27.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.447+0000 7fb858a00640 1 -- 172.21.15.122:0/2893891877 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8500a58a0 con 0x7fb8540cced0 2024-05-28T06:06:27.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.447+0000 7fb858a00640 1 -- 172.21.15.122:0/2893891877 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8500a5c70 con 0x7fb8540cced0 2024-05-28T06:06:27.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.447+0000 7fb85c800640 1 -- 172.21.15.122:0/2893891877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8540cced0 msgr2=0x7fb8540cd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:27.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.447+0000 7fb85c800640 1 --2- 172.21.15.122:0/2893891877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8540cced0 0x7fb8540cd340 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb850009e50 tx=0x7fb85001ca30 comp rx=0 tx=0).stop 2024-05-28T06:06:27.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.447+0000 7fb85c800640 1 -- 172.21.15.122:0/2893891877 shutdown_connections 2024-05-28T06:06:27.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.447+0000 7fb85c800640 1 --2- 172.21.15.122:0/2893891877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8540cced0 0x7fb8540cd340 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.447+0000 7fb85c800640 1 --2- 172.21.15.122:0/2893891877 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb854159280 0x7fb8540b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.447+0000 7fb85c800640 1 -- 172.21.15.122:0/2893891877 >> 172.21.15.122:0/2893891877 conn(0x7fb854062a40 msgr2=0x7fb85406b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:27.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.447+0000 7fb85c800640 1 -- 172.21.15.122:0/2893891877 shutdown_connections 2024-05-28T06:06:27.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.447+0000 7fb85c800640 1 -- 172.21.15.122:0/2893891877 wait complete. 2024-05-28T06:06:27.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.447+0000 7fb85c800640 1 Processor -- start 2024-05-28T06:06:27.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.447+0000 7fb85c800640 1 -- start start 2024-05-28T06:06:27.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.451+0000 7fb85c800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb8540cced0 0x7fb854158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:27.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.451+0000 7fb85c800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb854159280 0x7fb8541fae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:27.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.451+0000 7fb85c800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb85415c7a0 0x7fb85415d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:27.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.451+0000 7fb85c800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb85415fd10 con 0x7fb85415c7a0 2024-05-28T06:06:27.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.451+0000 7fb85c800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb85415fb90 con 0x7fb854159280 2024-05-28T06:06:27.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.451+0000 7fb85c800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb85415fe90 con 0x7fb8540cced0 2024-05-28T06:06:27.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.451+0000 7fb85a800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb85415c7a0 0x7fb85415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:27.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.451+0000 7fb85a800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb85415c7a0 0x7fb85415d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37710/0 (socket says 172.21.15.122:37710) 2024-05-28T06:06:27.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.451+0000 7fb85a800640 1 -- 172.21.15.122:0/1303444895 learned_addr learned my addr 172.21.15.122:0/1303444895 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:27.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.451+0000 7fb85a800640 1 -- 172.21.15.122:0/1303444895 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb8540cced0 msgr2=0x7fb854158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:27.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.451+0000 7fb85a800640 1 --2- 172.21.15.122:0/1303444895 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb8540cced0 0x7fb854158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.451+0000 7fb85a800640 1 -- 172.21.15.122:0/1303444895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb854159280 msgr2=0x7fb8541fae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:27.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.451+0000 7fb85a800640 1 --2- 172.21.15.122:0/1303444895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb854159280 0x7fb8541fae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.451+0000 7fb85a800640 1 -- 172.21.15.122:0/1303444895 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb854158670 con 0x7fb85415c7a0 2024-05-28T06:06:27.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.451+0000 7fb85a800640 1 --2- 172.21.15.122:0/1303444895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb85415c7a0 0x7fb85415d040 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb8500af040 tx=0x7fb8500197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:27.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.451+0000 7fb84e000640 1 -- 172.21.15.122:0/1303444895 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8500b8670 con 0x7fb85415c7a0 2024-05-28T06:06:27.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.451+0000 7fb84e000640 1 -- 172.21.15.122:0/1303444895 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8500be070 con 0x7fb85415c7a0 2024-05-28T06:06:27.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.451+0000 7fb85c800640 1 -- 172.21.15.122:0/1303444895 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8541fb8f0 con 0x7fb85415c7a0 2024-05-28T06:06:27.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.451+0000 7fb84e000640 1 -- 172.21.15.122:0/1303444895 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8500b8a50 con 0x7fb85415c7a0 2024-05-28T06:06:27.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.451+0000 7fb85c800640 1 -- 172.21.15.122:0/1303444895 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8540ab0d0 con 0x7fb85415c7a0 2024-05-28T06:06:27.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.451+0000 7fb85c800640 1 -- 172.21.15.122:0/1303444895 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb854068bd0 con 0x7fb85415c7a0 2024-05-28T06:06:27.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.451+0000 7fb84e000640 1 -- 172.21.15.122:0/1303444895 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb8500b8bf0 con 0x7fb85415c7a0 2024-05-28T06:06:27.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.455+0000 7fb84e000640 1 --2- 172.21.15.122:0/1303444895 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb838068380 0x7fb83806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:27.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.455+0000 7fb84e000640 1 -- 172.21.15.122:0/1303444895 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb850121c20 con 0x7fb85415c7a0 2024-05-28T06:06:27.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.455+0000 7fb859e00640 1 --2- 172.21.15.122:0/1303444895 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb838068380 0x7fb83806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:27.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.455+0000 7fb859e00640 1 --2- 172.21.15.122:0/1303444895 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb838068380 0x7fb83806a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb848006aa0 tx=0x7fb848006a30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:27.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.459+0000 7fb84e000640 1 -- 172.21.15.122:0/1303444895 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb850016620 con 0x7fb85415c7a0 2024-05-28T06:06:27.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.627+0000 7fb85c800640 1 -- 172.21.15.122:0/1303444895 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb85406c720 con 0x7fb85415c7a0 2024-05-28T06:06:27.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.627+0000 7fb84e000640 1 -- 172.21.15.122:0/1303444895 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fb8500f2260 con 0x7fb85415c7a0 2024-05-28T06:06:27.635 INFO:teuthology.orchestra.run.smithi122.stderr:listed 0 entries 2024-05-28T06:06:27.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.631+0000 7fb85c800640 1 -- 172.21.15.122:0/1303444895 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb838068380 msgr2=0x7fb83806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:27.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.631+0000 7fb85c800640 1 --2- 172.21.15.122:0/1303444895 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb838068380 0x7fb83806a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb848006aa0 tx=0x7fb848006a30 comp rx=0 tx=0).stop 2024-05-28T06:06:27.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.631+0000 7fb85c800640 1 -- 172.21.15.122:0/1303444895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb85415c7a0 msgr2=0x7fb85415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:27.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.631+0000 7fb85c800640 1 --2- 172.21.15.122:0/1303444895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb85415c7a0 0x7fb85415d040 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb8500af040 tx=0x7fb8500197d0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.631+0000 7fb85c800640 1 -- 172.21.15.122:0/1303444895 shutdown_connections 2024-05-28T06:06:27.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.631+0000 7fb85c800640 1 --2- 172.21.15.122:0/1303444895 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb838068380 0x7fb83806a840 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.631+0000 7fb85c800640 1 --2- 172.21.15.122:0/1303444895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb85415c7a0 0x7fb85415d040 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.631+0000 7fb85c800640 1 --2- 172.21.15.122:0/1303444895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb854159280 0x7fb8541fae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.631+0000 7fb85c800640 1 --2- 172.21.15.122:0/1303444895 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb8540cced0 0x7fb854158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.631+0000 7fb85c800640 1 -- 172.21.15.122:0/1303444895 >> 172.21.15.122:0/1303444895 conn(0x7fb854062a40 msgr2=0x7fb85406df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:27.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.631+0000 7fb85c800640 1 -- 172.21.15.122:0/1303444895 shutdown_connections 2024-05-28T06:06:27.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.631+0000 7fb85c800640 1 -- 172.21.15.122:0/1303444895 wait complete. 2024-05-28T06:06:27.655 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-05-28T06:06:27.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:27.656 DEBUG:teuthology.orchestra.run.smithi122:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-05-28T06:06:27.679 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2024-05-28T06:06:27.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:27.679 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-28T06:06:27.731 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:06:27.731 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:06:27.741 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:06:27.741 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:06:27.792 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:06:27.792 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:06:27.844 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:06:27.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.975+0000 7f2966200640 1 Processor -- start 2024-05-28T06:06:27.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.975+0000 7f2966200640 1 -- start start 2024-05-28T06:06:27.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.975+0000 7f2966200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2960073c80 0x7f29600d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:27.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.975+0000 7f2966200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f29600b36b0 0x7f29600b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:27.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.975+0000 7f2966200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29600b46c0 con 0x7f296015ea20 2024-05-28T06:06:27.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.975+0000 7f2966200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f29600b4040 con 0x7f2960073c80 2024-05-28T06:06:27.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.975+0000 7f2966200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f296015ee00 con 0x7f29600b36b0 2024-05-28T06:06:27.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.975+0000 7f295ea00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2960073c80 0x7f29600d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:27.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.975+0000 7f295ea00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2960073c80 0x7f29600d0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37722/0 (socket says 172.21.15.122:37722) 2024-05-28T06:06:27.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.975+0000 7f295ea00640 1 -- 172.21.15.122:0/3586668716 learned_addr learned my addr 172.21.15.122:0/3586668716 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:27.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.975+0000 7f295fe00640 1 --2- 172.21.15.122:0/3586668716 >> v2:172.21.15.153:3300/0 conn(0x7f29600b36b0 0x7f29600b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:27.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.975+0000 7f295ea00640 1 -- 172.21.15.122:0/3586668716 >> v2:172.21.15.153:3300/0 conn(0x7f29600b36b0 msgr2=0x7f29600b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:27.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.975+0000 7f295ea00640 1 --2- 172.21.15.122:0/3586668716 >> v2:172.21.15.153:3300/0 conn(0x7f29600b36b0 0x7f29600b3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.975+0000 7f295ea00640 1 -- 172.21.15.122:0/3586668716 >> v1:172.21.15.153:6789/0 conn(0x7f296015ea20 legacy=0x7f29600b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:27.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.975+0000 7f295ea00640 1 -- 172.21.15.122:0/3586668716 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29600b49a0 con 0x7f2960073c80 2024-05-28T06:06:27.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.979+0000 7f295ea00640 1 --2- 172.21.15.122:0/3586668716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2960073c80 0x7f29600d0e10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f29600d25f0 tx=0x7f294c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6cefa8e2243264 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:27.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.979+0000 7f295e000640 1 -- 172.21.15.122:0/3586668716 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c0ab610 con 0x7f2960073c80 2024-05-28T06:06:27.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.979+0000 7f295e000640 1 -- 172.21.15.122:0/3586668716 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f294c0b0070 con 0x7f2960073c80 2024-05-28T06:06:27.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.979+0000 7f295e000640 1 -- 172.21.15.122:0/3586668716 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c0ab9d0 con 0x7f2960073c80 2024-05-28T06:06:27.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.979+0000 7f2966200640 1 -- 172.21.15.122:0/3586668716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2960073c80 msgr2=0x7f29600d0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:27.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.979+0000 7f2966200640 1 --2- 172.21.15.122:0/3586668716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2960073c80 0x7f29600d0e10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f29600d25f0 tx=0x7f294c01c520 comp rx=0 tx=0).stop 2024-05-28T06:06:27.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.979+0000 7f2966200640 1 -- 172.21.15.122:0/3586668716 shutdown_connections 2024-05-28T06:06:27.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.979+0000 7f2966200640 1 --2- 172.21.15.122:0/3586668716 >> v2:172.21.15.153:3300/0 conn(0x7f29600b36b0 0x7f29600b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.979+0000 7f2966200640 1 --2- 172.21.15.122:0/3586668716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2960073c80 0x7f29600d0e10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.979+0000 7f2966200640 1 -- 172.21.15.122:0/3586668716 >> 172.21.15.122:0/3586668716 conn(0x7f29600b6c10 msgr2=0x7f29600b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:27.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.979+0000 7f2966200640 1 -- 172.21.15.122:0/3586668716 shutdown_connections 2024-05-28T06:06:27.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.979+0000 7f2966200640 1 -- 172.21.15.122:0/3586668716 wait complete. 2024-05-28T06:06:27.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f2966200640 1 Processor -- start 2024-05-28T06:06:27.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f2966200640 1 -- start start 2024-05-28T06:06:27.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f2966200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2960073c80 0x7f296014ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:27.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f2966200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29600b36b0 0x7f29600cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:27.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f2966200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f296015ea20 0x7f2960159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:27.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f2966200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f29600ce960 con 0x7f296015ea20 2024-05-28T06:06:27.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f2966200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f29600b56d0 con 0x7f29600b36b0 2024-05-28T06:06:27.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f2966200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f29600ceae0 con 0x7f2960073c80 2024-05-28T06:06:27.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f295fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f296015ea20 0x7f2960159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:27.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f295fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f296015ea20 0x7f2960159f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37724/0 (socket says 172.21.15.122:37724) 2024-05-28T06:06:27.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f295fe00640 1 -- 172.21.15.122:0/3206644411 learned_addr learned my addr 172.21.15.122:0/3206644411 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:27.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f295f400640 1 --2- 172.21.15.122:0/3206644411 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2960073c80 0x7f296014ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:27.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f295ea00640 1 --2- 172.21.15.122:0/3206644411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29600b36b0 0x7f29600cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:27.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f295fe00640 1 -- 172.21.15.122:0/3206644411 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2960073c80 msgr2=0x7f296014ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:27.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f295fe00640 1 --2- 172.21.15.122:0/3206644411 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2960073c80 0x7f296014ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f295fe00640 1 -- 172.21.15.122:0/3206644411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29600b36b0 msgr2=0x7f29600cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:27.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f295fe00640 1 --2- 172.21.15.122:0/3206644411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29600b36b0 0x7f29600cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:27.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f295fe00640 1 -- 172.21.15.122:0/3206644411 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f296014a050 con 0x7f296015ea20 2024-05-28T06:06:27.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f295fe00640 1 --2- 172.21.15.122:0/3206644411 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f296015ea20 0x7f2960159f10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f295800efc0 tx=0x7f295800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:27.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f2957400640 1 -- 172.21.15.122:0/3206644411 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2958018020 con 0x7f296015ea20 2024-05-28T06:06:27.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f2957400640 1 -- 172.21.15.122:0/3206644411 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2958014480 con 0x7f296015ea20 2024-05-28T06:06:27.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f2957400640 1 -- 172.21.15.122:0/3206644411 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2958014870 con 0x7f296015ea20 2024-05-28T06:06:27.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f2966200640 1 -- 172.21.15.122:0/3206644411 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29600cbd70 con 0x7f296015ea20 2024-05-28T06:06:27.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.983+0000 7f2966200640 1 -- 172.21.15.122:0/3206644411 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29600cc330 con 0x7f296015ea20 2024-05-28T06:06:27.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.987+0000 7f2966200640 1 -- 172.21.15.122:0/3206644411 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2960068c40 con 0x7f296015ea20 2024-05-28T06:06:27.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.987+0000 7f2957400640 1 -- 172.21.15.122:0/3206644411 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f295801b020 con 0x7f296015ea20 2024-05-28T06:06:27.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.987+0000 7f2957400640 1 --2- 172.21.15.122:0/3206644411 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2940068380 0x7f294006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:27.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.987+0000 7f2957400640 1 -- 172.21.15.122:0/3206644411 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2958087460 con 0x7f296015ea20 2024-05-28T06:06:27.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.987+0000 7f295f400640 1 --2- 172.21.15.122:0/3206644411 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2940068380 0x7f294006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:27.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.987+0000 7f295f400640 1 --2- 172.21.15.122:0/3206644411 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2940068380 0x7f294006a840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2950001770 tx=0x7f2950009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:27.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:27.991+0000 7f2957400640 1 -- 172.21.15.122:0/3206644411 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2958022070 con 0x7f296015ea20 2024-05-28T06:06:28.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.147+0000 7f2966200640 1 -- 172.21.15.122:0/3206644411 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f296015ba00 con 0x7f296015ea20 2024-05-28T06:06:28.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.151+0000 7f2957400640 1 -- 172.21.15.122:0/3206644411 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f296014a050 con 0x7f296015ea20 2024-05-28T06:06:28.159 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:28.159 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":20,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:05:50.822555+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:05:47.441193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-28T06:05:48.148164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:06:28.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.151+0000 7f2966200640 1 -- 172.21.15.122:0/3206644411 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2940068380 msgr2=0x7f294006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:28.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.151+0000 7f2966200640 1 --2- 172.21.15.122:0/3206644411 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2940068380 0x7f294006a840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2950001770 tx=0x7f2950009040 comp rx=0 tx=0).stop 2024-05-28T06:06:28.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.151+0000 7f2966200640 1 -- 172.21.15.122:0/3206644411 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f296015ea20 msgr2=0x7f2960159f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:28.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.151+0000 7f2966200640 1 --2- 172.21.15.122:0/3206644411 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f296015ea20 0x7f2960159f10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f295800efc0 tx=0x7f295800c490 comp rx=0 tx=0).stop 2024-05-28T06:06:28.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.151+0000 7f2966200640 1 -- 172.21.15.122:0/3206644411 shutdown_connections 2024-05-28T06:06:28.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.151+0000 7f2966200640 1 --2- 172.21.15.122:0/3206644411 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2940068380 0x7f294006a840 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.151+0000 7f2966200640 1 --2- 172.21.15.122:0/3206644411 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f296015ea20 0x7f2960159f10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.151+0000 7f2966200640 1 --2- 172.21.15.122:0/3206644411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29600b36b0 0x7f29600cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.151+0000 7f2966200640 1 --2- 172.21.15.122:0/3206644411 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2960073c80 0x7f296014ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.151+0000 7f2966200640 1 -- 172.21.15.122:0/3206644411 >> 172.21.15.122:0/3206644411 conn(0x7f29600b6c10 msgr2=0x7f296014fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:28.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.151+0000 7f2966200640 1 -- 172.21.15.122:0/3206644411 shutdown_connections 2024-05-28T06:06:28.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.151+0000 7f2966200640 1 -- 172.21.15.122:0/3206644411 wait complete. 2024-05-28T06:06:28.178 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-28T06:05:47.441193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-28T06:05:48.148164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:06:28.179 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:06:28.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.311+0000 7f9fbb200640 1 Processor -- start 2024-05-28T06:06:28.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.311+0000 7f9fbb200640 1 -- start start 2024-05-28T06:06:28.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.315+0000 7f9fbb200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9fbc06cc60 0x7f9fbc09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:28.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.315+0000 7f9fbb200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9fbc09af80 0x7f9fbc0cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:28.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.315+0000 7f9fbb200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fbc0ccb80 con 0x7f9fbc161ff0 2024-05-28T06:06:28.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.315+0000 7f9fbb200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f9fbc0cce60 con 0x7f9fbc06cc60 2024-05-28T06:06:28.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.315+0000 7f9fbb200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9fbc0cd140 con 0x7f9fbc09af80 2024-05-28T06:06:28.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.315+0000 7f9fb1400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9fbc06cc60 0x7f9fbc09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:28.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.315+0000 7f9fb1400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9fbc06cc60 0x7f9fbc09aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37734/0 (socket says 172.21.15.122:37734) 2024-05-28T06:06:28.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.315+0000 7f9fb1400640 1 -- 172.21.15.122:0/734922149 learned_addr learned my addr 172.21.15.122:0/734922149 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:28.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.315+0000 7f9fb9e00640 1 --1- 172.21.15.122:0/734922149 >> v1:172.21.15.122:6789/0 conn(0x7f9fbc161ff0 0x7f9fbc0d1270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47188/0 (socket says 172.21.15.122:47188) 2024-05-28T06:06:28.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.315+0000 7f9fba800640 1 --2- 172.21.15.122:0/734922149 >> v2:172.21.15.153:3300/0 conn(0x7f9fbc09af80 0x7f9fbc0cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:28.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.315+0000 7f9fb1400640 1 -- 172.21.15.122:0/734922149 >> v2:172.21.15.153:3300/0 conn(0x7f9fbc09af80 msgr2=0x7f9fbc0cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:28.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.315+0000 7f9fb1400640 1 --2- 172.21.15.122:0/734922149 >> v2:172.21.15.153:3300/0 conn(0x7f9fbc09af80 0x7f9fbc0cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.315+0000 7f9fb1400640 1 -- 172.21.15.122:0/734922149 >> v1:172.21.15.122:6789/0 conn(0x7f9fbc161ff0 legacy=0x7f9fbc0d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:28.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.315+0000 7f9fb1400640 1 -- 172.21.15.122:0/734922149 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fbc0cd420 con 0x7f9fbc06cc60 2024-05-28T06:06:28.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.315+0000 7f9fba800640 1 --2- 172.21.15.122:0/734922149 >> v2:172.21.15.153:3300/0 conn(0x7f9fbc09af80 0x7f9fbc0cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:28.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.315+0000 7f9fb1400640 1 --2- 172.21.15.122:0/734922149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fbc06cc60 0x7f9fbc09aa40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc0cca70 tx=0x7f9fa401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7145a3dae0fc2abd server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:28.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fb9400640 1 -- 172.21.15.122:0/734922149 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa40b0070 con 0x7f9fbc06cc60 2024-05-28T06:06:28.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fb9400640 1 -- 172.21.15.122:0/734922149 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa40ab600 con 0x7f9fbc06cc60 2024-05-28T06:06:28.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fb9400640 1 -- 172.21.15.122:0/734922149 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa40ab9d0 con 0x7f9fbc06cc60 2024-05-28T06:06:28.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fbb200640 1 -- 172.21.15.122:0/734922149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fbc06cc60 msgr2=0x7f9fbc09aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:28.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fbb200640 1 --2- 172.21.15.122:0/734922149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fbc06cc60 0x7f9fbc09aa40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc0cca70 tx=0x7f9fa401c520 comp rx=0 tx=0).stop 2024-05-28T06:06:28.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fbb200640 1 -- 172.21.15.122:0/734922149 shutdown_connections 2024-05-28T06:06:28.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fbb200640 1 --2- 172.21.15.122:0/734922149 >> v2:172.21.15.153:3300/0 conn(0x7f9fbc09af80 0x7f9fbc0cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fbb200640 1 --2- 172.21.15.122:0/734922149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fbc06cc60 0x7f9fbc09aa40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fbb200640 1 -- 172.21.15.122:0/734922149 >> 172.21.15.122:0/734922149 conn(0x7f9fbc0b3f80 msgr2=0x7f9fbc0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:28.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fbb200640 1 -- 172.21.15.122:0/734922149 shutdown_connections 2024-05-28T06:06:28.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fbb200640 1 -- 172.21.15.122:0/734922149 wait complete. 2024-05-28T06:06:28.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fbb200640 1 Processor -- start 2024-05-28T06:06:28.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fbb200640 1 -- start start 2024-05-28T06:06:28.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fbb200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9fbc06cc60 0x7f9fbc14d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:28.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fbb200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9fbc09af80 0x7f9fbc0b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:28.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fbb200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fbc161ff0 0x7f9fbc0b0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:28.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fbb200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9fbc0cea20 con 0x7f9fbc161ff0 2024-05-28T06:06:28.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fbb200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9fbc0ce8a0 con 0x7f9fbc06cc60 2024-05-28T06:06:28.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fbb200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9fbc0ceba0 con 0x7f9fbc09af80 2024-05-28T06:06:28.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fba800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fbc161ff0 0x7f9fbc0b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:28.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fb9e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9fbc06cc60 0x7f9fbc14d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:28.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fba800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fbc161ff0 0x7f9fbc0b0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37740/0 (socket says 172.21.15.122:37740) 2024-05-28T06:06:28.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fba800640 1 -- 172.21.15.122:0/4115856972 learned_addr learned my addr 172.21.15.122:0/4115856972 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:28.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.319+0000 7f9fb1400640 1 --2- 172.21.15.122:0/4115856972 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9fbc09af80 0x7f9fbc0b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:28.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.323+0000 7f9fba800640 1 -- 172.21.15.122:0/4115856972 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9fbc09af80 msgr2=0x7f9fbc0b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:28.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.323+0000 7f9fba800640 1 --2- 172.21.15.122:0/4115856972 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9fbc09af80 0x7f9fbc0b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.323+0000 7f9fba800640 1 -- 172.21.15.122:0/4115856972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9fbc06cc60 msgr2=0x7f9fbc14d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:28.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.323+0000 7f9fba800640 1 --2- 172.21.15.122:0/4115856972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9fbc06cc60 0x7f9fbc14d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.323+0000 7f9fba800640 1 -- 172.21.15.122:0/4115856972 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fbc0b1910 con 0x7f9fbc161ff0 2024-05-28T06:06:28.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.323+0000 7f9fba800640 1 --2- 172.21.15.122:0/4115856972 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fbc161ff0 0x7f9fbc0b0170 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400cd50 tx=0x7f9fb400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:28.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.323+0000 7f9fb2a00640 1 -- 172.21.15.122:0/4115856972 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb400f680 con 0x7f9fbc161ff0 2024-05-28T06:06:28.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.323+0000 7f9fb2a00640 1 -- 172.21.15.122:0/4115856972 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fb400f840 con 0x7f9fbc161ff0 2024-05-28T06:06:28.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.323+0000 7f9fbb200640 1 -- 172.21.15.122:0/4115856972 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fbc0b2970 con 0x7f9fbc161ff0 2024-05-28T06:06:28.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.323+0000 7f9fb2a00640 1 -- 172.21.15.122:0/4115856972 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb400fc30 con 0x7f9fbc161ff0 2024-05-28T06:06:28.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.323+0000 7f9fbb200640 1 -- 172.21.15.122:0/4115856972 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fbc0b1e90 con 0x7f9fbc161ff0 2024-05-28T06:06:28.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.323+0000 7f9fbb200640 1 -- 172.21.15.122:0/4115856972 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fbc075620 con 0x7f9fbc161ff0 2024-05-28T06:06:28.330 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.323+0000 7f9fb2a00640 1 -- 172.21.15.122:0/4115856972 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9fb40213f0 con 0x7f9fbc161ff0 2024-05-28T06:06:28.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.323+0000 7f9fb2a00640 1 --2- 172.21.15.122:0/4115856972 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9f98068380 0x7f9f9806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:28.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.327+0000 7f9fb2a00640 1 -- 172.21.15.122:0/4115856972 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9fb4087530 con 0x7f9fbc161ff0 2024-05-28T06:06:28.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.327+0000 7f9fb9e00640 1 --2- 172.21.15.122:0/4115856972 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9f98068380 0x7f9f9806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:28.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.327+0000 7f9fb9e00640 1 --2- 172.21.15.122:0/4115856972 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9f98068380 0x7f9f9806a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc0b1640 tx=0x7f9fac007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:28.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.331+0000 7f9fb2a00640 1 -- 172.21.15.122:0/4115856972 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9fb4014030 con 0x7f9fbc161ff0 2024-05-28T06:06:28.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.487+0000 7f9fbb200640 1 -- 172.21.15.122:0/4115856972 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9fbc0cc590 con 0x7f9fbc161ff0 2024-05-28T06:06:28.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.487+0000 7f9fb2a00640 1 -- 172.21.15.122:0/4115856972 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f9fb4057530 con 0x7f9fbc161ff0 2024-05-28T06:06:28.494 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:06:28.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.491+0000 7f9fbb200640 1 -- 172.21.15.122:0/4115856972 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9f98068380 msgr2=0x7f9f9806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:28.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.491+0000 7f9fbb200640 1 --2- 172.21.15.122:0/4115856972 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9f98068380 0x7f9f9806a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc0b1640 tx=0x7f9fac007e90 comp rx=0 tx=0).stop 2024-05-28T06:06:28.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.491+0000 7f9fbb200640 1 -- 172.21.15.122:0/4115856972 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fbc161ff0 msgr2=0x7f9fbc0b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:28.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.491+0000 7f9fbb200640 1 --2- 172.21.15.122:0/4115856972 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fbc161ff0 0x7f9fbc0b0170 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400cd50 tx=0x7f9fb400a650 comp rx=0 tx=0).stop 2024-05-28T06:06:28.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.491+0000 7f9fbb200640 1 -- 172.21.15.122:0/4115856972 shutdown_connections 2024-05-28T06:06:28.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.491+0000 7f9fbb200640 1 --2- 172.21.15.122:0/4115856972 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9f98068380 0x7f9f9806a840 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.491+0000 7f9fbb200640 1 --2- 172.21.15.122:0/4115856972 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fbc161ff0 0x7f9fbc0b0170 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.491+0000 7f9fbb200640 1 --2- 172.21.15.122:0/4115856972 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9fbc09af80 0x7f9fbc0b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.491+0000 7f9fbb200640 1 --2- 172.21.15.122:0/4115856972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9fbc06cc60 0x7f9fbc14d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.491+0000 7f9fbb200640 1 -- 172.21.15.122:0/4115856972 >> 172.21.15.122:0/4115856972 conn(0x7f9fbc0b3f80 msgr2=0x7f9fbc0d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:28.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.491+0000 7f9fbb200640 1 -- 172.21.15.122:0/4115856972 shutdown_connections 2024-05-28T06:06:28.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.491+0000 7f9fbb200640 1 -- 172.21.15.122:0/4115856972 wait complete. 2024-05-28T06:06:28.516 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-28T06:06:28.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.647+0000 7f7238400640 1 Processor -- start 2024-05-28T06:06:28.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.647+0000 7f7238400640 1 -- start start 2024-05-28T06:06:28.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.647+0000 7f7238400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f723015f740 0x7f7230167240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:28.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f7238400640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f723015d970 con 0x7f72300b58d0 2024-05-28T06:06:28.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f7238400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f723015dc50 con 0x7f72300ce4f0 2024-05-28T06:06:28.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f7238400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f723015df30 con 0x7f723015f740 2024-05-28T06:06:28.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f7235a00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f72300b58d0 0x7f72300b5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47204/0 (socket says 172.21.15.122:47204) 2024-05-28T06:06:28.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f7235a00640 1 -- 172.21.15.122:0/4153246608 learned_addr learned my addr 172.21.15.122:0/4153246608 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:28.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f7236400640 1 --2- 172.21.15.122:0/4153246608 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f723015f740 0x7f7230167240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:28.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f722fe00640 1 -- 172.21.15.122:0/4153246608 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2107522351 0 0) 0x7f723015d970 con 0x7f72300b58d0 2024-05-28T06:06:28.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f722fe00640 1 -- 172.21.15.122:0/4153246608 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7218003530 con 0x7f72300b58d0 2024-05-28T06:06:28.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f722fe00640 1 -- 172.21.15.122:0/4153246608 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1584312068 0 0) 0x7f7218003530 con 0x7f72300b58d0 2024-05-28T06:06:28.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f722fe00640 1 -- 172.21.15.122:0/4153246608 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f723015f740 msgr2=0x7f7230167240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:28.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f722fe00640 1 --2- 172.21.15.122:0/4153246608 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f723015f740 0x7f7230167240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f722fe00640 1 -- 172.21.15.122:0/4153246608 >> v1:172.21.15.153:6789/0 conn(0x7f72300ce4f0 legacy=0x7f72300ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:28.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f722fe00640 1 -- 172.21.15.122:0/4153246608 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723015e210 con 0x7f72300b58d0 2024-05-28T06:06:28.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f722fe00640 1 -- 172.21.15.122:0/4153246608 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f7224001680 con 0x7f72300b58d0 2024-05-28T06:06:28.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f722fe00640 1 -- 172.21.15.122:0/4153246608 >> v1:172.21.15.122:6789/0 conn(0x7f72300b58d0 legacy=0x7f72300b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:28.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f722fe00640 1 --2- 172.21.15.122:0/4153246608 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f723015f740 0x7f72180039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:28.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f722fe00640 1 --2- 172.21.15.122:0/4153246608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7218003f70 0x7f7218004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:28.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f722fe00640 1 --2- 172.21.15.122:0/4153246608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7218004d50 0x7f72180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:28.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f722fe00640 1 -- 172.21.15.122:0/4153246608 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f723015df30 con 0x7f7218004d50 2024-05-28T06:06:28.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f722fe00640 1 -- 172.21.15.122:0/4153246608 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f721800bab0 con 0x7f7218003f70 2024-05-28T06:06:28.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f722fe00640 1 -- 172.21.15.122:0/4153246608 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f721800bcb0 con 0x7f723015f740 2024-05-28T06:06:28.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f7236400640 1 --2- 172.21.15.122:0/4153246608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7218004d50 0x7f72180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:28.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f7235a00640 1 --2- 172.21.15.122:0/4153246608 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f723015f740 0x7f72180039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:28.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f7235000640 1 --2- 172.21.15.122:0/4153246608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7218003f70 0x7f7218004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:28.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f7236400640 1 -- 172.21.15.122:0/4153246608 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f723015f740 msgr2=0x7f72180039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:28.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f7236400640 1 --2- 172.21.15.122:0/4153246608 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f723015f740 0x7f72180039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f7236400640 1 -- 172.21.15.122:0/4153246608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7218003f70 msgr2=0x7f7218004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:28.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f7236400640 1 --2- 172.21.15.122:0/4153246608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7218003f70 0x7f7218004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.651+0000 7f7236400640 1 -- 172.21.15.122:0/4153246608 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7218003530 con 0x7f7218004d50 2024-05-28T06:06:28.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.655+0000 7f7236400640 1 --2- 172.21.15.122:0/4153246608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7218004d50 0x7f72180051d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7228009f90 tx=0x7f722801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c8537a36a3a343 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:28.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.655+0000 7f722fe00640 1 -- 172.21.15.122:0/4153246608 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72280b2070 con 0x7f7218004d50 2024-05-28T06:06:28.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.655+0000 7f722fe00640 1 -- 172.21.15.122:0/4153246608 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72280a5c50 con 0x7f7218004d50 2024-05-28T06:06:28.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.655+0000 7f722fe00640 1 -- 172.21.15.122:0/4153246608 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7228009c10 con 0x7f7218004d50 2024-05-28T06:06:28.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.655+0000 7f7238400640 1 -- 172.21.15.122:0/4153246608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7218004d50 msgr2=0x7f72180051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:28.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.655+0000 7f7238400640 1 --2- 172.21.15.122:0/4153246608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7218004d50 0x7f72180051d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7228009f90 tx=0x7f722801cc40 comp rx=0 tx=0).stop 2024-05-28T06:06:28.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.655+0000 7f7236400640 1 -- 172.21.15.122:0/4153246608 reap_dead start 2024-05-28T06:06:28.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.655+0000 7f7238400640 1 -- 172.21.15.122:0/4153246608 shutdown_connections 2024-05-28T06:06:28.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.655+0000 7f7238400640 1 -- 172.21.15.122:0/4153246608 >> 172.21.15.122:0/4153246608 conn(0x7f723006bd90 msgr2=0x7f723006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:28.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.655+0000 7f7238400640 1 -- 172.21.15.122:0/4153246608 shutdown_connections 2024-05-28T06:06:28.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.655+0000 7f7238400640 1 -- 172.21.15.122:0/4153246608 wait complete. 2024-05-28T06:06:28.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.655+0000 7f7238400640 1 Processor -- start 2024-05-28T06:06:28.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.655+0000 7f7238400640 1 -- start start 2024-05-28T06:06:28.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f7238400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7218004d50 0x7f723013c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:28.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f7238400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72301407c0 0x7f723013cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:28.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f7238400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7230157a60 0x7f7230157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:28.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f7238400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7230146260 con 0x7f72301407c0 2024-05-28T06:06:28.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f7238400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7230165230 con 0x7f7218004d50 2024-05-28T06:06:28.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f7238400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f72300b3e10 con 0x7f7230157a60 2024-05-28T06:06:28.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f7235000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72301407c0 0x7f723013cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:28.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f7235000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72301407c0 0x7f723013cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37744/0 (socket says 172.21.15.122:37744) 2024-05-28T06:06:28.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f7235000640 1 -- 172.21.15.122:0/2668067332 learned_addr learned my addr 172.21.15.122:0/2668067332 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:28.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f7236400640 1 --2- 172.21.15.122:0/2668067332 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7230157a60 0x7f7230157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:28.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f7235a00640 1 --2- 172.21.15.122:0/2668067332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7218004d50 0x7f723013c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:28.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f7235000640 1 -- 172.21.15.122:0/2668067332 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7230157a60 msgr2=0x7f7230157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:28.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f7235000640 1 --2- 172.21.15.122:0/2668067332 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7230157a60 0x7f7230157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f7235000640 1 -- 172.21.15.122:0/2668067332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7218004d50 msgr2=0x7f723013c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:28.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f7235000640 1 --2- 172.21.15.122:0/2668067332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7218004d50 0x7f723013c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f7235000640 1 -- 172.21.15.122:0/2668067332 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723013d290 con 0x7f72301407c0 2024-05-28T06:06:28.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f7235000640 1 --2- 172.21.15.122:0/2668067332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72301407c0 0x7f723013cd50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f721c00f820 tx=0x7f721c00fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:28.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f722d600640 1 -- 172.21.15.122:0/2668067332 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c0050d0 con 0x7f72301407c0 2024-05-28T06:06:28.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f722d600640 1 -- 172.21.15.122:0/2668067332 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f721c018070 con 0x7f72301407c0 2024-05-28T06:06:28.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f7238400640 1 -- 172.21.15.122:0/2668067332 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72300b34e0 con 0x7f72301407c0 2024-05-28T06:06:28.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f722d600640 1 -- 172.21.15.122:0/2668067332 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c00d730 con 0x7f72301407c0 2024-05-28T06:06:28.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f7238400640 1 -- 172.21.15.122:0/2668067332 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72300b3aa0 con 0x7f72301407c0 2024-05-28T06:06:28.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f7238400640 1 -- 172.21.15.122:0/2668067332 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7230068c40 con 0x7f72301407c0 2024-05-28T06:06:28.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.659+0000 7f722d600640 1 -- 172.21.15.122:0/2668067332 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f721c00d8d0 con 0x7f72301407c0 2024-05-28T06:06:28.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.663+0000 7f722d600640 1 --2- 172.21.15.122:0/2668067332 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f72100683b0 0x7f721006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:28.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.663+0000 7f722d600640 1 -- 172.21.15.122:0/2668067332 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f721c086670 con 0x7f72301407c0 2024-05-28T06:06:28.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.663+0000 7f7235a00640 1 --2- 172.21.15.122:0/2668067332 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f72100683b0 0x7f721006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:28.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.663+0000 7f7235a00640 1 --2- 172.21.15.122:0/2668067332 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f72100683b0 0x7f721006a870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f723013f480 tx=0x7f72240011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:28.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.667+0000 7f722d600640 1 -- 172.21.15.122:0/2668067332 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f721c056c20 con 0x7f72301407c0 2024-05-28T06:06:28.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.823+0000 7f7238400640 1 -- 172.21.15.122:0/2668067332 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f723015cdd0 con 0x7f72301407c0 2024-05-28T06:06:28.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.823+0000 7f722d600640 1 -- 172.21.15.122:0/2668067332 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f721c056520 con 0x7f72301407c0 2024-05-28T06:06:28.830 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 32 2024-05-28T06:06:28.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.827+0000 7f7238400640 1 -- 172.21.15.122:0/2668067332 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f72100683b0 msgr2=0x7f721006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:28.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.827+0000 7f7238400640 1 --2- 172.21.15.122:0/2668067332 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f72100683b0 0x7f721006a870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f723013f480 tx=0x7f72240011a0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.827+0000 7f7238400640 1 -- 172.21.15.122:0/2668067332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72301407c0 msgr2=0x7f723013cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:28.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.827+0000 7f7238400640 1 --2- 172.21.15.122:0/2668067332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72301407c0 0x7f723013cd50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f721c00f820 tx=0x7f721c00fc20 comp rx=0 tx=0).stop 2024-05-28T06:06:28.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.827+0000 7f7238400640 1 -- 172.21.15.122:0/2668067332 shutdown_connections 2024-05-28T06:06:28.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.827+0000 7f7238400640 1 --2- 172.21.15.122:0/2668067332 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f72100683b0 0x7f721006a870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.827+0000 7f7238400640 1 --2- 172.21.15.122:0/2668067332 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7230157a60 0x7f7230157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.827+0000 7f7238400640 1 --2- 172.21.15.122:0/2668067332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72301407c0 0x7f723013cd50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.827+0000 7f7238400640 1 --2- 172.21.15.122:0/2668067332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7218004d50 0x7f723013c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.827+0000 7f7238400640 1 -- 172.21.15.122:0/2668067332 >> 172.21.15.122:0/2668067332 conn(0x7f723006bd90 msgr2=0x7f7230143260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:28.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.827+0000 7f7238400640 1 -- 172.21.15.122:0/2668067332 shutdown_connections 2024-05-28T06:06:28.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.827+0000 7f7238400640 1 -- 172.21.15.122:0/2668067332 wait complete. 2024-05-28T06:06:28.852 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-28T06:06:28.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.983+0000 7ffb0c600640 1 Processor -- start 2024-05-28T06:06:28.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb0c600640 1 -- start start 2024-05-28T06:06:28.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb0c600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffb0415f740 0x7ffb04167240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:28.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb0c600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb0415d970 con 0x7ffb040b58d0 2024-05-28T06:06:28.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb0c600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb0415dc50 con 0x7ffb040ce4f0 2024-05-28T06:06:28.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb0c600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ffb0415df30 con 0x7ffb0415f740 2024-05-28T06:06:28.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb09c00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7ffb040b58d0 0x7ffb040b5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47212/0 (socket says 172.21.15.122:47212) 2024-05-28T06:06:28.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb09c00640 1 -- 172.21.15.122:0/1017102255 learned_addr learned my addr 172.21.15.122:0/1017102255 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:28.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb0a600640 1 --2- 172.21.15.122:0/1017102255 >> v2:172.21.15.153:3300/0 conn(0x7ffb0415f740 0x7ffb04167240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:28.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb03e00640 1 -- 172.21.15.122:0/1017102255 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 466790480 0 0) 0x7ffb0415d970 con 0x7ffb040b58d0 2024-05-28T06:06:28.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb03e00640 1 -- 172.21.15.122:0/1017102255 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffaec003530 con 0x7ffb040b58d0 2024-05-28T06:06:28.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb03e00640 1 -- 172.21.15.122:0/1017102255 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4275202404 0 0) 0x7ffaec003530 con 0x7ffb040b58d0 2024-05-28T06:06:28.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb03e00640 1 -- 172.21.15.122:0/1017102255 >> v2:172.21.15.153:3300/0 conn(0x7ffb0415f740 msgr2=0x7ffb04167240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:28.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb03e00640 1 --2- 172.21.15.122:0/1017102255 >> v2:172.21.15.153:3300/0 conn(0x7ffb0415f740 0x7ffb04167240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb03e00640 1 -- 172.21.15.122:0/1017102255 >> v1:172.21.15.153:6789/0 conn(0x7ffb040ce4f0 legacy=0x7ffb040ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:28.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb03e00640 1 -- 172.21.15.122:0/1017102255 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb0415e210 con 0x7ffb040b58d0 2024-05-28T06:06:28.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb03e00640 1 -- 172.21.15.122:0/1017102255 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7ffaf8001a00 con 0x7ffb040b58d0 2024-05-28T06:06:28.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb03e00640 1 -- 172.21.15.122:0/1017102255 >> v1:172.21.15.122:6789/0 conn(0x7ffb040b58d0 legacy=0x7ffb040b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:28.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb03e00640 1 --2- 172.21.15.122:0/1017102255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaec0039c0 0x7ffaec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:28.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb03e00640 1 --2- 172.21.15.122:0/1017102255 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaec004810 0x7ffaec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:28.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb03e00640 1 --2- 172.21.15.122:0/1017102255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaec0051d0 0x7ffaec00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:28.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb03e00640 1 -- 172.21.15.122:0/1017102255 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0415df30 con 0x7ffaec0039c0 2024-05-28T06:06:28.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb03e00640 1 -- 172.21.15.122:0/1017102255 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec00c070 con 0x7ffaec0051d0 2024-05-28T06:06:28.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb03e00640 1 -- 172.21.15.122:0/1017102255 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ffaec00c270 con 0x7ffaec004810 2024-05-28T06:06:28.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb09c00640 1 --2- 172.21.15.122:0/1017102255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaec0039c0 0x7ffaec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:28.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb0a600640 1 --2- 172.21.15.122:0/1017102255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaec0051d0 0x7ffaec00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:28.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb09200640 1 --2- 172.21.15.122:0/1017102255 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaec004810 0x7ffaec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:28.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb09c00640 1 -- 172.21.15.122:0/1017102255 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaec004810 msgr2=0x7ffaec004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:28.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb09c00640 1 --2- 172.21.15.122:0/1017102255 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaec004810 0x7ffaec004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb09c00640 1 -- 172.21.15.122:0/1017102255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaec0051d0 msgr2=0x7ffaec00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:28.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb09c00640 1 --2- 172.21.15.122:0/1017102255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaec0051d0 0x7ffaec00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb09c00640 1 -- 172.21.15.122:0/1017102255 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaec003530 con 0x7ffaec0039c0 2024-05-28T06:06:28.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb0a600640 1 -- 172.21.15.122:0/1017102255 reap_dead start 2024-05-28T06:06:28.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.987+0000 7ffb09200640 1 --2- 172.21.15.122:0/1017102255 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaec004810 0x7ffaec004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:28.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.991+0000 7ffb09c00640 1 --2- 172.21.15.122:0/1017102255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaec0039c0 0x7ffaec003de0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80109e0 tx=0x7ffaf8021610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32589549e2283b server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:28.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.991+0000 7ffb03e00640 1 -- 172.21.15.122:0/1017102255 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf80b4070 con 0x7ffaec0039c0 2024-05-28T06:06:28.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.991+0000 7ffb03e00640 1 -- 172.21.15.122:0/1017102255 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf80af610 con 0x7ffaec0039c0 2024-05-28T06:06:28.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.991+0000 7ffb03e00640 1 -- 172.21.15.122:0/1017102255 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8010630 con 0x7ffaec0039c0 2024-05-28T06:06:28.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.991+0000 7ffb0c600640 1 -- 172.21.15.122:0/1017102255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaec0039c0 msgr2=0x7ffaec003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:28.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.991+0000 7ffb0c600640 1 --2- 172.21.15.122:0/1017102255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaec0039c0 0x7ffaec003de0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80109e0 tx=0x7ffaf8021610 comp rx=0 tx=0).stop 2024-05-28T06:06:28.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.991+0000 7ffb0c600640 1 -- 172.21.15.122:0/1017102255 shutdown_connections 2024-05-28T06:06:28.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.991+0000 7ffb0c600640 1 --2- 172.21.15.122:0/1017102255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaec0039c0 0x7ffaec003de0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:28.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.991+0000 7ffb0c600640 1 -- 172.21.15.122:0/1017102255 >> 172.21.15.122:0/1017102255 conn(0x7ffb0406bd90 msgr2=0x7ffb0406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:28.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.991+0000 7ffb0c600640 1 -- 172.21.15.122:0/1017102255 shutdown_connections 2024-05-28T06:06:28.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.991+0000 7ffb0c600640 1 -- 172.21.15.122:0/1017102255 wait complete. 2024-05-28T06:06:28.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.995+0000 7ffb0c600640 1 Processor -- start 2024-05-28T06:06:29.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.995+0000 7ffb0c600640 1 -- start start 2024-05-28T06:06:29.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.995+0000 7ffb0c600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaec0039c0 0x7ffb0413df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:29.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.995+0000 7ffb0c600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb04150100 0x7ffb04143210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:29.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.995+0000 7ffb0c600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb041f2bd0 0x7ffb041f3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:29.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.995+0000 7ffb0c600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ffb040722a0 con 0x7ffaec0039c0 2024-05-28T06:06:29.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.995+0000 7ffb0c600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffb040b56d0 con 0x7ffb041f2bd0 2024-05-28T06:06:29.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.995+0000 7ffb0c600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ffb04072420 con 0x7ffb04150100 2024-05-28T06:06:29.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.995+0000 7ffb09c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaec0039c0 0x7ffb0413df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:29.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.995+0000 7ffb09c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaec0039c0 0x7ffb0413df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37754/0 (socket says 172.21.15.122:37754) 2024-05-28T06:06:29.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.995+0000 7ffb09c00640 1 -- 172.21.15.122:0/1681289219 learned_addr learned my addr 172.21.15.122:0/1681289219 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:29.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.995+0000 7ffb09c00640 1 -- 172.21.15.122:0/1681289219 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb04150100 msgr2=0x7ffb04143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:29.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.995+0000 7ffb09c00640 1 --2- 172.21.15.122:0/1681289219 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb04150100 0x7ffb04143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.995+0000 7ffb09c00640 1 -- 172.21.15.122:0/1681289219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb041f2bd0 msgr2=0x7ffb041f3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:29.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.995+0000 7ffb09c00640 1 --2- 172.21.15.122:0/1681289219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb041f2bd0 0x7ffb041f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.995+0000 7ffb09c00640 1 -- 172.21.15.122:0/1681289219 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb041f3570 con 0x7ffaec0039c0 2024-05-28T06:06:29.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.995+0000 7ffb09c00640 1 --2- 172.21.15.122:0/1681289219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaec0039c0 0x7ffb0413df80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8027b40 tx=0x7ffaec005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:29.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.995+0000 7ffb01600640 1 -- 172.21.15.122:0/1681289219 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf80b4030 con 0x7ffaec0039c0 2024-05-28T06:06:29.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.995+0000 7ffb01600640 1 -- 172.21.15.122:0/1681289219 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf80c1070 con 0x7ffaec0039c0 2024-05-28T06:06:29.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.995+0000 7ffb0c600640 1 -- 172.21.15.122:0/1681289219 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb0413e6f0 con 0x7ffaec0039c0 2024-05-28T06:06:29.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.995+0000 7ffb01600640 1 -- 172.21.15.122:0/1681289219 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8010630 con 0x7ffaec0039c0 2024-05-28T06:06:29.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.995+0000 7ffb0c600640 1 -- 172.21.15.122:0/1681289219 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb0413ecb0 con 0x7ffaec0039c0 2024-05-28T06:06:29.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.995+0000 7ffb0c600640 1 -- 172.21.15.122:0/1681289219 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb04068c40 con 0x7ffaec0039c0 2024-05-28T06:06:29.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.999+0000 7ffb01600640 1 -- 172.21.15.122:0/1681289219 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffaf8001800 con 0x7ffaec0039c0 2024-05-28T06:06:29.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.999+0000 7ffb01600640 1 --2- 172.21.15.122:0/1681289219 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffae4068380 0x7ffae406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:29.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.999+0000 7ffb01600640 1 -- 172.21.15.122:0/1681289219 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ffaf8125710 con 0x7ffaec0039c0 2024-05-28T06:06:29.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.999+0000 7ffb09200640 1 --2- 172.21.15.122:0/1681289219 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffae4068380 0x7ffae406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:29.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:28.999+0000 7ffb09200640 1 --2- 172.21.15.122:0/1681289219 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffae4068380 0x7ffae406a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffb04143cf0 tx=0x7ffaf0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:29.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.003+0000 7ffb01600640 1 -- 172.21.15.122:0/1681289219 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffaf80ac070 con 0x7ffaec0039c0 2024-05-28T06:06:29.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.159+0000 7ffb0c600640 1 -- 172.21.15.122:0/1681289219 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ffb040cde30 con 0x7ffaec0039c0 2024-05-28T06:06:29.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.159+0000 7ffb01600640 1 -- 172.21.15.122:0/1681289219 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7ffaf801b320 con 0x7ffaec0039c0 2024-05-28T06:06:29.166 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 64 2024-05-28T06:06:29.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.163+0000 7ffb0c600640 1 -- 172.21.15.122:0/1681289219 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffae4068380 msgr2=0x7ffae406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:29.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.163+0000 7ffb0c600640 1 --2- 172.21.15.122:0/1681289219 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffae4068380 0x7ffae406a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffb04143cf0 tx=0x7ffaf0009040 comp rx=0 tx=0).stop 2024-05-28T06:06:29.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.163+0000 7ffb0c600640 1 -- 172.21.15.122:0/1681289219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaec0039c0 msgr2=0x7ffb0413df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:29.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.163+0000 7ffb0c600640 1 --2- 172.21.15.122:0/1681289219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaec0039c0 0x7ffb0413df80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8027b40 tx=0x7ffaec005840 comp rx=0 tx=0).stop 2024-05-28T06:06:29.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.163+0000 7ffb0c600640 1 -- 172.21.15.122:0/1681289219 shutdown_connections 2024-05-28T06:06:29.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.163+0000 7ffb0c600640 1 --2- 172.21.15.122:0/1681289219 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffae4068380 0x7ffae406a840 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.163+0000 7ffb0c600640 1 --2- 172.21.15.122:0/1681289219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb041f2bd0 0x7ffb041f3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.163+0000 7ffb0c600640 1 --2- 172.21.15.122:0/1681289219 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb04150100 0x7ffb04143210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.163+0000 7ffb0c600640 1 --2- 172.21.15.122:0/1681289219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaec0039c0 0x7ffb0413df80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.163+0000 7ffb0c600640 1 -- 172.21.15.122:0/1681289219 >> 172.21.15.122:0/1681289219 conn(0x7ffb0406bd90 msgr2=0x7ffb040b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:29.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.163+0000 7ffb0c600640 1 -- 172.21.15.122:0/1681289219 shutdown_connections 2024-05-28T06:06:29.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.163+0000 7ffb0c600640 1 -- 172.21.15.122:0/1681289219 wait complete. 2024-05-28T06:06:29.187 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-28T06:06:29.330 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.323+0000 7f8fc2800640 1 Processor -- start 2024-05-28T06:06:29.330 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.323+0000 7f8fc2800640 1 -- start start 2024-05-28T06:06:29.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.327+0000 7f8fc2800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8fbc0cced0 0x7f8fbc0cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:29.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.327+0000 7f8fc2800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fbc0cd840 con 0x7f8fbc0b4e10 2024-05-28T06:06:29.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.327+0000 7f8fc2800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fbc0b54d0 con 0x7f8fbc159280 2024-05-28T06:06:29.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.327+0000 7f8fc2800640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f8fbc15c310 con 0x7f8fbc0cced0 2024-05-28T06:06:29.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.327+0000 7f8fbbe00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8fbc0cced0 0x7f8fbc0cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:29.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.327+0000 7f8fb2a00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f8fbc0b4e10 0x7f8fbc06f1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47228/0 (socket says 172.21.15.122:47228) 2024-05-28T06:06:29.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.327+0000 7f8fb2a00640 1 -- 172.21.15.122:0/3880718649 learned_addr learned my addr 172.21.15.122:0/3880718649 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:29.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.327+0000 7f8fbbe00640 1 -- 172.21.15.122:0/3880718649 >> v1:172.21.15.153:6789/0 conn(0x7f8fbc159280 legacy=0x7f8fbc15c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:29.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.327+0000 7f8fbbe00640 1 -- 172.21.15.122:0/3880718649 >> v1:172.21.15.122:6789/0 conn(0x7f8fbc0b4e10 legacy=0x7f8fbc06f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:29.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.327+0000 7f8fbbe00640 1 -- 172.21.15.122:0/3880718649 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fbc0b57b0 con 0x7f8fbc0cced0 2024-05-28T06:06:29.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.327+0000 7f8fbaa00640 1 -- 172.21.15.122:0/3880718649 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1107295454 0 0) 0x7f8fa4001120 con 0x7f8fbc0b4e10 2024-05-28T06:06:29.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.331+0000 7f8fbbe00640 1 --2- 172.21.15.122:0/3880718649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fbc0cced0 0x7f8fbc0cd300 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc15c490 tx=0x7f8fb401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22943155d44ccc7 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:29.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.331+0000 7f8fbaa00640 1 -- 172.21.15.122:0/3880718649 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40b2070 con 0x7f8fbc0cced0 2024-05-28T06:06:29.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.331+0000 7f8fbaa00640 1 -- 172.21.15.122:0/3880718649 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb40a5810 con 0x7f8fbc0cced0 2024-05-28T06:06:29.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.331+0000 7f8fbaa00640 1 -- 172.21.15.122:0/3880718649 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40a5be0 con 0x7f8fbc0cced0 2024-05-28T06:06:29.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.331+0000 7f8fc2800640 1 -- 172.21.15.122:0/3880718649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fbc0cced0 msgr2=0x7f8fbc0cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:29.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.331+0000 7f8fc2800640 1 --2- 172.21.15.122:0/3880718649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fbc0cced0 0x7f8fbc0cd300 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc15c490 tx=0x7f8fb401c950 comp rx=0 tx=0).stop 2024-05-28T06:06:29.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.331+0000 7f8fc2800640 1 -- 172.21.15.122:0/3880718649 shutdown_connections 2024-05-28T06:06:29.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.331+0000 7f8fc2800640 1 --2- 172.21.15.122:0/3880718649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fbc0cced0 0x7f8fbc0cd300 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.331+0000 7f8fc2800640 1 -- 172.21.15.122:0/3880718649 >> 172.21.15.122:0/3880718649 conn(0x7f8fbc062a40 msgr2=0x7f8fbc06b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:29.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.331+0000 7f8fc2800640 1 -- 172.21.15.122:0/3880718649 shutdown_connections 2024-05-28T06:06:29.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.331+0000 7f8fc2800640 1 -- 172.21.15.122:0/3880718649 wait complete. 2024-05-28T06:06:29.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.331+0000 7f8fc2800640 1 Processor -- start 2024-05-28T06:06:29.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.331+0000 7f8fc2800640 1 -- start start 2024-05-28T06:06:29.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.331+0000 7f8fc2800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fbc0b4e10 0x7f8fbc157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:29.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.331+0000 7f8fc2800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8fbc0cced0 0x7f8fbc157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:29.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.331+0000 7f8fc2800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fbc159280 0x7f8fbc0aa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:29.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.331+0000 7f8fc2800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc0b5280 con 0x7f8fbc159280 2024-05-28T06:06:29.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.331+0000 7f8fc2800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc15fe60 con 0x7f8fbc0b4e10 2024-05-28T06:06:29.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.331+0000 7f8fc2800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8fbc1694e0 con 0x7f8fbc0cced0 2024-05-28T06:06:29.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.331+0000 7f8fbbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fbc159280 0x7f8fbc0aa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:29.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.331+0000 7f8fbbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fbc159280 0x7f8fbc0aa1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37772/0 (socket says 172.21.15.122:37772) 2024-05-28T06:06:29.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.331+0000 7f8fbbe00640 1 -- 172.21.15.122:0/77811720 learned_addr learned my addr 172.21.15.122:0/77811720 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:29.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.335+0000 7f8fb2a00640 1 --2- 172.21.15.122:0/77811720 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8fbc0cced0 0x7f8fbc157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:29.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.331+0000 7f8fbb400640 1 --2- 172.21.15.122:0/77811720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fbc0b4e10 0x7f8fbc157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:29.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.335+0000 7f8fbbe00640 1 -- 172.21.15.122:0/77811720 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8fbc0cced0 msgr2=0x7f8fbc157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:29.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.335+0000 7f8fbbe00640 1 --2- 172.21.15.122:0/77811720 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8fbc0cced0 0x7f8fbc157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.335+0000 7f8fbbe00640 1 -- 172.21.15.122:0/77811720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fbc0b4e10 msgr2=0x7f8fbc157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:29.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.335+0000 7f8fbbe00640 1 --2- 172.21.15.122:0/77811720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fbc0b4e10 0x7f8fbc157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.335+0000 7f8fbbe00640 1 -- 172.21.15.122:0/77811720 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fbc163df0 con 0x7f8fbc159280 2024-05-28T06:06:29.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.335+0000 7f8fbb400640 1 --2- 172.21.15.122:0/77811720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fbc0b4e10 0x7f8fbc157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:29.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.335+0000 7f8fb2a00640 1 --2- 172.21.15.122:0/77811720 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8fbc0cced0 0x7f8fbc157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:29.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.335+0000 7f8fbbe00640 1 --2- 172.21.15.122:0/77811720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fbc159280 0x7f8fbc0aa1e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8fb401a580 tx=0x7f8fb40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:29.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.335+0000 7f8fb3e00640 1 -- 172.21.15.122:0/77811720 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40bd020 con 0x7f8fbc159280 2024-05-28T06:06:29.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.335+0000 7f8fb3e00640 1 -- 172.21.15.122:0/77811720 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb40b8670 con 0x7f8fbc159280 2024-05-28T06:06:29.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.335+0000 7f8fb3e00640 1 -- 172.21.15.122:0/77811720 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40b2040 con 0x7f8fbc159280 2024-05-28T06:06:29.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.335+0000 7f8fc2800640 1 -- 172.21.15.122:0/77811720 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fbc163030 con 0x7f8fbc159280 2024-05-28T06:06:29.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.335+0000 7f8fc2800640 1 -- 172.21.15.122:0/77811720 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fbc1635f0 con 0x7f8fbc159280 2024-05-28T06:06:29.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.335+0000 7f8fc2800640 1 -- 172.21.15.122:0/77811720 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fbc068bd0 con 0x7f8fbc159280 2024-05-28T06:06:29.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.335+0000 7f8fb3e00640 1 -- 172.21.15.122:0/77811720 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8fb40c0020 con 0x7f8fbc159280 2024-05-28T06:06:29.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.335+0000 7f8fb3e00640 1 --2- 172.21.15.122:0/77811720 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8f980683b0 0x7f8f9806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:29.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.335+0000 7f8fb3e00640 1 -- 172.21.15.122:0/77811720 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8fb4121320 con 0x7f8fbc159280 2024-05-28T06:06:29.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.339+0000 7f8fbb400640 1 --2- 172.21.15.122:0/77811720 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8f980683b0 0x7f8f9806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:29.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.339+0000 7f8fbb400640 1 --2- 172.21.15.122:0/77811720 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8f980683b0 0x7f8f9806a870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0a97c0 tx=0x7f8fac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:29.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.343+0000 7f8fb3e00640 1 -- 172.21.15.122:0/77811720 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8fb40c8020 con 0x7f8fbc159280 2024-05-28T06:06:29.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.515+0000 7f8fc2800640 1 -- 172.21.15.122:0/77811720 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8fbc0756f0 con 0x7f8fbc159280 2024-05-28T06:06:29.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.515+0000 7f8fb3e00640 1 -- 172.21.15.122:0/77811720 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f8fb4016540 con 0x7f8fbc159280 2024-05-28T06:06:29.522 INFO:teuthology.orchestra.run.smithi122.stderr:listed 0 entries 2024-05-28T06:06:29.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.519+0000 7f8fc2800640 1 -- 172.21.15.122:0/77811720 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8f980683b0 msgr2=0x7f8f9806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:29.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.519+0000 7f8fc2800640 1 --2- 172.21.15.122:0/77811720 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8f980683b0 0x7f8f9806a870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0a97c0 tx=0x7f8fac009040 comp rx=0 tx=0).stop 2024-05-28T06:06:29.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.519+0000 7f8fc2800640 1 -- 172.21.15.122:0/77811720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fbc159280 msgr2=0x7f8fbc0aa1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:29.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.519+0000 7f8fc2800640 1 --2- 172.21.15.122:0/77811720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fbc159280 0x7f8fbc0aa1e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8fb401a580 tx=0x7f8fb40196f0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.519+0000 7f8fc2800640 1 -- 172.21.15.122:0/77811720 shutdown_connections 2024-05-28T06:06:29.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.519+0000 7f8fc2800640 1 --2- 172.21.15.122:0/77811720 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8f980683b0 0x7f8f9806a870 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.519+0000 7f8fc2800640 1 --2- 172.21.15.122:0/77811720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fbc159280 0x7f8fbc0aa1e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.519+0000 7f8fc2800640 1 --2- 172.21.15.122:0/77811720 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8fbc0cced0 0x7f8fbc157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.519+0000 7f8fc2800640 1 --2- 172.21.15.122:0/77811720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fbc0b4e10 0x7f8fbc157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.519+0000 7f8fc2800640 1 -- 172.21.15.122:0/77811720 >> 172.21.15.122:0/77811720 conn(0x7f8fbc062a40 msgr2=0x7f8fbc159900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:29.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.519+0000 7f8fc2800640 1 -- 172.21.15.122:0/77811720 shutdown_connections 2024-05-28T06:06:29.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.519+0000 7f8fc2800640 1 -- 172.21.15.122:0/77811720 wait complete. 2024-05-28T06:06:29.543 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-05-28T06:06:29.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:29.543 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-05-28T06:06:29.570 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-05-28T06:06:29.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:29.571 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-28T06:06:29.625 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-28T06:06:29.625 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:06:29.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.755+0000 7f41e9e00640 1 Processor -- start 2024-05-28T06:06:29.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.755+0000 7f41e9e00640 1 -- start start 2024-05-28T06:06:29.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.755+0000 7f41e9e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f41e40d0c80 0x7f41e409b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:29.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.755+0000 7f41e9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41e40d0270 0x7f41e415d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:29.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.755+0000 7f41e9e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e40d0830 con 0x7f41e40d1060 2024-05-28T06:06:29.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.755+0000 7f41e9e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f41e409aa40 con 0x7f41e40d0c80 2024-05-28T06:06:29.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.755+0000 7f41e9e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f41e409ad20 con 0x7f41e40d0270 2024-05-28T06:06:29.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.755+0000 7f41e2a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f41e40d0c80 0x7f41e409b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:29.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.755+0000 7f41e3400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f41e40d1060 0x7f41e4160300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47232/0 (socket says 172.21.15.122:47232) 2024-05-28T06:06:29.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.755+0000 7f41e3400640 1 -- 172.21.15.122:0/1783001099 learned_addr learned my addr 172.21.15.122:0/1783001099 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:29.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.755+0000 7f41e2a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f41e40d0c80 0x7f41e409b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37776/0 (socket says 172.21.15.122:37776) 2024-05-28T06:06:29.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.755+0000 7f41da000640 1 --2- 172.21.15.122:0/1783001099 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41e40d0270 0x7f41e415d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:29.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.755+0000 7f41e2a00640 1 -- 172.21.15.122:0/1783001099 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41e40d0270 msgr2=0x7f41e415d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:29.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.755+0000 7f41e2a00640 1 --2- 172.21.15.122:0/1783001099 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41e40d0270 0x7f41e415d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.755+0000 7f41e2a00640 1 -- 172.21.15.122:0/1783001099 >> v1:172.21.15.122:6789/0 conn(0x7f41e40d1060 legacy=0x7f41e4160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:29.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.755+0000 7f41e2a00640 1 -- 172.21.15.122:0/1783001099 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e409b000 con 0x7f41e40d0c80 2024-05-28T06:06:29.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.755+0000 7f41e2000640 1 -- 172.21.15.122:0/1783001099 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2809841965 0 0) 0x7f41e40d0830 con 0x7f41e40d1060 2024-05-28T06:06:29.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.759+0000 7f41e2a00640 1 --2- 172.21.15.122:0/1783001099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41e40d0c80 0x7f41e409b800 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f41d40097c0 tx=0x7f41d401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4a12613ed4561a server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:29.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.759+0000 7f41e2000640 1 -- 172.21.15.122:0/1783001099 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d40b0070 con 0x7f41e40d0c80 2024-05-28T06:06:29.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.759+0000 7f41e2000640 1 -- 172.21.15.122:0/1783001099 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d40ab600 con 0x7f41e40d0c80 2024-05-28T06:06:29.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.759+0000 7f41e2000640 1 -- 172.21.15.122:0/1783001099 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d40ab9d0 con 0x7f41e40d0c80 2024-05-28T06:06:29.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.759+0000 7f41e9e00640 1 -- 172.21.15.122:0/1783001099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41e40d0c80 msgr2=0x7f41e409b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:29.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.759+0000 7f41e9e00640 1 --2- 172.21.15.122:0/1783001099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41e40d0c80 0x7f41e409b800 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f41d40097c0 tx=0x7f41d401c410 comp rx=0 tx=0).stop 2024-05-28T06:06:29.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.759+0000 7f41e9e00640 1 -- 172.21.15.122:0/1783001099 shutdown_connections 2024-05-28T06:06:29.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.759+0000 7f41e9e00640 1 --2- 172.21.15.122:0/1783001099 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41e40d0270 0x7f41e415d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.759+0000 7f41e9e00640 1 --2- 172.21.15.122:0/1783001099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41e40d0c80 0x7f41e409b800 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.759+0000 7f41e9e00640 1 -- 172.21.15.122:0/1783001099 >> 172.21.15.122:0/1783001099 conn(0x7f41e40b4190 msgr2=0x7f41e40b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:29.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.759+0000 7f41e9e00640 1 -- 172.21.15.122:0/1783001099 shutdown_connections 2024-05-28T06:06:29.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.759+0000 7f41e9e00640 1 -- 172.21.15.122:0/1783001099 wait complete. 2024-05-28T06:06:29.768 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41e9e00640 1 Processor -- start 2024-05-28T06:06:29.768 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41e9e00640 1 -- start start 2024-05-28T06:06:29.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41e9e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41e40d0270 0x7f41e40c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:29.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41e9e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41e40d0c80 0x7f41e4152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:29.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41e9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41e40d1060 0x7f41e40b6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:29.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41e9e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f41e41697c0 con 0x7f41e40d0c80 2024-05-28T06:06:29.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41e9e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f41e4169640 con 0x7f41e40d0270 2024-05-28T06:06:29.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41e9e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f41e4169940 con 0x7f41e40d1060 2024-05-28T06:06:29.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41da000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41e40d0c80 0x7f41e4152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:29.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41da000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41e40d0c80 0x7f41e4152200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37790/0 (socket says 172.21.15.122:37790) 2024-05-28T06:06:29.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41da000640 1 -- 172.21.15.122:0/1517825860 learned_addr learned my addr 172.21.15.122:0/1517825860 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:29.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41e3400640 1 --2- 172.21.15.122:0/1517825860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41e40d1060 0x7f41e40b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:29.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41e2a00640 1 --2- 172.21.15.122:0/1517825860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41e40d0270 0x7f41e40c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:29.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41da000640 1 -- 172.21.15.122:0/1517825860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41e40d1060 msgr2=0x7f41e40b6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:29.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41da000640 1 --2- 172.21.15.122:0/1517825860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41e40d1060 0x7f41e40b6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41da000640 1 -- 172.21.15.122:0/1517825860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41e40d0270 msgr2=0x7f41e40c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:29.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41da000640 1 --2- 172.21.15.122:0/1517825860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41e40d0270 0x7f41e40c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41da000640 1 -- 172.21.15.122:0/1517825860 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e40c7330 con 0x7f41e40d0c80 2024-05-28T06:06:29.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41e2a00640 1 --2- 172.21.15.122:0/1517825860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41e40d0270 0x7f41e40c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:29.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41da000640 1 --2- 172.21.15.122:0/1517825860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41e40d0c80 0x7f41e4152200 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00d620 tx=0x7f41cc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:29.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41dbe00640 1 -- 172.21.15.122:0/1517825860 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc00b620 con 0x7f41e40d0c80 2024-05-28T06:06:29.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41dbe00640 1 -- 172.21.15.122:0/1517825860 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41cc019070 con 0x7f41e40d0c80 2024-05-28T06:06:29.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41dbe00640 1 -- 172.21.15.122:0/1517825860 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc00b9e0 con 0x7f41e40d0c80 2024-05-28T06:06:29.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41e9e00640 1 -- 172.21.15.122:0/1517825860 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e40c7b30 con 0x7f41e40d0c80 2024-05-28T06:06:29.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.763+0000 7f41e9e00640 1 -- 172.21.15.122:0/1517825860 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e4152740 con 0x7f41e40d0c80 2024-05-28T06:06:29.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.767+0000 7f41e9e00640 1 -- 172.21.15.122:0/1517825860 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41e40694d0 con 0x7f41e40d0c80 2024-05-28T06:06:29.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.767+0000 7f41dbe00640 1 -- 172.21.15.122:0/1517825860 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f41cc00bb80 con 0x7f41e40d0c80 2024-05-28T06:06:29.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.767+0000 7f41dbe00640 1 --2- 172.21.15.122:0/1517825860 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f41c00683b0 0x7f41c006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:29.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.767+0000 7f41dbe00640 1 -- 172.21.15.122:0/1517825860 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7f41cc086dc0 con 0x7f41e40d0c80 2024-05-28T06:06:29.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.767+0000 7f41e2a00640 1 --2- 172.21.15.122:0/1517825860 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f41c00683b0 0x7f41c006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:29.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.767+0000 7f41e2a00640 1 --2- 172.21.15.122:0/1517825860 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f41c00683b0 0x7f41c006a870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f41d40ad000 tx=0x7f41d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:29.777 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.771+0000 7f41dbe00640 1 -- 172.21.15.122:0/1517825860 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f41cc057300 con 0x7f41e40d0c80 2024-05-28T06:06:29.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.971+0000 7f41e9e00640 1 -- 172.21.15.122:0/1517825860 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41e4068c40 con 0x7f41e40d0c80 2024-05-28T06:06:29.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.971+0000 7f41dbe00640 1 -- 172.21.15.122:0/1517825860 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7f41cc056c00 con 0x7f41e40d0c80 2024-05-28T06:06:29.976 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:29.976 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4177682646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4177682646},{"type":"v1","addr":"172.21.15.153:6835","nonce":4177682646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3318983491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3318983491},{"type":"v1","addr":"172.21.15.153:6834","nonce":3318983491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/360722760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":360722760},{"type":"v1","addr":"172.21.15.122:6836","nonce":360722760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-28T06:05:49.194771+0000","modified":"2024-05-28T06:05:52.203797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1474216380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1474216380},{"type":"v1","addr":"172.21.15.122:6837","nonce":1474216380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4270,"qdb_cluster":[4270]},"id":1}]} 2024-05-28T06:06:29.976 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 8 2024-05-28T06:06:29.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.971+0000 7f41e9e00640 1 -- 172.21.15.122:0/1517825860 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f41c00683b0 msgr2=0x7f41c006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:29.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.971+0000 7f41e9e00640 1 --2- 172.21.15.122:0/1517825860 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f41c00683b0 0x7f41c006a870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f41d40ad000 tx=0x7f41d4008040 comp rx=0 tx=0).stop 2024-05-28T06:06:29.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.971+0000 7f41e9e00640 1 -- 172.21.15.122:0/1517825860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41e40d0c80 msgr2=0x7f41e4152200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:29.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.971+0000 7f41e9e00640 1 --2- 172.21.15.122:0/1517825860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41e40d0c80 0x7f41e4152200 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00d620 tx=0x7f41cc00dae0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.971+0000 7f41e9e00640 1 -- 172.21.15.122:0/1517825860 shutdown_connections 2024-05-28T06:06:29.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.971+0000 7f41e9e00640 1 --2- 172.21.15.122:0/1517825860 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f41c00683b0 0x7f41c006a870 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.971+0000 7f41e9e00640 1 --2- 172.21.15.122:0/1517825860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41e40d1060 0x7f41e40b6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.971+0000 7f41e9e00640 1 --2- 172.21.15.122:0/1517825860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41e40d0c80 0x7f41e4152200 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.971+0000 7f41e9e00640 1 --2- 172.21.15.122:0/1517825860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41e40d0270 0x7f41e40c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:29.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.971+0000 7f41e9e00640 1 -- 172.21.15.122:0/1517825860 >> 172.21.15.122:0/1517825860 conn(0x7f41e40b4190 msgr2=0x7f41e40b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:29.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.971+0000 7f41e9e00640 1 -- 172.21.15.122:0/1517825860 shutdown_connections 2024-05-28T06:06:29.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:29.971+0000 7f41e9e00640 1 -- 172.21.15.122:0/1517825860 wait complete. 2024-05-28T06:06:29.996 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:06:30.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.127+0000 7fb62b800640 1 Processor -- start 2024-05-28T06:06:30.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.127+0000 7fb62b800640 1 -- start start 2024-05-28T06:06:30.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.127+0000 7fb62b800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb6240d0270 0x7fb62409b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:30.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.127+0000 7fb62b800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb62415d7e0 0x7fb6240cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:30.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.127+0000 7fb62b800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb62415dc70 con 0x7fb6240d0c80 2024-05-28T06:06:30.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.127+0000 7fb62b800640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fb6240d0830 con 0x7fb6240d0270 2024-05-28T06:06:30.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.127+0000 7fb62b800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb62409aa40 con 0x7fb62415d7e0 2024-05-28T06:06:30.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.127+0000 7fb623e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb6240d0270 0x7fb62409b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:30.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.127+0000 7fb623e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb6240d0270 0x7fb62409b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37792/0 (socket says 172.21.15.122:37792) 2024-05-28T06:06:30.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.127+0000 7fb623e00640 1 -- 172.21.15.122:0/4015128354 learned_addr learned my addr 172.21.15.122:0/4015128354 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:30.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.127+0000 7fb629800640 1 --2- 172.21.15.122:0/4015128354 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb62415d7e0 0x7fb6240cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:30.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.127+0000 7fb623e00640 1 -- 172.21.15.122:0/4015128354 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb62415d7e0 msgr2=0x7fb6240cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:30.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.127+0000 7fb623e00640 1 --2- 172.21.15.122:0/4015128354 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb62415d7e0 0x7fb6240cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.127+0000 7fb623e00640 1 -- 172.21.15.122:0/4015128354 >> v1:172.21.15.153:6789/0 conn(0x7fb6240d0c80 legacy=0x7fb6240d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:30.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.127+0000 7fb623e00640 1 -- 172.21.15.122:0/4015128354 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62409ad20 con 0x7fb6240d0270 2024-05-28T06:06:30.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.131+0000 7fb623e00640 1 --2- 172.21.15.122:0/4015128354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6240d0270 0x7fb62409b800 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb610009870 tx=0x7fb61001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19dde6d00741844f server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:30.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.131+0000 7fb623400640 1 -- 172.21.15.122:0/4015128354 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6100aa600 con 0x7fb6240d0270 2024-05-28T06:06:30.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.131+0000 7fb623400640 1 -- 172.21.15.122:0/4015128354 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6100af070 con 0x7fb6240d0270 2024-05-28T06:06:30.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.131+0000 7fb623400640 1 -- 172.21.15.122:0/4015128354 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6100aa9c0 con 0x7fb6240d0270 2024-05-28T06:06:30.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.131+0000 7fb62b800640 1 -- 172.21.15.122:0/4015128354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6240d0270 msgr2=0x7fb62409b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:30.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.131+0000 7fb62b800640 1 --2- 172.21.15.122:0/4015128354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6240d0270 0x7fb62409b800 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb610009870 tx=0x7fb61001c4a0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.131+0000 7fb62b800640 1 -- 172.21.15.122:0/4015128354 shutdown_connections 2024-05-28T06:06:30.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.131+0000 7fb62b800640 1 --2- 172.21.15.122:0/4015128354 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb62415d7e0 0x7fb6240cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.131+0000 7fb62b800640 1 --2- 172.21.15.122:0/4015128354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6240d0270 0x7fb62409b800 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.131+0000 7fb62b800640 1 -- 172.21.15.122:0/4015128354 >> 172.21.15.122:0/4015128354 conn(0x7fb6240b4190 msgr2=0x7fb6240b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:30.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.131+0000 7fb62b800640 1 -- 172.21.15.122:0/4015128354 shutdown_connections 2024-05-28T06:06:30.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.131+0000 7fb62b800640 1 -- 172.21.15.122:0/4015128354 wait complete. 2024-05-28T06:06:30.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb62b800640 1 Processor -- start 2024-05-28T06:06:30.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb62b800640 1 -- start start 2024-05-28T06:06:30.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb62b800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6240d0270 0x7fb6240b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:30.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb62b800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6240d0c80 0x7fb6240cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:30.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb62b800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb62415d7e0 0x7fb624154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:30.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb62b800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb6241697c0 con 0x7fb6240d0c80 2024-05-28T06:06:30.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb62b800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb624169640 con 0x7fb6240d0270 2024-05-28T06:06:30.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb62b800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb624169940 con 0x7fb62415d7e0 2024-05-28T06:06:30.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb623e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6240d0c80 0x7fb6240cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:30.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb623e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6240d0c80 0x7fb6240cb870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37794/0 (socket says 172.21.15.122:37794) 2024-05-28T06:06:30.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb623e00640 1 -- 172.21.15.122:0/1146199759 learned_addr learned my addr 172.21.15.122:0/1146199759 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:30.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb628e00640 1 --2- 172.21.15.122:0/1146199759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6240d0270 0x7fb6240b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:30.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb629800640 1 --2- 172.21.15.122:0/1146199759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb62415d7e0 0x7fb624154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:30.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb623e00640 1 -- 172.21.15.122:0/1146199759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb62415d7e0 msgr2=0x7fb624154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:30.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb623e00640 1 --2- 172.21.15.122:0/1146199759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb62415d7e0 0x7fb624154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb623e00640 1 -- 172.21.15.122:0/1146199759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6240d0270 msgr2=0x7fb6240b5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:30.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb623e00640 1 --2- 172.21.15.122:0/1146199759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6240d0270 0x7fb6240b5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb623e00640 1 -- 172.21.15.122:0/1146199759 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb624158a60 con 0x7fb6240d0c80 2024-05-28T06:06:30.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb623e00640 1 --2- 172.21.15.122:0/1146199759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6240d0c80 0x7fb6240cb870 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb6100097c0 tx=0x7fb61001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:30.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb620c00640 1 -- 172.21.15.122:0/1146199759 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6100bd5f0 con 0x7fb6240d0c80 2024-05-28T06:06:30.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb620c00640 1 -- 172.21.15.122:0/1146199759 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6100bd790 con 0x7fb6240d0c80 2024-05-28T06:06:30.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb62b800640 1 -- 172.21.15.122:0/1146199759 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6240b6590 con 0x7fb6240d0c80 2024-05-28T06:06:30.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb620c00640 1 -- 172.21.15.122:0/1146199759 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6100bdb80 con 0x7fb6240d0c80 2024-05-28T06:06:30.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb62b800640 1 -- 172.21.15.122:0/1146199759 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6240b6b50 con 0x7fb6240d0c80 2024-05-28T06:06:30.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.135+0000 7fb62b800640 1 -- 172.21.15.122:0/1146199759 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6240b7610 con 0x7fb6240d0c80 2024-05-28T06:06:30.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.139+0000 7fb620c00640 1 -- 172.21.15.122:0/1146199759 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb6100a9070 con 0x7fb6240d0c80 2024-05-28T06:06:30.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.139+0000 7fb620c00640 1 --2- 172.21.15.122:0/1146199759 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb604068380 0x7fb60406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:30.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.139+0000 7fb620c00640 1 -- 172.21.15.122:0/1146199759 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7fb610121340 con 0x7fb6240d0c80 2024-05-28T06:06:30.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.139+0000 7fb628e00640 1 --2- 172.21.15.122:0/1146199759 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb604068380 0x7fb60406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:30.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.139+0000 7fb628e00640 1 --2- 172.21.15.122:0/1146199759 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb604068380 0x7fb60406a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb624167600 tx=0x7fb614009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:30.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.143+0000 7fb620c00640 1 -- 172.21.15.122:0/1146199759 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb6240b7610 con 0x7fb6240d0c80 2024-05-28T06:06:30.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.299+0000 7fb62b800640 1 -- 172.21.15.122:0/1146199759 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb624068c40 con 0x7fb6240d0c80 2024-05-28T06:06:30.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.303+0000 7fb620c00640 1 -- 172.21.15.122:0/1146199759 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16855 (secure 0 0 0) 0x7fb6100c3060 con 0x7fb6240d0c80 2024-05-28T06:06:30.308 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:30.308 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":21,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:06:29.427164+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:05:47.441193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-28T06:05:48.148164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:06:30.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.303+0000 7fb62b800640 1 -- 172.21.15.122:0/1146199759 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb604068380 msgr2=0x7fb60406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:30.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.303+0000 7fb62b800640 1 --2- 172.21.15.122:0/1146199759 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb604068380 0x7fb60406a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb624167600 tx=0x7fb614009040 comp rx=0 tx=0).stop 2024-05-28T06:06:30.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.303+0000 7fb62b800640 1 -- 172.21.15.122:0/1146199759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6240d0c80 msgr2=0x7fb6240cb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:30.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.303+0000 7fb62b800640 1 --2- 172.21.15.122:0/1146199759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6240d0c80 0x7fb6240cb870 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb6100097c0 tx=0x7fb61001ace0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.303+0000 7fb62b800640 1 -- 172.21.15.122:0/1146199759 shutdown_connections 2024-05-28T06:06:30.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.303+0000 7fb62b800640 1 --2- 172.21.15.122:0/1146199759 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb604068380 0x7fb60406a840 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.303+0000 7fb62b800640 1 --2- 172.21.15.122:0/1146199759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb62415d7e0 0x7fb624154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.303+0000 7fb62b800640 1 --2- 172.21.15.122:0/1146199759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6240d0c80 0x7fb6240cb870 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.303+0000 7fb62b800640 1 --2- 172.21.15.122:0/1146199759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6240d0270 0x7fb6240b5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.303+0000 7fb62b800640 1 -- 172.21.15.122:0/1146199759 >> 172.21.15.122:0/1146199759 conn(0x7fb6240b4190 msgr2=0x7fb624157b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:30.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.303+0000 7fb62b800640 1 -- 172.21.15.122:0/1146199759 shutdown_connections 2024-05-28T06:06:30.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.303+0000 7fb62b800640 1 -- 172.21.15.122:0/1146199759 wait complete. 2024-05-28T06:06:30.329 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-28T06:05:47.441193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-28T06:05:48.148164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:06:30.329 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:06:30.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.463+0000 7fe830400640 1 Processor -- start 2024-05-28T06:06:30.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.463+0000 7fe830400640 1 -- start start 2024-05-28T06:06:30.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe830400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8280afd30 0x7fe8280adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:30.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe830400640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe82806e7f0 con 0x7fe828147410 2024-05-28T06:06:30.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe830400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe82806ead0 con 0x7fe8280729b0 2024-05-28T06:06:30.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe830400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe8280b5310 con 0x7fe8280afd30 2024-05-28T06:06:30.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe82da00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fe828147410 0x7fe8280722a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47248/0 (socket says 172.21.15.122:47248) 2024-05-28T06:06:30.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe82da00640 1 -- 172.21.15.122:0/1771162605 learned_addr learned my addr 172.21.15.122:0/1771162605 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:30.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe827e00640 1 -- 172.21.15.122:0/1771162605 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3694656515 0 0) 0x7fe82806e7f0 con 0x7fe828147410 2024-05-28T06:06:30.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe82e400640 1 --2- 172.21.15.122:0/1771162605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8280afd30 0x7fe8280adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:30.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe827e00640 1 -- 172.21.15.122:0/1771162605 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe810003530 con 0x7fe828147410 2024-05-28T06:06:30.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe827e00640 1 -- 172.21.15.122:0/1771162605 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 629147721 0 0) 0x7fe810003530 con 0x7fe828147410 2024-05-28T06:06:30.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe827e00640 1 -- 172.21.15.122:0/1771162605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8280afd30 msgr2=0x7fe8280adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:30.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe827e00640 1 --2- 172.21.15.122:0/1771162605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8280afd30 0x7fe8280adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe827e00640 1 -- 172.21.15.122:0/1771162605 >> v1:172.21.15.153:6789/0 conn(0x7fe8280729b0 legacy=0x7fe8280b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:30.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe827e00640 1 -- 172.21.15.122:0/1771162605 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82806edb0 con 0x7fe828147410 2024-05-28T06:06:30.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe827e00640 1 -- 172.21.15.122:0/1771162605 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7fe81c001680 con 0x7fe828147410 2024-05-28T06:06:30.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe827e00640 1 -- 172.21.15.122:0/1771162605 >> v1:172.21.15.122:6789/0 conn(0x7fe828147410 legacy=0x7fe8280722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:30.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe827e00640 1 --2- 172.21.15.122:0/1771162605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8280afd30 0x7fe8100039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:30.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe827e00640 1 --2- 172.21.15.122:0/1771162605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe810003f70 0x7fe810004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:30.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe827e00640 1 --2- 172.21.15.122:0/1771162605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe810004d50 0x7fe8100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:30.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe827e00640 1 -- 172.21.15.122:0/1771162605 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe81000ba80 con 0x7fe810004d50 2024-05-28T06:06:30.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe827e00640 1 -- 172.21.15.122:0/1771162605 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe81000bc30 con 0x7fe810003f70 2024-05-28T06:06:30.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe827e00640 1 -- 172.21.15.122:0/1771162605 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe81000be30 con 0x7fe8280afd30 2024-05-28T06:06:30.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe82e400640 1 --2- 172.21.15.122:0/1771162605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe810004d50 0x7fe8100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:30.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe82da00640 1 --2- 172.21.15.122:0/1771162605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8280afd30 0x7fe8100039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:30.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe82d000640 1 --2- 172.21.15.122:0/1771162605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe810003f70 0x7fe810004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:30.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe82e400640 1 -- 172.21.15.122:0/1771162605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8280afd30 msgr2=0x7fe8100039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:30.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe82e400640 1 --2- 172.21.15.122:0/1771162605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8280afd30 0x7fe8100039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe82e400640 1 -- 172.21.15.122:0/1771162605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe810003f70 msgr2=0x7fe810004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:30.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe82e400640 1 --2- 172.21.15.122:0/1771162605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe810003f70 0x7fe810004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.467+0000 7fe82e400640 1 -- 172.21.15.122:0/1771162605 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe810003530 con 0x7fe810004d50 2024-05-28T06:06:30.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.471+0000 7fe82e400640 1 --2- 172.21.15.122:0/1771162605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe810004d50 0x7fe8100051d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe820009fc0 tx=0x7fe82001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f084fc219379cf08 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:30.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.471+0000 7fe827e00640 1 -- 172.21.15.122:0/1771162605 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8200b2070 con 0x7fe810004d50 2024-05-28T06:06:30.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.471+0000 7fe827e00640 1 -- 172.21.15.122:0/1771162605 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8200a5c90 con 0x7fe810004d50 2024-05-28T06:06:30.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.471+0000 7fe827e00640 1 -- 172.21.15.122:0/1771162605 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe820009c10 con 0x7fe810004d50 2024-05-28T06:06:30.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.471+0000 7fe830400640 1 -- 172.21.15.122:0/1771162605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe810004d50 msgr2=0x7fe8100051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:30.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.471+0000 7fe830400640 1 --2- 172.21.15.122:0/1771162605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe810004d50 0x7fe8100051d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe820009fc0 tx=0x7fe82001cc80 comp rx=0 tx=0).stop 2024-05-28T06:06:30.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.471+0000 7fe82e400640 1 -- 172.21.15.122:0/1771162605 reap_dead start 2024-05-28T06:06:30.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.471+0000 7fe830400640 1 -- 172.21.15.122:0/1771162605 shutdown_connections 2024-05-28T06:06:30.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.471+0000 7fe830400640 1 -- 172.21.15.122:0/1771162605 >> 172.21.15.122:0/1771162605 conn(0x7fe82806bd90 msgr2=0x7fe82806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:30.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.471+0000 7fe830400640 1 -- 172.21.15.122:0/1771162605 shutdown_connections 2024-05-28T06:06:30.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.471+0000 7fe830400640 1 -- 172.21.15.122:0/1771162605 wait complete. 2024-05-28T06:06:30.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.471+0000 7fe830400640 1 Processor -- start 2024-05-28T06:06:30.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.471+0000 7fe830400640 1 -- start start 2024-05-28T06:06:30.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe830400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe810004d50 0x7fe82815d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:30.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe830400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe82815df10 0x7fe8280b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:30.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe830400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8280b17c0 0x7fe8280b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:30.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe830400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe8281477f0 con 0x7fe82815df10 2024-05-28T06:06:30.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe830400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe82806f090 con 0x7fe8280b17c0 2024-05-28T06:06:30.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe830400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe828147970 con 0x7fe810004d50 2024-05-28T06:06:30.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe82d000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe82815df10 0x7fe8280b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:30.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe82d000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe82815df10 0x7fe8280b1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37810/0 (socket says 172.21.15.122:37810) 2024-05-28T06:06:30.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe82d000640 1 -- 172.21.15.122:0/2790888498 learned_addr learned my addr 172.21.15.122:0/2790888498 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:30.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe82da00640 1 --2- 172.21.15.122:0/2790888498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe810004d50 0x7fe82815d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:30.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe82d000640 1 -- 172.21.15.122:0/2790888498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe810004d50 msgr2=0x7fe82815d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:30.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe82e400640 1 --2- 172.21.15.122:0/2790888498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8280b17c0 0x7fe8280b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:30.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe82d000640 1 --2- 172.21.15.122:0/2790888498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe810004d50 0x7fe82815d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe82d000640 1 -- 172.21.15.122:0/2790888498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8280b17c0 msgr2=0x7fe8280b1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:30.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe82d000640 1 --2- 172.21.15.122:0/2790888498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8280b17c0 0x7fe8280b1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe82d000640 1 -- 172.21.15.122:0/2790888498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8281430e0 con 0x7fe82815df10 2024-05-28T06:06:30.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe82da00640 1 --2- 172.21.15.122:0/2790888498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe810004d50 0x7fe82815d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:30.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe82d000640 1 --2- 172.21.15.122:0/2790888498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe82815df10 0x7fe8280b1280 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe81400f820 tx=0x7fe81400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:30.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe825600640 1 -- 172.21.15.122:0/2790888498 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81401a070 con 0x7fe82815df10 2024-05-28T06:06:30.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe825600640 1 -- 172.21.15.122:0/2790888498 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe814001cf0 con 0x7fe82815df10 2024-05-28T06:06:30.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe825600640 1 -- 172.21.15.122:0/2790888498 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814007030 con 0x7fe82815df10 2024-05-28T06:06:30.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe830400640 1 -- 172.21.15.122:0/2790888498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe828143380 con 0x7fe82815df10 2024-05-28T06:06:30.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe830400640 1 -- 172.21.15.122:0/2790888498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe82813b410 con 0x7fe82815df10 2024-05-28T06:06:30.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.475+0000 7fe830400640 1 -- 172.21.15.122:0/2790888498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe828068c40 con 0x7fe82815df10 2024-05-28T06:06:30.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.479+0000 7fe825600640 1 -- 172.21.15.122:0/2790888498 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe8140071d0 con 0x7fe82815df10 2024-05-28T06:06:30.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.479+0000 7fe825600640 1 --2- 172.21.15.122:0/2790888498 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe8080683b0 0x7fe80806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:30.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.479+0000 7fe825600640 1 -- 172.21.15.122:0/2790888498 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fe814086100 con 0x7fe82815df10 2024-05-28T06:06:30.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.479+0000 7fe82da00640 1 --2- 172.21.15.122:0/2790888498 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe8080683b0 0x7fe80806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:30.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.479+0000 7fe82da00640 1 --2- 172.21.15.122:0/2790888498 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe8080683b0 0x7fe80806a870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe81c001560 tx=0x7fe81c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:30.488 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.483+0000 7fe825600640 1 -- 172.21.15.122:0/2790888498 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe814056630 con 0x7fe82815df10 2024-05-28T06:06:30.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.643+0000 7fe830400640 1 -- 172.21.15.122:0/2790888498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe8280754d0 con 0x7fe82815df10 2024-05-28T06:06:30.650 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.643+0000 7fe825600640 1 -- 172.21.15.122:0/2790888498 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fe814055f30 con 0x7fe82815df10 2024-05-28T06:06:30.650 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:06:30.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.647+0000 7fe830400640 1 -- 172.21.15.122:0/2790888498 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe8080683b0 msgr2=0x7fe80806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:30.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.647+0000 7fe830400640 1 --2- 172.21.15.122:0/2790888498 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe8080683b0 0x7fe80806a870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe81c001560 tx=0x7fe81c009040 comp rx=0 tx=0).stop 2024-05-28T06:06:30.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.647+0000 7fe830400640 1 -- 172.21.15.122:0/2790888498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe82815df10 msgr2=0x7fe8280b1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:30.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.647+0000 7fe830400640 1 --2- 172.21.15.122:0/2790888498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe82815df10 0x7fe8280b1280 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe81400f820 tx=0x7fe81400fce0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.647+0000 7fe830400640 1 -- 172.21.15.122:0/2790888498 shutdown_connections 2024-05-28T06:06:30.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.647+0000 7fe830400640 1 --2- 172.21.15.122:0/2790888498 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe8080683b0 0x7fe80806a870 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.647+0000 7fe830400640 1 --2- 172.21.15.122:0/2790888498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8280b17c0 0x7fe8280b1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.647+0000 7fe830400640 1 --2- 172.21.15.122:0/2790888498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe82815df10 0x7fe8280b1280 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.647+0000 7fe830400640 1 --2- 172.21.15.122:0/2790888498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe810004d50 0x7fe82815d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.647+0000 7fe830400640 1 -- 172.21.15.122:0/2790888498 >> 172.21.15.122:0/2790888498 conn(0x7fe82806bd90 msgr2=0x7fe8280b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:30.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.647+0000 7fe830400640 1 -- 172.21.15.122:0/2790888498 shutdown_connections 2024-05-28T06:06:30.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.647+0000 7fe830400640 1 -- 172.21.15.122:0/2790888498 wait complete. 2024-05-28T06:06:30.671 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-28T06:06:30.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.803+0000 7efd26c00640 1 Processor -- start 2024-05-28T06:06:30.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.803+0000 7efd26c00640 1 -- start start 2024-05-28T06:06:30.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.807+0000 7efd26c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd2006cc60 0x7efd2009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:30.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.807+0000 7efd26c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efd2009af80 0x7efd200cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:30.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.807+0000 7efd26c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd200ccb80 con 0x7efd20161ff0 2024-05-28T06:06:30.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.807+0000 7efd26c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7efd200cce60 con 0x7efd2009af80 2024-05-28T06:06:30.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.807+0000 7efd26c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efd200cd140 con 0x7efd2006cc60 2024-05-28T06:06:30.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.807+0000 7efd24e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd2006cc60 0x7efd2009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:30.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.807+0000 7efd26200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efd2009af80 0x7efd200cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:30.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.807+0000 7efd24e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd2006cc60 0x7efd2009aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:57706/0 (socket says 172.21.15.122:57706) 2024-05-28T06:06:30.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.807+0000 7efd24e00640 1 -- 172.21.15.122:0/1300650234 learned_addr learned my addr 172.21.15.122:0/1300650234 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:30.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.807+0000 7efd25800640 1 --1- 172.21.15.122:0/1300650234 >> v1:172.21.15.153:6789/0 conn(0x7efd20161ff0 0x7efd200d1270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:54134/0 (socket says 172.21.15.122:54134) 2024-05-28T06:06:30.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.807+0000 7efd24e00640 1 -- 172.21.15.122:0/1300650234 >> v2:172.21.15.153:3300/0 conn(0x7efd2009af80 msgr2=0x7efd200cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:30.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.807+0000 7efd24e00640 1 --2- 172.21.15.122:0/1300650234 >> v2:172.21.15.153:3300/0 conn(0x7efd2009af80 0x7efd200cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.807+0000 7efd24e00640 1 -- 172.21.15.122:0/1300650234 >> v1:172.21.15.153:6789/0 conn(0x7efd20161ff0 legacy=0x7efd200d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:30.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.807+0000 7efd24e00640 1 -- 172.21.15.122:0/1300650234 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd200cd420 con 0x7efd2006cc60 2024-05-28T06:06:30.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.811+0000 7efd24e00640 1 --2- 172.21.15.122:0/1300650234 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd2006cc60 0x7efd2009aa40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd0c009870 tx=0x7efd0c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b921d3fdd35eb16 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:30.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.811+0000 7efd1fe00640 1 -- 172.21.15.122:0/1300650234 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c0b2070 con 0x7efd2006cc60 2024-05-28T06:06:30.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.811+0000 7efd1fe00640 1 -- 172.21.15.122:0/1300650234 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd0c0a9070 con 0x7efd2006cc60 2024-05-28T06:06:30.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.811+0000 7efd1fe00640 1 -- 172.21.15.122:0/1300650234 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c0ad880 con 0x7efd2006cc60 2024-05-28T06:06:30.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.811+0000 7efd26c00640 1 -- 172.21.15.122:0/1300650234 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd2006cc60 msgr2=0x7efd2009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:30.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.811+0000 7efd26c00640 1 --2- 172.21.15.122:0/1300650234 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd2006cc60 0x7efd2009aa40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd0c009870 tx=0x7efd0c01c560 comp rx=0 tx=0).stop 2024-05-28T06:06:30.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.811+0000 7efd26c00640 1 -- 172.21.15.122:0/1300650234 shutdown_connections 2024-05-28T06:06:30.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.811+0000 7efd26c00640 1 --2- 172.21.15.122:0/1300650234 >> v2:172.21.15.153:3300/0 conn(0x7efd2009af80 0x7efd200cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.811+0000 7efd26c00640 1 --2- 172.21.15.122:0/1300650234 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd2006cc60 0x7efd2009aa40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.811+0000 7efd26c00640 1 -- 172.21.15.122:0/1300650234 >> 172.21.15.122:0/1300650234 conn(0x7efd200b3f80 msgr2=0x7efd200b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:30.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.811+0000 7efd26c00640 1 -- 172.21.15.122:0/1300650234 shutdown_connections 2024-05-28T06:06:30.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.811+0000 7efd26c00640 1 -- 172.21.15.122:0/1300650234 wait complete. 2024-05-28T06:06:30.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.811+0000 7efd26c00640 1 Processor -- start 2024-05-28T06:06:30.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.811+0000 7efd26c00640 1 -- start start 2024-05-28T06:06:30.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.815+0000 7efd26c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2006cc60 0x7efd200b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:30.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.815+0000 7efd26c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd2009af80 0x7efd200b6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:30.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.815+0000 7efd26c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd20161ff0 0x7efd20070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:30.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.815+0000 7efd26c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efd200cea20 con 0x7efd2009af80 2024-05-28T06:06:30.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.815+0000 7efd26c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efd200ce8a0 con 0x7efd2006cc60 2024-05-28T06:06:30.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.815+0000 7efd26c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efd200ceba0 con 0x7efd20161ff0 2024-05-28T06:06:30.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.815+0000 7efd24e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd2009af80 0x7efd200b6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:30.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.815+0000 7efd24e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd2009af80 0x7efd200b6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37826/0 (socket says 172.21.15.122:37826) 2024-05-28T06:06:30.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.815+0000 7efd24e00640 1 -- 172.21.15.122:0/1697662120 learned_addr learned my addr 172.21.15.122:0/1697662120 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:30.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.815+0000 7efd25800640 1 --2- 172.21.15.122:0/1697662120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2006cc60 0x7efd200b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:30.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.815+0000 7efd26200640 1 --2- 172.21.15.122:0/1697662120 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd20161ff0 0x7efd20070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:30.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.815+0000 7efd24e00640 1 -- 172.21.15.122:0/1697662120 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd20161ff0 msgr2=0x7efd20070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:30.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.815+0000 7efd24e00640 1 --2- 172.21.15.122:0/1697662120 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd20161ff0 0x7efd20070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.815+0000 7efd24e00640 1 -- 172.21.15.122:0/1697662120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2006cc60 msgr2=0x7efd200b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:30.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.815+0000 7efd24e00640 1 --2- 172.21.15.122:0/1697662120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2006cc60 0x7efd200b5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.815+0000 7efd24e00640 1 -- 172.21.15.122:0/1697662120 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd200b6fe0 con 0x7efd2009af80 2024-05-28T06:06:30.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.815+0000 7efd24e00640 1 --2- 172.21.15.122:0/1697662120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd2009af80 0x7efd200b6aa0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efd0c01a190 tx=0x7efd0c019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:30.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.815+0000 7efd1d600640 1 -- 172.21.15.122:0/1697662120 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c0bc070 con 0x7efd2009af80 2024-05-28T06:06:30.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.815+0000 7efd1d600640 1 -- 172.21.15.122:0/1697662120 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd0c0b6620 con 0x7efd2009af80 2024-05-28T06:06:30.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.815+0000 7efd1d600640 1 -- 172.21.15.122:0/1697662120 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c0b2040 con 0x7efd2009af80 2024-05-28T06:06:30.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.815+0000 7efd26c00640 1 -- 172.21.15.122:0/1697662120 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd200b72a0 con 0x7efd2009af80 2024-05-28T06:06:30.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.815+0000 7efd26c00640 1 -- 172.21.15.122:0/1697662120 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd200b7860 con 0x7efd2009af80 2024-05-28T06:06:30.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.815+0000 7efd26c00640 1 -- 172.21.15.122:0/1697662120 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd20075620 con 0x7efd2009af80 2024-05-28T06:06:30.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.819+0000 7efd1d600640 1 -- 172.21.15.122:0/1697662120 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efd0c0ab070 con 0x7efd2009af80 2024-05-28T06:06:30.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.819+0000 7efd1d600640 1 --2- 172.21.15.122:0/1697662120 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efd00068380 0x7efd0006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:30.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.819+0000 7efd1d600640 1 -- 172.21.15.122:0/1697662120 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7efd0c11fd10 con 0x7efd2009af80 2024-05-28T06:06:30.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.819+0000 7efd25800640 1 --2- 172.21.15.122:0/1697662120 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efd00068380 0x7efd0006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:30.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.819+0000 7efd25800640 1 --2- 172.21.15.122:0/1697662120 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efd00068380 0x7efd0006a840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efd14000f70 tx=0x7efd14007e50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:30.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.823+0000 7efd1d600640 1 -- 172.21.15.122:0/1697662120 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efd0c125020 con 0x7efd2009af80 2024-05-28T06:06:30.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.983+0000 7efd26c00640 1 -- 172.21.15.122:0/1697662120 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7efd200cc590 con 0x7efd2009af80 2024-05-28T06:06:30.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.983+0000 7efd1d600640 1 -- 172.21.15.122:0/1697662120 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7efd0c016150 con 0x7efd2009af80 2024-05-28T06:06:30.990 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 32 2024-05-28T06:06:30.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.987+0000 7efd26c00640 1 -- 172.21.15.122:0/1697662120 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efd00068380 msgr2=0x7efd0006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:30.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.987+0000 7efd26c00640 1 --2- 172.21.15.122:0/1697662120 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efd00068380 0x7efd0006a840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efd14000f70 tx=0x7efd14007e50 comp rx=0 tx=0).stop 2024-05-28T06:06:30.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.987+0000 7efd26c00640 1 -- 172.21.15.122:0/1697662120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd2009af80 msgr2=0x7efd200b6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:30.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.987+0000 7efd26c00640 1 --2- 172.21.15.122:0/1697662120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd2009af80 0x7efd200b6aa0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efd0c01a190 tx=0x7efd0c019300 comp rx=0 tx=0).stop 2024-05-28T06:06:30.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.987+0000 7efd26c00640 1 -- 172.21.15.122:0/1697662120 shutdown_connections 2024-05-28T06:06:30.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.987+0000 7efd26c00640 1 --2- 172.21.15.122:0/1697662120 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efd00068380 0x7efd0006a840 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.987+0000 7efd26c00640 1 --2- 172.21.15.122:0/1697662120 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd20161ff0 0x7efd20070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.987+0000 7efd26c00640 1 --2- 172.21.15.122:0/1697662120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd2009af80 0x7efd200b6aa0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.987+0000 7efd26c00640 1 --2- 172.21.15.122:0/1697662120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2006cc60 0x7efd200b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:30.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.987+0000 7efd26c00640 1 -- 172.21.15.122:0/1697662120 >> 172.21.15.122:0/1697662120 conn(0x7efd200b3f80 msgr2=0x7efd2015b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:30.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.987+0000 7efd26c00640 1 -- 172.21.15.122:0/1697662120 shutdown_connections 2024-05-28T06:06:30.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:30.987+0000 7efd26c00640 1 -- 172.21.15.122:0/1697662120 wait complete. 2024-05-28T06:06:31.010 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-28T06:06:31.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.143+0000 7fddf9800640 1 Processor -- start 2024-05-28T06:06:31.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.143+0000 7fddf9800640 1 -- start start 2024-05-28T06:06:31.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.143+0000 7fddf9800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fddf40cff30 0x7fddf406f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:31.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.143+0000 7fddf9800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fddf40cdb00 0x7fddf40b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:31.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.143+0000 7fddf9800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf40cdf00 con 0x7fddf406f6c0 2024-05-28T06:06:31.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.143+0000 7fddf9800640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fddf406fb30 con 0x7fddf40cff30 2024-05-28T06:06:31.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.143+0000 7fddf9800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fddf40d0310 con 0x7fddf40cdb00 2024-05-28T06:06:31.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.143+0000 7fddf2a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fddf40cff30 0x7fddf406f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:31.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.143+0000 7fddf2a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fddf40cff30 0x7fddf406f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37832/0 (socket says 172.21.15.122:37832) 2024-05-28T06:06:31.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.143+0000 7fddf2a00640 1 -- 172.21.15.122:0/4046516910 learned_addr learned my addr 172.21.15.122:0/4046516910 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:31.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.143+0000 7fddf3400640 1 --2- 172.21.15.122:0/4046516910 >> v2:172.21.15.153:3300/0 conn(0x7fddf40cdb00 0x7fddf40b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:31.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.143+0000 7fddf2a00640 1 -- 172.21.15.122:0/4046516910 >> v2:172.21.15.153:3300/0 conn(0x7fddf40cdb00 msgr2=0x7fddf40b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:31.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.143+0000 7fddf2a00640 1 --2- 172.21.15.122:0/4046516910 >> v2:172.21.15.153:3300/0 conn(0x7fddf40cdb00 0x7fddf40b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.143+0000 7fddf2a00640 1 -- 172.21.15.122:0/4046516910 >> v1:172.21.15.153:6789/0 conn(0x7fddf406f6c0 legacy=0x7fddf40cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:31.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.143+0000 7fddf2a00640 1 -- 172.21.15.122:0/4046516910 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf415be20 con 0x7fddf40cff30 2024-05-28T06:06:31.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.147+0000 7fddf2a00640 1 --2- 172.21.15.122:0/4046516910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddf40cff30 0x7fddf406f180 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fddf415f010 tx=0x7fdde401ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83680a58396057c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:31.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.147+0000 7fddf1600640 1 -- 172.21.15.122:0/4046516910 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde40b4070 con 0x7fddf40cff30 2024-05-28T06:06:31.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.147+0000 7fddf1600640 1 -- 172.21.15.122:0/4046516910 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde40a7c90 con 0x7fddf40cff30 2024-05-28T06:06:31.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.147+0000 7fddf1600640 1 -- 172.21.15.122:0/4046516910 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde40af660 con 0x7fddf40cff30 2024-05-28T06:06:31.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.147+0000 7fddf9800640 1 -- 172.21.15.122:0/4046516910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddf40cff30 msgr2=0x7fddf406f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:31.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.147+0000 7fddf9800640 1 --2- 172.21.15.122:0/4046516910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddf40cff30 0x7fddf406f180 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fddf415f010 tx=0x7fdde401ebc0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.147+0000 7fddf9800640 1 -- 172.21.15.122:0/4046516910 shutdown_connections 2024-05-28T06:06:31.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.147+0000 7fddf9800640 1 --2- 172.21.15.122:0/4046516910 >> v2:172.21.15.153:3300/0 conn(0x7fddf40cdb00 0x7fddf40b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.147+0000 7fddf9800640 1 --2- 172.21.15.122:0/4046516910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddf40cff30 0x7fddf406f180 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.147+0000 7fddf9800640 1 -- 172.21.15.122:0/4046516910 >> 172.21.15.122:0/4046516910 conn(0x7fddf406bd90 msgr2=0x7fddf406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:31.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.147+0000 7fddf9800640 1 -- 172.21.15.122:0/4046516910 shutdown_connections 2024-05-28T06:06:31.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.147+0000 7fddf9800640 1 -- 172.21.15.122:0/4046516910 wait complete. 2024-05-28T06:06:31.157 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddf9800640 1 Processor -- start 2024-05-28T06:06:31.157 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddf9800640 1 -- start start 2024-05-28T06:06:31.157 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddf9800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddf406f6c0 0x7fddf4142a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:31.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddf9800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fddf40cdb00 0x7fddf4157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:31.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddf9800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddf40cff30 0x7fddf40ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:31.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddf9800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fddf40b5700 con 0x7fddf40cff30 2024-05-28T06:06:31.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddf9800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fddf415baf0 con 0x7fddf406f6c0 2024-05-28T06:06:31.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddf9800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fddf40b5880 con 0x7fddf40cdb00 2024-05-28T06:06:31.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddf3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddf40cff30 0x7fddf40ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:31.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddf3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddf40cff30 0x7fddf40ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37838/0 (socket says 172.21.15.122:37838) 2024-05-28T06:06:31.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddf3400640 1 -- 172.21.15.122:0/3616417613 learned_addr learned my addr 172.21.15.122:0/3616417613 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:31.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddf2a00640 1 --2- 172.21.15.122:0/3616417613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddf406f6c0 0x7fddf4142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:31.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddf2000640 1 --2- 172.21.15.122:0/3616417613 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fddf40cdb00 0x7fddf4157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:31.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddf3400640 1 -- 172.21.15.122:0/3616417613 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fddf40cdb00 msgr2=0x7fddf4157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:31.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddf3400640 1 --2- 172.21.15.122:0/3616417613 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fddf40cdb00 0x7fddf4157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddf3400640 1 -- 172.21.15.122:0/3616417613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddf406f6c0 msgr2=0x7fddf4142a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:31.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddf3400640 1 --2- 172.21.15.122:0/3616417613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddf406f6c0 0x7fddf4142a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddf3400640 1 -- 172.21.15.122:0/3616417613 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf4142f90 con 0x7fddf40cff30 2024-05-28T06:06:31.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddf3400640 1 --2- 172.21.15.122:0/3616417613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddf40cff30 0x7fddf40ae8c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fddec007e40 tx=0x7fddec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:31.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddeaa00640 1 -- 172.21.15.122:0/3616417613 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec014620 con 0x7fddf40cff30 2024-05-28T06:06:31.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddeaa00640 1 -- 172.21.15.122:0/3616417613 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddec019070 con 0x7fddf40cff30 2024-05-28T06:06:31.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddf9800640 1 -- 172.21.15.122:0/3616417613 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf40adb00 con 0x7fddf40cff30 2024-05-28T06:06:31.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddeaa00640 1 -- 172.21.15.122:0/3616417613 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec014a20 con 0x7fddf40cff30 2024-05-28T06:06:31.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddf9800640 1 -- 172.21.15.122:0/3616417613 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf40ae0c0 con 0x7fddf40cff30 2024-05-28T06:06:31.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.151+0000 7fddf9800640 1 -- 172.21.15.122:0/3616417613 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf4068c40 con 0x7fddf40cff30 2024-05-28T06:06:31.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.155+0000 7fddeaa00640 1 -- 172.21.15.122:0/3616417613 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fddec014bc0 con 0x7fddf40cff30 2024-05-28T06:06:31.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.155+0000 7fddeaa00640 1 --2- 172.21.15.122:0/3616417613 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fddd4068380 0x7fddd406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:31.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.155+0000 7fddeaa00640 1 -- 172.21.15.122:0/3616417613 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fddec087340 con 0x7fddf40cff30 2024-05-28T06:06:31.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.155+0000 7fddf2a00640 1 --2- 172.21.15.122:0/3616417613 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fddd4068380 0x7fddd406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:31.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.155+0000 7fddf2a00640 1 --2- 172.21.15.122:0/3616417613 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fddd4068380 0x7fddd406a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdde40b1000 tx=0x7fdde4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:31.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.159+0000 7fddeaa00640 1 -- 172.21.15.122:0/3616417613 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fddf4142f90 con 0x7fddf40cff30 2024-05-28T06:06:31.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.315+0000 7fddf9800640 1 -- 172.21.15.122:0/3616417613 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fddf40ccdf0 con 0x7fddf40cff30 2024-05-28T06:06:31.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.315+0000 7fddeaa00640 1 -- 172.21.15.122:0/3616417613 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7fddec0577e0 con 0x7fddf40cff30 2024-05-28T06:06:31.321 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 64 2024-05-28T06:06:31.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.315+0000 7fddf9800640 1 -- 172.21.15.122:0/3616417613 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fddd4068380 msgr2=0x7fddd406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:31.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.315+0000 7fddf9800640 1 --2- 172.21.15.122:0/3616417613 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fddd4068380 0x7fddd406a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdde40b1000 tx=0x7fdde4008040 comp rx=0 tx=0).stop 2024-05-28T06:06:31.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.315+0000 7fddf9800640 1 -- 172.21.15.122:0/3616417613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddf40cff30 msgr2=0x7fddf40ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:31.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.315+0000 7fddf9800640 1 --2- 172.21.15.122:0/3616417613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddf40cff30 0x7fddf40ae8c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fddec007e40 tx=0x7fddec00e4b0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.315+0000 7fddf9800640 1 -- 172.21.15.122:0/3616417613 shutdown_connections 2024-05-28T06:06:31.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.315+0000 7fddf9800640 1 --2- 172.21.15.122:0/3616417613 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fddd4068380 0x7fddd406a840 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.315+0000 7fddf9800640 1 --2- 172.21.15.122:0/3616417613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddf40cff30 0x7fddf40ae8c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.315+0000 7fddf9800640 1 --2- 172.21.15.122:0/3616417613 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fddf40cdb00 0x7fddf4157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.315+0000 7fddf9800640 1 --2- 172.21.15.122:0/3616417613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddf406f6c0 0x7fddf4142a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.315+0000 7fddf9800640 1 -- 172.21.15.122:0/3616417613 >> 172.21.15.122:0/3616417613 conn(0x7fddf406bd90 msgr2=0x7fddf414e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:31.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.319+0000 7fddf9800640 1 -- 172.21.15.122:0/3616417613 shutdown_connections 2024-05-28T06:06:31.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.319+0000 7fddf9800640 1 -- 172.21.15.122:0/3616417613 wait complete. 2024-05-28T06:06:31.342 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:06:31.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.475+0000 7f693ca00640 1 Processor -- start 2024-05-28T06:06:31.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.475+0000 7f693ca00640 1 -- start start 2024-05-28T06:06:31.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.475+0000 7f693ca00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f69380cff30 0x7f693806f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:31.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.475+0000 7f693ca00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69380cdf00 con 0x7f693806f6c0 2024-05-28T06:06:31.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.475+0000 7f693ca00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69380d0310 con 0x7f69380cdb00 2024-05-28T06:06:31.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.475+0000 7f693ca00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f693806fb30 con 0x7f69380cff30 2024-05-28T06:06:31.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.475+0000 7f6935400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f693806f6c0 0x7f69380cd3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47264/0 (socket says 172.21.15.122:47264) 2024-05-28T06:06:31.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.475+0000 7f6935400640 1 -- 172.21.15.122:0/1107478999 learned_addr learned my addr 172.21.15.122:0/1107478999 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:31.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.475+0000 7f6935e00640 1 --2- 172.21.15.122:0/1107478999 >> v2:172.21.15.153:3300/0 conn(0x7f69380cff30 0x7f693806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:31.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.475+0000 7f6934a00640 1 -- 172.21.15.122:0/1107478999 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2022557082 0 0) 0x7f6924001120 con 0x7f693806f6c0 2024-05-28T06:06:31.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.475+0000 7f6934a00640 1 -- 172.21.15.122:0/1107478999 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f691c003530 con 0x7f693806f6c0 2024-05-28T06:06:31.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.479+0000 7f6934a00640 1 -- 172.21.15.122:0/1107478999 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4259462305 0 0) 0x7f691c003530 con 0x7f693806f6c0 2024-05-28T06:06:31.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.479+0000 7f6934a00640 1 -- 172.21.15.122:0/1107478999 >> v2:172.21.15.153:3300/0 conn(0x7f69380cff30 msgr2=0x7f693806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:31.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.479+0000 7f6934a00640 1 --2- 172.21.15.122:0/1107478999 >> v2:172.21.15.153:3300/0 conn(0x7f69380cff30 0x7f693806f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.479+0000 7f6934a00640 1 -- 172.21.15.122:0/1107478999 >> v1:172.21.15.153:6789/0 conn(0x7f69380cdb00 legacy=0x7f69380b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:31.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.479+0000 7f6934a00640 1 -- 172.21.15.122:0/1107478999 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f693815be20 con 0x7f693806f6c0 2024-05-28T06:06:31.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.479+0000 7f6934a00640 1 -- 172.21.15.122:0/1107478999 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f6924001850 con 0x7f693806f6c0 2024-05-28T06:06:31.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.479+0000 7f6934a00640 1 -- 172.21.15.122:0/1107478999 >> v1:172.21.15.122:6789/0 conn(0x7f693806f6c0 legacy=0x7f69380cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:31.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.479+0000 7f6934a00640 1 --2- 172.21.15.122:0/1107478999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f691c0039c0 0x7f691c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:31.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.479+0000 7f6934a00640 1 --2- 172.21.15.122:0/1107478999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f691c004810 0x7f691c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:31.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.479+0000 7f6934a00640 1 --2- 172.21.15.122:0/1107478999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f691c0051d0 0x7f691c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:31.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.479+0000 7f6934a00640 1 -- 172.21.15.122:0/1107478999 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f693806fb30 con 0x7f691c0039c0 2024-05-28T06:06:31.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.479+0000 7f6934a00640 1 -- 172.21.15.122:0/1107478999 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f691c00c070 con 0x7f691c004810 2024-05-28T06:06:31.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.479+0000 7f6934a00640 1 -- 172.21.15.122:0/1107478999 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f691c00c270 con 0x7f691c0051d0 2024-05-28T06:06:31.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.479+0000 7f6935e00640 1 --2- 172.21.15.122:0/1107478999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f691c0039c0 0x7f691c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:31.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.479+0000 7f6936800640 1 --2- 172.21.15.122:0/1107478999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f691c0051d0 0x7f691c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:31.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.479+0000 7f6935400640 1 --2- 172.21.15.122:0/1107478999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f691c004810 0x7f691c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:31.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.479+0000 7f6935e00640 1 -- 172.21.15.122:0/1107478999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f691c0051d0 msgr2=0x7f691c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:31.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.479+0000 7f6935e00640 1 --2- 172.21.15.122:0/1107478999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f691c0051d0 0x7f691c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.479+0000 7f6935e00640 1 -- 172.21.15.122:0/1107478999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f691c004810 msgr2=0x7f691c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:31.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.479+0000 7f6935e00640 1 --2- 172.21.15.122:0/1107478999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f691c004810 0x7f691c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.479+0000 7f6935e00640 1 -- 172.21.15.122:0/1107478999 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691c003530 con 0x7f691c0039c0 2024-05-28T06:06:31.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.479+0000 7f6936800640 1 -- 172.21.15.122:0/1107478999 reap_dead start 2024-05-28T06:06:31.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.479+0000 7f6935e00640 1 --2- 172.21.15.122:0/1107478999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f691c0039c0 0x7f691c003de0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6928009ae0 tx=0x7f692801ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b25be5cc96ae52 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:31.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.483+0000 7f6934a00640 1 -- 172.21.15.122:0/1107478999 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69280b2070 con 0x7f691c0039c0 2024-05-28T06:06:31.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.483+0000 7f6934a00640 1 -- 172.21.15.122:0/1107478999 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69280a5630 con 0x7f691c0039c0 2024-05-28T06:06:31.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.483+0000 7f6934a00640 1 -- 172.21.15.122:0/1107478999 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69280096b0 con 0x7f691c0039c0 2024-05-28T06:06:31.488 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.483+0000 7f693ca00640 1 -- 172.21.15.122:0/1107478999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f691c0039c0 msgr2=0x7f691c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:31.488 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.483+0000 7f693ca00640 1 --2- 172.21.15.122:0/1107478999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f691c0039c0 0x7f691c003de0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6928009ae0 tx=0x7f692801ca60 comp rx=0 tx=0).stop 2024-05-28T06:06:31.488 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.483+0000 7f693ca00640 1 -- 172.21.15.122:0/1107478999 shutdown_connections 2024-05-28T06:06:31.488 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.483+0000 7f693ca00640 1 --2- 172.21.15.122:0/1107478999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f691c0039c0 0x7f691c003de0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.488 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.483+0000 7f693ca00640 1 -- 172.21.15.122:0/1107478999 >> 172.21.15.122:0/1107478999 conn(0x7f693806bd90 msgr2=0x7f693806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:31.488 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.483+0000 7f693ca00640 1 -- 172.21.15.122:0/1107478999 shutdown_connections 2024-05-28T06:06:31.488 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.483+0000 7f693ca00640 1 -- 172.21.15.122:0/1107478999 wait complete. 2024-05-28T06:06:31.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.483+0000 7f693ca00640 1 Processor -- start 2024-05-28T06:06:31.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.483+0000 7f693ca00640 1 -- start start 2024-05-28T06:06:31.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.483+0000 7f693ca00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f691c0039c0 0x7f693814b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:31.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.483+0000 7f693ca00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6938158c60 0x7f69380ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:31.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.483+0000 7f693ca00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69380b4d80 0x7f69380b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:31.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.483+0000 7f693ca00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f69380cd800 con 0x7f69380b4d80 2024-05-28T06:06:31.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.483+0000 7f693ca00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f693815baf0 con 0x7f691c0039c0 2024-05-28T06:06:31.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.483+0000 7f693ca00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f69380cd980 con 0x7f6938158c60 2024-05-28T06:06:31.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.483+0000 7f6936800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69380b4d80 0x7f69380b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:31.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.483+0000 7f6936800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69380b4d80 0x7f69380b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37842/0 (socket says 172.21.15.122:37842) 2024-05-28T06:06:31.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.483+0000 7f6936800640 1 -- 172.21.15.122:0/269269394 learned_addr learned my addr 172.21.15.122:0/269269394 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:31.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.483+0000 7f6935e00640 1 --2- 172.21.15.122:0/269269394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f691c0039c0 0x7f693814b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:31.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.483+0000 7f6935400640 1 --2- 172.21.15.122:0/269269394 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6938158c60 0x7f69380ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:31.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.487+0000 7f6936800640 1 -- 172.21.15.122:0/269269394 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6938158c60 msgr2=0x7f69380ae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:31.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.487+0000 7f6936800640 1 --2- 172.21.15.122:0/269269394 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6938158c60 0x7f69380ae060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.487+0000 7f6936800640 1 -- 172.21.15.122:0/269269394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f691c0039c0 msgr2=0x7f693814b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:31.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.487+0000 7f6936800640 1 --2- 172.21.15.122:0/269269394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f691c0039c0 0x7f693814b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.487+0000 7f6936800640 1 -- 172.21.15.122:0/269269394 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69380afa70 con 0x7f69380b4d80 2024-05-28T06:06:31.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.487+0000 7f6936800640 1 --2- 172.21.15.122:0/269269394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69380b4d80 0x7f69380b5200 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f69380b3b00 tx=0x7f693000fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:31.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.487+0000 7f692e000640 1 -- 172.21.15.122:0/269269394 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6930003980 con 0x7f69380b4d80 2024-05-28T06:06:31.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.487+0000 7f692e000640 1 -- 172.21.15.122:0/269269394 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6930018070 con 0x7f69380b4d80 2024-05-28T06:06:31.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.487+0000 7f692e000640 1 -- 172.21.15.122:0/269269394 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6930003d80 con 0x7f69380b4d80 2024-05-28T06:06:31.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.487+0000 7f693ca00640 1 -- 172.21.15.122:0/269269394 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69380ae9d0 con 0x7f69380b4d80 2024-05-28T06:06:31.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.487+0000 7f693ca00640 1 -- 172.21.15.122:0/269269394 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69380aef90 con 0x7f69380b4d80 2024-05-28T06:06:31.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.487+0000 7f693ca00640 1 -- 172.21.15.122:0/269269394 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6938068c40 con 0x7f69380b4d80 2024-05-28T06:06:31.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.487+0000 7f692e000640 1 -- 172.21.15.122:0/269269394 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f69300050d0 con 0x7f69380b4d80 2024-05-28T06:06:31.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.487+0000 7f692e000640 1 --2- 172.21.15.122:0/269269394 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f69180683b0 0x7f691806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:31.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.487+0000 7f692e000640 1 -- 172.21.15.122:0/269269394 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f69300866d0 con 0x7f69380b4d80 2024-05-28T06:06:31.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.491+0000 7f6935e00640 1 --2- 172.21.15.122:0/269269394 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f69180683b0 0x7f691806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:31.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.491+0000 7f6935e00640 1 --2- 172.21.15.122:0/269269394 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f69180683b0 0x7f691806a870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f69280af000 tx=0x7f69280046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:31.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.491+0000 7f692e000640 1 -- 172.21.15.122:0/269269394 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6930056b70 con 0x7f69380b4d80 2024-05-28T06:06:31.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.683+0000 7f693ca00640 1 -- 172.21.15.122:0/269269394 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69380b5f60 con 0x7f69380b4d80 2024-05-28T06:06:31.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.683+0000 7f692e000640 1 -- 172.21.15.122:0/269269394 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7f6930056470 con 0x7f69380b4d80 2024-05-28T06:06:31.689 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:31.689 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4177682646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4177682646},{"type":"v1","addr":"172.21.15.153:6835","nonce":4177682646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3318983491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3318983491},{"type":"v1","addr":"172.21.15.153:6834","nonce":3318983491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/360722760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":360722760},{"type":"v1","addr":"172.21.15.122:6836","nonce":360722760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-28T06:05:49.194771+0000","modified":"2024-05-28T06:05:52.203797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1474216380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1474216380},{"type":"v1","addr":"172.21.15.122:6837","nonce":1474216380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4270,"qdb_cluster":[4270]},"id":1}]} 2024-05-28T06:06:31.689 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 8 2024-05-28T06:06:31.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.683+0000 7f693ca00640 1 -- 172.21.15.122:0/269269394 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f69180683b0 msgr2=0x7f691806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:31.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.683+0000 7f693ca00640 1 --2- 172.21.15.122:0/269269394 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f69180683b0 0x7f691806a870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f69280af000 tx=0x7f69280046d0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.683+0000 7f693ca00640 1 -- 172.21.15.122:0/269269394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69380b4d80 msgr2=0x7f69380b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:31.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.683+0000 7f693ca00640 1 --2- 172.21.15.122:0/269269394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69380b4d80 0x7f69380b5200 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f69380b3b00 tx=0x7f693000fbb0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.683+0000 7f693ca00640 1 -- 172.21.15.122:0/269269394 shutdown_connections 2024-05-28T06:06:31.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.683+0000 7f693ca00640 1 --2- 172.21.15.122:0/269269394 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f69180683b0 0x7f691806a870 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.683+0000 7f693ca00640 1 --2- 172.21.15.122:0/269269394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69380b4d80 0x7f69380b5200 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.683+0000 7f693ca00640 1 --2- 172.21.15.122:0/269269394 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6938158c60 0x7f69380ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.683+0000 7f693ca00640 1 --2- 172.21.15.122:0/269269394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f691c0039c0 0x7f693814b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.683+0000 7f693ca00640 1 -- 172.21.15.122:0/269269394 >> 172.21.15.122:0/269269394 conn(0x7f693806bd90 msgr2=0x7f6938153f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:31.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.683+0000 7f693ca00640 1 -- 172.21.15.122:0/269269394 shutdown_connections 2024-05-28T06:06:31.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.683+0000 7f693ca00640 1 -- 172.21.15.122:0/269269394 wait complete. 2024-05-28T06:06:31.709 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:06:31.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.839+0000 7fa01a400640 1 Processor -- start 2024-05-28T06:06:31.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.839+0000 7fa01a400640 1 -- start start 2024-05-28T06:06:31.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.843+0000 7fa01a400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa01406f890 0x7fa0140cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:31.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.843+0000 7fa01a400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa0140cd930 0x7fa0140b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:31.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.843+0000 7fa01a400640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0140d0310 con 0x7fa0140cff30 2024-05-28T06:06:31.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.843+0000 7fa01a400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fa01415be20 con 0x7fa01406f890 2024-05-28T06:06:31.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.843+0000 7fa01a400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa01415c100 con 0x7fa0140cd930 2024-05-28T06:06:31.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.843+0000 7fa00aa00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa01406f890 0x7fa0140cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:31.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.843+0000 7fa013400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fa0140cff30 0x7fa01406f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47280/0 (socket says 172.21.15.122:47280) 2024-05-28T06:06:31.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.843+0000 7fa013400640 1 -- 172.21.15.122:0/1759555005 learned_addr learned my addr 172.21.15.122:0/1759555005 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:31.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.843+0000 7fa00aa00640 1 -- 172.21.15.122:0/1759555005 >> v2:172.21.15.153:3300/0 conn(0x7fa0140cd930 msgr2=0x7fa0140b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:31.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.843+0000 7fa013e00640 1 --2- 172.21.15.122:0/1759555005 >> v2:172.21.15.153:3300/0 conn(0x7fa0140cd930 0x7fa0140b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:31.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.843+0000 7fa00aa00640 1 --2- 172.21.15.122:0/1759555005 >> v2:172.21.15.153:3300/0 conn(0x7fa0140cd930 0x7fa0140b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.843+0000 7fa00aa00640 1 -- 172.21.15.122:0/1759555005 >> v1:172.21.15.122:6789/0 conn(0x7fa0140cff30 legacy=0x7fa01406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:31.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.843+0000 7fa012a00640 1 -- 172.21.15.122:0/1759555005 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1890007935 0 0) 0x7fa0140d0310 con 0x7fa0140cff30 2024-05-28T06:06:31.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.843+0000 7fa00aa00640 1 -- 172.21.15.122:0/1759555005 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa01415c3e0 con 0x7fa01406f890 2024-05-28T06:06:31.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.843+0000 7fa013e00640 1 --2- 172.21.15.122:0/1759555005 >> v2:172.21.15.153:3300/0 conn(0x7fa0140cd930 0x7fa0140b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:31.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.843+0000 7fa00aa00640 1 --2- 172.21.15.122:0/1759555005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa01406f890 0x7fa0140cd3f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa01415f040 tx=0x7f9ffc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e320612639164218 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:31.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.843+0000 7fa012a00640 1 -- 172.21.15.122:0/1759555005 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc0ab5f0 con 0x7fa01406f890 2024-05-28T06:06:31.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.843+0000 7fa012a00640 1 -- 172.21.15.122:0/1759555005 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ffc0b0070 con 0x7fa01406f890 2024-05-28T06:06:31.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.843+0000 7fa012a00640 1 -- 172.21.15.122:0/1759555005 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc0ab9b0 con 0x7fa01406f890 2024-05-28T06:06:31.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa01a400640 1 -- 172.21.15.122:0/1759555005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa01406f890 msgr2=0x7fa0140cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:31.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa01a400640 1 --2- 172.21.15.122:0/1759555005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa01406f890 0x7fa0140cd3f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa01415f040 tx=0x7f9ffc01c450 comp rx=0 tx=0).stop 2024-05-28T06:06:31.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa01a400640 1 -- 172.21.15.122:0/1759555005 shutdown_connections 2024-05-28T06:06:31.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa01a400640 1 --2- 172.21.15.122:0/1759555005 >> v2:172.21.15.153:3300/0 conn(0x7fa0140cd930 0x7fa0140b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa01a400640 1 --2- 172.21.15.122:0/1759555005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa01406f890 0x7fa0140cd3f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa01a400640 1 -- 172.21.15.122:0/1759555005 >> 172.21.15.122:0/1759555005 conn(0x7fa01406bd90 msgr2=0x7fa01406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:31.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa01a400640 1 -- 172.21.15.122:0/1759555005 shutdown_connections 2024-05-28T06:06:31.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa01a400640 1 -- 172.21.15.122:0/1759555005 wait complete. 2024-05-28T06:06:31.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa01a400640 1 Processor -- start 2024-05-28T06:06:31.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa01a400640 1 -- start start 2024-05-28T06:06:31.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa01a400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa01406f890 0x7fa0141f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:31.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa01a400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0140cd930 0x7fa0141455e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:31.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa01a400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0140cff30 0x7fa014145b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:31.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa01a400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa0140b5880 con 0x7fa0140cd930 2024-05-28T06:06:31.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa01a400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa0140b5700 con 0x7fa0140cff30 2024-05-28T06:06:31.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa01a400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa0140b5a00 con 0x7fa01406f890 2024-05-28T06:06:31.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa00aa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0140cd930 0x7fa0141455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:31.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa00aa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0140cd930 0x7fa0141455e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37854/0 (socket says 172.21.15.122:37854) 2024-05-28T06:06:31.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa00aa00640 1 -- 172.21.15.122:0/2541914228 learned_addr learned my addr 172.21.15.122:0/2541914228 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:31.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa013e00640 1 --2- 172.21.15.122:0/2541914228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0140cff30 0x7fa014145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:31.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa013400640 1 --2- 172.21.15.122:0/2541914228 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa01406f890 0x7fa0141f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:31.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa00aa00640 1 -- 172.21.15.122:0/2541914228 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa01406f890 msgr2=0x7fa0141f6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:31.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa00aa00640 1 --2- 172.21.15.122:0/2541914228 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa01406f890 0x7fa0141f6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa00aa00640 1 -- 172.21.15.122:0/2541914228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0140cff30 msgr2=0x7fa014145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:31.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa00aa00640 1 --2- 172.21.15.122:0/2541914228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0140cff30 0x7fa014145b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:31.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.847+0000 7fa00aa00640 1 -- 172.21.15.122:0/2541914228 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa014157620 con 0x7fa0140cd930 2024-05-28T06:06:31.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.851+0000 7fa00aa00640 1 --2- 172.21.15.122:0/2541914228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0140cd930 0x7fa0141455e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc0ad040 tx=0x7f9ffc01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:31.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.851+0000 7fa00be00640 1 -- 172.21.15.122:0/2541914228 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc0bf610 con 0x7fa0140cd930 2024-05-28T06:06:31.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.851+0000 7fa00be00640 1 -- 172.21.15.122:0/2541914228 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ffc0bf7b0 con 0x7fa0140cd930 2024-05-28T06:06:31.857 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.851+0000 7fa00be00640 1 -- 172.21.15.122:0/2541914228 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc0bfb60 con 0x7fa0140cd930 2024-05-28T06:06:31.857 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.851+0000 7fa01a400640 1 -- 172.21.15.122:0/2541914228 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa014157900 con 0x7fa0140cd930 2024-05-28T06:06:31.857 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.851+0000 7fa01a400640 1 -- 172.21.15.122:0/2541914228 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa014157ec0 con 0x7fa0140cd930 2024-05-28T06:06:31.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.851+0000 7fa01a400640 1 -- 172.21.15.122:0/2541914228 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa014068c40 con 0x7fa0140cd930 2024-05-28T06:06:31.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.851+0000 7fa00be00640 1 -- 172.21.15.122:0/2541914228 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9ffc0bd020 con 0x7fa0140cd930 2024-05-28T06:06:31.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.851+0000 7fa00be00640 1 --2- 172.21.15.122:0/2541914228 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9ff0068380 0x7f9ff006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:31.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.851+0000 7fa00be00640 1 -- 172.21.15.122:0/2541914228 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f9ffc121060 con 0x7fa0140cd930 2024-05-28T06:06:31.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.851+0000 7fa013400640 1 --2- 172.21.15.122:0/2541914228 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9ff0068380 0x7f9ff006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:31.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.855+0000 7fa013400640 1 --2- 172.21.15.122:0/2541914228 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9ff0068380 0x7f9ff006a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa004000f70 tx=0x7fa004007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:31.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:31.855+0000 7fa00be00640 1 -- 172.21.15.122:0/2541914228 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9ffc016070 con 0x7fa0140cd930 2024-05-28T06:06:32.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.011+0000 7fa01a400640 1 -- 172.21.15.122:0/2541914228 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa0140ccdf0 con 0x7fa0140cd930 2024-05-28T06:06:32.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.015+0000 7fa00be00640 1 -- 172.21.15.122:0/2541914228 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16855 (secure 0 0 0) 0x7f9ffc0f1470 con 0x7fa0140cd930 2024-05-28T06:06:32.020 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:32.020 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":22,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:06:30.430478+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:05:47.441193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-28T06:05:48.148164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:06:32.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.015+0000 7fa01a400640 1 -- 172.21.15.122:0/2541914228 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9ff0068380 msgr2=0x7f9ff006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:32.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.015+0000 7fa01a400640 1 --2- 172.21.15.122:0/2541914228 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9ff0068380 0x7f9ff006a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa004000f70 tx=0x7fa004007c10 comp rx=0 tx=0).stop 2024-05-28T06:06:32.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.015+0000 7fa01a400640 1 -- 172.21.15.122:0/2541914228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0140cd930 msgr2=0x7fa0141455e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:32.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.015+0000 7fa01a400640 1 --2- 172.21.15.122:0/2541914228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0140cd930 0x7fa0141455e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc0ad040 tx=0x7f9ffc01ac90 comp rx=0 tx=0).stop 2024-05-28T06:06:32.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.015+0000 7fa01a400640 1 -- 172.21.15.122:0/2541914228 shutdown_connections 2024-05-28T06:06:32.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.015+0000 7fa01a400640 1 --2- 172.21.15.122:0/2541914228 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9ff0068380 0x7f9ff006a840 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.015+0000 7fa01a400640 1 --2- 172.21.15.122:0/2541914228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0140cff30 0x7fa014145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.015+0000 7fa01a400640 1 --2- 172.21.15.122:0/2541914228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0140cd930 0x7fa0141455e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.015+0000 7fa01a400640 1 --2- 172.21.15.122:0/2541914228 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa01406f890 0x7fa0141f6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.015+0000 7fa01a400640 1 -- 172.21.15.122:0/2541914228 >> 172.21.15.122:0/2541914228 conn(0x7fa01406bd90 msgr2=0x7fa014072a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:32.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.015+0000 7fa01a400640 1 -- 172.21.15.122:0/2541914228 shutdown_connections 2024-05-28T06:06:32.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.015+0000 7fa01a400640 1 -- 172.21.15.122:0/2541914228 wait complete. 2024-05-28T06:06:32.043 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-28T06:06:32.043 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:06:32.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.171+0000 7efed9200640 1 Processor -- start 2024-05-28T06:06:32.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.171+0000 7efed9200640 1 -- start start 2024-05-28T06:06:32.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.175+0000 7efed9200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efed415f740 0x7efed4167240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:32.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.175+0000 7efed9200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efed415d970 con 0x7efed40ce4f0 2024-05-28T06:06:32.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.175+0000 7efed9200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efed415dc50 con 0x7efed40b58d0 2024-05-28T06:06:32.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.175+0000 7efed9200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7efed415df30 con 0x7efed415f740 2024-05-28T06:06:32.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.175+0000 7efed2800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efed415f740 0x7efed4167240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:32.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.175+0000 7efec9400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7efed40ce4f0 0x7efed40ce980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47292/0 (socket says 172.21.15.122:47292) 2024-05-28T06:06:32.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.175+0000 7efec9400640 1 -- 172.21.15.122:0/1865301106 learned_addr learned my addr 172.21.15.122:0/1865301106 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:32.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.175+0000 7efed2800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efed415f740 0x7efed4167240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37858/0 (socket says 172.21.15.122:37858) 2024-05-28T06:06:32.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.175+0000 7efed2800640 1 -- 172.21.15.122:0/1865301106 >> v1:172.21.15.153:6789/0 conn(0x7efed40b58d0 legacy=0x7efed40b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:32.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.175+0000 7efed2800640 1 -- 172.21.15.122:0/1865301106 >> v1:172.21.15.122:6789/0 conn(0x7efed40ce4f0 legacy=0x7efed40ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:32.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.175+0000 7efed2800640 1 -- 172.21.15.122:0/1865301106 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed415e210 con 0x7efed415f740 2024-05-28T06:06:32.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.175+0000 7efed1400640 1 -- 172.21.15.122:0/1865301106 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 927508864 0 0) 0x7efed415d970 con 0x7efed40ce4f0 2024-05-28T06:06:32.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.179+0000 7efed2800640 1 --2- 172.21.15.122:0/1865301106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efed415f740 0x7efed4167240 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efecc009d90 tx=0x7efecc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b9cc2a512f7d2b server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:32.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.179+0000 7efed1400640 1 -- 172.21.15.122:0/1865301106 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc0b2070 con 0x7efed415f740 2024-05-28T06:06:32.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.179+0000 7efed1400640 1 -- 172.21.15.122:0/1865301106 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efecc0a5840 con 0x7efed415f740 2024-05-28T06:06:32.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.179+0000 7efed1400640 1 -- 172.21.15.122:0/1865301106 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc0a5c10 con 0x7efed415f740 2024-05-28T06:06:32.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.179+0000 7efed9200640 1 -- 172.21.15.122:0/1865301106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efed415f740 msgr2=0x7efed4167240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:32.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.179+0000 7efed9200640 1 --2- 172.21.15.122:0/1865301106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efed415f740 0x7efed4167240 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efecc009d90 tx=0x7efecc01c970 comp rx=0 tx=0).stop 2024-05-28T06:06:32.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.179+0000 7efed9200640 1 -- 172.21.15.122:0/1865301106 shutdown_connections 2024-05-28T06:06:32.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.179+0000 7efed9200640 1 --2- 172.21.15.122:0/1865301106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efed415f740 0x7efed4167240 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.179+0000 7efed9200640 1 -- 172.21.15.122:0/1865301106 >> 172.21.15.122:0/1865301106 conn(0x7efed406bd90 msgr2=0x7efed406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:32.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.179+0000 7efed9200640 1 -- 172.21.15.122:0/1865301106 shutdown_connections 2024-05-28T06:06:32.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.179+0000 7efed9200640 1 -- 172.21.15.122:0/1865301106 wait complete. 2024-05-28T06:06:32.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.179+0000 7efed9200640 1 Processor -- start 2024-05-28T06:06:32.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.179+0000 7efed9200640 1 -- start start 2024-05-28T06:06:32.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.179+0000 7efed9200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efed40b58d0 0x7efed413de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:32.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.179+0000 7efed9200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efed40ce4f0 0x7efed40aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:32.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.179+0000 7efed9200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efed415f740 0x7efed4154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:32.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.179+0000 7efed9200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efed416a330 con 0x7efed40ce4f0 2024-05-28T06:06:32.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.179+0000 7efed9200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efed416a1b0 con 0x7efed415f740 2024-05-28T06:06:32.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.179+0000 7efed9200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efed416a4b0 con 0x7efed40b58d0 2024-05-28T06:06:32.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.179+0000 7efec9400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efed40ce4f0 0x7efed40aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:32.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.179+0000 7efec9400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efed40ce4f0 0x7efed40aec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37870/0 (socket says 172.21.15.122:37870) 2024-05-28T06:06:32.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.179+0000 7efec9400640 1 -- 172.21.15.122:0/1457435275 learned_addr learned my addr 172.21.15.122:0/1457435275 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:32.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.183+0000 7efed1e00640 1 --2- 172.21.15.122:0/1457435275 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efed40b58d0 0x7efed413de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:32.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.183+0000 7efed2800640 1 --2- 172.21.15.122:0/1457435275 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efed415f740 0x7efed4154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:32.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.183+0000 7efec9400640 1 -- 172.21.15.122:0/1457435275 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efed40b58d0 msgr2=0x7efed413de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:32.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.183+0000 7efec9400640 1 --2- 172.21.15.122:0/1457435275 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efed40b58d0 0x7efed413de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.183+0000 7efec9400640 1 -- 172.21.15.122:0/1457435275 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efed415f740 msgr2=0x7efed4154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:32.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.183+0000 7efec9400640 1 --2- 172.21.15.122:0/1457435275 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efed415f740 0x7efed4154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.183+0000 7efec9400640 1 -- 172.21.15.122:0/1457435275 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed415c8d0 con 0x7efed40ce4f0 2024-05-28T06:06:32.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.183+0000 7efec9400640 1 --2- 172.21.15.122:0/1457435275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efed40ce4f0 0x7efed40aec30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efebc00c4a0 tx=0x7efebc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:32.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.183+0000 7efecaa00640 1 -- 172.21.15.122:0/1457435275 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc018070 con 0x7efed40ce4f0 2024-05-28T06:06:32.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.183+0000 7efecaa00640 1 -- 172.21.15.122:0/1457435275 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efebc0074e0 con 0x7efed40ce4f0 2024-05-28T06:06:32.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.183+0000 7efecaa00640 1 -- 172.21.15.122:0/1457435275 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc004a30 con 0x7efed40ce4f0 2024-05-28T06:06:32.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.183+0000 7efed9200640 1 -- 172.21.15.122:0/1457435275 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efed415c030 con 0x7efed40ce4f0 2024-05-28T06:06:32.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.183+0000 7efed9200640 1 -- 172.21.15.122:0/1457435275 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efed415c5f0 con 0x7efed40ce4f0 2024-05-28T06:06:32.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.183+0000 7efed9200640 1 -- 172.21.15.122:0/1457435275 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efed4068c40 con 0x7efed40ce4f0 2024-05-28T06:06:32.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.183+0000 7efecaa00640 1 -- 172.21.15.122:0/1457435275 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efebc004bd0 con 0x7efed40ce4f0 2024-05-28T06:06:32.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.183+0000 7efecaa00640 1 --2- 172.21.15.122:0/1457435275 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efeb0068380 0x7efeb006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:32.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.187+0000 7efecaa00640 1 -- 172.21.15.122:0/1457435275 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7efebc085cf0 con 0x7efed40ce4f0 2024-05-28T06:06:32.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.187+0000 7efed1e00640 1 --2- 172.21.15.122:0/1457435275 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efeb0068380 0x7efeb006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:32.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.187+0000 7efed1e00640 1 --2- 172.21.15.122:0/1457435275 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efeb0068380 0x7efeb006a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efed40b58a0 tx=0x7efec4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:32.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.191+0000 7efecaa00640 1 -- 172.21.15.122:0/1457435275 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efebc055bd0 con 0x7efed40ce4f0 2024-05-28T06:06:32.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.379+0000 7efed9200640 1 -- 172.21.15.122:0/1457435275 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efed413f690 con 0x7efed40ce4f0 2024-05-28T06:06:32.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.379+0000 7efecaa00640 1 -- 172.21.15.122:0/1457435275 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7efebc059ed0 con 0x7efed40ce4f0 2024-05-28T06:06:32.386 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:32.386 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4177682646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4177682646},{"type":"v1","addr":"172.21.15.153:6835","nonce":4177682646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3318983491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3318983491},{"type":"v1","addr":"172.21.15.153:6834","nonce":3318983491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/360722760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":360722760},{"type":"v1","addr":"172.21.15.122:6836","nonce":360722760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-28T06:05:49.194771+0000","modified":"2024-05-28T06:05:52.203797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1474216380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1474216380},{"type":"v1","addr":"172.21.15.122:6837","nonce":1474216380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4270,"qdb_cluster":[4270]},"id":1}]} 2024-05-28T06:06:32.386 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 8 2024-05-28T06:06:32.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.383+0000 7efed9200640 1 -- 172.21.15.122:0/1457435275 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efeb0068380 msgr2=0x7efeb006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:32.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.383+0000 7efed9200640 1 --2- 172.21.15.122:0/1457435275 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efeb0068380 0x7efeb006a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efed40b58a0 tx=0x7efec4009040 comp rx=0 tx=0).stop 2024-05-28T06:06:32.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.383+0000 7efed9200640 1 -- 172.21.15.122:0/1457435275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efed40ce4f0 msgr2=0x7efed40aec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:32.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.383+0000 7efed9200640 1 --2- 172.21.15.122:0/1457435275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efed40ce4f0 0x7efed40aec30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efebc00c4a0 tx=0x7efebc00c960 comp rx=0 tx=0).stop 2024-05-28T06:06:32.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.383+0000 7efed9200640 1 -- 172.21.15.122:0/1457435275 shutdown_connections 2024-05-28T06:06:32.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.383+0000 7efed9200640 1 --2- 172.21.15.122:0/1457435275 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efeb0068380 0x7efeb006a840 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.383+0000 7efed9200640 1 --2- 172.21.15.122:0/1457435275 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efed415f740 0x7efed4154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.383+0000 7efed9200640 1 --2- 172.21.15.122:0/1457435275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efed40ce4f0 0x7efed40aec30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.383+0000 7efed9200640 1 --2- 172.21.15.122:0/1457435275 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efed40b58d0 0x7efed413de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.383+0000 7efed9200640 1 -- 172.21.15.122:0/1457435275 >> 172.21.15.122:0/1457435275 conn(0x7efed406bd90 msgr2=0x7efed40ce940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:32.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.383+0000 7efed9200640 1 -- 172.21.15.122:0/1457435275 shutdown_connections 2024-05-28T06:06:32.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.383+0000 7efed9200640 1 -- 172.21.15.122:0/1457435275 wait complete. 2024-05-28T06:06:32.407 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:06:32.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.539+0000 7f4cefe00640 1 Processor -- start 2024-05-28T06:06:32.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.539+0000 7f4cefe00640 1 -- start start 2024-05-28T06:06:32.545 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.539+0000 7f4cefe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4cf0162440 0x7f4cf0162820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:32.545 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.539+0000 7f4cefe00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4cf00d0640 0x7f4cf009b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:32.545 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.539+0000 7f4cefe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf015eb40 0x7f4cf015efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:32.545 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.539+0000 7f4cefe00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f4cf00d17a0 con 0x7f4cf00d0640 2024-05-28T06:06:32.545 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.539+0000 7f4cefe00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f4cf0162d60 con 0x7f4cf0162440 2024-05-28T06:06:32.545 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.539+0000 7f4cefe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf00d0b90 con 0x7f4cf015eb40 2024-05-28T06:06:32.545 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.539+0000 7f4cee000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4cf00d0640 0x7f4cf009b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:32.545 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.539+0000 7f4cee000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4cf00d0640 0x7f4cf009b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37886/0 (socket says 172.21.15.122:37886) 2024-05-28T06:06:32.545 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.539+0000 7f4cee000640 1 -- 172.21.15.122:0/2992842563 learned_addr learned my addr 172.21.15.122:0/2992842563 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:32.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.539+0000 7f4cef400640 1 --2- 172.21.15.122:0/2992842563 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf015eb40 0x7f4cf015efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:32.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.539+0000 7f4ceea00640 1 --2- 172.21.15.122:0/2992842563 >> v2:172.21.15.153:3300/0 conn(0x7f4cf0162440 0x7f4cf0162820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:32.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.539+0000 7f4cee000640 1 -- 172.21.15.122:0/2992842563 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf015eb40 msgr2=0x7f4cf015efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:32.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.539+0000 7f4cee000640 1 --2- 172.21.15.122:0/2992842563 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf015eb40 0x7f4cf015efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.539+0000 7f4cee000640 1 -- 172.21.15.122:0/2992842563 >> v2:172.21.15.153:3300/0 conn(0x7f4cf0162440 msgr2=0x7f4cf0162820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:32.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.539+0000 7f4cee000640 1 --2- 172.21.15.122:0/2992842563 >> v2:172.21.15.153:3300/0 conn(0x7f4cf0162440 0x7f4cf0162820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.539+0000 7f4cee000640 1 -- 172.21.15.122:0/2992842563 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf00d0e70 con 0x7f4cf00d0640 2024-05-28T06:06:32.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.543+0000 7f4cee000640 1 --2- 172.21.15.122:0/2992842563 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cf00d0640 0x7f4cf009b4c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0073380 tx=0x7f4ce001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ac3b7094356b6d server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:32.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.543+0000 7f4ced600640 1 -- 172.21.15.122:0/2992842563 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce00aa610 con 0x7f4cf00d0640 2024-05-28T06:06:32.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.543+0000 7f4ced600640 1 -- 172.21.15.122:0/2992842563 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce00af070 con 0x7f4cf00d0640 2024-05-28T06:06:32.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.543+0000 7f4ced600640 1 -- 172.21.15.122:0/2992842563 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce00aa9d0 con 0x7f4cf00d0640 2024-05-28T06:06:32.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.543+0000 7f4cefe00640 1 -- 172.21.15.122:0/2992842563 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cf00d0640 msgr2=0x7f4cf009b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:32.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.543+0000 7f4cefe00640 1 --2- 172.21.15.122:0/2992842563 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cf00d0640 0x7f4cf009b4c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0073380 tx=0x7f4ce001c4f0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.543+0000 7f4cefe00640 1 -- 172.21.15.122:0/2992842563 shutdown_connections 2024-05-28T06:06:32.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.543+0000 7f4cefe00640 1 --2- 172.21.15.122:0/2992842563 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf015eb40 0x7f4cf015efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.543+0000 7f4cefe00640 1 --2- 172.21.15.122:0/2992842563 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cf00d0640 0x7f4cf009b4c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.543+0000 7f4cefe00640 1 --2- 172.21.15.122:0/2992842563 >> v2:172.21.15.153:3300/0 conn(0x7f4cf0162440 0x7f4cf0162820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.543+0000 7f4cefe00640 1 -- 172.21.15.122:0/2992842563 >> 172.21.15.122:0/2992842563 conn(0x7f4cf00d24d0 msgr2=0x7f4cf00d28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:32.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.543+0000 7f4cefe00640 1 -- 172.21.15.122:0/2992842563 shutdown_connections 2024-05-28T06:06:32.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.543+0000 7f4cefe00640 1 -- 172.21.15.122:0/2992842563 wait complete. 2024-05-28T06:06:32.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.543+0000 7f4cefe00640 1 Processor -- start 2024-05-28T06:06:32.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.543+0000 7f4cefe00640 1 -- start start 2024-05-28T06:06:32.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.547+0000 7f4cefe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cf00d0640 0x7f4cf015be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:32.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.547+0000 7f4cefe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf015eb40 0x7f4cf00b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:32.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.547+0000 7f4cefe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cf0162440 0x7f4cf00b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:32.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.547+0000 7f4cefe00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf00701a0 con 0x7f4cf0162440 2024-05-28T06:06:32.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.547+0000 7f4cefe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf0070020 con 0x7f4cf00d0640 2024-05-28T06:06:32.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.547+0000 7f4cefe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf0070320 con 0x7f4cf015eb40 2024-05-28T06:06:32.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.547+0000 7f4cef400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cf0162440 0x7f4cf00b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:32.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.547+0000 7f4cef400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cf0162440 0x7f4cf00b5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37896/0 (socket says 172.21.15.122:37896) 2024-05-28T06:06:32.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.547+0000 7f4cef400640 1 -- 172.21.15.122:0/1108422657 learned_addr learned my addr 172.21.15.122:0/1108422657 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:32.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.547+0000 7f4cee000640 1 --2- 172.21.15.122:0/1108422657 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf015eb40 0x7f4cf00b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:32.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.547+0000 7f4ceea00640 1 --2- 172.21.15.122:0/1108422657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cf00d0640 0x7f4cf015be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:32.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.547+0000 7f4cef400640 1 -- 172.21.15.122:0/1108422657 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf015eb40 msgr2=0x7f4cf00b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:32.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.547+0000 7f4cef400640 1 --2- 172.21.15.122:0/1108422657 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf015eb40 0x7f4cf00b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.547+0000 7f4cef400640 1 -- 172.21.15.122:0/1108422657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cf00d0640 msgr2=0x7f4cf015be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:32.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.547+0000 7f4cef400640 1 --2- 172.21.15.122:0/1108422657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cf00d0640 0x7f4cf015be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.547+0000 7f4cef400640 1 -- 172.21.15.122:0/1108422657 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf015bc30 con 0x7f4cf0162440 2024-05-28T06:06:32.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.547+0000 7f4cef400640 1 --2- 172.21.15.122:0/1108422657 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cf0162440 0x7f4cf00b5a80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8007e60 tx=0x7f4ce800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:32.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.547+0000 7f4ce6a00640 1 -- 172.21.15.122:0/1108422657 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8014620 con 0x7f4cf0162440 2024-05-28T06:06:32.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.547+0000 7f4ce6a00640 1 -- 172.21.15.122:0/1108422657 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce8019070 con 0x7f4cf0162440 2024-05-28T06:06:32.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.547+0000 7f4ce6a00640 1 -- 172.21.15.122:0/1108422657 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8014a20 con 0x7f4cf0162440 2024-05-28T06:06:32.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.547+0000 7f4cefe00640 1 -- 172.21.15.122:0/1108422657 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf00b7aa0 con 0x7f4cf0162440 2024-05-28T06:06:32.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.547+0000 7f4cefe00640 1 -- 172.21.15.122:0/1108422657 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cf00b8060 con 0x7f4cf0162440 2024-05-28T06:06:32.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.547+0000 7f4cefe00640 1 -- 172.21.15.122:0/1108422657 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cf0075620 con 0x7f4cf0162440 2024-05-28T06:06:32.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.551+0000 7f4ce6a00640 1 -- 172.21.15.122:0/1108422657 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4ce8014bc0 con 0x7f4cf0162440 2024-05-28T06:06:32.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.551+0000 7f4ce6a00640 1 --2- 172.21.15.122:0/1108422657 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4ccc068380 0x7f4ccc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:32.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.551+0000 7f4ce6a00640 1 -- 172.21.15.122:0/1108422657 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f4ce80870d0 con 0x7f4cf0162440 2024-05-28T06:06:32.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.551+0000 7f4ceea00640 1 --2- 172.21.15.122:0/1108422657 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4ccc068380 0x7f4ccc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:32.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.551+0000 7f4ceea00640 1 --2- 172.21.15.122:0/1108422657 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4ccc068380 0x7f4ccc06a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4cf00d1e50 tx=0x7f4cd8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:32.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.555+0000 7f4ce6a00640 1 -- 172.21.15.122:0/1108422657 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4cf015bc30 con 0x7f4cf0162440 2024-05-28T06:06:32.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.743+0000 7f4cefe00640 1 -- 172.21.15.122:0/1108422657 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4cf0169590 con 0x7f4cf0162440 2024-05-28T06:06:32.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.743+0000 7f4ce6a00640 1 -- 172.21.15.122:0/1108422657 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7f4ce8057050 con 0x7f4cf0162440 2024-05-28T06:06:32.749 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:32.749 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4177682646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4177682646},{"type":"v1","addr":"172.21.15.153:6835","nonce":4177682646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3318983491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3318983491},{"type":"v1","addr":"172.21.15.153:6834","nonce":3318983491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/360722760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":360722760},{"type":"v1","addr":"172.21.15.122:6836","nonce":360722760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-28T06:05:49.194771+0000","modified":"2024-05-28T06:05:52.203797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1474216380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1474216380},{"type":"v1","addr":"172.21.15.122:6837","nonce":1474216380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4270,"qdb_cluster":[4270]},"id":1}]} 2024-05-28T06:06:32.749 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 8 2024-05-28T06:06:32.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.743+0000 7f4cefe00640 1 -- 172.21.15.122:0/1108422657 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4ccc068380 msgr2=0x7f4ccc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:32.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.743+0000 7f4cefe00640 1 --2- 172.21.15.122:0/1108422657 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4ccc068380 0x7f4ccc06a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4cf00d1e50 tx=0x7f4cd8008040 comp rx=0 tx=0).stop 2024-05-28T06:06:32.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.743+0000 7f4cefe00640 1 -- 172.21.15.122:0/1108422657 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cf0162440 msgr2=0x7f4cf00b5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:32.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.743+0000 7f4cefe00640 1 --2- 172.21.15.122:0/1108422657 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cf0162440 0x7f4cf00b5a80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8007e60 tx=0x7f4ce800e4b0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.747+0000 7f4cefe00640 1 -- 172.21.15.122:0/1108422657 shutdown_connections 2024-05-28T06:06:32.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.747+0000 7f4cefe00640 1 --2- 172.21.15.122:0/1108422657 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4ccc068380 0x7f4ccc06a840 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.747+0000 7f4cefe00640 1 --2- 172.21.15.122:0/1108422657 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cf0162440 0x7f4cf00b5a80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.747+0000 7f4cefe00640 1 --2- 172.21.15.122:0/1108422657 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf015eb40 0x7f4cf00b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.747+0000 7f4cefe00640 1 --2- 172.21.15.122:0/1108422657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cf00d0640 0x7f4cf015be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.747+0000 7f4cefe00640 1 -- 172.21.15.122:0/1108422657 >> 172.21.15.122:0/1108422657 conn(0x7f4cf00d24d0 msgr2=0x7f4cf00b12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:32.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.747+0000 7f4cefe00640 1 -- 172.21.15.122:0/1108422657 shutdown_connections 2024-05-28T06:06:32.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.747+0000 7f4cefe00640 1 -- 172.21.15.122:0/1108422657 wait complete. 2024-05-28T06:06:32.771 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:06:32.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.899+0000 7f1e28600640 1 Processor -- start 2024-05-28T06:06:32.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.899+0000 7f1e28600640 1 -- start start 2024-05-28T06:06:32.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.903+0000 7f1e28600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1e200cff30 0x7f1e2006f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:32.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.903+0000 7f1e28600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e200cdf00 con 0x7f1e200cdb00 2024-05-28T06:06:32.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.903+0000 7f1e28600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e200d0310 con 0x7f1e2006f6c0 2024-05-28T06:06:32.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.903+0000 7f1e28600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1e2006fb30 con 0x7f1e200cff30 2024-05-28T06:06:32.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.903+0000 7f1e26600640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f1e200cdb00 0x7f1e200b49b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47300/0 (socket says 172.21.15.122:47300) 2024-05-28T06:06:32.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.903+0000 7f1e26600640 1 -- 172.21.15.122:0/2091906725 learned_addr learned my addr 172.21.15.122:0/2091906725 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:32.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.903+0000 7f1e25c00640 1 --2- 172.21.15.122:0/2091906725 >> v2:172.21.15.153:3300/0 conn(0x7f1e200cff30 0x7f1e2006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:32.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.903+0000 7f1e1fe00640 1 -- 172.21.15.122:0/2091906725 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2169972387 0 0) 0x7f1e180014a0 con 0x7f1e200cdb00 2024-05-28T06:06:32.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.903+0000 7f1e1fe00640 1 -- 172.21.15.122:0/2091906725 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e08003530 con 0x7f1e200cdb00 2024-05-28T06:06:32.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.903+0000 7f1e1fe00640 1 -- 172.21.15.122:0/2091906725 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 186948982 0 0) 0x7f1e200d0310 con 0x7f1e2006f6c0 2024-05-28T06:06:32.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.903+0000 7f1e1fe00640 1 -- 172.21.15.122:0/2091906725 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e180014a0 con 0x7f1e2006f6c0 2024-05-28T06:06:32.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.903+0000 7f1e1fe00640 1 -- 172.21.15.122:0/2091906725 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4034242434 0 0) 0x7f1e08003530 con 0x7f1e200cdb00 2024-05-28T06:06:32.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.903+0000 7f1e25c00640 1 -- 172.21.15.122:0/2091906725 >> v1:172.21.15.153:6789/0 conn(0x7f1e2006f6c0 legacy=0x7f1e200cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:32.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.903+0000 7f1e25c00640 1 -- 172.21.15.122:0/2091906725 >> v1:172.21.15.122:6789/0 conn(0x7f1e200cdb00 legacy=0x7f1e200b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:32.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.903+0000 7f1e25c00640 1 -- 172.21.15.122:0/2091906725 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2015be20 con 0x7f1e200cff30 2024-05-28T06:06:32.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.907+0000 7f1e25c00640 1 --2- 172.21.15.122:0/2091906725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e200cff30 0x7f1e2006f180 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1e140097c0 tx=0x7f1e1401c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=902392315e19f634 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:32.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.907+0000 7f1e1fe00640 1 -- 172.21.15.122:0/2091906725 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e140b1070 con 0x7f1e200cff30 2024-05-28T06:06:32.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.907+0000 7f1e1fe00640 1 -- 172.21.15.122:0/2091906725 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e140ac440 con 0x7f1e200cff30 2024-05-28T06:06:32.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.907+0000 7f1e1fe00640 1 -- 172.21.15.122:0/2091906725 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18001bd0 con 0x7f1e200cff30 2024-05-28T06:06:32.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.907+0000 7f1e28600640 1 -- 172.21.15.122:0/2091906725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e200cff30 msgr2=0x7f1e2006f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:32.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.907+0000 7f1e28600640 1 --2- 172.21.15.122:0/2091906725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e200cff30 0x7f1e2006f180 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1e140097c0 tx=0x7f1e1401c390 comp rx=0 tx=0).stop 2024-05-28T06:06:32.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.907+0000 7f1e28600640 1 -- 172.21.15.122:0/2091906725 shutdown_connections 2024-05-28T06:06:32.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.907+0000 7f1e28600640 1 --2- 172.21.15.122:0/2091906725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e200cff30 0x7f1e2006f180 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.907+0000 7f1e28600640 1 -- 172.21.15.122:0/2091906725 >> 172.21.15.122:0/2091906725 conn(0x7f1e2006bd90 msgr2=0x7f1e2006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:32.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.907+0000 7f1e28600640 1 -- 172.21.15.122:0/2091906725 shutdown_connections 2024-05-28T06:06:32.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.907+0000 7f1e28600640 1 -- 172.21.15.122:0/2091906725 wait complete. 2024-05-28T06:06:32.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.907+0000 7f1e28600640 1 Processor -- start 2024-05-28T06:06:32.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.907+0000 7f1e28600640 1 -- start start 2024-05-28T06:06:32.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e28600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e2006f6c0 0x7f1e20158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:32.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e28600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e200cdb00 0x7f1e20156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:32.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e28600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e200cff30 0x7f1e200ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:32.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e28600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1e200b58d0 con 0x7f1e200cff30 2024-05-28T06:06:32.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e28600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2015baf0 con 0x7f1e2006f6c0 2024-05-28T06:06:32.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e28600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1e200b5a50 con 0x7f1e200cdb00 2024-05-28T06:06:32.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e26600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e200cff30 0x7f1e200ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:32.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e26600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e200cff30 0x7f1e200ae2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37912/0 (socket says 172.21.15.122:37912) 2024-05-28T06:06:32.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e26600640 1 -- 172.21.15.122:0/1409489126 learned_addr learned my addr 172.21.15.122:0/1409489126 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:32.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e25c00640 1 --2- 172.21.15.122:0/1409489126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e2006f6c0 0x7f1e20158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:32.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e25200640 1 --2- 172.21.15.122:0/1409489126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e200cdb00 0x7f1e20156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:32.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e26600640 1 -- 172.21.15.122:0/1409489126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e200cdb00 msgr2=0x7f1e20156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:32.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e26600640 1 --2- 172.21.15.122:0/1409489126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e200cdb00 0x7f1e20156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e26600640 1 -- 172.21.15.122:0/1409489126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e2006f6c0 msgr2=0x7f1e20158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:32.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e26600640 1 --2- 172.21.15.122:0/1409489126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e2006f6c0 0x7f1e20158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:32.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e26600640 1 -- 172.21.15.122:0/1409489126 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e201525c0 con 0x7f1e200cff30 2024-05-28T06:06:32.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e25c00640 1 --2- 172.21.15.122:0/1409489126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e2006f6c0 0x7f1e20158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:06:32.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e26600640 1 --2- 172.21.15.122:0/1409489126 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e200cff30 0x7f1e200ae2f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1e18001c70 tx=0x7f1e1800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:32.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e1d600640 1 -- 172.21.15.122:0/1409489126 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18012400 con 0x7f1e200cff30 2024-05-28T06:06:32.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e1d600640 1 -- 172.21.15.122:0/1409489126 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e180125c0 con 0x7f1e200cff30 2024-05-28T06:06:32.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e1d600640 1 -- 172.21.15.122:0/1409489126 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e180129f0 con 0x7f1e200cff30 2024-05-28T06:06:32.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e28600640 1 -- 172.21.15.122:0/1409489126 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e201528a0 con 0x7f1e200cff30 2024-05-28T06:06:32.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e28600640 1 -- 172.21.15.122:0/1409489126 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e20152e60 con 0x7f1e200cff30 2024-05-28T06:06:32.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.911+0000 7f1e28600640 1 -- 172.21.15.122:0/1409489126 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e20068c40 con 0x7f1e200cff30 2024-05-28T06:06:32.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.919+0000 7f1e1d600640 1 -- 172.21.15.122:0/1409489126 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1e18012b90 con 0x7f1e200cff30 2024-05-28T06:06:32.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.919+0000 7f1e1d600640 1 --2- 172.21.15.122:0/1409489126 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1e000683b0 0x7f1e0006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:32.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.919+0000 7f1e1d600640 1 -- 172.21.15.122:0/1409489126 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f1e18087420 con 0x7f1e200cff30 2024-05-28T06:06:32.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.919+0000 7f1e25c00640 1 --2- 172.21.15.122:0/1409489126 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1e000683b0 0x7f1e0006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:32.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.919+0000 7f1e25c00640 1 --2- 172.21.15.122:0/1409489126 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1e000683b0 0x7f1e0006a870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1e140ae000 tx=0x7f1e140a6070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:32.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:32.919+0000 7f1e1d600640 1 -- 172.21.15.122:0/1409489126 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1e200cdf00 con 0x7f1e200cff30 2024-05-28T06:06:33.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.075+0000 7f1e28600640 1 -- 172.21.15.122:0/1409489126 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e200ccdf0 con 0x7f1e200cff30 2024-05-28T06:06:33.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.079+0000 7f1e1d600640 1 -- 172.21.15.122:0/1409489126 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16855 (secure 0 0 0) 0x7f1e18057330 con 0x7f1e200cff30 2024-05-28T06:06:33.084 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:33.084 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":22,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:06:30.430478+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:05:47.441193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-28T06:05:48.148164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:06:33.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.079+0000 7f1e28600640 1 -- 172.21.15.122:0/1409489126 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1e000683b0 msgr2=0x7f1e0006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:33.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.079+0000 7f1e28600640 1 --2- 172.21.15.122:0/1409489126 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1e000683b0 0x7f1e0006a870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1e140ae000 tx=0x7f1e140a6070 comp rx=0 tx=0).stop 2024-05-28T06:06:33.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.079+0000 7f1e28600640 1 -- 172.21.15.122:0/1409489126 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e200cff30 msgr2=0x7f1e200ae2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:33.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.079+0000 7f1e28600640 1 --2- 172.21.15.122:0/1409489126 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e200cff30 0x7f1e200ae2f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1e18001c70 tx=0x7f1e1800cf90 comp rx=0 tx=0).stop 2024-05-28T06:06:33.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.079+0000 7f1e28600640 1 -- 172.21.15.122:0/1409489126 shutdown_connections 2024-05-28T06:06:33.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.079+0000 7f1e28600640 1 --2- 172.21.15.122:0/1409489126 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1e000683b0 0x7f1e0006a870 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:33.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.079+0000 7f1e28600640 1 --2- 172.21.15.122:0/1409489126 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e200cff30 0x7f1e200ae2f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:33.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.079+0000 7f1e28600640 1 --2- 172.21.15.122:0/1409489126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1e200cdb00 0x7f1e20156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:33.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.079+0000 7f1e28600640 1 --2- 172.21.15.122:0/1409489126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e2006f6c0 0x7f1e20158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:33.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.079+0000 7f1e28600640 1 -- 172.21.15.122:0/1409489126 >> 172.21.15.122:0/1409489126 conn(0x7f1e2006bd90 msgr2=0x7f1e20072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:33.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.079+0000 7f1e28600640 1 -- 172.21.15.122:0/1409489126 shutdown_connections 2024-05-28T06:06:33.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.079+0000 7f1e28600640 1 -- 172.21.15.122:0/1409489126 wait complete. 2024-05-28T06:06:33.106 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-28T06:06:33.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.243+0000 7f5a79a00640 1 Processor -- start 2024-05-28T06:06:33.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.243+0000 7f5a79a00640 1 -- start start 2024-05-28T06:06:33.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.243+0000 7f5a79a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a7415eae0 0x7f5a740b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:33.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.243+0000 7f5a79a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5a740d2140 0x7f5a740ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:33.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.243+0000 7f5a79a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a7415eec0 con 0x7f5a740b54c0 2024-05-28T06:06:33.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.243+0000 7f5a79a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5a740b4650 con 0x7f5a740d2140 2024-05-28T06:06:33.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.243+0000 7f5a79a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5a740b4930 con 0x7f5a7415eae0 2024-05-28T06:06:33.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.243+0000 7f5a73400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5a740d2140 0x7f5a740ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:33.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.243+0000 7f5a6be00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5a740b54c0 0x7f5a740d1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:54178/0 (socket says 172.21.15.122:54178) 2024-05-28T06:06:33.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.243+0000 7f5a72a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a7415eae0 0x7f5a740b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:33.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.243+0000 7f5a6be00640 1 -- 172.21.15.122:0/1689431118 learned_addr learned my addr 172.21.15.122:0/1689431118 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:33.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.243+0000 7f5a72a00640 1 -- 172.21.15.122:0/1689431118 >> v2:172.21.15.153:3300/0 conn(0x7f5a740d2140 msgr2=0x7f5a740ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:33.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.243+0000 7f5a72a00640 1 --2- 172.21.15.122:0/1689431118 >> v2:172.21.15.153:3300/0 conn(0x7f5a740d2140 0x7f5a740ca8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:33.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.243+0000 7f5a72a00640 1 -- 172.21.15.122:0/1689431118 >> v1:172.21.15.153:6789/0 conn(0x7f5a740b54c0 legacy=0x7f5a740d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:33.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.243+0000 7f5a72a00640 1 -- 172.21.15.122:0/1689431118 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a740b4c10 con 0x7f5a7415eae0 2024-05-28T06:06:33.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.243+0000 7f5a72000640 1 -- 172.21.15.122:0/1689431118 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 736073155 0 0) 0x7f5a7415eec0 con 0x7f5a740b54c0 2024-05-28T06:06:33.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.247+0000 7f5a72a00640 1 --2- 172.21.15.122:0/1689431118 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a7415eae0 0x7f5a740b4f80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5a640097c0 tx=0x7f5a6401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47b2694f05772dfa server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:33.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.247+0000 7f5a72000640 1 -- 172.21.15.122:0/1689431118 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a640b0070 con 0x7f5a7415eae0 2024-05-28T06:06:33.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.247+0000 7f5a72000640 1 -- 172.21.15.122:0/1689431118 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a640ab600 con 0x7f5a7415eae0 2024-05-28T06:06:33.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.247+0000 7f5a72000640 1 -- 172.21.15.122:0/1689431118 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a640ab9d0 con 0x7f5a7415eae0 2024-05-28T06:06:33.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.247+0000 7f5a79a00640 1 -- 172.21.15.122:0/1689431118 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a7415eae0 msgr2=0x7f5a740b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:33.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.247+0000 7f5a79a00640 1 --2- 172.21.15.122:0/1689431118 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a7415eae0 0x7f5a740b4f80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5a640097c0 tx=0x7f5a6401c470 comp rx=0 tx=0).stop 2024-05-28T06:06:33.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.247+0000 7f5a79a00640 1 -- 172.21.15.122:0/1689431118 shutdown_connections 2024-05-28T06:06:33.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.247+0000 7f5a79a00640 1 --2- 172.21.15.122:0/1689431118 >> v2:172.21.15.153:3300/0 conn(0x7f5a740d2140 0x7f5a740ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:33.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.247+0000 7f5a79a00640 1 --2- 172.21.15.122:0/1689431118 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a7415eae0 0x7f5a740b4f80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:33.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.247+0000 7f5a79a00640 1 -- 172.21.15.122:0/1689431118 >> 172.21.15.122:0/1689431118 conn(0x7f5a740b6c10 msgr2=0x7f5a740b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:33.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.247+0000 7f5a79a00640 1 -- 172.21.15.122:0/1689431118 shutdown_connections 2024-05-28T06:06:33.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.247+0000 7f5a79a00640 1 -- 172.21.15.122:0/1689431118 wait complete. 2024-05-28T06:06:33.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a79a00640 1 Processor -- start 2024-05-28T06:06:33.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a79a00640 1 -- start start 2024-05-28T06:06:33.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a79a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a740b54c0 0x7f5a7413ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:33.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a79a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a740d2140 0x7f5a74153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:33.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a79a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a7415eae0 0x7f5a7415d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:33.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a79a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5a740b3fa0 con 0x7f5a740b54c0 2024-05-28T06:06:33.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a79a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5a740b3e20 con 0x7f5a7415eae0 2024-05-28T06:06:33.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a79a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5a7416b610 con 0x7f5a740d2140 2024-05-28T06:06:33.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a72a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a740b54c0 0x7f5a7413ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:33.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a72a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a740b54c0 0x7f5a7413ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37922/0 (socket says 172.21.15.122:37922) 2024-05-28T06:06:33.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a72a00640 1 -- 172.21.15.122:0/2095706182 learned_addr learned my addr 172.21.15.122:0/2095706182 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:33.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a6be00640 1 --2- 172.21.15.122:0/2095706182 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a740d2140 0x7f5a74153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:33.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a73400640 1 --2- 172.21.15.122:0/2095706182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a7415eae0 0x7f5a7415d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:33.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a72a00640 1 -- 172.21.15.122:0/2095706182 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a740d2140 msgr2=0x7f5a74153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:33.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a72a00640 1 --2- 172.21.15.122:0/2095706182 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a740d2140 0x7f5a74153630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:33.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a72a00640 1 -- 172.21.15.122:0/2095706182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a7415eae0 msgr2=0x7f5a7415d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:33.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a72a00640 1 --2- 172.21.15.122:0/2095706182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a7415eae0 0x7f5a7415d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:33.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a72a00640 1 -- 172.21.15.122:0/2095706182 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a74160d60 con 0x7f5a740b54c0 2024-05-28T06:06:33.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a73400640 1 --2- 172.21.15.122:0/2095706182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a7415eae0 0x7f5a7415d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:33.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a72a00640 1 --2- 172.21.15.122:0/2095706182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a740b54c0 0x7f5a7413ca70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5a6401a0a0 tx=0x7f5a6401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:33.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a6aa00640 1 -- 172.21.15.122:0/2095706182 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a640b0050 con 0x7f5a740b54c0 2024-05-28T06:06:33.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a6aa00640 1 -- 172.21.15.122:0/2095706182 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a640bc070 con 0x7f5a740b54c0 2024-05-28T06:06:33.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a79a00640 1 -- 172.21.15.122:0/2095706182 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a74161040 con 0x7f5a740b54c0 2024-05-28T06:06:33.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a6aa00640 1 -- 172.21.15.122:0/2095706182 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a640b5830 con 0x7f5a740b54c0 2024-05-28T06:06:33.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a79a00640 1 -- 172.21.15.122:0/2095706182 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a74161600 con 0x7f5a740b54c0 2024-05-28T06:06:33.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.251+0000 7f5a79a00640 1 -- 172.21.15.122:0/2095706182 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a74068bd0 con 0x7f5a740b54c0 2024-05-28T06:06:33.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.255+0000 7f5a6aa00640 1 -- 172.21.15.122:0/2095706182 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5a640b59d0 con 0x7f5a740b54c0 2024-05-28T06:06:33.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.255+0000 7f5a6aa00640 1 --2- 172.21.15.122:0/2095706182 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5a50068380 0x7f5a5006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:33.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.255+0000 7f5a6aa00640 1 -- 172.21.15.122:0/2095706182 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f5a64121240 con 0x7f5a740b54c0 2024-05-28T06:06:33.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.255+0000 7f5a6be00640 1 --2- 172.21.15.122:0/2095706182 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5a50068380 0x7f5a5006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:33.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.255+0000 7f5a6be00640 1 --2- 172.21.15.122:0/2095706182 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5a50068380 0x7f5a5006a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5a7406d710 tx=0x7f5a5c007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:33.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.259+0000 7f5a6aa00640 1 -- 172.21.15.122:0/2095706182 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5a64016090 con 0x7f5a740b54c0 2024-05-28T06:06:33.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.451+0000 7f5a79a00640 1 -- 172.21.15.122:0/2095706182 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5a7406d460 con 0x7f5a740b54c0 2024-05-28T06:06:33.454 INFO:tasks.ceph.mon.a.smithi122.stderr:2024-05-28T06:06:33.451+0000 7f3c04000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-28T06:06:33.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.459+0000 7f5a6aa00640 1 -- 172.21.15.122:0/2095706182 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f5a640f18a0 con 0x7f5a740b54c0 2024-05-28T06:06:33.460 INFO:teuthology.orchestra.run.smithi122.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-28T06:06:33.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.459+0000 7f5a79a00640 1 -- 172.21.15.122:0/2095706182 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5a50068380 msgr2=0x7f5a5006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:33.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.459+0000 7f5a79a00640 1 --2- 172.21.15.122:0/2095706182 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5a50068380 0x7f5a5006a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5a7406d710 tx=0x7f5a5c007d60 comp rx=0 tx=0).stop 2024-05-28T06:06:33.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.459+0000 7f5a79a00640 1 -- 172.21.15.122:0/2095706182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a740b54c0 msgr2=0x7f5a7413ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:33.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.459+0000 7f5a79a00640 1 --2- 172.21.15.122:0/2095706182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a740b54c0 0x7f5a7413ca70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5a6401a0a0 tx=0x7f5a6401acb0 comp rx=0 tx=0).stop 2024-05-28T06:06:33.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.459+0000 7f5a79a00640 1 -- 172.21.15.122:0/2095706182 shutdown_connections 2024-05-28T06:06:33.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.459+0000 7f5a79a00640 1 --2- 172.21.15.122:0/2095706182 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5a50068380 0x7f5a5006a840 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:33.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.459+0000 7f5a79a00640 1 --2- 172.21.15.122:0/2095706182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a7415eae0 0x7f5a7415d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:33.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.459+0000 7f5a79a00640 1 --2- 172.21.15.122:0/2095706182 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a740d2140 0x7f5a74153630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:33.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.459+0000 7f5a79a00640 1 --2- 172.21.15.122:0/2095706182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a740b54c0 0x7f5a7413ca70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:33.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.459+0000 7f5a79a00640 1 -- 172.21.15.122:0/2095706182 >> 172.21.15.122:0/2095706182 conn(0x7f5a740b6c10 msgr2=0x7f5a74074d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:33.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.459+0000 7f5a79a00640 1 -- 172.21.15.122:0/2095706182 shutdown_connections 2024-05-28T06:06:33.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.459+0000 7f5a79a00640 1 -- 172.21.15.122:0/2095706182 wait complete. 2024-05-28T06:06:33.478 INFO:tasks.ceph.mds.a.smithi122.stderr: -7655> 2024-05-28T06:05:53.781+0000 7f11e3c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-28T06:06:33.482 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-28T06:06:33.527 INFO:tasks.ceph.mds.a.smithi122.stdout:starting mds.a at 2024-05-28T06:06:33.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.619+0000 7f38d3200640 1 Processor -- start 2024-05-28T06:06:33.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.619+0000 7f38d3200640 1 -- start start 2024-05-28T06:06:33.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d3200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38d40cf650 0x7f38d40b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:33.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d3200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38d406df80 con 0x7f38d406f780 2024-05-28T06:06:33.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d3200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38d406e260 con 0x7f38d40cfa30 2024-05-28T06:06:33.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d3200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f38d40cd7d0 con 0x7f38d40cf650 2024-05-28T06:06:33.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d2800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f38d406f780 0x7f38d40b40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47316/0 (socket says 172.21.15.122:47316) 2024-05-28T06:06:33.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d2800640 1 -- 172.21.15.122:0/2400882607 learned_addr learned my addr 172.21.15.122:0/2400882607 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:33.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d0a00640 1 -- 172.21.15.122:0/2400882607 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4194201229 0 0) 0x7f38d406df80 con 0x7f38d406f780 2024-05-28T06:06:33.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d0a00640 1 -- 172.21.15.122:0/2400882607 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38b8003530 con 0x7f38d406f780 2024-05-28T06:06:33.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d1e00640 1 --2- 172.21.15.122:0/2400882607 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38d40cf650 0x7f38d40b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:33.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d0a00640 1 -- 172.21.15.122:0/2400882607 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 868756648 0 0) 0x7f38b8003530 con 0x7f38d406f780 2024-05-28T06:06:33.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d0a00640 1 -- 172.21.15.122:0/2400882607 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38d40cf650 msgr2=0x7f38d40b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:33.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d0a00640 1 --2- 172.21.15.122:0/2400882607 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38d40cf650 0x7f38d40b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:33.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d0a00640 1 -- 172.21.15.122:0/2400882607 >> v1:172.21.15.153:6789/0 conn(0x7f38d40cfa30 legacy=0x7f38d40b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:33.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d0a00640 1 -- 172.21.15.122:0/2400882607 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d40cdab0 con 0x7f38d406f780 2024-05-28T06:06:33.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d0a00640 1 -- 172.21.15.122:0/2400882607 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f38cc001680 con 0x7f38d406f780 2024-05-28T06:06:33.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d1e00640 1 --2- 172.21.15.122:0/2400882607 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38d40cf650 0x7f38d40b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:33.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d0a00640 1 -- 172.21.15.122:0/2400882607 >> v1:172.21.15.122:6789/0 conn(0x7f38d406f780 legacy=0x7f38d40b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:33.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d0a00640 1 --2- 172.21.15.122:0/2400882607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38b80039f0 0x7f38b8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:33.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d0a00640 1 --2- 172.21.15.122:0/2400882607 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38d40cf650 0x7f38b8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:33.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d0a00640 1 --2- 172.21.15.122:0/2400882607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38b8004d50 0x7f38b80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:33.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d0a00640 1 -- 172.21.15.122:0/2400882607 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f38d40cd7d0 con 0x7f38b8004d50 2024-05-28T06:06:33.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d0a00640 1 -- 172.21.15.122:0/2400882607 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38b800bc00 con 0x7f38b80039f0 2024-05-28T06:06:33.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d0a00640 1 -- 172.21.15.122:0/2400882607 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f38b800be00 con 0x7f38d40cf650 2024-05-28T06:06:33.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d2800640 1 --2- 172.21.15.122:0/2400882607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38b8004d50 0x7f38b80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:33.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d1e00640 1 --2- 172.21.15.122:0/2400882607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38b80039f0 0x7f38b8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:33.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d1400640 1 --2- 172.21.15.122:0/2400882607 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38d40cf650 0x7f38b8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:33.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d1e00640 1 -- 172.21.15.122:0/2400882607 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38d40cf650 msgr2=0x7f38b8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:33.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d1e00640 1 --2- 172.21.15.122:0/2400882607 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38d40cf650 0x7f38b8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:33.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d1e00640 1 -- 172.21.15.122:0/2400882607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38b8004d50 msgr2=0x7f38b80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:33.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d1e00640 1 --2- 172.21.15.122:0/2400882607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38b8004d50 0x7f38b80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:33.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d1e00640 1 -- 172.21.15.122:0/2400882607 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b8003530 con 0x7f38b80039f0 2024-05-28T06:06:33.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.623+0000 7f38d2800640 1 --2- 172.21.15.122:0/2400882607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38b8004d50 0x7f38b80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:06:33.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.627+0000 7f38d1e00640 1 --2- 172.21.15.122:0/2400882607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38b80039f0 0x7f38b8003e10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f38c40073e0 tx=0x7f38c401cec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a9c097a29f4da45 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:33.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.627+0000 7f38d0a00640 1 -- 172.21.15.122:0/2400882607 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c40b2070 con 0x7f38b80039f0 2024-05-28T06:06:33.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.627+0000 7f38d0a00640 1 -- 172.21.15.122:0/2400882607 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38c40a5a90 con 0x7f38b80039f0 2024-05-28T06:06:33.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.627+0000 7f38d0a00640 1 -- 172.21.15.122:0/2400882607 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c4009c80 con 0x7f38b80039f0 2024-05-28T06:06:33.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.627+0000 7f38d3200640 1 -- 172.21.15.122:0/2400882607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38b80039f0 msgr2=0x7f38b8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:33.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.627+0000 7f38d3200640 1 --2- 172.21.15.122:0/2400882607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38b80039f0 0x7f38b8003e10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f38c40073e0 tx=0x7f38c401cec0 comp rx=0 tx=0).stop 2024-05-28T06:06:33.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.627+0000 7f38d2800640 1 -- 172.21.15.122:0/2400882607 reap_dead start 2024-05-28T06:06:33.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.627+0000 7f38d3200640 1 -- 172.21.15.122:0/2400882607 shutdown_connections 2024-05-28T06:06:33.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.627+0000 7f38d3200640 1 -- 172.21.15.122:0/2400882607 >> 172.21.15.122:0/2400882607 conn(0x7f38d406b990 msgr2=0x7f38d406bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:33.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.627+0000 7f38d3200640 1 -- 172.21.15.122:0/2400882607 shutdown_connections 2024-05-28T06:06:33.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.627+0000 7f38d3200640 1 -- 172.21.15.122:0/2400882607 wait complete. 2024-05-28T06:06:33.631 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38d3200640 1 Processor -- start 2024-05-28T06:06:33.631 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38d3200640 1 -- start start 2024-05-28T06:06:33.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38d3200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38b80039f0 0x7f38d414e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:33.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38d3200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38d40aef50 0x7f38d414ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:33.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38d3200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38d40b39b0 0x7f38d40b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:33.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38d3200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f38d41676e0 con 0x7f38d40aef50 2024-05-28T06:06:33.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38d3200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38d4167560 con 0x7f38b80039f0 2024-05-28T06:06:33.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38d3200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f38d4167860 con 0x7f38d40b39b0 2024-05-28T06:06:33.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38d1400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38d40aef50 0x7f38d414ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:33.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38d1400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38d40aef50 0x7f38d414ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37936/0 (socket says 172.21.15.122:37936) 2024-05-28T06:06:33.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38d1400640 1 -- 172.21.15.122:0/2654744691 learned_addr learned my addr 172.21.15.122:0/2654744691 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:33.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38d1e00640 1 --2- 172.21.15.122:0/2654744691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38b80039f0 0x7f38d414e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:33.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38d2800640 1 --2- 172.21.15.122:0/2654744691 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38d40b39b0 0x7f38d40b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:33.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38d1400640 1 -- 172.21.15.122:0/2654744691 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38d40b39b0 msgr2=0x7f38d40b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:33.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38d1400640 1 --2- 172.21.15.122:0/2654744691 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38d40b39b0 0x7f38d40b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:33.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38d1400640 1 -- 172.21.15.122:0/2654744691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38b80039f0 msgr2=0x7f38d414e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:33.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38d1400640 1 --2- 172.21.15.122:0/2654744691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38b80039f0 0x7f38d414e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:33.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38d1400640 1 -- 172.21.15.122:0/2654744691 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d414f010 con 0x7f38d40aef50 2024-05-28T06:06:33.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38d1400640 1 --2- 172.21.15.122:0/2654744691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38d40aef50 0x7f38d414ab10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f38c000f850 tx=0x7f38c000fc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:33.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38ca000640 1 -- 172.21.15.122:0/2654744691 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c00050d0 con 0x7f38d40aef50 2024-05-28T06:06:33.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38ca000640 1 -- 172.21.15.122:0/2654744691 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38c0018070 con 0x7f38d40aef50 2024-05-28T06:06:33.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38ca000640 1 -- 172.21.15.122:0/2654744691 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c000d730 con 0x7f38d40aef50 2024-05-28T06:06:33.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38d3200640 1 -- 172.21.15.122:0/2654744691 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38d415e1c0 con 0x7f38d40aef50 2024-05-28T06:06:33.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38d3200640 1 -- 172.21.15.122:0/2654744691 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38d415e780 con 0x7f38d40aef50 2024-05-28T06:06:33.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.631+0000 7f38d3200640 1 -- 172.21.15.122:0/2654744691 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38d4075620 con 0x7f38d40aef50 2024-05-28T06:06:33.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.635+0000 7f38ca000640 1 -- 172.21.15.122:0/2654744691 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f38c000d8d0 con 0x7f38d40aef50 2024-05-28T06:06:33.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.635+0000 7f38ca000640 1 --2- 172.21.15.122:0/2654744691 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f38b4068380 0x7f38b406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:33.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.635+0000 7f38ca000640 1 -- 172.21.15.122:0/2654744691 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5911+0+0 (secure 0 0 0) 0x7f38c0086760 con 0x7f38d40aef50 2024-05-28T06:06:33.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.635+0000 7f38d1e00640 1 --2- 172.21.15.122:0/2654744691 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f38b4068380 0x7f38b406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:33.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.635+0000 7f38d1e00640 1 --2- 172.21.15.122:0/2654744691 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f38b4068380 0x7f38b406a840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f38c40af000 tx=0x7f38c4004a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:33.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.639+0000 7f38ca000640 1 -- 172.21.15.122:0/2654744691 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f38c0056c40 con 0x7f38d40aef50 2024-05-28T06:06:33.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:33.835+0000 7f38d3200640 1 -- 172.21.15.122:0/2654744691 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f38d4167340 con 0x7f38d40aef50 2024-05-28T06:06:34.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.463+0000 7f38ca000640 1 -- 172.21.15.122:0/2654744691 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f38c0056540 con 0x7f38d40aef50 2024-05-28T06:06:34.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.463+0000 7f38d3200640 1 -- 172.21.15.122:0/2654744691 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f38b4068380 msgr2=0x7f38b406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:34.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.463+0000 7f38d3200640 1 --2- 172.21.15.122:0/2654744691 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f38b4068380 0x7f38b406a840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f38c40af000 tx=0x7f38c4004a50 comp rx=0 tx=0).stop 2024-05-28T06:06:34.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.463+0000 7f38d3200640 1 -- 172.21.15.122:0/2654744691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38d40aef50 msgr2=0x7f38d414ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:34.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.463+0000 7f38d3200640 1 --2- 172.21.15.122:0/2654744691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38d40aef50 0x7f38d414ab10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f38c000f850 tx=0x7f38c000fc50 comp rx=0 tx=0).stop 2024-05-28T06:06:34.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.463+0000 7f38d3200640 1 -- 172.21.15.122:0/2654744691 shutdown_connections 2024-05-28T06:06:34.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.463+0000 7f38d3200640 1 --2- 172.21.15.122:0/2654744691 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f38b4068380 0x7f38b406a840 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:34.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.463+0000 7f38d3200640 1 --2- 172.21.15.122:0/2654744691 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38d40b39b0 0x7f38d40b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:34.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.463+0000 7f38d3200640 1 --2- 172.21.15.122:0/2654744691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38d40aef50 0x7f38d414ab10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:34.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.463+0000 7f38d3200640 1 --2- 172.21.15.122:0/2654744691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38b80039f0 0x7f38d414e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:34.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.463+0000 7f38d3200640 1 -- 172.21.15.122:0/2654744691 >> 172.21.15.122:0/2654744691 conn(0x7f38d406b990 msgr2=0x7f38d415af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:34.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.463+0000 7f38d3200640 1 -- 172.21.15.122:0/2654744691 shutdown_connections 2024-05-28T06:06:34.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.463+0000 7f38d3200640 1 -- 172.21.15.122:0/2654744691 wait complete. 2024-05-28T06:06:34.490 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-28T06:06:34.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.671+0000 7f2b1a800640 1 Processor -- start 2024-05-28T06:06:34.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.675+0000 7f2b1a800640 1 -- start start 2024-05-28T06:06:34.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.675+0000 7f2b1a800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2b14147410 0x7f2b140afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:34.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.675+0000 7f2b1a800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b140adf20 con 0x7f2b140adac0 2024-05-28T06:06:34.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.675+0000 7f2b1a800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b1406e7f0 con 0x7f2b140729b0 2024-05-28T06:06:34.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.675+0000 7f2b1a800640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f2b140b5310 con 0x7f2b14147410 2024-05-28T06:06:34.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.675+0000 7f2b12a00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f2b140adac0 0x7f2b140722a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47330/0 (socket says 172.21.15.122:47330) 2024-05-28T06:06:34.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.675+0000 7f2b12a00640 1 -- 172.21.15.122:0/2272909600 learned_addr learned my addr 172.21.15.122:0/2272909600 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:34.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.675+0000 7f2b13400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2b14147410 0x7f2b140afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:34.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.675+0000 7f2b13400640 1 -- 172.21.15.122:0/2272909600 >> v1:172.21.15.153:6789/0 conn(0x7f2b140729b0 legacy=0x7f2b140b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:34.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.675+0000 7f2b13400640 1 -- 172.21.15.122:0/2272909600 >> v1:172.21.15.122:6789/0 conn(0x7f2b140adac0 legacy=0x7f2b140722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:34.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.675+0000 7f2b13400640 1 -- 172.21.15.122:0/2272909600 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b1406ead0 con 0x7f2b14147410 2024-05-28T06:06:34.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.675+0000 7f2b12000640 1 -- 172.21.15.122:0/2272909600 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1370515359 0 0) 0x7f2b04001120 con 0x7f2b140adac0 2024-05-28T06:06:34.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.679+0000 7f2b13400640 1 --2- 172.21.15.122:0/2272909600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b14147410 0x7f2b140afd30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0097c0 tx=0x7f2afc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da9cd3d771e398b server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:34.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.679+0000 7f2b12000640 1 -- 172.21.15.122:0/2272909600 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc0b0070 con 0x7f2b14147410 2024-05-28T06:06:34.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.679+0000 7f2b12000640 1 -- 172.21.15.122:0/2272909600 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2afc0ab600 con 0x7f2b14147410 2024-05-28T06:06:34.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.679+0000 7f2b12000640 1 -- 172.21.15.122:0/2272909600 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc0ab9d0 con 0x7f2b14147410 2024-05-28T06:06:34.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.679+0000 7f2b1a800640 1 -- 172.21.15.122:0/2272909600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b14147410 msgr2=0x7f2b140afd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:34.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.679+0000 7f2b1a800640 1 --2- 172.21.15.122:0/2272909600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b14147410 0x7f2b140afd30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0097c0 tx=0x7f2afc01c4a0 comp rx=0 tx=0).stop 2024-05-28T06:06:34.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.679+0000 7f2b1a800640 1 -- 172.21.15.122:0/2272909600 shutdown_connections 2024-05-28T06:06:34.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.679+0000 7f2b1a800640 1 --2- 172.21.15.122:0/2272909600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b14147410 0x7f2b140afd30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:34.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.679+0000 7f2b1a800640 1 -- 172.21.15.122:0/2272909600 >> 172.21.15.122:0/2272909600 conn(0x7f2b1406bd90 msgr2=0x7f2b1406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:34.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.679+0000 7f2b1a800640 1 -- 172.21.15.122:0/2272909600 shutdown_connections 2024-05-28T06:06:34.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.679+0000 7f2b1a800640 1 -- 172.21.15.122:0/2272909600 wait complete. 2024-05-28T06:06:34.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.679+0000 7f2b1a800640 1 Processor -- start 2024-05-28T06:06:34.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.679+0000 7f2b1a800640 1 -- start start 2024-05-28T06:06:34.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b1a800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b140729b0 0x7f2b1415c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:34.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b1a800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b140adac0 0x7f2b14140150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:34.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b1a800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b14147410 0x7f2b1413f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:34.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b1a800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2b14147970 con 0x7f2b140729b0 2024-05-28T06:06:34.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b1a800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2b141477f0 con 0x7f2b140adac0 2024-05-28T06:06:34.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b1a800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2b140b6580 con 0x7f2b14147410 2024-05-28T06:06:34.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b13400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b140729b0 0x7f2b1415c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:34.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b13400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b140729b0 0x7f2b1415c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37946/0 (socket says 172.21.15.122:37946) 2024-05-28T06:06:34.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b13400640 1 -- 172.21.15.122:0/351320924 learned_addr learned my addr 172.21.15.122:0/351320924 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:34.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b12a00640 1 --2- 172.21.15.122:0/351320924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b140adac0 0x7f2b14140150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:34.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b13e00640 1 --2- 172.21.15.122:0/351320924 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b14147410 0x7f2b1413f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:34.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b13400640 1 -- 172.21.15.122:0/351320924 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b14147410 msgr2=0x7f2b1413f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:34.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b13400640 1 --2- 172.21.15.122:0/351320924 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b14147410 0x7f2b1413f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:34.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b13400640 1 -- 172.21.15.122:0/351320924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b140adac0 msgr2=0x7f2b14140150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:34.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b13400640 1 --2- 172.21.15.122:0/351320924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b140adac0 0x7f2b14140150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:34.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b13400640 1 -- 172.21.15.122:0/351320924 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b1413e480 con 0x7f2b140729b0 2024-05-28T06:06:34.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b12a00640 1 --2- 172.21.15.122:0/351320924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b140adac0 0x7f2b14140150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:34.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b13400640 1 --2- 172.21.15.122:0/351320924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b140729b0 0x7f2b1415c030 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0097c0 tx=0x7f2afc01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:34.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b0b400640 1 -- 172.21.15.122:0/351320924 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc0bb070 con 0x7f2b140729b0 2024-05-28T06:06:34.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b0b400640 1 -- 172.21.15.122:0/351320924 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2afc004020 con 0x7f2b140729b0 2024-05-28T06:06:34.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b1a800640 1 -- 172.21.15.122:0/351320924 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b1413e760 con 0x7f2b140729b0 2024-05-28T06:06:34.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b0b400640 1 -- 172.21.15.122:0/351320924 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc0b0040 con 0x7f2b140729b0 2024-05-28T06:06:34.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b1a800640 1 -- 172.21.15.122:0/351320924 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b1413ed20 con 0x7f2b140729b0 2024-05-28T06:06:34.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b1a800640 1 -- 172.21.15.122:0/351320924 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b14068c40 con 0x7f2b140729b0 2024-05-28T06:06:34.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.683+0000 7f2b0b400640 1 -- 172.21.15.122:0/351320924 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2afc003620 con 0x7f2b140729b0 2024-05-28T06:06:34.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.687+0000 7f2b0b400640 1 --2- 172.21.15.122:0/351320924 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2af0068380 0x7f2af006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:34.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.687+0000 7f2b0b400640 1 -- 172.21.15.122:0/351320924 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5911+0+0 (secure 0 0 0) 0x7f2afc121290 con 0x7f2b140729b0 2024-05-28T06:06:34.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.687+0000 7f2b12a00640 1 --2- 172.21.15.122:0/351320924 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2af0068380 0x7f2af006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:34.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.687+0000 7f2b12a00640 1 --2- 172.21.15.122:0/351320924 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2af0068380 0x7f2af006a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2b14146280 tx=0x7f2b04007dd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:34.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.691+0000 7f2b0b400640 1 -- 172.21.15.122:0/351320924 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2afc016090 con 0x7f2b140729b0 2024-05-28T06:06:34.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:34.847+0000 7f2b1a800640 1 -- 172.21.15.122:0/351320924 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2b1406fbb0 con 0x7f2b140729b0 2024-05-28T06:06:35.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.471+0000 7f2b0b400640 1 -- 172.21.15.122:0/351320924 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) ==== 181+0+0 (secure 0 0 0) 0x7f2afc0f1770 con 0x7f2b140729b0 2024-05-28T06:06:35.472 INFO:teuthology.orchestra.run.smithi122.stderr:pool 'cephfs_metadata' removed 2024-05-28T06:06:35.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.471+0000 7f2b1a800640 1 -- 172.21.15.122:0/351320924 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2af0068380 msgr2=0x7f2af006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:35.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.471+0000 7f2b1a800640 1 --2- 172.21.15.122:0/351320924 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2af0068380 0x7f2af006a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2b14146280 tx=0x7f2b04007dd0 comp rx=0 tx=0).stop 2024-05-28T06:06:35.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.471+0000 7f2b1a800640 1 -- 172.21.15.122:0/351320924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b140729b0 msgr2=0x7f2b1415c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:35.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.471+0000 7f2b1a800640 1 --2- 172.21.15.122:0/351320924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b140729b0 0x7f2b1415c030 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0097c0 tx=0x7f2afc01ace0 comp rx=0 tx=0).stop 2024-05-28T06:06:35.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.471+0000 7f2b1a800640 1 -- 172.21.15.122:0/351320924 shutdown_connections 2024-05-28T06:06:35.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.471+0000 7f2b1a800640 1 --2- 172.21.15.122:0/351320924 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2af0068380 0x7f2af006a840 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:35.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.471+0000 7f2b1a800640 1 --2- 172.21.15.122:0/351320924 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b14147410 0x7f2b1413f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:35.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.471+0000 7f2b1a800640 1 --2- 172.21.15.122:0/351320924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b140adac0 0x7f2b14140150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:35.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.471+0000 7f2b1a800640 1 --2- 172.21.15.122:0/351320924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b140729b0 0x7f2b1415c030 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:35.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.471+0000 7f2b1a800640 1 -- 172.21.15.122:0/351320924 >> 172.21.15.122:0/351320924 conn(0x7f2b1406bd90 msgr2=0x7f2b140b5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:35.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.471+0000 7f2b1a800640 1 -- 172.21.15.122:0/351320924 shutdown_connections 2024-05-28T06:06:35.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.471+0000 7f2b1a800640 1 -- 172.21.15.122:0/351320924 wait complete. 2024-05-28T06:06:35.499 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-28T06:06:35.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.639+0000 7f17b8600640 1 Processor -- start 2024-05-28T06:06:35.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.639+0000 7f17b8600640 1 -- start start 2024-05-28T06:06:35.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.639+0000 7f17b8600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f17b006f890 0x7f17b00cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:35.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.639+0000 7f17b8600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f17b00cd930 0x7f17b00b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:35.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.639+0000 7f17b8600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17b00d0310 con 0x7f17b00cff30 2024-05-28T06:06:35.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.639+0000 7f17b8600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f17b015be20 con 0x7f17b006f890 2024-05-28T06:06:35.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.639+0000 7f17b8600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f17b015c100 con 0x7f17b00cd930 2024-05-28T06:06:35.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.639+0000 7f17b5200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f17b006f890 0x7f17b00cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:35.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.639+0000 7f17b5200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f17b006f890 0x7f17b00cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57450/0 (socket says 172.21.15.122:57450) 2024-05-28T06:06:35.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.639+0000 7f17b5200640 1 -- 172.21.15.122:0/2713466660 learned_addr learned my addr 172.21.15.122:0/2713466660 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:35.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.643+0000 7f17b6600640 1 --2- 172.21.15.122:0/2713466660 >> v2:172.21.15.153:3300/0 conn(0x7f17b00cd930 0x7f17b00b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:35.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.643+0000 7f17b5200640 1 -- 172.21.15.122:0/2713466660 >> v2:172.21.15.153:3300/0 conn(0x7f17b00cd930 msgr2=0x7f17b00b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:35.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.643+0000 7f17b5200640 1 --2- 172.21.15.122:0/2713466660 >> v2:172.21.15.153:3300/0 conn(0x7f17b00cd930 0x7f17b00b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:35.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.643+0000 7f17b5200640 1 -- 172.21.15.122:0/2713466660 >> v1:172.21.15.153:6789/0 conn(0x7f17b00cff30 legacy=0x7f17b006f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:35.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.643+0000 7f17b5200640 1 -- 172.21.15.122:0/2713466660 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b015c3e0 con 0x7f17b006f890 2024-05-28T06:06:35.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.643+0000 7f17b5200640 1 --2- 172.21.15.122:0/2713466660 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17b006f890 0x7f17b00cd3f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f17b015f040 tx=0x7f179c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56871c7fa6a51c5b server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:35.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.643+0000 7f17afe00640 1 -- 172.21.15.122:0/2713466660 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c0aa5f0 con 0x7f17b006f890 2024-05-28T06:06:35.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.643+0000 7f17afe00640 1 -- 172.21.15.122:0/2713466660 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f179c0af070 con 0x7f17b006f890 2024-05-28T06:06:35.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.643+0000 7f17afe00640 1 -- 172.21.15.122:0/2713466660 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c0aa9b0 con 0x7f17b006f890 2024-05-28T06:06:35.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.647+0000 7f17b8600640 1 -- 172.21.15.122:0/2713466660 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17b006f890 msgr2=0x7f17b00cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:35.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.647+0000 7f17b8600640 1 --2- 172.21.15.122:0/2713466660 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17b006f890 0x7f17b00cd3f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f17b015f040 tx=0x7f179c01c4f0 comp rx=0 tx=0).stop 2024-05-28T06:06:35.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.647+0000 7f17b8600640 1 -- 172.21.15.122:0/2713466660 shutdown_connections 2024-05-28T06:06:35.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.647+0000 7f17b8600640 1 --2- 172.21.15.122:0/2713466660 >> v2:172.21.15.153:3300/0 conn(0x7f17b00cd930 0x7f17b00b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:35.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.647+0000 7f17b8600640 1 --2- 172.21.15.122:0/2713466660 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17b006f890 0x7f17b00cd3f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:35.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.647+0000 7f17b8600640 1 -- 172.21.15.122:0/2713466660 >> 172.21.15.122:0/2713466660 conn(0x7f17b006bd90 msgr2=0x7f17b006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:35.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.647+0000 7f17b8600640 1 -- 172.21.15.122:0/2713466660 shutdown_connections 2024-05-28T06:06:35.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.647+0000 7f17b8600640 1 -- 172.21.15.122:0/2713466660 wait complete. 2024-05-28T06:06:35.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.647+0000 7f17b8600640 1 Processor -- start 2024-05-28T06:06:35.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.647+0000 7f17b8600640 1 -- start start 2024-05-28T06:06:35.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17b8600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17b006f890 0x7f17b00ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:35.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17b8600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17b00cd930 0x7f17b0153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:35.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17b8600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17b00cff30 0x7f17b0153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:35.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17b8600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f17b00b5880 con 0x7f17b00cd930 2024-05-28T06:06:35.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17b8600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f17b00b5700 con 0x7f17b00cff30 2024-05-28T06:06:35.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17b8600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f17b00b5a00 con 0x7f17b006f890 2024-05-28T06:06:35.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17b5200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17b00cd930 0x7f17b0153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:35.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17b5200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17b00cd930 0x7f17b0153150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57464/0 (socket says 172.21.15.122:57464) 2024-05-28T06:06:35.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17b5200640 1 -- 172.21.15.122:0/1204095905 learned_addr learned my addr 172.21.15.122:0/1204095905 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:35.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17b6600640 1 --2- 172.21.15.122:0/1204095905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17b00cff30 0x7f17b0153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:35.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17b5200640 1 -- 172.21.15.122:0/1204095905 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17b006f890 msgr2=0x7f17b00ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:35.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17b5c00640 1 --2- 172.21.15.122:0/1204095905 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17b006f890 0x7f17b00ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:35.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17b5200640 1 --2- 172.21.15.122:0/1204095905 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17b006f890 0x7f17b00ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:35.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17b5200640 1 -- 172.21.15.122:0/1204095905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17b00cff30 msgr2=0x7f17b0153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:35.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17b5200640 1 --2- 172.21.15.122:0/1204095905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17b00cff30 0x7f17b0153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:35.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17b5200640 1 -- 172.21.15.122:0/1204095905 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b00af1d0 con 0x7f17b00cd930 2024-05-28T06:06:35.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17b6600640 1 --2- 172.21.15.122:0/1204095905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17b00cff30 0x7f17b0153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:35.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17b5c00640 1 --2- 172.21.15.122:0/1204095905 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17b006f890 0x7f17b00ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:35.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17b5200640 1 --2- 172.21.15.122:0/1204095905 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17b00cd930 0x7f17b0153150 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f179c019100 tx=0x7f179c01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:35.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17ad600640 1 -- 172.21.15.122:0/1204095905 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c0bd5f0 con 0x7f17b00cd930 2024-05-28T06:06:35.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17ad600640 1 -- 172.21.15.122:0/1204095905 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f179c0bd790 con 0x7f17b00cd930 2024-05-28T06:06:35.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17b8600640 1 -- 172.21.15.122:0/1204095905 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17b00aec10 con 0x7f17b00cd930 2024-05-28T06:06:35.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17ad600640 1 -- 172.21.15.122:0/1204095905 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c0bdb40 con 0x7f17b00cd930 2024-05-28T06:06:35.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.651+0000 7f17b8600640 1 -- 172.21.15.122:0/1204095905 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17b0157160 con 0x7f17b00cd930 2024-05-28T06:06:35.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.655+0000 7f17b8600640 1 -- 172.21.15.122:0/1204095905 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17b0068c40 con 0x7f17b00cd930 2024-05-28T06:06:35.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.655+0000 7f17ad600640 1 -- 172.21.15.122:0/1204095905 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f179c0c8470 con 0x7f17b00cd930 2024-05-28T06:06:35.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.655+0000 7f17ad600640 1 --2- 172.21.15.122:0/1204095905 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1790068380 0x7f179006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:35.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.655+0000 7f17ad600640 1 -- 172.21.15.122:0/1204095905 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5473+0+0 (secure 0 0 0) 0x7f179c1217a0 con 0x7f17b00cd930 2024-05-28T06:06:35.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.655+0000 7f17b5c00640 1 --2- 172.21.15.122:0/1204095905 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1790068380 0x7f179006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:35.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.655+0000 7f17b5c00640 1 --2- 172.21.15.122:0/1204095905 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1790068380 0x7f179006a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f17a4001650 tx=0x7f17a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:35.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.659+0000 7f17ad600640 1 -- 172.21.15.122:0/1204095905 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f179c0c3060 con 0x7f17b00cd930 2024-05-28T06:06:35.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:35.815+0000 7f17b8600640 1 -- 172.21.15.122:0/1204095905 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f17b015a4a0 con 0x7f17b00cd930 2024-05-28T06:06:36.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:36.471+0000 7f17ad600640 1 -- 172.21.15.122:0/1204095905 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) ==== 169+0+0 (secure 0 0 0) 0x7f179c016110 con 0x7f17b00cd930 2024-05-28T06:06:36.475 INFO:teuthology.orchestra.run.smithi122.stderr:pool 'cephfs_data' removed 2024-05-28T06:06:36.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:36.475+0000 7f17b8600640 1 -- 172.21.15.122:0/1204095905 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1790068380 msgr2=0x7f179006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:36.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:36.475+0000 7f17b8600640 1 --2- 172.21.15.122:0/1204095905 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1790068380 0x7f179006a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f17a4001650 tx=0x7f17a4009040 comp rx=0 tx=0).stop 2024-05-28T06:06:36.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:36.475+0000 7f17b8600640 1 -- 172.21.15.122:0/1204095905 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17b00cd930 msgr2=0x7f17b0153150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:36.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:36.475+0000 7f17b8600640 1 --2- 172.21.15.122:0/1204095905 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17b00cd930 0x7f17b0153150 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f179c019100 tx=0x7f179c01ad30 comp rx=0 tx=0).stop 2024-05-28T06:06:36.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:36.475+0000 7f17b8600640 1 -- 172.21.15.122:0/1204095905 shutdown_connections 2024-05-28T06:06:36.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:36.475+0000 7f17b8600640 1 --2- 172.21.15.122:0/1204095905 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1790068380 0x7f179006a840 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:36.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:36.475+0000 7f17b8600640 1 --2- 172.21.15.122:0/1204095905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17b00cff30 0x7f17b0153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:36.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:36.475+0000 7f17b8600640 1 --2- 172.21.15.122:0/1204095905 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17b00cd930 0x7f17b0153150 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:36.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:36.475+0000 7f17b8600640 1 --2- 172.21.15.122:0/1204095905 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17b006f890 0x7f17b00ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:36.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:36.475+0000 7f17b8600640 1 -- 172.21.15.122:0/1204095905 >> 172.21.15.122:0/1204095905 conn(0x7f17b006bd90 msgr2=0x7f17b014e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:36.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:36.475+0000 7f17b8600640 1 -- 172.21.15.122:0/1204095905 shutdown_connections 2024-05-28T06:06:36.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:36.475+0000 7f17b8600640 1 -- 172.21.15.122:0/1204095905 wait complete. 2024-05-28T06:06:36.502 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-28T06:06:36.502 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-28T06:06:36.502 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-28T06:06:36.502 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:06:36.502 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-28T06:06:36.503 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-28T06:06:36.503 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-28T06:06:36.503 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:06:36.503 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-28T06:06:36.503 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-28T06:06:36.503 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-28T06:06:36.503 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:06:36.504 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-28T06:06:36.504 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-28T06:06:36.504 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-28T06:06:36.504 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:06:36.518 INFO:tasks.ceph.mds.b:Stopped 2024-05-28T06:06:36.518 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-28T06:06:36.520 INFO:tasks.ceph.mds.c:Stopped 2024-05-28T06:06:36.520 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-28T06:06:36.522 INFO:tasks.ceph.mds.d:Stopped 2024-05-28T06:06:36.522 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-28T06:06:36.566 INFO:tasks.ceph.mds.b:Started 2024-05-28T06:06:36.566 DEBUG:teuthology.parallel:result is None 2024-05-28T06:06:36.568 INFO:tasks.ceph.mds.d:Started 2024-05-28T06:06:36.568 DEBUG:teuthology.parallel:result is None 2024-05-28T06:06:36.570 INFO:tasks.ceph.mds.c:Started 2024-05-28T06:06:36.570 DEBUG:teuthology.parallel:result is None 2024-05-28T06:06:36.656 INFO:tasks.ceph.mds.b.smithi153.stdout:starting mds.b at 2024-05-28T06:06:36.656 INFO:tasks.ceph.mds.d.smithi153.stdout:starting mds.d at 2024-05-28T06:06:36.660 INFO:tasks.ceph.mds.c.smithi122.stdout:starting mds.c at 2024-05-28T06:06:42.520 INFO:tasks.ceph.mds.a:Stopped 2024-05-28T06:06:42.520 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-28T06:06:42.525 INFO:tasks.ceph.mds.a:Started 2024-05-28T06:06:42.525 DEBUG:teuthology.parallel:result is None 2024-05-28T06:06:42.526 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-28T06:06:42.619 INFO:tasks.ceph.mds.a.smithi122.stdout:starting mds.a at 2024-05-28T06:06:42.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.675+0000 7f47e9e00640 1 Processor -- start 2024-05-28T06:06:42.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.675+0000 7f47e9e00640 1 -- start start 2024-05-28T06:06:42.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.679+0000 7f47e9e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f47e40d2610 0x7f47e40d2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:42.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.679+0000 7f47e9e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47e406d470 con 0x7f47e415e9c0 2024-05-28T06:06:42.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.679+0000 7f47e9e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47e406d750 con 0x7f47e40cf740 2024-05-28T06:06:42.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.679+0000 7f47e9e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f47e406da30 con 0x7f47e40d2610 2024-05-28T06:06:42.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.679+0000 7f47e2a00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f47e415e9c0 0x7f47e40b60e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:48958/0 (socket says 172.21.15.122:48958) 2024-05-28T06:06:42.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.679+0000 7f47e2a00640 1 -- 172.21.15.122:0/3139122181 learned_addr learned my addr 172.21.15.122:0/3139122181 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:42.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.679+0000 7f47dbe00640 1 --2- 172.21.15.122:0/3139122181 >> v2:172.21.15.153:3300/0 conn(0x7f47e40d2610 0x7f47e40d2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:42.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.679+0000 7f47dbe00640 1 -- 172.21.15.122:0/3139122181 >> v1:172.21.15.153:6789/0 conn(0x7f47e40cf740 legacy=0x7f47e40cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:42.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.679+0000 7f47dbe00640 1 -- 172.21.15.122:0/3139122181 >> v1:172.21.15.122:6789/0 conn(0x7f47e415e9c0 legacy=0x7f47e40b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:42.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.679+0000 7f47dbe00640 1 -- 172.21.15.122:0/3139122181 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e406dd10 con 0x7f47e40d2610 2024-05-28T06:06:42.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.683+0000 7f47dbe00640 1 --2- 172.21.15.122:0/3139122181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47e40d2610 0x7f47e40d2aa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0097c0 tx=0x7f47cc01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8ecbcb67902aab8 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:42.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.683+0000 7f47e2000640 1 -- 172.21.15.122:0/3139122181 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47cc0b0070 con 0x7f47e40d2610 2024-05-28T06:06:42.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.683+0000 7f47e2000640 1 -- 172.21.15.122:0/3139122181 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e40d0a60 con 0x7f47e40d2610 2024-05-28T06:06:42.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.683+0000 7f47e2000640 1 -- 172.21.15.122:0/3139122181 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47cc0ab820 con 0x7f47e40d2610 2024-05-28T06:06:42.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.683+0000 7f47e9e00640 1 -- 172.21.15.122:0/3139122181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47e40d2610 msgr2=0x7f47e40d2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:42.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.683+0000 7f47e9e00640 1 --2- 172.21.15.122:0/3139122181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47e40d2610 0x7f47e40d2aa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0097c0 tx=0x7f47cc01c380 comp rx=0 tx=0).stop 2024-05-28T06:06:42.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.683+0000 7f47e9e00640 1 -- 172.21.15.122:0/3139122181 shutdown_connections 2024-05-28T06:06:42.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.683+0000 7f47e9e00640 1 --2- 172.21.15.122:0/3139122181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47e40d2610 0x7f47e40d2aa0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:42.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.683+0000 7f47e9e00640 1 -- 172.21.15.122:0/3139122181 >> 172.21.15.122:0/3139122181 conn(0x7f47e40702f0 msgr2=0x7f47e4070700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:42.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.683+0000 7f47e9e00640 1 -- 172.21.15.122:0/3139122181 shutdown_connections 2024-05-28T06:06:42.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.683+0000 7f47e9e00640 1 -- 172.21.15.122:0/3139122181 wait complete. 2024-05-28T06:06:42.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47e9e00640 1 Processor -- start 2024-05-28T06:06:42.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47e9e00640 1 -- start start 2024-05-28T06:06:42.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47e9e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47e40cf740 0x7f47e414f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:42.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47e9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f47e40d2610 0x7f47e415c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:42.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47e9e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47e415e9c0 0x7f47e415c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:42.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47e9e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f47e416c7a0 con 0x7f47e415e9c0 2024-05-28T06:06:42.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47e9e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f47e416c620 con 0x7f47e40cf740 2024-05-28T06:06:42.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47e9e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f47e416c920 con 0x7f47e40d2610 2024-05-28T06:06:42.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47e3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47e415e9c0 0x7f47e415c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:42.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47e3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47e415e9c0 0x7f47e415c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57500/0 (socket says 172.21.15.122:57500) 2024-05-28T06:06:42.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47e3400640 1 -- 172.21.15.122:0/3687797328 learned_addr learned my addr 172.21.15.122:0/3687797328 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:42.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47e2a00640 1 --2- 172.21.15.122:0/3687797328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47e40cf740 0x7f47e414f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:42.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47dbe00640 1 --2- 172.21.15.122:0/3687797328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f47e40d2610 0x7f47e415c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:42.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47e3400640 1 -- 172.21.15.122:0/3687797328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f47e40d2610 msgr2=0x7f47e415c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:42.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47e3400640 1 --2- 172.21.15.122:0/3687797328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f47e40d2610 0x7f47e415c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:42.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47e3400640 1 -- 172.21.15.122:0/3687797328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47e40cf740 msgr2=0x7f47e414f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:42.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47e3400640 1 --2- 172.21.15.122:0/3687797328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47e40cf740 0x7f47e414f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:42.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47e3400640 1 -- 172.21.15.122:0/3687797328 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e4157b00 con 0x7f47e415e9c0 2024-05-28T06:06:42.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47e2a00640 1 --2- 172.21.15.122:0/3687797328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47e40cf740 0x7f47e414f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:42.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47e3400640 1 --2- 172.21.15.122:0/3687797328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47e415e9c0 0x7f47e415c5c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f47dc00c770 tx=0x7f47dc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:42.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47db400640 1 -- 172.21.15.122:0/3687797328 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc003b80 con 0x7f47e415e9c0 2024-05-28T06:06:42.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47db400640 1 -- 172.21.15.122:0/3687797328 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47dc003d20 con 0x7f47e415e9c0 2024-05-28T06:06:42.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47db400640 1 -- 172.21.15.122:0/3687797328 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc00aa90 con 0x7f47e415e9c0 2024-05-28T06:06:42.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47e9e00640 1 -- 172.21.15.122:0/3687797328 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47e4157de0 con 0x7f47e415e9c0 2024-05-28T06:06:42.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47e9e00640 1 -- 172.21.15.122:0/3687797328 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47e41583a0 con 0x7f47e415e9c0 2024-05-28T06:06:42.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.687+0000 7f47e9e00640 1 -- 172.21.15.122:0/3687797328 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47e4068bd0 con 0x7f47e415e9c0 2024-05-28T06:06:42.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.691+0000 7f47db400640 1 -- 172.21.15.122:0/3687797328 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f47dc00ac30 con 0x7f47e415e9c0 2024-05-28T06:06:42.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.691+0000 7f47db400640 1 --2- 172.21.15.122:0/3687797328 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f47c0068380 0x7f47c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:42.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.691+0000 7f47db400640 1 -- 172.21.15.122:0/3687797328 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4943+0+0 (secure 0 0 0) 0x7f47dc0865c0 con 0x7f47e415e9c0 2024-05-28T06:06:42.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.691+0000 7f47e2a00640 1 --2- 172.21.15.122:0/3687797328 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f47c0068380 0x7f47c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:42.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.691+0000 7f47e2a00640 1 --2- 172.21.15.122:0/3687797328 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f47c0068380 0x7f47c006a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f47d4005890 tx=0x7f47d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:42.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.695+0000 7f47db400640 1 -- 172.21.15.122:0/3687797328 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f47dc056de0 con 0x7f47e415e9c0 2024-05-28T06:06:42.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:42.859+0000 7f47e9e00640 1 -- 172.21.15.122:0/3687797328 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f47e414fa50 con 0x7f47e415e9c0 2024-05-28T06:06:42.896 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-05-28T06:06:43.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.687+0000 7f47db400640 1 -- 172.21.15.122:0/3687797328 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) ==== 97+0+0 (secure 0 0 0) 0x7f47dc0566e0 con 0x7f47e415e9c0 2024-05-28T06:06:43.689 INFO:teuthology.orchestra.run.smithi122.stderr: removed all blocklist entries 2024-05-28T06:06:43.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.691+0000 7f47e9e00640 1 -- 172.21.15.122:0/3687797328 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f47c0068380 msgr2=0x7f47c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:43.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.691+0000 7f47e9e00640 1 --2- 172.21.15.122:0/3687797328 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f47c0068380 0x7f47c006a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f47d4005890 tx=0x7f47d4009040 comp rx=0 tx=0).stop 2024-05-28T06:06:43.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.691+0000 7f47e9e00640 1 -- 172.21.15.122:0/3687797328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47e415e9c0 msgr2=0x7f47e415c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:43.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.691+0000 7f47e9e00640 1 --2- 172.21.15.122:0/3687797328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47e415e9c0 0x7f47e415c5c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f47dc00c770 tx=0x7f47dc00cc30 comp rx=0 tx=0).stop 2024-05-28T06:06:43.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.691+0000 7f47e9e00640 1 -- 172.21.15.122:0/3687797328 shutdown_connections 2024-05-28T06:06:43.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.691+0000 7f47e9e00640 1 --2- 172.21.15.122:0/3687797328 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f47c0068380 0x7f47c006a840 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:43.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.691+0000 7f47e9e00640 1 --2- 172.21.15.122:0/3687797328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47e415e9c0 0x7f47e415c5c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:43.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.691+0000 7f47e9e00640 1 --2- 172.21.15.122:0/3687797328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f47e40d2610 0x7f47e415c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:43.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.691+0000 7f47e9e00640 1 --2- 172.21.15.122:0/3687797328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47e40cf740 0x7f47e414f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:43.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.691+0000 7f47e9e00640 1 -- 172.21.15.122:0/3687797328 >> 172.21.15.122:0/3687797328 conn(0x7f47e40702f0 msgr2=0x7f47e40d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:43.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.691+0000 7f47e9e00640 1 -- 172.21.15.122:0/3687797328 shutdown_connections 2024-05-28T06:06:43.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.691+0000 7f47e9e00640 1 -- 172.21.15.122:0/3687797328 wait complete. 2024-05-28T06:06:43.716 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-28T06:06:43.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.855+0000 7f58dce00640 1 Processor -- start 2024-05-28T06:06:43.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.855+0000 7f58dce00640 1 -- start start 2024-05-28T06:06:43.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.855+0000 7f58dce00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f58d806dab0 0x7f58d815f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:43.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.855+0000 7f58dce00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f58d815fa80 0x7f58d80d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:43.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.855+0000 7f58dce00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d8162510 con 0x7f58d815ea50 2024-05-28T06:06:43.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.855+0000 7f58dce00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f58d8163120 con 0x7f58d806dab0 2024-05-28T06:06:43.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.855+0000 7f58dce00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f58d81627f0 con 0x7f58d815fa80 2024-05-28T06:06:43.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.855+0000 7f58d5400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f58d806dab0 0x7f58d815f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:43.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.855+0000 7f58d5400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f58d806dab0 0x7f58d815f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57512/0 (socket says 172.21.15.122:57512) 2024-05-28T06:06:43.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.855+0000 7f58d5400640 1 -- 172.21.15.122:0/2854697273 learned_addr learned my addr 172.21.15.122:0/2854697273 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:43.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.855+0000 7f58d6800640 1 --2- 172.21.15.122:0/2854697273 >> v2:172.21.15.153:3300/0 conn(0x7f58d815fa80 0x7f58d80d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:43.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.855+0000 7f58d5400640 1 -- 172.21.15.122:0/2854697273 >> v2:172.21.15.153:3300/0 conn(0x7f58d815fa80 msgr2=0x7f58d80d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:43.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.855+0000 7f58d5400640 1 --2- 172.21.15.122:0/2854697273 >> v2:172.21.15.153:3300/0 conn(0x7f58d815fa80 0x7f58d80d08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:43.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.855+0000 7f58d5400640 1 -- 172.21.15.122:0/2854697273 >> v1:172.21.15.153:6789/0 conn(0x7f58d815ea50 legacy=0x7f58d815ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:43.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.855+0000 7f58d5400640 1 -- 172.21.15.122:0/2854697273 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d8162ad0 con 0x7f58d806dab0 2024-05-28T06:06:43.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.859+0000 7f58d5400640 1 --2- 172.21.15.122:0/2854697273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58d806dab0 0x7f58d815f540 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f58d8072ad0 tx=0x7f58c401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d0bd4fd3381a36 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:43.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.859+0000 7f58d4a00640 1 -- 172.21.15.122:0/2854697273 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c40ab610 con 0x7f58d806dab0 2024-05-28T06:06:43.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.859+0000 7f58d4a00640 1 -- 172.21.15.122:0/2854697273 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c40b0070 con 0x7f58d806dab0 2024-05-28T06:06:43.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.859+0000 7f58d4a00640 1 -- 172.21.15.122:0/2854697273 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c40ab9d0 con 0x7f58d806dab0 2024-05-28T06:06:43.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.859+0000 7f58dce00640 1 -- 172.21.15.122:0/2854697273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58d806dab0 msgr2=0x7f58d815f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:43.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.859+0000 7f58dce00640 1 --2- 172.21.15.122:0/2854697273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58d806dab0 0x7f58d815f540 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f58d8072ad0 tx=0x7f58c401c4f0 comp rx=0 tx=0).stop 2024-05-28T06:06:43.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.859+0000 7f58dce00640 1 -- 172.21.15.122:0/2854697273 shutdown_connections 2024-05-28T06:06:43.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.859+0000 7f58dce00640 1 --2- 172.21.15.122:0/2854697273 >> v2:172.21.15.153:3300/0 conn(0x7f58d815fa80 0x7f58d80d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:43.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.859+0000 7f58dce00640 1 --2- 172.21.15.122:0/2854697273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58d806dab0 0x7f58d815f540 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:43.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.859+0000 7f58dce00640 1 -- 172.21.15.122:0/2854697273 >> 172.21.15.122:0/2854697273 conn(0x7f58d80b4190 msgr2=0x7f58d80b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:43.864 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.859+0000 7f58dce00640 1 -- 172.21.15.122:0/2854697273 shutdown_connections 2024-05-28T06:06:43.864 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.859+0000 7f58dce00640 1 -- 172.21.15.122:0/2854697273 wait complete. 2024-05-28T06:06:43.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58dce00640 1 Processor -- start 2024-05-28T06:06:43.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58dce00640 1 -- start start 2024-05-28T06:06:43.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58dce00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58d806dab0 0x7f58d815c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:43.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58dce00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58d815ea50 0x7f58d8159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:43.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58dce00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58d815fa80 0x7f58d8159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:43.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58dce00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f58d80d1a00 con 0x7f58d806dab0 2024-05-28T06:06:43.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58dce00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f58d80d1880 con 0x7f58d815ea50 2024-05-28T06:06:43.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58dce00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f58d80d1b80 con 0x7f58d815fa80 2024-05-28T06:06:43.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58d5e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58d806dab0 0x7f58d815c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:43.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58d5e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58d806dab0 0x7f58d815c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57522/0 (socket says 172.21.15.122:57522) 2024-05-28T06:06:43.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58d5e00640 1 -- 172.21.15.122:0/431248649 learned_addr learned my addr 172.21.15.122:0/431248649 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:43.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58d6800640 1 --2- 172.21.15.122:0/431248649 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58d815fa80 0x7f58d8159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:43.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58d5400640 1 --2- 172.21.15.122:0/431248649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58d815ea50 0x7f58d8159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:43.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58d5e00640 1 -- 172.21.15.122:0/431248649 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58d815fa80 msgr2=0x7f58d8159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:43.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58d5e00640 1 --2- 172.21.15.122:0/431248649 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58d815fa80 0x7f58d8159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:43.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58d5e00640 1 -- 172.21.15.122:0/431248649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58d815ea50 msgr2=0x7f58d8159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:43.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58d5e00640 1 --2- 172.21.15.122:0/431248649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58d815ea50 0x7f58d8159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:43.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58d5e00640 1 -- 172.21.15.122:0/431248649 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d815cc60 con 0x7f58d806dab0 2024-05-28T06:06:43.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58d5400640 1 --2- 172.21.15.122:0/431248649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58d815ea50 0x7f58d8159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:43.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58d5e00640 1 --2- 172.21.15.122:0/431248649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58d806dab0 0x7f58d815c720 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f58c800c3a0 tx=0x7f58c800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:43.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58ce000640 1 -- 172.21.15.122:0/431248649 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c80052d0 con 0x7f58d806dab0 2024-05-28T06:06:43.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58ce000640 1 -- 172.21.15.122:0/431248649 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c8005470 con 0x7f58d806dab0 2024-05-28T06:06:43.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58dce00640 1 -- 172.21.15.122:0/431248649 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d815cf00 con 0x7f58d806dab0 2024-05-28T06:06:43.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58ce000640 1 -- 172.21.15.122:0/431248649 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c8007260 con 0x7f58d806dab0 2024-05-28T06:06:43.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58dce00640 1 -- 172.21.15.122:0/431248649 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d815d4c0 con 0x7f58d806dab0 2024-05-28T06:06:43.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.863+0000 7f58dce00640 1 -- 172.21.15.122:0/431248649 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58d815d700 con 0x7f58d806dab0 2024-05-28T06:06:43.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.867+0000 7f58ce000640 1 -- 172.21.15.122:0/431248649 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f58c8007400 con 0x7f58d806dab0 2024-05-28T06:06:43.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.867+0000 7f58ce000640 1 --2- 172.21.15.122:0/431248649 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f58b8068380 0x7f58b806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:43.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.867+0000 7f58ce000640 1 -- 172.21.15.122:0/431248649 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f58c8085b30 con 0x7f58d806dab0 2024-05-28T06:06:43.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.867+0000 7f58d5400640 1 --2- 172.21.15.122:0/431248649 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f58b8068380 0x7f58b806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:43.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.867+0000 7f58d5400640 1 --2- 172.21.15.122:0/431248649 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f58b8068380 0x7f58b806a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f58c40af000 tx=0x7f58c40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:43.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:43.871+0000 7f58ce000640 1 -- 172.21.15.122:0/431248649 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f58d815d700 con 0x7f58d806dab0 2024-05-28T06:06:44.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.083+0000 7f58dce00640 1 -- 172.21.15.122:0/431248649 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f58d8068c40 con 0x7f58d806dab0 2024-05-28T06:06:44.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.083+0000 7f58ce000640 1 -- 172.21.15.122:0/431248649 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7f58c8056430 con 0x7f58d806dab0 2024-05-28T06:06:44.087 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:44.087 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:06:44.087 INFO:teuthology.orchestra.run.smithi122.stdout: "auth_dump": [ 2024-05-28T06:06:44.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.087 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "mds.a", 2024-05-28T06:06:44.087 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQABdFVm1w+ENBAApIn8Y6gj7tEWLXulaHDeUQ==", 2024-05-28T06:06:44.087 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.088 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:06:44.088 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow *", 2024-05-28T06:06:44.088 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow *", 2024-05-28T06:06:44.088 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:06:44.088 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.088 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "mds.b", 2024-05-28T06:06:44.088 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQACdFVmGk7xBBAAMqLBLe5planzHBjA6ArHRw==", 2024-05-28T06:06:44.088 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.088 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:06:44.089 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow *", 2024-05-28T06:06:44.089 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow *", 2024-05-28T06:06:44.089 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:06:44.089 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.089 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "mds.c", 2024-05-28T06:06:44.089 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQACdFVmFGgJABAA77ul3s2asGb5MaqgumfSug==", 2024-05-28T06:06:44.089 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.089 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:06:44.089 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow *", 2024-05-28T06:06:44.090 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow *", 2024-05-28T06:06:44.090 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:06:44.090 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.091 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "mds.d", 2024-05-28T06:06:44.091 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQACdFVmJ6bgDhAAyvzv5Q6Q10llEPpP2ZrVMw==", 2024-05-28T06:06:44.091 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.091 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:06:44.091 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow *", 2024-05-28T06:06:44.091 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow *", 2024-05-28T06:06:44.091 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:06:44.091 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.091 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.0", 2024-05-28T06:06:44.092 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAFdFVmyeJQGBAAvF5HlH71HfNSzHJgrGQSeQ==", 2024-05-28T06:06:44.092 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.092 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:06:44.092 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:06:44.092 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:06:44.092 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.092 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.1", 2024-05-28T06:06:44.092 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAIdFVm1gb0IhAAfdRRFfamBuhL6VC4fKnd6A==", 2024-05-28T06:06:44.092 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.093 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:06:44.093 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:06:44.093 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:06:44.093 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.093 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.2", 2024-05-28T06:06:44.093 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQALdFVm7g3HLBAA9HywQrCOoZa52bOHJc8Nkw==", 2024-05-28T06:06:44.093 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.093 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:06:44.093 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:06:44.094 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:06:44.094 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.094 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.3", 2024-05-28T06:06:44.094 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAOdFVmo7kHOBAATvO+5IkILjPjVVGK09HAQw==", 2024-05-28T06:06:44.094 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.094 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:06:44.094 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:06:44.094 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:06:44.094 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.094 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.4", 2024-05-28T06:06:44.095 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAUdFVmlS0xMBAAnznRAYw5OO6Cgn/cfRrcfA==", 2024-05-28T06:06:44.095 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.095 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:06:44.095 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:06:44.095 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:06:44.095 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.095 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.5", 2024-05-28T06:06:44.095 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAXdFVmCcjTORAALJZO51S0QxuOlJVBtTl25A==", 2024-05-28T06:06:44.095 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.095 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:06:44.095 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:06:44.095 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:06:44.096 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.096 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.6", 2024-05-28T06:06:44.096 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAbdFVmMl0ABxAAPNjpXSKXvza1dAIaFCdesw==", 2024-05-28T06:06:44.096 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.096 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:06:44.096 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:06:44.096 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:06:44.096 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.097 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.7", 2024-05-28T06:06:44.097 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAedFVmA7ufDxAAPQwbA2Cb+c5sHN6cA1cwbQ==", 2024-05-28T06:06:44.097 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.097 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:06:44.097 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:06:44.097 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:06:44.097 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.098 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "client.0", 2024-05-28T06:06:44.098 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQACdFVm0fSmExAAkwJTGq732gbcMsBbs84lWw==", 2024-05-28T06:06:44.098 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.098 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:06:44.098 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow r", 2024-05-28T06:06:44.098 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow rw", 2024-05-28T06:06:44.098 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow rwx" 2024-05-28T06:06:44.098 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.098 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "client.1", 2024-05-28T06:06:44.098 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQACdFVmrapoHRAAgM01mt0lQsXP/W8G1QETmQ==", 2024-05-28T06:06:44.099 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.099 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:06:44.099 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow r", 2024-05-28T06:06:44.099 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow rw", 2024-05-28T06:06:44.099 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow rwx" 2024-05-28T06:06:44.099 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.099 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "client.2", 2024-05-28T06:06:44.099 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQACdFVmekj8GRAA2pS9myP+ygZmUImxnfgjiw==", 2024-05-28T06:06:44.099 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.099 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:06:44.099 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow r", 2024-05-28T06:06:44.099 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow rw", 2024-05-28T06:06:44.100 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow rwx" 2024-05-28T06:06:44.100 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.100 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "client.3", 2024-05-28T06:06:44.100 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQACdFVmwRh0IxAACbmN8+zTza+A3aB9xeRRRg==", 2024-05-28T06:06:44.100 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.100 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:06:44.100 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow r", 2024-05-28T06:06:44.100 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow rw", 2024-05-28T06:06:44.100 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow rwx" 2024-05-28T06:06:44.100 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.100 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "client.admin", 2024-05-28T06:06:44.101 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQABdFVmkLXlFxAAP8CCUVIxQMti8qk4wrU4Hw==", 2024-05-28T06:06:44.101 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.101 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow *", 2024-05-28T06:06:44.101 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow *", 2024-05-28T06:06:44.101 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow *", 2024-05-28T06:06:44.101 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:06:44.101 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.101 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "client.bootstrap-mds", 2024-05-28T06:06:44.101 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAkdFVmbc7fDhAAYZ8PiCEbK3dSfABRWGUfmg==", 2024-05-28T06:06:44.101 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.101 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile bootstrap-mds" 2024-05-28T06:06:44.101 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.102 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "client.bootstrap-mgr", 2024-05-28T06:06:44.102 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAkdFVmit/fDhAAU40IzQ1M6tl2PVAqFUQonw==", 2024-05-28T06:06:44.102 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.102 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-28T06:06:44.102 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.102 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "client.bootstrap-osd", 2024-05-28T06:06:44.102 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAkdFVmV+7fDhAAoQoySyEVO82yZngUcmZQnw==", 2024-05-28T06:06:44.102 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.102 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile bootstrap-osd" 2024-05-28T06:06:44.103 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.103 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "client.bootstrap-rbd", 2024-05-28T06:06:44.103 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAkdFVmWvzfDhAAlOnZE6uiFVPNXBbQed7GYQ==", 2024-05-28T06:06:44.103 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.103 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-28T06:06:44.103 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.104 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-28T06:06:44.104 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAkdFVmuArgDhAAU6IUb8JogO8/7NmYyuxw/A==", 2024-05-28T06:06:44.104 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.104 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-28T06:06:44.104 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.104 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "client.bootstrap-rgw", 2024-05-28T06:06:44.104 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAkdFVmuRbgDhAAYJKkWbSghBSdbG0V8UtWsg==", 2024-05-28T06:06:44.104 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.104 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-28T06:06:44.104 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.105 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "mgr.x", 2024-05-28T06:06:44.105 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQABdFVmyM6lLxAACnc16i7218VDdALiqlbb0A==", 2024-05-28T06:06:44.105 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.105 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow *", 2024-05-28T06:06:44.105 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile mgr", 2024-05-28T06:06:44.105 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:06:44.105 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:06:44.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:44.105 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "mgr.y", 2024-05-28T06:06:44.105 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQABdFVmnI6oKxAARwnXRnNv2SZ59/x+YyuO6g==", 2024-05-28T06:06:44.105 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:06:44.106 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow *", 2024-05-28T06:06:44.106 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile mgr", 2024-05-28T06:06:44.106 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:06:44.106 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.106 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:44.106 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-05-28T06:06:44.106 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:06:44.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.087+0000 7f58dce00640 1 -- 172.21.15.122:0/431248649 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f58b8068380 msgr2=0x7f58b806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:44.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.087+0000 7f58dce00640 1 --2- 172.21.15.122:0/431248649 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f58b8068380 0x7f58b806a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f58c40af000 tx=0x7f58c40a7000 comp rx=0 tx=0).stop 2024-05-28T06:06:44.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.087+0000 7f58dce00640 1 -- 172.21.15.122:0/431248649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58d806dab0 msgr2=0x7f58d815c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:44.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.087+0000 7f58dce00640 1 --2- 172.21.15.122:0/431248649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58d806dab0 0x7f58d815c720 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f58c800c3a0 tx=0x7f58c800c860 comp rx=0 tx=0).stop 2024-05-28T06:06:44.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.087+0000 7f58dce00640 1 -- 172.21.15.122:0/431248649 shutdown_connections 2024-05-28T06:06:44.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.087+0000 7f58dce00640 1 --2- 172.21.15.122:0/431248649 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f58b8068380 0x7f58b806a840 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:44.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.087+0000 7f58dce00640 1 --2- 172.21.15.122:0/431248649 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58d815fa80 0x7f58d8159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:44.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.087+0000 7f58dce00640 1 --2- 172.21.15.122:0/431248649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58d815ea50 0x7f58d8159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:44.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.087+0000 7f58dce00640 1 --2- 172.21.15.122:0/431248649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58d806dab0 0x7f58d815c720 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:44.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.087+0000 7f58dce00640 1 -- 172.21.15.122:0/431248649 >> 172.21.15.122:0/431248649 conn(0x7f58d80b4190 msgr2=0x7f58d8071510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:44.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.087+0000 7f58dce00640 1 -- 172.21.15.122:0/431248649 shutdown_connections 2024-05-28T06:06:44.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.087+0000 7f58dce00640 1 -- 172.21.15.122:0/431248649 wait complete. 2024-05-28T06:06:44.110 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-28T06:06:44.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.247+0000 7f30da600640 1 Processor -- start 2024-05-28T06:06:44.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.247+0000 7f30da600640 1 -- start start 2024-05-28T06:06:44.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.247+0000 7f30da600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f30d40cec70 0x7f30d4146010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:44.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.247+0000 7f30da600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30d406f7e0 con 0x7f30d4145b80 2024-05-28T06:06:44.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.247+0000 7f30da600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30d406e030 con 0x7f30d4142d30 2024-05-28T06:06:44.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.247+0000 7f30da600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f30d406ec40 con 0x7f30d40cec70 2024-05-28T06:06:44.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.247+0000 7f30d3e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f30d40cec70 0x7f30d4146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:44.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.247+0000 7f30caa00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f30d4145b80 0x7f30d40ce560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:48964/0 (socket says 172.21.15.122:48964) 2024-05-28T06:06:44.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.247+0000 7f30caa00640 1 -- 172.21.15.122:0/4215737798 learned_addr learned my addr 172.21.15.122:0/4215737798 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:44.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.247+0000 7f30d3e00640 1 -- 172.21.15.122:0/4215737798 >> v1:172.21.15.153:6789/0 conn(0x7f30d4142d30 legacy=0x7f30d406f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:44.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.247+0000 7f30d3e00640 1 -- 172.21.15.122:0/4215737798 >> v1:172.21.15.122:6789/0 conn(0x7f30d4145b80 legacy=0x7f30d40ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:44.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.247+0000 7f30d3e00640 1 -- 172.21.15.122:0/4215737798 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d406e310 con 0x7f30d40cec70 2024-05-28T06:06:44.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.251+0000 7f30d3e00640 1 --2- 172.21.15.122:0/4215737798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30d40cec70 0x7f30d4146010 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009d90 tx=0x7f30cc01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb9a4bf2afa0d3d server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:44.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.251+0000 7f30d2a00640 1 -- 172.21.15.122:0/4215737798 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc0b2070 con 0x7f30d40cec70 2024-05-28T06:06:44.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.251+0000 7f30d2a00640 1 -- 172.21.15.122:0/4215737798 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30cc0a5970 con 0x7f30d40cec70 2024-05-28T06:06:44.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.251+0000 7f30d2a00640 1 -- 172.21.15.122:0/4215737798 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc0a5d40 con 0x7f30d40cec70 2024-05-28T06:06:44.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.251+0000 7f30da600640 1 -- 172.21.15.122:0/4215737798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30d40cec70 msgr2=0x7f30d4146010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:44.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.251+0000 7f30da600640 1 --2- 172.21.15.122:0/4215737798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30d40cec70 0x7f30d4146010 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009d90 tx=0x7f30cc01c8b0 comp rx=0 tx=0).stop 2024-05-28T06:06:44.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.251+0000 7f30da600640 1 -- 172.21.15.122:0/4215737798 shutdown_connections 2024-05-28T06:06:44.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.251+0000 7f30da600640 1 --2- 172.21.15.122:0/4215737798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30d40cec70 0x7f30d4146010 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:44.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.251+0000 7f30da600640 1 -- 172.21.15.122:0/4215737798 >> 172.21.15.122:0/4215737798 conn(0x7f30d4062a40 msgr2=0x7f30d406b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:44.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.251+0000 7f30da600640 1 -- 172.21.15.122:0/4215737798 shutdown_connections 2024-05-28T06:06:44.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.251+0000 7f30da600640 1 -- 172.21.15.122:0/4215737798 wait complete. 2024-05-28T06:06:44.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.251+0000 7f30da600640 1 Processor -- start 2024-05-28T06:06:44.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.251+0000 7f30da600640 1 -- start start 2024-05-28T06:06:44.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30da600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30d40cec70 0x7f30d413e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:44.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30da600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30d4142d30 0x7f30d413e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:44.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30da600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30d4145b80 0x7f30d41584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:44.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30da600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f30d4143290 con 0x7f30d40cec70 2024-05-28T06:06:44.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30da600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f30d4143110 con 0x7f30d4145b80 2024-05-28T06:06:44.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30da600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f30d416a840 con 0x7f30d4142d30 2024-05-28T06:06:44.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30d3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30d40cec70 0x7f30d413e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:44.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30d3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30d40cec70 0x7f30d413e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57538/0 (socket says 172.21.15.122:57538) 2024-05-28T06:06:44.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30d3400640 1 -- 172.21.15.122:0/220605259 learned_addr learned my addr 172.21.15.122:0/220605259 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:44.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30caa00640 1 --2- 172.21.15.122:0/220605259 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30d4142d30 0x7f30d413e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:44.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30d3e00640 1 --2- 172.21.15.122:0/220605259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30d4145b80 0x7f30d41584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:44.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30d3400640 1 -- 172.21.15.122:0/220605259 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30d4142d30 msgr2=0x7f30d413e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:44.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30d3400640 1 --2- 172.21.15.122:0/220605259 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30d4142d30 0x7f30d413e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:44.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30d3400640 1 -- 172.21.15.122:0/220605259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30d4145b80 msgr2=0x7f30d41584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:44.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30d3400640 1 --2- 172.21.15.122:0/220605259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30d4145b80 0x7f30d41584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:44.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30d3400640 1 -- 172.21.15.122:0/220605259 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d40ae690 con 0x7f30d40cec70 2024-05-28T06:06:44.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30d3400640 1 --2- 172.21.15.122:0/220605259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30d40cec70 0x7f30d413e010 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f30c400c420 tx=0x7f30c400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:44.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30cbe00640 1 -- 172.21.15.122:0/220605259 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c40052d0 con 0x7f30d40cec70 2024-05-28T06:06:44.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30cbe00640 1 -- 172.21.15.122:0/220605259 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30c4005470 con 0x7f30d40cec70 2024-05-28T06:06:44.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30da600640 1 -- 172.21.15.122:0/220605259 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30d40ae970 con 0x7f30d40cec70 2024-05-28T06:06:44.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30cbe00640 1 -- 172.21.15.122:0/220605259 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4007260 con 0x7f30d40cec70 2024-05-28T06:06:44.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30da600640 1 -- 172.21.15.122:0/220605259 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30d40aef30 con 0x7f30d40cec70 2024-05-28T06:06:44.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30da600640 1 -- 172.21.15.122:0/220605259 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30d4068bd0 con 0x7f30d40cec70 2024-05-28T06:06:44.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.255+0000 7f30cbe00640 1 -- 172.21.15.122:0/220605259 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f30c4007400 con 0x7f30d40cec70 2024-05-28T06:06:44.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.259+0000 7f30cbe00640 1 --2- 172.21.15.122:0/220605259 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f30b0068380 0x7f30b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:44.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.259+0000 7f30cbe00640 1 -- 172.21.15.122:0/220605259 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f30c4085b30 con 0x7f30d40cec70 2024-05-28T06:06:44.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.259+0000 7f30caa00640 1 --2- 172.21.15.122:0/220605259 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f30b0068380 0x7f30b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:44.263 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.259+0000 7f30caa00640 1 --2- 172.21.15.122:0/220605259 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f30b0068380 0x7f30b006a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f30d4145190 tx=0x7f30bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:44.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.263+0000 7f30cbe00640 1 -- 172.21.15.122:0/220605259 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f30c4055dd0 con 0x7f30d40cec70 2024-05-28T06:06:44.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.475+0000 7f30da600640 1 -- 172.21.15.122:0/220605259 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f30d406ced0 con 0x7f30d40cec70 2024-05-28T06:06:44.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.479+0000 7f30cbe00640 1 -- 172.21.15.122:0/220605259 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f30c405a0d0 con 0x7f30d40cec70 2024-05-28T06:06:44.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.483+0000 7f30da600640 1 -- 172.21.15.122:0/220605259 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f30b0068380 msgr2=0x7f30b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:44.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.483+0000 7f30da600640 1 --2- 172.21.15.122:0/220605259 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f30b0068380 0x7f30b006a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f30d4145190 tx=0x7f30bc009040 comp rx=0 tx=0).stop 2024-05-28T06:06:44.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.483+0000 7f30da600640 1 -- 172.21.15.122:0/220605259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30d40cec70 msgr2=0x7f30d413e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:44.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.483+0000 7f30da600640 1 --2- 172.21.15.122:0/220605259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30d40cec70 0x7f30d413e010 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f30c400c420 tx=0x7f30c400c8e0 comp rx=0 tx=0).stop 2024-05-28T06:06:44.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.483+0000 7f30da600640 1 -- 172.21.15.122:0/220605259 shutdown_connections 2024-05-28T06:06:44.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.483+0000 7f30da600640 1 --2- 172.21.15.122:0/220605259 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f30b0068380 0x7f30b006a840 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:44.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.483+0000 7f30da600640 1 --2- 172.21.15.122:0/220605259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30d4145b80 0x7f30d41584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:44.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.483+0000 7f30da600640 1 --2- 172.21.15.122:0/220605259 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30d4142d30 0x7f30d413e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:44.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.483+0000 7f30da600640 1 --2- 172.21.15.122:0/220605259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30d40cec70 0x7f30d413e010 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:44.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.483+0000 7f30da600640 1 -- 172.21.15.122:0/220605259 >> 172.21.15.122:0/220605259 conn(0x7f30d4062a40 msgr2=0x7f30d40ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:44.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.483+0000 7f30da600640 1 -- 172.21.15.122:0/220605259 shutdown_connections 2024-05-28T06:06:44.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.483+0000 7f30da600640 1 -- 172.21.15.122:0/220605259 wait complete. 2024-05-28T06:06:44.503 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-28T06:06:44.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.639+0000 7f98fcc00640 1 Processor -- start 2024-05-28T06:06:44.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.639+0000 7f98fcc00640 1 -- start start 2024-05-28T06:06:44.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.639+0000 7f98fcc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98f815eae0 0x7f98f80b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:44.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.639+0000 7f98fcc00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f98f80d2140 0x7f98f80ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:44.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.639+0000 7f98fcc00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98f815eec0 con 0x7f98f80b54c0 2024-05-28T06:06:44.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.639+0000 7f98fcc00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f98f80b4650 con 0x7f98f80d2140 2024-05-28T06:06:44.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.639+0000 7f98fcc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f98f80b4930 con 0x7f98f815eae0 2024-05-28T06:06:44.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.639+0000 7f98ed400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f98f80b54c0 0x7f98f80d1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:48978/0 (socket says 172.21.15.122:48978) 2024-05-28T06:06:44.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.639+0000 7f98ed400640 1 -- 172.21.15.122:0/4045802940 learned_addr learned my addr 172.21.15.122:0/4045802940 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:44.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.639+0000 7f98f6800640 1 --2- 172.21.15.122:0/4045802940 >> v2:172.21.15.122:3300/0 conn(0x7f98f80d2140 0x7f98f80ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:44.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.639+0000 7f98f5e00640 1 --2- 172.21.15.122:0/4045802940 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98f815eae0 0x7f98f80b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:44.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.639+0000 7f98f6800640 1 -- 172.21.15.122:0/4045802940 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98f815eae0 msgr2=0x7f98f80b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:44.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.639+0000 7f98f6800640 1 --2- 172.21.15.122:0/4045802940 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98f815eae0 0x7f98f80b4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:44.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.639+0000 7f98f6800640 1 -- 172.21.15.122:0/4045802940 >> v1:172.21.15.122:6789/0 conn(0x7f98f80b54c0 legacy=0x7f98f80d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:44.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.639+0000 7f98f6800640 1 -- 172.21.15.122:0/4045802940 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f80b4c10 con 0x7f98f80d2140 2024-05-28T06:06:44.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.643+0000 7f98f6800640 1 --2- 172.21.15.122:0/4045802940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f80d2140 0x7f98f80ca8a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f98f00097c0 tx=0x7f98f001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6fd7cc17c1fccea server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:44.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.643+0000 7f98f5400640 1 -- 172.21.15.122:0/4045802940 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f00b0070 con 0x7f98f80d2140 2024-05-28T06:06:44.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.643+0000 7f98f5400640 1 -- 172.21.15.122:0/4045802940 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f00ab600 con 0x7f98f80d2140 2024-05-28T06:06:44.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.643+0000 7f98f5400640 1 -- 172.21.15.122:0/4045802940 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f00ab9d0 con 0x7f98f80d2140 2024-05-28T06:06:44.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.643+0000 7f98fcc00640 1 -- 172.21.15.122:0/4045802940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f80d2140 msgr2=0x7f98f80ca8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:44.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.643+0000 7f98fcc00640 1 --2- 172.21.15.122:0/4045802940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f80d2140 0x7f98f80ca8a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f98f00097c0 tx=0x7f98f001c470 comp rx=0 tx=0).stop 2024-05-28T06:06:44.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.643+0000 7f98fcc00640 1 -- 172.21.15.122:0/4045802940 shutdown_connections 2024-05-28T06:06:44.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.643+0000 7f98fcc00640 1 --2- 172.21.15.122:0/4045802940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f80d2140 0x7f98f80ca8a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:44.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.643+0000 7f98fcc00640 1 --2- 172.21.15.122:0/4045802940 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98f815eae0 0x7f98f80b4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:44.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.643+0000 7f98fcc00640 1 -- 172.21.15.122:0/4045802940 >> 172.21.15.122:0/4045802940 conn(0x7f98f80b6c10 msgr2=0x7f98f80b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:44.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.643+0000 7f98fcc00640 1 -- 172.21.15.122:0/4045802940 shutdown_connections 2024-05-28T06:06:44.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.643+0000 7f98fcc00640 1 -- 172.21.15.122:0/4045802940 wait complete. 2024-05-28T06:06:44.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98fcc00640 1 Processor -- start 2024-05-28T06:06:44.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98fcc00640 1 -- start start 2024-05-28T06:06:44.650 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98fcc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98f80b54c0 0x7f98f80ce270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:44.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98fcc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f80d2140 0x7f98f814ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:44.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98fcc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98f815eae0 0x7f98f80cf000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:44.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98fcc00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f98f80b3fa0 con 0x7f98f80d2140 2024-05-28T06:06:44.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98fcc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f98f80b3e20 con 0x7f98f80b54c0 2024-05-28T06:06:44.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98fcc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f98f816b610 con 0x7f98f815eae0 2024-05-28T06:06:44.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98ed400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f80d2140 0x7f98f814ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:44.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98ed400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f80d2140 0x7f98f814ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57566/0 (socket says 172.21.15.122:57566) 2024-05-28T06:06:44.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98ed400640 1 -- 172.21.15.122:0/1513233252 learned_addr learned my addr 172.21.15.122:0/1513233252 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:44.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98f6800640 1 --2- 172.21.15.122:0/1513233252 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98f815eae0 0x7f98f80cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:44.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98f5e00640 1 --2- 172.21.15.122:0/1513233252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98f80b54c0 0x7f98f80ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:44.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98ed400640 1 -- 172.21.15.122:0/1513233252 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98f815eae0 msgr2=0x7f98f80cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:44.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98ed400640 1 --2- 172.21.15.122:0/1513233252 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98f815eae0 0x7f98f80cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:44.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98ed400640 1 -- 172.21.15.122:0/1513233252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98f80b54c0 msgr2=0x7f98f80ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:44.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98ed400640 1 --2- 172.21.15.122:0/1513233252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98f80b54c0 0x7f98f80ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:44.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98ed400640 1 -- 172.21.15.122:0/1513233252 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f814f350 con 0x7f98f80d2140 2024-05-28T06:06:44.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98f6800640 1 --2- 172.21.15.122:0/1513233252 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98f815eae0 0x7f98f80cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:44.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98f5e00640 1 --2- 172.21.15.122:0/1513233252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98f80b54c0 0x7f98f80ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:44.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98ed400640 1 --2- 172.21.15.122:0/1513233252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f80d2140 0x7f98f814ee10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f98e000c420 tx=0x7f98e000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:44.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98eea00640 1 -- 172.21.15.122:0/1513233252 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e0017070 con 0x7f98f80d2140 2024-05-28T06:06:44.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98eea00640 1 -- 172.21.15.122:0/1513233252 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e0005cf0 con 0x7f98f80d2140 2024-05-28T06:06:44.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98eea00640 1 -- 172.21.15.122:0/1513233252 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e00072f0 con 0x7f98f80d2140 2024-05-28T06:06:44.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98fcc00640 1 -- 172.21.15.122:0/1513233252 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98f814f5d0 con 0x7f98f80d2140 2024-05-28T06:06:44.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.647+0000 7f98fcc00640 1 -- 172.21.15.122:0/1513233252 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98f814fb90 con 0x7f98f80d2140 2024-05-28T06:06:44.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.651+0000 7f98fcc00640 1 -- 172.21.15.122:0/1513233252 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98f81501a0 con 0x7f98f80d2140 2024-05-28T06:06:44.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.651+0000 7f98eea00640 1 -- 172.21.15.122:0/1513233252 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f98e001a070 con 0x7f98f80d2140 2024-05-28T06:06:44.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.651+0000 7f98eea00640 1 --2- 172.21.15.122:0/1513233252 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f98d4068380 0x7f98d406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:44.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.651+0000 7f98eea00640 1 -- 172.21.15.122:0/1513233252 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f98e0085b60 con 0x7f98f80d2140 2024-05-28T06:06:44.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.651+0000 7f98f5e00640 1 --2- 172.21.15.122:0/1513233252 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f98d4068380 0x7f98d406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:44.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.651+0000 7f98f5e00640 1 --2- 172.21.15.122:0/1513233252 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f98d4068380 0x7f98d406a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009f50 tx=0x7f98e800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:44.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.655+0000 7f98eea00640 1 -- 172.21.15.122:0/1513233252 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f98f814f350 con 0x7f98f80d2140 2024-05-28T06:06:44.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.867+0000 7f98fcc00640 1 -- 172.21.15.122:0/1513233252 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f98f80b0c90 con 0x7f98f80d2140 2024-05-28T06:06:44.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.871+0000 7f98eea00640 1 -- 172.21.15.122:0/1513233252 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f98e0056340 con 0x7f98f80d2140 2024-05-28T06:06:44.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.871+0000 7f98fcc00640 1 -- 172.21.15.122:0/1513233252 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f98d4068380 msgr2=0x7f98d406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:44.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.871+0000 7f98fcc00640 1 --2- 172.21.15.122:0/1513233252 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f98d4068380 0x7f98d406a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009f50 tx=0x7f98e800b040 comp rx=0 tx=0).stop 2024-05-28T06:06:44.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.871+0000 7f98fcc00640 1 -- 172.21.15.122:0/1513233252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f80d2140 msgr2=0x7f98f814ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:44.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.871+0000 7f98fcc00640 1 --2- 172.21.15.122:0/1513233252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f80d2140 0x7f98f814ee10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f98e000c420 tx=0x7f98e000c8e0 comp rx=0 tx=0).stop 2024-05-28T06:06:44.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.871+0000 7f98fcc00640 1 -- 172.21.15.122:0/1513233252 shutdown_connections 2024-05-28T06:06:44.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.871+0000 7f98fcc00640 1 --2- 172.21.15.122:0/1513233252 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f98d4068380 0x7f98d406a840 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:44.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.871+0000 7f98fcc00640 1 --2- 172.21.15.122:0/1513233252 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98f815eae0 0x7f98f80cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:44.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.871+0000 7f98fcc00640 1 --2- 172.21.15.122:0/1513233252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f80d2140 0x7f98f814ee10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:44.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.871+0000 7f98fcc00640 1 --2- 172.21.15.122:0/1513233252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98f80b54c0 0x7f98f80ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:44.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.871+0000 7f98fcc00640 1 -- 172.21.15.122:0/1513233252 >> 172.21.15.122:0/1513233252 conn(0x7f98f80b6c10 msgr2=0x7f98f815d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:44.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.871+0000 7f98fcc00640 1 -- 172.21.15.122:0/1513233252 shutdown_connections 2024-05-28T06:06:44.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:44.871+0000 7f98fcc00640 1 -- 172.21.15.122:0/1513233252 wait complete. 2024-05-28T06:06:44.893 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-28T06:06:45.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.027+0000 7f7a3e800640 1 Processor -- start 2024-05-28T06:06:45.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.027+0000 7f7a3e800640 1 -- start start 2024-05-28T06:06:45.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.027+0000 7f7a3e800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7a38142d30 0x7f7a3806f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.027+0000 7f7a3e800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a380ce560 0x7f7a380ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.027+0000 7f7a3e800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a3806e030 con 0x7f7a3806f610 2024-05-28T06:06:45.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.027+0000 7f7a3e800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7a380ceef0 con 0x7f7a38142d30 2024-05-28T06:06:45.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.027+0000 7f7a3e800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7a3806ec40 con 0x7f7a380ce560 2024-05-28T06:06:45.033 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36a00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f7a3806f610 0x7f7a38145b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:48986/0 (socket says 172.21.15.122:48986) 2024-05-28T06:06:45.033 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36a00640 1 -- 172.21.15.122:0/2394626797 learned_addr learned my addr 172.21.15.122:0/2394626797 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:45.033 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36000640 1 -- 172.21.15.122:0/2394626797 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2377957221 0 0) 0x7f7a3806e030 con 0x7f7a3806f610 2024-05-28T06:06:45.033 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36000640 1 -- 172.21.15.122:0/2394626797 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a1c003530 con 0x7f7a3806f610 2024-05-28T06:06:45.033 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a37e00640 1 --2- 172.21.15.122:0/2394626797 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a380ce560 0x7f7a380ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.033 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a37400640 1 --2- 172.21.15.122:0/2394626797 >> v2:172.21.15.153:3300/0 conn(0x7f7a38142d30 0x7f7a3806f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36000640 1 -- 172.21.15.122:0/2394626797 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2696371877 0 0) 0x7f7a1c003530 con 0x7f7a3806f610 2024-05-28T06:06:45.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36000640 1 -- 172.21.15.122:0/2394626797 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a380ce560 msgr2=0x7f7a380ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:45.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36000640 1 --2- 172.21.15.122:0/2394626797 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a380ce560 0x7f7a380ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36000640 1 -- 172.21.15.122:0/2394626797 >> v2:172.21.15.153:3300/0 conn(0x7f7a38142d30 msgr2=0x7f7a3806f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:45.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36000640 1 --2- 172.21.15.122:0/2394626797 >> v2:172.21.15.153:3300/0 conn(0x7f7a38142d30 0x7f7a3806f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36000640 1 -- 172.21.15.122:0/2394626797 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3806e310 con 0x7f7a3806f610 2024-05-28T06:06:45.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36000640 1 -- 172.21.15.122:0/2394626797 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f7a24001680 con 0x7f7a3806f610 2024-05-28T06:06:45.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36000640 1 -- 172.21.15.122:0/2394626797 >> v1:172.21.15.122:6789/0 conn(0x7f7a3806f610 legacy=0x7f7a38145b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:45.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36000640 1 --2- 172.21.15.122:0/2394626797 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a1c0039c0 0x7f7a1c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36000640 1 --2- 172.21.15.122:0/2394626797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a1c004810 0x7f7a1c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36000640 1 --2- 172.21.15.122:0/2394626797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a1c0051d0 0x7f7a1c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36000640 1 -- 172.21.15.122:0/2394626797 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7a380ceef0 con 0x7f7a1c004810 2024-05-28T06:06:45.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36000640 1 -- 172.21.15.122:0/2394626797 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3806ec40 con 0x7f7a1c0051d0 2024-05-28T06:06:45.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36000640 1 -- 172.21.15.122:0/2394626797 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7a1c00c0a0 con 0x7f7a1c0039c0 2024-05-28T06:06:45.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a37e00640 1 --2- 172.21.15.122:0/2394626797 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a380ce560 0x7f7a380ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:45.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a37400640 1 --2- 172.21.15.122:0/2394626797 >> v2:172.21.15.153:3300/0 conn(0x7f7a38142d30 0x7f7a3806f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:45.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36a00640 1 --2- 172.21.15.122:0/2394626797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a1c004810 0x7f7a1c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a37400640 1 --2- 172.21.15.122:0/2394626797 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a1c0039c0 0x7f7a1c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a37e00640 1 --2- 172.21.15.122:0/2394626797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a1c0051d0 0x7f7a1c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36a00640 1 -- 172.21.15.122:0/2394626797 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a1c0039c0 msgr2=0x7f7a1c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:45.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36a00640 1 --2- 172.21.15.122:0/2394626797 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a1c0039c0 0x7f7a1c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36a00640 1 -- 172.21.15.122:0/2394626797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a1c0051d0 msgr2=0x7f7a1c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:45.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36a00640 1 --2- 172.21.15.122:0/2394626797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a1c0051d0 0x7f7a1c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.031+0000 7f7a36a00640 1 -- 172.21.15.122:0/2394626797 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1c003530 con 0x7f7a1c004810 2024-05-28T06:06:45.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.035+0000 7f7a36a00640 1 --2- 172.21.15.122:0/2394626797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a1c004810 0x7f7a1c004c90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400c1c0 tx=0x7f7a2401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4014230f53c417a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:45.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.035+0000 7f7a36000640 1 -- 172.21.15.122:0/2394626797 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a24007d00 con 0x7f7a1c004810 2024-05-28T06:06:45.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.035+0000 7f7a36000640 1 -- 172.21.15.122:0/2394626797 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a240a9020 con 0x7f7a1c004810 2024-05-28T06:06:45.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.035+0000 7f7a36000640 1 -- 172.21.15.122:0/2394626797 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a24005ae0 con 0x7f7a1c004810 2024-05-28T06:06:45.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.035+0000 7f7a3e800640 1 -- 172.21.15.122:0/2394626797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a1c004810 msgr2=0x7f7a1c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:45.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.035+0000 7f7a3e800640 1 --2- 172.21.15.122:0/2394626797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a1c004810 0x7f7a1c004c90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400c1c0 tx=0x7f7a2401cc30 comp rx=0 tx=0).stop 2024-05-28T06:06:45.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.035+0000 7f7a37e00640 1 -- 172.21.15.122:0/2394626797 reap_dead start 2024-05-28T06:06:45.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.035+0000 7f7a3e800640 1 -- 172.21.15.122:0/2394626797 shutdown_connections 2024-05-28T06:06:45.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.035+0000 7f7a3e800640 1 -- 172.21.15.122:0/2394626797 >> 172.21.15.122:0/2394626797 conn(0x7f7a38062a40 msgr2=0x7f7a3806b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:45.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.035+0000 7f7a3e800640 1 -- 172.21.15.122:0/2394626797 shutdown_connections 2024-05-28T06:06:45.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.035+0000 7f7a3e800640 1 -- 172.21.15.122:0/2394626797 wait complete. 2024-05-28T06:06:45.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.035+0000 7f7a3e800640 1 Processor -- start 2024-05-28T06:06:45.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.035+0000 7f7a3e800640 1 -- start start 2024-05-28T06:06:45.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a3e800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a1c004810 0x7f7a381f89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a3e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a381f8ee0 0x7f7a38139ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a3e800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a3813a010 0x7f7a3813a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a3e800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7a38146290 con 0x7f7a3813a010 2024-05-28T06:06:45.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a3e800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7a38143110 con 0x7f7a381f8ee0 2024-05-28T06:06:45.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a3e800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7a3813c760 con 0x7f7a1c004810 2024-05-28T06:06:45.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a37e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a3813a010 0x7f7a3813a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a36a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a381f8ee0 0x7f7a38139ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a37400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a1c004810 0x7f7a381f89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a37e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a3813a010 0x7f7a3813a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57582/0 (socket says 172.21.15.122:57582) 2024-05-28T06:06:45.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a37e00640 1 -- 172.21.15.122:0/418347371 learned_addr learned my addr 172.21.15.122:0/418347371 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:45.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a37e00640 1 -- 172.21.15.122:0/418347371 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a1c004810 msgr2=0x7f7a381f89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:45.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a37e00640 1 --2- 172.21.15.122:0/418347371 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a1c004810 0x7f7a381f89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a37e00640 1 -- 172.21.15.122:0/418347371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a381f8ee0 msgr2=0x7f7a38139ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:45.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a37e00640 1 --2- 172.21.15.122:0/418347371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a381f8ee0 0x7f7a38139ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a37e00640 1 -- 172.21.15.122:0/418347371 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3813ca00 con 0x7f7a3813a010 2024-05-28T06:06:45.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a37e00640 1 --2- 172.21.15.122:0/418347371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a3813a010 0x7f7a3813a540 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7a380ce940 tx=0x7f7a30007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:45.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a2f400640 1 -- 172.21.15.122:0/418347371 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3001a070 con 0x7f7a3813a010 2024-05-28T06:06:45.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a2f400640 1 -- 172.21.15.122:0/418347371 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a300153f0 con 0x7f7a3813a010 2024-05-28T06:06:45.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a3e800640 1 -- 172.21.15.122:0/418347371 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a3813cce0 con 0x7f7a3813a010 2024-05-28T06:06:45.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a2f400640 1 -- 172.21.15.122:0/418347371 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a300157c0 con 0x7f7a3813a010 2024-05-28T06:06:45.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a3e800640 1 -- 172.21.15.122:0/418347371 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a3813d2a0 con 0x7f7a3813a010 2024-05-28T06:06:45.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a3e800640 1 -- 172.21.15.122:0/418347371 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a38068bd0 con 0x7f7a3813a010 2024-05-28T06:06:45.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.039+0000 7f7a2f400640 1 -- 172.21.15.122:0/418347371 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7a3001d070 con 0x7f7a3813a010 2024-05-28T06:06:45.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.043+0000 7f7a2f400640 1 --2- 172.21.15.122:0/418347371 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7a18068380 0x7f7a1806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.043+0000 7f7a2f400640 1 -- 172.21.15.122:0/418347371 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f7a30085fc0 con 0x7f7a3813a010 2024-05-28T06:06:45.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.043+0000 7f7a37400640 1 --2- 172.21.15.122:0/418347371 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7a18068380 0x7f7a1806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.043+0000 7f7a37400640 1 --2- 172.21.15.122:0/418347371 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7a18068380 0x7f7a1806a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7a3813fb90 tx=0x7f7a28008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:45.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.047+0000 7f7a2f400640 1 -- 172.21.15.122:0/418347371 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7a30012070 con 0x7f7a3813a010 2024-05-28T06:06:45.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.259+0000 7f7a3e800640 1 -- 172.21.15.122:0/418347371 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f7a380cdd70 con 0x7f7a3813a010 2024-05-28T06:06:45.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.259+0000 7f7a2f400640 1 -- 172.21.15.122:0/418347371 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f7a300561e0 con 0x7f7a3813a010 2024-05-28T06:06:45.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.263+0000 7f7a3e800640 1 -- 172.21.15.122:0/418347371 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7a18068380 msgr2=0x7f7a1806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:45.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.263+0000 7f7a3e800640 1 --2- 172.21.15.122:0/418347371 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7a18068380 0x7f7a1806a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7a3813fb90 tx=0x7f7a28008040 comp rx=0 tx=0).stop 2024-05-28T06:06:45.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.263+0000 7f7a3e800640 1 -- 172.21.15.122:0/418347371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a3813a010 msgr2=0x7f7a3813a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:45.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.263+0000 7f7a3e800640 1 --2- 172.21.15.122:0/418347371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a3813a010 0x7f7a3813a540 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7a380ce940 tx=0x7f7a30007700 comp rx=0 tx=0).stop 2024-05-28T06:06:45.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.263+0000 7f7a3e800640 1 -- 172.21.15.122:0/418347371 shutdown_connections 2024-05-28T06:06:45.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.263+0000 7f7a3e800640 1 --2- 172.21.15.122:0/418347371 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7a18068380 0x7f7a1806a840 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.263+0000 7f7a3e800640 1 --2- 172.21.15.122:0/418347371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a3813a010 0x7f7a3813a540 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.263+0000 7f7a3e800640 1 --2- 172.21.15.122:0/418347371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a381f8ee0 0x7f7a38139ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.263+0000 7f7a3e800640 1 --2- 172.21.15.122:0/418347371 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a1c004810 0x7f7a381f89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.263+0000 7f7a3e800640 1 -- 172.21.15.122:0/418347371 >> 172.21.15.122:0/418347371 conn(0x7f7a38062a40 msgr2=0x7f7a380cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:45.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.263+0000 7f7a3e800640 1 -- 172.21.15.122:0/418347371 shutdown_connections 2024-05-28T06:06:45.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.263+0000 7f7a3e800640 1 -- 172.21.15.122:0/418347371 wait complete. 2024-05-28T06:06:45.285 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-28T06:06:45.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.419+0000 7f8d44c00640 1 Processor -- start 2024-05-28T06:06:45.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.419+0000 7f8d44c00640 1 -- start start 2024-05-28T06:06:45.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d44c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8d4015eb70 0x7f8d40070d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d44c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d400ae490 0x7f8d400b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d44c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d400b6980 con 0x7f8d4006b990 2024-05-28T06:06:45.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d44c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8d400b6190 con 0x7f8d4015eb70 2024-05-28T06:06:45.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d44c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8d400b4930 con 0x7f8d400ae490 2024-05-28T06:06:45.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3e800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f8d4006b990 0x7f8d4006fae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:49002/0 (socket says 172.21.15.122:49002) 2024-05-28T06:06:45.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3e800640 1 -- 172.21.15.122:0/2782701836 learned_addr learned my addr 172.21.15.122:0/2782701836 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:45.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3d400640 1 --2- 172.21.15.122:0/2782701836 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d400ae490 0x7f8d400b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3de00640 1 --2- 172.21.15.122:0/2782701836 >> v2:172.21.15.153:3300/0 conn(0x7f8d4015eb70 0x7f8d40070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3ca00640 1 -- 172.21.15.122:0/2782701836 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2677857644 0 0) 0x7f8d400b6980 con 0x7f8d4006b990 2024-05-28T06:06:45.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3ca00640 1 -- 172.21.15.122:0/2782701836 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d24003530 con 0x7f8d4006b990 2024-05-28T06:06:45.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3ca00640 1 -- 172.21.15.122:0/2782701836 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 484357159 0 0) 0x7f8d24003530 con 0x7f8d4006b990 2024-05-28T06:06:45.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3ca00640 1 -- 172.21.15.122:0/2782701836 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d400ae490 msgr2=0x7f8d400b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:45.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3ca00640 1 --2- 172.21.15.122:0/2782701836 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d400ae490 0x7f8d400b04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3ca00640 1 -- 172.21.15.122:0/2782701836 >> v2:172.21.15.153:3300/0 conn(0x7f8d4015eb70 msgr2=0x7f8d40070d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:45.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3ca00640 1 --2- 172.21.15.122:0/2782701836 >> v2:172.21.15.153:3300/0 conn(0x7f8d4015eb70 0x7f8d40070d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3ca00640 1 -- 172.21.15.122:0/2782701836 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d400ae8f0 con 0x7f8d4006b990 2024-05-28T06:06:45.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3ca00640 1 -- 172.21.15.122:0/2782701836 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f8d38001680 con 0x7f8d4006b990 2024-05-28T06:06:45.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3ca00640 1 -- 172.21.15.122:0/2782701836 >> v1:172.21.15.122:6789/0 conn(0x7f8d4006b990 legacy=0x7f8d4006fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:45.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3ca00640 1 --2- 172.21.15.122:0/2782701836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d240039c0 0x7f8d24003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3ca00640 1 --2- 172.21.15.122:0/2782701836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d24004810 0x7f8d24004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3ca00640 1 --2- 172.21.15.122:0/2782701836 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d400ae490 0x7f8d240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3ca00640 1 -- 172.21.15.122:0/2782701836 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8d400b4930 con 0x7f8d240039c0 2024-05-28T06:06:45.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3ca00640 1 -- 172.21.15.122:0/2782701836 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2400b9d0 con 0x7f8d24004810 2024-05-28T06:06:45.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3ca00640 1 -- 172.21.15.122:0/2782701836 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8d2400bb50 con 0x7f8d400ae490 2024-05-28T06:06:45.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3de00640 1 --2- 172.21.15.122:0/2782701836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d240039c0 0x7f8d24003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3d400640 1 --2- 172.21.15.122:0/2782701836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d24004810 0x7f8d24004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3e800640 1 --2- 172.21.15.122:0/2782701836 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d400ae490 0x7f8d240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3de00640 1 -- 172.21.15.122:0/2782701836 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d400ae490 msgr2=0x7f8d240051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:45.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3de00640 1 --2- 172.21.15.122:0/2782701836 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d400ae490 0x7f8d240051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3de00640 1 -- 172.21.15.122:0/2782701836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d24004810 msgr2=0x7f8d24004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:45.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3de00640 1 --2- 172.21.15.122:0/2782701836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d24004810 0x7f8d24004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.423+0000 7f8d3de00640 1 -- 172.21.15.122:0/2782701836 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d24003530 con 0x7f8d240039c0 2024-05-28T06:06:45.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.427+0000 7f8d3de00640 1 --2- 172.21.15.122:0/2782701836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d240039c0 0x7f8d24003de0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009fc0 tx=0x7f8d3001cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0c0acbf1044eff server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:45.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.427+0000 7f8d3ca00640 1 -- 172.21.15.122:0/2782701836 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d300b2070 con 0x7f8d240039c0 2024-05-28T06:06:45.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.427+0000 7f8d3ca00640 1 -- 172.21.15.122:0/2782701836 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d300a5ba0 con 0x7f8d240039c0 2024-05-28T06:06:45.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.427+0000 7f8d3ca00640 1 -- 172.21.15.122:0/2782701836 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d30009c10 con 0x7f8d240039c0 2024-05-28T06:06:45.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.427+0000 7f8d44c00640 1 -- 172.21.15.122:0/2782701836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d240039c0 msgr2=0x7f8d24003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:45.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.427+0000 7f8d44c00640 1 --2- 172.21.15.122:0/2782701836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d240039c0 0x7f8d24003de0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009fc0 tx=0x7f8d3001cc90 comp rx=0 tx=0).stop 2024-05-28T06:06:45.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.427+0000 7f8d3e800640 1 -- 172.21.15.122:0/2782701836 reap_dead start 2024-05-28T06:06:45.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.427+0000 7f8d44c00640 1 -- 172.21.15.122:0/2782701836 shutdown_connections 2024-05-28T06:06:45.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.427+0000 7f8d44c00640 1 -- 172.21.15.122:0/2782701836 >> 172.21.15.122:0/2782701836 conn(0x7f8d40073570 msgr2=0x7f8d4009aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:45.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.427+0000 7f8d44c00640 1 -- 172.21.15.122:0/2782701836 shutdown_connections 2024-05-28T06:06:45.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.427+0000 7f8d44c00640 1 -- 172.21.15.122:0/2782701836 wait complete. 2024-05-28T06:06:45.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.427+0000 7f8d44c00640 1 Processor -- start 2024-05-28T06:06:45.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.427+0000 7f8d44c00640 1 -- start start 2024-05-28T06:06:45.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d44c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d240039c0 0x7f8d40155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d44c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d4015b8b0 0x7f8d400b1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d44c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d4015bd30 0x7f8d400b1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d44c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8d40070600 con 0x7f8d4015b8b0 2024-05-28T06:06:45.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d44c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8d400b08f0 con 0x7f8d240039c0 2024-05-28T06:06:45.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d44c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8d4006bda0 con 0x7f8d4015bd30 2024-05-28T06:06:45.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d3d400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d4015b8b0 0x7f8d400b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d3d400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d4015b8b0 0x7f8d400b1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57592/0 (socket says 172.21.15.122:57592) 2024-05-28T06:06:45.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d3d400640 1 -- 172.21.15.122:0/684291240 learned_addr learned my addr 172.21.15.122:0/684291240 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:45.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d3de00640 1 --2- 172.21.15.122:0/684291240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d240039c0 0x7f8d40155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d3e800640 1 --2- 172.21.15.122:0/684291240 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d4015bd30 0x7f8d400b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d3d400640 1 -- 172.21.15.122:0/684291240 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d4015bd30 msgr2=0x7f8d400b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:45.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d3d400640 1 --2- 172.21.15.122:0/684291240 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d4015bd30 0x7f8d400b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d3d400640 1 -- 172.21.15.122:0/684291240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d240039c0 msgr2=0x7f8d40155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:45.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d3d400640 1 --2- 172.21.15.122:0/684291240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d240039c0 0x7f8d40155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d3d400640 1 -- 172.21.15.122:0/684291240 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d400b3520 con 0x7f8d4015b8b0 2024-05-28T06:06:45.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d3de00640 1 --2- 172.21.15.122:0/684291240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d240039c0 0x7f8d40155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:45.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d3d400640 1 --2- 172.21.15.122:0/684291240 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d4015b8b0 0x7f8d400b1120 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c0119c0 tx=0x7f8d2c011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:45.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d36000640 1 -- 172.21.15.122:0/684291240 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c00fa90 con 0x7f8d4015b8b0 2024-05-28T06:06:45.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d36000640 1 -- 172.21.15.122:0/684291240 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d2c00fc30 con 0x7f8d4015b8b0 2024-05-28T06:06:45.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d44c00640 1 -- 172.21.15.122:0/684291240 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d400b3800 con 0x7f8d4015b8b0 2024-05-28T06:06:45.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d36000640 1 -- 172.21.15.122:0/684291240 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c014440 con 0x7f8d4015b8b0 2024-05-28T06:06:45.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d44c00640 1 -- 172.21.15.122:0/684291240 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d400b3dc0 con 0x7f8d4015b8b0 2024-05-28T06:06:45.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d44c00640 1 -- 172.21.15.122:0/684291240 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d40068bd0 con 0x7f8d4015b8b0 2024-05-28T06:06:45.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.431+0000 7f8d36000640 1 -- 172.21.15.122:0/684291240 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8d2c012040 con 0x7f8d4015b8b0 2024-05-28T06:06:45.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.435+0000 7f8d36000640 1 --2- 172.21.15.122:0/684291240 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8d20068380 0x7f8d2006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.435+0000 7f8d36000640 1 -- 172.21.15.122:0/684291240 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f8d2c086c80 con 0x7f8d4015b8b0 2024-05-28T06:06:45.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.435+0000 7f8d3de00640 1 --2- 172.21.15.122:0/684291240 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8d20068380 0x7f8d2006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.435+0000 7f8d3de00640 1 --2- 172.21.15.122:0/684291240 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8d20068380 0x7f8d2006a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8d300af000 tx=0x7f8d300a7040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:45.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.439+0000 7f8d36000640 1 -- 172.21.15.122:0/684291240 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8d2c019030 con 0x7f8d4015b8b0 2024-05-28T06:06:45.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.651+0000 7f8d44c00640 1 -- 172.21.15.122:0/684291240 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f8d401575b0 con 0x7f8d4015b8b0 2024-05-28T06:06:45.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.651+0000 7f8d36000640 1 -- 172.21.15.122:0/684291240 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f8d2c057580 con 0x7f8d4015b8b0 2024-05-28T06:06:45.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.655+0000 7f8d44c00640 1 -- 172.21.15.122:0/684291240 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8d20068380 msgr2=0x7f8d2006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:45.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.655+0000 7f8d44c00640 1 --2- 172.21.15.122:0/684291240 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8d20068380 0x7f8d2006a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8d300af000 tx=0x7f8d300a7040 comp rx=0 tx=0).stop 2024-05-28T06:06:45.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.655+0000 7f8d44c00640 1 -- 172.21.15.122:0/684291240 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d4015b8b0 msgr2=0x7f8d400b1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:45.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.655+0000 7f8d44c00640 1 --2- 172.21.15.122:0/684291240 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d4015b8b0 0x7f8d400b1120 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c0119c0 tx=0x7f8d2c011e80 comp rx=0 tx=0).stop 2024-05-28T06:06:45.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.655+0000 7f8d44c00640 1 -- 172.21.15.122:0/684291240 shutdown_connections 2024-05-28T06:06:45.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.655+0000 7f8d44c00640 1 --2- 172.21.15.122:0/684291240 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8d20068380 0x7f8d2006a840 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.655+0000 7f8d44c00640 1 --2- 172.21.15.122:0/684291240 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d4015bd30 0x7f8d400b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.655+0000 7f8d44c00640 1 --2- 172.21.15.122:0/684291240 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d4015b8b0 0x7f8d400b1120 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.655+0000 7f8d44c00640 1 --2- 172.21.15.122:0/684291240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d240039c0 0x7f8d40155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.655+0000 7f8d44c00640 1 -- 172.21.15.122:0/684291240 >> 172.21.15.122:0/684291240 conn(0x7f8d40073570 msgr2=0x7f8d4009aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:45.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.655+0000 7f8d44c00640 1 -- 172.21.15.122:0/684291240 shutdown_connections 2024-05-28T06:06:45.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.655+0000 7f8d44c00640 1 -- 172.21.15.122:0/684291240 wait complete. 2024-05-28T06:06:45.678 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-28T06:06:45.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.811+0000 7efe03800640 1 Processor -- start 2024-05-28T06:06:45.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.811+0000 7efe03800640 1 -- start start 2024-05-28T06:06:45.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.815+0000 7efe03800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efdfc159280 0x7efdfc0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.815+0000 7efe03800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efdfc15c7a0 0x7efdfc06f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.815+0000 7efe03800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdfc0b54d0 con 0x7efdfc0cced0 2024-05-28T06:06:45.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.815+0000 7efe03800640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7efdfc15c310 con 0x7efdfc159280 2024-05-28T06:06:45.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.815+0000 7efe03800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7efdfc0b57b0 con 0x7efdfc15c7a0 2024-05-28T06:06:45.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.815+0000 7efe00e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efdfc159280 0x7efdfc0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.815+0000 7efe01800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7efdfc0cced0 0x7efdfc0cd300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:43866/0 (socket says 172.21.15.122:43866) 2024-05-28T06:06:45.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.815+0000 7efe01800640 1 -- 172.21.15.122:0/532637714 learned_addr learned my addr 172.21.15.122:0/532637714 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:45.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.815+0000 7efdf3e00640 1 --2- 172.21.15.122:0/532637714 >> v2:172.21.15.153:3300/0 conn(0x7efdfc15c7a0 0x7efdfc06f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.815+0000 7efe00e00640 1 -- 172.21.15.122:0/532637714 >> v2:172.21.15.153:3300/0 conn(0x7efdfc15c7a0 msgr2=0x7efdfc06f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:45.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.815+0000 7efe00e00640 1 --2- 172.21.15.122:0/532637714 >> v2:172.21.15.153:3300/0 conn(0x7efdfc15c7a0 0x7efdfc06f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.815+0000 7efe00e00640 1 -- 172.21.15.122:0/532637714 >> v1:172.21.15.122:6789/0 conn(0x7efdfc0cced0 legacy=0x7efdfc0cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:45.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.815+0000 7efe00e00640 1 -- 172.21.15.122:0/532637714 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdfc15bfa0 con 0x7efdfc159280 2024-05-28T06:06:45.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.819+0000 7efe00e00640 1 --2- 172.21.15.122:0/532637714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdfc159280 0x7efdfc0b4e10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0731f0 tx=0x7efdec01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e6dd2bcbec3c8c server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:45.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.819+0000 7efdfbe00640 1 -- 172.21.15.122:0/532637714 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec0b0070 con 0x7efdfc159280 2024-05-28T06:06:45.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.819+0000 7efdfbe00640 1 -- 172.21.15.122:0/532637714 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdec0ab600 con 0x7efdfc159280 2024-05-28T06:06:45.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.819+0000 7efdfbe00640 1 -- 172.21.15.122:0/532637714 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec0ab9d0 con 0x7efdfc159280 2024-05-28T06:06:45.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.819+0000 7efe03800640 1 -- 172.21.15.122:0/532637714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdfc159280 msgr2=0x7efdfc0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:45.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.819+0000 7efe03800640 1 --2- 172.21.15.122:0/532637714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdfc159280 0x7efdfc0b4e10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0731f0 tx=0x7efdec01c480 comp rx=0 tx=0).stop 2024-05-28T06:06:45.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.819+0000 7efe03800640 1 -- 172.21.15.122:0/532637714 shutdown_connections 2024-05-28T06:06:45.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.819+0000 7efe03800640 1 --2- 172.21.15.122:0/532637714 >> v2:172.21.15.153:3300/0 conn(0x7efdfc15c7a0 0x7efdfc06f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.819+0000 7efe03800640 1 --2- 172.21.15.122:0/532637714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdfc159280 0x7efdfc0b4e10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.819+0000 7efe03800640 1 -- 172.21.15.122:0/532637714 >> 172.21.15.122:0/532637714 conn(0x7efdfc062a40 msgr2=0x7efdfc06b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:45.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.819+0000 7efe03800640 1 -- 172.21.15.122:0/532637714 shutdown_connections 2024-05-28T06:06:45.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.819+0000 7efe03800640 1 -- 172.21.15.122:0/532637714 wait complete. 2024-05-28T06:06:45.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.819+0000 7efe03800640 1 Processor -- start 2024-05-28T06:06:45.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.819+0000 7efe03800640 1 -- start start 2024-05-28T06:06:45.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efe03800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdfc0cced0 0x7efdfc158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efe03800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdfc159280 0x7efdfc1334d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efe03800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdfc15c7a0 0x7efdfc0b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efe03800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc15fd10 con 0x7efdfc159280 2024-05-28T06:06:45.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efe03800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc15fb90 con 0x7efdfc15c7a0 2024-05-28T06:06:45.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efe03800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efdfc15fe90 con 0x7efdfc0cced0 2024-05-28T06:06:45.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efdf3e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdfc159280 0x7efdfc1334d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efdf3e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdfc159280 0x7efdfc1334d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59730/0 (socket says 172.21.15.122:59730) 2024-05-28T06:06:45.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efdf3e00640 1 -- 172.21.15.122:0/4271313451 learned_addr learned my addr 172.21.15.122:0/4271313451 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:45.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efe00e00640 1 --2- 172.21.15.122:0/4271313451 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdfc0cced0 0x7efdfc158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efe01800640 1 --2- 172.21.15.122:0/4271313451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdfc15c7a0 0x7efdfc0b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efdf3e00640 1 -- 172.21.15.122:0/4271313451 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdfc0cced0 msgr2=0x7efdfc158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:45.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efdf3e00640 1 --2- 172.21.15.122:0/4271313451 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdfc0cced0 0x7efdfc158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efdf3e00640 1 -- 172.21.15.122:0/4271313451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdfc15c7a0 msgr2=0x7efdfc0b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:45.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efdf3e00640 1 --2- 172.21.15.122:0/4271313451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdfc15c7a0 0x7efdfc0b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:45.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efdf3e00640 1 -- 172.21.15.122:0/4271313451 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdfc158580 con 0x7efdfc159280 2024-05-28T06:06:45.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efe01800640 1 --2- 172.21.15.122:0/4271313451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdfc15c7a0 0x7efdfc0b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:45.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efdf3e00640 1 --2- 172.21.15.122:0/4271313451 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdfc159280 0x7efdfc1334d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7efde400e960 tx=0x7efde400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:45.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efdf9600640 1 -- 172.21.15.122:0/4271313451 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde4017070 con 0x7efdfc159280 2024-05-28T06:06:45.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efdf9600640 1 -- 172.21.15.122:0/4271313451 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efde400ca00 con 0x7efdfc159280 2024-05-28T06:06:45.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efe03800640 1 -- 172.21.15.122:0/4271313451 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdfc0aa1d0 con 0x7efdfc159280 2024-05-28T06:06:45.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efdf9600640 1 -- 172.21.15.122:0/4271313451 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde400cdb0 con 0x7efdfc159280 2024-05-28T06:06:45.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efe03800640 1 -- 172.21.15.122:0/4271313451 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdfc0b1fd0 con 0x7efdfc159280 2024-05-28T06:06:45.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efe03800640 1 -- 172.21.15.122:0/4271313451 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdfc068bd0 con 0x7efdfc159280 2024-05-28T06:06:45.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.823+0000 7efdf9600640 1 -- 172.21.15.122:0/4271313451 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efde401a070 con 0x7efdfc159280 2024-05-28T06:06:45.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.827+0000 7efdf9600640 1 --2- 172.21.15.122:0/4271313451 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdd8068380 0x7efdd806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:45.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.827+0000 7efdf9600640 1 -- 172.21.15.122:0/4271313451 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7efde40869c0 con 0x7efdfc159280 2024-05-28T06:06:45.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.827+0000 7efe00e00640 1 --2- 172.21.15.122:0/4271313451 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdd8068380 0x7efdd806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:45.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.827+0000 7efe00e00640 1 --2- 172.21.15.122:0/4271313451 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdd8068380 0x7efdd806a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efdec0ad000 tx=0x7efdec0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:45.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:45.831+0000 7efdf9600640 1 -- 172.21.15.122:0/4271313451 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efde4056c70 con 0x7efdfc159280 2024-05-28T06:06:46.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.047+0000 7efe03800640 1 -- 172.21.15.122:0/4271313451 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7efdfc06bb30 con 0x7efdfc159280 2024-05-28T06:06:46.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.047+0000 7efdf9600640 1 -- 172.21.15.122:0/4271313451 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7efde405af70 con 0x7efdfc159280 2024-05-28T06:06:46.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.051+0000 7efe03800640 1 -- 172.21.15.122:0/4271313451 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdd8068380 msgr2=0x7efdd806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:46.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.051+0000 7efe03800640 1 --2- 172.21.15.122:0/4271313451 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdd8068380 0x7efdd806a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efdec0ad000 tx=0x7efdec0a6000 comp rx=0 tx=0).stop 2024-05-28T06:06:46.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.051+0000 7efe03800640 1 -- 172.21.15.122:0/4271313451 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdfc159280 msgr2=0x7efdfc1334d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:46.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.051+0000 7efe03800640 1 --2- 172.21.15.122:0/4271313451 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdfc159280 0x7efdfc1334d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7efde400e960 tx=0x7efde400ee20 comp rx=0 tx=0).stop 2024-05-28T06:06:46.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.051+0000 7efe03800640 1 -- 172.21.15.122:0/4271313451 shutdown_connections 2024-05-28T06:06:46.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.051+0000 7efe03800640 1 --2- 172.21.15.122:0/4271313451 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdd8068380 0x7efdd806a840 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.051+0000 7efe03800640 1 --2- 172.21.15.122:0/4271313451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdfc15c7a0 0x7efdfc0b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.051+0000 7efe03800640 1 --2- 172.21.15.122:0/4271313451 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdfc159280 0x7efdfc1334d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.051+0000 7efe03800640 1 --2- 172.21.15.122:0/4271313451 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdfc0cced0 0x7efdfc158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.051+0000 7efe03800640 1 -- 172.21.15.122:0/4271313451 >> 172.21.15.122:0/4271313451 conn(0x7efdfc062a40 msgr2=0x7efdfc0cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:46.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.051+0000 7efe03800640 1 -- 172.21.15.122:0/4271313451 shutdown_connections 2024-05-28T06:06:46.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.051+0000 7efe03800640 1 -- 172.21.15.122:0/4271313451 wait complete. 2024-05-28T06:06:46.072 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-28T06:06:46.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.211+0000 7efff3600640 1 Processor -- start 2024-05-28T06:06:46.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.211+0000 7efff3600640 1 -- start start 2024-05-28T06:06:46.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.211+0000 7efff3600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7effec145b80 0x7effec146010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:46.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.211+0000 7efff3600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7effec0ce560 0x7effec0ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:46.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.211+0000 7efff3600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effec06f7e0 con 0x7effec142d30 2024-05-28T06:06:46.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.211+0000 7efff3600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7effec06ec40 con 0x7effec0ce560 2024-05-28T06:06:46.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.211+0000 7efff3600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7effec0ceed0 con 0x7effec145b80 2024-05-28T06:06:46.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.211+0000 7efff1600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7effec0ce560 0x7effec0ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:46.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.211+0000 7efff0c00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7effec142d30 0x7effec06f0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:43880/0 (socket says 172.21.15.122:43880) 2024-05-28T06:06:46.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.211+0000 7efff0c00640 1 -- 172.21.15.122:0/2570403171 learned_addr learned my addr 172.21.15.122:0/2570403171 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:46.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.211+0000 7efff1600640 1 -- 172.21.15.122:0/2570403171 >> v2:172.21.15.153:3300/0 conn(0x7effec145b80 msgr2=0x7effec146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:46.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.211+0000 7effe3e00640 1 --2- 172.21.15.122:0/2570403171 >> v2:172.21.15.153:3300/0 conn(0x7effec145b80 0x7effec146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:46.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.211+0000 7efff1600640 1 --2- 172.21.15.122:0/2570403171 >> v2:172.21.15.153:3300/0 conn(0x7effec145b80 0x7effec146010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.211+0000 7efff1600640 1 -- 172.21.15.122:0/2570403171 >> v1:172.21.15.122:6789/0 conn(0x7effec142d30 legacy=0x7effec06f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:46.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.211+0000 7effebe00640 1 -- 172.21.15.122:0/2570403171 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2015904947 0 0) 0x7effec06f7e0 con 0x7effec142d30 2024-05-28T06:06:46.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.211+0000 7efff1600640 1 -- 172.21.15.122:0/2570403171 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effec06e030 con 0x7effec0ce560 2024-05-28T06:06:46.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.211+0000 7effe3e00640 1 --2- 172.21.15.122:0/2570403171 >> v2:172.21.15.153:3300/0 conn(0x7effec145b80 0x7effec146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:46.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.215+0000 7efff1600640 1 --2- 172.21.15.122:0/2570403171 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effec0ce560 0x7effec0ce990 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7effec070420 tx=0x7effe401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d355ffcc1c43b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:46.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.215+0000 7effebe00640 1 -- 172.21.15.122:0/2570403171 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe40b2070 con 0x7effec0ce560 2024-05-28T06:06:46.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.215+0000 7effebe00640 1 -- 172.21.15.122:0/2570403171 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effe40a5930 con 0x7effec0ce560 2024-05-28T06:06:46.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.215+0000 7effebe00640 1 -- 172.21.15.122:0/2570403171 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe40a5d00 con 0x7effec0ce560 2024-05-28T06:06:46.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.215+0000 7efff3600640 1 -- 172.21.15.122:0/2570403171 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effec0ce560 msgr2=0x7effec0ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:46.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.215+0000 7efff3600640 1 --2- 172.21.15.122:0/2570403171 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effec0ce560 0x7effec0ce990 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7effec070420 tx=0x7effe401c870 comp rx=0 tx=0).stop 2024-05-28T06:06:46.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.215+0000 7efff3600640 1 -- 172.21.15.122:0/2570403171 shutdown_connections 2024-05-28T06:06:46.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.215+0000 7efff3600640 1 --2- 172.21.15.122:0/2570403171 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effec0ce560 0x7effec0ce990 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.215+0000 7efff3600640 1 --2- 172.21.15.122:0/2570403171 >> v2:172.21.15.153:3300/0 conn(0x7effec145b80 0x7effec146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.215+0000 7efff3600640 1 -- 172.21.15.122:0/2570403171 >> 172.21.15.122:0/2570403171 conn(0x7effec062a40 msgr2=0x7effec06b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:46.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.215+0000 7efff3600640 1 -- 172.21.15.122:0/2570403171 shutdown_connections 2024-05-28T06:06:46.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.215+0000 7efff3600640 1 -- 172.21.15.122:0/2570403171 wait complete. 2024-05-28T06:06:46.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.215+0000 7efff3600640 1 Processor -- start 2024-05-28T06:06:46.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7efff3600640 1 -- start start 2024-05-28T06:06:46.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7efff3600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effec0ce560 0x7effec13ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:46.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7efff3600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7effec142d30 0x7effec15f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:46.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7efff3600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7effec145b80 0x7effec13e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:46.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7efff3600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7effec143110 con 0x7effec0ce560 2024-05-28T06:06:46.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7efff3600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7effec161330 con 0x7effec145b80 2024-05-28T06:06:46.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7efff3600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7effec143290 con 0x7effec142d30 2024-05-28T06:06:46.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7efff0c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effec0ce560 0x7effec13ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:46.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7efff0c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effec0ce560 0x7effec13ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59744/0 (socket says 172.21.15.122:59744) 2024-05-28T06:06:46.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7efff0c00640 1 -- 172.21.15.122:0/4091714053 learned_addr learned my addr 172.21.15.122:0/4091714053 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:46.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7effe3e00640 1 --2- 172.21.15.122:0/4091714053 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7effec142d30 0x7effec15f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:46.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7efff1600640 1 --2- 172.21.15.122:0/4091714053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7effec145b80 0x7effec13e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:46.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7efff0c00640 1 -- 172.21.15.122:0/4091714053 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7effec142d30 msgr2=0x7effec15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:46.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7efff0c00640 1 --2- 172.21.15.122:0/4091714053 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7effec142d30 0x7effec15f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7efff0c00640 1 -- 172.21.15.122:0/4091714053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7effec145b80 msgr2=0x7effec13e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:46.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7efff0c00640 1 --2- 172.21.15.122:0/4091714053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7effec145b80 0x7effec13e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7efff0c00640 1 -- 172.21.15.122:0/4091714053 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effec15c400 con 0x7effec0ce560 2024-05-28T06:06:46.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7efff0c00640 1 --2- 172.21.15.122:0/4091714053 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effec0ce560 0x7effec13ae20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7effdc0011f0 tx=0x7effdc00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:46.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7effe9600640 1 -- 172.21.15.122:0/4091714053 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc018070 con 0x7effec0ce560 2024-05-28T06:06:46.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7effe9600640 1 -- 172.21.15.122:0/4091714053 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effdc0074e0 con 0x7effec0ce560 2024-05-28T06:06:46.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7effe9600640 1 -- 172.21.15.122:0/4091714053 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc004a10 con 0x7effec0ce560 2024-05-28T06:06:46.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7efff3600640 1 -- 172.21.15.122:0/4091714053 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effec15b070 con 0x7effec0ce560 2024-05-28T06:06:46.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7efff3600640 1 -- 172.21.15.122:0/4091714053 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effec15b630 con 0x7effec0ce560 2024-05-28T06:06:46.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.219+0000 7efff3600640 1 -- 172.21.15.122:0/4091714053 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effec068bd0 con 0x7effec0ce560 2024-05-28T06:06:46.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.223+0000 7effe9600640 1 -- 172.21.15.122:0/4091714053 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7effdc004bb0 con 0x7effec0ce560 2024-05-28T06:06:46.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.223+0000 7effe9600640 1 --2- 172.21.15.122:0/4091714053 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7effc8068380 0x7effc806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:46.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.223+0000 7effe9600640 1 -- 172.21.15.122:0/4091714053 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7effdc0858d0 con 0x7effec0ce560 2024-05-28T06:06:46.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.223+0000 7effe3e00640 1 --2- 172.21.15.122:0/4091714053 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7effc8068380 0x7effc806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:46.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.223+0000 7effe3e00640 1 --2- 172.21.15.122:0/4091714053 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7effc8068380 0x7effc806a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7effd4006fd0 tx=0x7effd4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:46.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.227+0000 7effe9600640 1 -- 172.21.15.122:0/4091714053 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7effdc056270 con 0x7effec0ce560 2024-05-28T06:06:46.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.435+0000 7efff3600640 1 -- 172.21.15.122:0/4091714053 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7effec0cdd70 con 0x7effec0ce560 2024-05-28T06:06:46.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.439+0000 7effe9600640 1 -- 172.21.15.122:0/4091714053 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7effdc055b70 con 0x7effec0ce560 2024-05-28T06:06:46.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.439+0000 7efff3600640 1 -- 172.21.15.122:0/4091714053 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7effc8068380 msgr2=0x7effc806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:46.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.439+0000 7efff3600640 1 --2- 172.21.15.122:0/4091714053 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7effc8068380 0x7effc806a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7effd4006fd0 tx=0x7effd4008040 comp rx=0 tx=0).stop 2024-05-28T06:06:46.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.439+0000 7efff3600640 1 -- 172.21.15.122:0/4091714053 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effec0ce560 msgr2=0x7effec13ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:46.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.439+0000 7efff3600640 1 --2- 172.21.15.122:0/4091714053 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effec0ce560 0x7effec13ae20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7effdc0011f0 tx=0x7effdc00c9b0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.443+0000 7efff3600640 1 -- 172.21.15.122:0/4091714053 shutdown_connections 2024-05-28T06:06:46.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.443+0000 7efff3600640 1 --2- 172.21.15.122:0/4091714053 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7effc8068380 0x7effc806a840 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.443+0000 7efff3600640 1 --2- 172.21.15.122:0/4091714053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7effec145b80 0x7effec13e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.443+0000 7efff3600640 1 --2- 172.21.15.122:0/4091714053 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7effec142d30 0x7effec15f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.443+0000 7efff3600640 1 --2- 172.21.15.122:0/4091714053 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effec0ce560 0x7effec13ae20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.443+0000 7efff3600640 1 -- 172.21.15.122:0/4091714053 >> 172.21.15.122:0/4091714053 conn(0x7effec062a40 msgr2=0x7effec0b1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:46.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.443+0000 7efff3600640 1 -- 172.21.15.122:0/4091714053 shutdown_connections 2024-05-28T06:06:46.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.443+0000 7efff3600640 1 -- 172.21.15.122:0/4091714053 wait complete. 2024-05-28T06:06:46.463 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:06:46.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.595+0000 7f15c1600640 1 Processor -- start 2024-05-28T06:06:46.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.595+0000 7f15c1600640 1 -- start start 2024-05-28T06:06:46.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.599+0000 7f15c1600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f15bc15f740 0x7f15bc167240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:46.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.599+0000 7f15c1600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15bc15d970 con 0x7f15bc0ce4f0 2024-05-28T06:06:46.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.599+0000 7f15c1600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15bc15dc50 con 0x7f15bc0b58d0 2024-05-28T06:06:46.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.599+0000 7f15c1600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f15bc15df30 con 0x7f15bc15f740 2024-05-28T06:06:46.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.599+0000 7f15b2000640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f15bc0ce4f0 0x7f15bc0ce980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:43896/0 (socket says 172.21.15.122:43896) 2024-05-28T06:06:46.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.599+0000 7f15b2000640 1 -- 172.21.15.122:0/3643582557 learned_addr learned my addr 172.21.15.122:0/3643582557 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:46.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.599+0000 7f15bb400640 1 --2- 172.21.15.122:0/3643582557 >> v2:172.21.15.122:3300/0 conn(0x7f15bc15f740 0x7f15bc167240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:46.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.599+0000 7f15bb400640 1 -- 172.21.15.122:0/3643582557 >> v1:172.21.15.153:6789/0 conn(0x7f15bc0b58d0 legacy=0x7f15bc0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:46.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.599+0000 7f15bb400640 1 -- 172.21.15.122:0/3643582557 >> v1:172.21.15.122:6789/0 conn(0x7f15bc0ce4f0 legacy=0x7f15bc0ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:46.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.599+0000 7f15bb400640 1 -- 172.21.15.122:0/3643582557 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15bc15e210 con 0x7f15bc15f740 2024-05-28T06:06:46.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.599+0000 7f15ba000640 1 -- 172.21.15.122:0/3643582557 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3320671604 0 0) 0x7f15bc15d970 con 0x7f15bc0ce4f0 2024-05-28T06:06:46.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.603+0000 7f15bb400640 1 --2- 172.21.15.122:0/3643582557 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15bc15f740 0x7f15bc167240 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f15b40097c0 tx=0x7f15b401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11498b72a19e39fb server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:46.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.603+0000 7f15ba000640 1 -- 172.21.15.122:0/3643582557 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b40b0070 con 0x7f15bc15f740 2024-05-28T06:06:46.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.603+0000 7f15ba000640 1 -- 172.21.15.122:0/3643582557 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15b40ab600 con 0x7f15bc15f740 2024-05-28T06:06:46.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.603+0000 7f15ba000640 1 -- 172.21.15.122:0/3643582557 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b40ab9d0 con 0x7f15bc15f740 2024-05-28T06:06:46.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.603+0000 7f15c1600640 1 -- 172.21.15.122:0/3643582557 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15bc15f740 msgr2=0x7f15bc167240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:46.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.603+0000 7f15c1600640 1 --2- 172.21.15.122:0/3643582557 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15bc15f740 0x7f15bc167240 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f15b40097c0 tx=0x7f15b401c4a0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.603+0000 7f15c1600640 1 -- 172.21.15.122:0/3643582557 shutdown_connections 2024-05-28T06:06:46.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.603+0000 7f15c1600640 1 --2- 172.21.15.122:0/3643582557 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15bc15f740 0x7f15bc167240 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.603+0000 7f15c1600640 1 -- 172.21.15.122:0/3643582557 >> 172.21.15.122:0/3643582557 conn(0x7f15bc06bd90 msgr2=0x7f15bc06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:46.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.603+0000 7f15c1600640 1 -- 172.21.15.122:0/3643582557 shutdown_connections 2024-05-28T06:06:46.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.603+0000 7f15c1600640 1 -- 172.21.15.122:0/3643582557 wait complete. 2024-05-28T06:06:46.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.603+0000 7f15c1600640 1 Processor -- start 2024-05-28T06:06:46.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.603+0000 7f15c1600640 1 -- start start 2024-05-28T06:06:46.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.603+0000 7f15c1600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15bc0b58d0 0x7f15bc0aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:46.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.607+0000 7f15c1600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f15bc0ce4f0 0x7f15bc13c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:46.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.607+0000 7f15c1600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15bc15f740 0x7f15bc13ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:46.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.607+0000 7f15c1600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f15bc16a330 con 0x7f15bc0b58d0 2024-05-28T06:06:46.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.607+0000 7f15c1600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f15bc16a1b0 con 0x7f15bc15f740 2024-05-28T06:06:46.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.607+0000 7f15c1600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f15bc16a4b0 con 0x7f15bc0ce4f0 2024-05-28T06:06:46.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.607+0000 7f15baa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15bc0b58d0 0x7f15bc0aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:46.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.607+0000 7f15baa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15bc0b58d0 0x7f15bc0aeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59758/0 (socket says 172.21.15.122:59758) 2024-05-28T06:06:46.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.607+0000 7f15baa00640 1 -- 172.21.15.122:0/4088307923 learned_addr learned my addr 172.21.15.122:0/4088307923 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:46.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.607+0000 7f15b2000640 1 --2- 172.21.15.122:0/4088307923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f15bc0ce4f0 0x7f15bc13c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:46.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.607+0000 7f15bb400640 1 --2- 172.21.15.122:0/4088307923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15bc15f740 0x7f15bc13ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:46.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.607+0000 7f15baa00640 1 -- 172.21.15.122:0/4088307923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f15bc0ce4f0 msgr2=0x7f15bc13c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:46.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.607+0000 7f15baa00640 1 --2- 172.21.15.122:0/4088307923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f15bc0ce4f0 0x7f15bc13c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.607+0000 7f15baa00640 1 -- 172.21.15.122:0/4088307923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15bc15f740 msgr2=0x7f15bc13ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:46.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.607+0000 7f15baa00640 1 --2- 172.21.15.122:0/4088307923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15bc15f740 0x7f15bc13ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.607+0000 7f15baa00640 1 -- 172.21.15.122:0/4088307923 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15bc13d6f0 con 0x7f15bc0b58d0 2024-05-28T06:06:46.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.607+0000 7f15baa00640 1 --2- 172.21.15.122:0/4088307923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15bc0b58d0 0x7f15bc0aeca0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00c7f0 tx=0x7f15ac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:46.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.607+0000 7f15b3400640 1 -- 172.21.15.122:0/4088307923 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ac003b80 con 0x7f15bc0b58d0 2024-05-28T06:06:46.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.607+0000 7f15b3400640 1 -- 172.21.15.122:0/4088307923 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15ac003d20 con 0x7f15bc0b58d0 2024-05-28T06:06:46.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.607+0000 7f15c1600640 1 -- 172.21.15.122:0/4088307923 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15bc13d9d0 con 0x7f15bc0b58d0 2024-05-28T06:06:46.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.607+0000 7f15b3400640 1 -- 172.21.15.122:0/4088307923 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ac00aa90 con 0x7f15bc0b58d0 2024-05-28T06:06:46.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.607+0000 7f15c1600640 1 -- 172.21.15.122:0/4088307923 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15bc13df90 con 0x7f15bc0b58d0 2024-05-28T06:06:46.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.607+0000 7f15c1600640 1 -- 172.21.15.122:0/4088307923 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15bc068c40 con 0x7f15bc0b58d0 2024-05-28T06:06:46.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.607+0000 7f15b3400640 1 -- 172.21.15.122:0/4088307923 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f15ac00ac30 con 0x7f15bc0b58d0 2024-05-28T06:06:46.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.611+0000 7f15b3400640 1 --2- 172.21.15.122:0/4088307923 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1598068380 0x7f159806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:46.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.611+0000 7f15b3400640 1 -- 172.21.15.122:0/4088307923 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f15ac086570 con 0x7f15bc0b58d0 2024-05-28T06:06:46.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.611+0000 7f15b2000640 1 --2- 172.21.15.122:0/4088307923 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1598068380 0x7f159806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:46.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.611+0000 7f15b2000640 1 --2- 172.21.15.122:0/4088307923 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1598068380 0x7f159806a840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f15a4007fd0 tx=0x7f15a4007ba0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:46.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.615+0000 7f15b3400640 1 -- 172.21.15.122:0/4088307923 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f15ac056f10 con 0x7f15bc0b58d0 2024-05-28T06:06:46.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.779+0000 7f15c1600640 1 -- 172.21.15.122:0/4088307923 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15bc0cee70 con 0x7f15bc0b58d0 2024-05-28T06:06:46.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.779+0000 7f15b3400640 1 -- 172.21.15.122:0/4088307923 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+12891 (secure 0 0 0) 0x7f15ac056810 con 0x7f15bc0b58d0 2024-05-28T06:06:46.783 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:46.783 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":30,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:06:43.682853+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:06:46.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.783+0000 7f15c1600640 1 -- 172.21.15.122:0/4088307923 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1598068380 msgr2=0x7f159806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:46.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.783+0000 7f15c1600640 1 --2- 172.21.15.122:0/4088307923 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1598068380 0x7f159806a840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f15a4007fd0 tx=0x7f15a4007ba0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.783+0000 7f15c1600640 1 -- 172.21.15.122:0/4088307923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15bc0b58d0 msgr2=0x7f15bc0aeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:46.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.783+0000 7f15c1600640 1 --2- 172.21.15.122:0/4088307923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15bc0b58d0 0x7f15bc0aeca0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00c7f0 tx=0x7f15ac00ccb0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.783+0000 7f15c1600640 1 -- 172.21.15.122:0/4088307923 shutdown_connections 2024-05-28T06:06:46.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.783+0000 7f15c1600640 1 --2- 172.21.15.122:0/4088307923 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1598068380 0x7f159806a840 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.783+0000 7f15c1600640 1 --2- 172.21.15.122:0/4088307923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15bc15f740 0x7f15bc13ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.783+0000 7f15c1600640 1 --2- 172.21.15.122:0/4088307923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f15bc0ce4f0 0x7f15bc13c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.783+0000 7f15c1600640 1 --2- 172.21.15.122:0/4088307923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15bc0b58d0 0x7f15bc0aeca0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.783+0000 7f15c1600640 1 -- 172.21.15.122:0/4088307923 >> 172.21.15.122:0/4088307923 conn(0x7f15bc06bd90 msgr2=0x7f15bc074d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:46.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.783+0000 7f15c1600640 1 -- 172.21.15.122:0/4088307923 shutdown_connections 2024-05-28T06:06:46.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.783+0000 7f15c1600640 1 -- 172.21.15.122:0/4088307923 wait complete. 2024-05-28T06:06:46.804 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:06:46.804 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:06:46.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.943+0000 7fe9a4200640 1 Processor -- start 2024-05-28T06:06:46.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.943+0000 7fe9a4200640 1 -- start start 2024-05-28T06:06:46.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.943+0000 7fe9a4200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe99c0ce4f0 0x7fe99c0ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:46.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.943+0000 7fe9a4200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe99c15e730 0x7fe99c15ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:46.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.943+0000 7fe9a4200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe99c15d970 con 0x7fe99c0b58d0 2024-05-28T06:06:46.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.943+0000 7fe9a4200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe99c15dc50 con 0x7fe99c15e730 2024-05-28T06:06:46.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.943+0000 7fe9a4200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe99c15df30 con 0x7fe99c0ce4f0 2024-05-28T06:06:46.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.943+0000 7fe9a1800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fe99c0b58d0 0x7fe99c0b5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:43898/0 (socket says 172.21.15.122:43898) 2024-05-28T06:06:46.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.943+0000 7fe9a1800640 1 -- 172.21.15.122:0/3008633640 learned_addr learned my addr 172.21.15.122:0/3008633640 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:46.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.943+0000 7fe9a2200640 1 --2- 172.21.15.122:0/3008633640 >> v2:172.21.15.153:3300/0 conn(0x7fe99c15e730 0x7fe99c15ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:46.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.943+0000 7fe9a0e00640 1 --2- 172.21.15.122:0/3008633640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe99c0ce4f0 0x7fe99c0ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:46.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.943+0000 7fe99be00640 1 -- 172.21.15.122:0/3008633640 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2681114732 0 0) 0x7fe99c15d970 con 0x7fe99c0b58d0 2024-05-28T06:06:46.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.943+0000 7fe99be00640 1 -- 172.21.15.122:0/3008633640 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe984003530 con 0x7fe99c0b58d0 2024-05-28T06:06:46.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.943+0000 7fe99be00640 1 -- 172.21.15.122:0/3008633640 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 706700330 0 0) 0x7fe984003530 con 0x7fe99c0b58d0 2024-05-28T06:06:46.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.943+0000 7fe99be00640 1 -- 172.21.15.122:0/3008633640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe99c0ce4f0 msgr2=0x7fe99c0ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:46.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.943+0000 7fe99be00640 1 --2- 172.21.15.122:0/3008633640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe99c0ce4f0 0x7fe99c0ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.943+0000 7fe99be00640 1 -- 172.21.15.122:0/3008633640 >> v2:172.21.15.153:3300/0 conn(0x7fe99c15e730 msgr2=0x7fe99c15ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:46.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.943+0000 7fe99be00640 1 --2- 172.21.15.122:0/3008633640 >> v2:172.21.15.153:3300/0 conn(0x7fe99c15e730 0x7fe99c15ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.943+0000 7fe99be00640 1 -- 172.21.15.122:0/3008633640 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99c15e210 con 0x7fe99c0b58d0 2024-05-28T06:06:46.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.943+0000 7fe99be00640 1 -- 172.21.15.122:0/3008633640 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7fe990001a00 con 0x7fe99c0b58d0 2024-05-28T06:06:46.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.947+0000 7fe99be00640 1 -- 172.21.15.122:0/3008633640 >> v1:172.21.15.122:6789/0 conn(0x7fe99c0b58d0 legacy=0x7fe99c0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:46.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.947+0000 7fe99be00640 1 --2- 172.21.15.122:0/3008633640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9840039c0 0x7fe984003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:46.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.947+0000 7fe99be00640 1 --2- 172.21.15.122:0/3008633640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe99c0ce4f0 0x7fe984004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:46.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.947+0000 7fe99be00640 1 --2- 172.21.15.122:0/3008633640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe984004d50 0x7fe9840051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:46.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.947+0000 7fe99be00640 1 -- 172.21.15.122:0/3008633640 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c15dc50 con 0x7fe984004d50 2024-05-28T06:06:46.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.947+0000 7fe99be00640 1 -- 172.21.15.122:0/3008633640 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c15df30 con 0x7fe9840039c0 2024-05-28T06:06:46.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.947+0000 7fe99be00640 1 -- 172.21.15.122:0/3008633640 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe98400b9d0 con 0x7fe99c0ce4f0 2024-05-28T06:06:46.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.947+0000 7fe9a2200640 1 --2- 172.21.15.122:0/3008633640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe984004d50 0x7fe9840051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:46.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.947+0000 7fe9a1800640 1 --2- 172.21.15.122:0/3008633640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9840039c0 0x7fe984003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:46.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.947+0000 7fe9a0e00640 1 --2- 172.21.15.122:0/3008633640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe99c0ce4f0 0x7fe984004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:46.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.947+0000 7fe9a2200640 1 -- 172.21.15.122:0/3008633640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe99c0ce4f0 msgr2=0x7fe984004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:46.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.947+0000 7fe9a2200640 1 --2- 172.21.15.122:0/3008633640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe99c0ce4f0 0x7fe984004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.947+0000 7fe9a2200640 1 -- 172.21.15.122:0/3008633640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9840039c0 msgr2=0x7fe984003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:46.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.947+0000 7fe9a2200640 1 --2- 172.21.15.122:0/3008633640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9840039c0 0x7fe984003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.947+0000 7fe9a2200640 1 -- 172.21.15.122:0/3008633640 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe984003530 con 0x7fe984004d50 2024-05-28T06:06:46.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.947+0000 7fe9a2200640 1 --2- 172.21.15.122:0/3008633640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe984004d50 0x7fe9840051d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe994009ae0 tx=0x7fe99401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59ff6cfbb8d4427 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:46.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.947+0000 7fe99be00640 1 -- 172.21.15.122:0/3008633640 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9940b2070 con 0x7fe984004d50 2024-05-28T06:06:46.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.947+0000 7fe99be00640 1 -- 172.21.15.122:0/3008633640 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9940a56a0 con 0x7fe984004d50 2024-05-28T06:06:46.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.947+0000 7fe99be00640 1 -- 172.21.15.122:0/3008633640 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9940096b0 con 0x7fe984004d50 2024-05-28T06:06:46.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a4200640 1 -- 172.21.15.122:0/3008633640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe984004d50 msgr2=0x7fe9840051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:46.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a4200640 1 --2- 172.21.15.122:0/3008633640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe984004d50 0x7fe9840051d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe994009ae0 tx=0x7fe99401cab0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a2200640 1 -- 172.21.15.122:0/3008633640 reap_dead start 2024-05-28T06:06:46.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a4200640 1 -- 172.21.15.122:0/3008633640 shutdown_connections 2024-05-28T06:06:46.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a4200640 1 -- 172.21.15.122:0/3008633640 >> 172.21.15.122:0/3008633640 conn(0x7fe99c06bd90 msgr2=0x7fe99c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:46.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a4200640 1 -- 172.21.15.122:0/3008633640 shutdown_connections 2024-05-28T06:06:46.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a4200640 1 -- 172.21.15.122:0/3008633640 wait complete. 2024-05-28T06:06:46.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a4200640 1 Processor -- start 2024-05-28T06:06:46.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a4200640 1 -- start start 2024-05-28T06:06:46.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a4200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe984004d50 0x7fe99c1f4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:46.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a4200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe99c13ceb0 0x7fe99c0ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:46.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a4200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe99c0aee10 0x7fe99c0b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:46.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a4200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c146260 con 0x7fe99c13ceb0 2024-05-28T06:06:46.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a4200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c0ce950 con 0x7fe984004d50 2024-05-28T06:06:46.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a4200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe99c0af390 con 0x7fe99c0aee10 2024-05-28T06:06:46.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a0e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe99c13ceb0 0x7fe99c0ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:46.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a0e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe99c13ceb0 0x7fe99c0ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59780/0 (socket says 172.21.15.122:59780) 2024-05-28T06:06:46.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a0e00640 1 -- 172.21.15.122:0/1829122938 learned_addr learned my addr 172.21.15.122:0/1829122938 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:46.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a1800640 1 --2- 172.21.15.122:0/1829122938 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe984004d50 0x7fe99c1f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:46.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a2200640 1 --2- 172.21.15.122:0/1829122938 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe99c0aee10 0x7fe99c0b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:46.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a0e00640 1 -- 172.21.15.122:0/1829122938 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe99c0aee10 msgr2=0x7fe99c0b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:46.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a0e00640 1 --2- 172.21.15.122:0/1829122938 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe99c0aee10 0x7fe99c0b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a0e00640 1 -- 172.21.15.122:0/1829122938 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe984004d50 msgr2=0x7fe99c1f4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:46.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a0e00640 1 --2- 172.21.15.122:0/1829122938 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe984004d50 0x7fe99c1f4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:46.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a0e00640 1 -- 172.21.15.122:0/1829122938 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99c1f4660 con 0x7fe99c13ceb0 2024-05-28T06:06:46.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.951+0000 7fe9a2200640 1 --2- 172.21.15.122:0/1829122938 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe99c0aee10 0x7fe99c0b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:46.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.955+0000 7fe9a0e00640 1 --2- 172.21.15.122:0/1829122938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe99c13ceb0 0x7fe99c0ae8d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe9880115e0 tx=0x7fe988011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:46.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.955+0000 7fe999600640 1 -- 172.21.15.122:0/1829122938 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988015870 con 0x7fe99c13ceb0 2024-05-28T06:06:46.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.955+0000 7fe999600640 1 -- 172.21.15.122:0/1829122938 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe988015a10 con 0x7fe99c13ceb0 2024-05-28T06:06:46.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.955+0000 7fe999600640 1 -- 172.21.15.122:0/1829122938 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988015dc0 con 0x7fe99c13ceb0 2024-05-28T06:06:46.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.955+0000 7fe9a4200640 1 -- 172.21.15.122:0/1829122938 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe99c13ef40 con 0x7fe99c13ceb0 2024-05-28T06:06:46.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.955+0000 7fe9a4200640 1 -- 172.21.15.122:0/1829122938 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe99c13f500 con 0x7fe99c13ceb0 2024-05-28T06:06:46.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.955+0000 7fe9a4200640 1 -- 172.21.15.122:0/1829122938 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe99c068c40 con 0x7fe99c13ceb0 2024-05-28T06:06:46.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.955+0000 7fe999600640 1 -- 172.21.15.122:0/1829122938 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe98800f480 con 0x7fe99c13ceb0 2024-05-28T06:06:46.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.955+0000 7fe999600640 1 --2- 172.21.15.122:0/1829122938 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe97c0683b0 0x7fe97c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:46.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.955+0000 7fe999600640 1 -- 172.21.15.122:0/1829122938 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fe988086f90 con 0x7fe99c13ceb0 2024-05-28T06:06:46.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.955+0000 7fe9a1800640 1 --2- 172.21.15.122:0/1829122938 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe97c0683b0 0x7fe97c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:46.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.959+0000 7fe9a1800640 1 --2- 172.21.15.122:0/1829122938 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe97c0683b0 0x7fe97c06a870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe990000f90 tx=0x7fe990009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:46.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:46.959+0000 7fe999600640 1 -- 172.21.15.122:0/1829122938 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe99c1f4660 con 0x7fe99c13ceb0 2024-05-28T06:06:47.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.115+0000 7fe9a4200640 1 -- 172.21.15.122:0/1829122938 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe99c06f520 con 0x7fe99c13ceb0 2024-05-28T06:06:47.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.115+0000 7fe999600640 1 -- 172.21.15.122:0/1829122938 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) ==== 93+0+10 (secure 0 0 0) 0x7fe988019030 con 0x7fe99c13ceb0 2024-05-28T06:06:47.119 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:06:47.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.119+0000 7fe9a4200640 1 -- 172.21.15.122:0/1829122938 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe97c0683b0 msgr2=0x7fe97c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:47.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.119+0000 7fe9a4200640 1 --2- 172.21.15.122:0/1829122938 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe97c0683b0 0x7fe97c06a870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe990000f90 tx=0x7fe990009040 comp rx=0 tx=0).stop 2024-05-28T06:06:47.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.119+0000 7fe9a4200640 1 -- 172.21.15.122:0/1829122938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe99c13ceb0 msgr2=0x7fe99c0ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:47.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.119+0000 7fe9a4200640 1 --2- 172.21.15.122:0/1829122938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe99c13ceb0 0x7fe99c0ae8d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe9880115e0 tx=0x7fe988011aa0 comp rx=0 tx=0).stop 2024-05-28T06:06:47.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.119+0000 7fe9a4200640 1 -- 172.21.15.122:0/1829122938 shutdown_connections 2024-05-28T06:06:47.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.119+0000 7fe9a4200640 1 --2- 172.21.15.122:0/1829122938 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe97c0683b0 0x7fe97c06a870 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:47.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.119+0000 7fe9a4200640 1 --2- 172.21.15.122:0/1829122938 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe99c0aee10 0x7fe99c0b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:47.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.119+0000 7fe9a4200640 1 --2- 172.21.15.122:0/1829122938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe99c13ceb0 0x7fe99c0ae8d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:47.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.119+0000 7fe9a4200640 1 --2- 172.21.15.122:0/1829122938 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe984004d50 0x7fe99c1f4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:47.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.119+0000 7fe9a4200640 1 -- 172.21.15.122:0/1829122938 >> 172.21.15.122:0/1829122938 conn(0x7fe99c06bd90 msgr2=0x7fe99c142da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:47.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.119+0000 7fe9a4200640 1 -- 172.21.15.122:0/1829122938 shutdown_connections 2024-05-28T06:06:47.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.119+0000 7fe9a4200640 1 -- 172.21.15.122:0/1829122938 wait complete. 2024-05-28T06:06:47.140 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-28T06:06:47.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.275+0000 7faa76400640 1 Processor -- start 2024-05-28T06:06:47.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.275+0000 7faa76400640 1 -- start start 2024-05-28T06:06:47.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.275+0000 7faa76400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa700ce4f0 0x7faa700ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:47.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.275+0000 7faa76400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7faa7015e730 0x7faa7015ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:47.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.275+0000 7faa76400640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa7015d970 con 0x7faa700b58d0 2024-05-28T06:06:47.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.275+0000 7faa76400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7faa7015dc50 con 0x7faa7015e730 2024-05-28T06:06:47.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.275+0000 7faa76400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7faa7015df30 con 0x7faa700ce4f0 2024-05-28T06:06:47.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.275+0000 7faa6fe00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7faa7015e730 0x7faa7015ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:47.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.275+0000 7faa6f400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7faa700b58d0 0x7faa700b5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:43900/0 (socket says 172.21.15.122:43900) 2024-05-28T06:06:47.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.275+0000 7faa6f400640 1 -- 172.21.15.122:0/253283788 learned_addr learned my addr 172.21.15.122:0/253283788 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:47.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.275+0000 7faa6ea00640 1 --2- 172.21.15.122:0/253283788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa700ce4f0 0x7faa700ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:47.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.275+0000 7faa6fe00640 1 -- 172.21.15.122:0/253283788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa700ce4f0 msgr2=0x7faa700ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:47.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.275+0000 7faa6fe00640 1 --2- 172.21.15.122:0/253283788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa700ce4f0 0x7faa700ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:47.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.275+0000 7faa6fe00640 1 -- 172.21.15.122:0/253283788 >> v1:172.21.15.122:6789/0 conn(0x7faa700b58d0 legacy=0x7faa700b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:47.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.275+0000 7faa6fe00640 1 -- 172.21.15.122:0/253283788 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa7015e210 con 0x7faa7015e730 2024-05-28T06:06:47.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.275+0000 7faa6e000640 1 -- 172.21.15.122:0/253283788 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2917073879 0 0) 0x7faa7015d970 con 0x7faa700b58d0 2024-05-28T06:06:47.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.279+0000 7faa6fe00640 1 --2- 172.21.15.122:0/253283788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa7015e730 0x7faa7015ebc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7faa68009d90 tx=0x7faa6801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818615140d8da42f server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:47.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.279+0000 7faa6e000640 1 -- 172.21.15.122:0/253283788 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa680b2070 con 0x7faa7015e730 2024-05-28T06:06:47.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.279+0000 7faa6e000640 1 -- 172.21.15.122:0/253283788 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa680a58d0 con 0x7faa7015e730 2024-05-28T06:06:47.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.279+0000 7faa6e000640 1 -- 172.21.15.122:0/253283788 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa680a5ca0 con 0x7faa7015e730 2024-05-28T06:06:47.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.279+0000 7faa76400640 1 -- 172.21.15.122:0/253283788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa7015e730 msgr2=0x7faa7015ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:47.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.279+0000 7faa76400640 1 --2- 172.21.15.122:0/253283788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa7015e730 0x7faa7015ebc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7faa68009d90 tx=0x7faa6801c970 comp rx=0 tx=0).stop 2024-05-28T06:06:47.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.279+0000 7faa76400640 1 -- 172.21.15.122:0/253283788 shutdown_connections 2024-05-28T06:06:47.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.279+0000 7faa76400640 1 --2- 172.21.15.122:0/253283788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa7015e730 0x7faa7015ebc0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:47.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.279+0000 7faa76400640 1 --2- 172.21.15.122:0/253283788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa700ce4f0 0x7faa700ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:47.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.279+0000 7faa76400640 1 -- 172.21.15.122:0/253283788 >> 172.21.15.122:0/253283788 conn(0x7faa7006bd90 msgr2=0x7faa7006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:47.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.279+0000 7faa76400640 1 -- 172.21.15.122:0/253283788 shutdown_connections 2024-05-28T06:06:47.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.279+0000 7faa76400640 1 -- 172.21.15.122:0/253283788 wait complete. 2024-05-28T06:06:47.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa76400640 1 Processor -- start 2024-05-28T06:06:47.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa76400640 1 -- start start 2024-05-28T06:06:47.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa76400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa700b58d0 0x7faa70074ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:47.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa76400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa700ce4f0 0x7faa70142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:47.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa76400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa7015e730 0x7faa70142d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:47.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa76400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7faa701693d0 con 0x7faa700ce4f0 2024-05-28T06:06:47.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa76400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faa70169250 con 0x7faa7015e730 2024-05-28T06:06:47.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa76400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7faa70169550 con 0x7faa700b58d0 2024-05-28T06:06:47.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa6ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa700ce4f0 0x7faa70142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:47.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa6ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa700ce4f0 0x7faa70142850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59790/0 (socket says 172.21.15.122:59790) 2024-05-28T06:06:47.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa6ea00640 1 -- 172.21.15.122:0/3040083737 learned_addr learned my addr 172.21.15.122:0/3040083737 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:47.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa6fe00640 1 --2- 172.21.15.122:0/3040083737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa7015e730 0x7faa70142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:47.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa6f400640 1 --2- 172.21.15.122:0/3040083737 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa700b58d0 0x7faa70074ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:47.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa6ea00640 1 -- 172.21.15.122:0/3040083737 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa700b58d0 msgr2=0x7faa70074ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:47.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa6ea00640 1 --2- 172.21.15.122:0/3040083737 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa700b58d0 0x7faa70074ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:47.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa6ea00640 1 -- 172.21.15.122:0/3040083737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa7015e730 msgr2=0x7faa70142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:47.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa6ea00640 1 --2- 172.21.15.122:0/3040083737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa7015e730 0x7faa70142d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:47.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa6ea00640 1 -- 172.21.15.122:0/3040083737 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa7015ff60 con 0x7faa700ce4f0 2024-05-28T06:06:47.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa6f400640 1 --2- 172.21.15.122:0/3040083737 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa700b58d0 0x7faa70074ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:47.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa6ea00640 1 --2- 172.21.15.122:0/3040083737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa700ce4f0 0x7faa70142850 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faa5c00d830 tx=0x7faa5c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:47.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa67400640 1 -- 172.21.15.122:0/3040083737 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c00b6c0 con 0x7faa700ce4f0 2024-05-28T06:06:47.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa67400640 1 -- 172.21.15.122:0/3040083737 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa5c019070 con 0x7faa700ce4f0 2024-05-28T06:06:47.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa76400640 1 -- 172.21.15.122:0/3040083737 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa70143510 con 0x7faa700ce4f0 2024-05-28T06:06:47.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa67400640 1 -- 172.21.15.122:0/3040083737 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c00ba60 con 0x7faa700ce4f0 2024-05-28T06:06:47.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa76400640 1 -- 172.21.15.122:0/3040083737 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa70143ad0 con 0x7faa700ce4f0 2024-05-28T06:06:47.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.283+0000 7faa76400640 1 -- 172.21.15.122:0/3040083737 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa70068c40 con 0x7faa700ce4f0 2024-05-28T06:06:47.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.287+0000 7faa67400640 1 -- 172.21.15.122:0/3040083737 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faa5c01e460 con 0x7faa700ce4f0 2024-05-28T06:06:47.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.287+0000 7faa67400640 1 --2- 172.21.15.122:0/3040083737 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7faa50068380 0x7faa5006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:47.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.287+0000 7faa67400640 1 -- 172.21.15.122:0/3040083737 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7faa5c086dd0 con 0x7faa700ce4f0 2024-05-28T06:06:47.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.287+0000 7faa6f400640 1 --2- 172.21.15.122:0/3040083737 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7faa50068380 0x7faa5006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:47.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.287+0000 7faa6f400640 1 --2- 172.21.15.122:0/3040083737 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7faa50068380 0x7faa5006a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7faa60000f70 tx=0x7faa60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:47.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.291+0000 7faa67400640 1 -- 172.21.15.122:0/3040083737 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faa5c057640 con 0x7faa700ce4f0 2024-05-28T06:06:47.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.451+0000 7faa76400640 1 -- 172.21.15.122:0/3040083737 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7faa7013d1f0 con 0x7faa700ce4f0 2024-05-28T06:06:47.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.451+0000 7faa67400640 1 -- 172.21.15.122:0/3040083737 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) ==== 84+0+65 (secure 0 0 0) 0x7faa5c056f40 con 0x7faa700ce4f0 2024-05-28T06:06:47.453 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:47.453 INFO:teuthology.orchestra.run.smithi122.stdout:[ 2024-05-28T06:06:47.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:47.453 INFO:teuthology.orchestra.run.smithi122.stdout: "poolnum": 1, 2024-05-28T06:06:47.453 INFO:teuthology.orchestra.run.smithi122.stdout: "poolname": ".mgr" 2024-05-28T06:06:47.453 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:47.453 INFO:teuthology.orchestra.run.smithi122.stdout:] 2024-05-28T06:06:47.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.451+0000 7faa76400640 1 -- 172.21.15.122:0/3040083737 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7faa50068380 msgr2=0x7faa5006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:47.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.451+0000 7faa76400640 1 --2- 172.21.15.122:0/3040083737 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7faa50068380 0x7faa5006a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7faa60000f70 tx=0x7faa60009040 comp rx=0 tx=0).stop 2024-05-28T06:06:47.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.451+0000 7faa76400640 1 -- 172.21.15.122:0/3040083737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa700ce4f0 msgr2=0x7faa70142850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:47.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.451+0000 7faa76400640 1 --2- 172.21.15.122:0/3040083737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa700ce4f0 0x7faa70142850 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faa5c00d830 tx=0x7faa5c00dcf0 comp rx=0 tx=0).stop 2024-05-28T06:06:47.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.451+0000 7faa76400640 1 -- 172.21.15.122:0/3040083737 shutdown_connections 2024-05-28T06:06:47.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.451+0000 7faa76400640 1 --2- 172.21.15.122:0/3040083737 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7faa50068380 0x7faa5006a840 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:47.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.451+0000 7faa76400640 1 --2- 172.21.15.122:0/3040083737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa7015e730 0x7faa70142d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:47.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.451+0000 7faa76400640 1 --2- 172.21.15.122:0/3040083737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa700ce4f0 0x7faa70142850 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:47.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.451+0000 7faa76400640 1 --2- 172.21.15.122:0/3040083737 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa700b58d0 0x7faa70074ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:47.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.451+0000 7faa76400640 1 -- 172.21.15.122:0/3040083737 >> 172.21.15.122:0/3040083737 conn(0x7faa7006bd90 msgr2=0x7faa7015cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:47.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.451+0000 7faa76400640 1 -- 172.21.15.122:0/3040083737 shutdown_connections 2024-05-28T06:06:47.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.451+0000 7faa76400640 1 -- 172.21.15.122:0/3040083737 wait complete. 2024-05-28T06:06:47.474 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-28T06:06:47.474 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-28T06:06:47.525 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:06:47.529 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:06:47.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.615+0000 7f1be5400640 1 Processor -- start 2024-05-28T06:06:47.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.615+0000 7f1be5400640 1 -- start start 2024-05-28T06:06:47.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.615+0000 7f1be5400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1be009b150 0x7f1be01672c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:47.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.615+0000 7f1be5400640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1be015ffe0 con 0x7f1be00b63d0 2024-05-28T06:06:47.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.615+0000 7f1be5400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1be00cf000 con 0x7f1be015fc00 2024-05-28T06:06:47.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.615+0000 7f1be5400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f1be00cfc10 con 0x7f1be009b150 2024-05-28T06:06:47.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.615+0000 7f1bd7400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f1be00b63d0 0x7f1be009aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:43902/0 (socket says 172.21.15.122:43902) 2024-05-28T06:06:47.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.615+0000 7f1bd7400640 1 -- 172.21.15.122:0/3357792760 learned_addr learned my addr 172.21.15.122:0/3357792760 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:47.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.615+0000 7f1be4a00640 1 --2- 172.21.15.122:0/3357792760 >> v2:172.21.15.122:3300/0 conn(0x7f1be009b150 0x7f1be01672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:47.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.615+0000 7f1be4a00640 1 -- 172.21.15.122:0/3357792760 >> v1:172.21.15.153:6789/0 conn(0x7f1be015fc00 legacy=0x7f1be00d1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:47.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.615+0000 7f1be4a00640 1 -- 172.21.15.122:0/3357792760 >> v1:172.21.15.122:6789/0 conn(0x7f1be00b63d0 legacy=0x7f1be009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:47.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.615+0000 7f1be4a00640 1 -- 172.21.15.122:0/3357792760 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be00cf2e0 con 0x7f1be009b150 2024-05-28T06:06:47.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.615+0000 7f1bdf400640 1 -- 172.21.15.122:0/3357792760 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2819275852 0 0) 0x7f1be015ffe0 con 0x7f1be00b63d0 2024-05-28T06:06:47.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.619+0000 7f1be4a00640 1 --2- 172.21.15.122:0/3357792760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1be009b150 0x7f1be01672c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8009d90 tx=0x7f1bd801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87bb3bda8bc2736e server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:47.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.619+0000 7f1bdf400640 1 -- 172.21.15.122:0/3357792760 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd80b2070 con 0x7f1be009b150 2024-05-28T06:06:47.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.619+0000 7f1bdf400640 1 -- 172.21.15.122:0/3357792760 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd80a5a00 con 0x7f1be009b150 2024-05-28T06:06:47.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.619+0000 7f1bdf400640 1 -- 172.21.15.122:0/3357792760 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd80a5dd0 con 0x7f1be009b150 2024-05-28T06:06:47.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.619+0000 7f1be5400640 1 -- 172.21.15.122:0/3357792760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1be009b150 msgr2=0x7f1be01672c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:47.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.619+0000 7f1be5400640 1 --2- 172.21.15.122:0/3357792760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1be009b150 0x7f1be01672c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8009d90 tx=0x7f1bd801c940 comp rx=0 tx=0).stop 2024-05-28T06:06:47.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.619+0000 7f1be5400640 1 -- 172.21.15.122:0/3357792760 shutdown_connections 2024-05-28T06:06:47.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.619+0000 7f1be5400640 1 --2- 172.21.15.122:0/3357792760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1be009b150 0x7f1be01672c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:47.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.619+0000 7f1be5400640 1 -- 172.21.15.122:0/3357792760 >> 172.21.15.122:0/3357792760 conn(0x7f1be00b40c0 msgr2=0x7f1be00b44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:47.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.619+0000 7f1be5400640 1 -- 172.21.15.122:0/3357792760 shutdown_connections 2024-05-28T06:06:47.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.619+0000 7f1be5400640 1 -- 172.21.15.122:0/3357792760 wait complete. 2024-05-28T06:06:47.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.619+0000 7f1be5400640 1 Processor -- start 2024-05-28T06:06:47.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.619+0000 7f1be5400640 1 -- start start 2024-05-28T06:06:47.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1be5400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1be009b150 0x7f1be006caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:47.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1be5400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1be00b63d0 0x7f1be0156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:47.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1be5400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1be015fc00 0x7f1be014f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:47.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1be5400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1be00ceda0 con 0x7f1be009b150 2024-05-28T06:06:47.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1be5400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1be00cec20 con 0x7f1be015fc00 2024-05-28T06:06:47.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1be5400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1be016a430 con 0x7f1be00b63d0 2024-05-28T06:06:47.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1bdfe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1be009b150 0x7f1be006caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:47.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1bdfe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1be009b150 0x7f1be006caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59808/0 (socket says 172.21.15.122:59808) 2024-05-28T06:06:47.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1bdfe00640 1 -- 172.21.15.122:0/2087979742 learned_addr learned my addr 172.21.15.122:0/2087979742 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:47.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1bd7400640 1 --2- 172.21.15.122:0/2087979742 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1be00b63d0 0x7f1be0156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:47.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1be4a00640 1 --2- 172.21.15.122:0/2087979742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1be015fc00 0x7f1be014f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:47.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1bdfe00640 1 -- 172.21.15.122:0/2087979742 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1be00b63d0 msgr2=0x7f1be0156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:47.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1bdfe00640 1 --2- 172.21.15.122:0/2087979742 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1be00b63d0 0x7f1be0156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:47.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1bdfe00640 1 -- 172.21.15.122:0/2087979742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1be015fc00 msgr2=0x7f1be014f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:47.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1bdfe00640 1 --2- 172.21.15.122:0/2087979742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1be015fc00 0x7f1be014f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:47.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1bdfe00640 1 -- 172.21.15.122:0/2087979742 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be015e990 con 0x7f1be009b150 2024-05-28T06:06:47.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1bdfe00640 1 --2- 172.21.15.122:0/2087979742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1be009b150 0x7f1be006caa0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000c3c0 tx=0x7f1bd000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:47.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1bdcc00640 1 -- 172.21.15.122:0/2087979742 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0017070 con 0x7f1be009b150 2024-05-28T06:06:47.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1bdcc00640 1 -- 172.21.15.122:0/2087979742 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd00052d0 con 0x7f1be009b150 2024-05-28T06:06:47.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1bdcc00640 1 -- 172.21.15.122:0/2087979742 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0003840 con 0x7f1be009b150 2024-05-28T06:06:47.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1be5400640 1 -- 172.21.15.122:0/2087979742 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be006d1a0 con 0x7f1be009b150 2024-05-28T06:06:47.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1be5400640 1 -- 172.21.15.122:0/2087979742 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be006d760 con 0x7f1be009b150 2024-05-28T06:06:47.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1be5400640 1 -- 172.21.15.122:0/2087979742 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1be0075620 con 0x7f1be009b150 2024-05-28T06:06:47.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.623+0000 7f1bdcc00640 1 -- 172.21.15.122:0/2087979742 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1bd001a070 con 0x7f1be009b150 2024-05-28T06:06:47.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.627+0000 7f1bdcc00640 1 --2- 172.21.15.122:0/2087979742 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1bbc068380 0x7f1bbc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:47.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.627+0000 7f1bdcc00640 1 -- 172.21.15.122:0/2087979742 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f1bd00858d0 con 0x7f1be009b150 2024-05-28T06:06:47.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.627+0000 7f1bd7400640 1 --2- 172.21.15.122:0/2087979742 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1bbc068380 0x7f1bbc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:47.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.627+0000 7f1bd7400640 1 --2- 172.21.15.122:0/2087979742 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1bbc068380 0x7f1bbc06a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1be01fb1f0 tx=0x7f1bc8007240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:47.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.631+0000 7f1bdcc00640 1 -- 172.21.15.122:0/2087979742 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1be015e990 con 0x7f1be009b150 2024-05-28T06:06:47.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.787+0000 7f1be5400640 1 -- 172.21.15.122:0/2087979742 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1be0070ea0 con 0x7f1be009b150 2024-05-28T06:06:47.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.879+0000 7f1bdcc00640 1 -- 172.21.15.122:0/2087979742 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) ==== 138+0+0 (secure 0 0 0) 0x7f1bd0005480 con 0x7f1be009b150 2024-05-28T06:06:47.882 INFO:teuthology.orchestra.run.smithi122.stderr:pool 'cephfs_metadata' created 2024-05-28T06:06:47.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.883+0000 7f1be5400640 1 -- 172.21.15.122:0/2087979742 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1bbc068380 msgr2=0x7f1bbc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:47.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.883+0000 7f1be5400640 1 --2- 172.21.15.122:0/2087979742 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1bbc068380 0x7f1bbc06a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1be01fb1f0 tx=0x7f1bc8007240 comp rx=0 tx=0).stop 2024-05-28T06:06:47.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.883+0000 7f1be5400640 1 -- 172.21.15.122:0/2087979742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1be009b150 msgr2=0x7f1be006caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:47.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.883+0000 7f1be5400640 1 --2- 172.21.15.122:0/2087979742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1be009b150 0x7f1be006caa0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000c3c0 tx=0x7f1bd000c880 comp rx=0 tx=0).stop 2024-05-28T06:06:47.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.883+0000 7f1be5400640 1 -- 172.21.15.122:0/2087979742 shutdown_connections 2024-05-28T06:06:47.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.883+0000 7f1be5400640 1 --2- 172.21.15.122:0/2087979742 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1bbc068380 0x7f1bbc06a840 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:47.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.883+0000 7f1be5400640 1 --2- 172.21.15.122:0/2087979742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1be015fc00 0x7f1be014f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:47.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.883+0000 7f1be5400640 1 --2- 172.21.15.122:0/2087979742 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1be00b63d0 0x7f1be0156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:47.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.883+0000 7f1be5400640 1 --2- 172.21.15.122:0/2087979742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1be009b150 0x7f1be006caa0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:47.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.883+0000 7f1be5400640 1 -- 172.21.15.122:0/2087979742 >> 172.21.15.122:0/2087979742 conn(0x7f1be00b40c0 msgr2=0x7f1be015be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:47.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.883+0000 7f1be5400640 1 -- 172.21.15.122:0/2087979742 shutdown_connections 2024-05-28T06:06:47.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:47.883+0000 7f1be5400640 1 -- 172.21.15.122:0/2087979742 wait complete. 2024-05-28T06:06:47.908 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-28T06:06:48.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.046+0000 7f5c31800640 1 Processor -- start 2024-05-28T06:06:48.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c31800640 1 -- start start 2024-05-28T06:06:48.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c31800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c2c147410 0x7f5c2c0afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:48.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c31800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c2c0adf20 con 0x7f5c2c0729b0 2024-05-28T06:06:48.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c31800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c2c06e7f0 con 0x7f5c2c0adac0 2024-05-28T06:06:48.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c31800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5c2c0b5310 con 0x7f5c2c147410 2024-05-28T06:06:48.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2b400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f5c2c0729b0 0x7f5c2c0b5a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:43906/0 (socket says 172.21.15.122:43906) 2024-05-28T06:06:48.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2b400640 1 -- 172.21.15.122:0/1420244122 learned_addr learned my addr 172.21.15.122:0/1420244122 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:48.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2aa00640 1 --2- 172.21.15.122:0/1420244122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c2c147410 0x7f5c2c0afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:48.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2a000640 1 -- 172.21.15.122:0/1420244122 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 124748653 0 0) 0x7f5c240014a0 con 0x7f5c2c0729b0 2024-05-28T06:06:48.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2a000640 1 -- 172.21.15.122:0/1420244122 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c10003530 con 0x7f5c2c0729b0 2024-05-28T06:06:48.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2a000640 1 -- 172.21.15.122:0/1420244122 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3999550918 0 0) 0x7f5c2c06e7f0 con 0x7f5c2c0adac0 2024-05-28T06:06:48.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2a000640 1 -- 172.21.15.122:0/1420244122 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c240014a0 con 0x7f5c2c0adac0 2024-05-28T06:06:48.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2a000640 1 -- 172.21.15.122:0/1420244122 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3505165060 0 0) 0x7f5c10003530 con 0x7f5c2c0729b0 2024-05-28T06:06:48.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2a000640 1 -- 172.21.15.122:0/1420244122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c2c147410 msgr2=0x7f5c2c0afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:48.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2a000640 1 --2- 172.21.15.122:0/1420244122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c2c147410 0x7f5c2c0afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:48.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2a000640 1 -- 172.21.15.122:0/1420244122 >> v1:172.21.15.153:6789/0 conn(0x7f5c2c0adac0 legacy=0x7f5c2c0722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:48.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2a000640 1 -- 172.21.15.122:0/1420244122 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c2c06ead0 con 0x7f5c2c0729b0 2024-05-28T06:06:48.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2a000640 1 -- 172.21.15.122:0/1420244122 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f5c24001bd0 con 0x7f5c2c0729b0 2024-05-28T06:06:48.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2a000640 1 -- 172.21.15.122:0/1420244122 >> v1:172.21.15.122:6789/0 conn(0x7f5c2c0729b0 legacy=0x7f5c2c0b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:48.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2a000640 1 --2- 172.21.15.122:0/1420244122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c10003b80 0x7f5c10003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:48.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2a000640 1 --2- 172.21.15.122:0/1420244122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c2c147410 0x7f5c10004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:48.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2a000640 1 --2- 172.21.15.122:0/1420244122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c10004d50 0x7f5c100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:48.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2a000640 1 -- 172.21.15.122:0/1420244122 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1000ba80 con 0x7f5c10003b80 2024-05-28T06:06:48.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2a000640 1 -- 172.21.15.122:0/1420244122 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1000bc00 con 0x7f5c10004d50 2024-05-28T06:06:48.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2a000640 1 -- 172.21.15.122:0/1420244122 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5c1000bdb0 con 0x7f5c2c147410 2024-05-28T06:06:48.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2aa00640 1 --2- 172.21.15.122:0/1420244122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c10003b80 0x7f5c10003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:48.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2b400640 1 --2- 172.21.15.122:0/1420244122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c10004d50 0x7f5c100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:48.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c22000640 1 --2- 172.21.15.122:0/1420244122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c2c147410 0x7f5c10004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:48.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2aa00640 1 -- 172.21.15.122:0/1420244122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c2c147410 msgr2=0x7f5c10004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:48.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2aa00640 1 --2- 172.21.15.122:0/1420244122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c2c147410 0x7f5c10004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:48.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2aa00640 1 -- 172.21.15.122:0/1420244122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c10004d50 msgr2=0x7f5c100051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:48.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2aa00640 1 --2- 172.21.15.122:0/1420244122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c10004d50 0x7f5c100051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:48.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2aa00640 1 -- 172.21.15.122:0/1420244122 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c10003530 con 0x7f5c10003b80 2024-05-28T06:06:48.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.050+0000 7f5c2b400640 1 --2- 172.21.15.122:0/1420244122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c10004d50 0x7f5c100051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:48.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.054+0000 7f5c2aa00640 1 --2- 172.21.15.122:0/1420244122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c10003b80 0x7f5c10003f80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c009ae0 tx=0x7f5c1c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90b9bdfee228058 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:48.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.054+0000 7f5c2a000640 1 -- 172.21.15.122:0/1420244122 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c0096b0 con 0x7f5c10003b80 2024-05-28T06:06:48.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.054+0000 7f5c2a000640 1 -- 172.21.15.122:0/1420244122 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c1c0a6450 con 0x7f5c10003b80 2024-05-28T06:06:48.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.054+0000 7f5c2a000640 1 -- 172.21.15.122:0/1420244122 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c0a6840 con 0x7f5c10003b80 2024-05-28T06:06:48.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.054+0000 7f5c31800640 1 -- 172.21.15.122:0/1420244122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c10003b80 msgr2=0x7f5c10003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:48.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.054+0000 7f5c31800640 1 --2- 172.21.15.122:0/1420244122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c10003b80 0x7f5c10003f80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c009ae0 tx=0x7f5c1c01ca70 comp rx=0 tx=0).stop 2024-05-28T06:06:48.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.054+0000 7f5c2b400640 1 -- 172.21.15.122:0/1420244122 reap_dead start 2024-05-28T06:06:48.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.054+0000 7f5c31800640 1 -- 172.21.15.122:0/1420244122 shutdown_connections 2024-05-28T06:06:48.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.054+0000 7f5c31800640 1 -- 172.21.15.122:0/1420244122 >> 172.21.15.122:0/1420244122 conn(0x7f5c2c06bd90 msgr2=0x7f5c2c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:48.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.054+0000 7f5c31800640 1 -- 172.21.15.122:0/1420244122 shutdown_connections 2024-05-28T06:06:48.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.054+0000 7f5c31800640 1 -- 172.21.15.122:0/1420244122 wait complete. 2024-05-28T06:06:48.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.058+0000 7f5c31800640 1 Processor -- start 2024-05-28T06:06:48.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.058+0000 7f5c31800640 1 -- start start 2024-05-28T06:06:48.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.058+0000 7f5c31800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c10003b80 0x7f5c2c1442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:48.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.058+0000 7f5c31800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c2c1449c0 0x7f5c2c165770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:48.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.058+0000 7f5c31800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c2c165cb0 0x7f5c2c166130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:48.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.058+0000 7f5c31800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5c2c1477f0 con 0x7f5c10003b80 2024-05-28T06:06:48.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.058+0000 7f5c31800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5c2c06f090 con 0x7f5c2c165cb0 2024-05-28T06:06:48.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.058+0000 7f5c31800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5c2c147970 con 0x7f5c2c1449c0 2024-05-28T06:06:48.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.058+0000 7f5c2aa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c10003b80 0x7f5c2c1442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:48.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.058+0000 7f5c2aa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c10003b80 0x7f5c2c1442e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59812/0 (socket says 172.21.15.122:59812) 2024-05-28T06:06:48.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.058+0000 7f5c2aa00640 1 -- 172.21.15.122:0/3481898784 learned_addr learned my addr 172.21.15.122:0/3481898784 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:48.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.058+0000 7f5c2aa00640 1 -- 172.21.15.122:0/3481898784 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c2c1449c0 msgr2=0x7f5c2c165770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:48.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.058+0000 7f5c2aa00640 1 --2- 172.21.15.122:0/3481898784 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c2c1449c0 0x7f5c2c165770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:48.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.058+0000 7f5c2aa00640 1 -- 172.21.15.122:0/3481898784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c2c165cb0 msgr2=0x7f5c2c166130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:48.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.058+0000 7f5c2aa00640 1 --2- 172.21.15.122:0/3481898784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c2c165cb0 0x7f5c2c166130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:48.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.058+0000 7f5c2aa00640 1 -- 172.21.15.122:0/3481898784 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c2c168ae0 con 0x7f5c10003b80 2024-05-28T06:06:48.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.058+0000 7f5c2aa00640 1 --2- 172.21.15.122:0/3481898784 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c10003b80 0x7f5c2c1442e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c009ae0 tx=0x7f5c10005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:48.064 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.058+0000 7f5c23400640 1 -- 172.21.15.122:0/3481898784 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c00f000 con 0x7f5c10003b80 2024-05-28T06:06:48.064 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.058+0000 7f5c23400640 1 -- 172.21.15.122:0/3481898784 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c1c0a6b80 con 0x7f5c10003b80 2024-05-28T06:06:48.064 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.058+0000 7f5c31800640 1 -- 172.21.15.122:0/3481898784 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c2c168540 con 0x7f5c10003b80 2024-05-28T06:06:48.064 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.058+0000 7f5c23400640 1 -- 172.21.15.122:0/3481898784 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c004020 con 0x7f5c10003b80 2024-05-28T06:06:48.064 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.058+0000 7f5c31800640 1 -- 172.21.15.122:0/3481898784 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c2c168fe0 con 0x7f5c10003b80 2024-05-28T06:06:48.064 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.062+0000 7f5c31800640 1 -- 172.21.15.122:0/3481898784 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c2c068c40 con 0x7f5c10003b80 2024-05-28T06:06:48.064 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.062+0000 7f5c23400640 1 -- 172.21.15.122:0/3481898784 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5c1c0c2060 con 0x7f5c10003b80 2024-05-28T06:06:48.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.062+0000 7f5c23400640 1 --2- 172.21.15.122:0/3481898784 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5c080683b0 0x7f5c0806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:48.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.062+0000 7f5c23400640 1 -- 172.21.15.122:0/3481898784 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5227+0+0 (secure 0 0 0) 0x7f5c1c120610 con 0x7f5c10003b80 2024-05-28T06:06:48.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.062+0000 7f5c22000640 1 --2- 172.21.15.122:0/3481898784 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5c080683b0 0x7f5c0806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:48.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.062+0000 7f5c22000640 1 --2- 172.21.15.122:0/3481898784 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5c080683b0 0x7f5c0806a870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5c14007af0 tx=0x7f5c14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:48.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.066+0000 7f5c23400640 1 -- 172.21.15.122:0/3481898784 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5c1c0ac020 con 0x7f5c10003b80 2024-05-28T06:06:48.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.226+0000 7f5c31800640 1 -- 172.21.15.122:0/3481898784 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f5c2c168cb0 con 0x7f5c10003b80 2024-05-28T06:06:48.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.886+0000 7f5c23400640 1 -- 172.21.15.122:0/3481898784 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) ==== 170+0+0 (secure 0 0 0) 0x7f5c1c016780 con 0x7f5c10003b80 2024-05-28T06:06:48.890 INFO:teuthology.orchestra.run.smithi122.stderr:pool 'cephfs_data' created 2024-05-28T06:06:48.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.890+0000 7f5c31800640 1 -- 172.21.15.122:0/3481898784 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5c080683b0 msgr2=0x7f5c0806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:48.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.890+0000 7f5c31800640 1 --2- 172.21.15.122:0/3481898784 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5c080683b0 0x7f5c0806a870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5c14007af0 tx=0x7f5c14009040 comp rx=0 tx=0).stop 2024-05-28T06:06:48.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.890+0000 7f5c31800640 1 -- 172.21.15.122:0/3481898784 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c10003b80 msgr2=0x7f5c2c1442e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:48.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.890+0000 7f5c31800640 1 --2- 172.21.15.122:0/3481898784 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c10003b80 0x7f5c2c1442e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c009ae0 tx=0x7f5c10005840 comp rx=0 tx=0).stop 2024-05-28T06:06:48.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.890+0000 7f5c31800640 1 -- 172.21.15.122:0/3481898784 shutdown_connections 2024-05-28T06:06:48.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.890+0000 7f5c31800640 1 --2- 172.21.15.122:0/3481898784 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5c080683b0 0x7f5c0806a870 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:48.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.890+0000 7f5c31800640 1 --2- 172.21.15.122:0/3481898784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c2c165cb0 0x7f5c2c166130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:48.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.890+0000 7f5c31800640 1 --2- 172.21.15.122:0/3481898784 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5c2c1449c0 0x7f5c2c165770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:48.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.890+0000 7f5c31800640 1 --2- 172.21.15.122:0/3481898784 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c10003b80 0x7f5c2c1442e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:48.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.890+0000 7f5c31800640 1 -- 172.21.15.122:0/3481898784 >> 172.21.15.122:0/3481898784 conn(0x7f5c2c06bd90 msgr2=0x7f5c2c072270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:48.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.890+0000 7f5c31800640 1 -- 172.21.15.122:0/3481898784 shutdown_connections 2024-05-28T06:06:48.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:48.890+0000 7f5c31800640 1 -- 172.21.15.122:0/3481898784 wait complete. 2024-05-28T06:06:48.932 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-28T06:06:49.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.070+0000 7f082b200640 1 Processor -- start 2024-05-28T06:06:49.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.070+0000 7f082b200640 1 -- start start 2024-05-28T06:06:49.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.070+0000 7f082b200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f082c0b3660 0x7f082c0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:49.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.070+0000 7f082b200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f082c0d0ea0 0x7f082c0cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:49.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.070+0000 7f082b200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f082c15ff70 con 0x7f082c15fb90 2024-05-28T06:06:49.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.070+0000 7f082b200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f082c160200 con 0x7f082c0d0ea0 2024-05-28T06:06:49.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.070+0000 7f082b200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f082c0d03b0 con 0x7f082c0b3660 2024-05-28T06:06:49.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.074+0000 7f082a800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f082c0d0ea0 0x7f082c0cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:49.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.074+0000 7f0829e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f082c15fb90 0x7f082c0d0790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:43918/0 (socket says 172.21.15.122:43918) 2024-05-28T06:06:49.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.074+0000 7f0829e00640 1 -- 172.21.15.122:0/1871052293 learned_addr learned my addr 172.21.15.122:0/1871052293 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:49.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.074+0000 7f0829400640 1 --2- 172.21.15.122:0/1871052293 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f082c0b3660 0x7f082c0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:49.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.074+0000 7f082a800640 1 -- 172.21.15.122:0/1871052293 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f082c0b3660 msgr2=0x7f082c0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:49.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.074+0000 7f082a800640 1 --2- 172.21.15.122:0/1871052293 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f082c0b3660 0x7f082c0cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:49.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.074+0000 7f082a800640 1 -- 172.21.15.122:0/1871052293 >> v1:172.21.15.122:6789/0 conn(0x7f082c15fb90 legacy=0x7f082c0d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:49.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.074+0000 7f082a800640 1 -- 172.21.15.122:0/1871052293 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f082c160450 con 0x7f082c0d0ea0 2024-05-28T06:06:49.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.074+0000 7f0828a00640 1 -- 172.21.15.122:0/1871052293 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3672889655 0 0) 0x7f082c15ff70 con 0x7f082c15fb90 2024-05-28T06:06:49.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.074+0000 7f082a800640 1 --2- 172.21.15.122:0/1871052293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f082c0d0ea0 0x7f082c0cd600 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0824009d90 tx=0x7f082401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352cb67fc050fad8 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:49.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.074+0000 7f0828a00640 1 -- 172.21.15.122:0/1871052293 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08240b2070 con 0x7f082c0d0ea0 2024-05-28T06:06:49.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.074+0000 7f0828a00640 1 -- 172.21.15.122:0/1871052293 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08240a5970 con 0x7f082c0d0ea0 2024-05-28T06:06:49.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.074+0000 7f0828a00640 1 -- 172.21.15.122:0/1871052293 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08240a5d40 con 0x7f082c0d0ea0 2024-05-28T06:06:49.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082b200640 1 -- 172.21.15.122:0/1871052293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f082c0d0ea0 msgr2=0x7f082c0cd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:49.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082b200640 1 --2- 172.21.15.122:0/1871052293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f082c0d0ea0 0x7f082c0cd600 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0824009d90 tx=0x7f082401c8b0 comp rx=0 tx=0).stop 2024-05-28T06:06:49.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082b200640 1 -- 172.21.15.122:0/1871052293 shutdown_connections 2024-05-28T06:06:49.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082b200640 1 --2- 172.21.15.122:0/1871052293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f082c0d0ea0 0x7f082c0cd600 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:49.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082b200640 1 --2- 172.21.15.122:0/1871052293 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f082c0b3660 0x7f082c0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:49.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082b200640 1 -- 172.21.15.122:0/1871052293 >> 172.21.15.122:0/1871052293 conn(0x7f082c09aa40 msgr2=0x7f082c0b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:49.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082b200640 1 -- 172.21.15.122:0/1871052293 shutdown_connections 2024-05-28T06:06:49.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082b200640 1 -- 172.21.15.122:0/1871052293 wait complete. 2024-05-28T06:06:49.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082b200640 1 Processor -- start 2024-05-28T06:06:49.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082b200640 1 -- start start 2024-05-28T06:06:49.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082b200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f082c0b3660 0x7f082c15b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:49.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082b200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f082c0d0ea0 0x7f082c15c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:49.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082b200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f082c15fb90 0x7f082c14d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:49.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082b200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f082c1610b0 con 0x7f082c15fb90 2024-05-28T06:06:49.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082b200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f082c160f30 con 0x7f082c0d0ea0 2024-05-28T06:06:49.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082b200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f082c0cdf50 con 0x7f082c0b3660 2024-05-28T06:06:49.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082a800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f082c15fb90 0x7f082c14d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:49.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082a800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f082c15fb90 0x7f082c14d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59828/0 (socket says 172.21.15.122:59828) 2024-05-28T06:06:49.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082a800640 1 -- 172.21.15.122:0/3729262733 learned_addr learned my addr 172.21.15.122:0/3729262733 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:49.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f0829e00640 1 --2- 172.21.15.122:0/3729262733 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f082c0b3660 0x7f082c15b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:49.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f0829400640 1 --2- 172.21.15.122:0/3729262733 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f082c0d0ea0 0x7f082c15c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:49.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082a800640 1 -- 172.21.15.122:0/3729262733 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f082c0b3660 msgr2=0x7f082c15b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:49.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082a800640 1 --2- 172.21.15.122:0/3729262733 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f082c0b3660 0x7f082c15b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:49.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082a800640 1 -- 172.21.15.122:0/3729262733 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f082c0d0ea0 msgr2=0x7f082c15c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:49.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082a800640 1 --2- 172.21.15.122:0/3729262733 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f082c0d0ea0 0x7f082c15c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:49.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.078+0000 7f082a800640 1 -- 172.21.15.122:0/3729262733 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f082c0af370 con 0x7f082c15fb90 2024-05-28T06:06:49.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.082+0000 7f082a800640 1 --2- 172.21.15.122:0/3729262733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f082c15fb90 0x7f082c14d970 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f08240b0040 tx=0x7f0824019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:49.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.082+0000 7f0822000640 1 -- 172.21.15.122:0/3729262733 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08240b2050 con 0x7f082c15fb90 2024-05-28T06:06:49.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.082+0000 7f0822000640 1 -- 172.21.15.122:0/3729262733 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08240be070 con 0x7f082c15fb90 2024-05-28T06:06:49.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.082+0000 7f0822000640 1 -- 172.21.15.122:0/3729262733 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08240ada50 con 0x7f082c15fb90 2024-05-28T06:06:49.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.082+0000 7f082b200640 1 -- 172.21.15.122:0/3729262733 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f082c0af650 con 0x7f082c15fb90 2024-05-28T06:06:49.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.082+0000 7f082b200640 1 -- 172.21.15.122:0/3729262733 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f082c15ab10 con 0x7f082c15fb90 2024-05-28T06:06:49.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.082+0000 7f082b200640 1 -- 172.21.15.122:0/3729262733 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f082c075620 con 0x7f082c15fb90 2024-05-28T06:06:49.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.082+0000 7f0822000640 1 -- 172.21.15.122:0/3729262733 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f08240adbf0 con 0x7f082c15fb90 2024-05-28T06:06:49.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.086+0000 7f0822000640 1 --2- 172.21.15.122:0/3729262733 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f080c068380 0x7f080c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:49.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.086+0000 7f0822000640 1 -- 172.21.15.122:0/3729262733 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5609+0+0 (secure 0 0 0) 0x7f08241225c0 con 0x7f082c15fb90 2024-05-28T06:06:49.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.086+0000 7f0829e00640 1 --2- 172.21.15.122:0/3729262733 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f080c068380 0x7f080c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:49.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.086+0000 7f0829e00640 1 --2- 172.21.15.122:0/3729262733 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f080c068380 0x7f080c06a840 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f081c000f70 tx=0x7f081c007df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:49.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.090+0000 7f0822000640 1 -- 172.21.15.122:0/3729262733 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0824016560 con 0x7f082c15fb90 2024-05-28T06:06:49.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.282+0000 7f082b200640 1 -- 172.21.15.122:0/3729262733 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f082c0b73a0 con 0x7f082c15fb90 2024-05-28T06:06:49.610 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-05-28T06:06:49.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.890+0000 7f0822000640 1 -- 172.21.15.122:0/3729262733 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v14) ==== 172+0+0 (secure 0 0 0) 0x7f08240f26a0 con 0x7f082c15fb90 2024-05-28T06:06:49.892 INFO:teuthology.orchestra.run.smithi122.stderr:new fs with metadata pool 4 and data pool 5 2024-05-28T06:06:49.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.890+0000 7f082b200640 1 -- 172.21.15.122:0/3729262733 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f080c068380 msgr2=0x7f080c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:49.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.890+0000 7f082b200640 1 --2- 172.21.15.122:0/3729262733 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f080c068380 0x7f080c06a840 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f081c000f70 tx=0x7f081c007df0 comp rx=0 tx=0).stop 2024-05-28T06:06:49.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.890+0000 7f082b200640 1 -- 172.21.15.122:0/3729262733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f082c15fb90 msgr2=0x7f082c14d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:49.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.890+0000 7f082b200640 1 --2- 172.21.15.122:0/3729262733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f082c15fb90 0x7f082c14d970 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f08240b0040 tx=0x7f0824019650 comp rx=0 tx=0).stop 2024-05-28T06:06:49.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.890+0000 7f082b200640 1 -- 172.21.15.122:0/3729262733 shutdown_connections 2024-05-28T06:06:49.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.890+0000 7f082b200640 1 --2- 172.21.15.122:0/3729262733 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f080c068380 0x7f080c06a840 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:49.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.890+0000 7f082b200640 1 --2- 172.21.15.122:0/3729262733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f082c15fb90 0x7f082c14d970 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:49.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.890+0000 7f082b200640 1 --2- 172.21.15.122:0/3729262733 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f082c0d0ea0 0x7f082c15c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:49.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.890+0000 7f082b200640 1 --2- 172.21.15.122:0/3729262733 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f082c0b3660 0x7f082c15b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:49.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.890+0000 7f082b200640 1 -- 172.21.15.122:0/3729262733 >> 172.21.15.122:0/3729262733 conn(0x7f082c09aa40 msgr2=0x7f082c15e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:49.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.890+0000 7f082b200640 1 -- 172.21.15.122:0/3729262733 shutdown_connections 2024-05-28T06:06:49.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:49.890+0000 7f082b200640 1 -- 172.21.15.122:0/3729262733 wait complete. 2024-05-28T06:06:49.948 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:06:50.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.082+0000 7f51a3200640 1 Processor -- start 2024-05-28T06:06:50.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.082+0000 7f51a3200640 1 -- start start 2024-05-28T06:06:50.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.082+0000 7f51a3200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f51a40b22c0 0x7f51a40b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:50.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.082+0000 7f51a3200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51a40cde10 0x7f51a40d1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:50.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.082+0000 7f51a3200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51a40b2be0 con 0x7f51a40ce270 2024-05-28T06:06:50.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.082+0000 7f51a3200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f51a40cf400 con 0x7f51a40b22c0 2024-05-28T06:06:50.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.082+0000 7f51a3200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f51a415b990 con 0x7f51a40cde10 2024-05-28T06:06:50.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.082+0000 7f51a1e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f51a40b22c0 0x7f51a40b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:50.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.082+0000 7f51a1e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f51a40b22c0 0x7f51a40b26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59830/0 (socket says 172.21.15.122:59830) 2024-05-28T06:06:50.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.082+0000 7f51a1e00640 1 -- 172.21.15.122:0/3781696644 learned_addr learned my addr 172.21.15.122:0/3781696644 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:50.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.082+0000 7f51a1400640 1 --2- 172.21.15.122:0/3781696644 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51a40cde10 0x7f51a40d1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:50.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.082+0000 7f51a1e00640 1 -- 172.21.15.122:0/3781696644 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51a40cde10 msgr2=0x7f51a40d1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:50.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.082+0000 7f51a1e00640 1 --2- 172.21.15.122:0/3781696644 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51a40cde10 0x7f51a40d1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:50.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.082+0000 7f51a1e00640 1 -- 172.21.15.122:0/3781696644 >> v1:172.21.15.153:6789/0 conn(0x7f51a40ce270 legacy=0x7f51a40d18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:50.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.082+0000 7f51a1e00640 1 -- 172.21.15.122:0/3781696644 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a40ce7f0 con 0x7f51a40b22c0 2024-05-28T06:06:50.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.086+0000 7f51a1e00640 1 --2- 172.21.15.122:0/3781696644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51a40b22c0 0x7f51a40b26a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5194009870 tx=0x7f519401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db55c766cbd8ca3f server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:50.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.086+0000 7f51a0a00640 1 -- 172.21.15.122:0/3781696644 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51940aa610 con 0x7f51a40b22c0 2024-05-28T06:06:50.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.086+0000 7f51a0a00640 1 -- 172.21.15.122:0/3781696644 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51940af070 con 0x7f51a40b22c0 2024-05-28T06:06:50.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.086+0000 7f51a0a00640 1 -- 172.21.15.122:0/3781696644 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51940aa9d0 con 0x7f51a40b22c0 2024-05-28T06:06:50.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.086+0000 7f51a3200640 1 -- 172.21.15.122:0/3781696644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51a40b22c0 msgr2=0x7f51a40b26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:50.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.086+0000 7f51a3200640 1 --2- 172.21.15.122:0/3781696644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51a40b22c0 0x7f51a40b26a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5194009870 tx=0x7f519401c4f0 comp rx=0 tx=0).stop 2024-05-28T06:06:50.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.086+0000 7f51a3200640 1 -- 172.21.15.122:0/3781696644 shutdown_connections 2024-05-28T06:06:50.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.086+0000 7f51a3200640 1 --2- 172.21.15.122:0/3781696644 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51a40cde10 0x7f51a40d1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:50.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.086+0000 7f51a3200640 1 --2- 172.21.15.122:0/3781696644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51a40b22c0 0x7f51a40b26a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:50.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.086+0000 7f51a3200640 1 -- 172.21.15.122:0/3781696644 >> 172.21.15.122:0/3781696644 conn(0x7f51a40b6b70 msgr2=0x7f51a409aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:50.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.086+0000 7f51a3200640 1 -- 172.21.15.122:0/3781696644 shutdown_connections 2024-05-28T06:06:50.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.086+0000 7f51a3200640 1 -- 172.21.15.122:0/3781696644 wait complete. 2024-05-28T06:06:50.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.086+0000 7f51a3200640 1 Processor -- start 2024-05-28T06:06:50.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.086+0000 7f51a3200640 1 -- start start 2024-05-28T06:06:50.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f51a3200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51a40b22c0 0x7f51a41512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:50.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f51a3200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51a40cde10 0x7f51a406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:50.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f51a3200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51a40ce270 0x7f51a414fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:50.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f51a3200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f51a40b4f50 con 0x7f51a40b22c0 2024-05-28T06:06:50.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f51a3200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f51a40b4dd0 con 0x7f51a40ce270 2024-05-28T06:06:50.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f51a3200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f51a40d1fe0 con 0x7f51a40cde10 2024-05-28T06:06:50.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f51a1e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51a40b22c0 0x7f51a41512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:50.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f51a1e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51a40b22c0 0x7f51a41512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59832/0 (socket says 172.21.15.122:59832) 2024-05-28T06:06:50.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f51a1e00640 1 -- 172.21.15.122:0/917145630 learned_addr learned my addr 172.21.15.122:0/917145630 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:50.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f51a1400640 1 --2- 172.21.15.122:0/917145630 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51a40cde10 0x7f51a406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:50.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f51a2800640 1 --2- 172.21.15.122:0/917145630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51a40ce270 0x7f51a414fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:50.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f51a1e00640 1 -- 172.21.15.122:0/917145630 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51a40cde10 msgr2=0x7f51a406f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:50.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f51a1e00640 1 --2- 172.21.15.122:0/917145630 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51a40cde10 0x7f51a406f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:50.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f51a1e00640 1 -- 172.21.15.122:0/917145630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51a40ce270 msgr2=0x7f51a414fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:50.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f51a1e00640 1 --2- 172.21.15.122:0/917145630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51a40ce270 0x7f51a414fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:50.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f51a1e00640 1 -- 172.21.15.122:0/917145630 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a415e100 con 0x7f51a40b22c0 2024-05-28T06:06:50.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f51a1e00640 1 --2- 172.21.15.122:0/917145630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51a40b22c0 0x7f51a41512c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f51940ac040 tx=0x7f519401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:50.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f519a000640 1 -- 172.21.15.122:0/917145630 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51940bd5f0 con 0x7f51a40b22c0 2024-05-28T06:06:50.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f519a000640 1 -- 172.21.15.122:0/917145630 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51940bd7b0 con 0x7f51a40b22c0 2024-05-28T06:06:50.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f519a000640 1 -- 172.21.15.122:0/917145630 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51940bdba0 con 0x7f51a40b22c0 2024-05-28T06:06:50.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f51a3200640 1 -- 172.21.15.122:0/917145630 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51a415e3e0 con 0x7f51a40b22c0 2024-05-28T06:06:50.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f51a3200640 1 -- 172.21.15.122:0/917145630 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51a40b01b0 con 0x7f51a40b22c0 2024-05-28T06:06:50.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f51a3200640 1 -- 172.21.15.122:0/917145630 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51a4075620 con 0x7f51a40b22c0 2024-05-28T06:06:50.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.090+0000 7f519a000640 1 -- 172.21.15.122:0/917145630 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f51940b33f0 con 0x7f51a40b22c0 2024-05-28T06:06:50.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.094+0000 7f519a000640 1 --2- 172.21.15.122:0/917145630 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5184068380 0x7f518406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:50.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.094+0000 7f519a000640 1 -- 172.21.15.122:0/917145630 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f51941213b0 con 0x7f51a40b22c0 2024-05-28T06:06:50.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.094+0000 7f51a1400640 1 --2- 172.21.15.122:0/917145630 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5184068380 0x7f518406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:50.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.094+0000 7f51a1400640 1 --2- 172.21.15.122:0/917145630 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5184068380 0x7f518406a840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f51a406faf0 tx=0x7f5190008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:50.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.098+0000 7f519a000640 1 -- 172.21.15.122:0/917145630 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f51940a7070 con 0x7f51a40b22c0 2024-05-28T06:06:50.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.254+0000 7f51a3200640 1 -- 172.21.15.122:0/917145630 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51a40b0380 con 0x7f51a40b22c0 2024-05-28T06:06:50.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.254+0000 7f519a000640 1 -- 172.21.15.122:0/917145630 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16682 (secure 0 0 0) 0x7f5194016110 con 0x7f51a40b22c0 2024-05-28T06:06:50.259 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:50.259 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":33,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:06:49.284516+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:06:47.799439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-28T06:06:48.236731+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:06:50.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.258+0000 7f51a3200640 1 -- 172.21.15.122:0/917145630 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5184068380 msgr2=0x7f518406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:50.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.258+0000 7f51a3200640 1 --2- 172.21.15.122:0/917145630 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5184068380 0x7f518406a840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f51a406faf0 tx=0x7f5190008040 comp rx=0 tx=0).stop 2024-05-28T06:06:50.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.258+0000 7f51a3200640 1 -- 172.21.15.122:0/917145630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51a40b22c0 msgr2=0x7f51a41512c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:50.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.258+0000 7f51a3200640 1 --2- 172.21.15.122:0/917145630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51a40b22c0 0x7f51a41512c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f51940ac040 tx=0x7f519401ad30 comp rx=0 tx=0).stop 2024-05-28T06:06:50.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.258+0000 7f51a3200640 1 -- 172.21.15.122:0/917145630 shutdown_connections 2024-05-28T06:06:50.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.258+0000 7f51a3200640 1 --2- 172.21.15.122:0/917145630 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5184068380 0x7f518406a840 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:50.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.258+0000 7f51a3200640 1 --2- 172.21.15.122:0/917145630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51a40ce270 0x7f51a414fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:50.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.258+0000 7f51a3200640 1 --2- 172.21.15.122:0/917145630 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51a40cde10 0x7f51a406f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:50.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.258+0000 7f51a3200640 1 --2- 172.21.15.122:0/917145630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51a40b22c0 0x7f51a41512c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:50.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.258+0000 7f51a3200640 1 -- 172.21.15.122:0/917145630 >> 172.21.15.122:0/917145630 conn(0x7f51a40b6b70 msgr2=0x7f51a40b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:50.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.258+0000 7f51a3200640 1 -- 172.21.15.122:0/917145630 shutdown_connections 2024-05-28T06:06:50.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.258+0000 7f51a3200640 1 -- 172.21.15.122:0/917145630 wait complete. 2024-05-28T06:06:50.281 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:06:50.418 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.414+0000 7f2201000640 1 Processor -- start 2024-05-28T06:06:50.418 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.414+0000 7f2201000640 1 -- start start 2024-05-28T06:06:50.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f2201000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21fc06f890 0x7f21fc0cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:50.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f2201000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f21fc0cd930 0x7f21fc0b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:50.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f2201000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21fc0d0310 con 0x7f21fc0cff30 2024-05-28T06:06:50.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f2201000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f21fc15be20 con 0x7f21fc0cd930 2024-05-28T06:06:50.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f2201000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f21fc15c100 con 0x7f21fc06f890 2024-05-28T06:06:50.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f21fc0cff30 0x7f21fc06f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:43932/0 (socket says 172.21.15.122:43932) 2024-05-28T06:06:50.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9e00640 1 -- 172.21.15.122:0/952348855 learned_addr learned my addr 172.21.15.122:0/952348855 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:50.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21fa800640 1 --2- 172.21.15.122:0/952348855 >> v2:172.21.15.153:3300/0 conn(0x7f21fc0cd930 0x7f21fc0b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:50.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f1400640 1 --2- 172.21.15.122:0/952348855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21fc06f890 0x7f21fc0cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:50.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9400640 1 -- 172.21.15.122:0/952348855 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1549400453 0 0) 0x7f21fc0d0310 con 0x7f21fc0cff30 2024-05-28T06:06:50.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9400640 1 -- 172.21.15.122:0/952348855 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21e0003530 con 0x7f21fc0cff30 2024-05-28T06:06:50.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9400640 1 -- 172.21.15.122:0/952348855 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3815651723 0 0) 0x7f21e0003530 con 0x7f21fc0cff30 2024-05-28T06:06:50.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9400640 1 -- 172.21.15.122:0/952348855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21fc06f890 msgr2=0x7f21fc0cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:50.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9400640 1 --2- 172.21.15.122:0/952348855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21fc06f890 0x7f21fc0cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:50.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9400640 1 -- 172.21.15.122:0/952348855 >> v2:172.21.15.153:3300/0 conn(0x7f21fc0cd930 msgr2=0x7f21fc0b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:50.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9400640 1 --2- 172.21.15.122:0/952348855 >> v2:172.21.15.153:3300/0 conn(0x7f21fc0cd930 0x7f21fc0b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:50.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9400640 1 -- 172.21.15.122:0/952348855 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21fc15c3e0 con 0x7f21fc0cff30 2024-05-28T06:06:50.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9400640 1 -- 172.21.15.122:0/952348855 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f21ec0016a0 con 0x7f21fc0cff30 2024-05-28T06:06:50.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f1400640 1 --2- 172.21.15.122:0/952348855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21fc06f890 0x7f21fc0cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:06:50.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21fa800640 1 --2- 172.21.15.122:0/952348855 >> v2:172.21.15.153:3300/0 conn(0x7f21fc0cd930 0x7f21fc0b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:06:50.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9400640 1 -- 172.21.15.122:0/952348855 >> v1:172.21.15.122:6789/0 conn(0x7f21fc0cff30 legacy=0x7f21fc06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:50.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9400640 1 --2- 172.21.15.122:0/952348855 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21e00039c0 0x7f21e0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:50.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9400640 1 --2- 172.21.15.122:0/952348855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21e0004810 0x7f21e0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:50.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9400640 1 --2- 172.21.15.122:0/952348855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21fc06f890 0x7f21e00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:50.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9400640 1 -- 172.21.15.122:0/952348855 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f21fc15be20 con 0x7f21e00039c0 2024-05-28T06:06:50.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9400640 1 -- 172.21.15.122:0/952348855 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f21fc15c100 con 0x7f21e0004810 2024-05-28T06:06:50.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9400640 1 -- 172.21.15.122:0/952348855 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f21e000b9d0 con 0x7f21fc06f890 2024-05-28T06:06:50.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9e00640 1 --2- 172.21.15.122:0/952348855 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21e00039c0 0x7f21e0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:50.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f1400640 1 --2- 172.21.15.122:0/952348855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21e0004810 0x7f21e0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:50.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21fa800640 1 --2- 172.21.15.122:0/952348855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21fc06f890 0x7f21e00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:50.424 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9e00640 1 -- 172.21.15.122:0/952348855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21fc06f890 msgr2=0x7f21e00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:50.424 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9e00640 1 --2- 172.21.15.122:0/952348855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21fc06f890 0x7f21e00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:50.424 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9e00640 1 -- 172.21.15.122:0/952348855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21e0004810 msgr2=0x7f21e0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:50.424 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9e00640 1 --2- 172.21.15.122:0/952348855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21e0004810 0x7f21e0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:50.424 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.418+0000 7f21f9e00640 1 -- 172.21.15.122:0/952348855 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e0003530 con 0x7f21e00039c0 2024-05-28T06:06:50.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.422+0000 7f21f9e00640 1 --2- 172.21.15.122:0/952348855 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21e00039c0 0x7f21e0003de0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f21ec007d30 tx=0x7f21ec01ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70ac2904aafacc0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:50.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.422+0000 7f21f9400640 1 -- 172.21.15.122:0/952348855 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec007d70 con 0x7f21e00039c0 2024-05-28T06:06:50.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.422+0000 7f21f9400640 1 -- 172.21.15.122:0/952348855 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ec0ab020 con 0x7f21e00039c0 2024-05-28T06:06:50.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.422+0000 7f21f9400640 1 -- 172.21.15.122:0/952348855 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec0a7bd0 con 0x7f21e00039c0 2024-05-28T06:06:50.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.422+0000 7f2201000640 1 -- 172.21.15.122:0/952348855 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21e00039c0 msgr2=0x7f21e0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:50.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.422+0000 7f2201000640 1 --2- 172.21.15.122:0/952348855 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21e00039c0 0x7f21e0003de0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f21ec007d30 tx=0x7f21ec01ee80 comp rx=0 tx=0).stop 2024-05-28T06:06:50.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.422+0000 7f21fa800640 1 -- 172.21.15.122:0/952348855 reap_dead start 2024-05-28T06:06:50.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.422+0000 7f2201000640 1 -- 172.21.15.122:0/952348855 shutdown_connections 2024-05-28T06:06:50.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.422+0000 7f2201000640 1 -- 172.21.15.122:0/952348855 >> 172.21.15.122:0/952348855 conn(0x7f21fc06bd90 msgr2=0x7f21fc06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:50.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.422+0000 7f2201000640 1 -- 172.21.15.122:0/952348855 shutdown_connections 2024-05-28T06:06:50.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.422+0000 7f2201000640 1 -- 172.21.15.122:0/952348855 wait complete. 2024-05-28T06:06:50.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.422+0000 7f2201000640 1 Processor -- start 2024-05-28T06:06:50.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.422+0000 7f2201000640 1 -- start start 2024-05-28T06:06:50.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.426+0000 7f2201000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21e00039c0 0x7f21fc158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:50.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.426+0000 7f2201000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21fc149b50 0x7f21fc0ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:50.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.426+0000 7f2201000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21fc0ae800 0x7f21fc1607b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:50.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.426+0000 7f2201000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f21fc0b5700 con 0x7f21e00039c0 2024-05-28T06:06:50.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.426+0000 7f2201000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f21fc0b5880 con 0x7f21fc0ae800 2024-05-28T06:06:50.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.426+0000 7f2201000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f21fc0b5a00 con 0x7f21fc149b50 2024-05-28T06:06:50.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.426+0000 7f21f9e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21e00039c0 0x7f21fc158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:50.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.426+0000 7f21f9e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21e00039c0 0x7f21fc158cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59844/0 (socket says 172.21.15.122:59844) 2024-05-28T06:06:50.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.426+0000 7f21f9e00640 1 -- 172.21.15.122:0/1912793866 learned_addr learned my addr 172.21.15.122:0/1912793866 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:50.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.426+0000 7f21f1400640 1 --2- 172.21.15.122:0/1912793866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21fc149b50 0x7f21fc0ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:50.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.426+0000 7f21fa800640 1 --2- 172.21.15.122:0/1912793866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21fc0ae800 0x7f21fc1607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:50.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.426+0000 7f21f9e00640 1 -- 172.21.15.122:0/1912793866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21fc149b50 msgr2=0x7f21fc0ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:50.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.426+0000 7f21f9e00640 1 --2- 172.21.15.122:0/1912793866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21fc149b50 0x7f21fc0ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:50.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.426+0000 7f21f9e00640 1 -- 172.21.15.122:0/1912793866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21fc0ae800 msgr2=0x7f21fc1607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:50.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.426+0000 7f21f9e00640 1 --2- 172.21.15.122:0/1912793866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21fc0ae800 0x7f21fc1607b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:50.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.426+0000 7f21f9e00640 1 -- 172.21.15.122:0/1912793866 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21fc1561d0 con 0x7f21e00039c0 2024-05-28T06:06:50.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.426+0000 7f21f9e00640 1 --2- 172.21.15.122:0/1912793866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21e00039c0 0x7f21fc158cf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f21ec007040 tx=0x7f21e0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:50.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.426+0000 7f21f2a00640 1 -- 172.21.15.122:0/1912793866 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec001cb0 con 0x7f21e00039c0 2024-05-28T06:06:50.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.426+0000 7f21f2a00640 1 -- 172.21.15.122:0/1912793866 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ec0a7bb0 con 0x7f21e00039c0 2024-05-28T06:06:50.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.426+0000 7f2201000640 1 -- 172.21.15.122:0/1912793866 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21fc0aeca0 con 0x7f21e00039c0 2024-05-28T06:06:50.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.426+0000 7f21f2a00640 1 -- 172.21.15.122:0/1912793866 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec0047f0 con 0x7f21e00039c0 2024-05-28T06:06:50.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.426+0000 7f2201000640 1 -- 172.21.15.122:0/1912793866 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21fc0b0440 con 0x7f21e00039c0 2024-05-28T06:06:50.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.426+0000 7f2201000640 1 -- 172.21.15.122:0/1912793866 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21fc068c40 con 0x7f21e00039c0 2024-05-28T06:06:50.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.430+0000 7f21f2a00640 1 -- 172.21.15.122:0/1912793866 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f21ec0b8020 con 0x7f21e00039c0 2024-05-28T06:06:50.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.430+0000 7f21f2a00640 1 --2- 172.21.15.122:0/1912793866 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f21d8068380 0x7f21d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:50.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.430+0000 7f21f2a00640 1 -- 172.21.15.122:0/1912793866 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f21ec11ff30 con 0x7f21e00039c0 2024-05-28T06:06:50.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.430+0000 7f21f1400640 1 --2- 172.21.15.122:0/1912793866 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f21d8068380 0x7f21d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:50.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.430+0000 7f21f1400640 1 --2- 172.21.15.122:0/1912793866 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f21d8068380 0x7f21d806a840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f21fc160700 tx=0x7f21e4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:50.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.434+0000 7f21f2a00640 1 -- 172.21.15.122:0/1912793866 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f21fc1561d0 con 0x7f21e00039c0 2024-05-28T06:06:50.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.590+0000 7f2201000640 1 -- 172.21.15.122:0/1912793866 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21fc155f70 con 0x7f21e00039c0 2024-05-28T06:06:50.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.594+0000 7f21f2a00640 1 -- 172.21.15.122:0/1912793866 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16682 (secure 0 0 0) 0x7f21ec018bc0 con 0x7f21e00039c0 2024-05-28T06:06:50.596 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:50.596 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":33,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:06:49.284516+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:06:47.799439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-28T06:06:48.236731+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:06:50.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.594+0000 7f2201000640 1 -- 172.21.15.122:0/1912793866 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f21d8068380 msgr2=0x7f21d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:50.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.594+0000 7f2201000640 1 --2- 172.21.15.122:0/1912793866 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f21d8068380 0x7f21d806a840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f21fc160700 tx=0x7f21e4009190 comp rx=0 tx=0).stop 2024-05-28T06:06:50.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.594+0000 7f2201000640 1 -- 172.21.15.122:0/1912793866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21e00039c0 msgr2=0x7f21fc158cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:50.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.594+0000 7f2201000640 1 --2- 172.21.15.122:0/1912793866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21e00039c0 0x7f21fc158cf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f21ec007040 tx=0x7f21e0005840 comp rx=0 tx=0).stop 2024-05-28T06:06:50.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.594+0000 7f2201000640 1 -- 172.21.15.122:0/1912793866 shutdown_connections 2024-05-28T06:06:50.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.594+0000 7f2201000640 1 --2- 172.21.15.122:0/1912793866 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f21d8068380 0x7f21d806a840 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:50.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.594+0000 7f2201000640 1 --2- 172.21.15.122:0/1912793866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21fc0ae800 0x7f21fc1607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:50.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.594+0000 7f2201000640 1 --2- 172.21.15.122:0/1912793866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21fc149b50 0x7f21fc0ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:50.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.594+0000 7f2201000640 1 --2- 172.21.15.122:0/1912793866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21e00039c0 0x7f21fc158cf0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:50.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.594+0000 7f2201000640 1 -- 172.21.15.122:0/1912793866 >> 172.21.15.122:0/1912793866 conn(0x7f21fc06bd90 msgr2=0x7f21fc1531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:50.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.594+0000 7f2201000640 1 -- 172.21.15.122:0/1912793866 shutdown_connections 2024-05-28T06:06:50.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.594+0000 7f2201000640 1 -- 172.21.15.122:0/1912793866 wait complete. 2024-05-28T06:06:50.618 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-28T06:06:50.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.754+0000 7f728c000640 1 Processor -- start 2024-05-28T06:06:50.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.754+0000 7f728c000640 1 -- start start 2024-05-28T06:06:50.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.754+0000 7f728c000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f728415a420 0x7f72840ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:50.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.754+0000 7f728c000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72841604e0 con 0x7f728406fc90 2024-05-28T06:06:50.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.754+0000 7f728c000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72841607c0 con 0x7f72840b6670 2024-05-28T06:06:50.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.754+0000 7f728c000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f7284160aa0 con 0x7f728415a420 2024-05-28T06:06:50.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.754+0000 7f728a000640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f728406fc90 0x7f728415cd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:43938/0 (socket says 172.21.15.122:43938) 2024-05-28T06:06:50.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.754+0000 7f7289600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f728415a420 0x7f72840ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:50.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.754+0000 7f728a000640 1 -- 172.21.15.122:0/2925485877 learned_addr learned my addr 172.21.15.122:0/2925485877 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:50.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.754+0000 7f7289600640 1 -- 172.21.15.122:0/2925485877 >> v1:172.21.15.153:6789/0 conn(0x7f72840b6670 legacy=0x7f728406f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:50.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.754+0000 7f7289600640 1 -- 172.21.15.122:0/2925485877 >> v1:172.21.15.122:6789/0 conn(0x7f728406fc90 legacy=0x7f728415cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:50.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.754+0000 7f7289600640 1 -- 172.21.15.122:0/2925485877 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7284160d80 con 0x7f728415a420 2024-05-28T06:06:50.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.754+0000 7f7283e00640 1 -- 172.21.15.122:0/2925485877 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 697024038 0 0) 0x7f72841604e0 con 0x7f728406fc90 2024-05-28T06:06:50.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.758+0000 7f7289600640 1 --2- 172.21.15.122:0/2925485877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f728415a420 0x7f72840ce7a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7278009d90 tx=0x7f727801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cfbf3d00e99f438 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:50.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.758+0000 7f7283e00640 1 -- 172.21.15.122:0/2925485877 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72780b2070 con 0x7f728415a420 2024-05-28T06:06:50.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.758+0000 7f7283e00640 1 -- 172.21.15.122:0/2925485877 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72780a5940 con 0x7f728415a420 2024-05-28T06:06:50.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.758+0000 7f7283e00640 1 -- 172.21.15.122:0/2925485877 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72780a5d10 con 0x7f728415a420 2024-05-28T06:06:50.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.758+0000 7f728c000640 1 -- 172.21.15.122:0/2925485877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f728415a420 msgr2=0x7f72840ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:50.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.758+0000 7f728c000640 1 --2- 172.21.15.122:0/2925485877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f728415a420 0x7f72840ce7a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7278009d90 tx=0x7f727801c970 comp rx=0 tx=0).stop 2024-05-28T06:06:50.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.758+0000 7f728c000640 1 -- 172.21.15.122:0/2925485877 shutdown_connections 2024-05-28T06:06:50.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.758+0000 7f728c000640 1 --2- 172.21.15.122:0/2925485877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f728415a420 0x7f72840ce7a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:50.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.758+0000 7f728c000640 1 -- 172.21.15.122:0/2925485877 >> 172.21.15.122:0/2925485877 conn(0x7f72840b6d30 msgr2=0x7f72840b7140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:50.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.758+0000 7f728c000640 1 -- 172.21.15.122:0/2925485877 shutdown_connections 2024-05-28T06:06:50.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.758+0000 7f728c000640 1 -- 172.21.15.122:0/2925485877 wait complete. 2024-05-28T06:06:50.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f728c000640 1 Processor -- start 2024-05-28T06:06:50.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f728c000640 1 -- start start 2024-05-28T06:06:50.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f728c000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f728406fc90 0x7f72840cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:50.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f728c000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72840b6670 0x7f728414a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:50.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f728c000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f728415a420 0x7f728415dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:50.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f728c000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f728416a870 con 0x7f72840b6670 2024-05-28T06:06:50.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f728c000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f728416a6f0 con 0x7f728415a420 2024-05-28T06:06:50.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f728c000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f728416a9f0 con 0x7f728406fc90 2024-05-28T06:06:50.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f7288c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72840b6670 0x7f728414a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:50.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f7288c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72840b6670 0x7f728414a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59872/0 (socket says 172.21.15.122:59872) 2024-05-28T06:06:50.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f7288c00640 1 -- 172.21.15.122:0/2863722087 learned_addr learned my addr 172.21.15.122:0/2863722087 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:50.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f7289600640 1 --2- 172.21.15.122:0/2863722087 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f728406fc90 0x7f72840cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:50.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f728a000640 1 --2- 172.21.15.122:0/2863722087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f728415a420 0x7f728415dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:50.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f7288c00640 1 -- 172.21.15.122:0/2863722087 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f728406fc90 msgr2=0x7f72840cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:50.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f7288c00640 1 --2- 172.21.15.122:0/2863722087 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f728406fc90 0x7f72840cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:50.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f7288c00640 1 -- 172.21.15.122:0/2863722087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f728415a420 msgr2=0x7f728415dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:50.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f7288c00640 1 --2- 172.21.15.122:0/2863722087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f728415a420 0x7f728415dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:50.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f7288c00640 1 -- 172.21.15.122:0/2863722087 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f728415c870 con 0x7f72840b6670 2024-05-28T06:06:50.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f7288c00640 1 --2- 172.21.15.122:0/2863722087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72840b6670 0x7f728414a530 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f727000c500 tx=0x7f727000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:50.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f7281600640 1 -- 172.21.15.122:0/2863722087 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7270016020 con 0x7f72840b6670 2024-05-28T06:06:50.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f7281600640 1 -- 172.21.15.122:0/2863722087 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7270005220 con 0x7f72840b6670 2024-05-28T06:06:50.768 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f7281600640 1 -- 172.21.15.122:0/2863722087 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7270007030 con 0x7f72840b6670 2024-05-28T06:06:50.768 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f728c000640 1 -- 172.21.15.122:0/2863722087 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7284152830 con 0x7f72840b6670 2024-05-28T06:06:50.768 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f728c000640 1 -- 172.21.15.122:0/2863722087 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f728414bb90 con 0x7f72840b6670 2024-05-28T06:06:50.768 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.762+0000 7f728c000640 1 -- 172.21.15.122:0/2863722087 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7284068c40 con 0x7f72840b6670 2024-05-28T06:06:50.768 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.766+0000 7f7281600640 1 -- 172.21.15.122:0/2863722087 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f72700071f0 con 0x7f72840b6670 2024-05-28T06:06:50.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.766+0000 7f7281600640 1 --2- 172.21.15.122:0/2863722087 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7264068380 0x7f726406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:50.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.766+0000 7f7281600640 1 -- 172.21.15.122:0/2863722087 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f7270086460 con 0x7f72840b6670 2024-05-28T06:06:50.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.766+0000 7f7289600640 1 --2- 172.21.15.122:0/2863722087 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7264068380 0x7f726406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:50.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.766+0000 7f7289600640 1 --2- 172.21.15.122:0/2863722087 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7264068380 0x7f726406a840 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f72780af000 tx=0x7f72780a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:50.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.770+0000 7f7281600640 1 -- 172.21.15.122:0/2863722087 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7270020020 con 0x7f72840b6670 2024-05-28T06:06:50.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:50.962+0000 7f728c000640 1 -- 172.21.15.122:0/2863722087 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f728415aef0 con 0x7f72840b6670 2024-05-28T06:06:51.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:51.922+0000 7f7281600640 1 -- 172.21.15.122:0/2863722087 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f7270056990 con 0x7f72840b6670 2024-05-28T06:06:51.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:51.922+0000 7f728c000640 1 -- 172.21.15.122:0/2863722087 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7264068380 msgr2=0x7f726406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:51.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:51.922+0000 7f728c000640 1 --2- 172.21.15.122:0/2863722087 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7264068380 0x7f726406a840 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f72780af000 tx=0x7f72780a7070 comp rx=0 tx=0).stop 2024-05-28T06:06:51.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:51.922+0000 7f728c000640 1 -- 172.21.15.122:0/2863722087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72840b6670 msgr2=0x7f728414a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:51.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:51.922+0000 7f728c000640 1 --2- 172.21.15.122:0/2863722087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72840b6670 0x7f728414a530 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f727000c500 tx=0x7f727000c9c0 comp rx=0 tx=0).stop 2024-05-28T06:06:51.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:51.922+0000 7f728c000640 1 -- 172.21.15.122:0/2863722087 shutdown_connections 2024-05-28T06:06:51.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:51.922+0000 7f728c000640 1 --2- 172.21.15.122:0/2863722087 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7264068380 0x7f726406a840 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:51.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:51.922+0000 7f728c000640 1 --2- 172.21.15.122:0/2863722087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f728415a420 0x7f728415dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:51.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:51.922+0000 7f728c000640 1 --2- 172.21.15.122:0/2863722087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72840b6670 0x7f728414a530 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:51.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:51.922+0000 7f728c000640 1 --2- 172.21.15.122:0/2863722087 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f728406fc90 0x7f72840cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:51.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:51.922+0000 7f728c000640 1 -- 172.21.15.122:0/2863722087 >> 172.21.15.122:0/2863722087 conn(0x7f72840b6d30 msgr2=0x7f728415ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:51.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:51.926+0000 7f728c000640 1 -- 172.21.15.122:0/2863722087 shutdown_connections 2024-05-28T06:06:51.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:51.926+0000 7f728c000640 1 -- 172.21.15.122:0/2863722087 wait complete. 2024-05-28T06:06:51.948 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-28T06:06:51.948 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-28T06:06:52.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.086+0000 7fc4eac00640 1 Processor -- start 2024-05-28T06:06:52.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.086+0000 7fc4eac00640 1 -- start start 2024-05-28T06:06:52.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.086+0000 7fc4eac00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc4e40b58d0 0x7fc4e40b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:52.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.086+0000 7fc4eac00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc4e415e730 0x7fc4e415eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:52.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.086+0000 7fc4eac00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4e40b61f0 con 0x7fc4e40ce4f0 2024-05-28T06:06:52.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.086+0000 7fc4eac00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fc4e415d970 con 0x7fc4e40b58d0 2024-05-28T06:06:52.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.086+0000 7fc4eac00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc4e415dc50 con 0x7fc4e415e730 2024-05-28T06:06:52.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.086+0000 7fc4e3e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc4e40b58d0 0x7fc4e40b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:52.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.086+0000 7fc4e3e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc4e40b58d0 0x7fc4e40b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59876/0 (socket says 172.21.15.122:59876) 2024-05-28T06:06:52.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.086+0000 7fc4e3e00640 1 -- 172.21.15.122:0/3346687041 learned_addr learned my addr 172.21.15.122:0/3346687041 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:52.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.086+0000 7fc4e8c00640 1 --2- 172.21.15.122:0/3346687041 >> v2:172.21.15.153:3300/0 conn(0x7fc4e415e730 0x7fc4e415eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:52.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.086+0000 7fc4e3e00640 1 -- 172.21.15.122:0/3346687041 >> v2:172.21.15.153:3300/0 conn(0x7fc4e415e730 msgr2=0x7fc4e415eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:52.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.086+0000 7fc4e3e00640 1 --2- 172.21.15.122:0/3346687041 >> v2:172.21.15.153:3300/0 conn(0x7fc4e415e730 0x7fc4e415eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:52.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.086+0000 7fc4e3e00640 1 -- 172.21.15.122:0/3346687041 >> v1:172.21.15.153:6789/0 conn(0x7fc4e40ce4f0 legacy=0x7fc4e40ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:52.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.086+0000 7fc4e3e00640 1 -- 172.21.15.122:0/3346687041 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e415df30 con 0x7fc4e40b58d0 2024-05-28T06:06:52.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.090+0000 7fc4e3e00640 1 --2- 172.21.15.122:0/3346687041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4e40b58d0 0x7fc4e40b5cb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc4e40b02c0 tx=0x7fc4d401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f51a721363b710 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:52.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.090+0000 7fc4e2a00640 1 -- 172.21.15.122:0/3346687041 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d40b0070 con 0x7fc4e40b58d0 2024-05-28T06:06:52.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.090+0000 7fc4e2a00640 1 -- 172.21.15.122:0/3346687041 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d40ab600 con 0x7fc4e40b58d0 2024-05-28T06:06:52.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.090+0000 7fc4e2a00640 1 -- 172.21.15.122:0/3346687041 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d40ab9d0 con 0x7fc4e40b58d0 2024-05-28T06:06:52.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.090+0000 7fc4eac00640 1 -- 172.21.15.122:0/3346687041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4e40b58d0 msgr2=0x7fc4e40b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:52.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.090+0000 7fc4eac00640 1 --2- 172.21.15.122:0/3346687041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4e40b58d0 0x7fc4e40b5cb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc4e40b02c0 tx=0x7fc4d401c4e0 comp rx=0 tx=0).stop 2024-05-28T06:06:52.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.090+0000 7fc4eac00640 1 -- 172.21.15.122:0/3346687041 shutdown_connections 2024-05-28T06:06:52.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.090+0000 7fc4eac00640 1 --2- 172.21.15.122:0/3346687041 >> v2:172.21.15.153:3300/0 conn(0x7fc4e415e730 0x7fc4e415eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:52.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.090+0000 7fc4eac00640 1 --2- 172.21.15.122:0/3346687041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4e40b58d0 0x7fc4e40b5cb0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:52.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.090+0000 7fc4eac00640 1 -- 172.21.15.122:0/3346687041 >> 172.21.15.122:0/3346687041 conn(0x7fc4e406bd90 msgr2=0x7fc4e406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:52.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.090+0000 7fc4eac00640 1 -- 172.21.15.122:0/3346687041 shutdown_connections 2024-05-28T06:06:52.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.090+0000 7fc4eac00640 1 -- 172.21.15.122:0/3346687041 wait complete. 2024-05-28T06:06:52.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.090+0000 7fc4eac00640 1 Processor -- start 2024-05-28T06:06:52.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.090+0000 7fc4eac00640 1 -- start start 2024-05-28T06:06:52.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.094+0000 7fc4eac00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e40b58d0 0x7fc4e40b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:52.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.094+0000 7fc4eac00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e40ce4f0 0x7fc4e413d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:52.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.094+0000 7fc4eac00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4e415e730 0x7fc4e4160190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:52.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.094+0000 7fc4eac00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e41693d0 con 0x7fc4e415e730 2024-05-28T06:06:52.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.094+0000 7fc4eac00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e4169250 con 0x7fc4e40b58d0 2024-05-28T06:06:52.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.094+0000 7fc4eac00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc4e4169550 con 0x7fc4e40ce4f0 2024-05-28T06:06:52.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.094+0000 7fc4e8c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4e415e730 0x7fc4e4160190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:52.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.094+0000 7fc4e8c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4e415e730 0x7fc4e4160190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59882/0 (socket says 172.21.15.122:59882) 2024-05-28T06:06:52.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.094+0000 7fc4e8c00640 1 -- 172.21.15.122:0/3408714644 learned_addr learned my addr 172.21.15.122:0/3408714644 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:52.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.094+0000 7fc4e3e00640 1 --2- 172.21.15.122:0/3408714644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e40b58d0 0x7fc4e40b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:52.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.094+0000 7fc4e3400640 1 --2- 172.21.15.122:0/3408714644 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e40ce4f0 0x7fc4e413d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:52.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.094+0000 7fc4e8c00640 1 -- 172.21.15.122:0/3408714644 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e40ce4f0 msgr2=0x7fc4e413d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:52.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.094+0000 7fc4e8c00640 1 --2- 172.21.15.122:0/3408714644 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e40ce4f0 0x7fc4e413d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:52.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.094+0000 7fc4e8c00640 1 -- 172.21.15.122:0/3408714644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e40b58d0 msgr2=0x7fc4e40b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:52.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.094+0000 7fc4e8c00640 1 --2- 172.21.15.122:0/3408714644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e40b58d0 0x7fc4e40b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:52.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.094+0000 7fc4e8c00640 1 -- 172.21.15.122:0/3408714644 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e40b34a0 con 0x7fc4e415e730 2024-05-28T06:06:52.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.094+0000 7fc4e8c00640 1 --2- 172.21.15.122:0/3408714644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4e415e730 0x7fc4e4160190 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc007e60 tx=0x7fc4dc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:52.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.094+0000 7fc4dbe00640 1 -- 172.21.15.122:0/3408714644 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc014420 con 0x7fc4e415e730 2024-05-28T06:06:52.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.094+0000 7fc4dbe00640 1 -- 172.21.15.122:0/3408714644 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4dc019070 con 0x7fc4e415e730 2024-05-28T06:06:52.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.094+0000 7fc4eac00640 1 -- 172.21.15.122:0/3408714644 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e40b3780 con 0x7fc4e415e730 2024-05-28T06:06:52.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.094+0000 7fc4dbe00640 1 -- 172.21.15.122:0/3408714644 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc014820 con 0x7fc4e415e730 2024-05-28T06:06:52.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.094+0000 7fc4eac00640 1 -- 172.21.15.122:0/3408714644 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e40b3d40 con 0x7fc4e415e730 2024-05-28T06:06:52.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.094+0000 7fc4eac00640 1 -- 172.21.15.122:0/3408714644 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4e4068c40 con 0x7fc4e415e730 2024-05-28T06:06:52.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.098+0000 7fc4dbe00640 1 -- 172.21.15.122:0/3408714644 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc4dc0149c0 con 0x7fc4e415e730 2024-05-28T06:06:52.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.098+0000 7fc4dbe00640 1 --2- 172.21.15.122:0/3408714644 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc4c4068380 0x7fc4c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:52.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.098+0000 7fc4dbe00640 1 -- 172.21.15.122:0/3408714644 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc4dc087270 con 0x7fc4e415e730 2024-05-28T06:06:52.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.098+0000 7fc4e3e00640 1 --2- 172.21.15.122:0/3408714644 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc4c4068380 0x7fc4c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:52.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.098+0000 7fc4e3e00640 1 --2- 172.21.15.122:0/3408714644 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc4c4068380 0x7fc4c406a840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40ad000 tx=0x7fc4d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:52.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.102+0000 7fc4dbe00640 1 -- 172.21.15.122:0/3408714644 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc4dc057790 con 0x7fc4e415e730 2024-05-28T06:06:52.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.290+0000 7fc4eac00640 1 -- 172.21.15.122:0/3408714644 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc4e41449e0 con 0x7fc4e415e730 2024-05-28T06:06:52.686 INFO:tasks.ceph.mds.a.smithi122.stderr:2024-05-28T06:06:52.682+0000 7ff76f000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-28T06:06:52.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.926+0000 7fc4dbe00640 1 -- 172.21.15.122:0/3408714644 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7fc4dc057090 con 0x7fc4e415e730 2024-05-28T06:06:52.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.930+0000 7fc4eac00640 1 -- 172.21.15.122:0/3408714644 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc4c4068380 msgr2=0x7fc4c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:52.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.930+0000 7fc4eac00640 1 --2- 172.21.15.122:0/3408714644 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc4c4068380 0x7fc4c406a840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40ad000 tx=0x7fc4d4008040 comp rx=0 tx=0).stop 2024-05-28T06:06:52.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.930+0000 7fc4eac00640 1 -- 172.21.15.122:0/3408714644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4e415e730 msgr2=0x7fc4e4160190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:52.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.930+0000 7fc4eac00640 1 --2- 172.21.15.122:0/3408714644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4e415e730 0x7fc4e4160190 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc007e60 tx=0x7fc4dc00e4b0 comp rx=0 tx=0).stop 2024-05-28T06:06:52.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.930+0000 7fc4eac00640 1 -- 172.21.15.122:0/3408714644 shutdown_connections 2024-05-28T06:06:52.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.930+0000 7fc4eac00640 1 --2- 172.21.15.122:0/3408714644 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc4c4068380 0x7fc4c406a840 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:52.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.930+0000 7fc4eac00640 1 --2- 172.21.15.122:0/3408714644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4e415e730 0x7fc4e4160190 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:52.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.930+0000 7fc4eac00640 1 --2- 172.21.15.122:0/3408714644 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e40ce4f0 0x7fc4e413d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:52.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.930+0000 7fc4eac00640 1 --2- 172.21.15.122:0/3408714644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e40b58d0 0x7fc4e40b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:52.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.930+0000 7fc4eac00640 1 -- 172.21.15.122:0/3408714644 >> 172.21.15.122:0/3408714644 conn(0x7fc4e406bd90 msgr2=0x7fc4e41441f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:52.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.930+0000 7fc4eac00640 1 -- 172.21.15.122:0/3408714644 shutdown_connections 2024-05-28T06:06:52.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:52.930+0000 7fc4eac00640 1 -- 172.21.15.122:0/3408714644 wait complete. 2024-05-28T06:06:52.955 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-28T06:06:52.956 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:06:53.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.090+0000 7f56a8400640 1 Processor -- start 2024-05-28T06:06:53.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.090+0000 7f56a8400640 1 -- start start 2024-05-28T06:06:53.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.090+0000 7f56a8400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56a00cff30 0x7f56a006f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:53.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.090+0000 7f56a8400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f56a00cdb00 0x7f56a00b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:53.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.090+0000 7f56a8400640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56a00d0310 con 0x7f56a006f6c0 2024-05-28T06:06:53.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.090+0000 7f56a8400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f56a006fb00 con 0x7f56a00cdb00 2024-05-28T06:06:53.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.090+0000 7f56a8400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f56a00cdf30 con 0x7f56a00cff30 2024-05-28T06:06:53.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.090+0000 7f56a5000640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f56a006f6c0 0x7f56a00cd3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:43946/0 (socket says 172.21.15.122:43946) 2024-05-28T06:06:53.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.090+0000 7f56a5000640 1 -- 172.21.15.122:0/3594178564 learned_addr learned my addr 172.21.15.122:0/3594178564 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:53.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.090+0000 7f56a6400640 1 --2- 172.21.15.122:0/3594178564 >> v2:172.21.15.122:3300/0 conn(0x7f56a00cdb00 0x7f56a00b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:53.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.090+0000 7f56a5a00640 1 --2- 172.21.15.122:0/3594178564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56a00cff30 0x7f56a006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:53.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.090+0000 7f569fe00640 1 -- 172.21.15.122:0/3594178564 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2201226596 0 0) 0x7f56a00d0310 con 0x7f56a006f6c0 2024-05-28T06:06:53.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.090+0000 7f569fe00640 1 -- 172.21.15.122:0/3594178564 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5688003530 con 0x7f56a006f6c0 2024-05-28T06:06:53.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.090+0000 7f56a6400640 1 -- 172.21.15.122:0/3594178564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56a00cff30 msgr2=0x7f56a006f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:53.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.090+0000 7f56a6400640 1 --2- 172.21.15.122:0/3594178564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56a00cff30 0x7f56a006f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.090+0000 7f56a6400640 1 -- 172.21.15.122:0/3594178564 >> v1:172.21.15.122:6789/0 conn(0x7f56a006f6c0 legacy=0x7f56a00cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:53.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.090+0000 7f56a6400640 1 -- 172.21.15.122:0/3594178564 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a015be20 con 0x7f56a00cdb00 2024-05-28T06:06:53.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.090+0000 7f56a5a00640 1 --2- 172.21.15.122:0/3594178564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56a00cff30 0x7f56a006f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:53.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.094+0000 7f56a6400640 1 --2- 172.21.15.122:0/3594178564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56a00cdb00 0x7f56a00b49b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5698009d90 tx=0x7f569801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5368fe7f56962b83 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:53.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.094+0000 7f569fe00640 1 -- 172.21.15.122:0/3594178564 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56980b2070 con 0x7f56a00cdb00 2024-05-28T06:06:53.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.094+0000 7f569fe00640 1 -- 172.21.15.122:0/3594178564 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56980a5a00 con 0x7f56a00cdb00 2024-05-28T06:06:53.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.094+0000 7f569fe00640 1 -- 172.21.15.122:0/3594178564 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56980a5dd0 con 0x7f56a00cdb00 2024-05-28T06:06:53.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.094+0000 7f56a8400640 1 -- 172.21.15.122:0/3594178564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56a00cdb00 msgr2=0x7f56a00b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:53.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.094+0000 7f56a8400640 1 --2- 172.21.15.122:0/3594178564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56a00cdb00 0x7f56a00b49b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5698009d90 tx=0x7f569801c940 comp rx=0 tx=0).stop 2024-05-28T06:06:53.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.094+0000 7f56a8400640 1 -- 172.21.15.122:0/3594178564 shutdown_connections 2024-05-28T06:06:53.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.094+0000 7f56a8400640 1 --2- 172.21.15.122:0/3594178564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56a00cdb00 0x7f56a00b49b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.094+0000 7f56a8400640 1 --2- 172.21.15.122:0/3594178564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56a00cff30 0x7f56a006f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.094+0000 7f56a8400640 1 -- 172.21.15.122:0/3594178564 >> 172.21.15.122:0/3594178564 conn(0x7f56a006bd90 msgr2=0x7f56a006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:53.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.094+0000 7f56a8400640 1 -- 172.21.15.122:0/3594178564 shutdown_connections 2024-05-28T06:06:53.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.094+0000 7f56a8400640 1 -- 172.21.15.122:0/3594178564 wait complete. 2024-05-28T06:06:53.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f56a8400640 1 Processor -- start 2024-05-28T06:06:53.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f56a8400640 1 -- start start 2024-05-28T06:06:53.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f56a8400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56a006f6c0 0x7f56a0141bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:53.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f56a8400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56a00cdb00 0x7f56a0142150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:53.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f56a8400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56a00cff30 0x7f56a0142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:53.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f56a8400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f56a00b5700 con 0x7f56a00cff30 2024-05-28T06:06:53.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f56a8400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f56a015baf0 con 0x7f56a00cdb00 2024-05-28T06:06:53.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f56a8400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f56a00b5880 con 0x7f56a006f6c0 2024-05-28T06:06:53.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f56a6400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56a00cff30 0x7f56a0142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:53.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f56a6400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56a00cff30 0x7f56a0142690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59906/0 (socket says 172.21.15.122:59906) 2024-05-28T06:06:53.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f56a6400640 1 -- 172.21.15.122:0/3887885979 learned_addr learned my addr 172.21.15.122:0/3887885979 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:53.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f56a5a00640 1 --2- 172.21.15.122:0/3887885979 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56a006f6c0 0x7f56a0141bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:53.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f56a5000640 1 --2- 172.21.15.122:0/3887885979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56a00cdb00 0x7f56a0142150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:53.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f56a6400640 1 -- 172.21.15.122:0/3887885979 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56a006f6c0 msgr2=0x7f56a0141bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:53.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f56a6400640 1 --2- 172.21.15.122:0/3887885979 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56a006f6c0 0x7f56a0141bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f56a6400640 1 -- 172.21.15.122:0/3887885979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56a00cdb00 msgr2=0x7f56a0142150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:53.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f56a6400640 1 --2- 172.21.15.122:0/3887885979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56a00cdb00 0x7f56a0142150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f56a6400640 1 -- 172.21.15.122:0/3887885979 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a00b28e0 con 0x7f56a00cff30 2024-05-28T06:06:53.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f56a5000640 1 --2- 172.21.15.122:0/3887885979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56a00cdb00 0x7f56a0142150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:53.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f56a6400640 1 --2- 172.21.15.122:0/3887885979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56a00cff30 0x7f56a0142690 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f56980b0040 tx=0x7f56980196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:53.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f569d600640 1 -- 172.21.15.122:0/3887885979 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56980b2050 con 0x7f56a00cff30 2024-05-28T06:06:53.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f569d600640 1 -- 172.21.15.122:0/3887885979 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56980be070 con 0x7f56a00cff30 2024-05-28T06:06:53.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f569d600640 1 -- 172.21.15.122:0/3887885979 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56980adb10 con 0x7f56a00cff30 2024-05-28T06:06:53.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f56a8400640 1 -- 172.21.15.122:0/3887885979 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56a00b2bc0 con 0x7f56a00cff30 2024-05-28T06:06:53.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.098+0000 7f56a8400640 1 -- 172.21.15.122:0/3887885979 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56a014aec0 con 0x7f56a00cff30 2024-05-28T06:06:53.105 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.102+0000 7f56a8400640 1 -- 172.21.15.122:0/3887885979 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56a0068c40 con 0x7f56a00cff30 2024-05-28T06:06:53.105 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.102+0000 7f569d600640 1 -- 172.21.15.122:0/3887885979 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f56980adcb0 con 0x7f56a00cff30 2024-05-28T06:06:53.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.102+0000 7f569d600640 1 --2- 172.21.15.122:0/3887885979 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5680068380 0x7f568006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:53.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.102+0000 7f569d600640 1 -- 172.21.15.122:0/3887885979 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f5698121dc0 con 0x7f56a00cff30 2024-05-28T06:06:53.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.102+0000 7f56a5a00640 1 --2- 172.21.15.122:0/3887885979 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5680068380 0x7f568006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:53.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.102+0000 7f56a5a00640 1 --2- 172.21.15.122:0/3887885979 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5680068380 0x7f568006a840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5694006e90 tx=0x7f5694008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:53.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.106+0000 7f569d600640 1 -- 172.21.15.122:0/3887885979 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5698016560 con 0x7f56a00cff30 2024-05-28T06:06:53.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.298+0000 7f56a8400640 1 -- 172.21.15.122:0/3887885979 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56a00cf550 con 0x7f56a00cff30 2024-05-28T06:06:53.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.298+0000 7f569d600640 1 -- 172.21.15.122:0/3887885979 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5190 (secure 0 0 0) 0x7f56980f22f0 con 0x7f56a00cff30 2024-05-28T06:06:53.300 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:53.300 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1943879237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1943879237},{"type":"v1","addr":"172.21.15.153:6834","nonce":1943879237}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1104849441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1104849441},{"type":"v1","addr":"172.21.15.153:6835","nonce":1104849441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/560614408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":560614408},{"type":"v1","addr":"172.21.15.122:6835","nonce":560614408}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-28T06:06:49.284485+0000","modified":"2024-05-28T06:06:52.295560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1698676182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1698676182},{"type":"v1","addr":"172.21.15.122:6837","nonce":1698676182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5082,"qdb_cluster":[5082]},"id":2}]} 2024-05-28T06:06:53.300 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 18 2024-05-28T06:06:53.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.298+0000 7f56a8400640 1 -- 172.21.15.122:0/3887885979 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5680068380 msgr2=0x7f568006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:53.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.298+0000 7f56a8400640 1 --2- 172.21.15.122:0/3887885979 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5680068380 0x7f568006a840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5694006e90 tx=0x7f5694008040 comp rx=0 tx=0).stop 2024-05-28T06:06:53.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.298+0000 7f56a8400640 1 -- 172.21.15.122:0/3887885979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56a00cff30 msgr2=0x7f56a0142690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:53.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.298+0000 7f56a8400640 1 --2- 172.21.15.122:0/3887885979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56a00cff30 0x7f56a0142690 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f56980b0040 tx=0x7f56980196e0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.298+0000 7f56a8400640 1 -- 172.21.15.122:0/3887885979 shutdown_connections 2024-05-28T06:06:53.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.298+0000 7f56a8400640 1 --2- 172.21.15.122:0/3887885979 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5680068380 0x7f568006a840 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.298+0000 7f56a8400640 1 --2- 172.21.15.122:0/3887885979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56a00cff30 0x7f56a0142690 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.298+0000 7f56a8400640 1 --2- 172.21.15.122:0/3887885979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56a00cdb00 0x7f56a0142150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.298+0000 7f56a8400640 1 --2- 172.21.15.122:0/3887885979 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56a006f6c0 0x7f56a0141bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.298+0000 7f56a8400640 1 -- 172.21.15.122:0/3887885979 >> 172.21.15.122:0/3887885979 conn(0x7f56a006bd90 msgr2=0x7f56a0151120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:53.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.298+0000 7f56a8400640 1 -- 172.21.15.122:0/3887885979 shutdown_connections 2024-05-28T06:06:53.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.298+0000 7f56a8400640 1 -- 172.21.15.122:0/3887885979 wait complete. 2024-05-28T06:06:53.322 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:06:53.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.454+0000 7f63e0a00640 1 Processor -- start 2024-05-28T06:06:53.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.454+0000 7f63e0a00640 1 -- start start 2024-05-28T06:06:53.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.454+0000 7f63e0a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f63dc0ce4f0 0x7f63dc0ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:53.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.454+0000 7f63e0a00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63dc15d970 con 0x7f63dc15e730 2024-05-28T06:06:53.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.454+0000 7f63e0a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63dc15dc50 con 0x7f63dc0b58d0 2024-05-28T06:06:53.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.454+0000 7f63e0a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f63dc15df30 con 0x7f63dc0ce4f0 2024-05-28T06:06:53.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.454+0000 7f63da800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f63dc15e730 0x7f63dc15eba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:43954/0 (socket says 172.21.15.122:43954) 2024-05-28T06:06:53.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.454+0000 7f63da800640 1 -- 172.21.15.122:0/2363674537 learned_addr learned my addr 172.21.15.122:0/2363674537 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:53.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d9400640 1 --2- 172.21.15.122:0/2363674537 >> v2:172.21.15.153:3300/0 conn(0x7f63dc0ce4f0 0x7f63dc0ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:53.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d8a00640 1 -- 172.21.15.122:0/2363674537 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 364164999 0 0) 0x7f63dc15d970 con 0x7f63dc15e730 2024-05-28T06:06:53.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d8a00640 1 -- 172.21.15.122:0/2363674537 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63c0003530 con 0x7f63dc15e730 2024-05-28T06:06:53.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d8a00640 1 -- 172.21.15.122:0/2363674537 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1781196774 0 0) 0x7f63dc15dc50 con 0x7f63dc0b58d0 2024-05-28T06:06:53.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d8a00640 1 -- 172.21.15.122:0/2363674537 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63dc15d970 con 0x7f63dc0b58d0 2024-05-28T06:06:53.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d8a00640 1 -- 172.21.15.122:0/2363674537 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4236739600 0 0) 0x7f63c0003530 con 0x7f63dc15e730 2024-05-28T06:06:53.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d8a00640 1 -- 172.21.15.122:0/2363674537 >> v2:172.21.15.153:3300/0 conn(0x7f63dc0ce4f0 msgr2=0x7f63dc0ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:53.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d8a00640 1 --2- 172.21.15.122:0/2363674537 >> v2:172.21.15.153:3300/0 conn(0x7f63dc0ce4f0 0x7f63dc0ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d8a00640 1 -- 172.21.15.122:0/2363674537 >> v1:172.21.15.153:6789/0 conn(0x7f63dc0b58d0 legacy=0x7f63dc0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:53.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d8a00640 1 -- 172.21.15.122:0/2363674537 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63dc15e210 con 0x7f63dc15e730 2024-05-28T06:06:53.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d8a00640 1 -- 172.21.15.122:0/2363674537 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f63d4001680 con 0x7f63dc15e730 2024-05-28T06:06:53.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d8a00640 1 -- 172.21.15.122:0/2363674537 >> v1:172.21.15.122:6789/0 conn(0x7f63dc15e730 legacy=0x7f63dc15eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:53.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d8a00640 1 --2- 172.21.15.122:0/2363674537 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63c0003ba0 0x7f63c0003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:53.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d8a00640 1 --2- 172.21.15.122:0/2363674537 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63c0004810 0x7f63c0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:53.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d8a00640 1 --2- 172.21.15.122:0/2363674537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63c00051d0 0x7f63c000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:53.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d8a00640 1 -- 172.21.15.122:0/2363674537 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f63dc15df30 con 0x7f63c0004810 2024-05-28T06:06:53.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d8a00640 1 -- 172.21.15.122:0/2363674537 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f63c000c0a0 con 0x7f63c00051d0 2024-05-28T06:06:53.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d8a00640 1 -- 172.21.15.122:0/2363674537 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f63c000c2a0 con 0x7f63c0003ba0 2024-05-28T06:06:53.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d9400640 1 --2- 172.21.15.122:0/2363674537 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63c0004810 0x7f63c0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:53.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d9e00640 1 --2- 172.21.15.122:0/2363674537 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63c0003ba0 0x7f63c0003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:53.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63da800640 1 --2- 172.21.15.122:0/2363674537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63c00051d0 0x7f63c000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:53.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d9400640 1 -- 172.21.15.122:0/2363674537 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63c0003ba0 msgr2=0x7f63c0003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:53.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d9400640 1 --2- 172.21.15.122:0/2363674537 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63c0003ba0 0x7f63c0003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d9400640 1 -- 172.21.15.122:0/2363674537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63c00051d0 msgr2=0x7f63c000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:53.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d9400640 1 --2- 172.21.15.122:0/2363674537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63c00051d0 0x7f63c000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63d9400640 1 -- 172.21.15.122:0/2363674537 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c0003530 con 0x7f63c0004810 2024-05-28T06:06:53.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63da800640 1 --2- 172.21.15.122:0/2363674537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63c00051d0 0x7f63c000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:53.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.458+0000 7f63da800640 1 -- 172.21.15.122:0/2363674537 reap_dead start 2024-05-28T06:06:53.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.462+0000 7f63d9400640 1 --2- 172.21.15.122:0/2363674537 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63c0004810 0x7f63c0004c90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f63c8009ae0 tx=0x7f63c801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f93d4a1068be64b server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:53.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.462+0000 7f63d8a00640 1 -- 172.21.15.122:0/2363674537 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c80b2070 con 0x7f63c0004810 2024-05-28T06:06:53.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.462+0000 7f63d8a00640 1 -- 172.21.15.122:0/2363674537 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63c80a5660 con 0x7f63c0004810 2024-05-28T06:06:53.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.462+0000 7f63d8a00640 1 -- 172.21.15.122:0/2363674537 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c80096b0 con 0x7f63c0004810 2024-05-28T06:06:53.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.462+0000 7f63e0a00640 1 -- 172.21.15.122:0/2363674537 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63c0004810 msgr2=0x7f63c0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:53.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.462+0000 7f63e0a00640 1 --2- 172.21.15.122:0/2363674537 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63c0004810 0x7f63c0004c90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f63c8009ae0 tx=0x7f63c801ca70 comp rx=0 tx=0).stop 2024-05-28T06:06:53.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.462+0000 7f63e0a00640 1 -- 172.21.15.122:0/2363674537 shutdown_connections 2024-05-28T06:06:53.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.462+0000 7f63e0a00640 1 --2- 172.21.15.122:0/2363674537 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63c0004810 0x7f63c0004c90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.462+0000 7f63e0a00640 1 -- 172.21.15.122:0/2363674537 >> 172.21.15.122:0/2363674537 conn(0x7f63dc06bd90 msgr2=0x7f63dc06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:53.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.462+0000 7f63e0a00640 1 -- 172.21.15.122:0/2363674537 shutdown_connections 2024-05-28T06:06:53.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.462+0000 7f63e0a00640 1 -- 172.21.15.122:0/2363674537 wait complete. 2024-05-28T06:06:53.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.462+0000 7f63e0a00640 1 Processor -- start 2024-05-28T06:06:53.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.462+0000 7f63e0a00640 1 -- start start 2024-05-28T06:06:53.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.462+0000 7f63e0a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63c0004810 0x7f63dc0af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:53.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.462+0000 7f63e0a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63dc15bc30 0x7f63dc15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:53.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.466+0000 7f63e0a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63dc1f4c70 0x7f63dc1f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:53.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.466+0000 7f63e0a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f63dc146260 con 0x7f63dc1f4c70 2024-05-28T06:06:53.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.466+0000 7f63e0a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f63dc0b5cb0 con 0x7f63c0004810 2024-05-28T06:06:53.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.466+0000 7f63e0a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f63dc1f59e0 con 0x7f63dc15bc30 2024-05-28T06:06:53.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.466+0000 7f63da800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63dc1f4c70 0x7f63dc1f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:53.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.466+0000 7f63da800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63dc1f4c70 0x7f63dc1f50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59916/0 (socket says 172.21.15.122:59916) 2024-05-28T06:06:53.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.466+0000 7f63da800640 1 -- 172.21.15.122:0/3779573701 learned_addr learned my addr 172.21.15.122:0/3779573701 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:53.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.466+0000 7f63d9e00640 1 --2- 172.21.15.122:0/3779573701 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63c0004810 0x7f63dc0af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:53.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.466+0000 7f63d9400640 1 --2- 172.21.15.122:0/3779573701 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63dc15bc30 0x7f63dc15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:53.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.466+0000 7f63da800640 1 -- 172.21.15.122:0/3779573701 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63dc15bc30 msgr2=0x7f63dc15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:53.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.466+0000 7f63da800640 1 --2- 172.21.15.122:0/3779573701 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63dc15bc30 0x7f63dc15c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.466+0000 7f63da800640 1 -- 172.21.15.122:0/3779573701 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63c0004810 msgr2=0x7f63dc0af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:53.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.466+0000 7f63da800640 1 --2- 172.21.15.122:0/3779573701 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63c0004810 0x7f63dc0af5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.466+0000 7f63da800640 1 -- 172.21.15.122:0/3779573701 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63dc1e6f90 con 0x7f63dc1f4c70 2024-05-28T06:06:53.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.466+0000 7f63da800640 1 --2- 172.21.15.122:0/3779573701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63dc1f4c70 0x7f63dc1f50e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0b6720 tx=0x7f63d400e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:53.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.466+0000 7f63d2000640 1 -- 172.21.15.122:0/3779573701 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d4010510 con 0x7f63dc1f4c70 2024-05-28T06:06:53.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.466+0000 7f63d2000640 1 -- 172.21.15.122:0/3779573701 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d40106b0 con 0x7f63dc1f4c70 2024-05-28T06:06:53.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.466+0000 7f63e0a00640 1 -- 172.21.15.122:0/3779573701 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63dc1e7270 con 0x7f63dc1f4c70 2024-05-28T06:06:53.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.466+0000 7f63d2000640 1 -- 172.21.15.122:0/3779573701 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d4010a80 con 0x7f63dc1f4c70 2024-05-28T06:06:53.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.466+0000 7f63e0a00640 1 -- 172.21.15.122:0/3779573701 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63dc1e7830 con 0x7f63dc1f4c70 2024-05-28T06:06:53.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.466+0000 7f63e0a00640 1 -- 172.21.15.122:0/3779573701 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63dc068c40 con 0x7f63dc1f4c70 2024-05-28T06:06:53.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.466+0000 7f63d2000640 1 -- 172.21.15.122:0/3779573701 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f63d4010c20 con 0x7f63dc1f4c70 2024-05-28T06:06:53.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.470+0000 7f63d2000640 1 --2- 172.21.15.122:0/3779573701 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f63bc068380 0x7f63bc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:53.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.470+0000 7f63d2000640 1 -- 172.21.15.122:0/3779573701 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f63d40860a0 con 0x7f63dc1f4c70 2024-05-28T06:06:53.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.470+0000 7f63d9e00640 1 --2- 172.21.15.122:0/3779573701 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f63bc068380 0x7f63bc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:53.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.470+0000 7f63d9e00640 1 --2- 172.21.15.122:0/3779573701 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f63bc068380 0x7f63bc06a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f63cc007be0 tx=0x7f63cc0075b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:53.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.474+0000 7f63d2000640 1 -- 172.21.15.122:0/3779573701 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f63d4055f70 con 0x7f63dc1f4c70 2024-05-28T06:06:53.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.630+0000 7f63e0a00640 1 -- 172.21.15.122:0/3779573701 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63dc0cefa0 con 0x7f63dc1f4c70 2024-05-28T06:06:53.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.630+0000 7f63d2000640 1 -- 172.21.15.122:0/3779573701 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16669 (secure 0 0 0) 0x7f63d405a270 con 0x7f63dc1f4c70 2024-05-28T06:06:53.635 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:53.635 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":34,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:06:50.892168+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:06:47.799439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-28T06:06:48.236731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:06:53.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.634+0000 7f63e0a00640 1 -- 172.21.15.122:0/3779573701 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f63bc068380 msgr2=0x7f63bc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:53.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.634+0000 7f63e0a00640 1 --2- 172.21.15.122:0/3779573701 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f63bc068380 0x7f63bc06a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f63cc007be0 tx=0x7f63cc0075b0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.634+0000 7f63e0a00640 1 -- 172.21.15.122:0/3779573701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63dc1f4c70 msgr2=0x7f63dc1f50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:53.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.634+0000 7f63e0a00640 1 --2- 172.21.15.122:0/3779573701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63dc1f4c70 0x7f63dc1f50e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0b6720 tx=0x7f63d400e960 comp rx=0 tx=0).stop 2024-05-28T06:06:53.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.634+0000 7f63e0a00640 1 -- 172.21.15.122:0/3779573701 shutdown_connections 2024-05-28T06:06:53.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.634+0000 7f63e0a00640 1 --2- 172.21.15.122:0/3779573701 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f63bc068380 0x7f63bc06a840 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.634+0000 7f63e0a00640 1 --2- 172.21.15.122:0/3779573701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63dc1f4c70 0x7f63dc1f50e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.634+0000 7f63e0a00640 1 --2- 172.21.15.122:0/3779573701 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63dc15bc30 0x7f63dc15c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.634+0000 7f63e0a00640 1 --2- 172.21.15.122:0/3779573701 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63c0004810 0x7f63dc0af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.634+0000 7f63e0a00640 1 -- 172.21.15.122:0/3779573701 >> 172.21.15.122:0/3779573701 conn(0x7f63dc06bd90 msgr2=0x7f63dc15ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:53.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.634+0000 7f63e0a00640 1 -- 172.21.15.122:0/3779573701 shutdown_connections 2024-05-28T06:06:53.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.634+0000 7f63e0a00640 1 -- 172.21.15.122:0/3779573701 wait complete. 2024-05-28T06:06:53.656 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-28T06:06:53.656 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-28T06:06:53.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.790+0000 7f5aa7e00640 1 Processor -- start 2024-05-28T06:06:53.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.790+0000 7f5aa7e00640 1 -- start start 2024-05-28T06:06:53.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.790+0000 7f5aa7e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5aa00add80 0x7f5aa00aff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:53.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.790+0000 7f5aa7e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5aa00ae160 0x7f5aa015d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:53.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.790+0000 7f5aa7e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aa015db50 con 0x7f5aa006cbd0 2024-05-28T06:06:53.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.790+0000 7f5aa7e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5aa006bb30 con 0x7f5aa00ae160 2024-05-28T06:06:53.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.790+0000 7f5aa7e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5aa006be10 con 0x7f5aa00add80 2024-05-28T06:06:53.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.790+0000 7f5aa5400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5aa00add80 0x7f5aa00aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:53.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.790+0000 7f5aa4a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5aa00ae160 0x7f5aa015d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:53.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.790+0000 7f5aa5400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5aa00add80 0x7f5aa00aff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:41094/0 (socket says 172.21.15.122:41094) 2024-05-28T06:06:53.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.790+0000 7f5aa5400640 1 -- 172.21.15.122:0/1236151738 learned_addr learned my addr 172.21.15.122:0/1236151738 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:53.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.794+0000 7f5aa4a00640 1 -- 172.21.15.122:0/1236151738 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5aa00add80 msgr2=0x7f5aa00aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:53.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.794+0000 7f5aa4a00640 1 --2- 172.21.15.122:0/1236151738 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5aa00add80 0x7f5aa00aff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.794+0000 7f5aa4a00640 1 -- 172.21.15.122:0/1236151738 >> v1:172.21.15.153:6789/0 conn(0x7f5aa006cbd0 legacy=0x7f5aa006e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:53.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.794+0000 7f5aa4a00640 1 -- 172.21.15.122:0/1236151738 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa006c0f0 con 0x7f5aa00ae160 2024-05-28T06:06:53.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.794+0000 7f5aa5400640 1 --2- 172.21.15.122:0/1236151738 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5aa00add80 0x7f5aa00aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:06:53.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.794+0000 7f5aa4a00640 1 --2- 172.21.15.122:0/1236151738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5aa00ae160 0x7f5aa015d610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c0097c0 tx=0x7f5a8c01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9c98be1d6dae7af server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:53.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.794+0000 7f5a9fe00640 1 -- 172.21.15.122:0/1236151738 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c0b1070 con 0x7f5aa00ae160 2024-05-28T06:06:53.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.794+0000 7f5a9fe00640 1 -- 172.21.15.122:0/1236151738 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a8c0a8050 con 0x7f5aa00ae160 2024-05-28T06:06:53.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.794+0000 7f5a9fe00640 1 -- 172.21.15.122:0/1236151738 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c0ac860 con 0x7f5aa00ae160 2024-05-28T06:06:53.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa7e00640 1 -- 172.21.15.122:0/1236151738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5aa00ae160 msgr2=0x7f5aa015d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:53.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa7e00640 1 --2- 172.21.15.122:0/1236151738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5aa00ae160 0x7f5aa015d610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c0097c0 tx=0x7f5a8c01c3e0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa7e00640 1 -- 172.21.15.122:0/1236151738 shutdown_connections 2024-05-28T06:06:53.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa7e00640 1 --2- 172.21.15.122:0/1236151738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5aa00ae160 0x7f5aa015d610 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa7e00640 1 --2- 172.21.15.122:0/1236151738 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5aa00add80 0x7f5aa00aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa7e00640 1 -- 172.21.15.122:0/1236151738 >> 172.21.15.122:0/1236151738 conn(0x7f5aa00b3130 msgr2=0x7f5aa00d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:53.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa7e00640 1 -- 172.21.15.122:0/1236151738 shutdown_connections 2024-05-28T06:06:53.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa7e00640 1 -- 172.21.15.122:0/1236151738 wait complete. 2024-05-28T06:06:53.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa7e00640 1 Processor -- start 2024-05-28T06:06:53.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa7e00640 1 -- start start 2024-05-28T06:06:53.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa7e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5aa006cbd0 0x7f5aa014bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:53.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa7e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5aa00add80 0x7f5aa014ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:53.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa7e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5aa00ae160 0x7f5aa0154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:53.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa7e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa01570e0 con 0x7f5aa006cbd0 2024-05-28T06:06:53.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa7e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa0156f60 con 0x7f5aa00add80 2024-05-28T06:06:53.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa7e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5aa0169d80 con 0x7f5aa00ae160 2024-05-28T06:06:53.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa5400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5aa006cbd0 0x7f5aa014bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:53.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa5400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5aa006cbd0 0x7f5aa014bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59922/0 (socket says 172.21.15.122:59922) 2024-05-28T06:06:53.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa5400640 1 -- 172.21.15.122:0/3688060678 learned_addr learned my addr 172.21.15.122:0/3688060678 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:53.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa4a00640 1 --2- 172.21.15.122:0/3688060678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5aa00add80 0x7f5aa014ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:53.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa5e00640 1 --2- 172.21.15.122:0/3688060678 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5aa00ae160 0x7f5aa0154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:53.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa5400640 1 -- 172.21.15.122:0/3688060678 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5aa00ae160 msgr2=0x7f5aa0154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:53.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa5400640 1 --2- 172.21.15.122:0/3688060678 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5aa00ae160 0x7f5aa0154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa5400640 1 -- 172.21.15.122:0/3688060678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5aa00add80 msgr2=0x7f5aa014ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:53.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa5400640 1 --2- 172.21.15.122:0/3688060678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5aa00add80 0x7f5aa014ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa5400640 1 -- 172.21.15.122:0/3688060678 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa014d1a0 con 0x7f5aa006cbd0 2024-05-28T06:06:53.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.798+0000 7f5aa5400640 1 --2- 172.21.15.122:0/3688060678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5aa006cbd0 0x7f5aa014bbe0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400efc0 tx=0x7f5a9400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:53.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.802+0000 7f5a9d600640 1 -- 172.21.15.122:0/3688060678 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a9400ce60 con 0x7f5aa006cbd0 2024-05-28T06:06:53.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.802+0000 7f5a9d600640 1 -- 172.21.15.122:0/3688060678 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a94019070 con 0x7f5aa006cbd0 2024-05-28T06:06:53.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.802+0000 7f5aa7e00640 1 -- 172.21.15.122:0/3688060678 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aa014d480 con 0x7f5aa006cbd0 2024-05-28T06:06:53.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.802+0000 7f5a9d600640 1 -- 172.21.15.122:0/3688060678 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a94014680 con 0x7f5aa006cbd0 2024-05-28T06:06:53.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.802+0000 7f5aa7e00640 1 -- 172.21.15.122:0/3688060678 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aa014c120 con 0x7f5aa006cbd0 2024-05-28T06:06:53.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.802+0000 7f5aa7e00640 1 -- 172.21.15.122:0/3688060678 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5aa014d6a0 con 0x7f5aa006cbd0 2024-05-28T06:06:53.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.802+0000 7f5a9d600640 1 -- 172.21.15.122:0/3688060678 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5a94012050 con 0x7f5aa006cbd0 2024-05-28T06:06:53.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.802+0000 7f5a9d600640 1 --2- 172.21.15.122:0/3688060678 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5a800683b0 0x7f5a8006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:53.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.802+0000 7f5a9d600640 1 -- 172.21.15.122:0/3688060678 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f5a94086f70 con 0x7f5aa006cbd0 2024-05-28T06:06:53.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.802+0000 7f5aa4a00640 1 --2- 172.21.15.122:0/3688060678 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5a800683b0 0x7f5a8006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:53.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.806+0000 7f5aa4a00640 1 --2- 172.21.15.122:0/3688060678 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5a800683b0 0x7f5a8006a870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c0ae000 tx=0x7f5a8c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:53.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.806+0000 7f5a9d600640 1 -- 172.21.15.122:0/3688060678 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5a94010040 con 0x7f5aa006cbd0 2024-05-28T06:06:53.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.962+0000 7f5aa7e00640 1 -- 172.21.15.122:0/3688060678 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5aa0076020 con 0x7f5a800683b0 2024-05-28T06:06:53.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.970+0000 7f5a9d600640 1 -- 172.21.15.122:0/3688060678 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7f5a8c0f9840 con 0x7f5a800683b0 2024-05-28T06:06:53.976 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:53.978 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-05-28T06:06:53.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.974+0000 7f5aa7e00640 1 -- 172.21.15.122:0/3688060678 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5a800683b0 msgr2=0x7f5a8006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:53.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.974+0000 7f5aa7e00640 1 --2- 172.21.15.122:0/3688060678 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5a800683b0 0x7f5a8006a870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c0ae000 tx=0x7f5a8c0a7000 comp rx=0 tx=0).stop 2024-05-28T06:06:53.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.974+0000 7f5aa7e00640 1 -- 172.21.15.122:0/3688060678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5aa006cbd0 msgr2=0x7f5aa014bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:53.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.974+0000 7f5aa7e00640 1 --2- 172.21.15.122:0/3688060678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5aa006cbd0 0x7f5aa014bbe0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400efc0 tx=0x7f5a9400c490 comp rx=0 tx=0).stop 2024-05-28T06:06:53.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.974+0000 7f5aa7e00640 1 -- 172.21.15.122:0/3688060678 shutdown_connections 2024-05-28T06:06:53.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.974+0000 7f5aa7e00640 1 --2- 172.21.15.122:0/3688060678 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5a800683b0 0x7f5a8006a870 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.974+0000 7f5aa7e00640 1 --2- 172.21.15.122:0/3688060678 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5aa00ae160 0x7f5aa0154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.974+0000 7f5aa7e00640 1 --2- 172.21.15.122:0/3688060678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5aa00add80 0x7f5aa014ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.974+0000 7f5aa7e00640 1 --2- 172.21.15.122:0/3688060678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5aa006cbd0 0x7f5aa014bbe0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:53.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.974+0000 7f5aa7e00640 1 -- 172.21.15.122:0/3688060678 >> 172.21.15.122:0/3688060678 conn(0x7f5aa00b3130 msgr2=0x7f5aa006e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:53.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.974+0000 7f5aa7e00640 1 -- 172.21.15.122:0/3688060678 shutdown_connections 2024-05-28T06:06:53.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:53.974+0000 7f5aa7e00640 1 -- 172.21.15.122:0/3688060678 wait complete. 2024-05-28T06:06:53.996 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-05-28T06:06:53.255765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220376,"kb_used_data":4196,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754344,"statfs":{"total":773094113280,"available":772868448256,"internally_reserved":0,"allocated":4296704,"data_stored":2382104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.368637"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.326952+0000","last_change":"2024-05-28T06:06:49.911349+0000","last_active":"2024-05-28T06:06:51.326952+0000","last_peered":"2024-05-28T06:06:51.326952+0000","last_clean":"2024-05-28T06:06:51.326952+0000","last_became_active":"2024-05-28T06:06:49.911050+0000","last_became_peered":"2024-05-28T06:06:49.911050+0000","last_unstale":"2024-05-28T06:06:51.326952+0000","last_undegraded":"2024-05-28T06:06:51.326952+0000","last_fullsized":"2024-05-28T06:06:51.326952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:52.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050681+0000","last_change":"2024-05-28T06:06:49.929349+0000","last_active":"2024-05-28T06:06:52.050681+0000","last_peered":"2024-05-28T06:06:52.050681+0000","last_clean":"2024-05-28T06:06:52.050681+0000","last_became_active":"2024-05-28T06:06:49.929093+0000","last_became_peered":"2024-05-28T06:06:49.929093+0000","last_unstale":"2024-05-28T06:06:52.050681+0000","last_undegraded":"2024-05-28T06:06:52.050681+0000","last_fullsized":"2024-05-28T06:06:52.050681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:35:23.352099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.051134+0000","last_change":"2024-05-28T06:06:49.915474+0000","last_active":"2024-05-28T06:06:52.051134+0000","last_peered":"2024-05-28T06:06:52.051134+0000","last_clean":"2024-05-28T06:06:52.051134+0000","last_became_active":"2024-05-28T06:06:49.915153+0000","last_became_peered":"2024-05-28T06:06:49.915153+0000","last_unstale":"2024-05-28T06:06:52.051134+0000","last_undegraded":"2024-05-28T06:06:52.051134+0000","last_fullsized":"2024-05-28T06:06:52.051134+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:10:12.633755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903411+0000","last_change":"2024-05-28T06:06:49.933769+0000","last_active":"2024-05-28T06:06:51.903411+0000","last_peered":"2024-05-28T06:06:51.903411+0000","last_clean":"2024-05-28T06:06:51.903411+0000","last_became_active":"2024-05-28T06:06:49.933462+0000","last_became_peered":"2024-05-28T06:06:49.933462+0000","last_unstale":"2024-05-28T06:06:51.903411+0000","last_undegraded":"2024-05-28T06:06:51.903411+0000","last_fullsized":"2024-05-28T06:06:51.903411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:22:45.724585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.896815+0000","last_change":"2024-05-28T06:06:49.916710+0000","last_active":"2024-05-28T06:06:50.896815+0000","last_peered":"2024-05-28T06:06:50.896815+0000","last_clean":"2024-05-28T06:06:50.896815+0000","last_became_active":"2024-05-28T06:06:49.916019+0000","last_became_peered":"2024-05-28T06:06:49.916019+0000","last_unstale":"2024-05-28T06:06:50.896815+0000","last_undegraded":"2024-05-28T06:06:50.896815+0000","last_fullsized":"2024-05-28T06:06:50.896815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:20:49.799405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050169+0000","last_change":"2024-05-28T06:06:49.913901+0000","last_active":"2024-05-28T06:06:52.050169+0000","last_peered":"2024-05-28T06:06:52.050169+0000","last_clean":"2024-05-28T06:06:52.050169+0000","last_became_active":"2024-05-28T06:06:49.913630+0000","last_became_peered":"2024-05-28T06:06:49.913630+0000","last_unstale":"2024-05-28T06:06:52.050169+0000","last_undegraded":"2024-05-28T06:06:52.050169+0000","last_fullsized":"2024-05-28T06:06:52.050169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:44.071425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898756+0000","last_change":"2024-05-28T06:06:49.916462+0000","last_active":"2024-05-28T06:06:50.898756+0000","last_peered":"2024-05-28T06:06:50.898756+0000","last_clean":"2024-05-28T06:06:50.898756+0000","last_became_active":"2024-05-28T06:06:49.916154+0000","last_became_peered":"2024-05-28T06:06:49.916154+0000","last_unstale":"2024-05-28T06:06:50.898756+0000","last_undegraded":"2024-05-28T06:06:50.898756+0000","last_fullsized":"2024-05-28T06:06:50.898756+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:10:12.633755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898298+0000","last_change":"2024-05-28T06:06:49.908259+0000","last_active":"2024-05-28T06:06:50.898298+0000","last_peered":"2024-05-28T06:06:50.898298+0000","last_clean":"2024-05-28T06:06:50.898298+0000","last_became_active":"2024-05-28T06:06:49.906662+0000","last_became_peered":"2024-05-28T06:06:49.906662+0000","last_unstale":"2024-05-28T06:06:50.898298+0000","last_undegraded":"2024-05-28T06:06:50.898298+0000","last_fullsized":"2024-05-28T06:06:50.898298+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:15:31.543660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610782+0000","last_change":"2024-05-28T06:06:49.924407+0000","last_active":"2024-05-28T06:06:51.610782+0000","last_peered":"2024-05-28T06:06:51.610782+0000","last_clean":"2024-05-28T06:06:51.610782+0000","last_became_active":"2024-05-28T06:06:49.923961+0000","last_became_peered":"2024-05-28T06:06:49.923961+0000","last_unstale":"2024-05-28T06:06:51.610782+0000","last_undegraded":"2024-05-28T06:06:51.610782+0000","last_fullsized":"2024-05-28T06:06:51.610782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:17:10.071527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903764+0000","last_change":"2024-05-28T06:06:49.921616+0000","last_active":"2024-05-28T06:06:51.903764+0000","last_peered":"2024-05-28T06:06:51.903764+0000","last_clean":"2024-05-28T06:06:51.903764+0000","last_became_active":"2024-05-28T06:06:49.921335+0000","last_became_peered":"2024-05-28T06:06:49.921335+0000","last_unstale":"2024-05-28T06:06:51.903764+0000","last_undegraded":"2024-05-28T06:06:51.903764+0000","last_fullsized":"2024-05-28T06:06:51.903764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:34:59.610967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898396+0000","last_change":"2024-05-28T06:06:49.919167+0000","last_active":"2024-05-28T06:06:50.898396+0000","last_peered":"2024-05-28T06:06:50.898396+0000","last_clean":"2024-05-28T06:06:50.898396+0000","last_became_active":"2024-05-28T06:06:49.918823+0000","last_became_peered":"2024-05-28T06:06:49.918823+0000","last_unstale":"2024-05-28T06:06:50.898396+0000","last_undegraded":"2024-05-28T06:06:50.898396+0000","last_fullsized":"2024-05-28T06:06:50.898396+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:34:59.610967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050903+0000","last_change":"2024-05-28T06:06:49.904030+0000","last_active":"2024-05-28T06:06:52.050903+0000","last_peered":"2024-05-28T06:06:52.050903+0000","last_clean":"2024-05-28T06:06:52.050903+0000","last_became_active":"2024-05-28T06:06:49.903745+0000","last_became_peered":"2024-05-28T06:06:49.903745+0000","last_unstale":"2024-05-28T06:06:52.050903+0000","last_undegraded":"2024-05-28T06:06:52.050903+0000","last_fullsized":"2024-05-28T06:06:52.050903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:17:10.071527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.897012+0000","last_change":"2024-05-28T06:06:49.919589+0000","last_active":"2024-05-28T06:06:50.897012+0000","last_peered":"2024-05-28T06:06:50.897012+0000","last_clean":"2024-05-28T06:06:50.897012+0000","last_became_active":"2024-05-28T06:06:49.919334+0000","last_became_peered":"2024-05-28T06:06:49.919334+0000","last_unstale":"2024-05-28T06:06:50.897012+0000","last_undegraded":"2024-05-28T06:06:50.897012+0000","last_fullsized":"2024-05-28T06:06:50.897012+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:17:08.380927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050189+0000","last_change":"2024-05-28T06:06:49.913133+0000","last_active":"2024-05-28T06:06:52.050189+0000","last_peered":"2024-05-28T06:06:52.050189+0000","last_clean":"2024-05-28T06:06:52.050189+0000","last_became_active":"2024-05-28T06:06:49.912827+0000","last_became_peered":"2024-05-28T06:06:49.912827+0000","last_unstale":"2024-05-28T06:06:52.050189+0000","last_undegraded":"2024-05-28T06:06:52.050189+0000","last_fullsized":"2024-05-28T06:06:52.050189+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:20:52.065092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050977+0000","last_change":"2024-05-28T06:06:49.910317+0000","last_active":"2024-05-28T06:06:52.050977+0000","last_peered":"2024-05-28T06:06:52.050977+0000","last_clean":"2024-05-28T06:06:52.050977+0000","last_became_active":"2024-05-28T06:06:49.910006+0000","last_became_peered":"2024-05-28T06:06:49.910006+0000","last_unstale":"2024-05-28T06:06:52.050977+0000","last_undegraded":"2024-05-28T06:06:52.050977+0000","last_fullsized":"2024-05-28T06:06:52.050977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:20:52.065092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898648+0000","last_change":"2024-05-28T06:06:49.922027+0000","last_active":"2024-05-28T06:06:50.898648+0000","last_peered":"2024-05-28T06:06:50.898648+0000","last_clean":"2024-05-28T06:06:50.898648+0000","last_became_active":"2024-05-28T06:06:49.921800+0000","last_became_peered":"2024-05-28T06:06:49.921800+0000","last_unstale":"2024-05-28T06:06:50.898648+0000","last_undegraded":"2024-05-28T06:06:50.898648+0000","last_fullsized":"2024-05-28T06:06:50.898648+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:32:19.232721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898517+0000","last_change":"2024-05-28T06:06:49.914520+0000","last_active":"2024-05-28T06:06:50.898517+0000","last_peered":"2024-05-28T06:06:50.898517+0000","last_clean":"2024-05-28T06:06:50.898517+0000","last_became_active":"2024-05-28T06:06:49.914166+0000","last_became_peered":"2024-05-28T06:06:49.914166+0000","last_unstale":"2024-05-28T06:06:50.898517+0000","last_undegraded":"2024-05-28T06:06:50.898517+0000","last_fullsized":"2024-05-28T06:06:50.898517+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:44.071425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050752+0000","last_change":"2024-05-28T06:06:49.917262+0000","last_active":"2024-05-28T06:06:52.050752+0000","last_peered":"2024-05-28T06:06:52.050752+0000","last_clean":"2024-05-28T06:06:52.050752+0000","last_became_active":"2024-05-28T06:06:49.917019+0000","last_became_peered":"2024-05-28T06:06:49.917019+0000","last_unstale":"2024-05-28T06:06:52.050752+0000","last_undegraded":"2024-05-28T06:06:52.050752+0000","last_fullsized":"2024-05-28T06:06:52.050752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:15:09.883838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050528+0000","last_change":"2024-05-28T06:06:49.914876+0000","last_active":"2024-05-28T06:06:52.050528+0000","last_peered":"2024-05-28T06:06:52.050528+0000","last_clean":"2024-05-28T06:06:52.050528+0000","last_became_active":"2024-05-28T06:06:49.914609+0000","last_became_peered":"2024-05-28T06:06:49.914609+0000","last_unstale":"2024-05-28T06:06:52.050528+0000","last_undegraded":"2024-05-28T06:06:52.050528+0000","last_fullsized":"2024-05-28T06:06:52.050528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:58:41.711951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.896862+0000","last_change":"2024-05-28T06:06:49.918752+0000","last_active":"2024-05-28T06:06:50.896862+0000","last_peered":"2024-05-28T06:06:50.896862+0000","last_clean":"2024-05-28T06:06:50.896862+0000","last_became_active":"2024-05-28T06:06:49.918523+0000","last_became_peered":"2024-05-28T06:06:49.918523+0000","last_unstale":"2024-05-28T06:06:50.896862+0000","last_undegraded":"2024-05-28T06:06:50.896862+0000","last_fullsized":"2024-05-28T06:06:50.896862+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:36:13.356967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610341+0000","last_change":"2024-05-28T06:06:49.929198+0000","last_active":"2024-05-28T06:06:51.610341+0000","last_peered":"2024-05-28T06:06:51.610341+0000","last_clean":"2024-05-28T06:06:51.610341+0000","last_became_active":"2024-05-28T06:06:49.924424+0000","last_became_peered":"2024-05-28T06:06:49.924424+0000","last_unstale":"2024-05-28T06:06:51.610341+0000","last_undegraded":"2024-05-28T06:06:51.610341+0000","last_fullsized":"2024-05-28T06:06:51.610341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:42:51.478908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610227+0000","last_change":"2024-05-28T06:06:49.928594+0000","last_active":"2024-05-28T06:06:51.610227+0000","last_peered":"2024-05-28T06:06:51.610227+0000","last_clean":"2024-05-28T06:06:51.610227+0000","last_became_active":"2024-05-28T06:06:49.928272+0000","last_became_peered":"2024-05-28T06:06:49.928272+0000","last_unstale":"2024-05-28T06:06:51.610227+0000","last_undegraded":"2024-05-28T06:06:51.610227+0000","last_fullsized":"2024-05-28T06:06:51.610227+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:15:31.543660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.901127+0000","last_change":"2024-05-28T06:06:49.920581+0000","last_active":"2024-05-28T06:06:51.901127+0000","last_peered":"2024-05-28T06:06:51.901127+0000","last_clean":"2024-05-28T06:06:51.901127+0000","last_became_active":"2024-05-28T06:06:49.920314+0000","last_became_peered":"2024-05-28T06:06:49.920314+0000","last_unstale":"2024-05-28T06:06:51.901127+0000","last_undegraded":"2024-05-28T06:06:51.901127+0000","last_fullsized":"2024-05-28T06:06:51.901127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:52.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050769+0000","last_change":"2024-05-28T06:06:49.908199+0000","last_active":"2024-05-28T06:06:52.050769+0000","last_peered":"2024-05-28T06:06:52.050769+0000","last_clean":"2024-05-28T06:06:52.050769+0000","last_became_active":"2024-05-28T06:06:49.907898+0000","last_became_peered":"2024-05-28T06:06:49.907898+0000","last_unstale":"2024-05-28T06:06:52.050769+0000","last_undegraded":"2024-05-28T06:06:52.050769+0000","last_fullsized":"2024-05-28T06:06:52.050769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:07:18.337847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903839+0000","last_change":"2024-05-28T06:06:49.926201+0000","last_active":"2024-05-28T06:06:51.903839+0000","last_peered":"2024-05-28T06:06:51.903839+0000","last_clean":"2024-05-28T06:06:51.903839+0000","last_became_active":"2024-05-28T06:06:49.926030+0000","last_became_peered":"2024-05-28T06:06:49.926030+0000","last_unstale":"2024-05-28T06:06:51.903839+0000","last_undegraded":"2024-05-28T06:06:51.903839+0000","last_fullsized":"2024-05-28T06:06:51.903839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:07:18.337847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050778+0000","last_change":"2024-05-28T06:06:49.920482+0000","last_active":"2024-05-28T06:06:52.050778+0000","last_peered":"2024-05-28T06:06:52.050778+0000","last_clean":"2024-05-28T06:06:52.050778+0000","last_became_active":"2024-05-28T06:06:49.920222+0000","last_became_peered":"2024-05-28T06:06:49.920222+0000","last_unstale":"2024-05-28T06:06:52.050778+0000","last_undegraded":"2024-05-28T06:06:52.050778+0000","last_fullsized":"2024-05-28T06:06:52.050778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:17:54.503357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903722+0000","last_change":"2024-05-28T06:06:49.935924+0000","last_active":"2024-05-28T06:06:51.903722+0000","last_peered":"2024-05-28T06:06:51.903722+0000","last_clean":"2024-05-28T06:06:51.903722+0000","last_became_active":"2024-05-28T06:06:49.933054+0000","last_became_peered":"2024-05-28T06:06:49.933054+0000","last_unstale":"2024-05-28T06:06:51.903722+0000","last_undegraded":"2024-05-28T06:06:51.903722+0000","last_fullsized":"2024-05-28T06:06:51.903722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:42:51.478908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.051099+0000","last_change":"2024-05-28T06:06:49.915352+0000","last_active":"2024-05-28T06:06:52.051099+0000","last_peered":"2024-05-28T06:06:52.051099+0000","last_clean":"2024-05-28T06:06:52.051099+0000","last_became_active":"2024-05-28T06:06:49.915019+0000","last_became_peered":"2024-05-28T06:06:49.915019+0000","last_unstale":"2024-05-28T06:06:52.051099+0000","last_undegraded":"2024-05-28T06:06:52.051099+0000","last_fullsized":"2024-05-28T06:06:52.051099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:32:19.232721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610448+0000","last_change":"2024-05-28T06:06:49.924091+0000","last_active":"2024-05-28T06:06:51.610448+0000","last_peered":"2024-05-28T06:06:51.610448+0000","last_clean":"2024-05-28T06:06:51.610448+0000","last_became_active":"2024-05-28T06:06:49.923491+0000","last_became_peered":"2024-05-28T06:06:49.923491+0000","last_unstale":"2024-05-28T06:06:51.610448+0000","last_undegraded":"2024-05-28T06:06:51.610448+0000","last_fullsized":"2024-05-28T06:06:51.610448+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:15:04.927295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898488+0000","last_change":"2024-05-28T06:06:49.914863+0000","last_active":"2024-05-28T06:06:50.898488+0000","last_peered":"2024-05-28T06:06:50.898488+0000","last_clean":"2024-05-28T06:06:50.898488+0000","last_became_active":"2024-05-28T06:06:49.914565+0000","last_became_peered":"2024-05-28T06:06:49.914565+0000","last_unstale":"2024-05-28T06:06:50.898488+0000","last_undegraded":"2024-05-28T06:06:50.898488+0000","last_fullsized":"2024-05-28T06:06:50.898488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:17:10.071527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.326944+0000","last_change":"2024-05-28T06:06:49.907250+0000","last_active":"2024-05-28T06:06:51.326944+0000","last_peered":"2024-05-28T06:06:51.326944+0000","last_clean":"2024-05-28T06:06:51.326944+0000","last_became_active":"2024-05-28T06:06:49.906943+0000","last_became_peered":"2024-05-28T06:06:49.906943+0000","last_unstale":"2024-05-28T06:06:51.326944+0000","last_undegraded":"2024-05-28T06:06:51.326944+0000","last_fullsized":"2024-05-28T06:06:51.326944+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:51:50.413343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898106+0000","last_change":"2024-05-28T06:06:49.926056+0000","last_active":"2024-05-28T06:06:50.898106+0000","last_peered":"2024-05-28T06:06:50.898106+0000","last_clean":"2024-05-28T06:06:50.898106+0000","last_became_active":"2024-05-28T06:06:49.925786+0000","last_became_peered":"2024-05-28T06:06:49.925786+0000","last_unstale":"2024-05-28T06:06:50.898106+0000","last_undegraded":"2024-05-28T06:06:50.898106+0000","last_fullsized":"2024-05-28T06:06:50.898106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:42:51.478908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.901038+0000","last_change":"2024-05-28T06:06:49.921956+0000","last_active":"2024-05-28T06:06:51.901038+0000","last_peered":"2024-05-28T06:06:51.901038+0000","last_clean":"2024-05-28T06:06:51.901038+0000","last_became_active":"2024-05-28T06:06:49.920758+0000","last_became_peered":"2024-05-28T06:06:49.920758+0000","last_unstale":"2024-05-28T06:06:51.901038+0000","last_undegraded":"2024-05-28T06:06:51.901038+0000","last_fullsized":"2024-05-28T06:06:51.901038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:26:06.933823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.327036+0000","last_change":"2024-05-28T06:06:48.913852+0000","last_active":"2024-05-28T06:06:51.327036+0000","last_peered":"2024-05-28T06:06:51.327036+0000","last_clean":"2024-05-28T06:06:51.327036+0000","last_became_active":"2024-05-28T06:06:48.911471+0000","last_became_peered":"2024-05-28T06:06:48.911471+0000","last_unstale":"2024-05-28T06:06:51.327036+0000","last_undegraded":"2024-05-28T06:06:51.327036+0000","last_fullsized":"2024-05-28T06:06:51.327036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:26:00.667879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.327035+0000","last_change":"2024-05-28T06:06:49.925217+0000","last_active":"2024-05-28T06:06:51.327035+0000","last_peered":"2024-05-28T06:06:51.327035+0000","last_clean":"2024-05-28T06:06:51.327035+0000","last_became_active":"2024-05-28T06:06:49.924864+0000","last_became_peered":"2024-05-28T06:06:49.924864+0000","last_unstale":"2024-05-28T06:06:51.327035+0000","last_undegraded":"2024-05-28T06:06:51.327035+0000","last_fullsized":"2024-05-28T06:06:51.327035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T18:01:04.418080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.901112+0000","last_change":"2024-05-28T06:06:48.915411+0000","last_active":"2024-05-28T06:06:51.901112+0000","last_peered":"2024-05-28T06:06:51.901112+0000","last_clean":"2024-05-28T06:06:51.901112+0000","last_became_active":"2024-05-28T06:06:48.915084+0000","last_became_peered":"2024-05-28T06:06:48.915084+0000","last_unstale":"2024-05-28T06:06:51.901112+0000","last_undegraded":"2024-05-28T06:06:51.901112+0000","last_fullsized":"2024-05-28T06:06:51.901112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:20:48.793281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610695+0000","last_change":"2024-05-28T06:06:49.927944+0000","last_active":"2024-05-28T06:06:51.610695+0000","last_peered":"2024-05-28T06:06:51.610695+0000","last_clean":"2024-05-28T06:06:51.610695+0000","last_became_active":"2024-05-28T06:06:49.922919+0000","last_became_peered":"2024-05-28T06:06:49.922919+0000","last_unstale":"2024-05-28T06:06:51.610695+0000","last_undegraded":"2024-05-28T06:06:51.610695+0000","last_fullsized":"2024-05-28T06:06:51.610695+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:07:18.337847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050471+0000","last_change":"2024-05-28T06:06:48.920312+0000","last_active":"2024-05-28T06:06:52.050471+0000","last_peered":"2024-05-28T06:06:52.050471+0000","last_clean":"2024-05-28T06:06:52.050471+0000","last_became_active":"2024-05-28T06:06:48.920015+0000","last_became_peered":"2024-05-28T06:06:48.920015+0000","last_unstale":"2024-05-28T06:06:52.050471+0000","last_undegraded":"2024-05-28T06:06:52.050471+0000","last_fullsized":"2024-05-28T06:06:52.050471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:26:05.927699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903737+0000","last_change":"2024-05-28T06:06:49.933393+0000","last_active":"2024-05-28T06:06:51.903737+0000","last_peered":"2024-05-28T06:06:51.903737+0000","last_clean":"2024-05-28T06:06:51.903737+0000","last_became_active":"2024-05-28T06:06:49.932702+0000","last_became_peered":"2024-05-28T06:06:49.932702+0000","last_unstale":"2024-05-28T06:06:51.903737+0000","last_undegraded":"2024-05-28T06:06:51.903737+0000","last_fullsized":"2024-05-28T06:06:51.903737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:15:04.927295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.896936+0000","last_change":"2024-05-28T06:06:48.913857+0000","last_active":"2024-05-28T06:06:50.896936+0000","last_peered":"2024-05-28T06:06:50.896936+0000","last_clean":"2024-05-28T06:06:50.896936+0000","last_became_active":"2024-05-28T06:06:48.913559+0000","last_became_peered":"2024-05-28T06:06:48.913559+0000","last_unstale":"2024-05-28T06:06:50.896936+0000","last_undegraded":"2024-05-28T06:06:50.896936+0000","last_fullsized":"2024-05-28T06:06:50.896936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:59:07.079204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898793+0000","last_change":"2024-05-28T06:06:49.931396+0000","last_active":"2024-05-28T06:06:50.898793+0000","last_peered":"2024-05-28T06:06:50.898793+0000","last_clean":"2024-05-28T06:06:50.898793+0000","last_became_active":"2024-05-28T06:06:49.931123+0000","last_became_peered":"2024-05-28T06:06:49.931123+0000","last_unstale":"2024-05-28T06:06:50.898793+0000","last_undegraded":"2024-05-28T06:06:50.898793+0000","last_fullsized":"2024-05-28T06:06:50.898793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:58:41.711951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610490+0000","last_change":"2024-05-28T06:06:48.910242+0000","last_active":"2024-05-28T06:06:51.610490+0000","last_peered":"2024-05-28T06:06:51.610490+0000","last_clean":"2024-05-28T06:06:51.610490+0000","last_became_active":"2024-05-28T06:06:48.909951+0000","last_became_peered":"2024-05-28T06:06:48.909951+0000","last_unstale":"2024-05-28T06:06:51.610490+0000","last_undegraded":"2024-05-28T06:06:51.610490+0000","last_fullsized":"2024-05-28T06:06:51.610490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:09:51.995851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050775+0000","last_change":"2024-05-28T06:06:49.910661+0000","last_active":"2024-05-28T06:06:52.050775+0000","last_peered":"2024-05-28T06:06:52.050775+0000","last_clean":"2024-05-28T06:06:52.050775+0000","last_became_active":"2024-05-28T06:06:49.910313+0000","last_became_peered":"2024-05-28T06:06:49.910313+0000","last_unstale":"2024-05-28T06:06:52.050775+0000","last_undegraded":"2024-05-28T06:06:52.050775+0000","last_fullsized":"2024-05-28T06:06:52.050775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:34:59.610967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610192+0000","last_change":"2024-05-28T06:06:48.909112+0000","last_active":"2024-05-28T06:06:51.610192+0000","last_peered":"2024-05-28T06:06:51.610192+0000","last_clean":"2024-05-28T06:06:51.610192+0000","last_became_active":"2024-05-28T06:06:48.908796+0000","last_became_peered":"2024-05-28T06:06:48.908796+0000","last_unstale":"2024-05-28T06:06:51.610192+0000","last_undegraded":"2024-05-28T06:06:51.610192+0000","last_fullsized":"2024-05-28T06:06:51.610192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:26:00.667879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610029+0000","last_change":"2024-05-28T06:06:49.922021+0000","last_active":"2024-05-28T06:06:51.610029+0000","last_peered":"2024-05-28T06:06:51.610029+0000","last_clean":"2024-05-28T06:06:51.610029+0000","last_became_active":"2024-05-28T06:06:49.918063+0000","last_became_peered":"2024-05-28T06:06:49.918063+0000","last_unstale":"2024-05-28T06:06:51.610029+0000","last_undegraded":"2024-05-28T06:06:51.610029+0000","last_fullsized":"2024-05-28T06:06:51.610029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:53:52.395522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.049968+0000","last_change":"2024-05-28T06:06:48.908204+0000","last_active":"2024-05-28T06:06:52.049968+0000","last_peered":"2024-05-28T06:06:52.049968+0000","last_clean":"2024-05-28T06:06:52.049968+0000","last_became_active":"2024-05-28T06:06:48.907846+0000","last_became_peered":"2024-05-28T06:06:48.907846+0000","last_unstale":"2024-05-28T06:06:52.049968+0000","last_undegraded":"2024-05-28T06:06:52.049968+0000","last_fullsized":"2024-05-28T06:06:52.049968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:34:32.941762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903310+0000","last_change":"2024-05-28T06:06:49.913654+0000","last_active":"2024-05-28T06:06:51.903310+0000","last_peered":"2024-05-28T06:06:51.903310+0000","last_clean":"2024-05-28T06:06:51.903310+0000","last_became_active":"2024-05-28T06:06:49.913452+0000","last_became_peered":"2024-05-28T06:06:49.913452+0000","last_unstale":"2024-05-28T06:06:51.903310+0000","last_undegraded":"2024-05-28T06:06:51.903310+0000","last_fullsized":"2024-05-28T06:06:51.903310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:26:54.816940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610025+0000","last_change":"2024-05-28T06:06:48.910904+0000","last_active":"2024-05-28T06:06:51.610025+0000","last_peered":"2024-05-28T06:06:51.610025+0000","last_clean":"2024-05-28T06:06:51.610025+0000","last_became_active":"2024-05-28T06:06:48.908525+0000","last_became_peered":"2024-05-28T06:06:48.908525+0000","last_unstale":"2024-05-28T06:06:51.610025+0000","last_undegraded":"2024-05-28T06:06:51.610025+0000","last_fullsized":"2024-05-28T06:06:51.610025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:44:37.523352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.051181+0000","last_change":"2024-05-28T06:06:49.903122+0000","last_active":"2024-05-28T06:06:52.051181+0000","last_peered":"2024-05-28T06:06:52.051181+0000","last_clean":"2024-05-28T06:06:52.051181+0000","last_became_active":"2024-05-28T06:06:49.902808+0000","last_became_peered":"2024-05-28T06:06:49.902808+0000","last_unstale":"2024-05-28T06:06:52.051181+0000","last_undegraded":"2024-05-28T06:06:52.051181+0000","last_fullsized":"2024-05-28T06:06:52.051181+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:58:41.711951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050754+0000","last_change":"2024-05-28T06:06:48.916423+0000","last_active":"2024-05-28T06:06:52.050754+0000","last_peered":"2024-05-28T06:06:52.050754+0000","last_clean":"2024-05-28T06:06:52.050754+0000","last_became_active":"2024-05-28T06:06:48.916068+0000","last_became_peered":"2024-05-28T06:06:48.916068+0000","last_unstale":"2024-05-28T06:06:52.050754+0000","last_undegraded":"2024-05-28T06:06:52.050754+0000","last_fullsized":"2024-05-28T06:06:52.050754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:51:49.407219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050798+0000","last_change":"2024-05-28T06:06:49.917833+0000","last_active":"2024-05-28T06:06:52.050798+0000","last_peered":"2024-05-28T06:06:52.050798+0000","last_clean":"2024-05-28T06:06:52.050798+0000","last_became_active":"2024-05-28T06:06:49.916605+0000","last_became_peered":"2024-05-28T06:06:49.916605+0000","last_unstale":"2024-05-28T06:06:52.050798+0000","last_undegraded":"2024-05-28T06:06:52.050798+0000","last_fullsized":"2024-05-28T06:06:52.050798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:49:24.268887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.901133+0000","last_change":"2024-05-28T06:06:48.914207+0000","last_active":"2024-05-28T06:06:51.901133+0000","last_peered":"2024-05-28T06:06:51.901133+0000","last_clean":"2024-05-28T06:06:51.901133+0000","last_became_active":"2024-05-28T06:06:48.913795+0000","last_became_peered":"2024-05-28T06:06:48.913795+0000","last_unstale":"2024-05-28T06:06:51.901133+0000","last_undegraded":"2024-05-28T06:06:51.901133+0000","last_fullsized":"2024-05-28T06:06:51.901133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:36:12.350844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050519+0000","last_change":"2024-05-28T06:06:49.920839+0000","last_active":"2024-05-28T06:06:52.050519+0000","last_peered":"2024-05-28T06:06:52.050519+0000","last_clean":"2024-05-28T06:06:52.050519+0000","last_became_active":"2024-05-28T06:06:49.920580+0000","last_became_peered":"2024-05-28T06:06:49.920580+0000","last_unstale":"2024-05-28T06:06:52.050519+0000","last_undegraded":"2024-05-28T06:06:52.050519+0000","last_fullsized":"2024-05-28T06:06:52.050519+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:10:12.633755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.051091+0000","last_change":"2024-05-28T06:06:48.916920+0000","last_active":"2024-05-28T06:06:52.051091+0000","last_peered":"2024-05-28T06:06:52.051091+0000","last_clean":"2024-05-28T06:06:52.051091+0000","last_became_active":"2024-05-28T06:06:48.916571+0000","last_became_peered":"2024-05-28T06:06:48.916571+0000","last_unstale":"2024-05-28T06:06:52.051091+0000","last_undegraded":"2024-05-28T06:06:52.051091+0000","last_fullsized":"2024-05-28T06:06:52.051091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:26:05.927699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050930+0000","last_change":"2024-05-28T06:06:49.917335+0000","last_active":"2024-05-28T06:06:52.050930+0000","last_peered":"2024-05-28T06:06:52.050930+0000","last_clean":"2024-05-28T06:06:52.050930+0000","last_became_active":"2024-05-28T06:06:49.917070+0000","last_became_peered":"2024-05-28T06:06:49.917070+0000","last_unstale":"2024-05-28T06:06:52.050930+0000","last_undegraded":"2024-05-28T06:06:52.050930+0000","last_fullsized":"2024-05-28T06:06:52.050930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:44.071425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050577+0000","last_change":"2024-05-28T06:06:48.920291+0000","last_active":"2024-05-28T06:06:52.050577+0000","last_peered":"2024-05-28T06:06:52.050577+0000","last_clean":"2024-05-28T06:06:52.050577+0000","last_became_active":"2024-05-28T06:06:48.920042+0000","last_became_peered":"2024-05-28T06:06:48.920042+0000","last_unstale":"2024-05-28T06:06:52.050577+0000","last_undegraded":"2024-05-28T06:06:52.050577+0000","last_fullsized":"2024-05-28T06:06:52.050577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:51.745494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903397+0000","last_change":"2024-05-28T06:06:49.926380+0000","last_active":"2024-05-28T06:06:51.903397+0000","last_peered":"2024-05-28T06:06:51.903397+0000","last_clean":"2024-05-28T06:06:51.903397+0000","last_became_active":"2024-05-28T06:06:49.924655+0000","last_became_peered":"2024-05-28T06:06:49.924655+0000","last_unstale":"2024-05-28T06:06:51.903397+0000","last_undegraded":"2024-05-28T06:06:51.903397+0000","last_fullsized":"2024-05-28T06:06:51.903397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:53:52.395522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610748+0000","last_change":"2024-05-28T06:06:48.911033+0000","last_active":"2024-05-28T06:06:51.610748+0000","last_peered":"2024-05-28T06:06:51.610748+0000","last_clean":"2024-05-28T06:06:51.610748+0000","last_became_active":"2024-05-28T06:06:48.910725+0000","last_became_peered":"2024-05-28T06:06:48.910725+0000","last_unstale":"2024-05-28T06:06:51.610748+0000","last_undegraded":"2024-05-28T06:06:51.610748+0000","last_fullsized":"2024-05-28T06:06:51.610748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:11:45.126556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050450+0000","last_change":"2024-05-28T06:06:49.930589+0000","last_active":"2024-05-28T06:06:52.050450+0000","last_peered":"2024-05-28T06:06:52.050450+0000","last_clean":"2024-05-28T06:06:52.050450+0000","last_became_active":"2024-05-28T06:06:49.929009+0000","last_became_peered":"2024-05-28T06:06:49.929009+0000","last_unstale":"2024-05-28T06:06:52.050450+0000","last_undegraded":"2024-05-28T06:06:52.050450+0000","last_fullsized":"2024-05-28T06:06:52.050450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:32:19.232721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903413+0000","last_change":"2024-05-28T06:06:48.910249+0000","last_active":"2024-05-28T06:06:51.903413+0000","last_peered":"2024-05-28T06:06:51.903413+0000","last_clean":"2024-05-28T06:06:51.903413+0000","last_became_active":"2024-05-28T06:06:48.909956+0000","last_became_peered":"2024-05-28T06:06:48.909956+0000","last_unstale":"2024-05-28T06:06:51.903413+0000","last_undegraded":"2024-05-28T06:06:51.903413+0000","last_fullsized":"2024-05-28T06:06:51.903413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:05:57.788813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898319+0000","last_change":"2024-05-28T06:06:49.930744+0000","last_active":"2024-05-28T06:06:50.898319+0000","last_peered":"2024-05-28T06:06:50.898319+0000","last_clean":"2024-05-28T06:06:50.898319+0000","last_became_active":"2024-05-28T06:06:49.930429+0000","last_became_peered":"2024-05-28T06:06:49.930429+0000","last_unstale":"2024-05-28T06:06:50.898319+0000","last_undegraded":"2024-05-28T06:06:50.898319+0000","last_fullsized":"2024-05-28T06:06:50.898319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:15:04.927295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050023+0000","last_change":"2024-05-28T06:06:48.916349+0000","last_active":"2024-05-28T06:06:52.050023+0000","last_peered":"2024-05-28T06:06:52.050023+0000","last_clean":"2024-05-28T06:06:52.050023+0000","last_became_active":"2024-05-28T06:06:48.916094+0000","last_became_peered":"2024-05-28T06:06:48.916094+0000","last_unstale":"2024-05-28T06:06:52.050023+0000","last_undegraded":"2024-05-28T06:06:52.050023+0000","last_fullsized":"2024-05-28T06:06:52.050023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:21:08.497625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.326813+0000","last_change":"2024-05-28T06:06:49.933367+0000","last_active":"2024-05-28T06:06:51.326813+0000","last_peered":"2024-05-28T06:06:51.326813+0000","last_clean":"2024-05-28T06:06:51.326813+0000","last_became_active":"2024-05-28T06:06:49.933122+0000","last_became_peered":"2024-05-28T06:06:49.933122+0000","last_unstale":"2024-05-28T06:06:51.326813+0000","last_undegraded":"2024-05-28T06:06:51.326813+0000","last_fullsized":"2024-05-28T06:06:51.326813+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:21:09.503749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050011+0000","last_change":"2024-05-28T06:06:48.920880+0000","last_active":"2024-05-28T06:06:52.050011+0000","last_peered":"2024-05-28T06:06:52.050011+0000","last_clean":"2024-05-28T06:06:52.050011+0000","last_became_active":"2024-05-28T06:06:48.920622+0000","last_became_peered":"2024-05-28T06:06:48.920622+0000","last_unstale":"2024-05-28T06:06:52.050011+0000","last_undegraded":"2024-05-28T06:06:52.050011+0000","last_fullsized":"2024-05-28T06:06:52.050011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:46:59.873260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610637+0000","last_change":"2024-05-28T06:06:49.927894+0000","last_active":"2024-05-28T06:06:51.610637+0000","last_peered":"2024-05-28T06:06:51.610637+0000","last_clean":"2024-05-28T06:06:51.610637+0000","last_became_active":"2024-05-28T06:06:49.923249+0000","last_became_peered":"2024-05-28T06:06:49.923249+0000","last_unstale":"2024-05-28T06:06:51.610637+0000","last_undegraded":"2024-05-28T06:06:51.610637+0000","last_fullsized":"2024-05-28T06:06:51.610637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:34:59.610967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903956+0000","last_change":"2024-05-28T06:06:48.913000+0000","last_active":"2024-05-28T06:06:51.903956+0000","last_peered":"2024-05-28T06:06:51.903956+0000","last_clean":"2024-05-28T06:06:51.903956+0000","last_became_active":"2024-05-28T06:06:48.912691+0000","last_became_peered":"2024-05-28T06:06:48.912691+0000","last_unstale":"2024-05-28T06:06:51.903956+0000","last_undegraded":"2024-05-28T06:06:51.903956+0000","last_fullsized":"2024-05-28T06:06:51.903956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:46:59.873260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.051266+0000","last_change":"2024-05-28T06:06:49.927892+0000","last_active":"2024-05-28T06:06:52.051266+0000","last_peered":"2024-05-28T06:06:52.051266+0000","last_clean":"2024-05-28T06:06:52.051266+0000","last_became_active":"2024-05-28T06:06:49.927638+0000","last_became_peered":"2024-05-28T06:06:49.927638+0000","last_unstale":"2024-05-28T06:06:52.051266+0000","last_undegraded":"2024-05-28T06:06:52.051266+0000","last_fullsized":"2024-05-28T06:06:52.051266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:35:23.352099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610672+0000","last_change":"2024-05-28T06:06:48.913474+0000","last_active":"2024-05-28T06:06:51.610672+0000","last_peered":"2024-05-28T06:06:51.610672+0000","last_clean":"2024-05-28T06:06:51.610672+0000","last_became_active":"2024-05-28T06:06:48.913193+0000","last_became_peered":"2024-05-28T06:06:48.913193+0000","last_unstale":"2024-05-28T06:06:51.610672+0000","last_undegraded":"2024-05-28T06:06:51.610672+0000","last_fullsized":"2024-05-28T06:06:51.610672+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:05:57.788813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903651+0000","last_change":"2024-05-28T06:06:49.936278+0000","last_active":"2024-05-28T06:06:51.903651+0000","last_peered":"2024-05-28T06:06:51.903651+0000","last_clean":"2024-05-28T06:06:51.903651+0000","last_became_active":"2024-05-28T06:06:49.936121+0000","last_became_peered":"2024-05-28T06:06:49.936121+0000","last_unstale":"2024-05-28T06:06:51.903651+0000","last_undegraded":"2024-05-28T06:06:51.903651+0000","last_fullsized":"2024-05-28T06:06:51.903651+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:15:31.543660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610644+0000","last_change":"2024-05-28T06:06:48.912301+0000","last_active":"2024-05-28T06:06:51.610644+0000","last_peered":"2024-05-28T06:06:51.610644+0000","last_clean":"2024-05-28T06:06:51.610644+0000","last_became_active":"2024-05-28T06:06:48.911945+0000","last_became_peered":"2024-05-28T06:06:48.911945+0000","last_unstale":"2024-05-28T06:06:51.610644+0000","last_undegraded":"2024-05-28T06:06:51.610644+0000","last_fullsized":"2024-05-28T06:06:51.610644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:07:58.851898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.897082+0000","last_change":"2024-05-28T06:06:49.925624+0000","last_active":"2024-05-28T06:06:50.897082+0000","last_peered":"2024-05-28T06:06:50.897082+0000","last_clean":"2024-05-28T06:06:50.897082+0000","last_became_active":"2024-05-28T06:06:49.925454+0000","last_became_peered":"2024-05-28T06:06:49.925454+0000","last_unstale":"2024-05-28T06:06:50.897082+0000","last_undegraded":"2024-05-28T06:06:50.897082+0000","last_fullsized":"2024-05-28T06:06:50.897082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:47:00.879384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610513+0000","last_change":"2024-05-28T06:06:48.914271+0000","last_active":"2024-05-28T06:06:51.610513+0000","last_peered":"2024-05-28T06:06:51.610513+0000","last_clean":"2024-05-28T06:06:51.610513+0000","last_became_active":"2024-05-28T06:06:48.913955+0000","last_became_peered":"2024-05-28T06:06:48.913955+0000","last_unstale":"2024-05-28T06:06:51.610513+0000","last_undegraded":"2024-05-28T06:06:51.610513+0000","last_fullsized":"2024-05-28T06:06:51.610513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:17:07.374803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.896779+0000","last_change":"2024-05-28T06:06:49.929515+0000","last_active":"2024-05-28T06:06:50.896779+0000","last_peered":"2024-05-28T06:06:50.896779+0000","last_clean":"2024-05-28T06:06:50.896779+0000","last_became_active":"2024-05-28T06:06:49.929267+0000","last_became_peered":"2024-05-28T06:06:49.929267+0000","last_unstale":"2024-05-28T06:06:50.896779+0000","last_undegraded":"2024-05-28T06:06:50.896779+0000","last_fullsized":"2024-05-28T06:06:50.896779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:26:01.674003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.901030+0000","last_change":"2024-05-28T06:06:48.915508+0000","last_active":"2024-05-28T06:06:51.901030+0000","last_peered":"2024-05-28T06:06:51.901030+0000","last_clean":"2024-05-28T06:06:51.901030+0000","last_became_active":"2024-05-28T06:06:48.915236+0000","last_became_peered":"2024-05-28T06:06:48.915236+0000","last_unstale":"2024-05-28T06:06:51.901030+0000","last_undegraded":"2024-05-28T06:06:51.901030+0000","last_fullsized":"2024-05-28T06:06:51.901030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:26:00.667879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.897079+0000","last_change":"2024-05-28T06:06:49.924348+0000","last_active":"2024-05-28T06:06:50.897079+0000","last_peered":"2024-05-28T06:06:50.897079+0000","last_clean":"2024-05-28T06:06:50.897079+0000","last_became_active":"2024-05-28T06:06:49.924061+0000","last_became_peered":"2024-05-28T06:06:49.924061+0000","last_unstale":"2024-05-28T06:06:50.897079+0000","last_undegraded":"2024-05-28T06:06:50.897079+0000","last_fullsized":"2024-05-28T06:06:50.897079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:07:59.858022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.326913+0000","last_change":"2024-05-28T06:06:48.915547+0000","last_active":"2024-05-28T06:06:51.326913+0000","last_peered":"2024-05-28T06:06:51.326913+0000","last_clean":"2024-05-28T06:06:51.326913+0000","last_became_active":"2024-05-28T06:06:48.915254+0000","last_became_peered":"2024-05-28T06:06:48.915254+0000","last_unstale":"2024-05-28T06:06:51.326913+0000","last_undegraded":"2024-05-28T06:06:51.326913+0000","last_fullsized":"2024-05-28T06:06:51.326913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:36:12.350844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.896675+0000","last_change":"2024-05-28T06:06:49.926152+0000","last_active":"2024-05-28T06:06:50.896675+0000","last_peered":"2024-05-28T06:06:50.896675+0000","last_clean":"2024-05-28T06:06:50.896675+0000","last_became_active":"2024-05-28T06:06:49.923947+0000","last_became_peered":"2024-05-28T06:06:49.923947+0000","last_unstale":"2024-05-28T06:06:50.896675+0000","last_undegraded":"2024-05-28T06:06:50.896675+0000","last_fullsized":"2024-05-28T06:06:50.896675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:11:46.132680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610133+0000","last_change":"2024-05-28T06:06:48.918499+0000","last_active":"2024-05-28T06:06:51.610133+0000","last_peered":"2024-05-28T06:06:51.610133+0000","last_clean":"2024-05-28T06:06:51.610133+0000","last_became_active":"2024-05-28T06:06:48.918151+0000","last_became_peered":"2024-05-28T06:06:48.918151+0000","last_unstale":"2024-05-28T06:06:51.610133+0000","last_undegraded":"2024-05-28T06:06:51.610133+0000","last_fullsized":"2024-05-28T06:06:51.610133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:20:48.793281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898399+0000","last_change":"2024-05-28T06:06:49.908981+0000","last_active":"2024-05-28T06:06:50.898399+0000","last_peered":"2024-05-28T06:06:50.898399+0000","last_clean":"2024-05-28T06:06:50.898399+0000","last_became_active":"2024-05-28T06:06:49.908498+0000","last_became_peered":"2024-05-28T06:06:49.908498+0000","last_unstale":"2024-05-28T06:06:50.898399+0000","last_undegraded":"2024-05-28T06:06:50.898399+0000","last_fullsized":"2024-05-28T06:06:50.898399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:07:18.337847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050947+0000","last_change":"2024-05-28T06:06:48.916979+0000","last_active":"2024-05-28T06:06:52.050947+0000","last_peered":"2024-05-28T06:06:52.050947+0000","last_clean":"2024-05-28T06:06:52.050947+0000","last_became_active":"2024-05-28T06:06:48.916685+0000","last_became_peered":"2024-05-28T06:06:48.916685+0000","last_unstale":"2024-05-28T06:06:52.050947+0000","last_undegraded":"2024-05-28T06:06:52.050947+0000","last_fullsized":"2024-05-28T06:06:52.050947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:21:08.497625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.896910+0000","last_change":"2024-05-28T06:06:49.920999+0000","last_active":"2024-05-28T06:06:50.896910+0000","last_peered":"2024-05-28T06:06:50.896910+0000","last_clean":"2024-05-28T06:06:50.896910+0000","last_became_active":"2024-05-28T06:06:49.920763+0000","last_became_peered":"2024-05-28T06:06:49.920763+0000","last_unstale":"2024-05-28T06:06:50.896910+0000","last_undegraded":"2024-05-28T06:06:50.896910+0000","last_fullsized":"2024-05-28T06:06:50.896910+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:05:58.794937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903956+0000","last_change":"2024-05-28T06:06:48.903948+0000","last_active":"2024-05-28T06:06:51.903956+0000","last_peered":"2024-05-28T06:06:51.903956+0000","last_clean":"2024-05-28T06:06:51.903956+0000","last_became_active":"2024-05-28T06:06:48.903587+0000","last_became_peered":"2024-05-28T06:06:48.903587+0000","last_unstale":"2024-05-28T06:06:51.903956+0000","last_undegraded":"2024-05-28T06:06:51.903956+0000","last_fullsized":"2024-05-28T06:06:51.903956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:57:15.144731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.051329+0000","last_change":"2024-05-28T06:06:49.916409+0000","last_active":"2024-05-28T06:06:52.051329+0000","last_peered":"2024-05-28T06:06:52.051329+0000","last_clean":"2024-05-28T06:06:52.051329+0000","last_became_active":"2024-05-28T06:06:49.916030+0000","last_became_peered":"2024-05-28T06:06:49.916030+0000","last_unstale":"2024-05-28T06:06:52.051329+0000","last_undegraded":"2024-05-28T06:06:52.051329+0000","last_fullsized":"2024-05-28T06:06:52.051329+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:15:09.883838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.902688+0000","last_change":"2024-05-28T06:06:48.918124+0000","last_active":"2024-05-28T06:06:51.902688+0000","last_peered":"2024-05-28T06:06:51.902688+0000","last_clean":"2024-05-28T06:06:51.902688+0000","last_became_active":"2024-05-28T06:06:48.917793+0000","last_became_peered":"2024-05-28T06:06:48.917793+0000","last_unstale":"2024-05-28T06:06:51.902688+0000","last_undegraded":"2024-05-28T06:06:51.902688+0000","last_fullsized":"2024-05-28T06:06:51.902688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:17:07.374803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.901038+0000","last_change":"2024-05-28T06:06:49.918427+0000","last_active":"2024-05-28T06:06:51.901038+0000","last_peered":"2024-05-28T06:06:51.901038+0000","last_clean":"2024-05-28T06:06:51.901038+0000","last_became_active":"2024-05-28T06:06:49.918164+0000","last_became_peered":"2024-05-28T06:06:49.918164+0000","last_unstale":"2024-05-28T06:06:51.901038+0000","last_undegraded":"2024-05-28T06:06:51.901038+0000","last_fullsized":"2024-05-28T06:06:51.901038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:21:09.503749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903597+0000","last_change":"2024-05-28T06:06:48.905551+0000","last_active":"2024-05-28T06:06:51.903597+0000","last_peered":"2024-05-28T06:06:51.903597+0000","last_clean":"2024-05-28T06:06:51.903597+0000","last_became_active":"2024-05-28T06:06:48.905274+0000","last_became_peered":"2024-05-28T06:06:48.905274+0000","last_unstale":"2024-05-28T06:06:51.903597+0000","last_undegraded":"2024-05-28T06:06:51.903597+0000","last_fullsized":"2024-05-28T06:06:51.903597+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:36:12.350844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.326822+0000","last_change":"2024-05-28T06:06:49.924206+0000","last_active":"2024-05-28T06:06:51.326822+0000","last_peered":"2024-05-28T06:06:51.326822+0000","last_clean":"2024-05-28T06:06:51.326822+0000","last_became_active":"2024-05-28T06:06:49.923920+0000","last_became_peered":"2024-05-28T06:06:49.923920+0000","last_unstale":"2024-05-28T06:06:51.326822+0000","last_undegraded":"2024-05-28T06:06:51.326822+0000","last_fullsized":"2024-05-28T06:06:51.326822+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:26:06.933823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.901159+0000","last_change":"2024-05-28T06:06:48.912205+0000","last_active":"2024-05-28T06:06:51.901159+0000","last_peered":"2024-05-28T06:06:51.901159+0000","last_clean":"2024-05-28T06:06:51.901159+0000","last_became_active":"2024-05-28T06:06:48.911898+0000","last_became_peered":"2024-05-28T06:06:48.911898+0000","last_unstale":"2024-05-28T06:06:51.901159+0000","last_undegraded":"2024-05-28T06:06:51.901159+0000","last_fullsized":"2024-05-28T06:06:51.901159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:05:57.788813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.901059+0000","last_change":"2024-05-28T06:06:49.920395+0000","last_active":"2024-05-28T06:06:51.901059+0000","last_peered":"2024-05-28T06:06:51.901059+0000","last_clean":"2024-05-28T06:06:51.901059+0000","last_became_active":"2024-05-28T06:06:49.920087+0000","last_became_peered":"2024-05-28T06:06:49.920087+0000","last_unstale":"2024-05-28T06:06:51.901059+0000","last_undegraded":"2024-05-28T06:06:51.901059+0000","last_fullsized":"2024-05-28T06:06:51.901059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:51:50.413343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903510+0000","last_change":"2024-05-28T06:06:48.903306+0000","last_active":"2024-05-28T06:06:51.903510+0000","last_peered":"2024-05-28T06:06:51.903510+0000","last_clean":"2024-05-28T06:06:51.903510+0000","last_became_active":"2024-05-28T06:06:48.902982+0000","last_became_peered":"2024-05-28T06:06:48.902982+0000","last_unstale":"2024-05-28T06:06:51.903510+0000","last_undegraded":"2024-05-28T06:06:51.903510+0000","last_fullsized":"2024-05-28T06:06:51.903510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:17:07.374803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.049982+0000","last_change":"2024-05-28T06:06:49.913227+0000","last_active":"2024-05-28T06:06:52.049982+0000","last_peered":"2024-05-28T06:06:52.049982+0000","last_clean":"2024-05-28T06:06:52.049982+0000","last_became_active":"2024-05-28T06:06:49.912953+0000","last_became_peered":"2024-05-28T06:06:49.912953+0000","last_unstale":"2024-05-28T06:06:52.049982+0000","last_undegraded":"2024-05-28T06:06:52.049982+0000","last_fullsized":"2024-05-28T06:06:52.049982+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:17:10.071527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610259+0000","last_change":"2024-05-28T06:06:48.907193+0000","last_active":"2024-05-28T06:06:51.610259+0000","last_peered":"2024-05-28T06:06:51.610259+0000","last_clean":"2024-05-28T06:06:51.610259+0000","last_became_active":"2024-05-28T06:06:48.906871+0000","last_became_peered":"2024-05-28T06:06:48.906871+0000","last_unstale":"2024-05-28T06:06:51.610259+0000","last_undegraded":"2024-05-28T06:06:51.610259+0000","last_fullsized":"2024-05-28T06:06:51.610259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:36:12.350844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610142+0000","last_change":"2024-05-28T06:06:49.929082+0000","last_active":"2024-05-28T06:06:51.610142+0000","last_peered":"2024-05-28T06:06:51.610142+0000","last_clean":"2024-05-28T06:06:51.610142+0000","last_became_active":"2024-05-28T06:06:49.928817+0000","last_became_peered":"2024-05-28T06:06:49.928817+0000","last_unstale":"2024-05-28T06:06:51.610142+0000","last_undegraded":"2024-05-28T06:06:51.610142+0000","last_fullsized":"2024-05-28T06:06:51.610142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:22:45.724585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050055+0000","last_change":"2024-05-28T06:06:48.916333+0000","last_active":"2024-05-28T06:06:52.050055+0000","last_peered":"2024-05-28T06:06:52.050055+0000","last_clean":"2024-05-28T06:06:52.050055+0000","last_became_active":"2024-05-28T06:06:48.916041+0000","last_became_peered":"2024-05-28T06:06:48.916041+0000","last_unstale":"2024-05-28T06:06:52.050055+0000","last_undegraded":"2024-05-28T06:06:52.050055+0000","last_fullsized":"2024-05-28T06:06:52.050055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:57:15.144731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898593+0000","last_change":"2024-05-28T06:06:49.915300+0000","last_active":"2024-05-28T06:06:50.898593+0000","last_peered":"2024-05-28T06:06:50.898593+0000","last_clean":"2024-05-28T06:06:50.898593+0000","last_became_active":"2024-05-28T06:06:49.914960+0000","last_became_peered":"2024-05-28T06:06:49.914960+0000","last_unstale":"2024-05-28T06:06:50.898593+0000","last_undegraded":"2024-05-28T06:06:50.898593+0000","last_fullsized":"2024-05-28T06:06:50.898593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:20:52.065092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.326849+0000","last_change":"2024-05-28T06:06:48.915594+0000","last_active":"2024-05-28T06:06:51.326849+0000","last_peered":"2024-05-28T06:06:51.326849+0000","last_clean":"2024-05-28T06:06:51.326849+0000","last_became_active":"2024-05-28T06:06:48.915314+0000","last_became_peered":"2024-05-28T06:06:48.915314+0000","last_unstale":"2024-05-28T06:06:51.326849+0000","last_undegraded":"2024-05-28T06:06:51.326849+0000","last_fullsized":"2024-05-28T06:06:51.326849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:20:48.793281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":193,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898580+0000","last_change":"2024-05-28T06:05:38.517922+0000","last_active":"2024-05-28T06:06:50.898580+0000","last_peered":"2024-05-28T06:06:50.898580+0000","last_clean":"2024-05-28T06:06:50.898580+0000","last_became_active":"2024-05-28T06:05:38.514745+0000","last_became_peered":"2024-05-28T06:05:38.514745+0000","last_unstale":"2024-05-28T06:06:50.898580+0000","last_undegraded":"2024-05-28T06:06:50.898580+0000","last_fullsized":"2024-05-28T06:06:50.898580+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_clean_scrub_stamp":"2024-05-28T06:05:37.485018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:23:27.978203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":742389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":152547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":146303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":145735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":147265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":152001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":153565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":742299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-28T06:06:54.001 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-28T06:06:54.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.178+0000 7fa25fe00640 1 Processor -- start 2024-05-28T06:06:54.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.178+0000 7fa25fe00640 1 -- start start 2024-05-28T06:06:54.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.178+0000 7fa25fe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa2600b22c0 0x7fa2600b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:54.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.178+0000 7fa25fe00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa2600cde10 0x7fa2600d1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:54.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.178+0000 7fa25fe00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2600b2be0 con 0x7fa2600ce270 2024-05-28T06:06:54.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.178+0000 7fa25fe00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fa2600cf400 con 0x7fa2600cde10 2024-05-28T06:06:54.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.178+0000 7fa25fe00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa26015b990 con 0x7fa2600b22c0 2024-05-28T06:06:54.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.178+0000 7fa256000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa2600cde10 0x7fa2600d1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:54.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.178+0000 7fa256000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa2600cde10 0x7fa2600d1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59930/0 (socket says 172.21.15.122:59930) 2024-05-28T06:06:54.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.178+0000 7fa256000640 1 -- 172.21.15.122:0/745890316 learned_addr learned my addr 172.21.15.122:0/745890316 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:54.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.178+0000 7fa25ea00640 1 --2- 172.21.15.122:0/745890316 >> v2:172.21.15.153:3300/0 conn(0x7fa2600b22c0 0x7fa2600b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:54.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.178+0000 7fa256000640 1 -- 172.21.15.122:0/745890316 >> v2:172.21.15.153:3300/0 conn(0x7fa2600b22c0 msgr2=0x7fa2600b26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:54.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.178+0000 7fa256000640 1 --2- 172.21.15.122:0/745890316 >> v2:172.21.15.153:3300/0 conn(0x7fa2600b22c0 0x7fa2600b26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.178+0000 7fa256000640 1 -- 172.21.15.122:0/745890316 >> v1:172.21.15.153:6789/0 conn(0x7fa2600ce270 legacy=0x7fa2600d18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:54.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.178+0000 7fa256000640 1 -- 172.21.15.122:0/745890316 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2600ce7f0 con 0x7fa2600cde10 2024-05-28T06:06:54.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.182+0000 7fa256000640 1 --2- 172.21.15.122:0/745890316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2600cde10 0x7fa2600d1390 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa2600b4730 tx=0x7fa24801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d54bd23f74fb6c server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:54.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.182+0000 7fa25e000640 1 -- 172.21.15.122:0/745890316 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2480aa650 con 0x7fa2600cde10 2024-05-28T06:06:54.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.182+0000 7fa25e000640 1 -- 172.21.15.122:0/745890316 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2480af070 con 0x7fa2600cde10 2024-05-28T06:06:54.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.182+0000 7fa25e000640 1 -- 172.21.15.122:0/745890316 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2480aaa10 con 0x7fa2600cde10 2024-05-28T06:06:54.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.182+0000 7fa25fe00640 1 -- 172.21.15.122:0/745890316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2600cde10 msgr2=0x7fa2600d1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:54.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.182+0000 7fa25fe00640 1 --2- 172.21.15.122:0/745890316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2600cde10 0x7fa2600d1390 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa2600b4730 tx=0x7fa24801c4f0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.182+0000 7fa25fe00640 1 -- 172.21.15.122:0/745890316 shutdown_connections 2024-05-28T06:06:54.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.182+0000 7fa25fe00640 1 --2- 172.21.15.122:0/745890316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2600cde10 0x7fa2600d1390 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.182+0000 7fa25fe00640 1 --2- 172.21.15.122:0/745890316 >> v2:172.21.15.153:3300/0 conn(0x7fa2600b22c0 0x7fa2600b26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.182+0000 7fa25fe00640 1 -- 172.21.15.122:0/745890316 >> 172.21.15.122:0/745890316 conn(0x7fa2600b6b70 msgr2=0x7fa26009aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:54.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.182+0000 7fa25fe00640 1 -- 172.21.15.122:0/745890316 shutdown_connections 2024-05-28T06:06:54.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.182+0000 7fa25fe00640 1 -- 172.21.15.122:0/745890316 wait complete. 2024-05-28T06:06:54.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.182+0000 7fa25fe00640 1 Processor -- start 2024-05-28T06:06:54.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.182+0000 7fa25fe00640 1 -- start start 2024-05-28T06:06:54.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa25fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2600b22c0 0x7fa260141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:54.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa25fe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2600cde10 0x7fa2601554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:54.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa25fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2600ce270 0x7fa2601fa410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:54.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa25fe00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa2600b4f50 con 0x7fa2600ce270 2024-05-28T06:06:54.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa25fe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa2600b4dd0 con 0x7fa2600b22c0 2024-05-28T06:06:54.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa25fe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa2600d1fe0 con 0x7fa2600cde10 2024-05-28T06:06:54.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa25f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2600ce270 0x7fa2601fa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:54.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa25f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2600ce270 0x7fa2601fa410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59946/0 (socket says 172.21.15.122:59946) 2024-05-28T06:06:54.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa25f400640 1 -- 172.21.15.122:0/3473960278 learned_addr learned my addr 172.21.15.122:0/3473960278 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:54.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa25ea00640 1 --2- 172.21.15.122:0/3473960278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2600b22c0 0x7fa260141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:54.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa256000640 1 --2- 172.21.15.122:0/3473960278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2600cde10 0x7fa2601554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:54.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa25f400640 1 -- 172.21.15.122:0/3473960278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2600cde10 msgr2=0x7fa2601554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:54.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa25f400640 1 --2- 172.21.15.122:0/3473960278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2600cde10 0x7fa2601554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa25f400640 1 -- 172.21.15.122:0/3473960278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2600b22c0 msgr2=0x7fa260141260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:54.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa25f400640 1 --2- 172.21.15.122:0/3473960278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2600b22c0 0x7fa260141260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa25f400640 1 -- 172.21.15.122:0/3473960278 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2601417a0 con 0x7fa2600ce270 2024-05-28T06:06:54.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa25f400640 1 --2- 172.21.15.122:0/3473960278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2600ce270 0x7fa2601fa410 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa25800c760 tx=0x7fa25800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:54.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa257400640 1 -- 172.21.15.122:0/3473960278 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa258003b80 con 0x7fa2600ce270 2024-05-28T06:06:54.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa257400640 1 -- 172.21.15.122:0/3473960278 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa258003d20 con 0x7fa2600ce270 2024-05-28T06:06:54.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa25fe00640 1 -- 172.21.15.122:0/3473960278 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa260152b70 con 0x7fa2600ce270 2024-05-28T06:06:54.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa257400640 1 -- 172.21.15.122:0/3473960278 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25800aa30 con 0x7fa2600ce270 2024-05-28T06:06:54.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa25fe00640 1 -- 172.21.15.122:0/3473960278 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa260153130 con 0x7fa2600ce270 2024-05-28T06:06:54.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa25fe00640 1 -- 172.21.15.122:0/3473960278 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa260075620 con 0x7fa2600ce270 2024-05-28T06:06:54.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.186+0000 7fa257400640 1 -- 172.21.15.122:0/3473960278 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa25800abd0 con 0x7fa2600ce270 2024-05-28T06:06:54.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.190+0000 7fa257400640 1 --2- 172.21.15.122:0/3473960278 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa23c068380 0x7fa23c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:54.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.190+0000 7fa257400640 1 -- 172.21.15.122:0/3473960278 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa2580866b0 con 0x7fa2600ce270 2024-05-28T06:06:54.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.190+0000 7fa25ea00640 1 --2- 172.21.15.122:0/3473960278 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa23c068380 0x7fa23c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:54.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.190+0000 7fa25ea00640 1 --2- 172.21.15.122:0/3473960278 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa23c068380 0x7fa23c06a840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa250007a60 tx=0x7fa250008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:54.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.194+0000 7fa257400640 1 -- 172.21.15.122:0/3473960278 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa258056620 con 0x7fa2600ce270 2024-05-28T06:06:54.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.350+0000 7fa25fe00640 1 -- 172.21.15.122:0/3473960278 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa260073730 con 0x7fa23c068380 2024-05-28T06:06:54.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.358+0000 7fa257400640 1 -- 172.21.15.122:0/3473960278 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7fa260073730 con 0x7fa23c068380 2024-05-28T06:06:54.363 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:54.364 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-05-28T06:06:54.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.362+0000 7fa25fe00640 1 -- 172.21.15.122:0/3473960278 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa23c068380 msgr2=0x7fa23c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:54.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.362+0000 7fa25fe00640 1 --2- 172.21.15.122:0/3473960278 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa23c068380 0x7fa23c06a840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa250007a60 tx=0x7fa250008040 comp rx=0 tx=0).stop 2024-05-28T06:06:54.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.362+0000 7fa25fe00640 1 -- 172.21.15.122:0/3473960278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2600ce270 msgr2=0x7fa2601fa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:54.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.362+0000 7fa25fe00640 1 --2- 172.21.15.122:0/3473960278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2600ce270 0x7fa2601fa410 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa25800c760 tx=0x7fa25800cc20 comp rx=0 tx=0).stop 2024-05-28T06:06:54.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.362+0000 7fa25fe00640 1 -- 172.21.15.122:0/3473960278 shutdown_connections 2024-05-28T06:06:54.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.362+0000 7fa25fe00640 1 --2- 172.21.15.122:0/3473960278 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa23c068380 0x7fa23c06a840 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.362+0000 7fa25fe00640 1 --2- 172.21.15.122:0/3473960278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2600ce270 0x7fa2601fa410 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.362+0000 7fa25fe00640 1 --2- 172.21.15.122:0/3473960278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2600cde10 0x7fa2601554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.362+0000 7fa25fe00640 1 --2- 172.21.15.122:0/3473960278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2600b22c0 0x7fa260141260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.362+0000 7fa25fe00640 1 -- 172.21.15.122:0/3473960278 >> 172.21.15.122:0/3473960278 conn(0x7fa2600b6b70 msgr2=0x7fa260070290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:54.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.362+0000 7fa25fe00640 1 -- 172.21.15.122:0/3473960278 shutdown_connections 2024-05-28T06:06:54.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.362+0000 7fa25fe00640 1 -- 172.21.15.122:0/3473960278 wait complete. 2024-05-28T06:06:54.383 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-05-28T06:06:53.255765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220376,"kb_used_data":4196,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754344,"statfs":{"total":773094113280,"available":772868448256,"internally_reserved":0,"allocated":4296704,"data_stored":2382104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.368637"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.326952+0000","last_change":"2024-05-28T06:06:49.911349+0000","last_active":"2024-05-28T06:06:51.326952+0000","last_peered":"2024-05-28T06:06:51.326952+0000","last_clean":"2024-05-28T06:06:51.326952+0000","last_became_active":"2024-05-28T06:06:49.911050+0000","last_became_peered":"2024-05-28T06:06:49.911050+0000","last_unstale":"2024-05-28T06:06:51.326952+0000","last_undegraded":"2024-05-28T06:06:51.326952+0000","last_fullsized":"2024-05-28T06:06:51.326952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:52.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050681+0000","last_change":"2024-05-28T06:06:49.929349+0000","last_active":"2024-05-28T06:06:52.050681+0000","last_peered":"2024-05-28T06:06:52.050681+0000","last_clean":"2024-05-28T06:06:52.050681+0000","last_became_active":"2024-05-28T06:06:49.929093+0000","last_became_peered":"2024-05-28T06:06:49.929093+0000","last_unstale":"2024-05-28T06:06:52.050681+0000","last_undegraded":"2024-05-28T06:06:52.050681+0000","last_fullsized":"2024-05-28T06:06:52.050681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:35:23.352099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.051134+0000","last_change":"2024-05-28T06:06:49.915474+0000","last_active":"2024-05-28T06:06:52.051134+0000","last_peered":"2024-05-28T06:06:52.051134+0000","last_clean":"2024-05-28T06:06:52.051134+0000","last_became_active":"2024-05-28T06:06:49.915153+0000","last_became_peered":"2024-05-28T06:06:49.915153+0000","last_unstale":"2024-05-28T06:06:52.051134+0000","last_undegraded":"2024-05-28T06:06:52.051134+0000","last_fullsized":"2024-05-28T06:06:52.051134+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:10:12.633755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903411+0000","last_change":"2024-05-28T06:06:49.933769+0000","last_active":"2024-05-28T06:06:51.903411+0000","last_peered":"2024-05-28T06:06:51.903411+0000","last_clean":"2024-05-28T06:06:51.903411+0000","last_became_active":"2024-05-28T06:06:49.933462+0000","last_became_peered":"2024-05-28T06:06:49.933462+0000","last_unstale":"2024-05-28T06:06:51.903411+0000","last_undegraded":"2024-05-28T06:06:51.903411+0000","last_fullsized":"2024-05-28T06:06:51.903411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:22:45.724585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.896815+0000","last_change":"2024-05-28T06:06:49.916710+0000","last_active":"2024-05-28T06:06:50.896815+0000","last_peered":"2024-05-28T06:06:50.896815+0000","last_clean":"2024-05-28T06:06:50.896815+0000","last_became_active":"2024-05-28T06:06:49.916019+0000","last_became_peered":"2024-05-28T06:06:49.916019+0000","last_unstale":"2024-05-28T06:06:50.896815+0000","last_undegraded":"2024-05-28T06:06:50.896815+0000","last_fullsized":"2024-05-28T06:06:50.896815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:20:49.799405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050169+0000","last_change":"2024-05-28T06:06:49.913901+0000","last_active":"2024-05-28T06:06:52.050169+0000","last_peered":"2024-05-28T06:06:52.050169+0000","last_clean":"2024-05-28T06:06:52.050169+0000","last_became_active":"2024-05-28T06:06:49.913630+0000","last_became_peered":"2024-05-28T06:06:49.913630+0000","last_unstale":"2024-05-28T06:06:52.050169+0000","last_undegraded":"2024-05-28T06:06:52.050169+0000","last_fullsized":"2024-05-28T06:06:52.050169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:44.071425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898756+0000","last_change":"2024-05-28T06:06:49.916462+0000","last_active":"2024-05-28T06:06:50.898756+0000","last_peered":"2024-05-28T06:06:50.898756+0000","last_clean":"2024-05-28T06:06:50.898756+0000","last_became_active":"2024-05-28T06:06:49.916154+0000","last_became_peered":"2024-05-28T06:06:49.916154+0000","last_unstale":"2024-05-28T06:06:50.898756+0000","last_undegraded":"2024-05-28T06:06:50.898756+0000","last_fullsized":"2024-05-28T06:06:50.898756+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:10:12.633755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898298+0000","last_change":"2024-05-28T06:06:49.908259+0000","last_active":"2024-05-28T06:06:50.898298+0000","last_peered":"2024-05-28T06:06:50.898298+0000","last_clean":"2024-05-28T06:06:50.898298+0000","last_became_active":"2024-05-28T06:06:49.906662+0000","last_became_peered":"2024-05-28T06:06:49.906662+0000","last_unstale":"2024-05-28T06:06:50.898298+0000","last_undegraded":"2024-05-28T06:06:50.898298+0000","last_fullsized":"2024-05-28T06:06:50.898298+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:15:31.543660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610782+0000","last_change":"2024-05-28T06:06:49.924407+0000","last_active":"2024-05-28T06:06:51.610782+0000","last_peered":"2024-05-28T06:06:51.610782+0000","last_clean":"2024-05-28T06:06:51.610782+0000","last_became_active":"2024-05-28T06:06:49.923961+0000","last_became_peered":"2024-05-28T06:06:49.923961+0000","last_unstale":"2024-05-28T06:06:51.610782+0000","last_undegraded":"2024-05-28T06:06:51.610782+0000","last_fullsized":"2024-05-28T06:06:51.610782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:17:10.071527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903764+0000","last_change":"2024-05-28T06:06:49.921616+0000","last_active":"2024-05-28T06:06:51.903764+0000","last_peered":"2024-05-28T06:06:51.903764+0000","last_clean":"2024-05-28T06:06:51.903764+0000","last_became_active":"2024-05-28T06:06:49.921335+0000","last_became_peered":"2024-05-28T06:06:49.921335+0000","last_unstale":"2024-05-28T06:06:51.903764+0000","last_undegraded":"2024-05-28T06:06:51.903764+0000","last_fullsized":"2024-05-28T06:06:51.903764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:34:59.610967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898396+0000","last_change":"2024-05-28T06:06:49.919167+0000","last_active":"2024-05-28T06:06:50.898396+0000","last_peered":"2024-05-28T06:06:50.898396+0000","last_clean":"2024-05-28T06:06:50.898396+0000","last_became_active":"2024-05-28T06:06:49.918823+0000","last_became_peered":"2024-05-28T06:06:49.918823+0000","last_unstale":"2024-05-28T06:06:50.898396+0000","last_undegraded":"2024-05-28T06:06:50.898396+0000","last_fullsized":"2024-05-28T06:06:50.898396+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:34:59.610967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050903+0000","last_change":"2024-05-28T06:06:49.904030+0000","last_active":"2024-05-28T06:06:52.050903+0000","last_peered":"2024-05-28T06:06:52.050903+0000","last_clean":"2024-05-28T06:06:52.050903+0000","last_became_active":"2024-05-28T06:06:49.903745+0000","last_became_peered":"2024-05-28T06:06:49.903745+0000","last_unstale":"2024-05-28T06:06:52.050903+0000","last_undegraded":"2024-05-28T06:06:52.050903+0000","last_fullsized":"2024-05-28T06:06:52.050903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:17:10.071527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.897012+0000","last_change":"2024-05-28T06:06:49.919589+0000","last_active":"2024-05-28T06:06:50.897012+0000","last_peered":"2024-05-28T06:06:50.897012+0000","last_clean":"2024-05-28T06:06:50.897012+0000","last_became_active":"2024-05-28T06:06:49.919334+0000","last_became_peered":"2024-05-28T06:06:49.919334+0000","last_unstale":"2024-05-28T06:06:50.897012+0000","last_undegraded":"2024-05-28T06:06:50.897012+0000","last_fullsized":"2024-05-28T06:06:50.897012+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:17:08.380927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050189+0000","last_change":"2024-05-28T06:06:49.913133+0000","last_active":"2024-05-28T06:06:52.050189+0000","last_peered":"2024-05-28T06:06:52.050189+0000","last_clean":"2024-05-28T06:06:52.050189+0000","last_became_active":"2024-05-28T06:06:49.912827+0000","last_became_peered":"2024-05-28T06:06:49.912827+0000","last_unstale":"2024-05-28T06:06:52.050189+0000","last_undegraded":"2024-05-28T06:06:52.050189+0000","last_fullsized":"2024-05-28T06:06:52.050189+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:20:52.065092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050977+0000","last_change":"2024-05-28T06:06:49.910317+0000","last_active":"2024-05-28T06:06:52.050977+0000","last_peered":"2024-05-28T06:06:52.050977+0000","last_clean":"2024-05-28T06:06:52.050977+0000","last_became_active":"2024-05-28T06:06:49.910006+0000","last_became_peered":"2024-05-28T06:06:49.910006+0000","last_unstale":"2024-05-28T06:06:52.050977+0000","last_undegraded":"2024-05-28T06:06:52.050977+0000","last_fullsized":"2024-05-28T06:06:52.050977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:20:52.065092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898648+0000","last_change":"2024-05-28T06:06:49.922027+0000","last_active":"2024-05-28T06:06:50.898648+0000","last_peered":"2024-05-28T06:06:50.898648+0000","last_clean":"2024-05-28T06:06:50.898648+0000","last_became_active":"2024-05-28T06:06:49.921800+0000","last_became_peered":"2024-05-28T06:06:49.921800+0000","last_unstale":"2024-05-28T06:06:50.898648+0000","last_undegraded":"2024-05-28T06:06:50.898648+0000","last_fullsized":"2024-05-28T06:06:50.898648+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:32:19.232721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898517+0000","last_change":"2024-05-28T06:06:49.914520+0000","last_active":"2024-05-28T06:06:50.898517+0000","last_peered":"2024-05-28T06:06:50.898517+0000","last_clean":"2024-05-28T06:06:50.898517+0000","last_became_active":"2024-05-28T06:06:49.914166+0000","last_became_peered":"2024-05-28T06:06:49.914166+0000","last_unstale":"2024-05-28T06:06:50.898517+0000","last_undegraded":"2024-05-28T06:06:50.898517+0000","last_fullsized":"2024-05-28T06:06:50.898517+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:44.071425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050752+0000","last_change":"2024-05-28T06:06:49.917262+0000","last_active":"2024-05-28T06:06:52.050752+0000","last_peered":"2024-05-28T06:06:52.050752+0000","last_clean":"2024-05-28T06:06:52.050752+0000","last_became_active":"2024-05-28T06:06:49.917019+0000","last_became_peered":"2024-05-28T06:06:49.917019+0000","last_unstale":"2024-05-28T06:06:52.050752+0000","last_undegraded":"2024-05-28T06:06:52.050752+0000","last_fullsized":"2024-05-28T06:06:52.050752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:15:09.883838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050528+0000","last_change":"2024-05-28T06:06:49.914876+0000","last_active":"2024-05-28T06:06:52.050528+0000","last_peered":"2024-05-28T06:06:52.050528+0000","last_clean":"2024-05-28T06:06:52.050528+0000","last_became_active":"2024-05-28T06:06:49.914609+0000","last_became_peered":"2024-05-28T06:06:49.914609+0000","last_unstale":"2024-05-28T06:06:52.050528+0000","last_undegraded":"2024-05-28T06:06:52.050528+0000","last_fullsized":"2024-05-28T06:06:52.050528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:58:41.711951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.896862+0000","last_change":"2024-05-28T06:06:49.918752+0000","last_active":"2024-05-28T06:06:50.896862+0000","last_peered":"2024-05-28T06:06:50.896862+0000","last_clean":"2024-05-28T06:06:50.896862+0000","last_became_active":"2024-05-28T06:06:49.918523+0000","last_became_peered":"2024-05-28T06:06:49.918523+0000","last_unstale":"2024-05-28T06:06:50.896862+0000","last_undegraded":"2024-05-28T06:06:50.896862+0000","last_fullsized":"2024-05-28T06:06:50.896862+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:36:13.356967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610341+0000","last_change":"2024-05-28T06:06:49.929198+0000","last_active":"2024-05-28T06:06:51.610341+0000","last_peered":"2024-05-28T06:06:51.610341+0000","last_clean":"2024-05-28T06:06:51.610341+0000","last_became_active":"2024-05-28T06:06:49.924424+0000","last_became_peered":"2024-05-28T06:06:49.924424+0000","last_unstale":"2024-05-28T06:06:51.610341+0000","last_undegraded":"2024-05-28T06:06:51.610341+0000","last_fullsized":"2024-05-28T06:06:51.610341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:42:51.478908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610227+0000","last_change":"2024-05-28T06:06:49.928594+0000","last_active":"2024-05-28T06:06:51.610227+0000","last_peered":"2024-05-28T06:06:51.610227+0000","last_clean":"2024-05-28T06:06:51.610227+0000","last_became_active":"2024-05-28T06:06:49.928272+0000","last_became_peered":"2024-05-28T06:06:49.928272+0000","last_unstale":"2024-05-28T06:06:51.610227+0000","last_undegraded":"2024-05-28T06:06:51.610227+0000","last_fullsized":"2024-05-28T06:06:51.610227+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:15:31.543660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.901127+0000","last_change":"2024-05-28T06:06:49.920581+0000","last_active":"2024-05-28T06:06:51.901127+0000","last_peered":"2024-05-28T06:06:51.901127+0000","last_clean":"2024-05-28T06:06:51.901127+0000","last_became_active":"2024-05-28T06:06:49.920314+0000","last_became_peered":"2024-05-28T06:06:49.920314+0000","last_unstale":"2024-05-28T06:06:51.901127+0000","last_undegraded":"2024-05-28T06:06:51.901127+0000","last_fullsized":"2024-05-28T06:06:51.901127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:52.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050769+0000","last_change":"2024-05-28T06:06:49.908199+0000","last_active":"2024-05-28T06:06:52.050769+0000","last_peered":"2024-05-28T06:06:52.050769+0000","last_clean":"2024-05-28T06:06:52.050769+0000","last_became_active":"2024-05-28T06:06:49.907898+0000","last_became_peered":"2024-05-28T06:06:49.907898+0000","last_unstale":"2024-05-28T06:06:52.050769+0000","last_undegraded":"2024-05-28T06:06:52.050769+0000","last_fullsized":"2024-05-28T06:06:52.050769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:07:18.337847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903839+0000","last_change":"2024-05-28T06:06:49.926201+0000","last_active":"2024-05-28T06:06:51.903839+0000","last_peered":"2024-05-28T06:06:51.903839+0000","last_clean":"2024-05-28T06:06:51.903839+0000","last_became_active":"2024-05-28T06:06:49.926030+0000","last_became_peered":"2024-05-28T06:06:49.926030+0000","last_unstale":"2024-05-28T06:06:51.903839+0000","last_undegraded":"2024-05-28T06:06:51.903839+0000","last_fullsized":"2024-05-28T06:06:51.903839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:07:18.337847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050778+0000","last_change":"2024-05-28T06:06:49.920482+0000","last_active":"2024-05-28T06:06:52.050778+0000","last_peered":"2024-05-28T06:06:52.050778+0000","last_clean":"2024-05-28T06:06:52.050778+0000","last_became_active":"2024-05-28T06:06:49.920222+0000","last_became_peered":"2024-05-28T06:06:49.920222+0000","last_unstale":"2024-05-28T06:06:52.050778+0000","last_undegraded":"2024-05-28T06:06:52.050778+0000","last_fullsized":"2024-05-28T06:06:52.050778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:17:54.503357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903722+0000","last_change":"2024-05-28T06:06:49.935924+0000","last_active":"2024-05-28T06:06:51.903722+0000","last_peered":"2024-05-28T06:06:51.903722+0000","last_clean":"2024-05-28T06:06:51.903722+0000","last_became_active":"2024-05-28T06:06:49.933054+0000","last_became_peered":"2024-05-28T06:06:49.933054+0000","last_unstale":"2024-05-28T06:06:51.903722+0000","last_undegraded":"2024-05-28T06:06:51.903722+0000","last_fullsized":"2024-05-28T06:06:51.903722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:42:51.478908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.051099+0000","last_change":"2024-05-28T06:06:49.915352+0000","last_active":"2024-05-28T06:06:52.051099+0000","last_peered":"2024-05-28T06:06:52.051099+0000","last_clean":"2024-05-28T06:06:52.051099+0000","last_became_active":"2024-05-28T06:06:49.915019+0000","last_became_peered":"2024-05-28T06:06:49.915019+0000","last_unstale":"2024-05-28T06:06:52.051099+0000","last_undegraded":"2024-05-28T06:06:52.051099+0000","last_fullsized":"2024-05-28T06:06:52.051099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:32:19.232721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610448+0000","last_change":"2024-05-28T06:06:49.924091+0000","last_active":"2024-05-28T06:06:51.610448+0000","last_peered":"2024-05-28T06:06:51.610448+0000","last_clean":"2024-05-28T06:06:51.610448+0000","last_became_active":"2024-05-28T06:06:49.923491+0000","last_became_peered":"2024-05-28T06:06:49.923491+0000","last_unstale":"2024-05-28T06:06:51.610448+0000","last_undegraded":"2024-05-28T06:06:51.610448+0000","last_fullsized":"2024-05-28T06:06:51.610448+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:15:04.927295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898488+0000","last_change":"2024-05-28T06:06:49.914863+0000","last_active":"2024-05-28T06:06:50.898488+0000","last_peered":"2024-05-28T06:06:50.898488+0000","last_clean":"2024-05-28T06:06:50.898488+0000","last_became_active":"2024-05-28T06:06:49.914565+0000","last_became_peered":"2024-05-28T06:06:49.914565+0000","last_unstale":"2024-05-28T06:06:50.898488+0000","last_undegraded":"2024-05-28T06:06:50.898488+0000","last_fullsized":"2024-05-28T06:06:50.898488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:17:10.071527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.326944+0000","last_change":"2024-05-28T06:06:49.907250+0000","last_active":"2024-05-28T06:06:51.326944+0000","last_peered":"2024-05-28T06:06:51.326944+0000","last_clean":"2024-05-28T06:06:51.326944+0000","last_became_active":"2024-05-28T06:06:49.906943+0000","last_became_peered":"2024-05-28T06:06:49.906943+0000","last_unstale":"2024-05-28T06:06:51.326944+0000","last_undegraded":"2024-05-28T06:06:51.326944+0000","last_fullsized":"2024-05-28T06:06:51.326944+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:51:50.413343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898106+0000","last_change":"2024-05-28T06:06:49.926056+0000","last_active":"2024-05-28T06:06:50.898106+0000","last_peered":"2024-05-28T06:06:50.898106+0000","last_clean":"2024-05-28T06:06:50.898106+0000","last_became_active":"2024-05-28T06:06:49.925786+0000","last_became_peered":"2024-05-28T06:06:49.925786+0000","last_unstale":"2024-05-28T06:06:50.898106+0000","last_undegraded":"2024-05-28T06:06:50.898106+0000","last_fullsized":"2024-05-28T06:06:50.898106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:42:51.478908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.901038+0000","last_change":"2024-05-28T06:06:49.921956+0000","last_active":"2024-05-28T06:06:51.901038+0000","last_peered":"2024-05-28T06:06:51.901038+0000","last_clean":"2024-05-28T06:06:51.901038+0000","last_became_active":"2024-05-28T06:06:49.920758+0000","last_became_peered":"2024-05-28T06:06:49.920758+0000","last_unstale":"2024-05-28T06:06:51.901038+0000","last_undegraded":"2024-05-28T06:06:51.901038+0000","last_fullsized":"2024-05-28T06:06:51.901038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:26:06.933823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.327036+0000","last_change":"2024-05-28T06:06:48.913852+0000","last_active":"2024-05-28T06:06:51.327036+0000","last_peered":"2024-05-28T06:06:51.327036+0000","last_clean":"2024-05-28T06:06:51.327036+0000","last_became_active":"2024-05-28T06:06:48.911471+0000","last_became_peered":"2024-05-28T06:06:48.911471+0000","last_unstale":"2024-05-28T06:06:51.327036+0000","last_undegraded":"2024-05-28T06:06:51.327036+0000","last_fullsized":"2024-05-28T06:06:51.327036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:26:00.667879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.327035+0000","last_change":"2024-05-28T06:06:49.925217+0000","last_active":"2024-05-28T06:06:51.327035+0000","last_peered":"2024-05-28T06:06:51.327035+0000","last_clean":"2024-05-28T06:06:51.327035+0000","last_became_active":"2024-05-28T06:06:49.924864+0000","last_became_peered":"2024-05-28T06:06:49.924864+0000","last_unstale":"2024-05-28T06:06:51.327035+0000","last_undegraded":"2024-05-28T06:06:51.327035+0000","last_fullsized":"2024-05-28T06:06:51.327035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T18:01:04.418080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.901112+0000","last_change":"2024-05-28T06:06:48.915411+0000","last_active":"2024-05-28T06:06:51.901112+0000","last_peered":"2024-05-28T06:06:51.901112+0000","last_clean":"2024-05-28T06:06:51.901112+0000","last_became_active":"2024-05-28T06:06:48.915084+0000","last_became_peered":"2024-05-28T06:06:48.915084+0000","last_unstale":"2024-05-28T06:06:51.901112+0000","last_undegraded":"2024-05-28T06:06:51.901112+0000","last_fullsized":"2024-05-28T06:06:51.901112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:20:48.793281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610695+0000","last_change":"2024-05-28T06:06:49.927944+0000","last_active":"2024-05-28T06:06:51.610695+0000","last_peered":"2024-05-28T06:06:51.610695+0000","last_clean":"2024-05-28T06:06:51.610695+0000","last_became_active":"2024-05-28T06:06:49.922919+0000","last_became_peered":"2024-05-28T06:06:49.922919+0000","last_unstale":"2024-05-28T06:06:51.610695+0000","last_undegraded":"2024-05-28T06:06:51.610695+0000","last_fullsized":"2024-05-28T06:06:51.610695+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:07:18.337847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050471+0000","last_change":"2024-05-28T06:06:48.920312+0000","last_active":"2024-05-28T06:06:52.050471+0000","last_peered":"2024-05-28T06:06:52.050471+0000","last_clean":"2024-05-28T06:06:52.050471+0000","last_became_active":"2024-05-28T06:06:48.920015+0000","last_became_peered":"2024-05-28T06:06:48.920015+0000","last_unstale":"2024-05-28T06:06:52.050471+0000","last_undegraded":"2024-05-28T06:06:52.050471+0000","last_fullsized":"2024-05-28T06:06:52.050471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:26:05.927699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903737+0000","last_change":"2024-05-28T06:06:49.933393+0000","last_active":"2024-05-28T06:06:51.903737+0000","last_peered":"2024-05-28T06:06:51.903737+0000","last_clean":"2024-05-28T06:06:51.903737+0000","last_became_active":"2024-05-28T06:06:49.932702+0000","last_became_peered":"2024-05-28T06:06:49.932702+0000","last_unstale":"2024-05-28T06:06:51.903737+0000","last_undegraded":"2024-05-28T06:06:51.903737+0000","last_fullsized":"2024-05-28T06:06:51.903737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:15:04.927295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.896936+0000","last_change":"2024-05-28T06:06:48.913857+0000","last_active":"2024-05-28T06:06:50.896936+0000","last_peered":"2024-05-28T06:06:50.896936+0000","last_clean":"2024-05-28T06:06:50.896936+0000","last_became_active":"2024-05-28T06:06:48.913559+0000","last_became_peered":"2024-05-28T06:06:48.913559+0000","last_unstale":"2024-05-28T06:06:50.896936+0000","last_undegraded":"2024-05-28T06:06:50.896936+0000","last_fullsized":"2024-05-28T06:06:50.896936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:59:07.079204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898793+0000","last_change":"2024-05-28T06:06:49.931396+0000","last_active":"2024-05-28T06:06:50.898793+0000","last_peered":"2024-05-28T06:06:50.898793+0000","last_clean":"2024-05-28T06:06:50.898793+0000","last_became_active":"2024-05-28T06:06:49.931123+0000","last_became_peered":"2024-05-28T06:06:49.931123+0000","last_unstale":"2024-05-28T06:06:50.898793+0000","last_undegraded":"2024-05-28T06:06:50.898793+0000","last_fullsized":"2024-05-28T06:06:50.898793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:58:41.711951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610490+0000","last_change":"2024-05-28T06:06:48.910242+0000","last_active":"2024-05-28T06:06:51.610490+0000","last_peered":"2024-05-28T06:06:51.610490+0000","last_clean":"2024-05-28T06:06:51.610490+0000","last_became_active":"2024-05-28T06:06:48.909951+0000","last_became_peered":"2024-05-28T06:06:48.909951+0000","last_unstale":"2024-05-28T06:06:51.610490+0000","last_undegraded":"2024-05-28T06:06:51.610490+0000","last_fullsized":"2024-05-28T06:06:51.610490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:09:51.995851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050775+0000","last_change":"2024-05-28T06:06:49.910661+0000","last_active":"2024-05-28T06:06:52.050775+0000","last_peered":"2024-05-28T06:06:52.050775+0000","last_clean":"2024-05-28T06:06:52.050775+0000","last_became_active":"2024-05-28T06:06:49.910313+0000","last_became_peered":"2024-05-28T06:06:49.910313+0000","last_unstale":"2024-05-28T06:06:52.050775+0000","last_undegraded":"2024-05-28T06:06:52.050775+0000","last_fullsized":"2024-05-28T06:06:52.050775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:34:59.610967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610192+0000","last_change":"2024-05-28T06:06:48.909112+0000","last_active":"2024-05-28T06:06:51.610192+0000","last_peered":"2024-05-28T06:06:51.610192+0000","last_clean":"2024-05-28T06:06:51.610192+0000","last_became_active":"2024-05-28T06:06:48.908796+0000","last_became_peered":"2024-05-28T06:06:48.908796+0000","last_unstale":"2024-05-28T06:06:51.610192+0000","last_undegraded":"2024-05-28T06:06:51.610192+0000","last_fullsized":"2024-05-28T06:06:51.610192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:26:00.667879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610029+0000","last_change":"2024-05-28T06:06:49.922021+0000","last_active":"2024-05-28T06:06:51.610029+0000","last_peered":"2024-05-28T06:06:51.610029+0000","last_clean":"2024-05-28T06:06:51.610029+0000","last_became_active":"2024-05-28T06:06:49.918063+0000","last_became_peered":"2024-05-28T06:06:49.918063+0000","last_unstale":"2024-05-28T06:06:51.610029+0000","last_undegraded":"2024-05-28T06:06:51.610029+0000","last_fullsized":"2024-05-28T06:06:51.610029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:53:52.395522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.049968+0000","last_change":"2024-05-28T06:06:48.908204+0000","last_active":"2024-05-28T06:06:52.049968+0000","last_peered":"2024-05-28T06:06:52.049968+0000","last_clean":"2024-05-28T06:06:52.049968+0000","last_became_active":"2024-05-28T06:06:48.907846+0000","last_became_peered":"2024-05-28T06:06:48.907846+0000","last_unstale":"2024-05-28T06:06:52.049968+0000","last_undegraded":"2024-05-28T06:06:52.049968+0000","last_fullsized":"2024-05-28T06:06:52.049968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:34:32.941762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903310+0000","last_change":"2024-05-28T06:06:49.913654+0000","last_active":"2024-05-28T06:06:51.903310+0000","last_peered":"2024-05-28T06:06:51.903310+0000","last_clean":"2024-05-28T06:06:51.903310+0000","last_became_active":"2024-05-28T06:06:49.913452+0000","last_became_peered":"2024-05-28T06:06:49.913452+0000","last_unstale":"2024-05-28T06:06:51.903310+0000","last_undegraded":"2024-05-28T06:06:51.903310+0000","last_fullsized":"2024-05-28T06:06:51.903310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:26:54.816940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610025+0000","last_change":"2024-05-28T06:06:48.910904+0000","last_active":"2024-05-28T06:06:51.610025+0000","last_peered":"2024-05-28T06:06:51.610025+0000","last_clean":"2024-05-28T06:06:51.610025+0000","last_became_active":"2024-05-28T06:06:48.908525+0000","last_became_peered":"2024-05-28T06:06:48.908525+0000","last_unstale":"2024-05-28T06:06:51.610025+0000","last_undegraded":"2024-05-28T06:06:51.610025+0000","last_fullsized":"2024-05-28T06:06:51.610025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:44:37.523352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.051181+0000","last_change":"2024-05-28T06:06:49.903122+0000","last_active":"2024-05-28T06:06:52.051181+0000","last_peered":"2024-05-28T06:06:52.051181+0000","last_clean":"2024-05-28T06:06:52.051181+0000","last_became_active":"2024-05-28T06:06:49.902808+0000","last_became_peered":"2024-05-28T06:06:49.902808+0000","last_unstale":"2024-05-28T06:06:52.051181+0000","last_undegraded":"2024-05-28T06:06:52.051181+0000","last_fullsized":"2024-05-28T06:06:52.051181+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:58:41.711951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050754+0000","last_change":"2024-05-28T06:06:48.916423+0000","last_active":"2024-05-28T06:06:52.050754+0000","last_peered":"2024-05-28T06:06:52.050754+0000","last_clean":"2024-05-28T06:06:52.050754+0000","last_became_active":"2024-05-28T06:06:48.916068+0000","last_became_peered":"2024-05-28T06:06:48.916068+0000","last_unstale":"2024-05-28T06:06:52.050754+0000","last_undegraded":"2024-05-28T06:06:52.050754+0000","last_fullsized":"2024-05-28T06:06:52.050754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:51:49.407219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050798+0000","last_change":"2024-05-28T06:06:49.917833+0000","last_active":"2024-05-28T06:06:52.050798+0000","last_peered":"2024-05-28T06:06:52.050798+0000","last_clean":"2024-05-28T06:06:52.050798+0000","last_became_active":"2024-05-28T06:06:49.916605+0000","last_became_peered":"2024-05-28T06:06:49.916605+0000","last_unstale":"2024-05-28T06:06:52.050798+0000","last_undegraded":"2024-05-28T06:06:52.050798+0000","last_fullsized":"2024-05-28T06:06:52.050798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:49:24.268887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.901133+0000","last_change":"2024-05-28T06:06:48.914207+0000","last_active":"2024-05-28T06:06:51.901133+0000","last_peered":"2024-05-28T06:06:51.901133+0000","last_clean":"2024-05-28T06:06:51.901133+0000","last_became_active":"2024-05-28T06:06:48.913795+0000","last_became_peered":"2024-05-28T06:06:48.913795+0000","last_unstale":"2024-05-28T06:06:51.901133+0000","last_undegraded":"2024-05-28T06:06:51.901133+0000","last_fullsized":"2024-05-28T06:06:51.901133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:36:12.350844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050519+0000","last_change":"2024-05-28T06:06:49.920839+0000","last_active":"2024-05-28T06:06:52.050519+0000","last_peered":"2024-05-28T06:06:52.050519+0000","last_clean":"2024-05-28T06:06:52.050519+0000","last_became_active":"2024-05-28T06:06:49.920580+0000","last_became_peered":"2024-05-28T06:06:49.920580+0000","last_unstale":"2024-05-28T06:06:52.050519+0000","last_undegraded":"2024-05-28T06:06:52.050519+0000","last_fullsized":"2024-05-28T06:06:52.050519+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:10:12.633755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.051091+0000","last_change":"2024-05-28T06:06:48.916920+0000","last_active":"2024-05-28T06:06:52.051091+0000","last_peered":"2024-05-28T06:06:52.051091+0000","last_clean":"2024-05-28T06:06:52.051091+0000","last_became_active":"2024-05-28T06:06:48.916571+0000","last_became_peered":"2024-05-28T06:06:48.916571+0000","last_unstale":"2024-05-28T06:06:52.051091+0000","last_undegraded":"2024-05-28T06:06:52.051091+0000","last_fullsized":"2024-05-28T06:06:52.051091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:26:05.927699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050930+0000","last_change":"2024-05-28T06:06:49.917335+0000","last_active":"2024-05-28T06:06:52.050930+0000","last_peered":"2024-05-28T06:06:52.050930+0000","last_clean":"2024-05-28T06:06:52.050930+0000","last_became_active":"2024-05-28T06:06:49.917070+0000","last_became_peered":"2024-05-28T06:06:49.917070+0000","last_unstale":"2024-05-28T06:06:52.050930+0000","last_undegraded":"2024-05-28T06:06:52.050930+0000","last_fullsized":"2024-05-28T06:06:52.050930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:44.071425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050577+0000","last_change":"2024-05-28T06:06:48.920291+0000","last_active":"2024-05-28T06:06:52.050577+0000","last_peered":"2024-05-28T06:06:52.050577+0000","last_clean":"2024-05-28T06:06:52.050577+0000","last_became_active":"2024-05-28T06:06:48.920042+0000","last_became_peered":"2024-05-28T06:06:48.920042+0000","last_unstale":"2024-05-28T06:06:52.050577+0000","last_undegraded":"2024-05-28T06:06:52.050577+0000","last_fullsized":"2024-05-28T06:06:52.050577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:34:51.745494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903397+0000","last_change":"2024-05-28T06:06:49.926380+0000","last_active":"2024-05-28T06:06:51.903397+0000","last_peered":"2024-05-28T06:06:51.903397+0000","last_clean":"2024-05-28T06:06:51.903397+0000","last_became_active":"2024-05-28T06:06:49.924655+0000","last_became_peered":"2024-05-28T06:06:49.924655+0000","last_unstale":"2024-05-28T06:06:51.903397+0000","last_undegraded":"2024-05-28T06:06:51.903397+0000","last_fullsized":"2024-05-28T06:06:51.903397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:53:52.395522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610748+0000","last_change":"2024-05-28T06:06:48.911033+0000","last_active":"2024-05-28T06:06:51.610748+0000","last_peered":"2024-05-28T06:06:51.610748+0000","last_clean":"2024-05-28T06:06:51.610748+0000","last_became_active":"2024-05-28T06:06:48.910725+0000","last_became_peered":"2024-05-28T06:06:48.910725+0000","last_unstale":"2024-05-28T06:06:51.610748+0000","last_undegraded":"2024-05-28T06:06:51.610748+0000","last_fullsized":"2024-05-28T06:06:51.610748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:11:45.126556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050450+0000","last_change":"2024-05-28T06:06:49.930589+0000","last_active":"2024-05-28T06:06:52.050450+0000","last_peered":"2024-05-28T06:06:52.050450+0000","last_clean":"2024-05-28T06:06:52.050450+0000","last_became_active":"2024-05-28T06:06:49.929009+0000","last_became_peered":"2024-05-28T06:06:49.929009+0000","last_unstale":"2024-05-28T06:06:52.050450+0000","last_undegraded":"2024-05-28T06:06:52.050450+0000","last_fullsized":"2024-05-28T06:06:52.050450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:32:19.232721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903413+0000","last_change":"2024-05-28T06:06:48.910249+0000","last_active":"2024-05-28T06:06:51.903413+0000","last_peered":"2024-05-28T06:06:51.903413+0000","last_clean":"2024-05-28T06:06:51.903413+0000","last_became_active":"2024-05-28T06:06:48.909956+0000","last_became_peered":"2024-05-28T06:06:48.909956+0000","last_unstale":"2024-05-28T06:06:51.903413+0000","last_undegraded":"2024-05-28T06:06:51.903413+0000","last_fullsized":"2024-05-28T06:06:51.903413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:05:57.788813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898319+0000","last_change":"2024-05-28T06:06:49.930744+0000","last_active":"2024-05-28T06:06:50.898319+0000","last_peered":"2024-05-28T06:06:50.898319+0000","last_clean":"2024-05-28T06:06:50.898319+0000","last_became_active":"2024-05-28T06:06:49.930429+0000","last_became_peered":"2024-05-28T06:06:49.930429+0000","last_unstale":"2024-05-28T06:06:50.898319+0000","last_undegraded":"2024-05-28T06:06:50.898319+0000","last_fullsized":"2024-05-28T06:06:50.898319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:15:04.927295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050023+0000","last_change":"2024-05-28T06:06:48.916349+0000","last_active":"2024-05-28T06:06:52.050023+0000","last_peered":"2024-05-28T06:06:52.050023+0000","last_clean":"2024-05-28T06:06:52.050023+0000","last_became_active":"2024-05-28T06:06:48.916094+0000","last_became_peered":"2024-05-28T06:06:48.916094+0000","last_unstale":"2024-05-28T06:06:52.050023+0000","last_undegraded":"2024-05-28T06:06:52.050023+0000","last_fullsized":"2024-05-28T06:06:52.050023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:21:08.497625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.326813+0000","last_change":"2024-05-28T06:06:49.933367+0000","last_active":"2024-05-28T06:06:51.326813+0000","last_peered":"2024-05-28T06:06:51.326813+0000","last_clean":"2024-05-28T06:06:51.326813+0000","last_became_active":"2024-05-28T06:06:49.933122+0000","last_became_peered":"2024-05-28T06:06:49.933122+0000","last_unstale":"2024-05-28T06:06:51.326813+0000","last_undegraded":"2024-05-28T06:06:51.326813+0000","last_fullsized":"2024-05-28T06:06:51.326813+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:21:09.503749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050011+0000","last_change":"2024-05-28T06:06:48.920880+0000","last_active":"2024-05-28T06:06:52.050011+0000","last_peered":"2024-05-28T06:06:52.050011+0000","last_clean":"2024-05-28T06:06:52.050011+0000","last_became_active":"2024-05-28T06:06:48.920622+0000","last_became_peered":"2024-05-28T06:06:48.920622+0000","last_unstale":"2024-05-28T06:06:52.050011+0000","last_undegraded":"2024-05-28T06:06:52.050011+0000","last_fullsized":"2024-05-28T06:06:52.050011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:46:59.873260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610637+0000","last_change":"2024-05-28T06:06:49.927894+0000","last_active":"2024-05-28T06:06:51.610637+0000","last_peered":"2024-05-28T06:06:51.610637+0000","last_clean":"2024-05-28T06:06:51.610637+0000","last_became_active":"2024-05-28T06:06:49.923249+0000","last_became_peered":"2024-05-28T06:06:49.923249+0000","last_unstale":"2024-05-28T06:06:51.610637+0000","last_undegraded":"2024-05-28T06:06:51.610637+0000","last_fullsized":"2024-05-28T06:06:51.610637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:34:59.610967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903956+0000","last_change":"2024-05-28T06:06:48.913000+0000","last_active":"2024-05-28T06:06:51.903956+0000","last_peered":"2024-05-28T06:06:51.903956+0000","last_clean":"2024-05-28T06:06:51.903956+0000","last_became_active":"2024-05-28T06:06:48.912691+0000","last_became_peered":"2024-05-28T06:06:48.912691+0000","last_unstale":"2024-05-28T06:06:51.903956+0000","last_undegraded":"2024-05-28T06:06:51.903956+0000","last_fullsized":"2024-05-28T06:06:51.903956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:46:59.873260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.051266+0000","last_change":"2024-05-28T06:06:49.927892+0000","last_active":"2024-05-28T06:06:52.051266+0000","last_peered":"2024-05-28T06:06:52.051266+0000","last_clean":"2024-05-28T06:06:52.051266+0000","last_became_active":"2024-05-28T06:06:49.927638+0000","last_became_peered":"2024-05-28T06:06:49.927638+0000","last_unstale":"2024-05-28T06:06:52.051266+0000","last_undegraded":"2024-05-28T06:06:52.051266+0000","last_fullsized":"2024-05-28T06:06:52.051266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:35:23.352099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610672+0000","last_change":"2024-05-28T06:06:48.913474+0000","last_active":"2024-05-28T06:06:51.610672+0000","last_peered":"2024-05-28T06:06:51.610672+0000","last_clean":"2024-05-28T06:06:51.610672+0000","last_became_active":"2024-05-28T06:06:48.913193+0000","last_became_peered":"2024-05-28T06:06:48.913193+0000","last_unstale":"2024-05-28T06:06:51.610672+0000","last_undegraded":"2024-05-28T06:06:51.610672+0000","last_fullsized":"2024-05-28T06:06:51.610672+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:05:57.788813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903651+0000","last_change":"2024-05-28T06:06:49.936278+0000","last_active":"2024-05-28T06:06:51.903651+0000","last_peered":"2024-05-28T06:06:51.903651+0000","last_clean":"2024-05-28T06:06:51.903651+0000","last_became_active":"2024-05-28T06:06:49.936121+0000","last_became_peered":"2024-05-28T06:06:49.936121+0000","last_unstale":"2024-05-28T06:06:51.903651+0000","last_undegraded":"2024-05-28T06:06:51.903651+0000","last_fullsized":"2024-05-28T06:06:51.903651+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:15:31.543660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610644+0000","last_change":"2024-05-28T06:06:48.912301+0000","last_active":"2024-05-28T06:06:51.610644+0000","last_peered":"2024-05-28T06:06:51.610644+0000","last_clean":"2024-05-28T06:06:51.610644+0000","last_became_active":"2024-05-28T06:06:48.911945+0000","last_became_peered":"2024-05-28T06:06:48.911945+0000","last_unstale":"2024-05-28T06:06:51.610644+0000","last_undegraded":"2024-05-28T06:06:51.610644+0000","last_fullsized":"2024-05-28T06:06:51.610644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:07:58.851898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.897082+0000","last_change":"2024-05-28T06:06:49.925624+0000","last_active":"2024-05-28T06:06:50.897082+0000","last_peered":"2024-05-28T06:06:50.897082+0000","last_clean":"2024-05-28T06:06:50.897082+0000","last_became_active":"2024-05-28T06:06:49.925454+0000","last_became_peered":"2024-05-28T06:06:49.925454+0000","last_unstale":"2024-05-28T06:06:50.897082+0000","last_undegraded":"2024-05-28T06:06:50.897082+0000","last_fullsized":"2024-05-28T06:06:50.897082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:47:00.879384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610513+0000","last_change":"2024-05-28T06:06:48.914271+0000","last_active":"2024-05-28T06:06:51.610513+0000","last_peered":"2024-05-28T06:06:51.610513+0000","last_clean":"2024-05-28T06:06:51.610513+0000","last_became_active":"2024-05-28T06:06:48.913955+0000","last_became_peered":"2024-05-28T06:06:48.913955+0000","last_unstale":"2024-05-28T06:06:51.610513+0000","last_undegraded":"2024-05-28T06:06:51.610513+0000","last_fullsized":"2024-05-28T06:06:51.610513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:17:07.374803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.896779+0000","last_change":"2024-05-28T06:06:49.929515+0000","last_active":"2024-05-28T06:06:50.896779+0000","last_peered":"2024-05-28T06:06:50.896779+0000","last_clean":"2024-05-28T06:06:50.896779+0000","last_became_active":"2024-05-28T06:06:49.929267+0000","last_became_peered":"2024-05-28T06:06:49.929267+0000","last_unstale":"2024-05-28T06:06:50.896779+0000","last_undegraded":"2024-05-28T06:06:50.896779+0000","last_fullsized":"2024-05-28T06:06:50.896779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:26:01.674003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.901030+0000","last_change":"2024-05-28T06:06:48.915508+0000","last_active":"2024-05-28T06:06:51.901030+0000","last_peered":"2024-05-28T06:06:51.901030+0000","last_clean":"2024-05-28T06:06:51.901030+0000","last_became_active":"2024-05-28T06:06:48.915236+0000","last_became_peered":"2024-05-28T06:06:48.915236+0000","last_unstale":"2024-05-28T06:06:51.901030+0000","last_undegraded":"2024-05-28T06:06:51.901030+0000","last_fullsized":"2024-05-28T06:06:51.901030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:26:00.667879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.897079+0000","last_change":"2024-05-28T06:06:49.924348+0000","last_active":"2024-05-28T06:06:50.897079+0000","last_peered":"2024-05-28T06:06:50.897079+0000","last_clean":"2024-05-28T06:06:50.897079+0000","last_became_active":"2024-05-28T06:06:49.924061+0000","last_became_peered":"2024-05-28T06:06:49.924061+0000","last_unstale":"2024-05-28T06:06:50.897079+0000","last_undegraded":"2024-05-28T06:06:50.897079+0000","last_fullsized":"2024-05-28T06:06:50.897079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:07:59.858022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.326913+0000","last_change":"2024-05-28T06:06:48.915547+0000","last_active":"2024-05-28T06:06:51.326913+0000","last_peered":"2024-05-28T06:06:51.326913+0000","last_clean":"2024-05-28T06:06:51.326913+0000","last_became_active":"2024-05-28T06:06:48.915254+0000","last_became_peered":"2024-05-28T06:06:48.915254+0000","last_unstale":"2024-05-28T06:06:51.326913+0000","last_undegraded":"2024-05-28T06:06:51.326913+0000","last_fullsized":"2024-05-28T06:06:51.326913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:36:12.350844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.896675+0000","last_change":"2024-05-28T06:06:49.926152+0000","last_active":"2024-05-28T06:06:50.896675+0000","last_peered":"2024-05-28T06:06:50.896675+0000","last_clean":"2024-05-28T06:06:50.896675+0000","last_became_active":"2024-05-28T06:06:49.923947+0000","last_became_peered":"2024-05-28T06:06:49.923947+0000","last_unstale":"2024-05-28T06:06:50.896675+0000","last_undegraded":"2024-05-28T06:06:50.896675+0000","last_fullsized":"2024-05-28T06:06:50.896675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:11:46.132680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610133+0000","last_change":"2024-05-28T06:06:48.918499+0000","last_active":"2024-05-28T06:06:51.610133+0000","last_peered":"2024-05-28T06:06:51.610133+0000","last_clean":"2024-05-28T06:06:51.610133+0000","last_became_active":"2024-05-28T06:06:48.918151+0000","last_became_peered":"2024-05-28T06:06:48.918151+0000","last_unstale":"2024-05-28T06:06:51.610133+0000","last_undegraded":"2024-05-28T06:06:51.610133+0000","last_fullsized":"2024-05-28T06:06:51.610133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:20:48.793281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898399+0000","last_change":"2024-05-28T06:06:49.908981+0000","last_active":"2024-05-28T06:06:50.898399+0000","last_peered":"2024-05-28T06:06:50.898399+0000","last_clean":"2024-05-28T06:06:50.898399+0000","last_became_active":"2024-05-28T06:06:49.908498+0000","last_became_peered":"2024-05-28T06:06:49.908498+0000","last_unstale":"2024-05-28T06:06:50.898399+0000","last_undegraded":"2024-05-28T06:06:50.898399+0000","last_fullsized":"2024-05-28T06:06:50.898399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:07:18.337847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050947+0000","last_change":"2024-05-28T06:06:48.916979+0000","last_active":"2024-05-28T06:06:52.050947+0000","last_peered":"2024-05-28T06:06:52.050947+0000","last_clean":"2024-05-28T06:06:52.050947+0000","last_became_active":"2024-05-28T06:06:48.916685+0000","last_became_peered":"2024-05-28T06:06:48.916685+0000","last_unstale":"2024-05-28T06:06:52.050947+0000","last_undegraded":"2024-05-28T06:06:52.050947+0000","last_fullsized":"2024-05-28T06:06:52.050947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:21:08.497625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.896910+0000","last_change":"2024-05-28T06:06:49.920999+0000","last_active":"2024-05-28T06:06:50.896910+0000","last_peered":"2024-05-28T06:06:50.896910+0000","last_clean":"2024-05-28T06:06:50.896910+0000","last_became_active":"2024-05-28T06:06:49.920763+0000","last_became_peered":"2024-05-28T06:06:49.920763+0000","last_unstale":"2024-05-28T06:06:50.896910+0000","last_undegraded":"2024-05-28T06:06:50.896910+0000","last_fullsized":"2024-05-28T06:06:50.896910+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:05:58.794937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903956+0000","last_change":"2024-05-28T06:06:48.903948+0000","last_active":"2024-05-28T06:06:51.903956+0000","last_peered":"2024-05-28T06:06:51.903956+0000","last_clean":"2024-05-28T06:06:51.903956+0000","last_became_active":"2024-05-28T06:06:48.903587+0000","last_became_peered":"2024-05-28T06:06:48.903587+0000","last_unstale":"2024-05-28T06:06:51.903956+0000","last_undegraded":"2024-05-28T06:06:51.903956+0000","last_fullsized":"2024-05-28T06:06:51.903956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:57:15.144731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.051329+0000","last_change":"2024-05-28T06:06:49.916409+0000","last_active":"2024-05-28T06:06:52.051329+0000","last_peered":"2024-05-28T06:06:52.051329+0000","last_clean":"2024-05-28T06:06:52.051329+0000","last_became_active":"2024-05-28T06:06:49.916030+0000","last_became_peered":"2024-05-28T06:06:49.916030+0000","last_unstale":"2024-05-28T06:06:52.051329+0000","last_undegraded":"2024-05-28T06:06:52.051329+0000","last_fullsized":"2024-05-28T06:06:52.051329+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:15:09.883838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.902688+0000","last_change":"2024-05-28T06:06:48.918124+0000","last_active":"2024-05-28T06:06:51.902688+0000","last_peered":"2024-05-28T06:06:51.902688+0000","last_clean":"2024-05-28T06:06:51.902688+0000","last_became_active":"2024-05-28T06:06:48.917793+0000","last_became_peered":"2024-05-28T06:06:48.917793+0000","last_unstale":"2024-05-28T06:06:51.902688+0000","last_undegraded":"2024-05-28T06:06:51.902688+0000","last_fullsized":"2024-05-28T06:06:51.902688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:17:07.374803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.901038+0000","last_change":"2024-05-28T06:06:49.918427+0000","last_active":"2024-05-28T06:06:51.901038+0000","last_peered":"2024-05-28T06:06:51.901038+0000","last_clean":"2024-05-28T06:06:51.901038+0000","last_became_active":"2024-05-28T06:06:49.918164+0000","last_became_peered":"2024-05-28T06:06:49.918164+0000","last_unstale":"2024-05-28T06:06:51.901038+0000","last_undegraded":"2024-05-28T06:06:51.901038+0000","last_fullsized":"2024-05-28T06:06:51.901038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:21:09.503749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903597+0000","last_change":"2024-05-28T06:06:48.905551+0000","last_active":"2024-05-28T06:06:51.903597+0000","last_peered":"2024-05-28T06:06:51.903597+0000","last_clean":"2024-05-28T06:06:51.903597+0000","last_became_active":"2024-05-28T06:06:48.905274+0000","last_became_peered":"2024-05-28T06:06:48.905274+0000","last_unstale":"2024-05-28T06:06:51.903597+0000","last_undegraded":"2024-05-28T06:06:51.903597+0000","last_fullsized":"2024-05-28T06:06:51.903597+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:36:12.350844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.326822+0000","last_change":"2024-05-28T06:06:49.924206+0000","last_active":"2024-05-28T06:06:51.326822+0000","last_peered":"2024-05-28T06:06:51.326822+0000","last_clean":"2024-05-28T06:06:51.326822+0000","last_became_active":"2024-05-28T06:06:49.923920+0000","last_became_peered":"2024-05-28T06:06:49.923920+0000","last_unstale":"2024-05-28T06:06:51.326822+0000","last_undegraded":"2024-05-28T06:06:51.326822+0000","last_fullsized":"2024-05-28T06:06:51.326822+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:26:06.933823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.901159+0000","last_change":"2024-05-28T06:06:48.912205+0000","last_active":"2024-05-28T06:06:51.901159+0000","last_peered":"2024-05-28T06:06:51.901159+0000","last_clean":"2024-05-28T06:06:51.901159+0000","last_became_active":"2024-05-28T06:06:48.911898+0000","last_became_peered":"2024-05-28T06:06:48.911898+0000","last_unstale":"2024-05-28T06:06:51.901159+0000","last_undegraded":"2024-05-28T06:06:51.901159+0000","last_fullsized":"2024-05-28T06:06:51.901159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:05:57.788813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.901059+0000","last_change":"2024-05-28T06:06:49.920395+0000","last_active":"2024-05-28T06:06:51.901059+0000","last_peered":"2024-05-28T06:06:51.901059+0000","last_clean":"2024-05-28T06:06:51.901059+0000","last_became_active":"2024-05-28T06:06:49.920087+0000","last_became_peered":"2024-05-28T06:06:49.920087+0000","last_unstale":"2024-05-28T06:06:51.901059+0000","last_undegraded":"2024-05-28T06:06:51.901059+0000","last_fullsized":"2024-05-28T06:06:51.901059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:51:50.413343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.903510+0000","last_change":"2024-05-28T06:06:48.903306+0000","last_active":"2024-05-28T06:06:51.903510+0000","last_peered":"2024-05-28T06:06:51.903510+0000","last_clean":"2024-05-28T06:06:51.903510+0000","last_became_active":"2024-05-28T06:06:48.902982+0000","last_became_peered":"2024-05-28T06:06:48.902982+0000","last_unstale":"2024-05-28T06:06:51.903510+0000","last_undegraded":"2024-05-28T06:06:51.903510+0000","last_fullsized":"2024-05-28T06:06:51.903510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:17:07.374803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.049982+0000","last_change":"2024-05-28T06:06:49.913227+0000","last_active":"2024-05-28T06:06:52.049982+0000","last_peered":"2024-05-28T06:06:52.049982+0000","last_clean":"2024-05-28T06:06:52.049982+0000","last_became_active":"2024-05-28T06:06:49.912953+0000","last_became_peered":"2024-05-28T06:06:49.912953+0000","last_unstale":"2024-05-28T06:06:52.049982+0000","last_undegraded":"2024-05-28T06:06:52.049982+0000","last_fullsized":"2024-05-28T06:06:52.049982+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:17:10.071527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610259+0000","last_change":"2024-05-28T06:06:48.907193+0000","last_active":"2024-05-28T06:06:51.610259+0000","last_peered":"2024-05-28T06:06:51.610259+0000","last_clean":"2024-05-28T06:06:51.610259+0000","last_became_active":"2024-05-28T06:06:48.906871+0000","last_became_peered":"2024-05-28T06:06:48.906871+0000","last_unstale":"2024-05-28T06:06:51.610259+0000","last_undegraded":"2024-05-28T06:06:51.610259+0000","last_fullsized":"2024-05-28T06:06:51.610259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:36:12.350844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.610142+0000","last_change":"2024-05-28T06:06:49.929082+0000","last_active":"2024-05-28T06:06:51.610142+0000","last_peered":"2024-05-28T06:06:51.610142+0000","last_clean":"2024-05-28T06:06:51.610142+0000","last_became_active":"2024-05-28T06:06:49.928817+0000","last_became_peered":"2024-05-28T06:06:49.928817+0000","last_unstale":"2024-05-28T06:06:51.610142+0000","last_undegraded":"2024-05-28T06:06:51.610142+0000","last_fullsized":"2024-05-28T06:06:51.610142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:22:45.724585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:52.050055+0000","last_change":"2024-05-28T06:06:48.916333+0000","last_active":"2024-05-28T06:06:52.050055+0000","last_peered":"2024-05-28T06:06:52.050055+0000","last_clean":"2024-05-28T06:06:52.050055+0000","last_became_active":"2024-05-28T06:06:48.916041+0000","last_became_peered":"2024-05-28T06:06:48.916041+0000","last_unstale":"2024-05-28T06:06:52.050055+0000","last_undegraded":"2024-05-28T06:06:52.050055+0000","last_fullsized":"2024-05-28T06:06:52.050055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:57:15.144731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898593+0000","last_change":"2024-05-28T06:06:49.915300+0000","last_active":"2024-05-28T06:06:50.898593+0000","last_peered":"2024-05-28T06:06:50.898593+0000","last_clean":"2024-05-28T06:06:50.898593+0000","last_became_active":"2024-05-28T06:06:49.914960+0000","last_became_peered":"2024-05-28T06:06:49.914960+0000","last_unstale":"2024-05-28T06:06:50.898593+0000","last_undegraded":"2024-05-28T06:06:50.898593+0000","last_fullsized":"2024-05-28T06:06:50.898593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:48.882597+0000","last_clean_scrub_stamp":"2024-05-28T06:06:48.882597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:20:52.065092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:51.326849+0000","last_change":"2024-05-28T06:06:48.915594+0000","last_active":"2024-05-28T06:06:51.326849+0000","last_peered":"2024-05-28T06:06:51.326849+0000","last_clean":"2024-05-28T06:06:51.326849+0000","last_became_active":"2024-05-28T06:06:48.915314+0000","last_became_peered":"2024-05-28T06:06:48.915314+0000","last_unstale":"2024-05-28T06:06:51.326849+0000","last_undegraded":"2024-05-28T06:06:51.326849+0000","last_fullsized":"2024-05-28T06:06:51.326849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:06:47.876473+0000","last_clean_scrub_stamp":"2024-05-28T06:06:47.876473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:20:48.793281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":193,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-28T06:06:50.898580+0000","last_change":"2024-05-28T06:05:38.517922+0000","last_active":"2024-05-28T06:06:50.898580+0000","last_peered":"2024-05-28T06:06:50.898580+0000","last_clean":"2024-05-28T06:06:50.898580+0000","last_became_active":"2024-05-28T06:05:38.514745+0000","last_became_peered":"2024-05-28T06:05:38.514745+0000","last_unstale":"2024-05-28T06:06:50.898580+0000","last_undegraded":"2024-05-28T06:06:50.898580+0000","last_fullsized":"2024-05-28T06:06:50.898580+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_clean_scrub_stamp":"2024-05-28T06:05:37.485018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:23:27.978203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":742389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":152547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":146303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":145735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":147265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":152001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":153565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":742299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-28T06:06:54.387 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-28T06:06:54.387 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-28T06:06:54.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.566+0000 7efe88e00640 1 Processor -- start 2024-05-28T06:06:54.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.566+0000 7efe88e00640 1 -- start start 2024-05-28T06:06:54.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.566+0000 7efe88e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efe8415ea30 0x7efe8409b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:54.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.566+0000 7efe88e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efe84162ba0 0x7efe8406caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:54.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.566+0000 7efe88e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe840d0c80 con 0x7efe8409b990 2024-05-28T06:06:54.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.566+0000 7efe88e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7efe840d0f60 con 0x7efe84162ba0 2024-05-28T06:06:54.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.566+0000 7efe88e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7efe840d1240 con 0x7efe8415ea30 2024-05-28T06:06:54.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.566+0000 7efe82800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efe84162ba0 0x7efe8406caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:54.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.566+0000 7efe82800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efe84162ba0 0x7efe8406caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59952/0 (socket says 172.21.15.122:59952) 2024-05-28T06:06:54.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.566+0000 7efe82800640 1 -- 172.21.15.122:0/3962155033 learned_addr learned my addr 172.21.15.122:0/3962155033 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:54.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.566+0000 7efe81e00640 1 --2- 172.21.15.122:0/3962155033 >> v2:172.21.15.153:3300/0 conn(0x7efe8415ea30 0x7efe8409b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:54.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.566+0000 7efe82800640 1 -- 172.21.15.122:0/3962155033 >> v2:172.21.15.153:3300/0 conn(0x7efe8415ea30 msgr2=0x7efe8409b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:54.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.566+0000 7efe82800640 1 --2- 172.21.15.122:0/3962155033 >> v2:172.21.15.153:3300/0 conn(0x7efe8415ea30 0x7efe8409b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.566+0000 7efe82800640 1 -- 172.21.15.122:0/3962155033 >> v1:172.21.15.153:6789/0 conn(0x7efe8409b990 legacy=0x7efe84162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:54.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.566+0000 7efe82800640 1 -- 172.21.15.122:0/3962155033 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe840d1520 con 0x7efe84162ba0 2024-05-28T06:06:54.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.570+0000 7efe82800640 1 --2- 172.21.15.122:0/3962155033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe84162ba0 0x7efe8406caa0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efe84069430 tx=0x7efe7c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf7720574e39aae server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:54.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.570+0000 7efe81400640 1 -- 172.21.15.122:0/3962155033 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c0a5810 con 0x7efe84162ba0 2024-05-28T06:06:54.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.570+0000 7efe81400640 1 -- 172.21.15.122:0/3962155033 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe7c0a59b0 con 0x7efe84162ba0 2024-05-28T06:06:54.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.570+0000 7efe81400640 1 -- 172.21.15.122:0/3962155033 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c0a5d80 con 0x7efe84162ba0 2024-05-28T06:06:54.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.570+0000 7efe88e00640 1 -- 172.21.15.122:0/3962155033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe84162ba0 msgr2=0x7efe8406caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:54.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.570+0000 7efe88e00640 1 --2- 172.21.15.122:0/3962155033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe84162ba0 0x7efe8406caa0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efe84069430 tx=0x7efe7c01c930 comp rx=0 tx=0).stop 2024-05-28T06:06:54.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.570+0000 7efe88e00640 1 -- 172.21.15.122:0/3962155033 shutdown_connections 2024-05-28T06:06:54.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.570+0000 7efe88e00640 1 --2- 172.21.15.122:0/3962155033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe84162ba0 0x7efe8406caa0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.570+0000 7efe88e00640 1 --2- 172.21.15.122:0/3962155033 >> v2:172.21.15.153:3300/0 conn(0x7efe8415ea30 0x7efe8409b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.570+0000 7efe88e00640 1 -- 172.21.15.122:0/3962155033 >> 172.21.15.122:0/3962155033 conn(0x7efe840b4100 msgr2=0x7efe840b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:54.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.570+0000 7efe88e00640 1 -- 172.21.15.122:0/3962155033 shutdown_connections 2024-05-28T06:06:54.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.570+0000 7efe88e00640 1 -- 172.21.15.122:0/3962155033 wait complete. 2024-05-28T06:06:54.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe88e00640 1 Processor -- start 2024-05-28T06:06:54.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe88e00640 1 -- start start 2024-05-28T06:06:54.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe88e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe8415ea30 0x7efe8415ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:54.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe88e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe84162ba0 0x7efe840c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:54.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe88e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe841588a0 0x7efe84070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:54.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe88e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efe8406db80 con 0x7efe84162ba0 2024-05-28T06:06:54.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe88e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efe8406da00 con 0x7efe8415ea30 2024-05-28T06:06:54.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe88e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efe8406dd00 con 0x7efe841588a0 2024-05-28T06:06:54.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe79400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe84162ba0 0x7efe840c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:54.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe81e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe8415ea30 0x7efe8415ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:54.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe81e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe8415ea30 0x7efe8415ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:35432/0 (socket says 172.21.15.122:35432) 2024-05-28T06:06:54.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe79400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe84162ba0 0x7efe840c7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59962/0 (socket says 172.21.15.122:59962) 2024-05-28T06:06:54.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe81e00640 1 -- 172.21.15.122:0/15891925 learned_addr learned my addr 172.21.15.122:0/15891925 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:54.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe82800640 1 --2- 172.21.15.122:0/15891925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe841588a0 0x7efe84070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:54.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe79400640 1 -- 172.21.15.122:0/15891925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe841588a0 msgr2=0x7efe84070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:54.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe79400640 1 --2- 172.21.15.122:0/15891925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe841588a0 0x7efe84070ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe79400640 1 -- 172.21.15.122:0/15891925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe8415ea30 msgr2=0x7efe8415ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:54.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe79400640 1 --2- 172.21.15.122:0/15891925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe8415ea30 0x7efe8415ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe79400640 1 -- 172.21.15.122:0/15891925 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe84160fa0 con 0x7efe84162ba0 2024-05-28T06:06:54.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe82800640 1 --2- 172.21.15.122:0/15891925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe841588a0 0x7efe84070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:54.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe79400640 1 --2- 172.21.15.122:0/15891925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe84162ba0 0x7efe840c7450 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00c3c0 tx=0x7efe6c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:54.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe7aa00640 1 -- 172.21.15.122:0/15891925 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe6c0052d0 con 0x7efe84162ba0 2024-05-28T06:06:54.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe7aa00640 1 -- 172.21.15.122:0/15891925 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe6c005470 con 0x7efe84162ba0 2024-05-28T06:06:54.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe88e00640 1 -- 172.21.15.122:0/15891925 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe84160700 con 0x7efe84162ba0 2024-05-28T06:06:54.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe7aa00640 1 -- 172.21.15.122:0/15891925 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe6c007260 con 0x7efe84162ba0 2024-05-28T06:06:54.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.574+0000 7efe88e00640 1 -- 172.21.15.122:0/15891925 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe84160cc0 con 0x7efe84162ba0 2024-05-28T06:06:54.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.578+0000 7efe88e00640 1 -- 172.21.15.122:0/15891925 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe84068c40 con 0x7efe84162ba0 2024-05-28T06:06:54.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.578+0000 7efe7aa00640 1 -- 172.21.15.122:0/15891925 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efe6c007400 con 0x7efe84162ba0 2024-05-28T06:06:54.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.578+0000 7efe7aa00640 1 --2- 172.21.15.122:0/15891925 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe60068380 0x7efe6006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:54.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.578+0000 7efe7aa00640 1 -- 172.21.15.122:0/15891925 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7efe6c085de0 con 0x7efe84162ba0 2024-05-28T06:06:54.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.578+0000 7efe81e00640 1 --2- 172.21.15.122:0/15891925 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe60068380 0x7efe6006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:54.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.578+0000 7efe81e00640 1 --2- 172.21.15.122:0/15891925 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe60068380 0x7efe6006a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efe74009c20 tx=0x7efe74009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:54.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.582+0000 7efe7aa00640 1 -- 172.21.15.122:0/15891925 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efe6c055cb0 con 0x7efe84162ba0 2024-05-28T06:06:54.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.794+0000 7efe88e00640 1 -- 172.21.15.122:0/15891925 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7efe84169600 con 0x7efe84162ba0 2024-05-28T06:06:54.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.798+0000 7efe7aa00640 1 -- 172.21.15.122:0/15891925 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7efe6c059fb0 con 0x7efe84162ba0 2024-05-28T06:06:54.802 INFO:teuthology.orchestra.run.smithi122.stdout:[client.0] 2024-05-28T06:06:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQACdFVm0fSmExAAkwJTGq732gbcMsBbs84lWw== 2024-05-28T06:06:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: caps mds = "allow" 2024-05-28T06:06:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: caps mon = "allow r" 2024-05-28T06:06:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-28T06:06:54.803 INFO:teuthology.orchestra.run.smithi122.stderr:updated caps for client.0 2024-05-28T06:06:54.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.802+0000 7efe88e00640 1 -- 172.21.15.122:0/15891925 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe60068380 msgr2=0x7efe6006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:54.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.802+0000 7efe88e00640 1 --2- 172.21.15.122:0/15891925 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe60068380 0x7efe6006a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efe74009c20 tx=0x7efe74009190 comp rx=0 tx=0).stop 2024-05-28T06:06:54.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.802+0000 7efe88e00640 1 -- 172.21.15.122:0/15891925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe84162ba0 msgr2=0x7efe840c7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:54.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.802+0000 7efe88e00640 1 --2- 172.21.15.122:0/15891925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe84162ba0 0x7efe840c7450 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00c3c0 tx=0x7efe6c00c880 comp rx=0 tx=0).stop 2024-05-28T06:06:54.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.802+0000 7efe88e00640 1 -- 172.21.15.122:0/15891925 shutdown_connections 2024-05-28T06:06:54.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.802+0000 7efe88e00640 1 --2- 172.21.15.122:0/15891925 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe60068380 0x7efe6006a840 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.802+0000 7efe88e00640 1 --2- 172.21.15.122:0/15891925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe841588a0 0x7efe84070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.802+0000 7efe88e00640 1 --2- 172.21.15.122:0/15891925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe84162ba0 0x7efe840c7450 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.802+0000 7efe88e00640 1 --2- 172.21.15.122:0/15891925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe8415ea30 0x7efe8415ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.802+0000 7efe88e00640 1 -- 172.21.15.122:0/15891925 >> 172.21.15.122:0/15891925 conn(0x7efe840b4100 msgr2=0x7efe840af2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:54.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.802+0000 7efe88e00640 1 -- 172.21.15.122:0/15891925 shutdown_connections 2024-05-28T06:06:54.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.802+0000 7efe88e00640 1 -- 172.21.15.122:0/15891925 wait complete. 2024-05-28T06:06:54.824 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:06:54.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.958+0000 7ff08fc00640 1 Processor -- start 2024-05-28T06:06:54.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.958+0000 7ff08fc00640 1 -- start start 2024-05-28T06:06:54.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.958+0000 7ff08fc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff08806f890 0x7ff0880cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:54.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.958+0000 7ff08fc00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff0880cd930 0x7ff0880b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:54.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.958+0000 7ff08fc00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0880d0310 con 0x7ff0880cff30 2024-05-28T06:06:54.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.958+0000 7ff08fc00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7ff08815be20 con 0x7ff0880cd930 2024-05-28T06:06:54.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.958+0000 7ff08fc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff08815c100 con 0x7ff08806f890 2024-05-28T06:06:54.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.958+0000 7ff08dc00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff0880cd930 0x7ff0880b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:54.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.958+0000 7ff08d200640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7ff0880cff30 0x7ff08806f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:43960/0 (socket says 172.21.15.122:43960) 2024-05-28T06:06:54.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.958+0000 7ff08d200640 1 -- 172.21.15.122:0/4190176906 learned_addr learned my addr 172.21.15.122:0/4190176906 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:54.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.958+0000 7ff087e00640 1 --2- 172.21.15.122:0/4190176906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff08806f890 0x7ff0880cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:54.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.958+0000 7ff08dc00640 1 -- 172.21.15.122:0/4190176906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff08806f890 msgr2=0x7ff0880cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:54.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.958+0000 7ff08dc00640 1 --2- 172.21.15.122:0/4190176906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff08806f890 0x7ff0880cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.958+0000 7ff08dc00640 1 -- 172.21.15.122:0/4190176906 >> v1:172.21.15.122:6789/0 conn(0x7ff0880cff30 legacy=0x7ff08806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:54.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.958+0000 7ff08dc00640 1 -- 172.21.15.122:0/4190176906 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08815c3e0 con 0x7ff0880cd930 2024-05-28T06:06:54.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.958+0000 7ff087400640 1 -- 172.21.15.122:0/4190176906 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4128256901 0 0) 0x7ff0880d0310 con 0x7ff0880cff30 2024-05-28T06:06:54.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.962+0000 7ff08dc00640 1 --2- 172.21.15.122:0/4190176906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0880cd930 0x7ff0880b49b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff08000bfa0 tx=0x7ff08001eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd351634dbce676 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:54.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.962+0000 7ff087400640 1 -- 172.21.15.122:0/4190176906 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08000b2d0 con 0x7ff0880cd930 2024-05-28T06:06:54.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.962+0000 7ff087400640 1 -- 172.21.15.122:0/4190176906 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0800a79b0 con 0x7ff0880cd930 2024-05-28T06:06:54.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.962+0000 7ff087400640 1 -- 172.21.15.122:0/4190176906 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0800a7d80 con 0x7ff0880cd930 2024-05-28T06:06:54.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.962+0000 7ff08fc00640 1 -- 172.21.15.122:0/4190176906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0880cd930 msgr2=0x7ff0880b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:54.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.962+0000 7ff08fc00640 1 --2- 172.21.15.122:0/4190176906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0880cd930 0x7ff0880b49b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff08000bfa0 tx=0x7ff08001eb40 comp rx=0 tx=0).stop 2024-05-28T06:06:54.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.962+0000 7ff08fc00640 1 -- 172.21.15.122:0/4190176906 shutdown_connections 2024-05-28T06:06:54.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.962+0000 7ff08fc00640 1 --2- 172.21.15.122:0/4190176906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0880cd930 0x7ff0880b49b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.962+0000 7ff08fc00640 1 --2- 172.21.15.122:0/4190176906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff08806f890 0x7ff0880cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.962+0000 7ff08fc00640 1 -- 172.21.15.122:0/4190176906 >> 172.21.15.122:0/4190176906 conn(0x7ff08806bd90 msgr2=0x7ff08806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:54.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.962+0000 7ff08fc00640 1 -- 172.21.15.122:0/4190176906 shutdown_connections 2024-05-28T06:06:54.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.962+0000 7ff08fc00640 1 -- 172.21.15.122:0/4190176906 wait complete. 2024-05-28T06:06:54.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff08fc00640 1 Processor -- start 2024-05-28T06:06:54.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff08fc00640 1 -- start start 2024-05-28T06:06:54.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff08fc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff08806f890 0x7ff08814d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:54.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff08fc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0880cd930 0x7ff08814c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:54.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff08fc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0880cff30 0x7ff0880b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:54.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff08fc00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff0880b5880 con 0x7ff0880cd930 2024-05-28T06:06:54.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff08fc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff0880b5700 con 0x7ff0880cff30 2024-05-28T06:06:54.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff08fc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff0880b5a00 con 0x7ff08806f890 2024-05-28T06:06:54.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff087e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0880cd930 0x7ff08814c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:54.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff087e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0880cd930 0x7ff08814c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59986/0 (socket says 172.21.15.122:59986) 2024-05-28T06:06:54.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff087e00640 1 -- 172.21.15.122:0/1815700637 learned_addr learned my addr 172.21.15.122:0/1815700637 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:54.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff08d200640 1 --2- 172.21.15.122:0/1815700637 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff08806f890 0x7ff08814d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:54.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff08dc00640 1 --2- 172.21.15.122:0/1815700637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0880cff30 0x7ff0880b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:54.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff087e00640 1 -- 172.21.15.122:0/1815700637 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff08806f890 msgr2=0x7ff08814d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:54.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff087e00640 1 --2- 172.21.15.122:0/1815700637 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff08806f890 0x7ff08814d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff087e00640 1 -- 172.21.15.122:0/1815700637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0880cff30 msgr2=0x7ff0880b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:54.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff087e00640 1 --2- 172.21.15.122:0/1815700637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0880cff30 0x7ff0880b2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:54.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff087e00640 1 -- 172.21.15.122:0/1815700637 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08814c8a0 con 0x7ff0880cd930 2024-05-28T06:06:54.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff087e00640 1 --2- 172.21.15.122:0/1815700637 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0880cd930 0x7ff08814c210 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff07400d860 tx=0x7ff07400dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:54.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff084c00640 1 -- 172.21.15.122:0/1815700637 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07400de50 con 0x7ff0880cd930 2024-05-28T06:06:54.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff084c00640 1 -- 172.21.15.122:0/1815700637 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff074019070 con 0x7ff0880cd930 2024-05-28T06:06:54.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff08fc00640 1 -- 172.21.15.122:0/1815700637 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff08814cb80 con 0x7ff0880cd930 2024-05-28T06:06:54.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff084c00640 1 -- 172.21.15.122:0/1815700637 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07400bb10 con 0x7ff0880cd930 2024-05-28T06:06:54.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.966+0000 7ff08fc00640 1 -- 172.21.15.122:0/1815700637 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff08814d140 con 0x7ff0880cd930 2024-05-28T06:06:54.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.970+0000 7ff08fc00640 1 -- 172.21.15.122:0/1815700637 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff088068c40 con 0x7ff0880cd930 2024-05-28T06:06:54.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.970+0000 7ff084c00640 1 -- 172.21.15.122:0/1815700637 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff07400bcb0 con 0x7ff0880cd930 2024-05-28T06:06:54.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.970+0000 7ff084c00640 1 --2- 172.21.15.122:0/1815700637 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff068068380 0x7ff06806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:54.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.970+0000 7ff084c00640 1 -- 172.21.15.122:0/1815700637 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff074086e60 con 0x7ff0880cd930 2024-05-28T06:06:54.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.970+0000 7ff08d200640 1 --2- 172.21.15.122:0/1815700637 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff068068380 0x7ff06806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:54.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.970+0000 7ff08d200640 1 --2- 172.21.15.122:0/1815700637 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff068068380 0x7ff06806a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff078007fd0 tx=0x7ff078009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:54.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:54.974+0000 7ff084c00640 1 -- 172.21.15.122:0/1815700637 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff074057420 con 0x7ff0880cd930 2024-05-28T06:06:55.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.166+0000 7ff08fc00640 1 -- 172.21.15.122:0/1815700637 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0880ccbb0 con 0x7ff0880cd930 2024-05-28T06:06:55.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.166+0000 7ff084c00640 1 -- 172.21.15.122:0/1815700637 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5190 (secure 0 0 0) 0x7ff074056d20 con 0x7ff0880cd930 2024-05-28T06:06:55.171 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:06:55.171 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1943879237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1943879237},{"type":"v1","addr":"172.21.15.153:6834","nonce":1943879237}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1104849441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1104849441},{"type":"v1","addr":"172.21.15.153:6835","nonce":1104849441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/560614408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":560614408},{"type":"v1","addr":"172.21.15.122:6835","nonce":560614408}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-28T06:06:49.284485+0000","modified":"2024-05-28T06:06:52.295560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1698676182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1698676182},{"type":"v1","addr":"172.21.15.122:6837","nonce":1698676182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5082,"qdb_cluster":[5082]},"id":2}]} 2024-05-28T06:06:55.171 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 18 2024-05-28T06:06:55.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.170+0000 7ff08fc00640 1 -- 172.21.15.122:0/1815700637 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff068068380 msgr2=0x7ff06806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:55.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.170+0000 7ff08fc00640 1 --2- 172.21.15.122:0/1815700637 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff068068380 0x7ff06806a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff078007fd0 tx=0x7ff078009040 comp rx=0 tx=0).stop 2024-05-28T06:06:55.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.170+0000 7ff08fc00640 1 -- 172.21.15.122:0/1815700637 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0880cd930 msgr2=0x7ff08814c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:55.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.170+0000 7ff08fc00640 1 --2- 172.21.15.122:0/1815700637 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0880cd930 0x7ff08814c210 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff07400d860 tx=0x7ff07400dd20 comp rx=0 tx=0).stop 2024-05-28T06:06:55.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.170+0000 7ff08fc00640 1 -- 172.21.15.122:0/1815700637 shutdown_connections 2024-05-28T06:06:55.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.170+0000 7ff08fc00640 1 --2- 172.21.15.122:0/1815700637 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff068068380 0x7ff06806a840 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.170+0000 7ff08fc00640 1 --2- 172.21.15.122:0/1815700637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0880cff30 0x7ff0880b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.170+0000 7ff08fc00640 1 --2- 172.21.15.122:0/1815700637 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0880cd930 0x7ff08814c210 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.170+0000 7ff08fc00640 1 --2- 172.21.15.122:0/1815700637 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff08806f890 0x7ff08814d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.170+0000 7ff08fc00640 1 -- 172.21.15.122:0/1815700637 >> 172.21.15.122:0/1815700637 conn(0x7ff08806bd90 msgr2=0x7ff088159710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:55.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.170+0000 7ff08fc00640 1 -- 172.21.15.122:0/1815700637 shutdown_connections 2024-05-28T06:06:55.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.170+0000 7ff08fc00640 1 -- 172.21.15.122:0/1815700637 wait complete. 2024-05-28T06:06:55.595 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-28T06:06:49.284485+0000', 'modified': '2024-05-28T06:06:52.295560+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5082}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5082': {'gid': 5082, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.122:6837/1698676182', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6836', 'nonce': 1698676182}, {'type': 'v1', 'addr': '172.21.15.122:6837', 'nonce': 1698676182}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5082, 'qdb_cluster': [5082]} 2024-05-28T06:06:55.595 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-28T06:06:55.596 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-28T06:06:55.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.730+0000 7f35c7a00640 1 Processor -- start 2024-05-28T06:06:55.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.730+0000 7f35c7a00640 1 -- start start 2024-05-28T06:06:55.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.734+0000 7f35c7a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35c00b4e10 0x7f35c006f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.734+0000 7f35c7a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f35c00cced0 0x7f35c00cd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.734+0000 7f35c7a00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35c00b54d0 con 0x7f35c0159280 2024-05-28T06:06:55.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.734+0000 7f35c7a00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f35c00b5290 con 0x7f35c00cced0 2024-05-28T06:06:55.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.734+0000 7f35c7a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f35c00cd880 con 0x7f35c00b4e10 2024-05-28T06:06:55.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.734+0000 7f35c5a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f35c00cced0 0x7f35c00cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.734+0000 7f35c5000640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f35c0159280 0x7f35c015c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:53968/0 (socket says 172.21.15.122:53968) 2024-05-28T06:06:55.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.734+0000 7f35c5000640 1 -- 172.21.15.122:0/1552558663 learned_addr learned my addr 172.21.15.122:0/1552558663 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:55.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.734+0000 7f35b7e00640 1 --2- 172.21.15.122:0/1552558663 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35c00b4e10 0x7f35c006f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.734+0000 7f35c5a00640 1 -- 172.21.15.122:0/1552558663 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35c00b4e10 msgr2=0x7f35c006f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:55.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.734+0000 7f35c5a00640 1 --2- 172.21.15.122:0/1552558663 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35c00b4e10 0x7f35c006f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.734+0000 7f35c5a00640 1 -- 172.21.15.122:0/1552558663 >> v1:172.21.15.122:6789/0 conn(0x7f35c0159280 legacy=0x7f35c015c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:55.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.734+0000 7f35c5a00640 1 -- 172.21.15.122:0/1552558663 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c00b57b0 con 0x7f35c00cced0 2024-05-28T06:06:55.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.734+0000 7f35bfe00640 1 -- 172.21.15.122:0/1552558663 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1281749479 0 0) 0x7f35c00b54d0 con 0x7f35c0159280 2024-05-28T06:06:55.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.734+0000 7f35c5a00640 1 --2- 172.21.15.122:0/1552558663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35c00cced0 0x7f35c00cd340 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009d90 tx=0x7f35b801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db0d804b3aa778f server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:55.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.734+0000 7f35bfe00640 1 -- 172.21.15.122:0/1552558663 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b80b2070 con 0x7f35c00cced0 2024-05-28T06:06:55.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.738+0000 7f35bfe00640 1 -- 172.21.15.122:0/1552558663 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b80a5830 con 0x7f35c00cced0 2024-05-28T06:06:55.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.738+0000 7f35bfe00640 1 -- 172.21.15.122:0/1552558663 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b80a5c00 con 0x7f35c00cced0 2024-05-28T06:06:55.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.738+0000 7f35c7a00640 1 -- 172.21.15.122:0/1552558663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35c00cced0 msgr2=0x7f35c00cd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:55.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.738+0000 7f35c7a00640 1 --2- 172.21.15.122:0/1552558663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35c00cced0 0x7f35c00cd340 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009d90 tx=0x7f35b801c970 comp rx=0 tx=0).stop 2024-05-28T06:06:55.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.738+0000 7f35c7a00640 1 -- 172.21.15.122:0/1552558663 shutdown_connections 2024-05-28T06:06:55.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.738+0000 7f35c7a00640 1 --2- 172.21.15.122:0/1552558663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35c00cced0 0x7f35c00cd340 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.738+0000 7f35c7a00640 1 --2- 172.21.15.122:0/1552558663 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35c00b4e10 0x7f35c006f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.738+0000 7f35c7a00640 1 -- 172.21.15.122:0/1552558663 >> 172.21.15.122:0/1552558663 conn(0x7f35c0062a40 msgr2=0x7f35c006b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:55.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.738+0000 7f35c7a00640 1 -- 172.21.15.122:0/1552558663 shutdown_connections 2024-05-28T06:06:55.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.738+0000 7f35c7a00640 1 -- 172.21.15.122:0/1552558663 wait complete. 2024-05-28T06:06:55.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.738+0000 7f35c7a00640 1 Processor -- start 2024-05-28T06:06:55.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.738+0000 7f35c7a00640 1 -- start start 2024-05-28T06:06:55.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.738+0000 7f35c7a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35c00b4e10 0x7f35c0142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.738+0000 7f35c7a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35c00cced0 0x7f35c00aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.738+0000 7f35c7a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35c0159280 0x7f35c00b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.738+0000 7f35c7a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f35c015fb90 con 0x7f35c0159280 2024-05-28T06:06:55.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.738+0000 7f35c7a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f35c015c310 con 0x7f35c00b4e10 2024-05-28T06:06:55.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.738+0000 7f35c7a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f35c015fd10 con 0x7f35c00cced0 2024-05-28T06:06:55.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.738+0000 7f35c5a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35c0159280 0x7f35c00b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.738+0000 7f35c5a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35c0159280 0x7f35c00b2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57758/0 (socket says 172.21.15.122:57758) 2024-05-28T06:06:55.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.738+0000 7f35c5a00640 1 -- 172.21.15.122:0/1182442216 learned_addr learned my addr 172.21.15.122:0/1182442216 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:55.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.738+0000 7f35b7e00640 1 --2- 172.21.15.122:0/1182442216 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35c00cced0 0x7f35c00aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.738+0000 7f35c5000640 1 --2- 172.21.15.122:0/1182442216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35c00b4e10 0x7f35c0142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.742+0000 7f35c5a00640 1 -- 172.21.15.122:0/1182442216 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35c00cced0 msgr2=0x7f35c00aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:55.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.742+0000 7f35c5a00640 1 --2- 172.21.15.122:0/1182442216 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35c00cced0 0x7f35c00aecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.742+0000 7f35c5a00640 1 -- 172.21.15.122:0/1182442216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35c00b4e10 msgr2=0x7f35c0142670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:55.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.742+0000 7f35c5a00640 1 --2- 172.21.15.122:0/1182442216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35c00b4e10 0x7f35c0142670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.742+0000 7f35c5a00640 1 -- 172.21.15.122:0/1182442216 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c00a95d0 con 0x7f35c0159280 2024-05-28T06:06:55.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.742+0000 7f35c5000640 1 --2- 172.21.15.122:0/1182442216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35c00b4e10 0x7f35c0142670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:55.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.742+0000 7f35c5a00640 1 --2- 172.21.15.122:0/1182442216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35c0159280 0x7f35c00b2720 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f35b801b020 tx=0x7f35b8019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:55.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.742+0000 7f35bd600640 1 -- 172.21.15.122:0/1182442216 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b80b2050 con 0x7f35c0159280 2024-05-28T06:06:55.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.742+0000 7f35bd600640 1 -- 172.21.15.122:0/1182442216 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b80be070 con 0x7f35c0159280 2024-05-28T06:06:55.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.742+0000 7f35bd600640 1 -- 172.21.15.122:0/1182442216 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b80ad850 con 0x7f35c0159280 2024-05-28T06:06:55.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.742+0000 7f35c7a00640 1 -- 172.21.15.122:0/1182442216 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35c00a9870 con 0x7f35c0159280 2024-05-28T06:06:55.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.742+0000 7f35c7a00640 1 -- 172.21.15.122:0/1182442216 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35c00a9e30 con 0x7f35c0159280 2024-05-28T06:06:55.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.742+0000 7f35bd600640 1 -- 172.21.15.122:0/1182442216 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f35b80ad9f0 con 0x7f35c0159280 2024-05-28T06:06:55.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35bd600640 1 --2- 172.21.15.122:0/1182442216 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f359c0683b0 0x7f359c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35bd600640 1 -- 172.21.15.122:0/1182442216 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f35b8121290 con 0x7f35c0159280 2024-05-28T06:06:55.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35c5000640 1 --2- 172.21.15.122:0/1182442216 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f359c0683b0 0x7f359c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35cae21000 1 Processor -- start 2024-05-28T06:06:55.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35cae21000 1 -- start start 2024-05-28T06:06:55.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35c5000640 1 --2- 172.21.15.122:0/1182442216 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f359c0683b0 0x7f359c06a870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f35b0007fd0 tx=0x7f35b0007c20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:55.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35cae21000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c02fa7f120 0x55c02fa7f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35cae21000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c02fa7fa40 0x55c02fa32110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35cae21000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa32650 0x55c02fa32a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35cae21000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c02f883420 con 0x55c02fa32650 2024-05-28T06:06:55.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35cae21000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c02f81dbf0 con 0x55c02fa7fa40 2024-05-28T06:06:55.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35cae21000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55c02f87f3e0 con 0x55c02fa7f120 2024-05-28T06:06:55.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35c5a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa32650 0x55c02fa32a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35c5a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa32650 0x55c02fa32a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57760/0 (socket says 172.21.15.122:57760) 2024-05-28T06:06:55.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35c5a00640 1 -- 172.21.15.122:0/1651331664 learned_addr learned my addr 172.21.15.122:0/1651331664 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:55.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35b7e00640 1 --2- 172.21.15.122:0/1651331664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c02fa7fa40 0x55c02fa32110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35c5000640 1 --2- 172.21.15.122:0/1651331664 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c02fa7f120 0x55c02fa7f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35c5a00640 1 -- 172.21.15.122:0/1651331664 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c02fa7f120 msgr2=0x55c02fa7f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:55.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35c5a00640 1 --2- 172.21.15.122:0/1651331664 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c02fa7f120 0x55c02fa7f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35c5a00640 1 -- 172.21.15.122:0/1651331664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c02fa7fa40 msgr2=0x55c02fa32110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:55.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35c5a00640 1 --2- 172.21.15.122:0/1651331664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c02fa7fa40 0x55c02fa32110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35c5a00640 1 -- 172.21.15.122:0/1651331664 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c02f92b450 con 0x55c02fa32650 2024-05-28T06:06:55.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35c5a00640 1 --2- 172.21.15.122:0/1651331664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa32650 0x55c02fa32a30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f35b80b0040 tx=0x7f35b80f0f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01a0a2d9abff1a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:55.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35b5600640 1 -- 172.21.15.122:0/1651331664 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b81210b0 con 0x55c02fa32650 2024-05-28T06:06:55.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35b5600640 1 -- 172.21.15.122:0/1651331664 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b80b3040 con 0x55c02fa32650 2024-05-28T06:06:55.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35b5600640 1 -- 172.21.15.122:0/1651331664 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b80f1300 con 0x55c02fa32650 2024-05-28T06:06:55.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35cae21000 1 -- 172.21.15.122:0/1651331664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa32650 msgr2=0x55c02fa32a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:55.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35cae21000 1 --2- 172.21.15.122:0/1651331664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa32650 0x55c02fa32a30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f35b80b0040 tx=0x7f35b80f0f70 comp rx=0 tx=0).stop 2024-05-28T06:06:55.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35cae21000 1 -- 172.21.15.122:0/1651331664 shutdown_connections 2024-05-28T06:06:55.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35cae21000 1 --2- 172.21.15.122:0/1651331664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa32650 0x55c02fa32a30 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35cae21000 1 --2- 172.21.15.122:0/1651331664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c02fa7fa40 0x55c02fa32110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35cae21000 1 --2- 172.21.15.122:0/1651331664 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c02fa7f120 0x55c02fa7f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35cae21000 1 -- 172.21.15.122:0/1651331664 >> 172.21.15.122:0/1651331664 conn(0x55c02fa5fec0 msgr2=0x55c02fa622b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:55.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35cae21000 1 -- 172.21.15.122:0/1651331664 shutdown_connections 2024-05-28T06:06:55.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.746+0000 7f35cae21000 1 -- 172.21.15.122:0/1651331664 wait complete. 2024-05-28T06:06:55.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35cae21000 1 -- start start 2024-05-28T06:06:55.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35cae21000 1 Processor -- start 2024-05-28T06:06:55.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35cae21000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa32650 0x55c02fa37b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35cae21000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c02fa7f120 0x55c02fa38080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35cae21000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c02fa7fa40 0x55c02fa385c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35cae21000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c02f823ec0 con 0x55c02fa32650 2024-05-28T06:06:55.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35cae21000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c02f904120 con 0x55c02fa7f120 2024-05-28T06:06:55.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35cae21000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55c02f88e350 con 0x55c02fa7fa40 2024-05-28T06:06:55.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35cae21000 10 client.0 _ll_register_callbacks cb 0x55c02f8604d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-28T06:06:55.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35c5000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa32650 0x55c02fa37b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35c5000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa32650 0x55c02fa37b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57770/0 (socket says 172.21.15.122:57770) 2024-05-28T06:06:55.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35c5000640 1 -- 172.21.15.122:0/584061942 learned_addr learned my addr 172.21.15.122:0/584061942 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:55.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35c5a00640 1 --2- 172.21.15.122:0/584061942 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c02fa7fa40 0x55c02fa385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35b7e00640 1 --2- 172.21.15.122:0/584061942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c02fa7f120 0x55c02fa38080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35c5000640 1 -- 172.21.15.122:0/584061942 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c02fa7fa40 msgr2=0x55c02fa385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:55.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35c5000640 1 --2- 172.21.15.122:0/584061942 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c02fa7fa40 0x55c02fa385c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35c5000640 1 -- 172.21.15.122:0/584061942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c02fa7f120 msgr2=0x55c02fa38080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:55.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35c5000640 1 --2- 172.21.15.122:0/584061942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c02fa7f120 0x55c02fa38080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35c5000640 1 -- 172.21.15.122:0/584061942 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c02f8c8f80 con 0x55c02fa32650 2024-05-28T06:06:55.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35c5000640 1 --2- 172.21.15.122:0/584061942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa32650 0x55c02fa37b40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f35b0001e90 tx=0x7f35b0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a45887ced14458 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:55.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35ae000640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-28T06:06:55.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35ae000640 1 -- 172.21.15.122:0/584061942 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b0027060 con 0x55c02fa32650 2024-05-28T06:06:55.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35ae000640 1 -- 172.21.15.122:0/584061942 <== mon.0 v2:172.21.15.122:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f35b0010040 con 0x55c02fa32650 2024-05-28T06:06:55.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35cae21000 1 -- 172.21.15.122:0/584061942 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35b80b3040 con 0x55c02fa32650 2024-05-28T06:06:55.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35ae000640 1 -- 172.21.15.122:0/584061942 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f35b0005e00 con 0x55c02fa32650 2024-05-28T06:06:55.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35cae21000 10 client.5268 fetch_fsmap learned FSMap version 18 2024-05-28T06:06:55.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35cae21000 1 -- 172.21.15.122:0/584061942 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55c02f85cf00 con 0x55c02fa32650 2024-05-28T06:06:55.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35ae000640 1 -- 172.21.15.122:0/584061942 <== mon.0 v2:172.21.15.122:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b80b3040 con 0x55c02fa32650 2024-05-28T06:06:55.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35ae000640 1 -- 172.21.15.122:0/584061942 <== mon.0 v2:172.21.15.122:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f35b0013420 con 0x55c02fa32650 2024-05-28T06:06:55.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35cae21000 10 client.5268 fetch_fsmap finished waiting for FSMap version 18 2024-05-28T06:06:55.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35cae21000 10 client.5268 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-28T06:06:55.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35cae21000 20 client.5268 populate_metadata read hostname 'smithi122' 2024-05-28T06:06:55.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35cae21000 1 --2- 172.21.15.122:0/584061942 >> [v2:172.21.15.122:6836/1698676182,v1:172.21.15.122:6837/1698676182] conn(0x55c02fa8e3c0 0x55c02fa907b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35cae21000 4 client.5268 mds_command: new command op to 5082 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-28T06:06:55.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35cae21000 1 -- 172.21.15.122:0/584061942 --> [v2:172.21.15.122:6836/1698676182,v1:172.21.15.122:6837/1698676182] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c02f81cbc0 con 0x55c02fa8e3c0 2024-05-28T06:06:55.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.750+0000 7f35b7e00640 1 --2- 172.21.15.122:0/584061942 >> [v2:172.21.15.122:6836/1698676182,v1:172.21.15.122:6837/1698676182] conn(0x55c02fa8e3c0 0x55c02fa907b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.754+0000 7f35b7e00640 1 --2- 172.21.15.122:0/584061942 >> [v2:172.21.15.122:6836/1698676182,v1:172.21.15.122:6837/1698676182] conn(0x55c02fa8e3c0 0x55c02fa907b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef9082d732bd9f04 server_cookie=5cb7b0cccc93eb5 in_seq=0 out_seq=0 2024-05-28T06:06:55.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.754+0000 7f35ae000640 10 client.5268 ms_handle_connect on v2:172.21.15.122:6836/1698676182 2024-05-28T06:06:55.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.754+0000 7f35ae000640 1 -- 172.21.15.122:0/584061942 <== mds.0 v2:172.21.15.122:6836/1698676182 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c02f81cbc0 con 0x55c02fa8e3c0 2024-05-28T06:06:55.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.754+0000 7f35ae000640 10 client.5268 handle_command_reply: tid=0 2024-05-28T06:06:55.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.754+0000 7f35cae21000 1 client.5268 shutdown 2024-05-28T06:06:55.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.754+0000 7f35cae21000 1 -- 172.21.15.122:0/584061942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa32650 msgr2=0x55c02fa37b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:55.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.754+0000 7f35cae21000 1 --2- 172.21.15.122:0/584061942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa32650 0x55c02fa37b40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f35b0001e90 tx=0x7f35b0011000 comp rx=0 tx=0).stop 2024-05-28T06:06:55.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.754+0000 7f35cae21000 1 -- 172.21.15.122:0/584061942 shutdown_connections 2024-05-28T06:06:55.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.754+0000 7f35cae21000 1 --2- 172.21.15.122:0/584061942 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c02fa7fa40 0x55c02fa385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.754+0000 7f35cae21000 1 --2- 172.21.15.122:0/584061942 >> [v2:172.21.15.122:6836/1698676182,v1:172.21.15.122:6837/1698676182] conn(0x55c02fa8e3c0 0x55c02fa907b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.754+0000 7f35cae21000 1 --2- 172.21.15.122:0/584061942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c02fa7f120 0x55c02fa38080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.754+0000 7f35cae21000 1 --2- 172.21.15.122:0/584061942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa32650 0x55c02fa37b40 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.754+0000 7f35cae21000 1 -- 172.21.15.122:0/584061942 >> 172.21.15.122:0/584061942 conn(0x55c02fa5fec0 msgr2=0x55c02fa622b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:55.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.754+0000 7f35ae000640 0 client.5268 ms_handle_reset on v2:172.21.15.122:6836/1698676182 2024-05-28T06:06:55.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.754+0000 7f35cae21000 1 -- 172.21.15.122:0/584061942 shutdown_connections 2024-05-28T06:06:55.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.754+0000 7f35cae21000 1 -- 172.21.15.122:0/584061942 wait complete. 2024-05-28T06:06:55.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.754+0000 7f35cae21000 20 client.5268 trim_cache size 0 max 16384 2024-05-28T06:06:55.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.770+0000 7f35cae21000 1 Processor -- start 2024-05-28T06:06:55.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.770+0000 7f35cae21000 1 -- start start 2024-05-28T06:06:55.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.770+0000 7f35cae21000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c02fa32650 0x55c02fa31810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.770+0000 7f35cae21000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa7f120 0x55c02fa31d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.770+0000 7f35cae21000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c02fa7fa40 0x55c02fa907b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.770+0000 7f35cae21000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f35c0202c30 con 0x55c02fa7f120 2024-05-28T06:06:55.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.770+0000 7f35cae21000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f35c0202030 con 0x55c02fa7fa40 2024-05-28T06:06:55.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.770+0000 7f35cae21000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f35c02025e0 con 0x55c02fa32650 2024-05-28T06:06:55.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35b7e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa7f120 0x55c02fa31d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35b7e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa7f120 0x55c02fa31d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57782/0 (socket says 172.21.15.122:57782) 2024-05-28T06:06:55.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35b7e00640 1 -- 172.21.15.122:0/2766586652 learned_addr learned my addr 172.21.15.122:0/2766586652 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:55.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35c5a00640 1 --2- 172.21.15.122:0/2766586652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c02fa7fa40 0x55c02fa907b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35c5000640 1 --2- 172.21.15.122:0/2766586652 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c02fa32650 0x55c02fa31810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35b7e00640 1 -- 172.21.15.122:0/2766586652 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c02fa32650 msgr2=0x55c02fa31810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:55.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35b7e00640 1 --2- 172.21.15.122:0/2766586652 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c02fa32650 0x55c02fa31810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35b7e00640 1 -- 172.21.15.122:0/2766586652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c02fa7fa40 msgr2=0x55c02fa907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:55.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35b7e00640 1 --2- 172.21.15.122:0/2766586652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c02fa7fa40 0x55c02fa907b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35b7e00640 1 -- 172.21.15.122:0/2766586652 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c02fa7f870 con 0x55c02fa7f120 2024-05-28T06:06:55.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35c5000640 1 --2- 172.21.15.122:0/2766586652 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c02fa32650 0x55c02fa31810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:55.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35b7e00640 1 --2- 172.21.15.122:0/2766586652 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa7f120 0x55c02fa31d50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f35a8009be0 tx=0x7f35a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf572202e5b03d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:55.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35b4c00640 1 -- 172.21.15.122:0/2766586652 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a8017e40 con 0x55c02fa7f120 2024-05-28T06:06:55.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35b4c00640 1 -- 172.21.15.122:0/2766586652 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a8023070 con 0x55c02fa7f120 2024-05-28T06:06:55.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35b4c00640 1 -- 172.21.15.122:0/2766586652 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a801ed90 con 0x55c02fa7f120 2024-05-28T06:06:55.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35cae21000 1 -- 172.21.15.122:0/2766586652 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa7f120 msgr2=0x55c02fa31d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:55.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35cae21000 1 --2- 172.21.15.122:0/2766586652 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa7f120 0x55c02fa31d50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f35a8009be0 tx=0x7f35a8008040 comp rx=0 tx=0).stop 2024-05-28T06:06:55.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35cae21000 1 -- 172.21.15.122:0/2766586652 shutdown_connections 2024-05-28T06:06:55.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35cae21000 1 --2- 172.21.15.122:0/2766586652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c02fa7fa40 0x55c02fa907b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35cae21000 1 --2- 172.21.15.122:0/2766586652 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa7f120 0x55c02fa31d50 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35cae21000 1 --2- 172.21.15.122:0/2766586652 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c02fa32650 0x55c02fa31810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35cae21000 1 -- 172.21.15.122:0/2766586652 >> 172.21.15.122:0/2766586652 conn(0x55c02fa5fec0 msgr2=0x55c02fa31100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:55.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35cae21000 1 -- 172.21.15.122:0/2766586652 shutdown_connections 2024-05-28T06:06:55.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35cae21000 1 -- 172.21.15.122:0/2766586652 wait complete. 2024-05-28T06:06:55.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35cae21000 1 -- start start 2024-05-28T06:06:55.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35cae21000 1 Processor -- start 2024-05-28T06:06:55.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35cae21000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa32650 0x55c02fa93650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35cae21000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c02fa7f120 0x55c02faaa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35cae21000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c02fa7fa40 0x55c02faaa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35cae21000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c02f882730 con 0x55c02fa32650 2024-05-28T06:06:55.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35cae21000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c02f84f9e0 con 0x55c02fa7fa40 2024-05-28T06:06:55.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35cae21000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x55c02f887a50 con 0x55c02fa7f120 2024-05-28T06:06:55.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35cae21000 10 client.0 _ll_register_callbacks cb 0x7f35b0007350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-28T06:06:55.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35c5000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa32650 0x55c02fa93650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35c5000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa32650 0x55c02fa93650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57794/0 (socket says 172.21.15.122:57794) 2024-05-28T06:06:55.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.774+0000 7f35c5000640 1 -- 172.21.15.122:0/1116896994 learned_addr learned my addr 172.21.15.122:0/1116896994 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:55.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35c5a00640 1 --2- 172.21.15.122:0/1116896994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c02fa7fa40 0x55c02faaa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35c5000640 1 -- 172.21.15.122:0/1116896994 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c02fa7f120 msgr2=0x55c02faaa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:55.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35b7e00640 1 --2- 172.21.15.122:0/1116896994 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c02fa7f120 0x55c02faaa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35c5000640 1 --2- 172.21.15.122:0/1116896994 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c02fa7f120 0x55c02faaa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35c5000640 1 -- 172.21.15.122:0/1116896994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c02fa7fa40 msgr2=0x55c02faaa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:55.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35c5000640 1 --2- 172.21.15.122:0/1116896994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c02fa7fa40 0x55c02faaa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35c5000640 1 -- 172.21.15.122:0/1116896994 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c02f809e80 con 0x55c02fa32650 2024-05-28T06:06:55.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35c5a00640 1 --2- 172.21.15.122:0/1116896994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c02fa7fa40 0x55c02faaa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:55.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35b7e00640 1 --2- 172.21.15.122:0/1116896994 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c02fa7f120 0x55c02faaa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:06:55.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35c5000640 1 --2- 172.21.15.122:0/1116896994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa32650 0x55c02fa93650 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f35b0007440 tx=0x7f35b0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e98df00125025df server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:55.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35ae000640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-28T06:06:55.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35ae000640 1 -- 172.21.15.122:0/1116896994 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b003a060 con 0x55c02fa32650 2024-05-28T06:06:55.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35ae000640 1 -- 172.21.15.122:0/1116896994 <== mon.0 v2:172.21.15.122:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f35b0013970 con 0x55c02fa32650 2024-05-28T06:06:55.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35cae21000 1 -- 172.21.15.122:0/1116896994 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35a8023070 con 0x55c02fa32650 2024-05-28T06:06:55.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35ae000640 1 -- 172.21.15.122:0/1116896994 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f35b0040050 con 0x55c02fa32650 2024-05-28T06:06:55.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35cae21000 10 client.5274 fetch_fsmap learned FSMap version 18 2024-05-28T06:06:55.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35cae21000 1 -- 172.21.15.122:0/1116896994 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55c02f84bb30 con 0x55c02fa32650 2024-05-28T06:06:55.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35ae000640 1 -- 172.21.15.122:0/1116896994 <== mon.0 v2:172.21.15.122:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a8023070 con 0x55c02fa32650 2024-05-28T06:06:55.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35ae000640 1 -- 172.21.15.122:0/1116896994 <== mon.0 v2:172.21.15.122:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f35b0043020 con 0x55c02fa32650 2024-05-28T06:06:55.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35cae21000 10 client.5274 fetch_fsmap finished waiting for FSMap version 18 2024-05-28T06:06:55.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35cae21000 10 client.5274 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-28T06:06:55.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35cae21000 20 client.5274 populate_metadata read hostname 'smithi122' 2024-05-28T06:06:55.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35cae21000 1 --2- 172.21.15.122:0/1116896994 >> [v2:172.21.15.122:6836/1698676182,v1:172.21.15.122:6837/1698676182] conn(0x55c02faaadc0 0x55c02faedfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35cae21000 4 client.5274 mds_command: new command op to 5082 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-28T06:06:55.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35cae21000 1 -- 172.21.15.122:0/1116896994 --> [v2:172.21.15.122:6836/1698676182,v1:172.21.15.122:6837/1698676182] -- command(tid 0: {"prefix": "status"}) -- 0x55c02f890e40 con 0x55c02faaadc0 2024-05-28T06:06:55.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35b7e00640 1 --2- 172.21.15.122:0/1116896994 >> [v2:172.21.15.122:6836/1698676182,v1:172.21.15.122:6837/1698676182] conn(0x55c02faaadc0 0x55c02faedfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35ae000640 10 client.5274 ms_handle_connect on v2:172.21.15.122:6836/1698676182 2024-05-28T06:06:55.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35b7e00640 1 --2- 172.21.15.122:0/1116896994 >> [v2:172.21.15.122:6836/1698676182,v1:172.21.15.122:6837/1698676182] conn(0x55c02faaadc0 0x55c02faedfb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27e277ee6ad662a7 server_cookie=eade21258f2f8864 in_seq=0 out_seq=0 2024-05-28T06:06:55.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35ae000640 1 -- 172.21.15.122:0/1116896994 <== mds.0 v2:172.21.15.122:6836/1698676182 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55c02f890e40 con 0x55c02faaadc0 2024-05-28T06:06:55.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35ae000640 10 client.5274 handle_command_reply: tid=0 2024-05-28T06:06:55.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35cae21000 1 client.5274 shutdown 2024-05-28T06:06:55.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35cae21000 1 -- 172.21.15.122:0/1116896994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa32650 msgr2=0x55c02fa93650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:55.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35cae21000 1 --2- 172.21.15.122:0/1116896994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa32650 0x55c02fa93650 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f35b0007440 tx=0x7f35b0000ee0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35cae21000 1 -- 172.21.15.122:0/1116896994 shutdown_connections 2024-05-28T06:06:55.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35cae21000 1 --2- 172.21.15.122:0/1116896994 >> [v2:172.21.15.122:6836/1698676182,v1:172.21.15.122:6837/1698676182] conn(0x55c02faaadc0 0x55c02faedfb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35cae21000 1 --2- 172.21.15.122:0/1116896994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c02fa7fa40 0x55c02faaa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35cae21000 1 --2- 172.21.15.122:0/1116896994 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c02fa7f120 0x55c02faaa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35ae000640 0 client.5274 ms_handle_reset on v2:172.21.15.122:6836/1698676182 2024-05-28T06:06:55.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35cae21000 1 --2- 172.21.15.122:0/1116896994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c02fa32650 0x55c02fa93650 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35cae21000 1 -- 172.21.15.122:0/1116896994 >> 172.21.15.122:0/1116896994 conn(0x55c02fa5fec0 msgr2=0x55c02fa31810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:55.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35cae21000 1 -- 172.21.15.122:0/1116896994 shutdown_connections 2024-05-28T06:06:55.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35cae21000 1 -- 172.21.15.122:0/1116896994 wait complete. 2024-05-28T06:06:55.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35cae21000 20 client.5274 trim_cache size 0 max 16384 2024-05-28T06:06:55.788 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:06:55.788 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:06:55.788 INFO:teuthology.orchestra.run.smithi122.stdout: "whoami": 0, 2024-05-28T06:06:55.788 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 5082, 2024-05-28T06:06:55.788 INFO:teuthology.orchestra.run.smithi122.stdout: "want_state": "up:active", 2024-05-28T06:06:55.788 INFO:teuthology.orchestra.run.smithi122.stdout: "state": "up:active", 2024-05-28T06:06:55.788 INFO:teuthology.orchestra.run.smithi122.stdout: "fs_name": "cephfs", 2024-05-28T06:06:55.789 INFO:teuthology.orchestra.run.smithi122.stdout: "rank_uptime": 5.8887014789999998, 2024-05-28T06:06:55.789 INFO:teuthology.orchestra.run.smithi122.stdout: "mdsmap_epoch": 18, 2024-05-28T06:06:55.789 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_epoch": 34, 2024-05-28T06:06:55.789 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_epoch_barrier": 34, 2024-05-28T06:06:55.789 INFO:teuthology.orchestra.run.smithi122.stdout: "uptime": 13.159425626000001 2024-05-28T06:06:55.789 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:06:55.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35c7a00640 1 -- 172.21.15.122:0/1182442216 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f359c0683b0 msgr2=0x7f359c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:55.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35c7a00640 1 --2- 172.21.15.122:0/1182442216 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f359c0683b0 0x7f359c06a870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f35b0007fd0 tx=0x7f35b0007c20 comp rx=0 tx=0).stop 2024-05-28T06:06:55.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35c7a00640 1 -- 172.21.15.122:0/1182442216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35c0159280 msgr2=0x7f35c00b2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:55.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35c7a00640 1 --2- 172.21.15.122:0/1182442216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35c0159280 0x7f35c00b2720 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f35b801b020 tx=0x7f35b8019710 comp rx=0 tx=0).stop 2024-05-28T06:06:55.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35c7a00640 1 -- 172.21.15.122:0/1182442216 shutdown_connections 2024-05-28T06:06:55.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35c7a00640 1 --2- 172.21.15.122:0/1182442216 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f359c0683b0 0x7f359c06a870 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35c7a00640 1 --2- 172.21.15.122:0/1182442216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35c0159280 0x7f35c00b2720 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35c7a00640 1 --2- 172.21.15.122:0/1182442216 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35c00cced0 0x7f35c00aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35c7a00640 1 --2- 172.21.15.122:0/1182442216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35c00b4e10 0x7f35c0142670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35c7a00640 1 -- 172.21.15.122:0/1182442216 >> 172.21.15.122:0/1182442216 conn(0x7f35c0062a40 msgr2=0x7f35c006b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:55.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35c7a00640 1 -- 172.21.15.122:0/1182442216 shutdown_connections 2024-05-28T06:06:55.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.778+0000 7f35c7a00640 1 -- 172.21.15.122:0/1182442216 wait complete. 2024-05-28T06:06:55.802 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-28T06:06:55.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.938+0000 7f7aeca00640 1 Processor -- start 2024-05-28T06:06:55.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.938+0000 7f7aeca00640 1 -- start start 2024-05-28T06:06:55.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.938+0000 7f7aeca00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7ae80b4430 0x7f7ae80b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.938+0000 7f7aeca00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ae80b49f0 con 0x7f7ae806b990 2024-05-28T06:06:55.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.938+0000 7f7aeca00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ae80b63d0 con 0x7f7ae8160bc0 2024-05-28T06:06:55.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.938+0000 7f7aeca00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f7ae8148330 con 0x7f7ae80b4430 2024-05-28T06:06:55.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.938+0000 7f7ae6a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7ae80b4430 0x7f7ae80b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.938+0000 7f7ae7400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f7ae806b990 0x7f7ae806bd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:53974/0 (socket says 172.21.15.122:53974) 2024-05-28T06:06:55.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.938+0000 7f7ae7400640 1 -- 172.21.15.122:0/2876319249 learned_addr learned my addr 172.21.15.122:0/2876319249 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:55.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.938+0000 7f7ae6000640 1 -- 172.21.15.122:0/2876319249 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1765403256 0 0) 0x7f7ae80b49f0 con 0x7f7ae806b990 2024-05-28T06:06:55.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.938+0000 7f7ae6000640 1 -- 172.21.15.122:0/2876319249 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7acc003530 con 0x7f7ae806b990 2024-05-28T06:06:55.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.938+0000 7f7ae6a00640 1 -- 172.21.15.122:0/2876319249 >> v1:172.21.15.153:6789/0 conn(0x7f7ae8160bc0 legacy=0x7f7ae8161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:55.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.938+0000 7f7ae6a00640 1 -- 172.21.15.122:0/2876319249 >> v1:172.21.15.122:6789/0 conn(0x7f7ae806b990 legacy=0x7f7ae806bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:55.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.938+0000 7f7ae6a00640 1 -- 172.21.15.122:0/2876319249 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae80b66b0 con 0x7f7ae80b4430 2024-05-28T06:06:55.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.942+0000 7f7ae6a00640 1 --2- 172.21.15.122:0/2876319249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae80b4430 0x7f7ae80b2b20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40097c0 tx=0x7f7ad401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bcc666f618271f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:55.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.942+0000 7f7ae6000640 1 -- 172.21.15.122:0/2876319249 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad40b0070 con 0x7f7ae80b4430 2024-05-28T06:06:55.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.942+0000 7f7ae6000640 1 -- 172.21.15.122:0/2876319249 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad40ab600 con 0x7f7ae80b4430 2024-05-28T06:06:55.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.942+0000 7f7ae6000640 1 -- 172.21.15.122:0/2876319249 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad40ab9d0 con 0x7f7ae80b4430 2024-05-28T06:06:55.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.942+0000 7f7aeca00640 1 -- 172.21.15.122:0/2876319249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae80b4430 msgr2=0x7f7ae80b2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:55.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.942+0000 7f7aeca00640 1 --2- 172.21.15.122:0/2876319249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae80b4430 0x7f7ae80b2b20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40097c0 tx=0x7f7ad401c4a0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.942+0000 7f7aeca00640 1 -- 172.21.15.122:0/2876319249 shutdown_connections 2024-05-28T06:06:55.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.942+0000 7f7aeca00640 1 --2- 172.21.15.122:0/2876319249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae80b4430 0x7f7ae80b2b20 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.942+0000 7f7aeca00640 1 -- 172.21.15.122:0/2876319249 >> 172.21.15.122:0/2876319249 conn(0x7f7ae80b6b70 msgr2=0x7f7ae809aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:55.947 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.942+0000 7f7aeca00640 1 -- 172.21.15.122:0/2876319249 shutdown_connections 2024-05-28T06:06:55.947 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.942+0000 7f7aeca00640 1 -- 172.21.15.122:0/2876319249 wait complete. 2024-05-28T06:06:55.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7aeca00640 1 Processor -- start 2024-05-28T06:06:55.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7aeca00640 1 -- start start 2024-05-28T06:06:55.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7aeca00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7ae806b990 0x7f7ae8158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7aeca00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ae80b4430 0x7f7ae8143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7aeca00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae8160bc0 0x7f7ae81448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7aeca00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae816c530 con 0x7f7ae8160bc0 2024-05-28T06:06:55.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7aeca00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae8147e10 con 0x7f7ae80b4430 2024-05-28T06:06:55.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7aeca00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7ae816c6b0 con 0x7f7ae806b990 2024-05-28T06:06:55.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7ae7e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae8160bc0 0x7f7ae81448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7ae7e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae8160bc0 0x7f7ae81448b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57812/0 (socket says 172.21.15.122:57812) 2024-05-28T06:06:55.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7ae7e00640 1 -- 172.21.15.122:0/687984582 learned_addr learned my addr 172.21.15.122:0/687984582 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:55.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7ae6a00640 1 --2- 172.21.15.122:0/687984582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ae80b4430 0x7f7ae8143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7ae7400640 1 --2- 172.21.15.122:0/687984582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7ae806b990 0x7f7ae8158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7ae7e00640 1 -- 172.21.15.122:0/687984582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7ae806b990 msgr2=0x7f7ae8158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:55.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7ae7e00640 1 --2- 172.21.15.122:0/687984582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7ae806b990 0x7f7ae8158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7ae7e00640 1 -- 172.21.15.122:0/687984582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ae80b4430 msgr2=0x7f7ae8143e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:55.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7ae7e00640 1 --2- 172.21.15.122:0/687984582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ae80b4430 0x7f7ae8143e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:55.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7ae7e00640 1 -- 172.21.15.122:0/687984582 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae8142350 con 0x7f7ae8160bc0 2024-05-28T06:06:55.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7ae6a00640 1 --2- 172.21.15.122:0/687984582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ae80b4430 0x7f7ae8143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:06:55.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7ae7e00640 1 --2- 172.21.15.122:0/687984582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae8160bc0 0x7f7ae81448b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000c730 tx=0x7f7ae000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:55.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7adf400640 1 -- 172.21.15.122:0/687984582 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0003b80 con 0x7f7ae8160bc0 2024-05-28T06:06:55.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7adf400640 1 -- 172.21.15.122:0/687984582 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ae0003d20 con 0x7f7ae8160bc0 2024-05-28T06:06:55.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7aeca00640 1 -- 172.21.15.122:0/687984582 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae8142630 con 0x7f7ae8160bc0 2024-05-28T06:06:55.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7adf400640 1 -- 172.21.15.122:0/687984582 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae000aa30 con 0x7f7ae8160bc0 2024-05-28T06:06:55.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7aeca00640 1 -- 172.21.15.122:0/687984582 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae8142bf0 con 0x7f7ae8160bc0 2024-05-28T06:06:55.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.946+0000 7f7aeca00640 1 -- 172.21.15.122:0/687984582 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ae8075620 con 0x7f7ae8160bc0 2024-05-28T06:06:55.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.950+0000 7f7adf400640 1 -- 172.21.15.122:0/687984582 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7ae000abd0 con 0x7f7ae8160bc0 2024-05-28T06:06:55.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.950+0000 7f7adf400640 1 --2- 172.21.15.122:0/687984582 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7ac8068380 0x7f7ac806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:55.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.950+0000 7f7adf400640 1 -- 172.21.15.122:0/687984582 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7ae00868e0 con 0x7f7ae8160bc0 2024-05-28T06:06:55.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.950+0000 7f7ae7400640 1 --2- 172.21.15.122:0/687984582 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7ac8068380 0x7f7ac806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:55.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.950+0000 7f7ae7400640 1 --2- 172.21.15.122:0/687984582 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7ac8068380 0x7f7ac806a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80011f0 tx=0x7f7ad8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:55.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:55.954+0000 7f7adf400640 1 -- 172.21.15.122:0/687984582 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7ae0056e00 con 0x7f7ae8160bc0 2024-05-28T06:06:56.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:56.146+0000 7f7aeca00640 1 -- 172.21.15.122:0/687984582 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7ae8070780 con 0x7f7ae8160bc0 2024-05-28T06:06:56.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:56.146+0000 7f7adf400640 1 -- 172.21.15.122:0/687984582 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7f7ae0056700 con 0x7f7ae8160bc0 2024-05-28T06:06:56.148 INFO:teuthology.orchestra.run.smithi122.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-28T06:06:56.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:56.146+0000 7f7aeca00640 1 -- 172.21.15.122:0/687984582 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7ac8068380 msgr2=0x7f7ac806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:56.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:56.146+0000 7f7aeca00640 1 --2- 172.21.15.122:0/687984582 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7ac8068380 0x7f7ac806a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80011f0 tx=0x7f7ad8009040 comp rx=0 tx=0).stop 2024-05-28T06:06:56.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:56.146+0000 7f7aeca00640 1 -- 172.21.15.122:0/687984582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae8160bc0 msgr2=0x7f7ae81448b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:56.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:56.146+0000 7f7aeca00640 1 --2- 172.21.15.122:0/687984582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae8160bc0 0x7f7ae81448b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000c730 tx=0x7f7ae000cbf0 comp rx=0 tx=0).stop 2024-05-28T06:06:56.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:56.146+0000 7f7aeca00640 1 -- 172.21.15.122:0/687984582 shutdown_connections 2024-05-28T06:06:56.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:56.146+0000 7f7aeca00640 1 --2- 172.21.15.122:0/687984582 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7ac8068380 0x7f7ac806a840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:56.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:56.146+0000 7f7aeca00640 1 --2- 172.21.15.122:0/687984582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae8160bc0 0x7f7ae81448b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:56.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:56.146+0000 7f7aeca00640 1 --2- 172.21.15.122:0/687984582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ae80b4430 0x7f7ae8143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:56.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:56.146+0000 7f7aeca00640 1 --2- 172.21.15.122:0/687984582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7ae806b990 0x7f7ae8158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:56.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:56.146+0000 7f7aeca00640 1 -- 172.21.15.122:0/687984582 >> 172.21.15.122:0/687984582 conn(0x7f7ae80b6b70 msgr2=0x7f7ae806feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:56.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:56.146+0000 7f7aeca00640 1 -- 172.21.15.122:0/687984582 shutdown_connections 2024-05-28T06:06:56.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:56.146+0000 7f7aeca00640 1 -- 172.21.15.122:0/687984582 wait complete. 2024-05-28T06:06:56.169 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-28T06:06:56.169 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-28T06:06:56.169 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi122.front.sepia.ceph.com 2024-05-28T06:06:56.170 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-28T06:06:56.170 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-28T06:06:56.170 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-28T06:06:56.170 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-28T06:06:56.170 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-28T06:06:56.170 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-28T06:06:56.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:56.170 DEBUG:teuthology.orchestra.run.smithi122:> ip addr 2024-05-28T06:06:56.180 INFO:teuthology.orchestra.run.smithi122.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-28T06:06:56.181 INFO:teuthology.orchestra.run.smithi122.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-28T06:06:56.181 INFO:teuthology.orchestra.run.smithi122.stdout: inet 127.0.0.1/8 scope host lo 2024-05-28T06:06:56.181 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:56.181 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 ::1/128 scope host 2024-05-28T06:06:56.181 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:56.181 INFO:teuthology.orchestra.run.smithi122.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-28T06:06:56.181 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e4 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:56.181 INFO:teuthology.orchestra.run.smithi122.stdout: altname enp7s0f0 2024-05-28T06:06:56.181 INFO:teuthology.orchestra.run.smithi122.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-28T06:06:56.181 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e5 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:56.181 INFO:teuthology.orchestra.run.smithi122.stdout: altname enp7s0f1 2024-05-28T06:06:56.181 INFO:teuthology.orchestra.run.smithi122.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-28T06:06:56.181 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:14 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:56.182 INFO:teuthology.orchestra.run.smithi122.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-28T06:06:56.182 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:15 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:56.182 INFO:teuthology.orchestra.run.smithi122.stdout: inet 172.21.15.122/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-28T06:06:56.182 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft 42406sec preferred_lft 42406sec 2024-05-28T06:06:56.182 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::ec4:7aff:fe8f:d515/64 scope link 2024-05-28T06:06:56.182 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:56.182 INFO:teuthology.orchestra.run.smithi122.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-28T06:06:56.182 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 02:42:4d:d8:1b:5f brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:56.182 INFO:teuthology.orchestra.run.smithi122.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-28T06:06:56.182 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:56.182 INFO:teuthology.orchestra.run.smithi122.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-28T06:06:56.182 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-28T06:06:56.182 INFO:teuthology.orchestra.run.smithi122.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-28T06:06:56.182 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:56.183 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-28T06:06:56.183 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:56.183 INFO:teuthology.orchestra.run.smithi122.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-28T06:06:56.183 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-28T06:06:56.183 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-28T06:06:56.183 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:56.183 INFO:teuthology.orchestra.run.smithi122.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-28T06:06:56.183 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-28T06:06:56.183 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-28T06:06:56.183 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:06:56.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:56.184 DEBUG:teuthology.orchestra.run.smithi122:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-28T06:06:56.245 INFO:teuthology.orchestra.run.smithi122.stdout:1 2024-05-28T06:06:56.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:56.247 DEBUG:teuthology.orchestra.run.smithi122:> route 2024-05-28T06:06:56.307 INFO:teuthology.orchestra.run.smithi122.stdout:Kernel IP routing table 2024-05-28T06:06:56.307 INFO:teuthology.orchestra.run.smithi122.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-28T06:06:56.307 INFO:teuthology.orchestra.run.smithi122.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-28T06:06:56.307 INFO:teuthology.orchestra.run.smithi122.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-28T06:06:56.307 INFO:teuthology.orchestra.run.smithi122.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-28T06:06:56.307 INFO:teuthology.orchestra.run.smithi122.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-28T06:06:56.307 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-28T06:06:56.307 INFO:teuthology.orchestra.run.smithi122.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-28T06:06:56.307 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-28T06:06:56.308 INFO:teuthology.orchestra.run.smithi122.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-28T06:06:56.308 INFO:teuthology.orchestra.run.smithi122.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-28T06:06:56.308 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-28T06:06:56.308 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-05-28T06:06:56.308 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-28T06:06:56.308 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-28T06:06:56.308 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-28T06:06:56.308 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-05-28T06:06:56.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:06:56.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:56.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:56.448 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2024-05-28T06:06:56.457 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-28T06:06:56.457 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-28T06:06:56.458 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-28T06:06:56.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:56.458 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set brx.0 up 2024-05-28T06:06:56.523 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-28T06:06:56.523 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-28T06:06:56.579 INFO:teuthology.orchestra.run.smithi122.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-28T06:06:56.579 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-28T06:06:56.579 DEBUG:teuthology.orchestra.run.smithi122:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-28T06:06:56.631 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-28T06:06:56.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:56.631 DEBUG:teuthology.orchestra.run.smithi122:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-28T06:06:56.723 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-28T06:06:56.723 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-28T06:06:56.723 INFO:teuthology.orchestra.run.smithi122.stdout:invalid new device string format 2024-05-28T06:06:56.738 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-28T06:06:56.738 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-28T06:06:56.738 INFO:teuthology.orchestra.run.smithi122.stdout:invalid new device string format 2024-05-28T06:06:56.738 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.122:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-05-28T06:06:56.738 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-28T06:06:56.747 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-28T06:06:56.747 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-28T06:06:56.747 INFO:teuthology.orchestra.run.smithi122.stdout:invalid new device string format 2024-05-28T06:06:56.747 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.122:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-05-28T06:06:56.747 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-28T06:06:56.747 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.122:6789,172.21.15.153:6789,172.21.15.153:6790" 2024-05-28T06:06:56.747 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.122:6789,172.21.15.153:6789,172.21.15.153:6790:/ 2024-05-28T06:06:56.748 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=e63a9349-baf2-4247-95d1-eb8599fad84f" will pass to kernel 2024-05-28T06:06:56.751 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-28T06:06:56.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:56.751 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-28T06:06:56.771 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-28T06:06:56.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-28T06:06:56.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:06:56.876 INFO:teuthology.orchestra.run.smithi122.stdout:client4856 2024-05-28T06:06:56.876 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:06:56.876 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:06:56.927 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-28T06:06:57.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.106+0000 7f4bc4400640 1 Processor -- start 2024-05-28T06:06:57.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.106+0000 7f4bc4400640 1 -- start start 2024-05-28T06:06:57.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.110+0000 7f4bc4400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4bbc0ce4f0 0x7f4bbc0ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:57.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.110+0000 7f4bc4400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4bbc15e730 0x7f4bbc15eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:57.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.110+0000 7f4bc4400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bbc15d970 con 0x7f4bbc0b58d0 2024-05-28T06:06:57.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.110+0000 7f4bc4400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f4bbc15dc50 con 0x7f4bbc0ce4f0 2024-05-28T06:06:57.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.110+0000 7f4bc4400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f4bbc15df30 con 0x7f4bbc15e730 2024-05-28T06:06:57.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.110+0000 7f4bc1000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4bbc0ce4f0 0x7f4bbc0ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:57.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.110+0000 7f4bc1000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4bbc0ce4f0 0x7f4bbc0ce980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57822/0 (socket says 172.21.15.122:57822) 2024-05-28T06:06:57.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.110+0000 7f4bc1000640 1 -- 172.21.15.122:0/306138954 learned_addr learned my addr 172.21.15.122:0/306138954 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:57.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.110+0000 7f4bc2400640 1 --2- 172.21.15.122:0/306138954 >> v2:172.21.15.153:3300/0 conn(0x7f4bbc15e730 0x7f4bbc15eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:57.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.110+0000 7f4bc1000640 1 -- 172.21.15.122:0/306138954 >> v2:172.21.15.153:3300/0 conn(0x7f4bbc15e730 msgr2=0x7f4bbc15eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:57.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.110+0000 7f4bc1000640 1 --2- 172.21.15.122:0/306138954 >> v2:172.21.15.153:3300/0 conn(0x7f4bbc15e730 0x7f4bbc15eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:57.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.110+0000 7f4bc1000640 1 -- 172.21.15.122:0/306138954 >> v1:172.21.15.153:6789/0 conn(0x7f4bbc0b58d0 legacy=0x7f4bbc0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:57.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.110+0000 7f4bc1000640 1 -- 172.21.15.122:0/306138954 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bbc15e210 con 0x7f4bbc0ce4f0 2024-05-28T06:06:57.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.114+0000 7f4bc1000640 1 --2- 172.21.15.122:0/306138954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bbc0ce4f0 0x7f4bbc0ce980 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc071cf0 tx=0x7f4ba801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5b96a48e927a1d server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:57.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.114+0000 7f4bbbe00640 1 -- 172.21.15.122:0/306138954 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba80b1070 con 0x7f4bbc0ce4f0 2024-05-28T06:06:57.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.114+0000 7f4bbbe00640 1 -- 172.21.15.122:0/306138954 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba80ac630 con 0x7f4bbc0ce4f0 2024-05-28T06:06:57.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.114+0000 7f4bbbe00640 1 -- 172.21.15.122:0/306138954 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba80a8050 con 0x7f4bbc0ce4f0 2024-05-28T06:06:57.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.114+0000 7f4bc4400640 1 -- 172.21.15.122:0/306138954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bbc0ce4f0 msgr2=0x7f4bbc0ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:57.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.114+0000 7f4bc4400640 1 --2- 172.21.15.122:0/306138954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bbc0ce4f0 0x7f4bbc0ce980 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc071cf0 tx=0x7f4ba801c520 comp rx=0 tx=0).stop 2024-05-28T06:06:57.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.114+0000 7f4bc4400640 1 -- 172.21.15.122:0/306138954 shutdown_connections 2024-05-28T06:06:57.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.114+0000 7f4bc4400640 1 --2- 172.21.15.122:0/306138954 >> v2:172.21.15.153:3300/0 conn(0x7f4bbc15e730 0x7f4bbc15eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:57.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.114+0000 7f4bc4400640 1 --2- 172.21.15.122:0/306138954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bbc0ce4f0 0x7f4bbc0ce980 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:57.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.114+0000 7f4bc4400640 1 -- 172.21.15.122:0/306138954 >> 172.21.15.122:0/306138954 conn(0x7f4bbc06bd90 msgr2=0x7f4bbc06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:57.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.114+0000 7f4bc4400640 1 -- 172.21.15.122:0/306138954 shutdown_connections 2024-05-28T06:06:57.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.114+0000 7f4bc4400640 1 -- 172.21.15.122:0/306138954 wait complete. 2024-05-28T06:06:57.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.114+0000 7f4bc4400640 1 Processor -- start 2024-05-28T06:06:57.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.114+0000 7f4bc4400640 1 -- start start 2024-05-28T06:06:57.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bc4400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bbc0b58d0 0x7f4bbc13ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:57.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bc4400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bbc0ce4f0 0x7f4bbc143f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:57.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bc4400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bbc15e730 0x7f4bbc074d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:57.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bc4400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4bbc1693d0 con 0x7f4bbc15e730 2024-05-28T06:06:57.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bc4400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4bbc169250 con 0x7f4bbc0b58d0 2024-05-28T06:06:57.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bc4400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4bbc169550 con 0x7f4bbc0ce4f0 2024-05-28T06:06:57.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bc2400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bbc15e730 0x7f4bbc074d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:57.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bc2400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bbc15e730 0x7f4bbc074d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57824/0 (socket says 172.21.15.122:57824) 2024-05-28T06:06:57.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bc2400640 1 -- 172.21.15.122:0/993017511 learned_addr learned my addr 172.21.15.122:0/993017511 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:57.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bc1a00640 1 --2- 172.21.15.122:0/993017511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bbc0b58d0 0x7f4bbc13ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:57.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bc1000640 1 --2- 172.21.15.122:0/993017511 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bbc0ce4f0 0x7f4bbc143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:57.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bc2400640 1 -- 172.21.15.122:0/993017511 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bbc0ce4f0 msgr2=0x7f4bbc143f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:57.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bc2400640 1 --2- 172.21.15.122:0/993017511 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bbc0ce4f0 0x7f4bbc143f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:57.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bc2400640 1 -- 172.21.15.122:0/993017511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bbc0b58d0 msgr2=0x7f4bbc13ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:57.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bc2400640 1 --2- 172.21.15.122:0/993017511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bbc0b58d0 0x7f4bbc13ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:57.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bc2400640 1 -- 172.21.15.122:0/993017511 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bbc0b1600 con 0x7f4bbc15e730 2024-05-28T06:06:57.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bc2400640 1 --2- 172.21.15.122:0/993017511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bbc15e730 0x7f4bbc074d90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400e7f0 tx=0x7f4bb400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:57.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bb9600640 1 -- 172.21.15.122:0/993017511 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4017070 con 0x7f4bbc15e730 2024-05-28T06:06:57.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bb9600640 1 -- 172.21.15.122:0/993017511 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb400c940 con 0x7f4bbc15e730 2024-05-28T06:06:57.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bc4400640 1 -- 172.21.15.122:0/993017511 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bbc0b18e0 con 0x7f4bbc15e730 2024-05-28T06:06:57.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bb9600640 1 -- 172.21.15.122:0/993017511 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb400eea0 con 0x7f4bbc15e730 2024-05-28T06:06:57.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bc4400640 1 -- 172.21.15.122:0/993017511 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bbc0b1ea0 con 0x7f4bbc15e730 2024-05-28T06:06:57.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bc4400640 1 -- 172.21.15.122:0/993017511 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bbc068c40 con 0x7f4bbc15e730 2024-05-28T06:06:57.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.118+0000 7f4bb9600640 1 -- 172.21.15.122:0/993017511 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4bb401a070 con 0x7f4bbc15e730 2024-05-28T06:06:57.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.122+0000 7f4bb9600640 1 --2- 172.21.15.122:0/993017511 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4b9c068380 0x7f4b9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:57.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.122+0000 7f4bb9600640 1 -- 172.21.15.122:0/993017511 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4bb4086c10 con 0x7f4bbc15e730 2024-05-28T06:06:57.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.122+0000 7f4bc1a00640 1 --2- 172.21.15.122:0/993017511 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4b9c068380 0x7f4b9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:57.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.122+0000 7f4bc1a00640 1 --2- 172.21.15.122:0/993017511 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4b9c068380 0x7f4b9c06a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc15d3a0 tx=0x7f4bb0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:57.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.126+0000 7f4bb9600640 1 -- 172.21.15.122:0/993017511 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4bb4056ae0 con 0x7f4bbc15e730 2024-05-28T06:06:57.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.318+0000 7f4bc4400640 1 -- 172.21.15.122:0/993017511 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f4bbc13f3d0 con 0x7f4bbc15e730 2024-05-28T06:06:57.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.950+0000 7f4bb9600640 1 -- 172.21.15.122:0/993017511 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v19) ==== 136+0+0 (secure 0 0 0) 0x7f4bb405ade0 con 0x7f4bbc15e730 2024-05-28T06:06:57.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.950+0000 7f4bc4400640 1 -- 172.21.15.122:0/993017511 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4b9c068380 msgr2=0x7f4b9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:57.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.950+0000 7f4bc4400640 1 --2- 172.21.15.122:0/993017511 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4b9c068380 0x7f4b9c06a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc15d3a0 tx=0x7f4bb0009040 comp rx=0 tx=0).stop 2024-05-28T06:06:57.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.950+0000 7f4bc4400640 1 -- 172.21.15.122:0/993017511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bbc15e730 msgr2=0x7f4bbc074d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:57.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.950+0000 7f4bc4400640 1 --2- 172.21.15.122:0/993017511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bbc15e730 0x7f4bbc074d90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400e7f0 tx=0x7f4bb400ecb0 comp rx=0 tx=0).stop 2024-05-28T06:06:57.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.950+0000 7f4bc4400640 1 -- 172.21.15.122:0/993017511 shutdown_connections 2024-05-28T06:06:57.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.950+0000 7f4bc4400640 1 --2- 172.21.15.122:0/993017511 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4b9c068380 0x7f4b9c06a840 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:57.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.950+0000 7f4bc4400640 1 --2- 172.21.15.122:0/993017511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bbc15e730 0x7f4bbc074d90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:57.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.950+0000 7f4bc4400640 1 --2- 172.21.15.122:0/993017511 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bbc0ce4f0 0x7f4bbc143f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:57.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.950+0000 7f4bc4400640 1 --2- 172.21.15.122:0/993017511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bbc0b58d0 0x7f4bbc13ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:57.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.950+0000 7f4bc4400640 1 -- 172.21.15.122:0/993017511 >> 172.21.15.122:0/993017511 conn(0x7f4bbc06bd90 msgr2=0x7f4bbc0b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:57.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.950+0000 7f4bc4400640 1 -- 172.21.15.122:0/993017511 shutdown_connections 2024-05-28T06:06:57.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:57.950+0000 7f4bc4400640 1 -- 172.21.15.122:0/993017511 wait complete. 2024-05-28T06:06:57.974 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-28T06:06:58.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.106+0000 7fc4ee600640 1 Processor -- start 2024-05-28T06:06:58.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.110+0000 7fc4ee600640 1 -- start start 2024-05-28T06:06:58.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.110+0000 7fc4ee600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e8142d30 0x7fc4e806f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:58.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.110+0000 7fc4ee600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc4e80ce560 0x7fc4e80ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:58.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.110+0000 7fc4ee600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4e806e030 con 0x7fc4e806f610 2024-05-28T06:06:58.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.110+0000 7fc4ee600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fc4e80ceef0 con 0x7fc4e80ce560 2024-05-28T06:06:58.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.110+0000 7fc4ee600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc4e806ec40 con 0x7fc4e8142d30 2024-05-28T06:06:58.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.110+0000 7fc4e7e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc4e80ce560 0x7fc4e80ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:58.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.110+0000 7fc4dea00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fc4e806f610 0x7fc4e8145b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:53986/0 (socket says 172.21.15.122:53986) 2024-05-28T06:06:58.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.110+0000 7fc4dea00640 1 -- 172.21.15.122:0/1100157103 learned_addr learned my addr 172.21.15.122:0/1100157103 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:58.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.110+0000 7fc4e7400640 1 --2- 172.21.15.122:0/1100157103 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e8142d30 0x7fc4e806f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:58.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.110+0000 7fc4e7e00640 1 -- 172.21.15.122:0/1100157103 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e8142d30 msgr2=0x7fc4e806f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:58.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.110+0000 7fc4e7e00640 1 --2- 172.21.15.122:0/1100157103 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e8142d30 0x7fc4e806f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.110+0000 7fc4e7e00640 1 -- 172.21.15.122:0/1100157103 >> v1:172.21.15.122:6789/0 conn(0x7fc4e806f610 legacy=0x7fc4e8145b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:58.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.110+0000 7fc4e6a00640 1 -- 172.21.15.122:0/1100157103 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2755519112 0 0) 0x7fc4e806e030 con 0x7fc4e806f610 2024-05-28T06:06:58.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.110+0000 7fc4e7e00640 1 -- 172.21.15.122:0/1100157103 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e806e310 con 0x7fc4e80ce560 2024-05-28T06:06:58.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.114+0000 7fc4e7e00640 1 --2- 172.21.15.122:0/1100157103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4e80ce560 0x7fc4e80ce9b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0009d90 tx=0x7fc4e001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17b4aa1c4d7f09b server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:58.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.114+0000 7fc4e6a00640 1 -- 172.21.15.122:0/1100157103 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e00b2070 con 0x7fc4e80ce560 2024-05-28T06:06:58.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.114+0000 7fc4e6a00640 1 -- 172.21.15.122:0/1100157103 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e00a5970 con 0x7fc4e80ce560 2024-05-28T06:06:58.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.114+0000 7fc4e6a00640 1 -- 172.21.15.122:0/1100157103 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e00a5d40 con 0x7fc4e80ce560 2024-05-28T06:06:58.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.114+0000 7fc4ee600640 1 -- 172.21.15.122:0/1100157103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4e80ce560 msgr2=0x7fc4e80ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:58.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.114+0000 7fc4ee600640 1 --2- 172.21.15.122:0/1100157103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4e80ce560 0x7fc4e80ce9b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0009d90 tx=0x7fc4e001c8b0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.114+0000 7fc4ee600640 1 -- 172.21.15.122:0/1100157103 shutdown_connections 2024-05-28T06:06:58.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.114+0000 7fc4ee600640 1 --2- 172.21.15.122:0/1100157103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4e80ce560 0x7fc4e80ce9b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.114+0000 7fc4ee600640 1 --2- 172.21.15.122:0/1100157103 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e8142d30 0x7fc4e806f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.114+0000 7fc4ee600640 1 -- 172.21.15.122:0/1100157103 >> 172.21.15.122:0/1100157103 conn(0x7fc4e8062a40 msgr2=0x7fc4e806b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:58.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.114+0000 7fc4ee600640 1 -- 172.21.15.122:0/1100157103 shutdown_connections 2024-05-28T06:06:58.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.114+0000 7fc4ee600640 1 -- 172.21.15.122:0/1100157103 wait complete. 2024-05-28T06:06:58.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.114+0000 7fc4ee600640 1 Processor -- start 2024-05-28T06:06:58.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.114+0000 7fc4ee600640 1 -- start start 2024-05-28T06:06:58.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4ee600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e80ce560 0x7fc4e815a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:58.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4ee600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4e8142d30 0x7fc4e80b5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:58.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4ee600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e815b880 0x7fc4e815bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:58.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4ee600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e8146290 con 0x7fc4e8142d30 2024-05-28T06:06:58.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4ee600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e8143110 con 0x7fc4e80ce560 2024-05-28T06:06:58.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4ee600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc4e80b4140 con 0x7fc4e815b880 2024-05-28T06:06:58.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4dea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4e8142d30 0x7fc4e80b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:58.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4dea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4e8142d30 0x7fc4e80b5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57844/0 (socket says 172.21.15.122:57844) 2024-05-28T06:06:58.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4dea00640 1 -- 172.21.15.122:0/1072545135 learned_addr learned my addr 172.21.15.122:0/1072545135 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:58.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4e7400640 1 --2- 172.21.15.122:0/1072545135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e80ce560 0x7fc4e815a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:58.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4e7e00640 1 --2- 172.21.15.122:0/1072545135 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e815b880 0x7fc4e815bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:58.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4dea00640 1 -- 172.21.15.122:0/1072545135 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e815b880 msgr2=0x7fc4e815bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:58.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4dea00640 1 --2- 172.21.15.122:0/1072545135 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e815b880 0x7fc4e815bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4dea00640 1 -- 172.21.15.122:0/1072545135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e80ce560 msgr2=0x7fc4e815a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:58.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4dea00640 1 --2- 172.21.15.122:0/1072545135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e80ce560 0x7fc4e815a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4dea00640 1 -- 172.21.15.122:0/1072545135 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e80b4420 con 0x7fc4e8142d30 2024-05-28T06:06:58.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4dea00640 1 --2- 172.21.15.122:0/1072545135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4e8142d30 0x7fc4e80b5190 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000c480 tx=0x7fc4d000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:58.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4dfe00640 1 -- 172.21.15.122:0/1072545135 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0018070 con 0x7fc4e8142d30 2024-05-28T06:06:58.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4dfe00640 1 -- 172.21.15.122:0/1072545135 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d0007500 con 0x7fc4e8142d30 2024-05-28T06:06:58.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4ee600640 1 -- 172.21.15.122:0/1072545135 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e80b4700 con 0x7fc4e8142d30 2024-05-28T06:06:58.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4dfe00640 1 -- 172.21.15.122:0/1072545135 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0004a30 con 0x7fc4e8142d30 2024-05-28T06:06:58.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4ee600640 1 -- 172.21.15.122:0/1072545135 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e80b4cc0 con 0x7fc4e8142d30 2024-05-28T06:06:58.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4ee600640 1 -- 172.21.15.122:0/1072545135 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4e80b4ec0 con 0x7fc4e8142d30 2024-05-28T06:06:58.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.118+0000 7fc4dfe00640 1 -- 172.21.15.122:0/1072545135 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc4d001b070 con 0x7fc4e8142d30 2024-05-28T06:06:58.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.122+0000 7fc4dfe00640 1 --2- 172.21.15.122:0/1072545135 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc4c4068380 0x7fc4c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:58.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.122+0000 7fc4dfe00640 1 -- 172.21.15.122:0/1072545135 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc4d0085c80 con 0x7fc4e8142d30 2024-05-28T06:06:58.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.122+0000 7fc4e7400640 1 --2- 172.21.15.122:0/1072545135 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc4c4068380 0x7fc4c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:58.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.122+0000 7fc4e7400640 1 --2- 172.21.15.122:0/1072545135 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc4c4068380 0x7fc4c406a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8007a60 tx=0x7fc4d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:58.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.126+0000 7fc4dfe00640 1 -- 172.21.15.122:0/1072545135 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc4e80b4ec0 con 0x7fc4e8142d30 2024-05-28T06:06:58.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.306+0000 7fc4ee600640 1 -- 172.21.15.122:0/1072545135 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fc4e80cdd70 con 0x7fc4c4068380 2024-05-28T06:06:58.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.306+0000 7fc4dfe00640 1 -- 172.21.15.122:0/1072545135 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fc4e80cdd70 con 0x7fc4c4068380 2024-05-28T06:06:58.310 INFO:teuthology.orchestra.run.smithi122.stdout:[ 2024-05-28T06:06:58.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:06:58.311 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "cephfs" 2024-05-28T06:06:58.311 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:06:58.311 INFO:teuthology.orchestra.run.smithi122.stdout:] 2024-05-28T06:06:58.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.310+0000 7fc4ee600640 1 -- 172.21.15.122:0/1072545135 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc4c4068380 msgr2=0x7fc4c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:58.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.310+0000 7fc4ee600640 1 --2- 172.21.15.122:0/1072545135 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc4c4068380 0x7fc4c406a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8007a60 tx=0x7fc4d8008040 comp rx=0 tx=0).stop 2024-05-28T06:06:58.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.310+0000 7fc4ee600640 1 -- 172.21.15.122:0/1072545135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4e8142d30 msgr2=0x7fc4e80b5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:58.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.310+0000 7fc4ee600640 1 --2- 172.21.15.122:0/1072545135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4e8142d30 0x7fc4e80b5190 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000c480 tx=0x7fc4d000c940 comp rx=0 tx=0).stop 2024-05-28T06:06:58.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.310+0000 7fc4ee600640 1 -- 172.21.15.122:0/1072545135 shutdown_connections 2024-05-28T06:06:58.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.310+0000 7fc4ee600640 1 --2- 172.21.15.122:0/1072545135 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc4c4068380 0x7fc4c406a840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.310+0000 7fc4ee600640 1 --2- 172.21.15.122:0/1072545135 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4e815b880 0x7fc4e815bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.310+0000 7fc4ee600640 1 --2- 172.21.15.122:0/1072545135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4e8142d30 0x7fc4e80b5190 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.310+0000 7fc4ee600640 1 --2- 172.21.15.122:0/1072545135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e80ce560 0x7fc4e815a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.310+0000 7fc4ee600640 1 -- 172.21.15.122:0/1072545135 >> 172.21.15.122:0/1072545135 conn(0x7fc4e8062a40 msgr2=0x7fc4e80b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:58.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.310+0000 7fc4ee600640 1 -- 172.21.15.122:0/1072545135 shutdown_connections 2024-05-28T06:06:58.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.310+0000 7fc4ee600640 1 -- 172.21.15.122:0/1072545135 wait complete. 2024-05-28T06:06:58.331 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-28T06:06:58.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.466+0000 7efe20800640 1 Processor -- start 2024-05-28T06:06:58.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.466+0000 7efe20800640 1 -- start start 2024-05-28T06:06:58.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.466+0000 7efe20800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efe180b58d0 0x7efe180b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:58.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.466+0000 7efe20800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe180ce4f0 0x7efe180ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:58.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.466+0000 7efe20800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe180b61f0 con 0x7efe180722a0 2024-05-28T06:06:58.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.466+0000 7efe20800640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7efe1815d970 con 0x7efe180b58d0 2024-05-28T06:06:58.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.466+0000 7efe20800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efe1815dc50 con 0x7efe180ce4f0 2024-05-28T06:06:58.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.470+0000 7efe1de00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efe180b58d0 0x7efe180b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:58.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.470+0000 7efe1de00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efe180b58d0 0x7efe180b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57858/0 (socket says 172.21.15.122:57858) 2024-05-28T06:06:58.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.470+0000 7efe1de00640 1 -- 172.21.15.122:0/3133555853 learned_addr learned my addr 172.21.15.122:0/3133555853 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:58.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.470+0000 7efe1d400640 1 --2- 172.21.15.122:0/3133555853 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe180ce4f0 0x7efe180ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:58.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.470+0000 7efe1de00640 1 -- 172.21.15.122:0/3133555853 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe180ce4f0 msgr2=0x7efe180ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:58.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.470+0000 7efe1de00640 1 --2- 172.21.15.122:0/3133555853 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe180ce4f0 0x7efe180ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.470+0000 7efe1de00640 1 -- 172.21.15.122:0/3133555853 >> v1:172.21.15.153:6789/0 conn(0x7efe180722a0 legacy=0x7efe18072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:58.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.470+0000 7efe1de00640 1 -- 172.21.15.122:0/3133555853 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1815df30 con 0x7efe180b58d0 2024-05-28T06:06:58.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.470+0000 7efe1de00640 1 --2- 172.21.15.122:0/3133555853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe180b58d0 0x7efe180b5cb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009870 tx=0x7efe0c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc932fc8740b423 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:58.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.470+0000 7efe1ca00640 1 -- 172.21.15.122:0/3133555853 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c0aa430 con 0x7efe180b58d0 2024-05-28T06:06:58.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.470+0000 7efe1ca00640 1 -- 172.21.15.122:0/3133555853 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe0c0af070 con 0x7efe180b58d0 2024-05-28T06:06:58.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.470+0000 7efe1ca00640 1 -- 172.21.15.122:0/3133555853 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c0aa7f0 con 0x7efe180b58d0 2024-05-28T06:06:58.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.474+0000 7efe20800640 1 -- 172.21.15.122:0/3133555853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe180b58d0 msgr2=0x7efe180b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:58.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.474+0000 7efe20800640 1 --2- 172.21.15.122:0/3133555853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe180b58d0 0x7efe180b5cb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009870 tx=0x7efe0c01c530 comp rx=0 tx=0).stop 2024-05-28T06:06:58.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.474+0000 7efe20800640 1 -- 172.21.15.122:0/3133555853 shutdown_connections 2024-05-28T06:06:58.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.474+0000 7efe20800640 1 --2- 172.21.15.122:0/3133555853 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe180ce4f0 0x7efe180ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.474+0000 7efe20800640 1 --2- 172.21.15.122:0/3133555853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe180b58d0 0x7efe180b5cb0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.474+0000 7efe20800640 1 -- 172.21.15.122:0/3133555853 >> 172.21.15.122:0/3133555853 conn(0x7efe1806bd90 msgr2=0x7efe1806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:58.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.474+0000 7efe20800640 1 -- 172.21.15.122:0/3133555853 shutdown_connections 2024-05-28T06:06:58.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.474+0000 7efe20800640 1 -- 172.21.15.122:0/3133555853 wait complete. 2024-05-28T06:06:58.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.474+0000 7efe20800640 1 Processor -- start 2024-05-28T06:06:58.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.474+0000 7efe20800640 1 -- start start 2024-05-28T06:06:58.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.474+0000 7efe20800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe180722a0 0x7efe18159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:58.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.474+0000 7efe20800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe180b58d0 0x7efe180b1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:58.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.474+0000 7efe20800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe180ce4f0 0x7efe1813b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:58.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.474+0000 7efe20800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efe180cf010 con 0x7efe180ce4f0 2024-05-28T06:06:58.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.474+0000 7efe20800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efe180cee90 con 0x7efe180b58d0 2024-05-28T06:06:58.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.474+0000 7efe20800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efe18169a60 con 0x7efe180722a0 2024-05-28T06:06:58.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.474+0000 7efe1e800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe180ce4f0 0x7efe1813b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:58.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.474+0000 7efe1de00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe180722a0 0x7efe18159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:58.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.474+0000 7efe1d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe180b58d0 0x7efe180b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:58.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.474+0000 7efe1de00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe180722a0 0x7efe18159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:58152/0 (socket says 172.21.15.122:58152) 2024-05-28T06:06:58.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.474+0000 7efe1de00640 1 -- 172.21.15.122:0/3458605390 learned_addr learned my addr 172.21.15.122:0/3458605390 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:58.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.474+0000 7efe1e800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe180ce4f0 0x7efe1813b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57874/0 (socket says 172.21.15.122:57874) 2024-05-28T06:06:58.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.478+0000 7efe1e800640 1 -- 172.21.15.122:0/3458605390 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe180722a0 msgr2=0x7efe18159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:58.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.478+0000 7efe1e800640 1 --2- 172.21.15.122:0/3458605390 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe180722a0 0x7efe18159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.478+0000 7efe1e800640 1 -- 172.21.15.122:0/3458605390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe180b58d0 msgr2=0x7efe180b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:58.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.478+0000 7efe1e800640 1 --2- 172.21.15.122:0/3458605390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe180b58d0 0x7efe180b1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.478+0000 7efe1e800640 1 -- 172.21.15.122:0/3458605390 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1813adb0 con 0x7efe180ce4f0 2024-05-28T06:06:58.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.478+0000 7efe1de00640 1 --2- 172.21.15.122:0/3458605390 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe180722a0 0x7efe18159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:06:58.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.478+0000 7efe1e800640 1 --2- 172.21.15.122:0/3458605390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe180ce4f0 0x7efe1813b850 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efe14001e60 tx=0x7efe14010420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:58.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.478+0000 7efe12000640 1 -- 172.21.15.122:0/3458605390 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1400e0d0 con 0x7efe180ce4f0 2024-05-28T06:06:58.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.478+0000 7efe12000640 1 -- 172.21.15.122:0/3458605390 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe1400e270 con 0x7efe180ce4f0 2024-05-28T06:06:58.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.478+0000 7efe20800640 1 -- 172.21.15.122:0/3458605390 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe1815a7c0 con 0x7efe180ce4f0 2024-05-28T06:06:58.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.478+0000 7efe12000640 1 -- 172.21.15.122:0/3458605390 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe14010d70 con 0x7efe180ce4f0 2024-05-28T06:06:58.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.478+0000 7efe20800640 1 -- 172.21.15.122:0/3458605390 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe1813b050 con 0x7efe180ce4f0 2024-05-28T06:06:58.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.478+0000 7efe20800640 1 -- 172.21.15.122:0/3458605390 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe18068c40 con 0x7efe180ce4f0 2024-05-28T06:06:58.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.478+0000 7efe12000640 1 -- 172.21.15.122:0/3458605390 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efe14003980 con 0x7efe180ce4f0 2024-05-28T06:06:58.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.478+0000 7efe12000640 1 --2- 172.21.15.122:0/3458605390 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdfc068380 0x7efdfc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:58.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.478+0000 7efe12000640 1 -- 172.21.15.122:0/3458605390 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7efe1408a740 con 0x7efe180ce4f0 2024-05-28T06:06:58.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.478+0000 7efe1de00640 1 --2- 172.21.15.122:0/3458605390 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdfc068380 0x7efdfc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:58.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.482+0000 7efe1de00640 1 --2- 172.21.15.122:0/3458605390 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdfc068380 0x7efdfc06a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efe0c01c570 tx=0x7efe0c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:58.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.482+0000 7efe12000640 1 -- 172.21.15.122:0/3458605390 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efe1405a6a0 con 0x7efe180ce4f0 2024-05-28T06:06:58.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.642+0000 7efe20800640 1 -- 172.21.15.122:0/3458605390 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7efe180af720 con 0x7efe180ce4f0 2024-05-28T06:06:58.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.642+0000 7efe12000640 1 -- 172.21.15.122:0/3458605390 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7efe1405e9a0 con 0x7efe180ce4f0 2024-05-28T06:06:58.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.642+0000 7efe20800640 1 -- 172.21.15.122:0/3458605390 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdfc068380 msgr2=0x7efdfc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:58.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.642+0000 7efe20800640 1 --2- 172.21.15.122:0/3458605390 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdfc068380 0x7efdfc06a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efe0c01c570 tx=0x7efe0c0a7000 comp rx=0 tx=0).stop 2024-05-28T06:06:58.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.642+0000 7efe20800640 1 -- 172.21.15.122:0/3458605390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe180ce4f0 msgr2=0x7efe1813b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:58.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.642+0000 7efe20800640 1 --2- 172.21.15.122:0/3458605390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe180ce4f0 0x7efe1813b850 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efe14001e60 tx=0x7efe14010420 comp rx=0 tx=0).stop 2024-05-28T06:06:58.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.642+0000 7efe20800640 1 -- 172.21.15.122:0/3458605390 shutdown_connections 2024-05-28T06:06:58.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.642+0000 7efe20800640 1 --2- 172.21.15.122:0/3458605390 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdfc068380 0x7efdfc06a840 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.642+0000 7efe20800640 1 --2- 172.21.15.122:0/3458605390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe180ce4f0 0x7efe1813b850 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.642+0000 7efe20800640 1 --2- 172.21.15.122:0/3458605390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe180b58d0 0x7efe180b1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.642+0000 7efe20800640 1 --2- 172.21.15.122:0/3458605390 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe180722a0 0x7efe18159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.646+0000 7efe20800640 1 -- 172.21.15.122:0/3458605390 >> 172.21.15.122:0/3458605390 conn(0x7efe1806bd90 msgr2=0x7efe1813c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:58.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.646+0000 7efe20800640 1 -- 172.21.15.122:0/3458605390 shutdown_connections 2024-05-28T06:06:58.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.646+0000 7efe20800640 1 -- 172.21.15.122:0/3458605390 wait complete. 2024-05-28T06:06:58.666 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-28T06:06:58.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.802+0000 7fb6c7a00640 1 Processor -- start 2024-05-28T06:06:58.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.802+0000 7fb6c7a00640 1 -- start start 2024-05-28T06:06:58.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.802+0000 7fb6c7a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6c006f890 0x7fb6c00cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:58.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.802+0000 7fb6c7a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb6c00cd930 0x7fb6c00b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:58.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.802+0000 7fb6c7a00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6c00d0310 con 0x7fb6c00cff30 2024-05-28T06:06:58.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.802+0000 7fb6c7a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb6c015be20 con 0x7fb6c00cd930 2024-05-28T06:06:58.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.802+0000 7fb6c7a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c015c100 con 0x7fb6c006f890 2024-05-28T06:06:58.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.802+0000 7fb6c5000640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fb6c00cff30 0x7fb6c006f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:53996/0 (socket says 172.21.15.122:53996) 2024-05-28T06:06:58.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.802+0000 7fb6c5000640 1 -- 172.21.15.122:0/2538984385 learned_addr learned my addr 172.21.15.122:0/2538984385 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:06:58.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.802+0000 7fb6bfe00640 1 --2- 172.21.15.122:0/2538984385 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6c006f890 0x7fb6c00cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:58.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.802+0000 7fb6c5a00640 1 --2- 172.21.15.122:0/2538984385 >> v2:172.21.15.153:3300/0 conn(0x7fb6c00cd930 0x7fb6c00b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:58.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.806+0000 7fb6bf400640 1 -- 172.21.15.122:0/2538984385 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2858771307 0 0) 0x7fb6c00d0310 con 0x7fb6c00cff30 2024-05-28T06:06:58.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.806+0000 7fb6bf400640 1 -- 172.21.15.122:0/2538984385 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6a4005740 con 0x7fb6c00cff30 2024-05-28T06:06:58.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.806+0000 7fb6bfe00640 1 -- 172.21.15.122:0/2538984385 >> v2:172.21.15.153:3300/0 conn(0x7fb6c00cd930 msgr2=0x7fb6c00b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:58.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.806+0000 7fb6bfe00640 1 --2- 172.21.15.122:0/2538984385 >> v2:172.21.15.153:3300/0 conn(0x7fb6c00cd930 0x7fb6c00b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.806+0000 7fb6bfe00640 1 -- 172.21.15.122:0/2538984385 >> v1:172.21.15.122:6789/0 conn(0x7fb6c00cff30 legacy=0x7fb6c006f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:58.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.806+0000 7fb6bfe00640 1 -- 172.21.15.122:0/2538984385 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c015c3e0 con 0x7fb6c006f890 2024-05-28T06:06:58.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.806+0000 7fb6bfe00640 1 --2- 172.21.15.122:0/2538984385 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6c006f890 0x7fb6c00cd3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00097c0 tx=0x7fb6b001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc4e713c32a1d166 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:58.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.806+0000 7fb6bf400640 1 -- 172.21.15.122:0/2538984385 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b00ab610 con 0x7fb6c006f890 2024-05-28T06:06:58.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.806+0000 7fb6bf400640 1 -- 172.21.15.122:0/2538984385 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6b00b0070 con 0x7fb6c006f890 2024-05-28T06:06:58.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.806+0000 7fb6bf400640 1 -- 172.21.15.122:0/2538984385 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b00ab9d0 con 0x7fb6c006f890 2024-05-28T06:06:58.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.806+0000 7fb6c7a00640 1 -- 172.21.15.122:0/2538984385 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6c006f890 msgr2=0x7fb6c00cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:58.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.806+0000 7fb6c7a00640 1 --2- 172.21.15.122:0/2538984385 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6c006f890 0x7fb6c00cd3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00097c0 tx=0x7fb6b001c470 comp rx=0 tx=0).stop 2024-05-28T06:06:58.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.806+0000 7fb6c7a00640 1 -- 172.21.15.122:0/2538984385 shutdown_connections 2024-05-28T06:06:58.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.806+0000 7fb6c7a00640 1 --2- 172.21.15.122:0/2538984385 >> v2:172.21.15.153:3300/0 conn(0x7fb6c00cd930 0x7fb6c00b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.806+0000 7fb6c7a00640 1 --2- 172.21.15.122:0/2538984385 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6c006f890 0x7fb6c00cd3f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.810+0000 7fb6c7a00640 1 -- 172.21.15.122:0/2538984385 >> 172.21.15.122:0/2538984385 conn(0x7fb6c006bd90 msgr2=0x7fb6c006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:58.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.810+0000 7fb6c7a00640 1 -- 172.21.15.122:0/2538984385 shutdown_connections 2024-05-28T06:06:58.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.810+0000 7fb6c7a00640 1 -- 172.21.15.122:0/2538984385 wait complete. 2024-05-28T06:06:58.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.810+0000 7fb6c7a00640 1 Processor -- start 2024-05-28T06:06:58.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.810+0000 7fb6c7a00640 1 -- start start 2024-05-28T06:06:58.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.810+0000 7fb6c7a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6c006f890 0x7fb6c01532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:58.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.810+0000 7fb6c7a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6c00cd930 0x7fb6c0156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:58.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.810+0000 7fb6c7a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6c00cff30 0x7fb6c00b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:58.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.810+0000 7fb6c7a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c00b5880 con 0x7fb6c00cff30 2024-05-28T06:06:58.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.810+0000 7fb6c7a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c00b5700 con 0x7fb6c006f890 2024-05-28T06:06:58.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.810+0000 7fb6c7a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c00b5a00 con 0x7fb6c00cd930 2024-05-28T06:06:58.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.810+0000 7fb6c5a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6c00cff30 0x7fb6c00b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:58.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.810+0000 7fb6c5000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6c006f890 0x7fb6c01532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:58.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.810+0000 7fb6c5a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6c00cff30 0x7fb6c00b2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57888/0 (socket says 172.21.15.122:57888) 2024-05-28T06:06:58.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.810+0000 7fb6c5a00640 1 -- 172.21.15.122:0/3790035146 learned_addr learned my addr 172.21.15.122:0/3790035146 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:58.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.810+0000 7fb6bfe00640 1 --2- 172.21.15.122:0/3790035146 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6c00cd930 0x7fb6c0156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:58.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.810+0000 7fb6c5a00640 1 -- 172.21.15.122:0/3790035146 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6c00cd930 msgr2=0x7fb6c0156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:58.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.810+0000 7fb6c5a00640 1 --2- 172.21.15.122:0/3790035146 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6c00cd930 0x7fb6c0156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.810+0000 7fb6c5a00640 1 -- 172.21.15.122:0/3790035146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6c006f890 msgr2=0x7fb6c01532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:58.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.810+0000 7fb6c5a00640 1 --2- 172.21.15.122:0/3790035146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6c006f890 0x7fb6c01532f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:58.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.810+0000 7fb6c5a00640 1 -- 172.21.15.122:0/3790035146 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c0153920 con 0x7fb6c00cff30 2024-05-28T06:06:58.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.810+0000 7fb6c5000640 1 --2- 172.21.15.122:0/3790035146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6c006f890 0x7fb6c01532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:06:58.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.810+0000 7fb6c5a00640 1 --2- 172.21.15.122:0/3790035146 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6c00cff30 0x7fb6c00b2960 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800efc0 tx=0x7fb6b800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:58.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.814+0000 7fb6bcc00640 1 -- 172.21.15.122:0/3790035146 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8018020 con 0x7fb6c00cff30 2024-05-28T06:06:58.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.814+0000 7fb6bcc00640 1 -- 172.21.15.122:0/3790035146 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6b8014480 con 0x7fb6c00cff30 2024-05-28T06:06:58.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.814+0000 7fb6bcc00640 1 -- 172.21.15.122:0/3790035146 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8014870 con 0x7fb6c00cff30 2024-05-28T06:06:58.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.814+0000 7fb6c7a00640 1 -- 172.21.15.122:0/3790035146 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c0153c00 con 0x7fb6c00cff30 2024-05-28T06:06:58.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.814+0000 7fb6c7a00640 1 -- 172.21.15.122:0/3790035146 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c01541c0 con 0x7fb6c00cff30 2024-05-28T06:06:58.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.814+0000 7fb6c7a00640 1 -- 172.21.15.122:0/3790035146 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c0154600 con 0x7fb6c00cff30 2024-05-28T06:06:58.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.814+0000 7fb6bcc00640 1 -- 172.21.15.122:0/3790035146 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb6b801b020 con 0x7fb6c00cff30 2024-05-28T06:06:58.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.814+0000 7fb6bcc00640 1 --2- 172.21.15.122:0/3790035146 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb69c068380 0x7fb69c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:58.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.814+0000 7fb6bcc00640 1 -- 172.21.15.122:0/3790035146 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb6b8087390 con 0x7fb6c00cff30 2024-05-28T06:06:58.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.814+0000 7fb6c5000640 1 --2- 172.21.15.122:0/3790035146 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb69c068380 0x7fb69c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:58.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.814+0000 7fb6c5000640 1 --2- 172.21.15.122:0/3790035146 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb69c068380 0x7fb69c06a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8007fd0 tx=0x7fb6a8000bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:58.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:58.818+0000 7fb6bcc00640 1 -- 172.21.15.122:0/3790035146 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb6b8022070 con 0x7fb6c00cff30 2024-05-28T06:06:59.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.002+0000 7fb6c7a00640 1 -- 172.21.15.122:0/3790035146 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7fb6c0076020 con 0x7fb69c068380 2024-05-28T06:06:59.009 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:06:59.006+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:06:59.009 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:06:59.006+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:06:59.009 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:06:59.006+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:06:59.009 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:06:59.006+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:06:59.009 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:06:59.006+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:06:59.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.142+0000 7fb6bcc00640 1 -- 172.21.15.122:0/3790035146 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb6a8001820 con 0x7fb69c068380 2024-05-28T06:06:59.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.142+0000 7fb6c7a00640 1 -- 172.21.15.122:0/3790035146 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb69c068380 msgr2=0x7fb69c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:59.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.142+0000 7fb6c7a00640 1 --2- 172.21.15.122:0/3790035146 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb69c068380 0x7fb69c06a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8007fd0 tx=0x7fb6a8000bd0 comp rx=0 tx=0).stop 2024-05-28T06:06:59.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.142+0000 7fb6c7a00640 1 -- 172.21.15.122:0/3790035146 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6c00cff30 msgr2=0x7fb6c00b2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:59.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.142+0000 7fb6c7a00640 1 --2- 172.21.15.122:0/3790035146 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6c00cff30 0x7fb6c00b2960 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800efc0 tx=0x7fb6b800c490 comp rx=0 tx=0).stop 2024-05-28T06:06:59.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.142+0000 7fb6c7a00640 1 -- 172.21.15.122:0/3790035146 shutdown_connections 2024-05-28T06:06:59.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.142+0000 7fb6c7a00640 1 --2- 172.21.15.122:0/3790035146 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb69c068380 0x7fb69c06a840 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:59.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.142+0000 7fb6c7a00640 1 --2- 172.21.15.122:0/3790035146 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6c00cff30 0x7fb6c00b2960 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:59.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.142+0000 7fb6c7a00640 1 --2- 172.21.15.122:0/3790035146 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6c00cd930 0x7fb6c0156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:59.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.142+0000 7fb6c7a00640 1 --2- 172.21.15.122:0/3790035146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6c006f890 0x7fb6c01532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:59.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.142+0000 7fb6c7a00640 1 -- 172.21.15.122:0/3790035146 >> 172.21.15.122:0/3790035146 conn(0x7fb6c006bd90 msgr2=0x7fb6c01551e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:59.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.142+0000 7fb6c7a00640 1 -- 172.21.15.122:0/3790035146 shutdown_connections 2024-05-28T06:06:59.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.142+0000 7fb6c7a00640 1 -- 172.21.15.122:0/3790035146 wait complete. 2024-05-28T06:06:59.165 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-28T06:06:59.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.302+0000 7f1a29e00640 1 Processor -- start 2024-05-28T06:06:59.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.302+0000 7f1a29e00640 1 -- start start 2024-05-28T06:06:59.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.302+0000 7f1a29e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1a2415e7a0 0x7f1a2406cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:59.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.302+0000 7f1a29e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a240b42d0 0x7f1a240add80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:59.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.302+0000 7f1a29e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a2406be00 con 0x7f1a24162e90 2024-05-28T06:06:59.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.302+0000 7f1a29e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1a2406c0e0 con 0x7f1a2415e7a0 2024-05-28T06:06:59.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.302+0000 7f1a29e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1a2406c3c0 con 0x7f1a240b42d0 2024-05-28T06:06:59.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.302+0000 7f1a22a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1a2415e7a0 0x7f1a2406cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:59.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.302+0000 7f1a23400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a240b42d0 0x7f1a240add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:59.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.302+0000 7f1a22a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1a2415e7a0 0x7f1a2406cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:46966/0 (socket says 172.21.15.122:46966) 2024-05-28T06:06:59.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.302+0000 7f1a22a00640 1 -- 172.21.15.122:0/3727395288 learned_addr learned my addr 172.21.15.122:0/3727395288 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:59.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.302+0000 7f1a23400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a240b42d0 0x7f1a240add80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:58216/0 (socket says 172.21.15.122:58216) 2024-05-28T06:06:59.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.302+0000 7f1a22000640 1 --1- 172.21.15.122:0/3727395288 >> v1:172.21.15.153:6789/0 conn(0x7f1a24162e90 0x7f1a240b3bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:35660/0 (socket says 172.21.15.122:35660) 2024-05-28T06:06:59.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.302+0000 7f1a23400640 1 -- 172.21.15.122:0/3727395288 >> v2:172.21.15.153:3300/0 conn(0x7f1a2415e7a0 msgr2=0x7f1a2406cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:06:59.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.302+0000 7f1a23400640 1 --2- 172.21.15.122:0/3727395288 >> v2:172.21.15.153:3300/0 conn(0x7f1a2415e7a0 0x7f1a2406cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:59.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.302+0000 7f1a23400640 1 -- 172.21.15.122:0/3727395288 >> v1:172.21.15.153:6789/0 conn(0x7f1a24162e90 legacy=0x7f1a240b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:59.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.302+0000 7f1a23400640 1 -- 172.21.15.122:0/3727395288 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2406c6a0 con 0x7f1a240b42d0 2024-05-28T06:06:59.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.302+0000 7f1a22a00640 1 --2- 172.21.15.122:0/3727395288 >> v2:172.21.15.153:3300/0 conn(0x7f1a2415e7a0 0x7f1a2406cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:06:59.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.306+0000 7f1a23400640 1 --2- 172.21.15.122:0/3727395288 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a240b42d0 0x7f1a240add80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009d90 tx=0x7f1a1c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2ee6bdc9a20be26 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:59.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.306+0000 7f1a21600640 1 -- 172.21.15.122:0/3727395288 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0b2070 con 0x7f1a240b42d0 2024-05-28T06:06:59.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.306+0000 7f1a21600640 1 -- 172.21.15.122:0/3727395288 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1c0a5a20 con 0x7f1a240b42d0 2024-05-28T06:06:59.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.306+0000 7f1a21600640 1 -- 172.21.15.122:0/3727395288 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0a5df0 con 0x7f1a240b42d0 2024-05-28T06:06:59.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.306+0000 7f1a29e00640 1 -- 172.21.15.122:0/3727395288 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a240b42d0 msgr2=0x7f1a240add80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:59.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.306+0000 7f1a29e00640 1 --2- 172.21.15.122:0/3727395288 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a240b42d0 0x7f1a240add80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009d90 tx=0x7f1a1c01c940 comp rx=0 tx=0).stop 2024-05-28T06:06:59.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.306+0000 7f1a29e00640 1 -- 172.21.15.122:0/3727395288 shutdown_connections 2024-05-28T06:06:59.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.306+0000 7f1a29e00640 1 --2- 172.21.15.122:0/3727395288 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a240b42d0 0x7f1a240add80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:59.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.306+0000 7f1a29e00640 1 --2- 172.21.15.122:0/3727395288 >> v2:172.21.15.153:3300/0 conn(0x7f1a2415e7a0 0x7f1a2406cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:59.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.306+0000 7f1a29e00640 1 -- 172.21.15.122:0/3727395288 >> 172.21.15.122:0/3727395288 conn(0x7f1a240b3130 msgr2=0x7f1a240d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:59.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.306+0000 7f1a29e00640 1 -- 172.21.15.122:0/3727395288 shutdown_connections 2024-05-28T06:06:59.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.306+0000 7f1a29e00640 1 -- 172.21.15.122:0/3727395288 wait complete. 2024-05-28T06:06:59.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a29e00640 1 Processor -- start 2024-05-28T06:06:59.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a29e00640 1 -- start start 2024-05-28T06:06:59.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a29e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a240b42d0 0x7f1a240af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:59.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a29e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a2415e7a0 0x7f1a24150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:59.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a29e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a24162e90 0x7f1a24150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:59.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a29e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2415ed00 con 0x7f1a24162e90 2024-05-28T06:06:59.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a29e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2415eb80 con 0x7f1a240b42d0 2024-05-28T06:06:59.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a29e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1a2406b990 con 0x7f1a2415e7a0 2024-05-28T06:06:59.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a23400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a24162e90 0x7f1a24150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:59.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a22a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a240b42d0 0x7f1a240af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:59.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a23400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a24162e90 0x7f1a24150bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57904/0 (socket says 172.21.15.122:57904) 2024-05-28T06:06:59.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a23400640 1 -- 172.21.15.122:0/4206950882 learned_addr learned my addr 172.21.15.122:0/4206950882 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:06:59.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a22000640 1 --2- 172.21.15.122:0/4206950882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a2415e7a0 0x7f1a24150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:59.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a23400640 1 -- 172.21.15.122:0/4206950882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a2415e7a0 msgr2=0x7f1a24150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:59.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a23400640 1 --2- 172.21.15.122:0/4206950882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a2415e7a0 0x7f1a24150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:59.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a23400640 1 -- 172.21.15.122:0/4206950882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a240b42d0 msgr2=0x7f1a240af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:59.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a23400640 1 --2- 172.21.15.122:0/4206950882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a240b42d0 0x7f1a240af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:59.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a23400640 1 -- 172.21.15.122:0/4206950882 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a24161cc0 con 0x7f1a24162e90 2024-05-28T06:06:59.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a22a00640 1 --2- 172.21.15.122:0/4206950882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a240b42d0 0x7f1a240af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:06:59.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a23400640 1 --2- 172.21.15.122:0/4206950882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a24162e90 0x7f1a24150bc0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c01aff0 tx=0x7f1a1c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:59.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a1b400640 1 -- 172.21.15.122:0/4206950882 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0b2050 con 0x7f1a24162e90 2024-05-28T06:06:59.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a1b400640 1 -- 172.21.15.122:0/4206950882 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1c0be070 con 0x7f1a24162e90 2024-05-28T06:06:59.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a29e00640 1 -- 172.21.15.122:0/4206950882 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a2415bad0 con 0x7f1a24162e90 2024-05-28T06:06:59.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a1b400640 1 -- 172.21.15.122:0/4206950882 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0ada50 con 0x7f1a24162e90 2024-05-28T06:06:59.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.310+0000 7f1a29e00640 1 -- 172.21.15.122:0/4206950882 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a2415c090 con 0x7f1a24162e90 2024-05-28T06:06:59.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.314+0000 7f1a29e00640 1 -- 172.21.15.122:0/4206950882 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a24068c40 con 0x7f1a24162e90 2024-05-28T06:06:59.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.314+0000 7f1a1b400640 1 -- 172.21.15.122:0/4206950882 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1a1c0adbf0 con 0x7f1a24162e90 2024-05-28T06:06:59.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.314+0000 7f1a1b400640 1 --2- 172.21.15.122:0/4206950882 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1a04068380 0x7f1a0406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:06:59.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.314+0000 7f1a1b400640 1 -- 172.21.15.122:0/4206950882 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f1a1c121c60 con 0x7f1a24162e90 2024-05-28T06:06:59.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.314+0000 7f1a22a00640 1 --2- 172.21.15.122:0/4206950882 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1a04068380 0x7f1a0406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:06:59.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.314+0000 7f1a22a00640 1 --2- 172.21.15.122:0/4206950882 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1a04068380 0x7f1a0406a840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1a14009630 tx=0x7f1a14009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:06:59.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.318+0000 7f1a1b400640 1 -- 172.21.15.122:0/4206950882 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1a1c016560 con 0x7f1a24162e90 2024-05-28T06:06:59.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.502+0000 7f1a29e00640 1 -- 172.21.15.122:0/4206950882 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f1a240add80 con 0x7f1a04068380 2024-05-28T06:06:59.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.506+0000 7f1a1b400640 1 -- 172.21.15.122:0/4206950882 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f1a240add80 con 0x7f1a04068380 2024-05-28T06:06:59.508 INFO:teuthology.orchestra.run.smithi122.stdout:/volumes/_nogroup/sv1/91f96634-bc4b-43a9-a527-eb450e888062 2024-05-28T06:06:59.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.506+0000 7f1a29e00640 1 -- 172.21.15.122:0/4206950882 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1a04068380 msgr2=0x7f1a0406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:59.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.506+0000 7f1a29e00640 1 --2- 172.21.15.122:0/4206950882 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1a04068380 0x7f1a0406a840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1a14009630 tx=0x7f1a14009240 comp rx=0 tx=0).stop 2024-05-28T06:06:59.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.506+0000 7f1a29e00640 1 -- 172.21.15.122:0/4206950882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a24162e90 msgr2=0x7f1a24150bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:06:59.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.506+0000 7f1a29e00640 1 --2- 172.21.15.122:0/4206950882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a24162e90 0x7f1a24150bc0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c01aff0 tx=0x7f1a1c0196e0 comp rx=0 tx=0).stop 2024-05-28T06:06:59.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.506+0000 7f1a29e00640 1 -- 172.21.15.122:0/4206950882 shutdown_connections 2024-05-28T06:06:59.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.506+0000 7f1a29e00640 1 --2- 172.21.15.122:0/4206950882 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1a04068380 0x7f1a0406a840 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:59.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.506+0000 7f1a29e00640 1 --2- 172.21.15.122:0/4206950882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a24162e90 0x7f1a24150bc0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:59.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.506+0000 7f1a29e00640 1 --2- 172.21.15.122:0/4206950882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a2415e7a0 0x7f1a24150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:59.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.506+0000 7f1a29e00640 1 --2- 172.21.15.122:0/4206950882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a240b42d0 0x7f1a240af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:06:59.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.506+0000 7f1a29e00640 1 -- 172.21.15.122:0/4206950882 >> 172.21.15.122:0/4206950882 conn(0x7f1a240b3130 msgr2=0x7f1a240b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:06:59.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.506+0000 7f1a29e00640 1 -- 172.21.15.122:0/4206950882 shutdown_connections 2024-05-28T06:06:59.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:06:59.506+0000 7f1a29e00640 1 -- 172.21.15.122:0/4206950882 wait complete. 2024-05-28T06:06:59.529 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 10 files each 1024MB size under directory volumes/_nogroup/sv1/91f96634-bc4b-43a9-a527-eb450e888062 2024-05-28T06:06:59.529 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:06:59.529 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:06:59.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:06:59.538 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/91f96634-bc4b-43a9-a527-eb450e888062/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-28T06:07:08.827 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records in 2024-05-28T06:07:08.827 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records out 2024-05-28T06:07:08.827 INFO:teuthology.orchestra.run.smithi122.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 9.22917 s, 116 MB/s 2024-05-28T06:07:08.828 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:07:08.828 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:07:08.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:07:08.837 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/91f96634-bc4b-43a9-a527-eb450e888062/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-28T06:07:17.589 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:07:17.599 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:07:17.928 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records in 2024-05-28T06:07:17.929 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records out 2024-05-28T06:07:17.929 INFO:teuthology.orchestra.run.smithi122.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 9.03601 s, 119 MB/s 2024-05-28T06:07:17.930 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:07:17.930 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:07:17.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:07:17.938 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/91f96634-bc4b-43a9-a527-eb450e888062/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-28T06:07:27.281 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records in 2024-05-28T06:07:27.281 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records out 2024-05-28T06:07:27.282 INFO:teuthology.orchestra.run.smithi122.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 9.28981 s, 116 MB/s 2024-05-28T06:07:27.283 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:07:27.283 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:07:27.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:07:27.292 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/91f96634-bc4b-43a9-a527-eb450e888062/subvolume_file.3 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-28T06:07:36.502 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records in 2024-05-28T06:07:36.502 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records out 2024-05-28T06:07:36.502 INFO:teuthology.orchestra.run.smithi122.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 9.15779 s, 117 MB/s 2024-05-28T06:07:36.503 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:07:36.503 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:07:36.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:07:36.512 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/91f96634-bc4b-43a9-a527-eb450e888062/subvolume_file.4 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-28T06:07:45.416 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records in 2024-05-28T06:07:45.416 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records out 2024-05-28T06:07:45.416 INFO:teuthology.orchestra.run.smithi122.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.85217 s, 121 MB/s 2024-05-28T06:07:45.417 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:07:45.418 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:07:45.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:07:45.426 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/91f96634-bc4b-43a9-a527-eb450e888062/subvolume_file.5 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-28T06:07:47.693 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:07:47.698 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:07:54.661 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records in 2024-05-28T06:07:54.662 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records out 2024-05-28T06:07:54.662 INFO:teuthology.orchestra.run.smithi122.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 9.18471 s, 117 MB/s 2024-05-28T06:07:54.662 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:07:54.662 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:07:54.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:07:54.676 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/91f96634-bc4b-43a9-a527-eb450e888062/subvolume_file.6 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-28T06:08:03.613 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records in 2024-05-28T06:08:03.613 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records out 2024-05-28T06:08:03.613 INFO:teuthology.orchestra.run.smithi122.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.88063 s, 121 MB/s 2024-05-28T06:08:03.614 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:08:03.614 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:08:03.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:08:03.623 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/91f96634-bc4b-43a9-a527-eb450e888062/subvolume_file.7 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-28T06:08:13.161 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records in 2024-05-28T06:08:13.161 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records out 2024-05-28T06:08:13.161 INFO:teuthology.orchestra.run.smithi122.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 9.48537 s, 113 MB/s 2024-05-28T06:08:13.162 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:08:13.162 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:08:13.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:08:13.171 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/91f96634-bc4b-43a9-a527-eb450e888062/subvolume_file.8 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-28T06:08:17.757 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:08:17.761 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:08:22.142 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records in 2024-05-28T06:08:22.142 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records out 2024-05-28T06:08:22.142 INFO:teuthology.orchestra.run.smithi122.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.91811 s, 120 MB/s 2024-05-28T06:08:22.143 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:08:22.143 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:08:22.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:08:22.152 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/91f96634-bc4b-43a9-a527-eb450e888062/subvolume_file.9 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-28T06:08:31.447 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records in 2024-05-28T06:08:31.447 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records out 2024-05-28T06:08:31.447 INFO:teuthology.orchestra.run.smithi122.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 9.24242 s, 116 MB/s 2024-05-28T06:08:31.449 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-28T06:08:31.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.585+0000 7f7160c00640 1 Processor -- start 2024-05-28T06:08:31.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.585+0000 7f7160c00640 1 -- start start 2024-05-28T06:08:31.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7160c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f715c15f740 0x7f715c167240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:31.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7160c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f715c15d970 con 0x7f715c0b58d0 2024-05-28T06:08:31.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7160c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f715c15dc50 con 0x7f715c0ce4f0 2024-05-28T06:08:31.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7160c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f715c15df30 con 0x7f715c15f740 2024-05-28T06:08:31.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f715c0b58d0 0x7f715c0b5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:44608/0 (socket says 172.21.15.122:44608) 2024-05-28T06:08:31.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159e00640 1 -- 172.21.15.122:0/3067950655 learned_addr learned my addr 172.21.15.122:0/3067950655 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:08:31.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f715a800640 1 --2- 172.21.15.122:0/3067950655 >> v2:172.21.15.153:3300/0 conn(0x7f715c15f740 0x7f715c167240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:31.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159400640 1 -- 172.21.15.122:0/3067950655 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3931863500 0 0) 0x7f715c15d970 con 0x7f715c0b58d0 2024-05-28T06:08:31.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159400640 1 -- 172.21.15.122:0/3067950655 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7140003530 con 0x7f715c0b58d0 2024-05-28T06:08:31.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159400640 1 -- 172.21.15.122:0/3067950655 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2446564137 0 0) 0x7f715c15dc50 con 0x7f715c0ce4f0 2024-05-28T06:08:31.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159400640 1 -- 172.21.15.122:0/3067950655 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f715c15d970 con 0x7f715c0ce4f0 2024-05-28T06:08:31.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159400640 1 -- 172.21.15.122:0/3067950655 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1917866742 0 0) 0x7f7140003530 con 0x7f715c0b58d0 2024-05-28T06:08:31.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159400640 1 -- 172.21.15.122:0/3067950655 >> v2:172.21.15.153:3300/0 conn(0x7f715c15f740 msgr2=0x7f715c167240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:08:31.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159400640 1 --2- 172.21.15.122:0/3067950655 >> v2:172.21.15.153:3300/0 conn(0x7f715c15f740 0x7f715c167240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:31.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159400640 1 -- 172.21.15.122:0/3067950655 >> v1:172.21.15.153:6789/0 conn(0x7f715c0ce4f0 legacy=0x7f715c0ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:31.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159400640 1 -- 172.21.15.122:0/3067950655 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715c15e210 con 0x7f715c0b58d0 2024-05-28T06:08:31.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159400640 1 -- 172.21.15.122:0/3067950655 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f714c001680 con 0x7f715c0b58d0 2024-05-28T06:08:31.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159400640 1 -- 172.21.15.122:0/3067950655 >> v1:172.21.15.122:6789/0 conn(0x7f715c0b58d0 legacy=0x7f715c0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:31.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159400640 1 --2- 172.21.15.122:0/3067950655 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7140003b50 0x7f7140003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:31.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159400640 1 --2- 172.21.15.122:0/3067950655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7140004810 0x7f7140004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:31.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159400640 1 --2- 172.21.15.122:0/3067950655 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71400051d0 0x7f714000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:31.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159400640 1 -- 172.21.15.122:0/3067950655 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f715c15df30 con 0x7f7140003b50 2024-05-28T06:08:31.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159400640 1 -- 172.21.15.122:0/3067950655 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f714000c050 con 0x7f7140004810 2024-05-28T06:08:31.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159400640 1 -- 172.21.15.122:0/3067950655 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f714000c250 con 0x7f71400051d0 2024-05-28T06:08:31.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159e00640 1 --2- 172.21.15.122:0/3067950655 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7140003b50 0x7f7140003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:31.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f715a800640 1 --2- 172.21.15.122:0/3067950655 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71400051d0 0x7f714000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:31.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7153e00640 1 --2- 172.21.15.122:0/3067950655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7140004810 0x7f7140004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:31.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159e00640 1 -- 172.21.15.122:0/3067950655 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71400051d0 msgr2=0x7f714000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:08:31.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159e00640 1 --2- 172.21.15.122:0/3067950655 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71400051d0 0x7f714000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:31.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159e00640 1 -- 172.21.15.122:0/3067950655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7140004810 msgr2=0x7f7140004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:08:31.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159e00640 1 --2- 172.21.15.122:0/3067950655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7140004810 0x7f7140004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:31.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f7159e00640 1 -- 172.21.15.122:0/3067950655 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7140003530 con 0x7f7140003b50 2024-05-28T06:08:31.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.589+0000 7f715a800640 1 -- 172.21.15.122:0/3067950655 reap_dead start 2024-05-28T06:08:31.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.593+0000 7f7159e00640 1 --2- 172.21.15.122:0/3067950655 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7140003b50 0x7f7140003f50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f714c00c1c0 tx=0x7f714c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e17884e1d8ea73f server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:31.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.593+0000 7f7159400640 1 -- 172.21.15.122:0/3067950655 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c007cd0 con 0x7f7140003b50 2024-05-28T06:08:31.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.593+0000 7f7159400640 1 -- 172.21.15.122:0/3067950655 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f714c0a9020 con 0x7f7140003b50 2024-05-28T06:08:31.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.593+0000 7f7159400640 1 -- 172.21.15.122:0/3067950655 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c005b00 con 0x7f7140003b50 2024-05-28T06:08:31.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.593+0000 7f7160c00640 1 -- 172.21.15.122:0/3067950655 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7140003b50 msgr2=0x7f7140003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:31.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.593+0000 7f7160c00640 1 --2- 172.21.15.122:0/3067950655 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7140003b50 0x7f7140003f50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f714c00c1c0 tx=0x7f714c01cc20 comp rx=0 tx=0).stop 2024-05-28T06:08:31.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.593+0000 7f7160c00640 1 -- 172.21.15.122:0/3067950655 shutdown_connections 2024-05-28T06:08:31.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.593+0000 7f7160c00640 1 --2- 172.21.15.122:0/3067950655 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7140003b50 0x7f7140003f50 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:31.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.593+0000 7f7160c00640 1 -- 172.21.15.122:0/3067950655 >> 172.21.15.122:0/3067950655 conn(0x7f715c06bd90 msgr2=0x7f715c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:31.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.593+0000 7f7160c00640 1 -- 172.21.15.122:0/3067950655 shutdown_connections 2024-05-28T06:08:31.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.593+0000 7f7160c00640 1 -- 172.21.15.122:0/3067950655 wait complete. 2024-05-28T06:08:31.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7160c00640 1 Processor -- start 2024-05-28T06:08:31.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7160c00640 1 -- start start 2024-05-28T06:08:31.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7160c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7140003b50 0x7f715c0ad420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:31.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7160c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f715c0abe80 0x7f715c0af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:31.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7160c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f715c136c50 0x7f715c1370d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:31.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7160c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f715c072420 con 0x7f7140003b50 2024-05-28T06:08:31.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7160c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f715c0722a0 con 0x7f715c0abe80 2024-05-28T06:08:31.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7160c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f715c0725a0 con 0x7f715c136c50 2024-05-28T06:08:31.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7159e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7140003b50 0x7f715c0ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:31.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7159e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7140003b50 0x7f715c0ad420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:34064/0 (socket says 172.21.15.122:34064) 2024-05-28T06:08:31.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7159e00640 1 -- 172.21.15.122:0/3947246073 learned_addr learned my addr 172.21.15.122:0/3947246073 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:08:31.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7153e00640 1 --2- 172.21.15.122:0/3947246073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f715c0abe80 0x7f715c0af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:31.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f715a800640 1 --2- 172.21.15.122:0/3947246073 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f715c136c50 0x7f715c1370d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:31.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7159e00640 1 -- 172.21.15.122:0/3947246073 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f715c136c50 msgr2=0x7f715c1370d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:31.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7159e00640 1 --2- 172.21.15.122:0/3947246073 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f715c136c50 0x7f715c1370d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:31.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7159e00640 1 -- 172.21.15.122:0/3947246073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f715c0abe80 msgr2=0x7f715c0af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:31.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7159e00640 1 --2- 172.21.15.122:0/3947246073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f715c0abe80 0x7f715c0af640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:31.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7159e00640 1 -- 172.21.15.122:0/3947246073 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715c0adca0 con 0x7f7140003b50 2024-05-28T06:08:31.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7159e00640 1 --2- 172.21.15.122:0/3947246073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7140003b50 0x7f715c0ad420 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f714c01ca50 tx=0x7f7140005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:31.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7152000640 1 -- 172.21.15.122:0/3947246073 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c001c20 con 0x7f7140003b50 2024-05-28T06:08:31.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7152000640 1 -- 172.21.15.122:0/3947246073 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f714c0049f0 con 0x7f7140003b50 2024-05-28T06:08:31.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7152000640 1 -- 172.21.15.122:0/3947246073 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c004dc0 con 0x7f7140003b50 2024-05-28T06:08:31.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7160c00640 1 -- 172.21.15.122:0/3947246073 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f715c0adf80 con 0x7f7140003b50 2024-05-28T06:08:31.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7160c00640 1 -- 172.21.15.122:0/3947246073 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f715c0ae540 con 0x7f7140003b50 2024-05-28T06:08:31.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.597+0000 7f7160c00640 1 -- 172.21.15.122:0/3947246073 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f715c068c40 con 0x7f7140003b50 2024-05-28T06:08:31.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.601+0000 7f7152000640 1 -- 172.21.15.122:0/3947246073 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 7) ==== 87987+0+0 (secure 0 0 0) 0x7f714c0bd060 con 0x7f7140003b50 2024-05-28T06:08:31.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.601+0000 7f7152000640 1 --2- 172.21.15.122:0/3947246073 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7138068380 0x7f713806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:31.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.601+0000 7f7152000640 1 -- 172.21.15.122:0/3947246073 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f714c11f5e0 con 0x7f7140003b50 2024-05-28T06:08:31.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.601+0000 7f7153e00640 1 --2- 172.21.15.122:0/3947246073 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7138068380 0x7f713806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:31.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.601+0000 7f7153e00640 1 --2- 172.21.15.122:0/3947246073 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7138068380 0x7f713806a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f715c0ac9f0 tx=0x7f7144009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:31.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.605+0000 7f7152000640 1 -- 172.21.15.122:0/3947246073 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f714c016930 con 0x7f7140003b50 2024-05-28T06:08:31.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.789+0000 7f7160c00640 1 -- 172.21.15.122:0/3947246073 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f715c0aed40 con 0x7f7138068380 2024-05-28T06:08:31.798 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:08:31.793+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:08:31.799 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:08:31.793+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:08:31.799 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:08:31.793+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:08:31.799 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:08:31.793+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:08:31.799 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:08:31.793+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:08:31.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.817+0000 7f7152000640 1 -- 172.21.15.122:0/3947246073 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7144012890 con 0x7f7138068380 2024-05-28T06:08:31.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.817+0000 7f7160c00640 1 -- 172.21.15.122:0/3947246073 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7138068380 msgr2=0x7f713806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:31.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.817+0000 7f7160c00640 1 --2- 172.21.15.122:0/3947246073 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7138068380 0x7f713806a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f715c0ac9f0 tx=0x7f7144009040 comp rx=0 tx=0).stop 2024-05-28T06:08:31.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.817+0000 7f7160c00640 1 -- 172.21.15.122:0/3947246073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7140003b50 msgr2=0x7f715c0ad420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:31.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.817+0000 7f7160c00640 1 --2- 172.21.15.122:0/3947246073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7140003b50 0x7f715c0ad420 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f714c01ca50 tx=0x7f7140005840 comp rx=0 tx=0).stop 2024-05-28T06:08:31.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.817+0000 7f7160c00640 1 -- 172.21.15.122:0/3947246073 shutdown_connections 2024-05-28T06:08:31.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.817+0000 7f7160c00640 1 --2- 172.21.15.122:0/3947246073 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7138068380 0x7f713806a840 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:31.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.817+0000 7f7160c00640 1 --2- 172.21.15.122:0/3947246073 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f715c136c50 0x7f715c1370d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:31.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.817+0000 7f7160c00640 1 --2- 172.21.15.122:0/3947246073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f715c0abe80 0x7f715c0af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:31.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.817+0000 7f7160c00640 1 --2- 172.21.15.122:0/3947246073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7140003b50 0x7f715c0ad420 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:31.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.817+0000 7f7160c00640 1 -- 172.21.15.122:0/3947246073 >> 172.21.15.122:0/3947246073 conn(0x7f715c06bd90 msgr2=0x7f715c144170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:31.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.817+0000 7f7160c00640 1 -- 172.21.15.122:0/3947246073 shutdown_connections 2024-05-28T06:08:31.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.817+0000 7f7160c00640 1 -- 172.21.15.122:0/3947246073 wait complete. 2024-05-28T06:08:31.840 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-28T06:08:31.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.977+0000 7fd648e00640 1 Processor -- start 2024-05-28T06:08:31.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.977+0000 7fd648e00640 1 -- start start 2024-05-28T06:08:31.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.977+0000 7fd648e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6440cff30 0x7fd64406f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:31.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.977+0000 7fd648e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd64406f6c0 0x7fd6440cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:31.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.977+0000 7fd648e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6440d0310 con 0x7fd6440cd930 2024-05-28T06:08:31.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.977+0000 7fd648e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd64406fb00 con 0x7fd64406f6c0 2024-05-28T06:08:31.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.977+0000 7fd648e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd64415be20 con 0x7fd6440cff30 2024-05-28T06:08:31.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.977+0000 7fd642800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fd6440cd930 0x7fd6440722a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:44612/0 (socket says 172.21.15.122:44612) 2024-05-28T06:08:31.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.977+0000 7fd642800640 1 -- 172.21.15.122:0/2407582930 learned_addr learned my addr 172.21.15.122:0/2407582930 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:08:31.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.977+0000 7fd641e00640 1 --2- 172.21.15.122:0/2407582930 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6440cff30 0x7fd64406f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:31.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.977+0000 7fd641400640 1 --2- 172.21.15.122:0/2407582930 >> v2:172.21.15.153:3300/0 conn(0x7fd64406f6c0 0x7fd6440cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:31.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.977+0000 7fd640a00640 1 -- 172.21.15.122:0/2407582930 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1576017549 0 0) 0x7fd6440d0310 con 0x7fd6440cd930 2024-05-28T06:08:31.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.977+0000 7fd640a00640 1 -- 172.21.15.122:0/2407582930 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd628005740 con 0x7fd6440cd930 2024-05-28T06:08:31.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.977+0000 7fd641e00640 1 -- 172.21.15.122:0/2407582930 >> v2:172.21.15.153:3300/0 conn(0x7fd64406f6c0 msgr2=0x7fd6440cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:08:31.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.977+0000 7fd641e00640 1 --2- 172.21.15.122:0/2407582930 >> v2:172.21.15.153:3300/0 conn(0x7fd64406f6c0 0x7fd6440cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:31.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.977+0000 7fd641e00640 1 -- 172.21.15.122:0/2407582930 >> v1:172.21.15.122:6789/0 conn(0x7fd6440cd930 legacy=0x7fd6440722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:31.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.977+0000 7fd641e00640 1 -- 172.21.15.122:0/2407582930 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd64415c100 con 0x7fd6440cff30 2024-05-28T06:08:31.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.981+0000 7fd641e00640 1 --2- 172.21.15.122:0/2407582930 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6440cff30 0x7fd64406f180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd6340097c0 tx=0x7fd63401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7bec9281e1856d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:31.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.981+0000 7fd640a00640 1 -- 172.21.15.122:0/2407582930 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6340a7070 con 0x7fd6440cff30 2024-05-28T06:08:31.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.981+0000 7fd640a00640 1 -- 172.21.15.122:0/2407582930 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6340b0070 con 0x7fd6440cff30 2024-05-28T06:08:31.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.981+0000 7fd640a00640 1 -- 172.21.15.122:0/2407582930 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6340ab870 con 0x7fd6440cff30 2024-05-28T06:08:31.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.981+0000 7fd648e00640 1 -- 172.21.15.122:0/2407582930 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6440cff30 msgr2=0x7fd64406f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:31.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.981+0000 7fd648e00640 1 --2- 172.21.15.122:0/2407582930 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6440cff30 0x7fd64406f180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd6340097c0 tx=0x7fd63401c470 comp rx=0 tx=0).stop 2024-05-28T06:08:31.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.981+0000 7fd648e00640 1 -- 172.21.15.122:0/2407582930 shutdown_connections 2024-05-28T06:08:31.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.981+0000 7fd648e00640 1 --2- 172.21.15.122:0/2407582930 >> v2:172.21.15.153:3300/0 conn(0x7fd64406f6c0 0x7fd6440cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:31.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.981+0000 7fd648e00640 1 --2- 172.21.15.122:0/2407582930 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6440cff30 0x7fd64406f180 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:31.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.981+0000 7fd648e00640 1 -- 172.21.15.122:0/2407582930 >> 172.21.15.122:0/2407582930 conn(0x7fd64406bd90 msgr2=0x7fd64406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:31.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.981+0000 7fd648e00640 1 -- 172.21.15.122:0/2407582930 shutdown_connections 2024-05-28T06:08:31.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.981+0000 7fd648e00640 1 -- 172.21.15.122:0/2407582930 wait complete. 2024-05-28T06:08:31.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd648e00640 1 Processor -- start 2024-05-28T06:08:31.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd648e00640 1 -- start start 2024-05-28T06:08:31.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd648e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd64406f6c0 0x7fd6440b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:31.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd648e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6440cd930 0x7fd6440b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:31.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd648e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6440cff30 0x7fd644148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:31.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd648e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd6440cdec0 con 0x7fd6440cff30 2024-05-28T06:08:31.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd648e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd6440cdd40 con 0x7fd6440cd930 2024-05-28T06:08:31.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd648e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd6440b59c0 con 0x7fd64406f6c0 2024-05-28T06:08:31.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd642800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6440cff30 0x7fd644148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:31.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd642800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6440cff30 0x7fd644148110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:34094/0 (socket says 172.21.15.122:34094) 2024-05-28T06:08:31.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd642800640 1 -- 172.21.15.122:0/1022098832 learned_addr learned my addr 172.21.15.122:0/1022098832 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:08:31.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd641e00640 1 --2- 172.21.15.122:0/1022098832 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd64406f6c0 0x7fd6440b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:31.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd641400640 1 --2- 172.21.15.122:0/1022098832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6440cd930 0x7fd6440b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:31.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd642800640 1 -- 172.21.15.122:0/1022098832 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd64406f6c0 msgr2=0x7fd6440b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:31.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd642800640 1 --2- 172.21.15.122:0/1022098832 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd64406f6c0 0x7fd6440b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:31.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd642800640 1 -- 172.21.15.122:0/1022098832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6440cd930 msgr2=0x7fd6440b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:31.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd642800640 1 --2- 172.21.15.122:0/1022098832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6440cd930 0x7fd6440b21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:31.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd642800640 1 -- 172.21.15.122:0/1022098832 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6440b1100 con 0x7fd6440cff30 2024-05-28T06:08:31.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd641400640 1 --2- 172.21.15.122:0/1022098832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6440cd930 0x7fd6440b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:08:31.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd642800640 1 --2- 172.21.15.122:0/1022098832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6440cff30 0x7fd644148110 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00cb60 tx=0x7fd63c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:31.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd63a000640 1 -- 172.21.15.122:0/1022098832 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63c017070 con 0x7fd6440cff30 2024-05-28T06:08:31.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd63a000640 1 -- 172.21.15.122:0/1022098832 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd63c00ad40 con 0x7fd6440cff30 2024-05-28T06:08:31.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd648e00640 1 -- 172.21.15.122:0/1022098832 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6440b13e0 con 0x7fd6440cff30 2024-05-28T06:08:31.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd63a000640 1 -- 172.21.15.122:0/1022098832 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63c012600 con 0x7fd6440cff30 2024-05-28T06:08:31.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd648e00640 1 -- 172.21.15.122:0/1022098832 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6440b19a0 con 0x7fd6440cff30 2024-05-28T06:08:31.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.985+0000 7fd648e00640 1 -- 172.21.15.122:0/1022098832 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd644068c40 con 0x7fd6440cff30 2024-05-28T06:08:31.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.989+0000 7fd63a000640 1 -- 172.21.15.122:0/1022098832 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 7) ==== 87987+0+0 (secure 0 0 0) 0x7fd63c01a070 con 0x7fd6440cff30 2024-05-28T06:08:31.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.989+0000 7fd63a000640 1 --2- 172.21.15.122:0/1022098832 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd624068380 0x7fd62406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:31.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.989+0000 7fd63a000640 1 -- 172.21.15.122:0/1022098832 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd63c0866e0 con 0x7fd6440cff30 2024-05-28T06:08:31.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.989+0000 7fd641e00640 1 --2- 172.21.15.122:0/1022098832 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd624068380 0x7fd62406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:31.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.989+0000 7fd641e00640 1 --2- 172.21.15.122:0/1022098832 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd624068380 0x7fd62406a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd6340af000 tx=0x7fd6340a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:31.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:31.993+0000 7fd63a000640 1 -- 172.21.15.122:0/1022098832 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd63c056650 con 0x7fd6440cff30 2024-05-28T06:08:32.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:32.177+0000 7fd648e00640 1 -- 172.21.15.122:0/1022098832 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fd644076020 con 0x7fd624068380 2024-05-28T06:08:32.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:32.181+0000 7fd63a000640 1 -- 172.21.15.122:0/1022098832 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7fd6340b0040 con 0x7fd624068380 2024-05-28T06:08:32.185 INFO:teuthology.orchestra.run.smithi122.stdout:/volumes/_nogroup/sv1/91f96634-bc4b-43a9-a527-eb450e888062 2024-05-28T06:08:32.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:32.185+0000 7fd648e00640 1 -- 172.21.15.122:0/1022098832 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd624068380 msgr2=0x7fd62406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:32.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:32.185+0000 7fd648e00640 1 --2- 172.21.15.122:0/1022098832 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd624068380 0x7fd62406a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd6340af000 tx=0x7fd6340a7000 comp rx=0 tx=0).stop 2024-05-28T06:08:32.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:32.185+0000 7fd648e00640 1 -- 172.21.15.122:0/1022098832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6440cff30 msgr2=0x7fd644148110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:32.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:32.185+0000 7fd648e00640 1 --2- 172.21.15.122:0/1022098832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6440cff30 0x7fd644148110 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00cb60 tx=0x7fd63c00a430 comp rx=0 tx=0).stop 2024-05-28T06:08:32.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:32.185+0000 7fd648e00640 1 -- 172.21.15.122:0/1022098832 shutdown_connections 2024-05-28T06:08:32.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:32.185+0000 7fd648e00640 1 --2- 172.21.15.122:0/1022098832 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd624068380 0x7fd62406a840 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:32.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:32.185+0000 7fd648e00640 1 --2- 172.21.15.122:0/1022098832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6440cff30 0x7fd644148110 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:32.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:32.185+0000 7fd648e00640 1 --2- 172.21.15.122:0/1022098832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6440cd930 0x7fd6440b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:32.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:32.185+0000 7fd648e00640 1 --2- 172.21.15.122:0/1022098832 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd64406f6c0 0x7fd6440b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:32.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:32.185+0000 7fd648e00640 1 -- 172.21.15.122:0/1022098832 >> 172.21.15.122:0/1022098832 conn(0x7fd64406bd90 msgr2=0x7fd644159ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:32.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:32.185+0000 7fd648e00640 1 -- 172.21.15.122:0/1022098832 shutdown_connections 2024-05-28T06:08:32.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:32.185+0000 7fd648e00640 1 -- 172.21.15.122:0/1022098832 wait complete. 2024-05-28T06:08:32.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:08:32.206 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/91f96634-bc4b-43a9-a527-eb450e888062 2024-05-28T06:08:32.206 DEBUG:teuthology.orchestra.run.smithi122:> ) 2024-05-28T06:08:32.215 INFO:teuthology.orchestra.run.smithi122.stdout:# file: volumes/_nogroup/sv1/91f96634-bc4b-43a9-a527-eb450e888062 2024-05-28T06:08:32.215 INFO:teuthology.orchestra.run.smithi122.stdout:ceph.dir.rbytes="10488365056" 2024-05-28T06:08:32.215 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:08:32.216 INFO:tasks.cephfs.test_volumes:r_size = 10488365056 exp_size = 10737418240 2024-05-28T06:08:34.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:08:34.218 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/91f96634-bc4b-43a9-a527-eb450e888062 2024-05-28T06:08:34.218 DEBUG:teuthology.orchestra.run.smithi122:> ) 2024-05-28T06:08:34.228 INFO:teuthology.orchestra.run.smithi122.stdout:# file: volumes/_nogroup/sv1/91f96634-bc4b-43a9-a527-eb450e888062 2024-05-28T06:08:34.228 INFO:teuthology.orchestra.run.smithi122.stdout:ceph.dir.rbytes="10737418240" 2024-05-28T06:08:34.228 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:08:34.229 INFO:tasks.cephfs.test_volumes:r_size = 10737418240 exp_size = 10737418240 2024-05-28T06:08:34.229 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 ss1clone1 2024-05-28T06:08:34.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.425+0000 7fef60a00640 1 Processor -- start 2024-05-28T06:08:34.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.425+0000 7fef60a00640 1 -- start start 2024-05-28T06:08:34.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.425+0000 7fef60a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fef5c09aca0 0x7fef5c0b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:34.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.425+0000 7fef60a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef5c160240 0x7fef5c09b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:34.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.425+0000 7fef60a00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef5c0d0bf0 con 0x7fef5c09b080 2024-05-28T06:08:34.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.425+0000 7fef60a00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fef5c0b5460 con 0x7fef5c09aca0 2024-05-28T06:08:34.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.425+0000 7fef60a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fef5c0d0eb0 con 0x7fef5c160240 2024-05-28T06:08:34.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.429+0000 7fef59e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fef5c09aca0 0x7fef5c0b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:34.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.429+0000 7fef59400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fef5c09b080 0x7fef5c15fb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:44624/0 (socket says 172.21.15.122:44624) 2024-05-28T06:08:34.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.429+0000 7fef59400640 1 -- 172.21.15.122:0/3960491511 learned_addr learned my addr 172.21.15.122:0/3960491511 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:08:34.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.429+0000 7fef5a800640 1 --2- 172.21.15.122:0/3960491511 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef5c160240 0x7fef5c09b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:34.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.429+0000 7fef59e00640 1 -- 172.21.15.122:0/3960491511 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef5c160240 msgr2=0x7fef5c09b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:08:34.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.429+0000 7fef59e00640 1 --2- 172.21.15.122:0/3960491511 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef5c160240 0x7fef5c09b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:34.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.429+0000 7fef59e00640 1 -- 172.21.15.122:0/3960491511 >> v1:172.21.15.122:6789/0 conn(0x7fef5c09b080 legacy=0x7fef5c15fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:34.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.429+0000 7fef59e00640 1 -- 172.21.15.122:0/3960491511 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef5c0d1190 con 0x7fef5c09aca0 2024-05-28T06:08:34.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.429+0000 7fef59e00640 1 --2- 172.21.15.122:0/3960491511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef5c09aca0 0x7fef5c0b35b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fef4c0097c0 tx=0x7fef4c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12fc5b6d1fbb89a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:34.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.429+0000 7fef58a00640 1 -- 172.21.15.122:0/3960491511 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c0b1070 con 0x7fef5c09aca0 2024-05-28T06:08:34.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.429+0000 7fef58a00640 1 -- 172.21.15.122:0/3960491511 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef4c0ac410 con 0x7fef5c09aca0 2024-05-28T06:08:34.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.429+0000 7fef58a00640 1 -- 172.21.15.122:0/3960491511 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c0ac7e0 con 0x7fef5c09aca0 2024-05-28T06:08:34.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef60a00640 1 -- 172.21.15.122:0/3960491511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef5c09aca0 msgr2=0x7fef5c0b35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:34.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef60a00640 1 --2- 172.21.15.122:0/3960491511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef5c09aca0 0x7fef5c0b35b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fef4c0097c0 tx=0x7fef4c01c4a0 comp rx=0 tx=0).stop 2024-05-28T06:08:34.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef60a00640 1 -- 172.21.15.122:0/3960491511 shutdown_connections 2024-05-28T06:08:34.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef60a00640 1 --2- 172.21.15.122:0/3960491511 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef5c160240 0x7fef5c09b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:34.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef60a00640 1 --2- 172.21.15.122:0/3960491511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef5c09aca0 0x7fef5c0b35b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:34.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef60a00640 1 -- 172.21.15.122:0/3960491511 >> 172.21.15.122:0/3960491511 conn(0x7fef5c0b4100 msgr2=0x7fef5c0b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:34.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef60a00640 1 -- 172.21.15.122:0/3960491511 shutdown_connections 2024-05-28T06:08:34.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef60a00640 1 -- 172.21.15.122:0/3960491511 wait complete. 2024-05-28T06:08:34.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef60a00640 1 Processor -- start 2024-05-28T06:08:34.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef60a00640 1 -- start start 2024-05-28T06:08:34.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef60a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef5c09aca0 0x7fef5c06e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:34.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef60a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef5c09b080 0x7fef5c14ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:34.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef60a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef5c160240 0x7fef5c156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:34.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef60a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c0b64d0 con 0x7fef5c09aca0 2024-05-28T06:08:34.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef60a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c0b6350 con 0x7fef5c09b080 2024-05-28T06:08:34.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef60a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fef5c0b6650 con 0x7fef5c160240 2024-05-28T06:08:34.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef59e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef5c09aca0 0x7fef5c06e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:34.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef59e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef5c09aca0 0x7fef5c06e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:34118/0 (socket says 172.21.15.122:34118) 2024-05-28T06:08:34.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef59e00640 1 -- 172.21.15.122:0/1998473471 learned_addr learned my addr 172.21.15.122:0/1998473471 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:08:34.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef59e00640 1 -- 172.21.15.122:0/1998473471 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef5c160240 msgr2=0x7fef5c156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:34.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef59e00640 1 --2- 172.21.15.122:0/1998473471 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef5c160240 0x7fef5c156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:34.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef59e00640 1 -- 172.21.15.122:0/1998473471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef5c09b080 msgr2=0x7fef5c14ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:34.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef59e00640 1 --2- 172.21.15.122:0/1998473471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef5c09b080 0x7fef5c14ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:34.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.433+0000 7fef59e00640 1 -- 172.21.15.122:0/1998473471 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef5c14f2c0 con 0x7fef5c09aca0 2024-05-28T06:08:34.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.437+0000 7fef59e00640 1 --2- 172.21.15.122:0/1998473471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef5c09aca0 0x7fef5c06e700 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fef4c01a0d0 tx=0x7fef4c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:34.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.437+0000 7fef52000640 1 -- 172.21.15.122:0/1998473471 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c0b9020 con 0x7fef5c09aca0 2024-05-28T06:08:34.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.437+0000 7fef52000640 1 -- 172.21.15.122:0/1998473471 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef4c0b54d0 con 0x7fef5c09aca0 2024-05-28T06:08:34.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.437+0000 7fef60a00640 1 -- 172.21.15.122:0/1998473471 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef5c164c20 con 0x7fef5c09aca0 2024-05-28T06:08:34.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.437+0000 7fef52000640 1 -- 172.21.15.122:0/1998473471 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c0b1040 con 0x7fef5c09aca0 2024-05-28T06:08:34.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.437+0000 7fef60a00640 1 -- 172.21.15.122:0/1998473471 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef5c1651e0 con 0x7fef5c09aca0 2024-05-28T06:08:34.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.437+0000 7fef60a00640 1 -- 172.21.15.122:0/1998473471 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef5c068c40 con 0x7fef5c09aca0 2024-05-28T06:08:34.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.437+0000 7fef52000640 1 -- 172.21.15.122:0/1998473471 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 8) ==== 88038+0+0 (secure 0 0 0) 0x7fef4c0bc020 con 0x7fef5c09aca0 2024-05-28T06:08:34.442 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.437+0000 7fef52000640 1 --2- 172.21.15.122:0/1998473471 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fef3c068410 0x7fef3c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:34.442 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.437+0000 7fef52000640 1 -- 172.21.15.122:0/1998473471 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fef4c1207c0 con 0x7fef5c09aca0 2024-05-28T06:08:34.442 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.437+0000 7fef59400640 1 --2- 172.21.15.122:0/1998473471 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fef3c068410 0x7fef3c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:34.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.441+0000 7fef59400640 1 --2- 172.21.15.122:0/1998473471 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fef3c068410 0x7fef3c06a8d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fef48000f70 tx=0x7fef48007a90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:34.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.445+0000 7fef52000640 1 -- 172.21.15.122:0/1998473471 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fef4c0c3030 con 0x7fef5c09aca0 2024-05-28T06:08:34.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.661+0000 7fef60a00640 1 -- 172.21.15.122:0/1998473471 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7fef5c0b7d60 con 0x7fef3c068410 2024-05-28T06:08:34.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.721+0000 7fef52000640 1 -- 172.21.15.122:0/1998473471 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fef5c0b7d60 con 0x7fef3c068410 2024-05-28T06:08:34.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.721+0000 7fef60a00640 1 -- 172.21.15.122:0/1998473471 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fef3c068410 msgr2=0x7fef3c06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:34.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.721+0000 7fef60a00640 1 --2- 172.21.15.122:0/1998473471 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fef3c068410 0x7fef3c06a8d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fef48000f70 tx=0x7fef48007a90 comp rx=0 tx=0).stop 2024-05-28T06:08:34.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.721+0000 7fef60a00640 1 -- 172.21.15.122:0/1998473471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef5c09aca0 msgr2=0x7fef5c06e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:34.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.721+0000 7fef60a00640 1 --2- 172.21.15.122:0/1998473471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef5c09aca0 0x7fef5c06e700 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fef4c01a0d0 tx=0x7fef4c019240 comp rx=0 tx=0).stop 2024-05-28T06:08:34.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.721+0000 7fef60a00640 1 -- 172.21.15.122:0/1998473471 shutdown_connections 2024-05-28T06:08:34.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.721+0000 7fef60a00640 1 --2- 172.21.15.122:0/1998473471 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fef3c068410 0x7fef3c06a8d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:34.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.721+0000 7fef60a00640 1 --2- 172.21.15.122:0/1998473471 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef5c160240 0x7fef5c156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:34.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.721+0000 7fef60a00640 1 --2- 172.21.15.122:0/1998473471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef5c09b080 0x7fef5c14ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:34.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.721+0000 7fef60a00640 1 --2- 172.21.15.122:0/1998473471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef5c09aca0 0x7fef5c06e700 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:34.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.721+0000 7fef60a00640 1 -- 172.21.15.122:0/1998473471 >> 172.21.15.122:0/1998473471 conn(0x7fef5c0b4100 msgr2=0x7fef5c0b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:34.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.721+0000 7fef60a00640 1 -- 172.21.15.122:0/1998473471 shutdown_connections 2024-05-28T06:08:34.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.721+0000 7fef60a00640 1 -- 172.21.15.122:0/1998473471 wait complete. 2024-05-28T06:08:34.727 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:08:34.725+0000 7f9ded800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:08:34.727 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:08:34.725+0000 7f9ded800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:08:34.727 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:08:34.725+0000 7f9ded800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:08:34.727 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:08:34.725+0000 7f9ded800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:08:34.727 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:08:34.725+0000 7f9ded800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:08:34.744 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:08:34.741+0000 7f9deec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:08:34.744 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:08:34.741+0000 7f9deec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:08:34.744 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:08:34.741+0000 7f9deec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:08:34.744 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:08:34.741+0000 7f9deec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:08:34.744 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:08:34.741+0000 7f9deec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:08:34.750 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:08:34.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.889+0000 7f82b1600640 1 Processor -- start 2024-05-28T06:08:34.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.889+0000 7f82b1600640 1 -- start start 2024-05-28T06:08:34.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.889+0000 7f82b1600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f82ac06f890 0x7f82ac0cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:34.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.889+0000 7f82b1600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82ac0cd930 0x7f82ac0b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:34.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.889+0000 7f82b1600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82ac0d0310 con 0x7f82ac0cff30 2024-05-28T06:08:34.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.889+0000 7f82b1600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f82ac15be20 con 0x7f82ac06f890 2024-05-28T06:08:34.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.889+0000 7f82b1600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f82ac15c100 con 0x7f82ac0cd930 2024-05-28T06:08:34.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.889+0000 7f82aa000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f82ac06f890 0x7f82ac0cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:34.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.889+0000 7f82aa000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f82ac06f890 0x7f82ac0cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:34152/0 (socket says 172.21.15.122:34152) 2024-05-28T06:08:34.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.889+0000 7f82aa000640 1 -- 172.21.15.122:0/38877650 learned_addr learned my addr 172.21.15.122:0/38877650 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:08:34.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.889+0000 7f82ab400640 1 --2- 172.21.15.122:0/38877650 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82ac0cd930 0x7f82ac0b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:34.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.893+0000 7f82aa000640 1 -- 172.21.15.122:0/38877650 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82ac0cd930 msgr2=0x7f82ac0b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:08:34.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.893+0000 7f82aa000640 1 --2- 172.21.15.122:0/38877650 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82ac0cd930 0x7f82ac0b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:34.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.893+0000 7f82a9600640 1 -- 172.21.15.122:0/38877650 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1947571105 0 0) 0x7f82ac0d0310 con 0x7f82ac0cff30 2024-05-28T06:08:34.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.893+0000 7f82aa000640 1 -- 172.21.15.122:0/38877650 >> v1:172.21.15.153:6789/0 conn(0x7f82ac0cff30 legacy=0x7f82ac06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:34.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.893+0000 7f82aa000640 1 -- 172.21.15.122:0/38877650 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82ac15c3e0 con 0x7f82ac06f890 2024-05-28T06:08:34.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.893+0000 7f82aa000640 1 --2- 172.21.15.122:0/38877650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82ac06f890 0x7f82ac0cd3f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f829800bb10 tx=0x7f829801ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4337516f3caaa2a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:34.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.893+0000 7f82a9600640 1 -- 172.21.15.122:0/38877650 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82980b4070 con 0x7f82ac06f890 2024-05-28T06:08:34.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.893+0000 7f82a9600640 1 -- 172.21.15.122:0/38877650 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82980a7c70 con 0x7f82ac06f890 2024-05-28T06:08:34.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.893+0000 7f82a9600640 1 -- 172.21.15.122:0/38877650 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82980af660 con 0x7f82ac06f890 2024-05-28T06:08:34.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.893+0000 7f82b1600640 1 -- 172.21.15.122:0/38877650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82ac06f890 msgr2=0x7f82ac0cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:34.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.893+0000 7f82b1600640 1 --2- 172.21.15.122:0/38877650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82ac06f890 0x7f82ac0cd3f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f829800bb10 tx=0x7f829801ec00 comp rx=0 tx=0).stop 2024-05-28T06:08:34.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.893+0000 7f82b1600640 1 -- 172.21.15.122:0/38877650 shutdown_connections 2024-05-28T06:08:34.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.893+0000 7f82b1600640 1 --2- 172.21.15.122:0/38877650 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82ac0cd930 0x7f82ac0b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:34.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.893+0000 7f82b1600640 1 --2- 172.21.15.122:0/38877650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82ac06f890 0x7f82ac0cd3f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:34.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.893+0000 7f82b1600640 1 -- 172.21.15.122:0/38877650 >> 172.21.15.122:0/38877650 conn(0x7f82ac06bd90 msgr2=0x7f82ac06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:34.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82b1600640 1 -- 172.21.15.122:0/38877650 shutdown_connections 2024-05-28T06:08:34.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82b1600640 1 -- 172.21.15.122:0/38877650 wait complete. 2024-05-28T06:08:34.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82b1600640 1 Processor -- start 2024-05-28T06:08:34.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82b1600640 1 -- start start 2024-05-28T06:08:34.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82b1600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82ac06f890 0x7f82ac140d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:34.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82b1600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82ac0cd930 0x7f82ac0b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:34.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82b1600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82ac0cff30 0x7f82ac0b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:34.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82b1600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f82ac0b5700 con 0x7f82ac0cff30 2024-05-28T06:08:34.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82b1600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f82ac0b5880 con 0x7f82ac0cd930 2024-05-28T06:08:34.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82b1600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f82ac0b5a00 con 0x7f82ac06f890 2024-05-28T06:08:34.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82ab400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82ac0cff30 0x7f82ac0b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:34.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82ab400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82ac0cff30 0x7f82ac0b1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:34154/0 (socket says 172.21.15.122:34154) 2024-05-28T06:08:34.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82ab400640 1 -- 172.21.15.122:0/2210795513 learned_addr learned my addr 172.21.15.122:0/2210795513 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:08:34.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82aa000640 1 --2- 172.21.15.122:0/2210795513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82ac0cd930 0x7f82ac0b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:34.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82aaa00640 1 --2- 172.21.15.122:0/2210795513 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82ac06f890 0x7f82ac140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:34.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82ab400640 1 -- 172.21.15.122:0/2210795513 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82ac06f890 msgr2=0x7f82ac140d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:34.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82ab400640 1 --2- 172.21.15.122:0/2210795513 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82ac06f890 0x7f82ac140d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:34.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82ab400640 1 -- 172.21.15.122:0/2210795513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82ac0cd930 msgr2=0x7f82ac0b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:34.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82ab400640 1 --2- 172.21.15.122:0/2210795513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82ac0cd930 0x7f82ac0b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:34.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82ab400640 1 -- 172.21.15.122:0/2210795513 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82ac0b0d40 con 0x7f82ac0cff30 2024-05-28T06:08:34.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82ab400640 1 --2- 172.21.15.122:0/2210795513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82ac0cff30 0x7f82ac0b1de0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009dd0 tx=0x7f82a400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:34.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82a2a00640 1 -- 172.21.15.122:0/2210795513 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a4018020 con 0x7f82ac0cff30 2024-05-28T06:08:34.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82a2a00640 1 -- 172.21.15.122:0/2210795513 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82a4014480 con 0x7f82ac0cff30 2024-05-28T06:08:34.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82b1600640 1 -- 172.21.15.122:0/2210795513 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82ac0b1020 con 0x7f82ac0cff30 2024-05-28T06:08:34.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.897+0000 7f82a2a00640 1 -- 172.21.15.122:0/2210795513 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a4014870 con 0x7f82ac0cff30 2024-05-28T06:08:34.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.901+0000 7f82b1600640 1 -- 172.21.15.122:0/2210795513 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82ac0b18c0 con 0x7f82ac0cff30 2024-05-28T06:08:34.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.901+0000 7f82b1600640 1 -- 172.21.15.122:0/2210795513 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82ac0b11f0 con 0x7f82ac0cff30 2024-05-28T06:08:34.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.901+0000 7f82a2a00640 1 -- 172.21.15.122:0/2210795513 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 8) ==== 88038+0+0 (secure 0 0 0) 0x7f82a401b020 con 0x7f82ac0cff30 2024-05-28T06:08:34.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.901+0000 7f82a2a00640 1 --2- 172.21.15.122:0/2210795513 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f828c068410 0x7f828c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:34.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.901+0000 7f82a2a00640 1 -- 172.21.15.122:0/2210795513 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f82a4087630 con 0x7f82ac0cff30 2024-05-28T06:08:34.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.901+0000 7f82aaa00640 1 --2- 172.21.15.122:0/2210795513 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f828c068410 0x7f828c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:34.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.901+0000 7f82aaa00640 1 --2- 172.21.15.122:0/2210795513 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f828c068410 0x7f828c06a8d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f829c000f70 tx=0x7f829c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:34.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:34.905+0000 7f82a2a00640 1 -- 172.21.15.122:0/2210795513 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f82a4022070 con 0x7f82ac0cff30 2024-05-28T06:08:35.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:35.121+0000 7f82b1600640 1 -- 172.21.15.122:0/2210795513 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f82ac068c40 con 0x7f82ac0cff30 2024-05-28T06:08:35.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:35.121+0000 7f82a2a00640 1 -- 172.21.15.122:0/2210795513 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1860 (secure 0 0 0) 0x7f82a4010040 con 0x7f82ac0cff30 2024-05-28T06:08:35.123 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:08:35.124 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:08:35.124 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:08:35.124 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:08:35.124 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:08:35.124 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:08:35.124 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:08:35.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:35.124 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:08:35.124 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:08:35.124 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:08:35.124 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:08:35.124 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:08:35.125 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:35.125 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:08:35.125 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:08:35.125 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:08:35.125 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:08:35.125 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:35.125 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 190, 2024-05-28T06:08:35.125 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:08:35.125 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:08:35.125 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:08:35.125 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:08:35.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:35.125 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:08:35.125 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 34, 2024-05-28T06:08:35.126 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:08:35.126 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:08:35.126 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:08:35.126 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:08:35.126 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:08:35.126 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:08:35.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:35.126 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:08:35.126 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:08:35.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:08:35.126 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:08:35.126 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:08:35.126 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:35.127 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:35.127 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:08:35.127 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:08:35.127 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 2585, 2024-05-28T06:08:35.127 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 10738565042, 2024-05-28T06:08:35.127 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 21723095040, 2024-05-28T06:08:35.127 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 751371018240, 2024-05-28T06:08:35.127 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:08:35.127 INFO:teuthology.orchestra.run.smithi122.stdout: "read_bytes_sec": 85, 2024-05-28T06:08:35.127 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 178913209, 2024-05-28T06:08:35.127 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 0, 2024-05-28T06:08:35.127 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 45 2024-05-28T06:08:35.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:35.128 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:08:35.128 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 19, 2024-05-28T06:08:35.128 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 2, 2024-05-28T06:08:35.128 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:08:35.128 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:08:35.128 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:08:35.128 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:08:35.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:08:35.128 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 2, 2024-05-28T06:08:35.128 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:08:35.128 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "a", 2024-05-28T06:08:35.128 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:08:35.128 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 5082 2024-05-28T06:08:35.129 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:35.129 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:35.129 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:08:35.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:35.129 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:08:35.129 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:08:35.129 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:08:35.129 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:08:35.129 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:08:35.129 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:08:35.129 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:08:35.129 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:35.129 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:08:35.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:35.130 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:08:35.130 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 5, 2024-05-28T06:08:35.130 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:07:53.268069+0000", 2024-05-28T06:08:35.130 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:08:35.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:35.130 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": {} 2024-05-28T06:08:35.130 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:08:35.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:35.121+0000 7f82b1600640 1 -- 172.21.15.122:0/2210795513 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f828c068410 msgr2=0x7f828c06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:35.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:35.121+0000 7f82b1600640 1 --2- 172.21.15.122:0/2210795513 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f828c068410 0x7f828c06a8d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f829c000f70 tx=0x7f829c009040 comp rx=0 tx=0).stop 2024-05-28T06:08:35.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:35.121+0000 7f82b1600640 1 -- 172.21.15.122:0/2210795513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82ac0cff30 msgr2=0x7f82ac0b1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:35.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:35.121+0000 7f82b1600640 1 --2- 172.21.15.122:0/2210795513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82ac0cff30 0x7f82ac0b1de0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009dd0 tx=0x7f82a400c490 comp rx=0 tx=0).stop 2024-05-28T06:08:35.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:35.121+0000 7f82b1600640 1 -- 172.21.15.122:0/2210795513 shutdown_connections 2024-05-28T06:08:35.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:35.121+0000 7f82b1600640 1 --2- 172.21.15.122:0/2210795513 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f828c068410 0x7f828c06a8d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:35.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:35.121+0000 7f82b1600640 1 --2- 172.21.15.122:0/2210795513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82ac0cff30 0x7f82ac0b1de0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:35.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:35.121+0000 7f82b1600640 1 --2- 172.21.15.122:0/2210795513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82ac0cd930 0x7f82ac0b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:35.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:35.121+0000 7f82b1600640 1 --2- 172.21.15.122:0/2210795513 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82ac06f890 0x7f82ac140d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:35.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:35.121+0000 7f82b1600640 1 -- 172.21.15.122:0/2210795513 >> 172.21.15.122:0/2210795513 conn(0x7f82ac06bd90 msgr2=0x7f82ac1531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:35.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:35.121+0000 7f82b1600640 1 -- 172.21.15.122:0/2210795513 shutdown_connections 2024-05-28T06:08:35.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:35.121+0000 7f82b1600640 1 -- 172.21.15.122:0/2210795513 wait complete. 2024-05-28T06:08:37.145 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:08:37.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.285+0000 7f9871000640 1 Processor -- start 2024-05-28T06:08:37.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.285+0000 7f9871000640 1 -- start start 2024-05-28T06:08:37.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.289+0000 7f9871000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f986c15e720 0x7f986c06c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:37.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.289+0000 7f9871000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f986c070dc0 0x7f986c06cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:37.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.289+0000 7f9871000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f986c0ccf60 0x7f986c1623a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:37.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.289+0000 7f9871000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f986c0b3cc0 con 0x7f986c0ccf60 2024-05-28T06:08:37.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.289+0000 7f9871000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f986c0b3f10 con 0x7f986c15e720 2024-05-28T06:08:37.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.289+0000 7f9871000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f986c0b41f0 con 0x7f986c070dc0 2024-05-28T06:08:37.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.289+0000 7f986be00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f986c0ccf60 0x7f986c1623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:37.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.289+0000 7f986be00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f986c0ccf60 0x7f986c1623a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58564/0 (socket says 172.21.15.122:58564) 2024-05-28T06:08:37.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.289+0000 7f986be00640 1 -- 172.21.15.122:0/2259251918 learned_addr learned my addr 172.21.15.122:0/2259251918 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:08:37.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.289+0000 7f986b400640 1 --2- 172.21.15.122:0/2259251918 >> v2:172.21.15.153:3300/0 conn(0x7f986c15e720 0x7f986c06c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:37.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.289+0000 7f986aa00640 1 --2- 172.21.15.122:0/2259251918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f986c070dc0 0x7f986c06cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:37.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.289+0000 7f986be00640 1 -- 172.21.15.122:0/2259251918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f986c070dc0 msgr2=0x7f986c06cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:08:37.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.289+0000 7f986be00640 1 --2- 172.21.15.122:0/2259251918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f986c070dc0 0x7f986c06cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:37.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.289+0000 7f986be00640 1 -- 172.21.15.122:0/2259251918 >> v2:172.21.15.153:3300/0 conn(0x7f986c15e720 msgr2=0x7f986c06c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:08:37.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.289+0000 7f986be00640 1 --2- 172.21.15.122:0/2259251918 >> v2:172.21.15.153:3300/0 conn(0x7f986c15e720 0x7f986c06c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:37.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.289+0000 7f986be00640 1 -- 172.21.15.122:0/2259251918 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986c06e750 con 0x7f986c0ccf60 2024-05-28T06:08:37.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.293+0000 7f986be00640 1 --2- 172.21.15.122:0/2259251918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f986c0ccf60 0x7f986c1623a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f986c06dd70 tx=0x7f986401c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f5dbe1be98479c server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:37.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.293+0000 7f986a000640 1 -- 172.21.15.122:0/2259251918 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98640ac020 con 0x7f986c0ccf60 2024-05-28T06:08:37.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.293+0000 7f986a000640 1 -- 172.21.15.122:0/2259251918 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98640a6490 con 0x7f986c0ccf60 2024-05-28T06:08:37.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.293+0000 7f986a000640 1 -- 172.21.15.122:0/2259251918 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98640a6860 con 0x7f986c0ccf60 2024-05-28T06:08:37.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.293+0000 7f9871000640 1 -- 172.21.15.122:0/2259251918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f986c0ccf60 msgr2=0x7f986c1623a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:37.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.293+0000 7f9871000640 1 --2- 172.21.15.122:0/2259251918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f986c0ccf60 0x7f986c1623a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f986c06dd70 tx=0x7f986401c5e0 comp rx=0 tx=0).stop 2024-05-28T06:08:37.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.293+0000 7f9871000640 1 -- 172.21.15.122:0/2259251918 shutdown_connections 2024-05-28T06:08:37.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.293+0000 7f9871000640 1 --2- 172.21.15.122:0/2259251918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f986c0ccf60 0x7f986c1623a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:37.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.293+0000 7f9871000640 1 --2- 172.21.15.122:0/2259251918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f986c070dc0 0x7f986c06cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:37.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.293+0000 7f9871000640 1 --2- 172.21.15.122:0/2259251918 >> v2:172.21.15.153:3300/0 conn(0x7f986c15e720 0x7f986c06c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:37.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.293+0000 7f9871000640 1 -- 172.21.15.122:0/2259251918 >> 172.21.15.122:0/2259251918 conn(0x7f986c072680 msgr2=0x7f986c072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:37.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.293+0000 7f9871000640 1 -- 172.21.15.122:0/2259251918 shutdown_connections 2024-05-28T06:08:37.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.293+0000 7f9871000640 1 -- 172.21.15.122:0/2259251918 wait complete. 2024-05-28T06:08:37.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.293+0000 7f9871000640 1 Processor -- start 2024-05-28T06:08:37.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.293+0000 7f9871000640 1 -- start start 2024-05-28T06:08:37.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.293+0000 7f9871000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f986c070dc0 0x7f986c1498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:37.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.293+0000 7f9871000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f986c0ccf60 0x7f986c147e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:37.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.293+0000 7f9871000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f986c15e720 0x7f986c0d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:37.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.293+0000 7f9871000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f986c06f0d0 con 0x7f986c0ccf60 2024-05-28T06:08:37.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.297+0000 7f9871000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f986c06ef50 con 0x7f986c15e720 2024-05-28T06:08:37.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.297+0000 7f9871000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f986c06f250 con 0x7f986c070dc0 2024-05-28T06:08:37.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.297+0000 7f986aa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f986c0ccf60 0x7f986c147e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:37.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.297+0000 7f986aa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f986c0ccf60 0x7f986c147e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58578/0 (socket says 172.21.15.122:58578) 2024-05-28T06:08:37.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.297+0000 7f986aa00640 1 -- 172.21.15.122:0/3954939632 learned_addr learned my addr 172.21.15.122:0/3954939632 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:08:37.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.297+0000 7f986b400640 1 --2- 172.21.15.122:0/3954939632 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f986c070dc0 0x7f986c1498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:37.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.297+0000 7f986be00640 1 --2- 172.21.15.122:0/3954939632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f986c15e720 0x7f986c0d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:37.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.297+0000 7f986aa00640 1 -- 172.21.15.122:0/3954939632 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f986c070dc0 msgr2=0x7f986c1498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:37.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.297+0000 7f986aa00640 1 --2- 172.21.15.122:0/3954939632 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f986c070dc0 0x7f986c1498d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:37.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.297+0000 7f986aa00640 1 -- 172.21.15.122:0/3954939632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f986c15e720 msgr2=0x7f986c0d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:37.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.297+0000 7f986aa00640 1 --2- 172.21.15.122:0/3954939632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f986c15e720 0x7f986c0d02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:37.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.297+0000 7f986aa00640 1 -- 172.21.15.122:0/3954939632 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986c0ced60 con 0x7f986c0ccf60 2024-05-28T06:08:37.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.297+0000 7f986aa00640 1 --2- 172.21.15.122:0/3954939632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f986c0ccf60 0x7f986c147e20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f985800e930 tx=0x7f985800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:37.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.297+0000 7f9863400640 1 -- 172.21.15.122:0/3954939632 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9858017070 con 0x7f986c0ccf60 2024-05-28T06:08:37.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.297+0000 7f9863400640 1 -- 172.21.15.122:0/3954939632 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f985800ca00 con 0x7f986c0ccf60 2024-05-28T06:08:37.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.297+0000 7f9871000640 1 -- 172.21.15.122:0/3954939632 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f986c0cf040 con 0x7f986c0ccf60 2024-05-28T06:08:37.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.297+0000 7f9863400640 1 -- 172.21.15.122:0/3954939632 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985800cdf0 con 0x7f986c0ccf60 2024-05-28T06:08:37.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.297+0000 7f9871000640 1 -- 172.21.15.122:0/3954939632 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f986c0cf600 con 0x7f986c0ccf60 2024-05-28T06:08:37.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.297+0000 7f9871000640 1 -- 172.21.15.122:0/3954939632 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f986c075620 con 0x7f986c0ccf60 2024-05-28T06:08:37.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.297+0000 7f9863400640 1 -- 172.21.15.122:0/3954939632 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f985801a070 con 0x7f986c0ccf60 2024-05-28T06:08:37.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.301+0000 7f9863400640 1 --2- 172.21.15.122:0/3954939632 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f984c068530 0x7f984c06a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:37.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.301+0000 7f9863400640 1 -- 172.21.15.122:0/3954939632 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9858087370 con 0x7f986c0ccf60 2024-05-28T06:08:37.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.301+0000 7f986b400640 1 --2- 172.21.15.122:0/3954939632 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f984c068530 0x7f984c06a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:37.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.301+0000 7f986b400640 1 --2- 172.21.15.122:0/3954939632 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f984c068530 0x7f984c06a9f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f986c0d0260 tx=0x7f985c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:37.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.301+0000 7f9863400640 1 -- 172.21.15.122:0/3954939632 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f98580571b0 con 0x7f986c0ccf60 2024-05-28T06:08:37.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.521+0000 7f9871000640 1 -- 172.21.15.122:0/3954939632 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f986c0627c0 con 0x7f986c0ccf60 2024-05-28T06:08:37.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.521+0000 7f9863400640 1 -- 172.21.15.122:0/3954939632 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1859 (secure 0 0 0) 0x7f985805b4b0 con 0x7f986c0ccf60 2024-05-28T06:08:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:08:37.524 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:08:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:08:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:08:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:08:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:08:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:08:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:08:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:08:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:08:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:08:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:08:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:08:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:08:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:08:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:08:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 193, 2024-05-28T06:08:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:08:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:08:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:08:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:08:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:08:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 34, 2024-05-28T06:08:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:08:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:08:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:08:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:08:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:08:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:08:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:08:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:08:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:08:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:08:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:08:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:08:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:08:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 2585, 2024-05-28T06:08:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 10738565042, 2024-05-28T06:08:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 21723095040, 2024-05-28T06:08:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 751371018240, 2024-05-28T06:08:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:08:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: "read_bytes_sec": 85, 2024-05-28T06:08:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 89458574, 2024-05-28T06:08:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 0, 2024-05-28T06:08:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 23 2024-05-28T06:08:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:08:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 19, 2024-05-28T06:08:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 2, 2024-05-28T06:08:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:08:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:08:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:08:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:08:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:08:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 2, 2024-05-28T06:08:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:08:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "a", 2024-05-28T06:08:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:08:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 5082 2024-05-28T06:08:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:08:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:08:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:08:37.530 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:08:37.530 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:08:37.530 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:08:37.530 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:08:37.530 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:08:37.530 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:37.530 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:08:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:08:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 5, 2024-05-28T06:08:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:07:53.268069+0000", 2024-05-28T06:08:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:08:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": {} 2024-05-28T06:08:37.531 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:08:37.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.521+0000 7f9871000640 1 -- 172.21.15.122:0/3954939632 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f984c068530 msgr2=0x7f984c06a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:37.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.521+0000 7f9871000640 1 --2- 172.21.15.122:0/3954939632 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f984c068530 0x7f984c06a9f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f986c0d0260 tx=0x7f985c009190 comp rx=0 tx=0).stop 2024-05-28T06:08:37.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.521+0000 7f9871000640 1 -- 172.21.15.122:0/3954939632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f986c0ccf60 msgr2=0x7f986c147e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:37.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.521+0000 7f9871000640 1 --2- 172.21.15.122:0/3954939632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f986c0ccf60 0x7f986c147e20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f985800e930 tx=0x7f985800edf0 comp rx=0 tx=0).stop 2024-05-28T06:08:37.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.521+0000 7f9871000640 1 -- 172.21.15.122:0/3954939632 shutdown_connections 2024-05-28T06:08:37.533 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.521+0000 7f9871000640 1 --2- 172.21.15.122:0/3954939632 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f984c068530 0x7f984c06a9f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:37.533 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.521+0000 7f9871000640 1 --2- 172.21.15.122:0/3954939632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f986c15e720 0x7f986c0d02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:37.533 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.521+0000 7f9871000640 1 --2- 172.21.15.122:0/3954939632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f986c0ccf60 0x7f986c147e20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:37.533 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.521+0000 7f9871000640 1 --2- 172.21.15.122:0/3954939632 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f986c070dc0 0x7f986c1498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:37.533 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.521+0000 7f9871000640 1 -- 172.21.15.122:0/3954939632 >> 172.21.15.122:0/3954939632 conn(0x7f986c072680 msgr2=0x7f986c0b4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:37.533 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.521+0000 7f9871000640 1 -- 172.21.15.122:0/3954939632 shutdown_connections 2024-05-28T06:08:37.533 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:37.521+0000 7f9871000640 1 -- 172.21.15.122:0/3954939632 wait complete. 2024-05-28T06:08:39.546 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:08:39.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.777+0000 7f5ed7400640 1 Processor -- start 2024-05-28T06:08:39.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.777+0000 7f5ed7400640 1 -- start start 2024-05-28T06:08:39.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.777+0000 7f5ed7400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5ed00d0c80 0x7f5ed009b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:39.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.777+0000 7f5ed7400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5ed015d7e0 0x7f5ed00cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:39.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.777+0000 7f5ed7400640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ed015dc70 con 0x7f5ed00d0270 2024-05-28T06:08:39.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.777+0000 7f5ed7400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f5ed00d0830 con 0x7f5ed00d0c80 2024-05-28T06:08:39.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.777+0000 7f5ed7400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5ed009aa40 con 0x7f5ed015d7e0 2024-05-28T06:08:39.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.777+0000 7f5ecfe00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f5ed00d0270 0x7f5ed00d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:53464/0 (socket says 172.21.15.122:53464) 2024-05-28T06:08:39.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.781+0000 7f5ed4a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5ed00d0c80 0x7f5ed009b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:39.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.781+0000 7f5ecfe00640 1 -- 172.21.15.122:0/3679792121 learned_addr learned my addr 172.21.15.122:0/3679792121 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:08:39.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.781+0000 7f5ed4a00640 1 -- 172.21.15.122:0/3679792121 >> v2:172.21.15.153:3300/0 conn(0x7f5ed015d7e0 msgr2=0x7f5ed00cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:08:39.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.781+0000 7f5ed4a00640 1 --2- 172.21.15.122:0/3679792121 >> v2:172.21.15.153:3300/0 conn(0x7f5ed015d7e0 0x7f5ed00cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:39.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.781+0000 7f5ed4a00640 1 -- 172.21.15.122:0/3679792121 >> v1:172.21.15.122:6789/0 conn(0x7f5ed00d0270 legacy=0x7f5ed00d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:39.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.781+0000 7f5ed4a00640 1 -- 172.21.15.122:0/3679792121 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed009ad20 con 0x7f5ed00d0c80 2024-05-28T06:08:39.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.781+0000 7f5ecf400640 1 -- 172.21.15.122:0/3679792121 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1926374604 0 0) 0x7f5ed015dc70 con 0x7f5ed00d0270 2024-05-28T06:08:39.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.785+0000 7f5ed4a00640 1 --2- 172.21.15.122:0/3679792121 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ed00d0c80 0x7f5ed009b800 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5ed009c1c0 tx=0x7f5ec401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304ce496cf340d7e server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:39.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.785+0000 7f5ecf400640 1 -- 172.21.15.122:0/3679792121 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec40b1070 con 0x7f5ed00d0c80 2024-05-28T06:08:39.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.785+0000 7f5ecf400640 1 -- 172.21.15.122:0/3679792121 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec40ac620 con 0x7f5ed00d0c80 2024-05-28T06:08:39.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.785+0000 7f5ecf400640 1 -- 172.21.15.122:0/3679792121 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec40ac9f0 con 0x7f5ed00d0c80 2024-05-28T06:08:39.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.785+0000 7f5ed7400640 1 -- 172.21.15.122:0/3679792121 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ed00d0c80 msgr2=0x7f5ed009b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:39.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.785+0000 7f5ed7400640 1 --2- 172.21.15.122:0/3679792121 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ed00d0c80 0x7f5ed009b800 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5ed009c1c0 tx=0x7f5ec401c3c0 comp rx=0 tx=0).stop 2024-05-28T06:08:39.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.785+0000 7f5ed7400640 1 -- 172.21.15.122:0/3679792121 shutdown_connections 2024-05-28T06:08:39.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.785+0000 7f5ed7400640 1 --2- 172.21.15.122:0/3679792121 >> v2:172.21.15.153:3300/0 conn(0x7f5ed015d7e0 0x7f5ed00cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:39.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.785+0000 7f5ed7400640 1 --2- 172.21.15.122:0/3679792121 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ed00d0c80 0x7f5ed009b800 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:39.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.785+0000 7f5ed7400640 1 -- 172.21.15.122:0/3679792121 >> 172.21.15.122:0/3679792121 conn(0x7f5ed00b4190 msgr2=0x7f5ed00b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:39.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.785+0000 7f5ed7400640 1 -- 172.21.15.122:0/3679792121 shutdown_connections 2024-05-28T06:08:39.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.785+0000 7f5ed7400640 1 -- 172.21.15.122:0/3679792121 wait complete. 2024-05-28T06:08:39.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.785+0000 7f5ed7400640 1 Processor -- start 2024-05-28T06:08:39.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.785+0000 7f5ed7400640 1 -- start start 2024-05-28T06:08:39.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.789+0000 7f5ed7400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ed00d0270 0x7f5ed01496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:39.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.789+0000 7f5ed7400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ed00d0c80 0x7f5ed015ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:39.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.789+0000 7f5ed7400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ed015d7e0 0x7f5ed00b7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:39.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.789+0000 7f5ed7400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed01697c0 con 0x7f5ed015d7e0 2024-05-28T06:08:39.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.789+0000 7f5ed7400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed0169640 con 0x7f5ed00d0270 2024-05-28T06:08:39.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.789+0000 7f5ed7400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5ed0169940 con 0x7f5ed00d0c80 2024-05-28T06:08:39.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.789+0000 7f5ed5400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ed015d7e0 0x7f5ed00b7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:39.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.789+0000 7f5ed5400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ed015d7e0 0x7f5ed00b7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58596/0 (socket says 172.21.15.122:58596) 2024-05-28T06:08:39.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.789+0000 7f5ed5400640 1 -- 172.21.15.122:0/913040852 learned_addr learned my addr 172.21.15.122:0/913040852 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:08:39.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.789+0000 7f5ed4a00640 1 --2- 172.21.15.122:0/913040852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ed00d0270 0x7f5ed01496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:39.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.789+0000 7f5ecfe00640 1 --2- 172.21.15.122:0/913040852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ed00d0c80 0x7f5ed015ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:39.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.789+0000 7f5ed5400640 1 -- 172.21.15.122:0/913040852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ed00d0c80 msgr2=0x7f5ed015ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:39.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.789+0000 7f5ed5400640 1 --2- 172.21.15.122:0/913040852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ed00d0c80 0x7f5ed015ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:39.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.789+0000 7f5ed5400640 1 -- 172.21.15.122:0/913040852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ed00d0270 msgr2=0x7f5ed01496d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:39.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.789+0000 7f5ed5400640 1 --2- 172.21.15.122:0/913040852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ed00d0270 0x7f5ed01496d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:39.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.789+0000 7f5ed5400640 1 -- 172.21.15.122:0/913040852 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed015f480 con 0x7f5ed015d7e0 2024-05-28T06:08:39.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.789+0000 7f5ed5400640 1 --2- 172.21.15.122:0/913040852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ed015d7e0 0x7f5ed00b7e90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5ec800b9a0 tx=0x7f5ec800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:39.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.789+0000 7f5eccc00640 1 -- 172.21.15.122:0/913040852 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8019070 con 0x7f5ed015d7e0 2024-05-28T06:08:39.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.789+0000 7f5eccc00640 1 -- 172.21.15.122:0/913040852 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec800cbc0 con 0x7f5ed015d7e0 2024-05-28T06:08:39.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.789+0000 7f5eccc00640 1 -- 172.21.15.122:0/913040852 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8014440 con 0x7f5ed015d7e0 2024-05-28T06:08:39.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.789+0000 7f5ed7400640 1 -- 172.21.15.122:0/913040852 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ed00b83d0 con 0x7f5ed015d7e0 2024-05-28T06:08:39.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.789+0000 7f5ed7400640 1 -- 172.21.15.122:0/913040852 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ed015fa00 con 0x7f5ed015d7e0 2024-05-28T06:08:39.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.793+0000 7f5ed7400640 1 -- 172.21.15.122:0/913040852 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ed00c5ed0 con 0x7f5ed015d7e0 2024-05-28T06:08:39.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.793+0000 7f5eccc00640 1 -- 172.21.15.122:0/913040852 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f5ec801c070 con 0x7f5ed015d7e0 2024-05-28T06:08:39.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.793+0000 7f5eccc00640 1 --2- 172.21.15.122:0/913040852 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5eb0068530 0x7f5eb006a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:39.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.793+0000 7f5eccc00640 1 -- 172.21.15.122:0/913040852 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f5ec8086d90 con 0x7f5ed015d7e0 2024-05-28T06:08:39.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.793+0000 7f5ed4a00640 1 --2- 172.21.15.122:0/913040852 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5eb0068530 0x7f5eb006a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:39.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.801+0000 7f5eccc00640 1 -- 172.21.15.122:0/913040852 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5ec8023020 con 0x7f5ed015d7e0 2024-05-28T06:08:39.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:39.805+0000 7f5ed4a00640 1 --2- 172.21.15.122:0/913040852 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5eb0068530 0x7f5eb006a9f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5ec40ae000 tx=0x7f5ec40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:40.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.229+0000 7f5ed7400640 1 -- 172.21.15.122:0/913040852 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f5ed0068c40 con 0x7f5ed015d7e0 2024-05-28T06:08:40.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.233+0000 7f5eccc00640 1 -- 172.21.15.122:0/913040852 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2095 (secure 0 0 0) 0x7f5ec80571b0 con 0x7f5ed015d7e0 2024-05-28T06:08:40.235 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:08:40.235 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:08:40.235 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:08:40.235 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:08:40.235 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:08:40.235 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:08:40.235 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:08:40.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:40.235 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:08:40.235 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:08:40.235 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:08:40.235 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:08:40.235 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:08:40.236 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:40.236 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:08:40.236 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:08:40.236 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:08:40.236 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:08:40.236 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:40.236 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 195, 2024-05-28T06:08:40.236 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:08:40.236 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:08:40.236 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:08:40.236 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:08:40.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:40.236 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:08:40.236 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 34, 2024-05-28T06:08:40.237 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:08:40.237 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:08:40.237 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:08:40.237 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:08:40.237 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:08:40.237 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:08:40.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:40.237 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:08:40.237 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:08:40.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:08:40.237 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:08:40.237 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:08:40.237 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:40.237 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:40.237 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:08:40.238 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:08:40.238 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 2589, 2024-05-28T06:08:40.238 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 10738637096, 2024-05-28T06:08:40.238 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 21735849984, 2024-05-28T06:08:40.238 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 751358263296, 2024-05-28T06:08:40.238 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:08:40.238 INFO:teuthology.orchestra.run.smithi122.stdout: "read_bytes_sec": 341, 2024-05-28T06:08:40.238 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 89465954, 2024-05-28T06:08:40.238 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 0, 2024-05-28T06:08:40.238 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 25 2024-05-28T06:08:40.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:40.238 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:08:40.238 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 19, 2024-05-28T06:08:40.238 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 2, 2024-05-28T06:08:40.239 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:08:40.239 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:08:40.239 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:08:40.239 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:08:40.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:08:40.239 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 2, 2024-05-28T06:08:40.239 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:08:40.239 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "a", 2024-05-28T06:08:40.239 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:08:40.239 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 5082 2024-05-28T06:08:40.239 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:40.239 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:40.239 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:08:40.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:40.239 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:08:40.240 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:08:40.240 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:08:40.240 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:08:40.240 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:08:40.240 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:08:40.240 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:08:40.240 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:40.240 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:08:40.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:40.240 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:08:40.240 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 5, 2024-05-28T06:08:40.240 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:07:53.268069+0000", 2024-05-28T06:08:40.240 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:08:40.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:40.240 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:08:40.241 INFO:teuthology.orchestra.run.smithi122.stdout: "438f16d6-8ab7-4475-aa32-a0b2476e25e8": { 2024-05-28T06:08:40.241 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "1 ongoing clones; Avg progress is 0.0% (1s)\n [............................] ", 2024-05-28T06:08:40.241 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0, 2024-05-28T06:08:40.241 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:08:40.241 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:40.241 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:40.241 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:08:40.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.233+0000 7f5ed7400640 1 -- 172.21.15.122:0/913040852 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5eb0068530 msgr2=0x7f5eb006a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:40.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.233+0000 7f5ed7400640 1 --2- 172.21.15.122:0/913040852 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5eb0068530 0x7f5eb006a9f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5ec40ae000 tx=0x7f5ec40a7000 comp rx=0 tx=0).stop 2024-05-28T06:08:40.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.233+0000 7f5ed7400640 1 -- 172.21.15.122:0/913040852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ed015d7e0 msgr2=0x7f5ed00b7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:40.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.233+0000 7f5ed7400640 1 --2- 172.21.15.122:0/913040852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ed015d7e0 0x7f5ed00b7e90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5ec800b9a0 tx=0x7f5ec800be60 comp rx=0 tx=0).stop 2024-05-28T06:08:40.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.233+0000 7f5ed7400640 1 -- 172.21.15.122:0/913040852 shutdown_connections 2024-05-28T06:08:40.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.233+0000 7f5ed7400640 1 --2- 172.21.15.122:0/913040852 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5eb0068530 0x7f5eb006a9f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:40.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.233+0000 7f5ed7400640 1 --2- 172.21.15.122:0/913040852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ed015d7e0 0x7f5ed00b7e90 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:40.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.233+0000 7f5ed7400640 1 --2- 172.21.15.122:0/913040852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ed00d0c80 0x7f5ed015ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:40.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.233+0000 7f5ed7400640 1 --2- 172.21.15.122:0/913040852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ed00d0270 0x7f5ed01496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:40.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.233+0000 7f5ed7400640 1 -- 172.21.15.122:0/913040852 >> 172.21.15.122:0/913040852 conn(0x7f5ed00b4190 msgr2=0x7f5ed00c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:40.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.237+0000 7f5ed7400640 1 -- 172.21.15.122:0/913040852 shutdown_connections 2024-05-28T06:08:40.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.237+0000 7f5ed7400640 1 -- 172.21.15.122:0/913040852 wait complete. 2024-05-28T06:08:40.290 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs ss1clone1 2024-05-28T06:08:40.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.573+0000 7fd698a00640 1 Processor -- start 2024-05-28T06:08:40.578 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.573+0000 7fd698a00640 1 -- start start 2024-05-28T06:08:40.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.577+0000 7fd698a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd6940b4560 0x7fd69406b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:40.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.577+0000 7fd698a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd69406bed0 0x7fd6940ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:40.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.577+0000 7fd698a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6941631c0 con 0x7fd694162de0 2024-05-28T06:08:40.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.577+0000 7fd698a00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fd69406c340 con 0x7fd6940b4560 2024-05-28T06:08:40.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.577+0000 7fd698a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd6940b4bf0 con 0x7fd69406bed0 2024-05-28T06:08:40.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.577+0000 7fd691e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd694162de0 0x7fd694073aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:58476/0 (socket says 172.21.15.122:58476) 2024-05-28T06:08:40.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.577+0000 7fd691e00640 1 -- 172.21.15.122:0/2309219759 learned_addr learned my addr 172.21.15.122:0/2309219759 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:08:40.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.577+0000 7fd68be00640 1 --2- 172.21.15.122:0/2309219759 >> v2:172.21.15.122:3300/0 conn(0x7fd6940b4560 0x7fd69406b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:40.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.577+0000 7fd692800640 1 --2- 172.21.15.122:0/2309219759 >> v2:172.21.15.153:3300/0 conn(0x7fd69406bed0 0x7fd6940ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:40.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.577+0000 7fd68be00640 1 -- 172.21.15.122:0/2309219759 >> v2:172.21.15.153:3300/0 conn(0x7fd69406bed0 msgr2=0x7fd6940ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:08:40.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.577+0000 7fd68be00640 1 --2- 172.21.15.122:0/2309219759 >> v2:172.21.15.153:3300/0 conn(0x7fd69406bed0 0x7fd6940ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:40.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.577+0000 7fd68be00640 1 -- 172.21.15.122:0/2309219759 >> v1:172.21.15.153:6789/0 conn(0x7fd694162de0 legacy=0x7fd694073aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:40.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.577+0000 7fd68be00640 1 -- 172.21.15.122:0/2309219759 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6940b4ed0 con 0x7fd6940b4560 2024-05-28T06:08:40.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.581+0000 7fd68be00640 1 --2- 172.21.15.122:0/2309219759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6940b4560 0x7fd69406b990 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd694166890 tx=0x7fd67c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e247e6dc361414 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:40.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.581+0000 7fd691400640 1 -- 172.21.15.122:0/2309219759 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c0b0070 con 0x7fd6940b4560 2024-05-28T06:08:40.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.585+0000 7fd691400640 1 -- 172.21.15.122:0/2309219759 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd67c0ab600 con 0x7fd6940b4560 2024-05-28T06:08:40.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.585+0000 7fd691400640 1 -- 172.21.15.122:0/2309219759 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c0ab9d0 con 0x7fd6940b4560 2024-05-28T06:08:40.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.585+0000 7fd698a00640 1 -- 172.21.15.122:0/2309219759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6940b4560 msgr2=0x7fd69406b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:40.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.585+0000 7fd698a00640 1 --2- 172.21.15.122:0/2309219759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6940b4560 0x7fd69406b990 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd694166890 tx=0x7fd67c01c3f0 comp rx=0 tx=0).stop 2024-05-28T06:08:40.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.585+0000 7fd698a00640 1 -- 172.21.15.122:0/2309219759 shutdown_connections 2024-05-28T06:08:40.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.585+0000 7fd698a00640 1 --2- 172.21.15.122:0/2309219759 >> v2:172.21.15.153:3300/0 conn(0x7fd69406bed0 0x7fd6940ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:40.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.585+0000 7fd698a00640 1 --2- 172.21.15.122:0/2309219759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6940b4560 0x7fd69406b990 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:40.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.585+0000 7fd698a00640 1 -- 172.21.15.122:0/2309219759 >> 172.21.15.122:0/2309219759 conn(0x7fd694062610 msgr2=0x7fd69406caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:40.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.585+0000 7fd698a00640 1 -- 172.21.15.122:0/2309219759 shutdown_connections 2024-05-28T06:08:40.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.585+0000 7fd698a00640 1 -- 172.21.15.122:0/2309219759 wait complete. 2024-05-28T06:08:40.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.585+0000 7fd698a00640 1 Processor -- start 2024-05-28T06:08:40.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.585+0000 7fd698a00640 1 -- start start 2024-05-28T06:08:40.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd698a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd69406bed0 0x7fd69414fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:40.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd698a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6940b4560 0x7fd694151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:40.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd698a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd694162de0 0x7fd694151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:40.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd698a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd6940cf330 con 0x7fd69406bed0 2024-05-28T06:08:40.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd698a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd6940cf1b0 con 0x7fd6940b4560 2024-05-28T06:08:40.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd698a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd6940cf4b0 con 0x7fd694162de0 2024-05-28T06:08:40.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd691e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd69406bed0 0x7fd69414fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:40.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd691e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd69406bed0 0x7fd69414fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58614/0 (socket says 172.21.15.122:58614) 2024-05-28T06:08:40.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd691e00640 1 -- 172.21.15.122:0/3092070373 learned_addr learned my addr 172.21.15.122:0/3092070373 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:08:40.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd68be00640 1 --2- 172.21.15.122:0/3092070373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6940b4560 0x7fd694151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:40.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd692800640 1 --2- 172.21.15.122:0/3092070373 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd694162de0 0x7fd694151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:40.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd691e00640 1 -- 172.21.15.122:0/3092070373 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd694162de0 msgr2=0x7fd694151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:40.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd691e00640 1 --2- 172.21.15.122:0/3092070373 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd694162de0 0x7fd694151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:40.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd691e00640 1 -- 172.21.15.122:0/3092070373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6940b4560 msgr2=0x7fd694151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:40.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd691e00640 1 --2- 172.21.15.122:0/3092070373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6940b4560 0x7fd694151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:40.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd691e00640 1 -- 172.21.15.122:0/3092070373 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6941528c0 con 0x7fd69406bed0 2024-05-28T06:08:40.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd692800640 1 --2- 172.21.15.122:0/3092070373 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd694162de0 0x7fd694151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:08:40.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd691e00640 1 --2- 172.21.15.122:0/3092070373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd69406bed0 0x7fd69414fa20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd68400c370 tx=0x7fd68400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:40.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd68a000640 1 -- 172.21.15.122:0/3092070373 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd684017070 con 0x7fd69406bed0 2024-05-28T06:08:40.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd68a000640 1 -- 172.21.15.122:0/3092070373 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd684005cf0 con 0x7fd69406bed0 2024-05-28T06:08:40.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd698a00640 1 -- 172.21.15.122:0/3092070373 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd694157990 con 0x7fd69406bed0 2024-05-28T06:08:40.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd68a000640 1 -- 172.21.15.122:0/3092070373 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6840072f0 con 0x7fd69406bed0 2024-05-28T06:08:40.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd698a00640 1 -- 172.21.15.122:0/3092070373 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd694157f50 con 0x7fd69406bed0 2024-05-28T06:08:40.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.589+0000 7fd698a00640 1 -- 172.21.15.122:0/3092070373 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd694158150 con 0x7fd69406bed0 2024-05-28T06:08:40.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.593+0000 7fd68a000640 1 -- 172.21.15.122:0/3092070373 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7fd68401a070 con 0x7fd69406bed0 2024-05-28T06:08:40.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.593+0000 7fd68a000640 1 --2- 172.21.15.122:0/3092070373 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd670068580 0x7fd67006aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:40.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.593+0000 7fd68a000640 1 -- 172.21.15.122:0/3092070373 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd684086390 con 0x7fd69406bed0 2024-05-28T06:08:40.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.593+0000 7fd68be00640 1 --2- 172.21.15.122:0/3092070373 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd670068580 0x7fd67006aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:40.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.593+0000 7fd68be00640 1 --2- 172.21.15.122:0/3092070373 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd670068580 0x7fd67006aa40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0ad000 tx=0x7fd67c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:40.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.597+0000 7fd68a000640 1 -- 172.21.15.122:0/3092070373 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd694158150 con 0x7fd69406bed0 2024-05-28T06:08:40.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:40.949+0000 7fd698a00640 1 -- 172.21.15.122:0/3092070373 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7fd694076020 con 0x7fd670068580 2024-05-28T06:08:41.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.077+0000 7fd68a000640 1 -- 172.21.15.122:0/3092070373 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd67c0ab660 con 0x7fd670068580 2024-05-28T06:08:41.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.081+0000 7fd698a00640 1 -- 172.21.15.122:0/3092070373 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd670068580 msgr2=0x7fd67006aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:41.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.081+0000 7fd698a00640 1 --2- 172.21.15.122:0/3092070373 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd670068580 0x7fd67006aa40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0ad000 tx=0x7fd67c008040 comp rx=0 tx=0).stop 2024-05-28T06:08:41.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.081+0000 7fd698a00640 1 -- 172.21.15.122:0/3092070373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd69406bed0 msgr2=0x7fd69414fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:41.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.081+0000 7fd698a00640 1 --2- 172.21.15.122:0/3092070373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd69406bed0 0x7fd69414fa20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd68400c370 tx=0x7fd68400c830 comp rx=0 tx=0).stop 2024-05-28T06:08:41.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.081+0000 7fd698a00640 1 -- 172.21.15.122:0/3092070373 shutdown_connections 2024-05-28T06:08:41.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.081+0000 7fd698a00640 1 --2- 172.21.15.122:0/3092070373 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd670068580 0x7fd67006aa40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:41.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.081+0000 7fd698a00640 1 --2- 172.21.15.122:0/3092070373 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd694162de0 0x7fd694151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:41.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.081+0000 7fd698a00640 1 --2- 172.21.15.122:0/3092070373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6940b4560 0x7fd694151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:41.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.081+0000 7fd698a00640 1 --2- 172.21.15.122:0/3092070373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd69406bed0 0x7fd69414fa20 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:41.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.081+0000 7fd698a00640 1 -- 172.21.15.122:0/3092070373 >> 172.21.15.122:0/3092070373 conn(0x7fd694062610 msgr2=0x7fd6940b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:41.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.081+0000 7fd698a00640 1 -- 172.21.15.122:0/3092070373 shutdown_connections 2024-05-28T06:08:41.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.081+0000 7fd698a00640 1 -- 172.21.15.122:0/3092070373 wait complete. 2024-05-28T06:08:41.104 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-28T06:08:41.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.241+0000 7f66b7e00640 1 Processor -- start 2024-05-28T06:08:41.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.241+0000 7f66b7e00640 1 -- start start 2024-05-28T06:08:41.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.241+0000 7f66b7e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f66b00b4e10 0x7f66b006f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:41.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.241+0000 7f66b7e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66b00b54d0 con 0x7f66b0159280 2024-05-28T06:08:41.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.241+0000 7f66b7e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66b00b57b0 con 0x7f66b00cced0 2024-05-28T06:08:41.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.241+0000 7f66b7e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f66b015c310 con 0x7f66b00b4e10 2024-05-28T06:08:41.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.241+0000 7f66b5400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f66b0159280 0x7f66b015c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:53474/0 (socket says 172.21.15.122:53474) 2024-05-28T06:08:41.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.241+0000 7f66b5400640 1 -- 172.21.15.122:0/924778666 learned_addr learned my addr 172.21.15.122:0/924778666 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:08:41.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.241+0000 7f66b4a00640 1 --2- 172.21.15.122:0/924778666 >> v2:172.21.15.153:3300/0 conn(0x7f66b00b4e10 0x7f66b006f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:41.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.241+0000 7f66afe00640 1 -- 172.21.15.122:0/924778666 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 804206332 0 0) 0x7f66b00b54d0 con 0x7f66b0159280 2024-05-28T06:08:41.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.241+0000 7f66afe00640 1 -- 172.21.15.122:0/924778666 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6698003530 con 0x7f66b0159280 2024-05-28T06:08:41.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.241+0000 7f66afe00640 1 -- 172.21.15.122:0/924778666 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 896802977 0 0) 0x7f66b00b57b0 con 0x7f66b00cced0 2024-05-28T06:08:41.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.241+0000 7f66afe00640 1 -- 172.21.15.122:0/924778666 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66b00b54d0 con 0x7f66b00cced0 2024-05-28T06:08:41.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.241+0000 7f66afe00640 1 -- 172.21.15.122:0/924778666 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1729607688 0 0) 0x7f6698003530 con 0x7f66b0159280 2024-05-28T06:08:41.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.241+0000 7f66b4a00640 1 -- 172.21.15.122:0/924778666 >> v1:172.21.15.153:6789/0 conn(0x7f66b00cced0 legacy=0x7f66b00cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:41.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.241+0000 7f66b4a00640 1 -- 172.21.15.122:0/924778666 >> v1:172.21.15.122:6789/0 conn(0x7f66b0159280 legacy=0x7f66b015c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:41.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.241+0000 7f66b4a00640 1 -- 172.21.15.122:0/924778666 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b015bfa0 con 0x7f66b00b4e10 2024-05-28T06:08:41.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.245+0000 7f66b4a00640 1 --2- 172.21.15.122:0/924778666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66b00b4e10 0x7f66b006f1e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f66b015c490 tx=0x7f669c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3b67aaa538880e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:41.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.245+0000 7f66afe00640 1 -- 172.21.15.122:0/924778666 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c0b0070 con 0x7f66b00b4e10 2024-05-28T06:08:41.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.245+0000 7f66afe00640 1 -- 172.21.15.122:0/924778666 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f669c0ab400 con 0x7f66b00b4e10 2024-05-28T06:08:41.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.245+0000 7f66afe00640 1 -- 172.21.15.122:0/924778666 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a4001680 con 0x7f66b00b4e10 2024-05-28T06:08:41.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.245+0000 7f66b7e00640 1 -- 172.21.15.122:0/924778666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66b00b4e10 msgr2=0x7f66b006f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:41.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.245+0000 7f66b7e00640 1 --2- 172.21.15.122:0/924778666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66b00b4e10 0x7f66b006f1e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f66b015c490 tx=0x7f669c01c3c0 comp rx=0 tx=0).stop 2024-05-28T06:08:41.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.245+0000 7f66b7e00640 1 -- 172.21.15.122:0/924778666 shutdown_connections 2024-05-28T06:08:41.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.245+0000 7f66b7e00640 1 --2- 172.21.15.122:0/924778666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66b00b4e10 0x7f66b006f1e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:41.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.245+0000 7f66b7e00640 1 -- 172.21.15.122:0/924778666 >> 172.21.15.122:0/924778666 conn(0x7f66b0062a40 msgr2=0x7f66b006b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:41.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.245+0000 7f66b7e00640 1 -- 172.21.15.122:0/924778666 shutdown_connections 2024-05-28T06:08:41.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.245+0000 7f66b7e00640 1 -- 172.21.15.122:0/924778666 wait complete. 2024-05-28T06:08:41.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66b7e00640 1 Processor -- start 2024-05-28T06:08:41.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66b7e00640 1 -- start start 2024-05-28T06:08:41.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66b7e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66b00b4e10 0x7f66b013f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:41.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66b7e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66b00cced0 0x7f66b0143f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:41.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66b7e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66b0159280 0x7f66b0144440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:41.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66b7e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f66b01694e0 con 0x7f66b00cced0 2024-05-28T06:08:41.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66b7e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f66b015fe60 con 0x7f66b00b4e10 2024-05-28T06:08:41.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66b7e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f66b0169660 con 0x7f66b0159280 2024-05-28T06:08:41.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66b4a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66b00cced0 0x7f66b0143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:41.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66b4a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66b00cced0 0x7f66b0143f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58624/0 (socket says 172.21.15.122:58624) 2024-05-28T06:08:41.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66b4a00640 1 -- 172.21.15.122:0/2274515538 learned_addr learned my addr 172.21.15.122:0/2274515538 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:08:41.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66b5400640 1 --2- 172.21.15.122:0/2274515538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66b00b4e10 0x7f66b013f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:41.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66b5e00640 1 --2- 172.21.15.122:0/2274515538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66b0159280 0x7f66b0144440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:41.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66b4a00640 1 -- 172.21.15.122:0/2274515538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66b0159280 msgr2=0x7f66b0144440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:41.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66b4a00640 1 --2- 172.21.15.122:0/2274515538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66b0159280 0x7f66b0144440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:41.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66b4a00640 1 -- 172.21.15.122:0/2274515538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66b00b4e10 msgr2=0x7f66b013f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:41.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66b4a00640 1 --2- 172.21.15.122:0/2274515538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66b00b4e10 0x7f66b013f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:41.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66b4a00640 1 -- 172.21.15.122:0/2274515538 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b00b2770 con 0x7f66b00cced0 2024-05-28T06:08:41.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66b4a00640 1 --2- 172.21.15.122:0/2274515538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66b00cced0 0x7f66b0143f00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f669c000c10 tx=0x7f669c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:41.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66ad600640 1 -- 172.21.15.122:0/2274515538 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c0b0040 con 0x7f66b00cced0 2024-05-28T06:08:41.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66ad600640 1 -- 172.21.15.122:0/2274515538 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f669c0b9070 con 0x7f66b00cced0 2024-05-28T06:08:41.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66ad600640 1 -- 172.21.15.122:0/2274515538 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c003b20 con 0x7f66b00cced0 2024-05-28T06:08:41.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66b7e00640 1 -- 172.21.15.122:0/2274515538 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66b00b2a50 con 0x7f66b00cced0 2024-05-28T06:08:41.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66b7e00640 1 -- 172.21.15.122:0/2274515538 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66b00b3010 con 0x7f66b00cced0 2024-05-28T06:08:41.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.249+0000 7f66b7e00640 1 -- 172.21.15.122:0/2274515538 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66b0068bd0 con 0x7f66b00cced0 2024-05-28T06:08:41.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.253+0000 7f66ad600640 1 -- 172.21.15.122:0/2274515538 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f669c003cc0 con 0x7f66b00cced0 2024-05-28T06:08:41.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.253+0000 7f66ad600640 1 --2- 172.21.15.122:0/2274515538 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6690068530 0x7f669006a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:41.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.253+0000 7f66ad600640 1 -- 172.21.15.122:0/2274515538 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f669c1208a0 con 0x7f66b00cced0 2024-05-28T06:08:41.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.253+0000 7f66b5400640 1 --2- 172.21.15.122:0/2274515538 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6690068530 0x7f669006a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:41.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.253+0000 7f66b5400640 1 --2- 172.21.15.122:0/2274515538 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6690068530 0x7f669006a9f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f66a4000fe0 tx=0x7f66a4001160 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:41.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.257+0000 7f66ad600640 1 -- 172.21.15.122:0/2274515538 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f669c015fb0 con 0x7f66b00cced0 2024-05-28T06:08:41.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.437+0000 7f66b7e00640 1 -- 172.21.15.122:0/2274515538 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f66b006f380 con 0x7f6690068530 2024-05-28T06:08:41.442 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.441+0000 7f66ad600640 1 -- 172.21.15.122:0/2274515538 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f66b006f380 con 0x7f6690068530 2024-05-28T06:08:41.443 INFO:teuthology.orchestra.run.smithi122.stdout:[ 2024-05-28T06:08:41.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:08:41.443 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "cephfs" 2024-05-28T06:08:41.443 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:41.443 INFO:teuthology.orchestra.run.smithi122.stdout:] 2024-05-28T06:08:41.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.441+0000 7f66b7e00640 1 -- 172.21.15.122:0/2274515538 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6690068530 msgr2=0x7f669006a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:41.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.441+0000 7f66b7e00640 1 --2- 172.21.15.122:0/2274515538 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6690068530 0x7f669006a9f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f66a4000fe0 tx=0x7f66a4001160 comp rx=0 tx=0).stop 2024-05-28T06:08:41.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.441+0000 7f66b7e00640 1 -- 172.21.15.122:0/2274515538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66b00cced0 msgr2=0x7f66b0143f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:41.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.441+0000 7f66b7e00640 1 --2- 172.21.15.122:0/2274515538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66b00cced0 0x7f66b0143f00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f669c000c10 tx=0x7f669c019160 comp rx=0 tx=0).stop 2024-05-28T06:08:41.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.441+0000 7f66b7e00640 1 -- 172.21.15.122:0/2274515538 shutdown_connections 2024-05-28T06:08:41.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.441+0000 7f66b7e00640 1 --2- 172.21.15.122:0/2274515538 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6690068530 0x7f669006a9f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:41.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.441+0000 7f66b7e00640 1 --2- 172.21.15.122:0/2274515538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66b0159280 0x7f66b0144440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:41.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.441+0000 7f66b7e00640 1 --2- 172.21.15.122:0/2274515538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66b00cced0 0x7f66b0143f00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:41.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.441+0000 7f66b7e00640 1 --2- 172.21.15.122:0/2274515538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66b00b4e10 0x7f66b013f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:41.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.441+0000 7f66b7e00640 1 -- 172.21.15.122:0/2274515538 >> 172.21.15.122:0/2274515538 conn(0x7f66b0062a40 msgr2=0x7f66b006b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:41.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.441+0000 7f66b7e00640 1 -- 172.21.15.122:0/2274515538 shutdown_connections 2024-05-28T06:08:41.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.441+0000 7f66b7e00640 1 -- 172.21.15.122:0/2274515538 wait complete. 2024-05-28T06:08:41.464 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:08:41.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.597+0000 7f1260800640 1 Processor -- start 2024-05-28T06:08:41.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.597+0000 7f1260800640 1 -- start start 2024-05-28T06:08:41.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.597+0000 7f1260800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f12580d1820 0x7f1258169ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:41.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.597+0000 7f1260800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f125806df80 con 0x7f12580b7b40 2024-05-28T06:08:41.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.597+0000 7f1260800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12580d2f10 con 0x7f125815ebf0 2024-05-28T06:08:41.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.597+0000 7f1260800640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f12580d46e0 con 0x7f12580d1820 2024-05-28T06:08:41.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.597+0000 7f125d400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f12580b7b40 0x7f12580d1110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:53480/0 (socket says 172.21.15.122:53480) 2024-05-28T06:08:41.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.597+0000 7f125d400640 1 -- 172.21.15.122:0/3867246861 learned_addr learned my addr 172.21.15.122:0/3867246861 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:08:41.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.597+0000 7f125e800640 1 --2- 172.21.15.122:0/3867246861 >> v2:172.21.15.122:3300/0 conn(0x7f12580d1820 0x7f1258169ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:41.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.597+0000 7f125ca00640 1 -- 172.21.15.122:0/3867246861 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1389233481 0 0) 0x7f125806df80 con 0x7f12580b7b40 2024-05-28T06:08:41.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.597+0000 7f125e800640 1 -- 172.21.15.122:0/3867246861 >> v1:172.21.15.153:6789/0 conn(0x7f125815ebf0 legacy=0x7f12580cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:08:41.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.597+0000 7f125e800640 1 -- 172.21.15.122:0/3867246861 >> v1:172.21.15.122:6789/0 conn(0x7f12580b7b40 legacy=0x7f12580d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:41.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.597+0000 7f125e800640 1 -- 172.21.15.122:0/3867246861 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12580cfb50 con 0x7f12580d1820 2024-05-28T06:08:41.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.601+0000 7f125e800640 1 --2- 172.21.15.122:0/3867246861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12580d1820 0x7f1258169ad0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1254009d90 tx=0x7f125401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7929ad42d9b722e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:41.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.601+0000 7f125ca00640 1 -- 172.21.15.122:0/3867246861 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12540b2070 con 0x7f12580d1820 2024-05-28T06:08:41.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.601+0000 7f125ca00640 1 -- 172.21.15.122:0/3867246861 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12540a5970 con 0x7f12580d1820 2024-05-28T06:08:41.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.601+0000 7f125ca00640 1 -- 172.21.15.122:0/3867246861 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12540a5d40 con 0x7f12580d1820 2024-05-28T06:08:41.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.601+0000 7f1260800640 1 -- 172.21.15.122:0/3867246861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12580d1820 msgr2=0x7f1258169ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:41.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.601+0000 7f1260800640 1 --2- 172.21.15.122:0/3867246861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12580d1820 0x7f1258169ad0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1254009d90 tx=0x7f125401c8b0 comp rx=0 tx=0).stop 2024-05-28T06:08:41.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.601+0000 7f1260800640 1 -- 172.21.15.122:0/3867246861 shutdown_connections 2024-05-28T06:08:41.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.601+0000 7f1260800640 1 --2- 172.21.15.122:0/3867246861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12580d1820 0x7f1258169ad0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:41.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.601+0000 7f1260800640 1 -- 172.21.15.122:0/3867246861 >> 172.21.15.122:0/3867246861 conn(0x7f125806ce10 msgr2=0x7f125806d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:41.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.601+0000 7f1260800640 1 -- 172.21.15.122:0/3867246861 shutdown_connections 2024-05-28T06:08:41.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.601+0000 7f1260800640 1 -- 172.21.15.122:0/3867246861 wait complete. 2024-05-28T06:08:41.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.601+0000 7f1260800640 1 Processor -- start 2024-05-28T06:08:41.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.601+0000 7f1260800640 1 -- start start 2024-05-28T06:08:41.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f1260800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12580b7b40 0x7f125815f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:41.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f1260800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12580d1820 0x7f12580ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:41.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f1260800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f125815ebf0 0x7f12581610b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:41.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f1260800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f125815efd0 con 0x7f12580d1820 2024-05-28T06:08:41.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f1260800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f12580cf810 con 0x7f125815ebf0 2024-05-28T06:08:41.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f1260800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1258162940 con 0x7f12580b7b40 2024-05-28T06:08:41.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f125d400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12580d1820 0x7f12580ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:41.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f125d400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12580d1820 0x7f12580ce3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58652/0 (socket says 172.21.15.122:58652) 2024-05-28T06:08:41.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f125d400640 1 -- 172.21.15.122:0/2318328963 learned_addr learned my addr 172.21.15.122:0/2318328963 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:08:41.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f125e800640 1 --2- 172.21.15.122:0/2318328963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f125815ebf0 0x7f12581610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:41.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f125de00640 1 --2- 172.21.15.122:0/2318328963 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12580b7b40 0x7f125815f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:41.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f125d400640 1 -- 172.21.15.122:0/2318328963 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12580b7b40 msgr2=0x7f125815f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:41.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f125d400640 1 --2- 172.21.15.122:0/2318328963 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12580b7b40 0x7f125815f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:41.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f125d400640 1 -- 172.21.15.122:0/2318328963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f125815ebf0 msgr2=0x7f12581610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:41.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f125d400640 1 --2- 172.21.15.122:0/2318328963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f125815ebf0 0x7f12581610b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:41.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f125d400640 1 -- 172.21.15.122:0/2318328963 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f125814dfc0 con 0x7f12580d1820 2024-05-28T06:08:41.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f125d400640 1 --2- 172.21.15.122:0/2318328963 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12580d1820 0x7f12580ce3e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f124800c4a0 tx=0x7f124800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:41.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f1252000640 1 -- 172.21.15.122:0/2318328963 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1248018070 con 0x7f12580d1820 2024-05-28T06:08:41.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f1252000640 1 -- 172.21.15.122:0/2318328963 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12480074e0 con 0x7f12580d1820 2024-05-28T06:08:41.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f1252000640 1 -- 172.21.15.122:0/2318328963 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1248004a30 con 0x7f12580d1820 2024-05-28T06:08:41.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f1260800640 1 -- 172.21.15.122:0/2318328963 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f125815f730 con 0x7f12580d1820 2024-05-28T06:08:41.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f1260800640 1 -- 172.21.15.122:0/2318328963 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1258161f20 con 0x7f12580d1820 2024-05-28T06:08:41.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f1260800640 1 -- 172.21.15.122:0/2318328963 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1258068c40 con 0x7f12580d1820 2024-05-28T06:08:41.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.605+0000 7f1252000640 1 -- 172.21.15.122:0/2318328963 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f124801b070 con 0x7f12580d1820 2024-05-28T06:08:41.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.609+0000 7f1252000640 1 --2- 172.21.15.122:0/2318328963 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f123c068560 0x7f123c06aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:41.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.609+0000 7f1252000640 1 -- 172.21.15.122:0/2318328963 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f1248085fa0 con 0x7f12580d1820 2024-05-28T06:08:41.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.609+0000 7f125de00640 1 --2- 172.21.15.122:0/2318328963 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f123c068560 0x7f123c06aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:41.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.609+0000 7f125de00640 1 --2- 172.21.15.122:0/2318328963 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f123c068560 0x7f123c06aa20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f124c001770 tx=0x7f124c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:41.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.613+0000 7f1252000640 1 -- 172.21.15.122:0/2318328963 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1248055c10 con 0x7f12580d1820 2024-05-28T06:08:41.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.825+0000 7f1260800640 1 -- 172.21.15.122:0/2318328963 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f12580d26b0 con 0x7f12580d1820 2024-05-28T06:08:41.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.829+0000 7f1252000640 1 -- 172.21.15.122:0/2318328963 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2132 (secure 0 0 0) 0x7f1248059f10 con 0x7f12580d1820 2024-05-28T06:08:41.831 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:08:41.831 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:08:41.831 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:08:41.831 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:08:41.831 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:08:41.831 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:08:41.831 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:08:41.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:41.831 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:08:41.831 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:08:41.832 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:08:41.832 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:08:41.832 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:08:41.832 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:41.832 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:08:41.832 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:08:41.832 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:08:41.832 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:08:41.832 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:41.832 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 197, 2024-05-28T06:08:41.832 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:08:41.832 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:08:41.832 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:08:41.832 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:08:41.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:41.833 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:08:41.833 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 34, 2024-05-28T06:08:41.833 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:08:41.833 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:08:41.833 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:08:41.833 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:08:41.833 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:08:41.833 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:08:41.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:41.833 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:08:41.833 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:08:41.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:08:41.834 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:08:41.834 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:08:41.834 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:41.834 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:41.834 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:08:41.834 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:08:41.834 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 2589, 2024-05-28T06:08:41.834 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 10738637096, 2024-05-28T06:08:41.834 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 21735849984, 2024-05-28T06:08:41.834 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 751358263296, 2024-05-28T06:08:41.834 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:08:41.834 INFO:teuthology.orchestra.run.smithi122.stdout: "read_bytes_sec": 341, 2024-05-28T06:08:41.834 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 89463710, 2024-05-28T06:08:41.834 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 0, 2024-05-28T06:08:41.835 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 24 2024-05-28T06:08:41.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:41.835 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:08:41.835 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 19, 2024-05-28T06:08:41.835 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 2, 2024-05-28T06:08:41.835 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:08:41.835 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:08:41.835 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:08:41.835 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:08:41.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:08:41.835 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 2, 2024-05-28T06:08:41.835 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:08:41.835 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "a", 2024-05-28T06:08:41.835 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:08:41.836 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 5082 2024-05-28T06:08:41.836 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:41.836 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:41.836 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:08:41.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:41.836 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:08:41.836 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:08:41.836 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:08:41.836 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:08:41.836 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:08:41.836 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:08:41.836 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:08:41.836 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:41.836 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:08:41.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:41.837 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:08:41.837 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 5, 2024-05-28T06:08:41.837 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:07:53.268069+0000", 2024-05-28T06:08:41.837 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:08:41.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:41.837 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:08:41.837 INFO:teuthology.orchestra.run.smithi122.stdout: "438f16d6-8ab7-4475-aa32-a0b2476e25e8": { 2024-05-28T06:08:41.837 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "1 ongoing clones; Avg progress is 10.313% (3s)\n [==..........................] (remaining: 27s)", 2024-05-28T06:08:41.837 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.10312999784946442, 2024-05-28T06:08:41.837 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:08:41.837 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:41.837 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:41.837 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:08:41.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.829+0000 7f1260800640 1 -- 172.21.15.122:0/2318328963 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f123c068560 msgr2=0x7f123c06aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:41.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.829+0000 7f1260800640 1 --2- 172.21.15.122:0/2318328963 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f123c068560 0x7f123c06aa20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f124c001770 tx=0x7f124c009040 comp rx=0 tx=0).stop 2024-05-28T06:08:41.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.829+0000 7f1260800640 1 -- 172.21.15.122:0/2318328963 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12580d1820 msgr2=0x7f12580ce3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:41.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.829+0000 7f1260800640 1 --2- 172.21.15.122:0/2318328963 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12580d1820 0x7f12580ce3e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f124800c4a0 tx=0x7f124800c960 comp rx=0 tx=0).stop 2024-05-28T06:08:41.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.829+0000 7f1260800640 1 -- 172.21.15.122:0/2318328963 shutdown_connections 2024-05-28T06:08:41.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.829+0000 7f1260800640 1 --2- 172.21.15.122:0/2318328963 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f123c068560 0x7f123c06aa20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:41.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.829+0000 7f1260800640 1 --2- 172.21.15.122:0/2318328963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f125815ebf0 0x7f12581610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:41.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.829+0000 7f1260800640 1 --2- 172.21.15.122:0/2318328963 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12580d1820 0x7f12580ce3e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:41.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.829+0000 7f1260800640 1 --2- 172.21.15.122:0/2318328963 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12580b7b40 0x7f125815f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:41.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.829+0000 7f1260800640 1 -- 172.21.15.122:0/2318328963 >> 172.21.15.122:0/2318328963 conn(0x7f125806ce10 msgr2=0x7f125815d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:41.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.829+0000 7f1260800640 1 -- 172.21.15.122:0/2318328963 shutdown_connections 2024-05-28T06:08:41.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:41.829+0000 7f1260800640 1 -- 172.21.15.122:0/2318328963 wait complete. 2024-05-28T06:08:46.852 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:08:47.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.001+0000 7fdeb8a00640 1 Processor -- start 2024-05-28T06:08:47.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.001+0000 7fdeb8a00640 1 -- start start 2024-05-28T06:08:47.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.005+0000 7fdeb8a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdeb40cff30 0x7fdeb406f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:47.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.005+0000 7fdeb8a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdeb406f6c0 0x7fdeb40cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:47.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.005+0000 7fdeb8a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeb40d0310 con 0x7fdeb40cd930 2024-05-28T06:08:47.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.005+0000 7fdeb8a00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fdeb406fb30 con 0x7fdeb406f6c0 2024-05-28T06:08:47.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.005+0000 7fdeb8a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fdeb415be20 con 0x7fdeb40cff30 2024-05-28T06:08:47.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.005+0000 7fdea9400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdeb406f6c0 0x7fdeb40cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:47.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.005+0000 7fdea9400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdeb406f6c0 0x7fdeb40cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35566/0 (socket says 172.21.15.122:35566) 2024-05-28T06:08:47.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.005+0000 7fdea9400640 1 -- 172.21.15.122:0/2133306566 learned_addr learned my addr 172.21.15.122:0/2133306566 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:08:47.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.005+0000 7fdeb1e00640 1 --2- 172.21.15.122:0/2133306566 >> v2:172.21.15.153:3300/0 conn(0x7fdeb40cff30 0x7fdeb406f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:47.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.005+0000 7fdea9400640 1 -- 172.21.15.122:0/2133306566 >> v2:172.21.15.153:3300/0 conn(0x7fdeb40cff30 msgr2=0x7fdeb406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:08:47.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.005+0000 7fdea9400640 1 --2- 172.21.15.122:0/2133306566 >> v2:172.21.15.153:3300/0 conn(0x7fdeb40cff30 0x7fdeb406f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:47.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.005+0000 7fdea9400640 1 -- 172.21.15.122:0/2133306566 >> v1:172.21.15.153:6789/0 conn(0x7fdeb40cd930 legacy=0x7fdeb40722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:47.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.005+0000 7fdea9400640 1 -- 172.21.15.122:0/2133306566 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb415c100 con 0x7fdeb406f6c0 2024-05-28T06:08:47.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.005+0000 7fdea9400640 1 --2- 172.21.15.122:0/2133306566 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdeb406f6c0 0x7fdeb40cd3f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fdeb40b3dc0 tx=0x7fde9c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f656bd2f97f8c71 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:47.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdeb1400640 1 -- 172.21.15.122:0/2133306566 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9c0aa650 con 0x7fdeb406f6c0 2024-05-28T06:08:47.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdeb1400640 1 -- 172.21.15.122:0/2133306566 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde9c0af070 con 0x7fdeb406f6c0 2024-05-28T06:08:47.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdeb1400640 1 -- 172.21.15.122:0/2133306566 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9c0aaa10 con 0x7fdeb406f6c0 2024-05-28T06:08:47.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdeb8a00640 1 -- 172.21.15.122:0/2133306566 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdeb406f6c0 msgr2=0x7fdeb40cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:47.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdeb8a00640 1 --2- 172.21.15.122:0/2133306566 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdeb406f6c0 0x7fdeb40cd3f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fdeb40b3dc0 tx=0x7fde9c01c4f0 comp rx=0 tx=0).stop 2024-05-28T06:08:47.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdeb8a00640 1 -- 172.21.15.122:0/2133306566 shutdown_connections 2024-05-28T06:08:47.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdeb8a00640 1 --2- 172.21.15.122:0/2133306566 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdeb406f6c0 0x7fdeb40cd3f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:47.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdeb8a00640 1 --2- 172.21.15.122:0/2133306566 >> v2:172.21.15.153:3300/0 conn(0x7fdeb40cff30 0x7fdeb406f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:47.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdeb8a00640 1 -- 172.21.15.122:0/2133306566 >> 172.21.15.122:0/2133306566 conn(0x7fdeb406bd90 msgr2=0x7fdeb406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:47.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdeb8a00640 1 -- 172.21.15.122:0/2133306566 shutdown_connections 2024-05-28T06:08:47.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdeb8a00640 1 -- 172.21.15.122:0/2133306566 wait complete. 2024-05-28T06:08:47.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdeb8a00640 1 Processor -- start 2024-05-28T06:08:47.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdeb8a00640 1 -- start start 2024-05-28T06:08:47.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdeb8a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdeb406f6c0 0x7fdeb4152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:47.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdeb8a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdeb40cd930 0x7fdeb4145fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:47.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdeb8a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdeb40cff30 0x7fdeb41561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:47.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdeb8a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb40cde90 con 0x7fdeb40cd930 2024-05-28T06:08:47.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdeb8a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb40cdd10 con 0x7fdeb406f6c0 2024-05-28T06:08:47.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdeb8a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdeb40b59c0 con 0x7fdeb40cff30 2024-05-28T06:08:47.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdea9400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdeb40cd930 0x7fdeb4145fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:47.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdea9400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdeb40cd930 0x7fdeb4145fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35576/0 (socket says 172.21.15.122:35576) 2024-05-28T06:08:47.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdea9400640 1 -- 172.21.15.122:0/3360243705 learned_addr learned my addr 172.21.15.122:0/3360243705 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:08:47.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdeb1e00640 1 --2- 172.21.15.122:0/3360243705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdeb406f6c0 0x7fdeb4152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:47.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.009+0000 7fdeb2800640 1 --2- 172.21.15.122:0/3360243705 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdeb40cff30 0x7fdeb41561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:47.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.013+0000 7fdea9400640 1 -- 172.21.15.122:0/3360243705 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdeb40cff30 msgr2=0x7fdeb41561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:47.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.013+0000 7fdea9400640 1 --2- 172.21.15.122:0/3360243705 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdeb40cff30 0x7fdeb41561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:47.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.013+0000 7fdea9400640 1 -- 172.21.15.122:0/3360243705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdeb406f6c0 msgr2=0x7fdeb4152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:47.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.013+0000 7fdea9400640 1 --2- 172.21.15.122:0/3360243705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdeb406f6c0 0x7fdeb4152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:47.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.013+0000 7fdea9400640 1 -- 172.21.15.122:0/3360243705 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb4146510 con 0x7fdeb40cd930 2024-05-28T06:08:47.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.013+0000 7fdea9400640 1 --2- 172.21.15.122:0/3360243705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdeb40cd930 0x7fdeb4145fd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fde9c019100 tx=0x7fde9c01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:47.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.013+0000 7fdeaaa00640 1 -- 172.21.15.122:0/3360243705 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9c0bd5f0 con 0x7fdeb40cd930 2024-05-28T06:08:47.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.013+0000 7fdeaaa00640 1 -- 172.21.15.122:0/3360243705 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde9c0a6040 con 0x7fdeb40cd930 2024-05-28T06:08:47.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.013+0000 7fdeaaa00640 1 -- 172.21.15.122:0/3360243705 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9c0bd990 con 0x7fdeb40cd930 2024-05-28T06:08:47.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.013+0000 7fdeb8a00640 1 -- 172.21.15.122:0/3360243705 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeb41566f0 con 0x7fdeb40cd930 2024-05-28T06:08:47.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.013+0000 7fdeb8a00640 1 -- 172.21.15.122:0/3360243705 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeb4156c70 con 0x7fdeb40cd930 2024-05-28T06:08:47.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.013+0000 7fdeb8a00640 1 -- 172.21.15.122:0/3360243705 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeb4068c40 con 0x7fdeb40cd930 2024-05-28T06:08:47.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.013+0000 7fdeaaa00640 1 -- 172.21.15.122:0/3360243705 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7fde9c0b33f0 con 0x7fdeb40cd930 2024-05-28T06:08:47.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.013+0000 7fdeaaa00640 1 --2- 172.21.15.122:0/3360243705 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fde90068530 0x7fde9006a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:47.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.013+0000 7fdeaaa00640 1 -- 172.21.15.122:0/3360243705 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fde9c120fc0 con 0x7fdeb40cd930 2024-05-28T06:08:47.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.013+0000 7fdeb1e00640 1 --2- 172.21.15.122:0/3360243705 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fde90068530 0x7fde9006a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:47.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.017+0000 7fdeb1e00640 1 --2- 172.21.15.122:0/3360243705 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fde90068530 0x7fde9006a9f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdea40079c0 tx=0x7fdea4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:47.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.021+0000 7fdeaaa00640 1 -- 172.21.15.122:0/3360243705 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fde9c016110 con 0x7fdeb40cd930 2024-05-28T06:08:47.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.229+0000 7fdeb8a00640 1 -- 172.21.15.122:0/3360243705 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fdeb40af910 con 0x7fdeb40cd930 2024-05-28T06:08:47.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.229+0000 7fdeaaa00640 1 -- 172.21.15.122:0/3360243705 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2122 (secure 0 0 0) 0x7fde9c0f0bb0 con 0x7fdeb40cd930 2024-05-28T06:08:47.232 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:08:47.232 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:08:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:08:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:08:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:08:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:08:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:08:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:08:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:08:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:08:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:08:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:08:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:08:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:08:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:08:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:08:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 202, 2024-05-28T06:08:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:08:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:08:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:08:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:08:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:08:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 34, 2024-05-28T06:08:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:08:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:08:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:08:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:08:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:08:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:08:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:08:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:08:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:08:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:08:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:08:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:08:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:08:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 3030, 2024-05-28T06:08:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 12575853534, 2024-05-28T06:08:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 25410297856, 2024-05-28T06:08:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 747683815424, 2024-05-28T06:08:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:08:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "read_bytes_sec": 155148498, 2024-05-28T06:08:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 153068968, 2024-05-28T06:08:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 37, 2024-05-28T06:08:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 42 2024-05-28T06:08:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:08:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 19, 2024-05-28T06:08:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 2, 2024-05-28T06:08:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:08:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:08:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:08:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:08:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:08:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 2, 2024-05-28T06:08:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:08:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "a", 2024-05-28T06:08:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:08:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 5082 2024-05-28T06:08:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:08:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:08:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:08:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:08:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:08:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:08:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:08:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:08:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:08:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:08:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 5, 2024-05-28T06:08:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:07:53.268069+0000", 2024-05-28T06:08:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:08:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:47.239 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:08:47.239 INFO:teuthology.orchestra.run.smithi122.stdout: "438f16d6-8ab7-4475-aa32-a0b2476e25e8": { 2024-05-28T06:08:47.239 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "All cloning finished, waiting 27.0 seconds before exiting (7s)\n [============================] ", 2024-05-28T06:08:47.239 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 1, 2024-05-28T06:08:47.239 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:08:47.239 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:47.239 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:47.239 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:08:47.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.229+0000 7fdeb8a00640 1 -- 172.21.15.122:0/3360243705 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fde90068530 msgr2=0x7fde9006a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:47.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.229+0000 7fdeb8a00640 1 --2- 172.21.15.122:0/3360243705 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fde90068530 0x7fde9006a9f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdea40079c0 tx=0x7fdea4008040 comp rx=0 tx=0).stop 2024-05-28T06:08:47.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.229+0000 7fdeb8a00640 1 -- 172.21.15.122:0/3360243705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdeb40cd930 msgr2=0x7fdeb4145fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:47.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.229+0000 7fdeb8a00640 1 --2- 172.21.15.122:0/3360243705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdeb40cd930 0x7fdeb4145fd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fde9c019100 tx=0x7fde9c01ad30 comp rx=0 tx=0).stop 2024-05-28T06:08:47.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.229+0000 7fdeb8a00640 1 -- 172.21.15.122:0/3360243705 shutdown_connections 2024-05-28T06:08:47.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.229+0000 7fdeb8a00640 1 --2- 172.21.15.122:0/3360243705 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fde90068530 0x7fde9006a9f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:47.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.229+0000 7fdeb8a00640 1 --2- 172.21.15.122:0/3360243705 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdeb40cff30 0x7fdeb41561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:47.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.229+0000 7fdeb8a00640 1 --2- 172.21.15.122:0/3360243705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdeb40cd930 0x7fdeb4145fd0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:47.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.229+0000 7fdeb8a00640 1 --2- 172.21.15.122:0/3360243705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdeb406f6c0 0x7fdeb4152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:47.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.229+0000 7fdeb8a00640 1 -- 172.21.15.122:0/3360243705 >> 172.21.15.122:0/3360243705 conn(0x7fdeb406bd90 msgr2=0x7fdeb4146820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:47.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.233+0000 7fdeb8a00640 1 -- 172.21.15.122:0/3360243705 shutdown_connections 2024-05-28T06:08:47.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:47.233+0000 7fdeb8a00640 1 -- 172.21.15.122:0/3360243705 wait complete. 2024-05-28T06:08:47.812 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:08:47.815 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:08:52.253 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:08:52.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.397+0000 7f093f000640 1 Processor -- start 2024-05-28T06:08:52.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.397+0000 7f093f000640 1 -- start start 2024-05-28T06:08:52.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.401+0000 7f093f000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09380b5900 0x7f093815b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:52.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.401+0000 7f093f000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f093806e6c0 0x7f093815b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:52.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.401+0000 7f093f000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09380b0240 con 0x7f09380b5520 2024-05-28T06:08:52.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.401+0000 7f093f000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f093815bb70 con 0x7f093806e6c0 2024-05-28T06:08:52.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.401+0000 7f093f000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f09380af9a0 con 0x7f09380b5900 2024-05-28T06:08:52.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.401+0000 7f093d000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f093806e6c0 0x7f093815b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:52.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.401+0000 7f092f400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09380b5900 0x7f093815b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:52.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.401+0000 7f0937e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f09380b5520 0x7f09380aeec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:38602/0 (socket says 172.21.15.122:38602) 2024-05-28T06:08:52.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.401+0000 7f0937e00640 1 -- 172.21.15.122:0/3358522428 learned_addr learned my addr 172.21.15.122:0/3358522428 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:08:52.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.401+0000 7f0937400640 1 -- 172.21.15.122:0/3358522428 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2475472883 0 0) 0x7f09380b0240 con 0x7f09380b5520 2024-05-28T06:08:52.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.401+0000 7f0937400640 1 -- 172.21.15.122:0/3358522428 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f091c005740 con 0x7f09380b5520 2024-05-28T06:08:52.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.401+0000 7f093d000640 1 -- 172.21.15.122:0/3358522428 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09380b5900 msgr2=0x7f093815b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:08:52.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.401+0000 7f093d000640 1 --2- 172.21.15.122:0/3358522428 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09380b5900 0x7f093815b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:52.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.401+0000 7f093d000640 1 -- 172.21.15.122:0/3358522428 >> v1:172.21.15.153:6789/0 conn(0x7f09380b5520 legacy=0x7f09380aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:52.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.401+0000 7f093d000640 1 -- 172.21.15.122:0/3358522428 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09380afc80 con 0x7f093806e6c0 2024-05-28T06:08:52.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.401+0000 7f092f400640 1 --2- 172.21.15.122:0/3358522428 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09380b5900 0x7f093815b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:08:52.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.405+0000 7f093d000640 1 --2- 172.21.15.122:0/3358522428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f093806e6c0 0x7f093815b630 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0930009d90 tx=0x7f093001c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d809997d5c69472 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:52.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.405+0000 7f0937400640 1 -- 172.21.15.122:0/3358522428 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09300b2070 con 0x7f093806e6c0 2024-05-28T06:08:52.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.405+0000 7f0937400640 1 -- 172.21.15.122:0/3358522428 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09300a5820 con 0x7f093806e6c0 2024-05-28T06:08:52.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.405+0000 7f0937400640 1 -- 172.21.15.122:0/3358522428 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09300a5bf0 con 0x7f093806e6c0 2024-05-28T06:08:52.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.405+0000 7f093f000640 1 -- 172.21.15.122:0/3358522428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f093806e6c0 msgr2=0x7f093815b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:52.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.405+0000 7f093f000640 1 --2- 172.21.15.122:0/3358522428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f093806e6c0 0x7f093815b630 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0930009d90 tx=0x7f093001c850 comp rx=0 tx=0).stop 2024-05-28T06:08:52.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.405+0000 7f093f000640 1 -- 172.21.15.122:0/3358522428 shutdown_connections 2024-05-28T06:08:52.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.405+0000 7f093f000640 1 --2- 172.21.15.122:0/3358522428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f093806e6c0 0x7f093815b630 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:52.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.405+0000 7f093f000640 1 --2- 172.21.15.122:0/3358522428 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09380b5900 0x7f093815b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:52.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.405+0000 7f093f000640 1 -- 172.21.15.122:0/3358522428 >> 172.21.15.122:0/3358522428 conn(0x7f09380b3130 msgr2=0x7f09380d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:52.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.405+0000 7f093f000640 1 -- 172.21.15.122:0/3358522428 shutdown_connections 2024-05-28T06:08:52.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.405+0000 7f093f000640 1 -- 172.21.15.122:0/3358522428 wait complete. 2024-05-28T06:08:52.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f093f000640 1 Processor -- start 2024-05-28T06:08:52.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f093f000640 1 -- start start 2024-05-28T06:08:52.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f093f000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f093806e6c0 0x7f0938153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:52.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f093f000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09380b5520 0x7f09380b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:52.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f093f000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09380b5900 0x7f093814e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:52.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f093f000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f09380b4b10 con 0x7f093806e6c0 2024-05-28T06:08:52.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f093f000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f09380b4990 con 0x7f09380b5900 2024-05-28T06:08:52.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f093f000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f09380b4c90 con 0x7f09380b5520 2024-05-28T06:08:52.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f0937e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f093806e6c0 0x7f0938153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:52.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f0937e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f093806e6c0 0x7f0938153d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35578/0 (socket says 172.21.15.122:35578) 2024-05-28T06:08:52.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f0937e00640 1 -- 172.21.15.122:0/2236323594 learned_addr learned my addr 172.21.15.122:0/2236323594 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:08:52.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f092f400640 1 --2- 172.21.15.122:0/2236323594 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09380b5520 0x7f09380b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:52.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f093d000640 1 --2- 172.21.15.122:0/2236323594 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09380b5900 0x7f093814e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:52.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f0937e00640 1 -- 172.21.15.122:0/2236323594 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09380b5520 msgr2=0x7f09380b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:52.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f0937e00640 1 --2- 172.21.15.122:0/2236323594 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09380b5520 0x7f09380b0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:52.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f0937e00640 1 -- 172.21.15.122:0/2236323594 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09380b5900 msgr2=0x7f093814e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:52.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f0937e00640 1 --2- 172.21.15.122:0/2236323594 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09380b5900 0x7f093814e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:52.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f0937e00640 1 -- 172.21.15.122:0/2236323594 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09381545c0 con 0x7f093806e6c0 2024-05-28T06:08:52.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f093d000640 1 --2- 172.21.15.122:0/2236323594 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09380b5900 0x7f093814e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:08:52.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f0937e00640 1 --2- 172.21.15.122:0/2236323594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f093806e6c0 0x7f0938153d90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f092800c450 tx=0x7f092800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:52.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f0934c00640 1 -- 172.21.15.122:0/2236323594 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0928017070 con 0x7f093806e6c0 2024-05-28T06:08:52.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f0934c00640 1 -- 172.21.15.122:0/2236323594 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0928005cf0 con 0x7f093806e6c0 2024-05-28T06:08:52.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f093f000640 1 -- 172.21.15.122:0/2236323594 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09380cf800 con 0x7f093806e6c0 2024-05-28T06:08:52.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f0934c00640 1 -- 172.21.15.122:0/2236323594 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0928007290 con 0x7f093806e6c0 2024-05-28T06:08:52.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f093f000640 1 -- 172.21.15.122:0/2236323594 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09380cfdc0 con 0x7f093806e6c0 2024-05-28T06:08:52.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.409+0000 7f093f000640 1 -- 172.21.15.122:0/2236323594 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0938068c40 con 0x7f093806e6c0 2024-05-28T06:08:52.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.413+0000 7f0934c00640 1 -- 172.21.15.122:0/2236323594 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f092801a070 con 0x7f093806e6c0 2024-05-28T06:08:52.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.413+0000 7f0934c00640 1 --2- 172.21.15.122:0/2236323594 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0914068530 0x7f091406a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:52.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.413+0000 7f0934c00640 1 -- 172.21.15.122:0/2236323594 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0928086090 con 0x7f093806e6c0 2024-05-28T06:08:52.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.413+0000 7f092f400640 1 --2- 172.21.15.122:0/2236323594 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0914068530 0x7f091406a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:52.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.413+0000 7f092f400640 1 --2- 172.21.15.122:0/2236323594 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0914068530 0x7f091406a9f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0920009580 tx=0x7f0920009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:52.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.417+0000 7f0934c00640 1 -- 172.21.15.122:0/2236323594 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0928055ce0 con 0x7f093806e6c0 2024-05-28T06:08:52.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.629+0000 7f093f000640 1 -- 172.21.15.122:0/2236323594 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f093806f9f0 con 0x7f093806e6c0 2024-05-28T06:08:52.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.629+0000 7f0934c00640 1 -- 172.21.15.122:0/2236323594 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2123 (secure 0 0 0) 0x7f0928059fe0 con 0x7f093806e6c0 2024-05-28T06:08:52.632 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:08:52.632 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:08:52.633 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:08:52.633 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:08:52.633 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:08:52.633 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:08:52.633 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:08:52.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:52.634 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:08:52.634 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:08:52.634 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:08:52.634 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:08:52.635 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:08:52.635 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:52.635 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:08:52.635 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:08:52.635 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:08:52.635 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:08:52.636 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:52.636 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 208, 2024-05-28T06:08:52.636 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:08:52.636 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:08:52.636 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:08:52.636 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:08:52.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:52.637 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:08:52.637 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 34, 2024-05-28T06:08:52.637 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:08:52.637 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:08:52.637 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:08:52.637 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:08:52.637 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:08:52.637 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:08:52.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:52.638 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:08:52.638 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:08:52.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:08:52.638 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:08:52.638 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:08:52.638 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:52.638 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:52.638 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:08:52.638 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:08:52.639 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 3027, 2024-05-28T06:08:52.639 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 12575876401, 2024-05-28T06:08:52.639 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 25410322432, 2024-05-28T06:08:52.639 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 747683790848, 2024-05-28T06:08:52.639 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:08:52.639 INFO:teuthology.orchestra.run.smithi122.stdout: "read_bytes_sec": 155148631, 2024-05-28T06:08:52.639 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 153064236, 2024-05-28T06:08:52.639 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 37, 2024-05-28T06:08:52.639 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 41 2024-05-28T06:08:52.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:52.639 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:08:52.640 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 19, 2024-05-28T06:08:52.640 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 2, 2024-05-28T06:08:52.640 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:08:52.640 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:08:52.640 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:08:52.640 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:08:52.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:08:52.640 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 2, 2024-05-28T06:08:52.640 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:08:52.640 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "a", 2024-05-28T06:08:52.640 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:08:52.640 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 5082 2024-05-28T06:08:52.640 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:52.640 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:52.641 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:08:52.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:52.641 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:08:52.641 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:08:52.641 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:08:52.641 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:08:52.641 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:08:52.641 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:08:52.641 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:08:52.641 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:52.641 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:08:52.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:52.642 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:08:52.642 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 5, 2024-05-28T06:08:52.642 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:07:53.268069+0000", 2024-05-28T06:08:52.642 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:08:52.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:52.642 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:08:52.642 INFO:teuthology.orchestra.run.smithi122.stdout: "438f16d6-8ab7-4475-aa32-a0b2476e25e8": { 2024-05-28T06:08:52.642 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "All cloning finished, waiting 21.0 seconds before exiting (13s)\n [============================] ", 2024-05-28T06:08:52.642 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 1, 2024-05-28T06:08:52.642 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:08:52.642 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:52.642 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:52.642 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:08:52.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.629+0000 7f093f000640 1 -- 172.21.15.122:0/2236323594 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0914068530 msgr2=0x7f091406a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:52.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.629+0000 7f093f000640 1 --2- 172.21.15.122:0/2236323594 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0914068530 0x7f091406a9f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0920009580 tx=0x7f0920009190 comp rx=0 tx=0).stop 2024-05-28T06:08:52.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.629+0000 7f093f000640 1 -- 172.21.15.122:0/2236323594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f093806e6c0 msgr2=0x7f0938153d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:52.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.629+0000 7f093f000640 1 --2- 172.21.15.122:0/2236323594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f093806e6c0 0x7f0938153d90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f092800c450 tx=0x7f092800c910 comp rx=0 tx=0).stop 2024-05-28T06:08:52.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.629+0000 7f093f000640 1 -- 172.21.15.122:0/2236323594 shutdown_connections 2024-05-28T06:08:52.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.629+0000 7f093f000640 1 --2- 172.21.15.122:0/2236323594 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0914068530 0x7f091406a9f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:52.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.629+0000 7f093f000640 1 --2- 172.21.15.122:0/2236323594 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09380b5900 0x7f093814e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:52.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.629+0000 7f093f000640 1 --2- 172.21.15.122:0/2236323594 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09380b5520 0x7f09380b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:52.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.629+0000 7f093f000640 1 --2- 172.21.15.122:0/2236323594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f093806e6c0 0x7f0938153d90 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:52.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.629+0000 7f093f000640 1 -- 172.21.15.122:0/2236323594 >> 172.21.15.122:0/2236323594 conn(0x7f09380b3130 msgr2=0x7f09380aee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:52.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.629+0000 7f093f000640 1 -- 172.21.15.122:0/2236323594 shutdown_connections 2024-05-28T06:08:52.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:52.629+0000 7f093f000640 1 -- 172.21.15.122:0/2236323594 wait complete. 2024-05-28T06:08:57.655 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:08:57.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.793+0000 7fc251c00640 1 Processor -- start 2024-05-28T06:08:57.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.793+0000 7fc251c00640 1 -- start start 2024-05-28T06:08:57.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.797+0000 7fc251c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc24c160330 0x7fc24c070230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:57.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.797+0000 7fc251c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc24c15c610 0x7fc24c15ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:57.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.797+0000 7fc251c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc24c06f190 con 0x7fc24c09eb10 2024-05-28T06:08:57.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.797+0000 7fc251c00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fc24c06f470 con 0x7fc24c160330 2024-05-28T06:08:57.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.797+0000 7fc251c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc24c06f750 con 0x7fc24c15c610 2024-05-28T06:08:57.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.797+0000 7fc24be00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc24c160330 0x7fc24c070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:57.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.797+0000 7fc243400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fc24c09eb10 0x7fc24c160710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:46206/0 (socket says 172.21.15.122:46206) 2024-05-28T06:08:57.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.797+0000 7fc243400640 1 -- 172.21.15.122:0/1817362194 learned_addr learned my addr 172.21.15.122:0/1817362194 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:08:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.797+0000 7fc251200640 1 --2- 172.21.15.122:0/1817362194 >> v2:172.21.15.153:3300/0 conn(0x7fc24c15c610 0x7fc24c15ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.797+0000 7fc24be00640 1 -- 172.21.15.122:0/1817362194 >> v2:172.21.15.153:3300/0 conn(0x7fc24c15c610 msgr2=0x7fc24c15ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:08:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.797+0000 7fc24be00640 1 --2- 172.21.15.122:0/1817362194 >> v2:172.21.15.153:3300/0 conn(0x7fc24c15c610 0x7fc24c15ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.797+0000 7fc24be00640 1 -- 172.21.15.122:0/1817362194 >> v1:172.21.15.122:6789/0 conn(0x7fc24c09eb10 legacy=0x7fc24c160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.797+0000 7fc24be00640 1 -- 172.21.15.122:0/1817362194 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24c06fa30 con 0x7fc24c160330 2024-05-28T06:08:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.797+0000 7fc24b400640 1 -- 172.21.15.122:0/1817362194 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3054659701 0 0) 0x7fc24c06f190 con 0x7fc24c09eb10 2024-05-28T06:08:57.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.797+0000 7fc251200640 1 --2- 172.21.15.122:0/1817362194 >> v2:172.21.15.153:3300/0 conn(0x7fc24c15c610 0x7fc24c15ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:08:57.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.801+0000 7fc24be00640 1 --2- 172.21.15.122:0/1817362194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc24c160330 0x7fc24c070230 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc24c160010 tx=0x7fc23c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ed5738883e713c server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:57.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.801+0000 7fc24b400640 1 -- 172.21.15.122:0/1817362194 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c0b1070 con 0x7fc24c160330 2024-05-28T06:08:57.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.801+0000 7fc24b400640 1 -- 172.21.15.122:0/1817362194 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc23c0ac440 con 0x7fc24c160330 2024-05-28T06:08:57.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.801+0000 7fc24b400640 1 -- 172.21.15.122:0/1817362194 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c161030 con 0x7fc24c160330 2024-05-28T06:08:57.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.801+0000 7fc251c00640 1 -- 172.21.15.122:0/1817362194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc24c160330 msgr2=0x7fc24c070230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:57.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.801+0000 7fc251c00640 1 --2- 172.21.15.122:0/1817362194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc24c160330 0x7fc24c070230 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc24c160010 tx=0x7fc23c01c3f0 comp rx=0 tx=0).stop 2024-05-28T06:08:57.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.801+0000 7fc251c00640 1 -- 172.21.15.122:0/1817362194 shutdown_connections 2024-05-28T06:08:57.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.801+0000 7fc251c00640 1 --2- 172.21.15.122:0/1817362194 >> v2:172.21.15.153:3300/0 conn(0x7fc24c15c610 0x7fc24c15ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:57.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.801+0000 7fc251c00640 1 --2- 172.21.15.122:0/1817362194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc24c160330 0x7fc24c070230 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:57.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.801+0000 7fc251c00640 1 -- 172.21.15.122:0/1817362194 >> 172.21.15.122:0/1817362194 conn(0x7fc24c073510 msgr2=0x7fc24c06b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:57.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.801+0000 7fc251c00640 1 -- 172.21.15.122:0/1817362194 shutdown_connections 2024-05-28T06:08:57.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.801+0000 7fc251c00640 1 -- 172.21.15.122:0/1817362194 wait complete. 2024-05-28T06:08:57.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.801+0000 7fc251c00640 1 Processor -- start 2024-05-28T06:08:57.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.801+0000 7fc251c00640 1 -- start start 2024-05-28T06:08:57.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.801+0000 7fc251c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc24c09eb10 0x7fc24c14d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:57.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.801+0000 7fc251c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc24c15c610 0x7fc24c157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:57.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.801+0000 7fc251c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc24c160330 0x7fc24c157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:57.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.801+0000 7fc251c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc24c169800 con 0x7fc24c160330 2024-05-28T06:08:57.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.801+0000 7fc251c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc24c169680 con 0x7fc24c09eb10 2024-05-28T06:08:57.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.801+0000 7fc251c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc24c169980 con 0x7fc24c15c610 2024-05-28T06:08:57.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.805+0000 7fc251200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc24c160330 0x7fc24c157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:57.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.805+0000 7fc24be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc24c09eb10 0x7fc24c14d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:57.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.805+0000 7fc251200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc24c160330 0x7fc24c157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51320/0 (socket says 172.21.15.122:51320) 2024-05-28T06:08:57.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.805+0000 7fc251200640 1 -- 172.21.15.122:0/3865519470 learned_addr learned my addr 172.21.15.122:0/3865519470 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:08:57.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.805+0000 7fc243400640 1 --2- 172.21.15.122:0/3865519470 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc24c15c610 0x7fc24c157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:57.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.805+0000 7fc251200640 1 -- 172.21.15.122:0/3865519470 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc24c15c610 msgr2=0x7fc24c157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:57.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.805+0000 7fc251200640 1 --2- 172.21.15.122:0/3865519470 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc24c15c610 0x7fc24c157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:57.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.805+0000 7fc251200640 1 -- 172.21.15.122:0/3865519470 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc24c09eb10 msgr2=0x7fc24c14d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:57.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.805+0000 7fc251200640 1 --2- 172.21.15.122:0/3865519470 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc24c09eb10 0x7fc24c14d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:57.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.805+0000 7fc251200640 1 -- 172.21.15.122:0/3865519470 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24c14f1c0 con 0x7fc24c160330 2024-05-28T06:08:57.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.805+0000 7fc24be00640 1 --2- 172.21.15.122:0/3865519470 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc24c09eb10 0x7fc24c14d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:08:57.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.805+0000 7fc251200640 1 --2- 172.21.15.122:0/3865519470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc24c160330 0x7fc24c157cc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc24400ce40 tx=0x7fc24400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:57.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.805+0000 7fc248c00640 1 -- 172.21.15.122:0/3865519470 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24401a070 con 0x7fc24c160330 2024-05-28T06:08:57.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.805+0000 7fc248c00640 1 -- 172.21.15.122:0/3865519470 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc24400d840 con 0x7fc24c160330 2024-05-28T06:08:57.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.805+0000 7fc251c00640 1 -- 172.21.15.122:0/3865519470 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc24c13a730 con 0x7fc24c160330 2024-05-28T06:08:57.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.805+0000 7fc248c00640 1 -- 172.21.15.122:0/3865519470 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24400dc30 con 0x7fc24c160330 2024-05-28T06:08:57.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.805+0000 7fc251c00640 1 -- 172.21.15.122:0/3865519470 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc24c13acf0 con 0x7fc24c160330 2024-05-28T06:08:57.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.805+0000 7fc251c00640 1 -- 172.21.15.122:0/3865519470 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc24c075620 con 0x7fc24c160330 2024-05-28T06:08:57.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.805+0000 7fc248c00640 1 -- 172.21.15.122:0/3865519470 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7fc24401d070 con 0x7fc24c160330 2024-05-28T06:08:57.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.809+0000 7fc248c00640 1 --2- 172.21.15.122:0/3865519470 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc228068560 0x7fc22806aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:08:57.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.809+0000 7fc248c00640 1 -- 172.21.15.122:0/3865519470 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc244087460 con 0x7fc24c160330 2024-05-28T06:08:57.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.809+0000 7fc24be00640 1 --2- 172.21.15.122:0/3865519470 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc228068560 0x7fc22806aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:08:57.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.809+0000 7fc24be00640 1 --2- 172.21.15.122:0/3865519470 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc228068560 0x7fc22806aa20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc23c0ae000 tx=0x7fc23c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:08:57.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:57.813+0000 7fc248c00640 1 -- 172.21.15.122:0/3865519470 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc2440570d0 con 0x7fc24c160330 2024-05-28T06:08:58.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:58.033+0000 7fc251c00640 1 -- 172.21.15.122:0/3865519470 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc24c062940 con 0x7fc24c160330 2024-05-28T06:08:58.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:58.033+0000 7fc248c00640 1 -- 172.21.15.122:0/3865519470 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2110 (secure 0 0 0) 0x7fc24405b3d0 con 0x7fc24c160330 2024-05-28T06:08:58.035 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:08:58.036 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:08:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:08:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:08:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:08:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:08:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:08:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:08:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:08:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:08:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:08:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:08:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:08:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:08:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:08:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:08:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 213, 2024-05-28T06:08:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:08:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:08:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:08:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:08:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:08:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 34, 2024-05-28T06:08:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:08:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:08:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:08:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:08:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:08:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:08:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:08:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:08:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:08:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:08:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:08:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:08:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:08:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 3027, 2024-05-28T06:08:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 12575902500, 2024-05-28T06:08:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 25410371584, 2024-05-28T06:08:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 747683741696, 2024-05-28T06:08:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:08:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: "read_bytes_sec": 255, 2024-05-28T06:08:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 5118, 2024-05-28T06:08:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 0, 2024-05-28T06:08:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 2 2024-05-28T06:08:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:08:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 19, 2024-05-28T06:08:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 2, 2024-05-28T06:08:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:08:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:08:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:08:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:08:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:08:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 2, 2024-05-28T06:08:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:08:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "a", 2024-05-28T06:08:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:08:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 5082 2024-05-28T06:08:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:08:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:08:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:08:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:08:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:08:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:08:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:08:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:08:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:08:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:08:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:08:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 5, 2024-05-28T06:08:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:07:53.268069+0000", 2024-05-28T06:08:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:08:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:08:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:08:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: "438f16d6-8ab7-4475-aa32-a0b2476e25e8": { 2024-05-28T06:08:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "All cloning finished, waiting 15.0 seconds before exiting (19s)\n [============================] ", 2024-05-28T06:08:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 1, 2024-05-28T06:08:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:08:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:08:58.042 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:08:58.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:58.033+0000 7fc251c00640 1 -- 172.21.15.122:0/3865519470 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc228068560 msgr2=0x7fc22806aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:58.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:58.033+0000 7fc251c00640 1 --2- 172.21.15.122:0/3865519470 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc228068560 0x7fc22806aa20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc23c0ae000 tx=0x7fc23c008040 comp rx=0 tx=0).stop 2024-05-28T06:08:58.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:58.033+0000 7fc251c00640 1 -- 172.21.15.122:0/3865519470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc24c160330 msgr2=0x7fc24c157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:08:58.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:58.033+0000 7fc251c00640 1 --2- 172.21.15.122:0/3865519470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc24c160330 0x7fc24c157cc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc24400ce40 tx=0x7fc24400a710 comp rx=0 tx=0).stop 2024-05-28T06:08:58.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:58.033+0000 7fc251c00640 1 -- 172.21.15.122:0/3865519470 shutdown_connections 2024-05-28T06:08:58.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:58.033+0000 7fc251c00640 1 --2- 172.21.15.122:0/3865519470 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc228068560 0x7fc22806aa20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:58.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:58.033+0000 7fc251c00640 1 --2- 172.21.15.122:0/3865519470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc24c160330 0x7fc24c157cc0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:58.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:58.033+0000 7fc251c00640 1 --2- 172.21.15.122:0/3865519470 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc24c15c610 0x7fc24c157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:58.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:58.033+0000 7fc251c00640 1 --2- 172.21.15.122:0/3865519470 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc24c09eb10 0x7fc24c14d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:08:58.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:58.033+0000 7fc251c00640 1 -- 172.21.15.122:0/3865519470 >> 172.21.15.122:0/3865519470 conn(0x7fc24c073510 msgr2=0x7fc24c14c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:08:58.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:58.033+0000 7fc251c00640 1 -- 172.21.15.122:0/3865519470 shutdown_connections 2024-05-28T06:08:58.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:08:58.033+0000 7fc251c00640 1 -- 172.21.15.122:0/3865519470 wait complete. 2024-05-28T06:09:03.058 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:09:03.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.197+0000 7f3e75800640 1 Processor -- start 2024-05-28T06:09:03.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.197+0000 7f3e75800640 1 -- start start 2024-05-28T06:09:03.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e75800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e700ce4f0 0x7f3e700ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:03.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e75800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e7015d970 con 0x7f3e700b58d0 2024-05-28T06:09:03.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e75800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e7015dc50 con 0x7f3e7015e730 2024-05-28T06:09:03.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e75800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3e7015df30 con 0x7f3e700ce4f0 2024-05-28T06:09:03.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6ea00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f3e700b58d0 0x7f3e700b5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:46214/0 (socket says 172.21.15.122:46214) 2024-05-28T06:09:03.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6ea00640 1 -- 172.21.15.122:0/545766076 learned_addr learned my addr 172.21.15.122:0/545766076 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:03.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6e000640 1 --2- 172.21.15.122:0/545766076 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e700ce4f0 0x7f3e700ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:03.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6d600640 1 -- 172.21.15.122:0/545766076 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1404610860 0 0) 0x7f3e7015d970 con 0x7f3e700b58d0 2024-05-28T06:09:03.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6d600640 1 -- 172.21.15.122:0/545766076 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e54003530 con 0x7f3e700b58d0 2024-05-28T06:09:03.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6d600640 1 -- 172.21.15.122:0/545766076 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1643274945 0 0) 0x7f3e7015dc50 con 0x7f3e7015e730 2024-05-28T06:09:03.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6d600640 1 -- 172.21.15.122:0/545766076 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e7015d970 con 0x7f3e7015e730 2024-05-28T06:09:03.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6d600640 1 -- 172.21.15.122:0/545766076 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2809146650 0 0) 0x7f3e54003530 con 0x7f3e700b58d0 2024-05-28T06:09:03.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6d600640 1 -- 172.21.15.122:0/545766076 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e700ce4f0 msgr2=0x7f3e700ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:03.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6d600640 1 --2- 172.21.15.122:0/545766076 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e700ce4f0 0x7f3e700ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:03.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6d600640 1 -- 172.21.15.122:0/545766076 >> v1:172.21.15.153:6789/0 conn(0x7f3e7015e730 legacy=0x7f3e7015ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:03.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6d600640 1 -- 172.21.15.122:0/545766076 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e7015e210 con 0x7f3e700b58d0 2024-05-28T06:09:03.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6d600640 1 -- 172.21.15.122:0/545766076 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f3e60001a00 con 0x7f3e700b58d0 2024-05-28T06:09:03.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6d600640 1 -- 172.21.15.122:0/545766076 >> v1:172.21.15.122:6789/0 conn(0x7f3e700b58d0 legacy=0x7f3e700b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:03.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6d600640 1 --2- 172.21.15.122:0/545766076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e54003b80 0x7f3e54003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:03.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6d600640 1 --2- 172.21.15.122:0/545766076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e54004810 0x7f3e54004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:03.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6d600640 1 --2- 172.21.15.122:0/545766076 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e700ce4f0 0x7f3e540051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:03.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6d600640 1 -- 172.21.15.122:0/545766076 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7015df30 con 0x7f3e54003b80 2024-05-28T06:09:03.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6d600640 1 -- 172.21.15.122:0/545766076 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5400ba80 con 0x7f3e54004810 2024-05-28T06:09:03.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6d600640 1 -- 172.21.15.122:0/545766076 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3e5400bc80 con 0x7f3e700ce4f0 2024-05-28T06:09:03.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6ea00640 1 --2- 172.21.15.122:0/545766076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e54003b80 0x7f3e54003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:03.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6f400640 1 --2- 172.21.15.122:0/545766076 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e700ce4f0 0x7f3e540051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:03.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6e000640 1 --2- 172.21.15.122:0/545766076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e54004810 0x7f3e54004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:03.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6ea00640 1 -- 172.21.15.122:0/545766076 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e700ce4f0 msgr2=0x7f3e540051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:03.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6ea00640 1 --2- 172.21.15.122:0/545766076 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e700ce4f0 0x7f3e540051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:03.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6ea00640 1 -- 172.21.15.122:0/545766076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e54004810 msgr2=0x7f3e54004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:03.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6ea00640 1 --2- 172.21.15.122:0/545766076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e54004810 0x7f3e54004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:03.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.201+0000 7f3e6ea00640 1 -- 172.21.15.122:0/545766076 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e54003530 con 0x7f3e54003b80 2024-05-28T06:09:03.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.205+0000 7f3e6ea00640 1 --2- 172.21.15.122:0/545766076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e54003b80 0x7f3e54003f80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000a720 tx=0x7f3e6001d260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f533069dfd4077d server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:03.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.205+0000 7f3e6d600640 1 -- 172.21.15.122:0/545766076 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6000a370 con 0x7f3e54003b80 2024-05-28T06:09:03.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.205+0000 7f3e6d600640 1 -- 172.21.15.122:0/545766076 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e600ad650 con 0x7f3e54003b80 2024-05-28T06:09:03.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.205+0000 7f3e6d600640 1 -- 172.21.15.122:0/545766076 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e600ada40 con 0x7f3e54003b80 2024-05-28T06:09:03.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.205+0000 7f3e75800640 1 -- 172.21.15.122:0/545766076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e54003b80 msgr2=0x7f3e54003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:03.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.205+0000 7f3e75800640 1 --2- 172.21.15.122:0/545766076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e54003b80 0x7f3e54003f80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000a720 tx=0x7f3e6001d260 comp rx=0 tx=0).stop 2024-05-28T06:09:03.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.205+0000 7f3e6f400640 1 -- 172.21.15.122:0/545766076 reap_dead start 2024-05-28T06:09:03.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.205+0000 7f3e75800640 1 -- 172.21.15.122:0/545766076 shutdown_connections 2024-05-28T06:09:03.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.205+0000 7f3e75800640 1 -- 172.21.15.122:0/545766076 >> 172.21.15.122:0/545766076 conn(0x7f3e7006bd90 msgr2=0x7f3e7006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:03.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.205+0000 7f3e75800640 1 -- 172.21.15.122:0/545766076 shutdown_connections 2024-05-28T06:09:03.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.205+0000 7f3e75800640 1 -- 172.21.15.122:0/545766076 wait complete. 2024-05-28T06:09:03.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.205+0000 7f3e75800640 1 Processor -- start 2024-05-28T06:09:03.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e75800640 1 -- start start 2024-05-28T06:09:03.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e75800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e54003b80 0x7f3e700b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:03.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e75800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7015bfd0 0x7f3e7015b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:03.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e75800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e701fb350 0x7f3e7013efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:03.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e75800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7015f660 con 0x7f3e7015bfd0 2024-05-28T06:09:03.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e75800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7015f4e0 con 0x7f3e701fb350 2024-05-28T06:09:03.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e75800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3e7015f7e0 con 0x7f3e54003b80 2024-05-28T06:09:03.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e6e000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7015bfd0 0x7f3e7015b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:03.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e6e000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7015bfd0 0x7f3e7015b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51338/0 (socket says 172.21.15.122:51338) 2024-05-28T06:09:03.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e6e000640 1 -- 172.21.15.122:0/1881689178 learned_addr learned my addr 172.21.15.122:0/1881689178 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:03.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e6ea00640 1 --2- 172.21.15.122:0/1881689178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e54003b80 0x7f3e700b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:03.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e6f400640 1 --2- 172.21.15.122:0/1881689178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e701fb350 0x7f3e7013efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:03.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e6e000640 1 -- 172.21.15.122:0/1881689178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e54003b80 msgr2=0x7f3e700b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:03.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e6e000640 1 --2- 172.21.15.122:0/1881689178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e54003b80 0x7f3e700b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:03.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e6e000640 1 -- 172.21.15.122:0/1881689178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e701fb350 msgr2=0x7f3e7013efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:03.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e6e000640 1 --2- 172.21.15.122:0/1881689178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e701fb350 0x7f3e7013efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:03.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e6e000640 1 -- 172.21.15.122:0/1881689178 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e700b4780 con 0x7f3e7015bfd0 2024-05-28T06:09:03.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e6f400640 1 --2- 172.21.15.122:0/1881689178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e701fb350 0x7f3e7013efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:09:03.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e6e000640 1 --2- 172.21.15.122:0/1881689178 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7015bfd0 0x7f3e7015b920 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c011960 tx=0x7f3e5c011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:03.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e66a00640 1 -- 172.21.15.122:0/1881689178 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c00fa90 con 0x7f3e7015bfd0 2024-05-28T06:09:03.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e66a00640 1 -- 172.21.15.122:0/1881689178 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e5c00fc50 con 0x7f3e7015bfd0 2024-05-28T06:09:03.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e75800640 1 -- 172.21.15.122:0/1881689178 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e700b4a60 con 0x7f3e7015bfd0 2024-05-28T06:09:03.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e66a00640 1 -- 172.21.15.122:0/1881689178 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c014440 con 0x7f3e7015bfd0 2024-05-28T06:09:03.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e75800640 1 -- 172.21.15.122:0/1881689178 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e701fab50 con 0x7f3e7015bfd0 2024-05-28T06:09:03.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.209+0000 7f3e75800640 1 -- 172.21.15.122:0/1881689178 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e70068c40 con 0x7f3e7015bfd0 2024-05-28T06:09:03.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.213+0000 7f3e66a00640 1 -- 172.21.15.122:0/1881689178 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f3e5c012040 con 0x7f3e7015bfd0 2024-05-28T06:09:03.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.213+0000 7f3e66a00640 1 --2- 172.21.15.122:0/1881689178 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3e50068560 0x7f3e5006aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:03.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.213+0000 7f3e66a00640 1 -- 172.21.15.122:0/1881689178 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3e5c087280 con 0x7f3e7015bfd0 2024-05-28T06:09:03.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.213+0000 7f3e6ea00640 1 --2- 172.21.15.122:0/1881689178 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3e50068560 0x7f3e5006aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:03.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.213+0000 7f3e6ea00640 1 --2- 172.21.15.122:0/1881689178 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3e50068560 0x7f3e5006aa20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3e600ad000 tx=0x7f3e600a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:03.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.217+0000 7f3e66a00640 1 -- 172.21.15.122:0/1881689178 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3e5c019030 con 0x7f3e7015bfd0 2024-05-28T06:09:03.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.429+0000 7f3e75800640 1 -- 172.21.15.122:0/1881689178 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f3e70141210 con 0x7f3e7015bfd0 2024-05-28T06:09:03.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.429+0000 7f3e66a00640 1 -- 172.21.15.122:0/1881689178 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2078 (secure 0 0 0) 0x7f3e5c057520 con 0x7f3e7015bfd0 2024-05-28T06:09:03.433 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:03.433 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:09:03.433 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:09:03.433 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:09:03.433 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:09:03.433 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:09:03.433 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:09:03.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:03.433 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:09:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:09:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:09:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:09:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:09:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:09:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:09:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:09:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:09:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:09:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:09:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 219, 2024-05-28T06:09:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:09:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:09:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:09:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:09:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:09:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 34, 2024-05-28T06:09:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:09:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:09:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:09:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:09:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:09:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:09:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:09:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:09:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:09:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:09:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:09:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:09:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:09:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 3027, 2024-05-28T06:09:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 12575922512, 2024-05-28T06:09:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 25410412544, 2024-05-28T06:09:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 747683700736, 2024-05-28T06:09:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:09:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 4265, 2024-05-28T06:09:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 0, 2024-05-28T06:09:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 1 2024-05-28T06:09:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:09:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 19, 2024-05-28T06:09:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 2, 2024-05-28T06:09:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:09:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:09:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:09:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:09:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 2, 2024-05-28T06:09:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:09:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "a", 2024-05-28T06:09:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:09:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 5082 2024-05-28T06:09:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:09:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:09:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:09:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:09:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:09:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:09:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:09:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:09:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:09:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:09:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:09:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:09:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 5, 2024-05-28T06:09:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:07:53.268069+0000", 2024-05-28T06:09:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:09:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:09:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: "438f16d6-8ab7-4475-aa32-a0b2476e25e8": { 2024-05-28T06:09:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "All cloning finished, waiting 9.0 seconds before exiting (25s)\n [============================] ", 2024-05-28T06:09:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 1, 2024-05-28T06:09:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:09:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:03.439 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:09:03.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.433+0000 7f3e75800640 1 -- 172.21.15.122:0/1881689178 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3e50068560 msgr2=0x7f3e5006aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:03.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.433+0000 7f3e75800640 1 --2- 172.21.15.122:0/1881689178 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3e50068560 0x7f3e5006aa20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3e600ad000 tx=0x7f3e600a7000 comp rx=0 tx=0).stop 2024-05-28T06:09:03.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.433+0000 7f3e75800640 1 -- 172.21.15.122:0/1881689178 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7015bfd0 msgr2=0x7f3e7015b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:03.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.433+0000 7f3e75800640 1 --2- 172.21.15.122:0/1881689178 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7015bfd0 0x7f3e7015b920 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c011960 tx=0x7f3e5c011e20 comp rx=0 tx=0).stop 2024-05-28T06:09:03.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.433+0000 7f3e75800640 1 -- 172.21.15.122:0/1881689178 shutdown_connections 2024-05-28T06:09:03.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.433+0000 7f3e75800640 1 --2- 172.21.15.122:0/1881689178 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3e50068560 0x7f3e5006aa20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:03.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.433+0000 7f3e75800640 1 --2- 172.21.15.122:0/1881689178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e701fb350 0x7f3e7013efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:03.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.433+0000 7f3e75800640 1 --2- 172.21.15.122:0/1881689178 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7015bfd0 0x7f3e7015b920 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:03.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.433+0000 7f3e75800640 1 --2- 172.21.15.122:0/1881689178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e54003b80 0x7f3e700b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:03.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.433+0000 7f3e75800640 1 -- 172.21.15.122:0/1881689178 >> 172.21.15.122:0/1881689178 conn(0x7f3e7006bd90 msgr2=0x7f3e700b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:03.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.433+0000 7f3e75800640 1 -- 172.21.15.122:0/1881689178 shutdown_connections 2024-05-28T06:09:03.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:03.433+0000 7f3e75800640 1 -- 172.21.15.122:0/1881689178 wait complete. 2024-05-28T06:09:08.456 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:09:08.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.597+0000 7f640e600640 1 Processor -- start 2024-05-28T06:09:08.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.597+0000 7f640e600640 1 -- start start 2024-05-28T06:09:08.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.597+0000 7f640e600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f64080ce4f0 0x7f64080ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:08.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.597+0000 7f640e600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f640815e730 0x7f640815eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:08.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.597+0000 7f640e600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f640815d970 con 0x7f64080b58d0 2024-05-28T06:09:08.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.597+0000 7f640e600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f640815dc50 con 0x7f640815e730 2024-05-28T06:09:08.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.597+0000 7f640e600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f640815df30 con 0x7f64080ce4f0 2024-05-28T06:09:08.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.597+0000 7f6407e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f640815e730 0x7f640815eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:08.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.597+0000 7f6407400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f64080b58d0 0x7f64080b5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38742/0 (socket says 172.21.15.122:38742) 2024-05-28T06:09:08.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.597+0000 7f6407400640 1 -- 172.21.15.122:0/641099819 learned_addr learned my addr 172.21.15.122:0/641099819 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:08.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.601+0000 7f6406a00640 1 -- 172.21.15.122:0/641099819 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 811294986 0 0) 0x7f640815d970 con 0x7f64080b58d0 2024-05-28T06:09:08.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.601+0000 7f63fea00640 1 --2- 172.21.15.122:0/641099819 >> v2:172.21.15.153:3300/0 conn(0x7f64080ce4f0 0x7f64080ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:08.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.601+0000 7f6406a00640 1 -- 172.21.15.122:0/641099819 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63ec003530 con 0x7f64080b58d0 2024-05-28T06:09:08.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.601+0000 7f6407e00640 1 -- 172.21.15.122:0/641099819 >> v2:172.21.15.153:3300/0 conn(0x7f64080ce4f0 msgr2=0x7f64080ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:08.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.601+0000 7f6407e00640 1 --2- 172.21.15.122:0/641099819 >> v2:172.21.15.153:3300/0 conn(0x7f64080ce4f0 0x7f64080ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:08.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.601+0000 7f6407e00640 1 -- 172.21.15.122:0/641099819 >> v1:172.21.15.122:6789/0 conn(0x7f64080b58d0 legacy=0x7f64080b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:08.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.601+0000 7f6407e00640 1 -- 172.21.15.122:0/641099819 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640815e210 con 0x7f640815e730 2024-05-28T06:09:08.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.601+0000 7f63fea00640 1 --2- 172.21.15.122:0/641099819 >> v2:172.21.15.153:3300/0 conn(0x7f64080ce4f0 0x7f64080ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:09:08.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.601+0000 7f6407e00640 1 --2- 172.21.15.122:0/641099819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f640815e730 0x7f640815eba0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f64080d0470 tx=0x7f640001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5a5c5d8f654982 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:08.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.601+0000 7f6406a00640 1 -- 172.21.15.122:0/641099819 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64000b2070 con 0x7f640815e730 2024-05-28T06:09:08.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.601+0000 7f6406a00640 1 -- 172.21.15.122:0/641099819 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64000a58a0 con 0x7f640815e730 2024-05-28T06:09:08.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.601+0000 7f6406a00640 1 -- 172.21.15.122:0/641099819 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64000a5c70 con 0x7f640815e730 2024-05-28T06:09:08.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.601+0000 7f640e600640 1 -- 172.21.15.122:0/641099819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f640815e730 msgr2=0x7f640815eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:08.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.601+0000 7f640e600640 1 --2- 172.21.15.122:0/641099819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f640815e730 0x7f640815eba0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f64080d0470 tx=0x7f640001c930 comp rx=0 tx=0).stop 2024-05-28T06:09:08.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.601+0000 7f640e600640 1 -- 172.21.15.122:0/641099819 shutdown_connections 2024-05-28T06:09:08.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.601+0000 7f640e600640 1 --2- 172.21.15.122:0/641099819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f640815e730 0x7f640815eba0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:08.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.601+0000 7f640e600640 1 --2- 172.21.15.122:0/641099819 >> v2:172.21.15.153:3300/0 conn(0x7f64080ce4f0 0x7f64080ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:08.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.601+0000 7f640e600640 1 -- 172.21.15.122:0/641099819 >> 172.21.15.122:0/641099819 conn(0x7f640806bd90 msgr2=0x7f640806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:08.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.601+0000 7f640e600640 1 -- 172.21.15.122:0/641099819 shutdown_connections 2024-05-28T06:09:08.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.601+0000 7f640e600640 1 -- 172.21.15.122:0/641099819 wait complete. 2024-05-28T06:09:08.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f640e600640 1 Processor -- start 2024-05-28T06:09:08.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f640e600640 1 -- start start 2024-05-28T06:09:08.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f640e600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64080b58d0 0x7f6408159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:08.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f640e600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64080ce4f0 0x7f6408154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:08.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f640e600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f640815e730 0x7f6408139ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:08.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f640e600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f64081693d0 con 0x7f640815e730 2024-05-28T06:09:08.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f640e600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6408169250 con 0x7f64080ce4f0 2024-05-28T06:09:08.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f640e600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6408169550 con 0x7f64080b58d0 2024-05-28T06:09:08.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f6407e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f640815e730 0x7f6408139ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:08.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f6407e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f640815e730 0x7f6408139ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:60014/0 (socket says 172.21.15.122:60014) 2024-05-28T06:09:08.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f6407e00640 1 -- 172.21.15.122:0/3465248572 learned_addr learned my addr 172.21.15.122:0/3465248572 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:08.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f6407400640 1 --2- 172.21.15.122:0/3465248572 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64080b58d0 0x7f6408159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:08.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f63fea00640 1 --2- 172.21.15.122:0/3465248572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64080ce4f0 0x7f6408154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:08.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f6407e00640 1 -- 172.21.15.122:0/3465248572 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64080b58d0 msgr2=0x7f6408159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:08.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f6407e00640 1 --2- 172.21.15.122:0/3465248572 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64080b58d0 0x7f6408159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:08.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f6407e00640 1 -- 172.21.15.122:0/3465248572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64080ce4f0 msgr2=0x7f6408154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:08.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f6407e00640 1 --2- 172.21.15.122:0/3465248572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64080ce4f0 0x7f6408154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:08.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f6407e00640 1 -- 172.21.15.122:0/3465248572 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6408159c00 con 0x7f640815e730 2024-05-28T06:09:08.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f63fea00640 1 --2- 172.21.15.122:0/3465248572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64080ce4f0 0x7f6408154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:09:08.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f6407e00640 1 --2- 172.21.15.122:0/3465248572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f640815e730 0x7f6408139ef0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f64000b0040 tx=0x7f64000196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:08.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f63ffe00640 1 -- 172.21.15.122:0/3465248572 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64000b2050 con 0x7f640815e730 2024-05-28T06:09:08.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f63ffe00640 1 -- 172.21.15.122:0/3465248572 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64000be070 con 0x7f640815e730 2024-05-28T06:09:08.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f63ffe00640 1 -- 172.21.15.122:0/3465248572 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64000ad870 con 0x7f640815e730 2024-05-28T06:09:08.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.605+0000 7f640e600640 1 -- 172.21.15.122:0/3465248572 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6408159ee0 con 0x7f640815e730 2024-05-28T06:09:08.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.609+0000 7f640e600640 1 -- 172.21.15.122:0/3465248572 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f640813aa30 con 0x7f640815e730 2024-05-28T06:09:08.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.609+0000 7f640e600640 1 -- 172.21.15.122:0/3465248572 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f640813ac30 con 0x7f640815e730 2024-05-28T06:09:08.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.609+0000 7f63ffe00640 1 -- 172.21.15.122:0/3465248572 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f64000ada10 con 0x7f640815e730 2024-05-28T06:09:08.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.609+0000 7f63ffe00640 1 --2- 172.21.15.122:0/3465248572 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f63e4068530 0x7f63e406a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:08.613 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.609+0000 7f63ffe00640 1 -- 172.21.15.122:0/3465248572 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6400121dd0 con 0x7f640815e730 2024-05-28T06:09:08.613 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.609+0000 7f6407400640 1 --2- 172.21.15.122:0/3465248572 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f63e4068530 0x7f63e406a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:08.613 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.609+0000 7f6407400640 1 --2- 172.21.15.122:0/3465248572 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f63e4068530 0x7f63e406a9f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f63f8005890 tx=0x7f63f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:08.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.613+0000 7f63ffe00640 1 -- 172.21.15.122:0/3465248572 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f640813ac30 con 0x7f640815e730 2024-05-28T06:09:08.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.825+0000 7f640e600640 1 -- 172.21.15.122:0/3465248572 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6408068c40 con 0x7f640815e730 2024-05-28T06:09:08.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.829+0000 7f63ffe00640 1 -- 172.21.15.122:0/3465248572 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2078 (secure 0 0 0) 0x7f6400016520 con 0x7f640815e730 2024-05-28T06:09:08.831 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:08.831 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:09:08.831 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:09:08.831 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:09:08.831 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:09:08.831 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:09:08.831 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:09:08.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:08.831 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:09:08.831 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:09:08.831 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:09:08.831 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:09:08.831 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:09:08.832 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:09:08.832 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:09:08.832 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:09:08.832 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:09:08.832 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:09:08.832 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:09:08.832 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 224, 2024-05-28T06:09:08.832 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:09:08.832 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:09:08.832 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:09:08.832 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:09:08.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:08.832 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:09:08.832 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 34, 2024-05-28T06:09:08.833 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:09:08.833 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:09:08.833 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:09:08.833 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:09:08.833 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:09:08.833 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:09:08.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:08.833 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:09:08.833 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:09:08.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:08.833 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:09:08.833 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:09:08.833 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:08.833 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:09:08.834 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:09:08.834 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:09:08.834 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 3027, 2024-05-28T06:09:08.834 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 12575922512, 2024-05-28T06:09:08.834 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 25410412544, 2024-05-28T06:09:08.834 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 747683700736, 2024-05-28T06:09:08.834 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:09:08.834 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 1791, 2024-05-28T06:09:08.834 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 0, 2024-05-28T06:09:08.834 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 0 2024-05-28T06:09:08.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:08.834 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:09:08.834 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 19, 2024-05-28T06:09:08.834 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 2, 2024-05-28T06:09:08.835 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:09:08.835 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:09:08.835 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:09:08.835 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:09:08.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:08.835 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 2, 2024-05-28T06:09:08.835 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:09:08.835 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "a", 2024-05-28T06:09:08.835 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:09:08.835 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 5082 2024-05-28T06:09:08.835 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:08.835 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:09:08.835 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:09:08.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:08.836 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:09:08.836 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:09:08.836 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:09:08.836 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:09:08.836 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:09:08.836 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:09:08.836 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:09:08.836 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:09:08.836 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:09:08.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:08.836 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:09:08.836 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 5, 2024-05-28T06:09:08.836 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:07:53.268069+0000", 2024-05-28T06:09:08.836 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:09:08.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:08.837 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:09:08.837 INFO:teuthology.orchestra.run.smithi122.stdout: "438f16d6-8ab7-4475-aa32-a0b2476e25e8": { 2024-05-28T06:09:08.837 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "All cloning finished, waiting 5.0 seconds before exiting (29s)\n [============================] ", 2024-05-28T06:09:08.837 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 1, 2024-05-28T06:09:08.837 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:09:08.837 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:08.837 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:08.837 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:09:08.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.829+0000 7f640e600640 1 -- 172.21.15.122:0/3465248572 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f63e4068530 msgr2=0x7f63e406a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:08.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.829+0000 7f640e600640 1 --2- 172.21.15.122:0/3465248572 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f63e4068530 0x7f63e406a9f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f63f8005890 tx=0x7f63f8009040 comp rx=0 tx=0).stop 2024-05-28T06:09:08.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.829+0000 7f640e600640 1 -- 172.21.15.122:0/3465248572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f640815e730 msgr2=0x7f6408139ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:08.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.829+0000 7f640e600640 1 --2- 172.21.15.122:0/3465248572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f640815e730 0x7f6408139ef0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f64000b0040 tx=0x7f64000196d0 comp rx=0 tx=0).stop 2024-05-28T06:09:08.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.829+0000 7f640e600640 1 -- 172.21.15.122:0/3465248572 shutdown_connections 2024-05-28T06:09:08.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.829+0000 7f640e600640 1 --2- 172.21.15.122:0/3465248572 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f63e4068530 0x7f63e406a9f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:08.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.829+0000 7f640e600640 1 --2- 172.21.15.122:0/3465248572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f640815e730 0x7f6408139ef0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:08.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.829+0000 7f640e600640 1 --2- 172.21.15.122:0/3465248572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64080ce4f0 0x7f6408154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:08.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.829+0000 7f640e600640 1 --2- 172.21.15.122:0/3465248572 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64080b58d0 0x7f6408159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:08.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.829+0000 7f640e600640 1 -- 172.21.15.122:0/3465248572 >> 172.21.15.122:0/3465248572 conn(0x7f640806bd90 msgr2=0x7f6408074d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:08.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.829+0000 7f640e600640 1 -- 172.21.15.122:0/3465248572 shutdown_connections 2024-05-28T06:09:08.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:08.829+0000 7f640e600640 1 -- 172.21.15.122:0/3465248572 wait complete. 2024-05-28T06:09:13.853 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:09:14.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:13.996+0000 7fba70400640 1 Processor -- start 2024-05-28T06:09:14.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.000+0000 7fba70400640 1 -- start start 2024-05-28T06:09:14.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.000+0000 7fba70400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fba6815ebf0 0x7fba680cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:14.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.000+0000 7fba70400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fba680b7b40 0x7fba680d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:14.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.000+0000 7fba70400640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba6806df80 con 0x7fba680cf640 2024-05-28T06:09:14.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.000+0000 7fba70400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fba680d46e0 con 0x7fba6815ebf0 2024-05-28T06:09:14.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.000+0000 7fba70400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fba680d2f10 con 0x7fba680b7b40 2024-05-28T06:09:14.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.000+0000 7fba6e400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fba680cf640 0x7fba680b6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38756/0 (socket says 172.21.15.122:38756) 2024-05-28T06:09:14.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.000+0000 7fba6e400640 1 -- 172.21.15.122:0/88531047 learned_addr learned my addr 172.21.15.122:0/88531047 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:14.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.000+0000 7fba6d000640 1 --2- 172.21.15.122:0/88531047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fba680b7b40 0x7fba680d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:14.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.000+0000 7fba6da00640 1 --2- 172.21.15.122:0/88531047 >> v2:172.21.15.153:3300/0 conn(0x7fba6815ebf0 0x7fba680cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:14.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.000+0000 7fba67e00640 1 -- 172.21.15.122:0/88531047 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3416662691 0 0) 0x7fba6806df80 con 0x7fba680cf640 2024-05-28T06:09:14.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.000+0000 7fba67e00640 1 -- 172.21.15.122:0/88531047 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba50003530 con 0x7fba680cf640 2024-05-28T06:09:14.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.000+0000 7fba6d000640 1 -- 172.21.15.122:0/88531047 >> v2:172.21.15.153:3300/0 conn(0x7fba6815ebf0 msgr2=0x7fba680cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:14.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.000+0000 7fba6d000640 1 --2- 172.21.15.122:0/88531047 >> v2:172.21.15.153:3300/0 conn(0x7fba6815ebf0 0x7fba680cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.000+0000 7fba6d000640 1 -- 172.21.15.122:0/88531047 >> v1:172.21.15.122:6789/0 conn(0x7fba680cf640 legacy=0x7fba680b6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:14.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.000+0000 7fba6d000640 1 -- 172.21.15.122:0/88531047 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba680cfb50 con 0x7fba680b7b40 2024-05-28T06:09:14.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.000+0000 7fba6da00640 1 --2- 172.21.15.122:0/88531047 >> v2:172.21.15.153:3300/0 conn(0x7fba6815ebf0 0x7fba680cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:09:14.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.004+0000 7fba6d000640 1 --2- 172.21.15.122:0/88531047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fba680b7b40 0x7fba680d1110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fba540097c0 tx=0x7fba5401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92bdf763a083cf53 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:14.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.004+0000 7fba67e00640 1 -- 172.21.15.122:0/88531047 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba540b1070 con 0x7fba680b7b40 2024-05-28T06:09:14.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.004+0000 7fba67e00640 1 -- 172.21.15.122:0/88531047 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba540a8050 con 0x7fba680b7b40 2024-05-28T06:09:14.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.004+0000 7fba67e00640 1 -- 172.21.15.122:0/88531047 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba540ac860 con 0x7fba680b7b40 2024-05-28T06:09:14.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.004+0000 7fba70400640 1 -- 172.21.15.122:0/88531047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fba680b7b40 msgr2=0x7fba680d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:14.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.004+0000 7fba70400640 1 --2- 172.21.15.122:0/88531047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fba680b7b40 0x7fba680d1110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fba540097c0 tx=0x7fba5401c3e0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.004+0000 7fba70400640 1 -- 172.21.15.122:0/88531047 shutdown_connections 2024-05-28T06:09:14.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.004+0000 7fba70400640 1 --2- 172.21.15.122:0/88531047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fba680b7b40 0x7fba680d1110 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.004+0000 7fba70400640 1 --2- 172.21.15.122:0/88531047 >> v2:172.21.15.153:3300/0 conn(0x7fba6815ebf0 0x7fba680cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.004+0000 7fba70400640 1 -- 172.21.15.122:0/88531047 >> 172.21.15.122:0/88531047 conn(0x7fba6806ce10 msgr2=0x7fba6806d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:14.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.004+0000 7fba70400640 1 -- 172.21.15.122:0/88531047 shutdown_connections 2024-05-28T06:09:14.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.004+0000 7fba70400640 1 -- 172.21.15.122:0/88531047 wait complete. 2024-05-28T06:09:14.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.004+0000 7fba70400640 1 Processor -- start 2024-05-28T06:09:14.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba70400640 1 -- start start 2024-05-28T06:09:14.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba70400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba680b7b40 0x7fba6814d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:14.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba70400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fba680cf640 0x7fba68159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:14.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba70400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba6815ebf0 0x7fba68159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:14.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba70400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fba680d1a60 con 0x7fba680b7b40 2024-05-28T06:09:14.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba70400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fba6815efd0 con 0x7fba6815ebf0 2024-05-28T06:09:14.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba70400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fba68162940 con 0x7fba680cf640 2024-05-28T06:09:14.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba6da00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba680b7b40 0x7fba6814d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:14.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba6da00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba680b7b40 0x7fba6814d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:60026/0 (socket says 172.21.15.122:60026) 2024-05-28T06:09:14.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba6da00640 1 -- 172.21.15.122:0/3204584047 learned_addr learned my addr 172.21.15.122:0/3204584047 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:14.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba6d000640 1 --2- 172.21.15.122:0/3204584047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fba680cf640 0x7fba68159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:14.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba6e400640 1 --2- 172.21.15.122:0/3204584047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba6815ebf0 0x7fba68159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:14.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba6da00640 1 -- 172.21.15.122:0/3204584047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fba680cf640 msgr2=0x7fba68159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:14.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba6da00640 1 --2- 172.21.15.122:0/3204584047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fba680cf640 0x7fba68159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba6da00640 1 -- 172.21.15.122:0/3204584047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba6815ebf0 msgr2=0x7fba68159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:14.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba6da00640 1 --2- 172.21.15.122:0/3204584047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba6815ebf0 0x7fba68159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba6da00640 1 -- 172.21.15.122:0/3204584047 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba680b93a0 con 0x7fba680b7b40 2024-05-28T06:09:14.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba6da00640 1 --2- 172.21.15.122:0/3204584047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba680b7b40 0x7fba6814d520 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00ebe0 tx=0x7fba5c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:14.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba65600640 1 -- 172.21.15.122:0/3204584047 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c017070 con 0x7fba680b7b40 2024-05-28T06:09:14.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba65600640 1 -- 172.21.15.122:0/3204584047 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba5c00cc30 con 0x7fba680b7b40 2024-05-28T06:09:14.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba65600640 1 -- 172.21.15.122:0/3204584047 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c013470 con 0x7fba680b7b40 2024-05-28T06:09:14.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba70400640 1 -- 172.21.15.122:0/3204584047 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba680b9680 con 0x7fba680b7b40 2024-05-28T06:09:14.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba70400640 1 -- 172.21.15.122:0/3204584047 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba680b9c40 con 0x7fba680b7b40 2024-05-28T06:09:14.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.008+0000 7fba70400640 1 -- 172.21.15.122:0/3204584047 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba68068c40 con 0x7fba680b7b40 2024-05-28T06:09:14.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.012+0000 7fba65600640 1 -- 172.21.15.122:0/3204584047 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7fba5c01a070 con 0x7fba680b7b40 2024-05-28T06:09:14.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.012+0000 7fba65600640 1 --2- 172.21.15.122:0/3204584047 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fba48068530 0x7fba4806a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:14.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.012+0000 7fba65600640 1 -- 172.21.15.122:0/3204584047 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fba5c086bb0 con 0x7fba680b7b40 2024-05-28T06:09:14.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.012+0000 7fba6d000640 1 --2- 172.21.15.122:0/3204584047 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fba48068530 0x7fba4806a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:14.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.012+0000 7fba6d000640 1 --2- 172.21.15.122:0/3204584047 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fba48068530 0x7fba4806a9f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fba540ae000 tx=0x7fba540a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:14.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.016+0000 7fba65600640 1 -- 172.21.15.122:0/3204584047 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fba5c056890 con 0x7fba680b7b40 2024-05-28T06:09:14.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.232+0000 7fba70400640 1 -- 172.21.15.122:0/3204584047 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fba680d26b0 con 0x7fba680b7b40 2024-05-28T06:09:14.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.232+0000 7fba65600640 1 -- 172.21.15.122:0/3204584047 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1823 (secure 0 0 0) 0x7fba5c05ab90 con 0x7fba680b7b40 2024-05-28T06:09:14.235 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:14.235 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:09:14.235 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:09:14.235 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:09:14.235 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:09:14.235 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:09:14.235 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:09:14.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:14.235 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:09:14.235 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:09:14.235 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:09:14.236 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:09:14.236 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:09:14.236 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:09:14.236 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:09:14.236 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:09:14.236 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:09:14.236 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:09:14.236 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:09:14.236 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 229, 2024-05-28T06:09:14.236 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:09:14.236 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:09:14.236 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:09:14.236 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:09:14.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:14.237 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:09:14.237 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 34, 2024-05-28T06:09:14.237 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:09:14.237 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:09:14.237 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:09:14.237 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:09:14.237 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:09:14.237 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:09:14.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:14.237 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:09:14.237 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:09:14.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:14.237 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:09:14.238 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:09:14.238 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:14.238 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:09:14.238 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:09:14.238 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:09:14.238 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 3027, 2024-05-28T06:09:14.238 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 12575922512, 2024-05-28T06:09:14.238 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 25410412544, 2024-05-28T06:09:14.238 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 747683700736, 2024-05-28T06:09:14.238 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:09:14.238 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 597, 2024-05-28T06:09:14.238 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 0, 2024-05-28T06:09:14.238 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 0 2024-05-28T06:09:14.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:14.239 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:09:14.239 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 19, 2024-05-28T06:09:14.239 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 2, 2024-05-28T06:09:14.239 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:09:14.239 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:09:14.239 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:09:14.239 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:09:14.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:14.239 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 2, 2024-05-28T06:09:14.239 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:09:14.239 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "a", 2024-05-28T06:09:14.239 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:09:14.239 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 5082 2024-05-28T06:09:14.239 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:14.240 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:09:14.240 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:09:14.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:14.240 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:09:14.240 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:09:14.240 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:09:14.240 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:09:14.240 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:09:14.240 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:09:14.240 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:09:14.240 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:09:14.240 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:09:14.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:14.240 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:09:14.241 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 5, 2024-05-28T06:09:14.241 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:07:53.268069+0000", 2024-05-28T06:09:14.241 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:09:14.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:14.241 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": {} 2024-05-28T06:09:14.241 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:09:14.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.232+0000 7fba70400640 1 -- 172.21.15.122:0/3204584047 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fba48068530 msgr2=0x7fba4806a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:14.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.232+0000 7fba70400640 1 --2- 172.21.15.122:0/3204584047 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fba48068530 0x7fba4806a9f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fba540ae000 tx=0x7fba540a7000 comp rx=0 tx=0).stop 2024-05-28T06:09:14.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.232+0000 7fba70400640 1 -- 172.21.15.122:0/3204584047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba680b7b40 msgr2=0x7fba6814d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:14.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.232+0000 7fba70400640 1 --2- 172.21.15.122:0/3204584047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba680b7b40 0x7fba6814d520 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00ebe0 tx=0x7fba5c00c520 comp rx=0 tx=0).stop 2024-05-28T06:09:14.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.232+0000 7fba70400640 1 -- 172.21.15.122:0/3204584047 shutdown_connections 2024-05-28T06:09:14.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.232+0000 7fba70400640 1 --2- 172.21.15.122:0/3204584047 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fba48068530 0x7fba4806a9f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.232+0000 7fba70400640 1 --2- 172.21.15.122:0/3204584047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba6815ebf0 0x7fba68159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.232+0000 7fba70400640 1 --2- 172.21.15.122:0/3204584047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fba680cf640 0x7fba68159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.232+0000 7fba70400640 1 --2- 172.21.15.122:0/3204584047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba680b7b40 0x7fba6814d520 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.232+0000 7fba70400640 1 -- 172.21.15.122:0/3204584047 >> 172.21.15.122:0/3204584047 conn(0x7fba6806ce10 msgr2=0x7fba6815db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:14.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.232+0000 7fba70400640 1 -- 172.21.15.122:0/3204584047 shutdown_connections 2024-05-28T06:09:14.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.232+0000 7fba70400640 1 -- 172.21.15.122:0/3204584047 wait complete. 2024-05-28T06:09:14.256 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-05-28T06:09:14.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.392+0000 7f6e9c200640 1 Processor -- start 2024-05-28T06:09:14.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.392+0000 7f6e9c200640 1 -- start start 2024-05-28T06:09:14.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.396+0000 7f6e9c200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6e940ce4f0 0x7f6e940ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:14.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.396+0000 7f6e9c200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e9415d970 con 0x7f6e940b58d0 2024-05-28T06:09:14.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.396+0000 7f6e9c200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e9415dc50 con 0x7f6e9415e730 2024-05-28T06:09:14.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.396+0000 7f6e9c200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f6e9415df30 con 0x7f6e940ce4f0 2024-05-28T06:09:14.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.396+0000 7f6e99800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f6e940b58d0 0x7f6e940b5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38764/0 (socket says 172.21.15.122:38764) 2024-05-28T06:09:14.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.396+0000 7f6e99800640 1 -- 172.21.15.122:0/1117986921 learned_addr learned my addr 172.21.15.122:0/1117986921 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:14.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.396+0000 7f6e98e00640 1 --2- 172.21.15.122:0/1117986921 >> v2:172.21.15.122:3300/0 conn(0x7f6e940ce4f0 0x7f6e940ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:14.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.396+0000 7f6e93e00640 1 -- 172.21.15.122:0/1117986921 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4038961272 0 0) 0x7f6e9415d970 con 0x7f6e940b58d0 2024-05-28T06:09:14.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.396+0000 7f6e93e00640 1 -- 172.21.15.122:0/1117986921 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e7c003530 con 0x7f6e940b58d0 2024-05-28T06:09:14.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.396+0000 7f6e98e00640 1 -- 172.21.15.122:0/1117986921 >> v1:172.21.15.153:6789/0 conn(0x7f6e9415e730 legacy=0x7f6e9415eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:14.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.396+0000 7f6e98e00640 1 -- 172.21.15.122:0/1117986921 >> v1:172.21.15.122:6789/0 conn(0x7f6e940b58d0 legacy=0x7f6e940b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:14.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.396+0000 7f6e98e00640 1 -- 172.21.15.122:0/1117986921 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9415e210 con 0x7f6e940ce4f0 2024-05-28T06:09:14.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.400+0000 7f6e98e00640 1 --2- 172.21.15.122:0/1117986921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e940ce4f0 0x7f6e940ce980 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6e800097c0 tx=0x7f6e8001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02489fd9d30643d server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:14.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.400+0000 7f6e93e00640 1 -- 172.21.15.122:0/1117986921 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e800b0070 con 0x7f6e940ce4f0 2024-05-28T06:09:14.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.400+0000 7f6e93e00640 1 -- 172.21.15.122:0/1117986921 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e80004230 con 0x7f6e940ce4f0 2024-05-28T06:09:14.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.400+0000 7f6e93e00640 1 -- 172.21.15.122:0/1117986921 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e80003620 con 0x7f6e940ce4f0 2024-05-28T06:09:14.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.400+0000 7f6e9c200640 1 -- 172.21.15.122:0/1117986921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e940ce4f0 msgr2=0x7f6e940ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:14.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.400+0000 7f6e9c200640 1 --2- 172.21.15.122:0/1117986921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e940ce4f0 0x7f6e940ce980 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6e800097c0 tx=0x7f6e8001c4a0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.400+0000 7f6e9c200640 1 -- 172.21.15.122:0/1117986921 shutdown_connections 2024-05-28T06:09:14.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.400+0000 7f6e9c200640 1 --2- 172.21.15.122:0/1117986921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e940ce4f0 0x7f6e940ce980 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.400+0000 7f6e9c200640 1 -- 172.21.15.122:0/1117986921 >> 172.21.15.122:0/1117986921 conn(0x7f6e9406bd90 msgr2=0x7f6e9406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:14.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.400+0000 7f6e9c200640 1 -- 172.21.15.122:0/1117986921 shutdown_connections 2024-05-28T06:09:14.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.400+0000 7f6e9c200640 1 -- 172.21.15.122:0/1117986921 wait complete. 2024-05-28T06:09:14.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.400+0000 7f6e9c200640 1 Processor -- start 2024-05-28T06:09:14.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.400+0000 7f6e9c200640 1 -- start start 2024-05-28T06:09:14.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e9c200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e940b58d0 0x7f6e940ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:14.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e9c200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e940ce4f0 0x7f6e940b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:14.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e9c200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e9415e730 0x7f6e9413e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:14.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e9c200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9416a3e0 con 0x7f6e940b58d0 2024-05-28T06:09:14.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e9c200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9416a260 con 0x7f6e9415e730 2024-05-28T06:09:14.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e9c200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6e9416a560 con 0x7f6e940ce4f0 2024-05-28T06:09:14.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e99800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e940b58d0 0x7f6e940ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:14.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e99800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e940b58d0 0x7f6e940ae3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:60046/0 (socket says 172.21.15.122:60046) 2024-05-28T06:09:14.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e99800640 1 -- 172.21.15.122:0/2401759095 learned_addr learned my addr 172.21.15.122:0/2401759095 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:14.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e9a200640 1 --2- 172.21.15.122:0/2401759095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e9415e730 0x7f6e9413e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:14.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e98e00640 1 --2- 172.21.15.122:0/2401759095 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e940ce4f0 0x7f6e940b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:14.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e99800640 1 -- 172.21.15.122:0/2401759095 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e940ce4f0 msgr2=0x7f6e940b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:14.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e99800640 1 --2- 172.21.15.122:0/2401759095 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e940ce4f0 0x7f6e940b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e99800640 1 -- 172.21.15.122:0/2401759095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e9415e730 msgr2=0x7f6e9413e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:14.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e99800640 1 --2- 172.21.15.122:0/2401759095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e9415e730 0x7f6e9413e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e99800640 1 -- 172.21.15.122:0/2401759095 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e940aeb70 con 0x7f6e940b58d0 2024-05-28T06:09:14.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e99800640 1 --2- 172.21.15.122:0/2401759095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e940b58d0 0x7f6e940ae3d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800c4d0 tx=0x7f6e8800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:14.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e91600640 1 -- 172.21.15.122:0/2401759095 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e88017070 con 0x7f6e940b58d0 2024-05-28T06:09:14.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e91600640 1 -- 172.21.15.122:0/2401759095 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e88005cf0 con 0x7f6e940b58d0 2024-05-28T06:09:14.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e9c200640 1 -- 172.21.15.122:0/2401759095 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e940aee50 con 0x7f6e940b58d0 2024-05-28T06:09:14.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e91600640 1 -- 172.21.15.122:0/2401759095 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e88007270 con 0x7f6e940b58d0 2024-05-28T06:09:14.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e9c200640 1 -- 172.21.15.122:0/2401759095 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e940b09b0 con 0x7f6e940b58d0 2024-05-28T06:09:14.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e9c200640 1 -- 172.21.15.122:0/2401759095 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e940af370 con 0x7f6e940b58d0 2024-05-28T06:09:14.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.404+0000 7f6e91600640 1 -- 172.21.15.122:0/2401759095 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f6e8801a070 con 0x7f6e940b58d0 2024-05-28T06:09:14.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.408+0000 7f6e91600640 1 --2- 172.21.15.122:0/2401759095 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6e74068530 0x7f6e7406a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:14.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.408+0000 7f6e91600640 1 -- 172.21.15.122:0/2401759095 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6e88085f70 con 0x7f6e940b58d0 2024-05-28T06:09:14.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.408+0000 7f6e98e00640 1 --2- 172.21.15.122:0/2401759095 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6e74068530 0x7f6e7406a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:14.411 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.408+0000 7f6e98e00640 1 --2- 172.21.15.122:0/2401759095 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6e74068530 0x7f6e7406a9f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6e800ad000 tx=0x7f6e800a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:14.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.412+0000 7f6e91600640 1 -- 172.21.15.122:0/2401759095 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6e88055cf0 con 0x7f6e940b58d0 2024-05-28T06:09:14.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.592+0000 7f6e9c200640 1 -- 172.21.15.122:0/2401759095 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6e940ae910 con 0x7f6e74068530 2024-05-28T06:09:14.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.596+0000 7f6e91600640 1 -- 172.21.15.122:0/2401759095 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+79 (secure 0 0 0) 0x7f6e80004290 con 0x7f6e74068530 2024-05-28T06:09:14.600 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:14.600 INFO:teuthology.orchestra.run.smithi122.stdout:[ 2024-05-28T06:09:14.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:14.600 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "sv1" 2024-05-28T06:09:14.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:14.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:14.600 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "ss1clone1" 2024-05-28T06:09:14.601 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:14.601 INFO:teuthology.orchestra.run.smithi122.stdout:] 2024-05-28T06:09:14.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.600+0000 7f6e9c200640 1 -- 172.21.15.122:0/2401759095 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6e74068530 msgr2=0x7f6e7406a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:14.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.600+0000 7f6e9c200640 1 --2- 172.21.15.122:0/2401759095 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6e74068530 0x7f6e7406a9f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6e800ad000 tx=0x7f6e800a6000 comp rx=0 tx=0).stop 2024-05-28T06:09:14.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.600+0000 7f6e9c200640 1 -- 172.21.15.122:0/2401759095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e940b58d0 msgr2=0x7f6e940ae3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:14.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.600+0000 7f6e9c200640 1 --2- 172.21.15.122:0/2401759095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e940b58d0 0x7f6e940ae3d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800c4d0 tx=0x7f6e8800c990 comp rx=0 tx=0).stop 2024-05-28T06:09:14.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.600+0000 7f6e9c200640 1 -- 172.21.15.122:0/2401759095 shutdown_connections 2024-05-28T06:09:14.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.600+0000 7f6e9c200640 1 --2- 172.21.15.122:0/2401759095 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6e74068530 0x7f6e7406a9f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.600+0000 7f6e9c200640 1 --2- 172.21.15.122:0/2401759095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e9415e730 0x7f6e9413e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.600+0000 7f6e9c200640 1 --2- 172.21.15.122:0/2401759095 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e940ce4f0 0x7f6e940b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.600+0000 7f6e9c200640 1 --2- 172.21.15.122:0/2401759095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e940b58d0 0x7f6e940ae3d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.600+0000 7f6e9c200640 1 -- 172.21.15.122:0/2401759095 >> 172.21.15.122:0/2401759095 conn(0x7f6e9406bd90 msgr2=0x7f6e94144f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:14.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.600+0000 7f6e9c200640 1 -- 172.21.15.122:0/2401759095 shutdown_connections 2024-05-28T06:09:14.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.600+0000 7f6e9c200640 1 -- 172.21.15.122:0/2401759095 wait complete. 2024-05-28T06:09:14.622 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-05-28T06:09:14.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.760+0000 7fa6c1200640 1 Processor -- start 2024-05-28T06:09:14.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.760+0000 7fa6c1200640 1 -- start start 2024-05-28T06:09:14.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.760+0000 7fa6c1200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa6bc0ce4f0 0x7fa6bc0ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:14.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.760+0000 7fa6c1200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa6bc15e730 0x7fa6bc15ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:14.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.760+0000 7fa6c1200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6bc15d970 con 0x7fa6bc0b58d0 2024-05-28T06:09:14.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.760+0000 7fa6c1200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fa6bc15dc50 con 0x7fa6bc15e730 2024-05-28T06:09:14.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.760+0000 7fa6c1200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa6bc15df30 con 0x7fa6bc0ce4f0 2024-05-28T06:09:14.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.760+0000 7fa6ba800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa6bc15e730 0x7fa6bc15ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:14.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.760+0000 7fa6ba800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa6bc15e730 0x7fa6bc15ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:60048/0 (socket says 172.21.15.122:60048) 2024-05-28T06:09:14.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.760+0000 7fa6ba800640 1 -- 172.21.15.122:0/2404874456 learned_addr learned my addr 172.21.15.122:0/2404874456 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:14.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.760+0000 7fa6b9400640 1 --2- 172.21.15.122:0/2404874456 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa6bc0ce4f0 0x7fa6bc0ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:14.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.760+0000 7fa6ba800640 1 -- 172.21.15.122:0/2404874456 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa6bc0ce4f0 msgr2=0x7fa6bc0ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:14.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.760+0000 7fa6ba800640 1 --2- 172.21.15.122:0/2404874456 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa6bc0ce4f0 0x7fa6bc0ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.760+0000 7fa6ba800640 1 -- 172.21.15.122:0/2404874456 >> v1:172.21.15.153:6789/0 conn(0x7fa6bc0b58d0 legacy=0x7fa6bc0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:14.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.760+0000 7fa6ba800640 1 -- 172.21.15.122:0/2404874456 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6bc15e210 con 0x7fa6bc15e730 2024-05-28T06:09:14.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.760+0000 7fa6b9400640 1 --2- 172.21.15.122:0/2404874456 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa6bc0ce4f0 0x7fa6bc0ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:09:14.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.764+0000 7fa6ba800640 1 --2- 172.21.15.122:0/2404874456 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6bc15e730 0x7fa6bc15ebc0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4009e50 tx=0x7fa6b401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3579673295221fc server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:14.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.764+0000 7fa6b8a00640 1 -- 172.21.15.122:0/2404874456 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b40a57a0 con 0x7fa6bc15e730 2024-05-28T06:09:14.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.764+0000 7fa6b8a00640 1 -- 172.21.15.122:0/2404874456 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b40a5940 con 0x7fa6bc15e730 2024-05-28T06:09:14.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.764+0000 7fa6b8a00640 1 -- 172.21.15.122:0/2404874456 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b40a5d10 con 0x7fa6bc15e730 2024-05-28T06:09:14.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.764+0000 7fa6c1200640 1 -- 172.21.15.122:0/2404874456 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6bc15e730 msgr2=0x7fa6bc15ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:14.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.764+0000 7fa6c1200640 1 --2- 172.21.15.122:0/2404874456 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6bc15e730 0x7fa6bc15ebc0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4009e50 tx=0x7fa6b401ca30 comp rx=0 tx=0).stop 2024-05-28T06:09:14.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.764+0000 7fa6c1200640 1 -- 172.21.15.122:0/2404874456 shutdown_connections 2024-05-28T06:09:14.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.764+0000 7fa6c1200640 1 --2- 172.21.15.122:0/2404874456 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6bc15e730 0x7fa6bc15ebc0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.764+0000 7fa6c1200640 1 --2- 172.21.15.122:0/2404874456 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa6bc0ce4f0 0x7fa6bc0ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.764+0000 7fa6c1200640 1 -- 172.21.15.122:0/2404874456 >> 172.21.15.122:0/2404874456 conn(0x7fa6bc06bd90 msgr2=0x7fa6bc06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:14.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.764+0000 7fa6c1200640 1 -- 172.21.15.122:0/2404874456 shutdown_connections 2024-05-28T06:09:14.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.764+0000 7fa6c1200640 1 -- 172.21.15.122:0/2404874456 wait complete. 2024-05-28T06:09:14.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.768+0000 7fa6c1200640 1 Processor -- start 2024-05-28T06:09:14.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.768+0000 7fa6c1200640 1 -- start start 2024-05-28T06:09:14.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.768+0000 7fa6c1200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa6bc0b58d0 0x7fa6bc15ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:14.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.768+0000 7fa6c1200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6bc0ce4f0 0x7fa6bc0ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:14.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.768+0000 7fa6c1200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6bc15e730 0x7fa6bc142160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:14.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.768+0000 7fa6c1200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa6bc1693d0 con 0x7fa6bc0ce4f0 2024-05-28T06:09:14.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.768+0000 7fa6c1200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa6bc169250 con 0x7fa6bc15e730 2024-05-28T06:09:14.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.768+0000 7fa6c1200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa6bc169550 con 0x7fa6bc0b58d0 2024-05-28T06:09:14.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.768+0000 7fa6b9400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6bc0ce4f0 0x7fa6bc0ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:14.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.768+0000 7fa6b9400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6bc0ce4f0 0x7fa6bc0ae060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:60060/0 (socket says 172.21.15.122:60060) 2024-05-28T06:09:14.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.768+0000 7fa6b9400640 1 -- 172.21.15.122:0/1402896552 learned_addr learned my addr 172.21.15.122:0/1402896552 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:14.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.768+0000 7fa6b9400640 1 -- 172.21.15.122:0/1402896552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa6bc0b58d0 msgr2=0x7fa6bc15ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:14.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.768+0000 7fa6b9400640 1 --2- 172.21.15.122:0/1402896552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa6bc0b58d0 0x7fa6bc15ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.768+0000 7fa6b9400640 1 -- 172.21.15.122:0/1402896552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6bc15e730 msgr2=0x7fa6bc142160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:14.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.768+0000 7fa6b9400640 1 --2- 172.21.15.122:0/1402896552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6bc15e730 0x7fa6bc142160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.768+0000 7fa6b9400640 1 -- 172.21.15.122:0/1402896552 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6bc0ae5a0 con 0x7fa6bc0ce4f0 2024-05-28T06:09:14.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.768+0000 7fa6b9400640 1 --2- 172.21.15.122:0/1402896552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6bc0ce4f0 0x7fa6bc0ae060 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800c7c0 tx=0x7fa6a800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:14.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.768+0000 7fa6b2000640 1 -- 172.21.15.122:0/1402896552 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8007a30 con 0x7fa6bc0ce4f0 2024-05-28T06:09:14.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.768+0000 7fa6b2000640 1 -- 172.21.15.122:0/1402896552 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6a8007bd0 con 0x7fa6bc0ce4f0 2024-05-28T06:09:14.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.768+0000 7fa6b2000640 1 -- 172.21.15.122:0/1402896552 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a80113f0 con 0x7fa6bc0ce4f0 2024-05-28T06:09:14.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.768+0000 7fa6c1200640 1 -- 172.21.15.122:0/1402896552 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6bc0aec40 con 0x7fa6bc0ce4f0 2024-05-28T06:09:14.777 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.768+0000 7fa6c1200640 1 -- 172.21.15.122:0/1402896552 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6bc0af200 con 0x7fa6bc0ce4f0 2024-05-28T06:09:14.777 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.768+0000 7fa6c1200640 1 -- 172.21.15.122:0/1402896552 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6bc068c40 con 0x7fa6bc0ce4f0 2024-05-28T06:09:14.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.772+0000 7fa6b2000640 1 -- 172.21.15.122:0/1402896552 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7fa6a8011590 con 0x7fa6bc0ce4f0 2024-05-28T06:09:14.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.772+0000 7fa6b2000640 1 --2- 172.21.15.122:0/1402896552 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa69c068560 0x7fa69c06aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:14.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.772+0000 7fa6b2000640 1 -- 172.21.15.122:0/1402896552 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa6a8086f70 con 0x7fa6bc0ce4f0 2024-05-28T06:09:14.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.772+0000 7fa6b9e00640 1 --2- 172.21.15.122:0/1402896552 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa69c068560 0x7fa69c06aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:14.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.772+0000 7fa6b9e00640 1 --2- 172.21.15.122:0/1402896552 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa69c068560 0x7fa69c06aa20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac000f70 tx=0x7fa6ac0079e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:14.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.776+0000 7fa6b2000640 1 -- 172.21.15.122:0/1402896552 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa6bc0ae5a0 con 0x7fa6bc0ce4f0 2024-05-28T06:09:14.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.956+0000 7fa6c1200640 1 -- 172.21.15.122:0/1402896552 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa6bc076020 con 0x7fa69c068560 2024-05-28T06:09:14.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.968+0000 7fa6b2000640 1 -- 172.21.15.122:0/1402896552 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fa6ac005080 con 0x7fa69c068560 2024-05-28T06:09:14.972 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:14.972 INFO:teuthology.orchestra.run.smithi122.stdout:[ 2024-05-28T06:09:14.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:14.973 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "ss1" 2024-05-28T06:09:14.973 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:14.973 INFO:teuthology.orchestra.run.smithi122.stdout:] 2024-05-28T06:09:14.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.972+0000 7fa6c1200640 1 -- 172.21.15.122:0/1402896552 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa69c068560 msgr2=0x7fa69c06aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:14.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.972+0000 7fa6c1200640 1 --2- 172.21.15.122:0/1402896552 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa69c068560 0x7fa69c06aa20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac000f70 tx=0x7fa6ac0079e0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.972+0000 7fa6c1200640 1 -- 172.21.15.122:0/1402896552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6bc0ce4f0 msgr2=0x7fa6bc0ae060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:14.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.972+0000 7fa6c1200640 1 --2- 172.21.15.122:0/1402896552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6bc0ce4f0 0x7fa6bc0ae060 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800c7c0 tx=0x7fa6a800cc80 comp rx=0 tx=0).stop 2024-05-28T06:09:14.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.972+0000 7fa6c1200640 1 -- 172.21.15.122:0/1402896552 shutdown_connections 2024-05-28T06:09:14.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.972+0000 7fa6c1200640 1 --2- 172.21.15.122:0/1402896552 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa69c068560 0x7fa69c06aa20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.972+0000 7fa6c1200640 1 --2- 172.21.15.122:0/1402896552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6bc15e730 0x7fa6bc142160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.972+0000 7fa6c1200640 1 --2- 172.21.15.122:0/1402896552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6bc0ce4f0 0x7fa6bc0ae060 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.972+0000 7fa6c1200640 1 --2- 172.21.15.122:0/1402896552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa6bc0b58d0 0x7fa6bc15ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:14.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.972+0000 7fa6c1200640 1 -- 172.21.15.122:0/1402896552 >> 172.21.15.122:0/1402896552 conn(0x7fa6bc06bd90 msgr2=0x7fa6bc13edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:14.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.972+0000 7fa6c1200640 1 -- 172.21.15.122:0/1402896552 shutdown_connections 2024-05-28T06:09:14.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:14.972+0000 7fa6c1200640 1 -- 172.21.15.122:0/1402896552 wait complete. 2024-05-28T06:09:14.994 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-28T06:09:15.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.132+0000 7f0e79000640 1 Processor -- start 2024-05-28T06:09:15.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.132+0000 7f0e79000640 1 -- start start 2024-05-28T06:09:15.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.132+0000 7f0e79000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0e741552a0 0x7f0e7415ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:15.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.132+0000 7f0e79000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e7415f470 0x7f0e740b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:15.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.132+0000 7f0e79000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e740b5620 con 0x7f0e74154ec0 2024-05-28T06:09:15.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.132+0000 7f0e79000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f0e7415eaa0 con 0x7f0e741552a0 2024-05-28T06:09:15.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.132+0000 7f0e79000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0e740b4d80 con 0x7f0e7415f470 2024-05-28T06:09:15.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.132+0000 7f0e71400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0e741552a0 0x7f0e7415ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:15.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.132+0000 7f0e71e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0e74154ec0 0x7f0e7415bd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:51958/0 (socket says 172.21.15.122:51958) 2024-05-28T06:09:15.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.132+0000 7f0e71e00640 1 -- 172.21.15.122:0/1475524169 learned_addr learned my addr 172.21.15.122:0/1475524169 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:15.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.132+0000 7f0e72800640 1 --2- 172.21.15.122:0/1475524169 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e7415f470 0x7f0e740b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:15.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.132+0000 7f0e71400640 1 -- 172.21.15.122:0/1475524169 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e7415f470 msgr2=0x7f0e740b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:15.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.132+0000 7f0e71400640 1 --2- 172.21.15.122:0/1475524169 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e7415f470 0x7f0e740b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.132+0000 7f0e71400640 1 -- 172.21.15.122:0/1475524169 >> v1:172.21.15.153:6789/0 conn(0x7f0e74154ec0 legacy=0x7f0e7415bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:15.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.132+0000 7f0e71400640 1 -- 172.21.15.122:0/1475524169 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e740b5060 con 0x7f0e741552a0 2024-05-28T06:09:15.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.136+0000 7f0e71400640 1 --2- 172.21.15.122:0/1475524169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e741552a0 0x7f0e7415ef30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0e600097f0 tx=0x7f0e6001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5a9d8736cdf7a03 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:15.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.136+0000 7f0e70a00640 1 -- 172.21.15.122:0/1475524169 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e600b0070 con 0x7f0e741552a0 2024-05-28T06:09:15.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.136+0000 7f0e70a00640 1 -- 172.21.15.122:0/1475524169 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e600ab600 con 0x7f0e741552a0 2024-05-28T06:09:15.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.136+0000 7f0e70a00640 1 -- 172.21.15.122:0/1475524169 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e600ab9d0 con 0x7f0e741552a0 2024-05-28T06:09:15.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.136+0000 7f0e79000640 1 -- 172.21.15.122:0/1475524169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e741552a0 msgr2=0x7f0e7415ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:15.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.136+0000 7f0e79000640 1 --2- 172.21.15.122:0/1475524169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e741552a0 0x7f0e7415ef30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0e600097f0 tx=0x7f0e6001c4a0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.136+0000 7f0e79000640 1 -- 172.21.15.122:0/1475524169 shutdown_connections 2024-05-28T06:09:15.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.136+0000 7f0e79000640 1 --2- 172.21.15.122:0/1475524169 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e7415f470 0x7f0e740b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.136+0000 7f0e79000640 1 --2- 172.21.15.122:0/1475524169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e741552a0 0x7f0e7415ef30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.136+0000 7f0e79000640 1 -- 172.21.15.122:0/1475524169 >> 172.21.15.122:0/1475524169 conn(0x7f0e740b3130 msgr2=0x7f0e740d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:15.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.136+0000 7f0e79000640 1 -- 172.21.15.122:0/1475524169 shutdown_connections 2024-05-28T06:09:15.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.136+0000 7f0e79000640 1 -- 172.21.15.122:0/1475524169 wait complete. 2024-05-28T06:09:15.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e79000640 1 Processor -- start 2024-05-28T06:09:15.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e79000640 1 -- start start 2024-05-28T06:09:15.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e79000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e74154ec0 0x7f0e74147e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:15.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e79000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e741552a0 0x7f0e7414cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:15.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e79000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e7415f470 0x7f0e74144f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:15.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e79000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0e740b4b60 con 0x7f0e74154ec0 2024-05-28T06:09:15.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e79000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0e740b49e0 con 0x7f0e741552a0 2024-05-28T06:09:15.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e79000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0e740ae5b0 con 0x7f0e7415f470 2024-05-28T06:09:15.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e71e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e74154ec0 0x7f0e74147e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:15.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e71e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e74154ec0 0x7f0e74147e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:60062/0 (socket says 172.21.15.122:60062) 2024-05-28T06:09:15.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e71e00640 1 -- 172.21.15.122:0/1695919011 learned_addr learned my addr 172.21.15.122:0/1695919011 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:15.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e71400640 1 --2- 172.21.15.122:0/1695919011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e741552a0 0x7f0e7414cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:15.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e72800640 1 --2- 172.21.15.122:0/1695919011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e7415f470 0x7f0e74144f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:15.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e71e00640 1 -- 172.21.15.122:0/1695919011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e7415f470 msgr2=0x7f0e74144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:15.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e71e00640 1 --2- 172.21.15.122:0/1695919011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e7415f470 0x7f0e74144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e71e00640 1 -- 172.21.15.122:0/1695919011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e741552a0 msgr2=0x7f0e7414cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:15.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e71e00640 1 --2- 172.21.15.122:0/1695919011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e741552a0 0x7f0e7414cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e71e00640 1 -- 172.21.15.122:0/1695919011 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e741fa5d0 con 0x7f0e74154ec0 2024-05-28T06:09:15.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e71e00640 1 --2- 172.21.15.122:0/1695919011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e74154ec0 0x7f0e74147e90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400ca70 tx=0x7f0e6400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:15.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e6a000640 1 -- 172.21.15.122:0/1695919011 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e64017070 con 0x7f0e74154ec0 2024-05-28T06:09:15.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e6a000640 1 -- 172.21.15.122:0/1695919011 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e6400abd0 con 0x7f0e74154ec0 2024-05-28T06:09:15.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e79000640 1 -- 172.21.15.122:0/1695919011 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e741473b0 con 0x7f0e74154ec0 2024-05-28T06:09:15.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e6a000640 1 -- 172.21.15.122:0/1695919011 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e64012400 con 0x7f0e74154ec0 2024-05-28T06:09:15.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.140+0000 7f0e79000640 1 -- 172.21.15.122:0/1695919011 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e74147060 con 0x7f0e74154ec0 2024-05-28T06:09:15.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.144+0000 7f0e79000640 1 -- 172.21.15.122:0/1695919011 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e74068c40 con 0x7f0e74154ec0 2024-05-28T06:09:15.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.144+0000 7f0e6a000640 1 -- 172.21.15.122:0/1695919011 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f0e6401a070 con 0x7f0e74154ec0 2024-05-28T06:09:15.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.144+0000 7f0e6a000640 1 --2- 172.21.15.122:0/1695919011 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0e54068530 0x7f0e5406a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:15.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.144+0000 7f0e6a000640 1 -- 172.21.15.122:0/1695919011 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0e64086880 con 0x7f0e74154ec0 2024-05-28T06:09:15.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.144+0000 7f0e71400640 1 --2- 172.21.15.122:0/1695919011 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0e54068530 0x7f0e5406a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:15.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.144+0000 7f0e71400640 1 --2- 172.21.15.122:0/1695919011 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0e54068530 0x7f0e5406a9f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0e600ad000 tx=0x7f0e60008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:15.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.148+0000 7f0e6a000640 1 -- 172.21.15.122:0/1695919011 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0e64056610 con 0x7f0e74154ec0 2024-05-28T06:09:15.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.336+0000 7f0e79000640 1 -- 172.21.15.122:0/1695919011 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0e740b5a80 con 0x7f0e54068530 2024-05-28T06:09:15.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.360+0000 7f0e6a000640 1 -- 172.21.15.122:0/1695919011 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0e740b5a80 con 0x7f0e54068530 2024-05-28T06:09:15.364 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:15.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.364+0000 7f0e79000640 1 -- 172.21.15.122:0/1695919011 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0e54068530 msgr2=0x7f0e5406a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:15.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.364+0000 7f0e79000640 1 --2- 172.21.15.122:0/1695919011 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0e54068530 0x7f0e5406a9f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0e600ad000 tx=0x7f0e60008040 comp rx=0 tx=0).stop 2024-05-28T06:09:15.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.364+0000 7f0e79000640 1 -- 172.21.15.122:0/1695919011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e74154ec0 msgr2=0x7f0e74147e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:15.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.364+0000 7f0e79000640 1 --2- 172.21.15.122:0/1695919011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e74154ec0 0x7f0e74147e90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400ca70 tx=0x7f0e6400cf30 comp rx=0 tx=0).stop 2024-05-28T06:09:15.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.364+0000 7f0e79000640 1 -- 172.21.15.122:0/1695919011 shutdown_connections 2024-05-28T06:09:15.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.364+0000 7f0e79000640 1 --2- 172.21.15.122:0/1695919011 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0e54068530 0x7f0e5406a9f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.364+0000 7f0e79000640 1 --2- 172.21.15.122:0/1695919011 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e7415f470 0x7f0e74144f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.364+0000 7f0e79000640 1 --2- 172.21.15.122:0/1695919011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e741552a0 0x7f0e7414cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.364+0000 7f0e79000640 1 --2- 172.21.15.122:0/1695919011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e74154ec0 0x7f0e74147e90 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.364+0000 7f0e79000640 1 -- 172.21.15.122:0/1695919011 >> 172.21.15.122:0/1695919011 conn(0x7f0e740b3130 msgr2=0x7f0e740ae9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:15.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.364+0000 7f0e79000640 1 -- 172.21.15.122:0/1695919011 shutdown_connections 2024-05-28T06:09:15.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.364+0000 7f0e79000640 1 -- 172.21.15.122:0/1695919011 wait complete. 2024-05-28T06:09:15.387 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-05-28T06:09:15.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.524+0000 7f7e60000640 1 Processor -- start 2024-05-28T06:09:15.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.524+0000 7f7e60000640 1 -- start start 2024-05-28T06:09:15.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.524+0000 7f7e60000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7e580b58d0 0x7f7e580b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:15.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.524+0000 7f7e60000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e580ce4f0 0x7f7e580ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:15.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.524+0000 7f7e60000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e580b61f0 con 0x7f7e580722a0 2024-05-28T06:09:15.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.524+0000 7f7e60000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f7e5815d970 con 0x7f7e580b58d0 2024-05-28T06:09:15.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.524+0000 7f7e60000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7e5815dc50 con 0x7f7e580ce4f0 2024-05-28T06:09:15.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.524+0000 7f7e5d600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7e580b58d0 0x7f7e580b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:15.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.524+0000 7f7e5e000640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f7e580722a0 0x7f7e58072730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:51502/0 (socket says 172.21.15.122:51502) 2024-05-28T06:09:15.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.524+0000 7f7e5e000640 1 -- 172.21.15.122:0/8714988 learned_addr learned my addr 172.21.15.122:0/8714988 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:15.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.524+0000 7f7e5cc00640 1 --2- 172.21.15.122:0/8714988 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e580ce4f0 0x7f7e580ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:15.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.524+0000 7f7e5d600640 1 -- 172.21.15.122:0/8714988 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e580ce4f0 msgr2=0x7f7e580ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:15.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.524+0000 7f7e5d600640 1 --2- 172.21.15.122:0/8714988 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e580ce4f0 0x7f7e580ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.524+0000 7f7e5d600640 1 -- 172.21.15.122:0/8714988 >> v1:172.21.15.122:6789/0 conn(0x7f7e580722a0 legacy=0x7f7e58072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:15.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.524+0000 7f7e5d600640 1 -- 172.21.15.122:0/8714988 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5815df30 con 0x7f7e580b58d0 2024-05-28T06:09:15.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.524+0000 7f7e57e00640 1 -- 172.21.15.122:0/8714988 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1254545850 0 0) 0x7f7e580b61f0 con 0x7f7e580722a0 2024-05-28T06:09:15.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.528+0000 7f7e5d600640 1 --2- 172.21.15.122:0/8714988 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e580b58d0 0x7f7e580b5cb0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009d90 tx=0x7f7e4c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ece03203328a546 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:15.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.528+0000 7f7e57e00640 1 -- 172.21.15.122:0/8714988 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c0b2070 con 0x7f7e580b58d0 2024-05-28T06:09:15.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.528+0000 7f7e57e00640 1 -- 172.21.15.122:0/8714988 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e4c0a59a0 con 0x7f7e580b58d0 2024-05-28T06:09:15.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.528+0000 7f7e57e00640 1 -- 172.21.15.122:0/8714988 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c0a5d70 con 0x7f7e580b58d0 2024-05-28T06:09:15.533 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.528+0000 7f7e60000640 1 -- 172.21.15.122:0/8714988 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e580b58d0 msgr2=0x7f7e580b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:15.533 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.528+0000 7f7e60000640 1 --2- 172.21.15.122:0/8714988 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e580b58d0 0x7f7e580b5cb0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009d90 tx=0x7f7e4c01c940 comp rx=0 tx=0).stop 2024-05-28T06:09:15.533 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.528+0000 7f7e60000640 1 -- 172.21.15.122:0/8714988 shutdown_connections 2024-05-28T06:09:15.533 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.528+0000 7f7e60000640 1 --2- 172.21.15.122:0/8714988 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e580ce4f0 0x7f7e580ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.533 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.528+0000 7f7e60000640 1 --2- 172.21.15.122:0/8714988 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e580b58d0 0x7f7e580b5cb0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.533 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.528+0000 7f7e60000640 1 -- 172.21.15.122:0/8714988 >> 172.21.15.122:0/8714988 conn(0x7f7e5806bd90 msgr2=0x7f7e5806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:15.534 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.528+0000 7f7e60000640 1 -- 172.21.15.122:0/8714988 shutdown_connections 2024-05-28T06:09:15.534 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.528+0000 7f7e60000640 1 -- 172.21.15.122:0/8714988 wait complete. 2024-05-28T06:09:15.534 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e60000640 1 Processor -- start 2024-05-28T06:09:15.534 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e60000640 1 -- start start 2024-05-28T06:09:15.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e60000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e580722a0 0x7f7e58159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:15.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e60000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e580b58d0 0x7f7e58140bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:15.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e60000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e580ce4f0 0x7f7e580b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:15.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e60000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7e580cf010 con 0x7f7e580722a0 2024-05-28T06:09:15.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e60000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7e580cee90 con 0x7f7e580ce4f0 2024-05-28T06:09:15.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e60000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7e58169a60 con 0x7f7e580b58d0 2024-05-28T06:09:15.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e5d600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e580722a0 0x7f7e58159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:15.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e5d600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e580722a0 0x7f7e58159a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40482/0 (socket says 172.21.15.122:40482) 2024-05-28T06:09:15.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e5d600640 1 -- 172.21.15.122:0/3483430825 learned_addr learned my addr 172.21.15.122:0/3483430825 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:15.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e5cc00640 1 --2- 172.21.15.122:0/3483430825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e580b58d0 0x7f7e58140bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:15.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e5e000640 1 --2- 172.21.15.122:0/3483430825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e580ce4f0 0x7f7e580b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:15.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e5d600640 1 -- 172.21.15.122:0/3483430825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e580b58d0 msgr2=0x7f7e58140bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:15.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e5d600640 1 --2- 172.21.15.122:0/3483430825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e580b58d0 0x7f7e58140bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e5d600640 1 -- 172.21.15.122:0/3483430825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e580ce4f0 msgr2=0x7f7e580b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:15.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e5d600640 1 --2- 172.21.15.122:0/3483430825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e580ce4f0 0x7f7e580b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e5d600640 1 -- 172.21.15.122:0/3483430825 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e58141540 con 0x7f7e580722a0 2024-05-28T06:09:15.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e5e000640 1 --2- 172.21.15.122:0/3483430825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e580ce4f0 0x7f7e580b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:09:15.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e5d600640 1 --2- 172.21.15.122:0/3483430825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e580722a0 0x7f7e58159a30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0b0040 tx=0x7f7e4c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:15.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e55600640 1 -- 172.21.15.122:0/3483430825 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c0bd070 con 0x7f7e580722a0 2024-05-28T06:09:15.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e55600640 1 -- 172.21.15.122:0/3483430825 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e4c003ba0 con 0x7f7e580722a0 2024-05-28T06:09:15.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e55600640 1 -- 172.21.15.122:0/3483430825 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c0b2040 con 0x7f7e580722a0 2024-05-28T06:09:15.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e60000640 1 -- 172.21.15.122:0/3483430825 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e58141820 con 0x7f7e580722a0 2024-05-28T06:09:15.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e60000640 1 -- 172.21.15.122:0/3483430825 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e58142300 con 0x7f7e580722a0 2024-05-28T06:09:15.539 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.532+0000 7f7e60000640 1 -- 172.21.15.122:0/3483430825 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e58068c40 con 0x7f7e580722a0 2024-05-28T06:09:15.539 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.536+0000 7f7e55600640 1 -- 172.21.15.122:0/3483430825 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f7e4c003f70 con 0x7f7e580722a0 2024-05-28T06:09:15.539 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.536+0000 7f7e55600640 1 --2- 172.21.15.122:0/3483430825 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7e38068530 0x7f7e3806a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:15.539 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.536+0000 7f7e55600640 1 -- 172.21.15.122:0/3483430825 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7e4c121db0 con 0x7f7e580722a0 2024-05-28T06:09:15.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.536+0000 7f7e5cc00640 1 --2- 172.21.15.122:0/3483430825 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7e38068530 0x7f7e3806a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:15.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.536+0000 7f7e5cc00640 1 --2- 172.21.15.122:0/3483430825 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7e38068530 0x7f7e3806a9f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7e580b3180 tx=0x7f7e44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:15.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.540+0000 7f7e55600640 1 -- 172.21.15.122:0/3483430825 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7e4c126070 con 0x7f7e580722a0 2024-05-28T06:09:15.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.720+0000 7f7e60000640 1 -- 172.21.15.122:0/3483430825 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f7e58076020 con 0x7f7e38068530 2024-05-28T06:09:15.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.736+0000 7f7e55600640 1 -- 172.21.15.122:0/3483430825 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7e440108a0 con 0x7f7e38068530 2024-05-28T06:09:15.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.740+0000 7f7e60000640 1 -- 172.21.15.122:0/3483430825 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7e38068530 msgr2=0x7f7e3806a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:15.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.740+0000 7f7e60000640 1 --2- 172.21.15.122:0/3483430825 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7e38068530 0x7f7e3806a9f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7e580b3180 tx=0x7f7e44008040 comp rx=0 tx=0).stop 2024-05-28T06:09:15.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.740+0000 7f7e60000640 1 -- 172.21.15.122:0/3483430825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e580722a0 msgr2=0x7f7e58159a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:15.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.740+0000 7f7e60000640 1 --2- 172.21.15.122:0/3483430825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e580722a0 0x7f7e58159a30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0b0040 tx=0x7f7e4c0196e0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.740+0000 7f7e60000640 1 -- 172.21.15.122:0/3483430825 shutdown_connections 2024-05-28T06:09:15.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.740+0000 7f7e60000640 1 --2- 172.21.15.122:0/3483430825 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7e38068530 0x7f7e3806a9f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.740+0000 7f7e60000640 1 --2- 172.21.15.122:0/3483430825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e580ce4f0 0x7f7e580b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.740+0000 7f7e60000640 1 --2- 172.21.15.122:0/3483430825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e580b58d0 0x7f7e58140bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.740+0000 7f7e60000640 1 --2- 172.21.15.122:0/3483430825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e580722a0 0x7f7e58159a30 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.740+0000 7f7e60000640 1 -- 172.21.15.122:0/3483430825 >> 172.21.15.122:0/3483430825 conn(0x7f7e5806bd90 msgr2=0x7f7e58074d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:15.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.740+0000 7f7e60000640 1 -- 172.21.15.122:0/3483430825 shutdown_connections 2024-05-28T06:09:15.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.740+0000 7f7e60000640 1 -- 172.21.15.122:0/3483430825 wait complete. 2024-05-28T06:09:15.746 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:09:15.744+0000 7f9deba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:09:15.746 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:09:15.744+0000 7f9deba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:09:15.746 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:09:15.744+0000 7f9deba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:09:15.746 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:09:15.744+0000 7f9deba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:09:15.746 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:09:15.744+0000 7f9deba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:09:15.763 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:09:15.760+0000 7f9dea600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:09:15.763 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:09:15.760+0000 7f9dea600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:09:15.763 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:09:15.760+0000 7f9dea600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:09:15.763 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:09:15.760+0000 7f9dea600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:09:15.763 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:09:15.760+0000 7f9dea600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:09:15.768 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs ss1clone1 2024-05-28T06:09:15.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.912+0000 7f059fc00640 1 Processor -- start 2024-05-28T06:09:15.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.912+0000 7f059fc00640 1 -- start start 2024-05-28T06:09:15.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.912+0000 7f059fc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05980cff30 0x7f059806f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:15.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.912+0000 7f059fc00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f059806f6c0 0x7f05980cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:15.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.912+0000 7f059fc00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f05980cd930 0x7f05980722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:15.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.912+0000 7f059fc00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f059806fb00 con 0x7f059806f6c0 2024-05-28T06:09:15.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.912+0000 7f059fc00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f05980d0310 con 0x7f05980cd930 2024-05-28T06:09:15.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.912+0000 7f059fc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f059815be20 con 0x7f05980cff30 2024-05-28T06:09:15.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.912+0000 7f0597e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f059806f6c0 0x7f05980cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:15.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.912+0000 7f0597e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f059806f6c0 0x7f05980cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40512/0 (socket says 172.21.15.122:40512) 2024-05-28T06:09:15.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.912+0000 7f0597e00640 1 -- 172.21.15.122:0/2292857582 learned_addr learned my addr 172.21.15.122:0/2292857582 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:15.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.912+0000 7f059dc00640 1 --2- 172.21.15.122:0/2292857582 >> v2:172.21.15.153:3300/0 conn(0x7f05980cd930 0x7f05980722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:15.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.912+0000 7f059d200640 1 --2- 172.21.15.122:0/2292857582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05980cff30 0x7f059806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:15.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.912+0000 7f0597e00640 1 -- 172.21.15.122:0/2292857582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05980cff30 msgr2=0x7f059806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:15.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.912+0000 7f0597e00640 1 --2- 172.21.15.122:0/2292857582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05980cff30 0x7f059806f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.912+0000 7f0597e00640 1 -- 172.21.15.122:0/2292857582 >> v2:172.21.15.153:3300/0 conn(0x7f05980cd930 msgr2=0x7f05980722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:15.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.912+0000 7f0597e00640 1 --2- 172.21.15.122:0/2292857582 >> v2:172.21.15.153:3300/0 conn(0x7f05980cd930 0x7f05980722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.912+0000 7f0597e00640 1 -- 172.21.15.122:0/2292857582 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f059815c100 con 0x7f059806f6c0 2024-05-28T06:09:15.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.912+0000 7f059dc00640 1 --2- 172.21.15.122:0/2292857582 >> v2:172.21.15.153:3300/0 conn(0x7f05980cd930 0x7f05980722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:09:15.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.912+0000 7f059d200640 1 --2- 172.21.15.122:0/2292857582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05980cff30 0x7f059806f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:09:15.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.916+0000 7f0597e00640 1 --2- 172.21.15.122:0/2292857582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f059806f6c0 0x7f05980cd3f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f05980b3b00 tx=0x7f058401c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b3f1d6d0ca85e server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:15.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.916+0000 7f0597400640 1 -- 172.21.15.122:0/2292857582 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05840b0070 con 0x7f059806f6c0 2024-05-28T06:09:15.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.916+0000 7f0597400640 1 -- 172.21.15.122:0/2292857582 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05840ab600 con 0x7f059806f6c0 2024-05-28T06:09:15.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.916+0000 7f0597400640 1 -- 172.21.15.122:0/2292857582 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05840ab9d0 con 0x7f059806f6c0 2024-05-28T06:09:15.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.916+0000 7f059fc00640 1 -- 172.21.15.122:0/2292857582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f059806f6c0 msgr2=0x7f05980cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:15.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.916+0000 7f059fc00640 1 --2- 172.21.15.122:0/2292857582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f059806f6c0 0x7f05980cd3f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f05980b3b00 tx=0x7f058401c230 comp rx=0 tx=0).stop 2024-05-28T06:09:15.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.916+0000 7f059fc00640 1 -- 172.21.15.122:0/2292857582 shutdown_connections 2024-05-28T06:09:15.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.916+0000 7f059fc00640 1 --2- 172.21.15.122:0/2292857582 >> v2:172.21.15.153:3300/0 conn(0x7f05980cd930 0x7f05980722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.916+0000 7f059fc00640 1 --2- 172.21.15.122:0/2292857582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f059806f6c0 0x7f05980cd3f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.916+0000 7f059fc00640 1 --2- 172.21.15.122:0/2292857582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05980cff30 0x7f059806f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.916+0000 7f059fc00640 1 -- 172.21.15.122:0/2292857582 >> 172.21.15.122:0/2292857582 conn(0x7f059806bd90 msgr2=0x7f059806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:15.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.916+0000 7f059fc00640 1 -- 172.21.15.122:0/2292857582 shutdown_connections 2024-05-28T06:09:15.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.916+0000 7f059fc00640 1 -- 172.21.15.122:0/2292857582 wait complete. 2024-05-28T06:09:15.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.916+0000 7f059fc00640 1 Processor -- start 2024-05-28T06:09:15.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f059fc00640 1 -- start start 2024-05-28T06:09:15.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f059fc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f059806f6c0 0x7f059814ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:15.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f059fc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05980cd930 0x7f059814f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:15.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f059fc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05980cff30 0x7f059815cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:15.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f059fc00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f05980cdec0 con 0x7f05980cff30 2024-05-28T06:09:15.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f059fc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f05980cdd40 con 0x7f05980cd930 2024-05-28T06:09:15.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f059fc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f05980b49b0 con 0x7f059806f6c0 2024-05-28T06:09:15.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f059dc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05980cff30 0x7f059815cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:15.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f059dc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05980cff30 0x7f059815cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40514/0 (socket says 172.21.15.122:40514) 2024-05-28T06:09:15.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f059dc00640 1 -- 172.21.15.122:0/893267958 learned_addr learned my addr 172.21.15.122:0/893267958 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:15.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f0597e00640 1 --2- 172.21.15.122:0/893267958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05980cd930 0x7f059814f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:15.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f059d200640 1 --2- 172.21.15.122:0/893267958 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f059806f6c0 0x7f059814ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:15.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f059dc00640 1 -- 172.21.15.122:0/893267958 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f059806f6c0 msgr2=0x7f059814ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:15.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f059dc00640 1 --2- 172.21.15.122:0/893267958 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f059806f6c0 0x7f059814ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f059dc00640 1 -- 172.21.15.122:0/893267958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05980cd930 msgr2=0x7f059814f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:15.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f059dc00640 1 --2- 172.21.15.122:0/893267958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05980cd930 0x7f059814f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:15.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f059dc00640 1 -- 172.21.15.122:0/893267958 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f059815a470 con 0x7f05980cff30 2024-05-28T06:09:15.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f059d200640 1 --2- 172.21.15.122:0/893267958 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f059806f6c0 0x7f059814ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:09:15.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f059dc00640 1 --2- 172.21.15.122:0/893267958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05980cff30 0x7f059815cc90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f059000cef0 tx=0x7f059000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:15.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f0594c00640 1 -- 172.21.15.122:0/893267958 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059001a070 con 0x7f05980cff30 2024-05-28T06:09:15.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f0594c00640 1 -- 172.21.15.122:0/893267958 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f059000d860 con 0x7f05980cff30 2024-05-28T06:09:15.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f0594c00640 1 -- 172.21.15.122:0/893267958 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059000dc50 con 0x7f05980cff30 2024-05-28T06:09:15.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f059fc00640 1 -- 172.21.15.122:0/893267958 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f059814d9c0 con 0x7f05980cff30 2024-05-28T06:09:15.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f059fc00640 1 -- 172.21.15.122:0/893267958 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f059814df40 con 0x7f05980cff30 2024-05-28T06:09:15.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.920+0000 7f059fc00640 1 -- 172.21.15.122:0/893267958 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0598068c40 con 0x7f05980cff30 2024-05-28T06:09:15.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.924+0000 7f0594c00640 1 -- 172.21.15.122:0/893267958 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f059001d070 con 0x7f05980cff30 2024-05-28T06:09:15.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.924+0000 7f0594c00640 1 --2- 172.21.15.122:0/893267958 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0578068530 0x7f057806a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:15.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.924+0000 7f0594c00640 1 -- 172.21.15.122:0/893267958 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f05900874f0 con 0x7f05980cff30 2024-05-28T06:09:15.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.924+0000 7f059d200640 1 --2- 172.21.15.122:0/893267958 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0578068530 0x7f057806a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:15.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.924+0000 7f059d200640 1 --2- 172.21.15.122:0/893267958 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0578068530 0x7f057806a9f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f058c00a930 tx=0x7f058c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:15.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:15.928+0000 7f0594c00640 1 -- 172.21.15.122:0/893267958 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0590057290 con 0x7f05980cff30 2024-05-28T06:09:16.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.108+0000 7f059fc00640 1 -- 172.21.15.122:0/893267958 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f0598076020 con 0x7f0578068530 2024-05-28T06:09:16.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.128+0000 7f0594c00640 1 -- 172.21.15.122:0/893267958 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f058c00a190 con 0x7f0578068530 2024-05-28T06:09:16.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.128+0000 7f059fc00640 1 -- 172.21.15.122:0/893267958 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0578068530 msgr2=0x7f057806a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:16.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.128+0000 7f059fc00640 1 --2- 172.21.15.122:0/893267958 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0578068530 0x7f057806a9f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f058c00a930 tx=0x7f058c008040 comp rx=0 tx=0).stop 2024-05-28T06:09:16.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.128+0000 7f059fc00640 1 -- 172.21.15.122:0/893267958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05980cff30 msgr2=0x7f059815cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:16.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.128+0000 7f059fc00640 1 --2- 172.21.15.122:0/893267958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05980cff30 0x7f059815cc90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f059000cef0 tx=0x7f059000a710 comp rx=0 tx=0).stop 2024-05-28T06:09:16.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.132+0000 7f059fc00640 1 -- 172.21.15.122:0/893267958 shutdown_connections 2024-05-28T06:09:16.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.132+0000 7f059fc00640 1 --2- 172.21.15.122:0/893267958 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0578068530 0x7f057806a9f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:16.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.132+0000 7f059fc00640 1 --2- 172.21.15.122:0/893267958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05980cff30 0x7f059815cc90 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:16.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.132+0000 7f059fc00640 1 --2- 172.21.15.122:0/893267958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05980cd930 0x7f059814f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:16.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.132+0000 7f059fc00640 1 --2- 172.21.15.122:0/893267958 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f059806f6c0 0x7f059814ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:16.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.132+0000 7f059fc00640 1 -- 172.21.15.122:0/893267958 >> 172.21.15.122:0/893267958 conn(0x7f059806bd90 msgr2=0x7f059814ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:16.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.132+0000 7f059fc00640 1 -- 172.21.15.122:0/893267958 shutdown_connections 2024-05-28T06:09:16.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.132+0000 7f059fc00640 1 -- 172.21.15.122:0/893267958 wait complete. 2024-05-28T06:09:16.158 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-05-28T06:09:16.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-28T06:09:16.212 INFO:teuthology.orchestra.run.smithi122.stdout:2 2024-05-28T06:09:16.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:09:16.219 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-28T06:09:16.219 DEBUG:teuthology.orchestra.run.smithi122:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-28T06:09:16.292 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-28T06:09:16.390 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-28T06:09:16.390 INFO:tasks.cephfs.mount:Terminating background process 2024-05-28T06:09:16.390 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:09:16.390 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:09:16.403 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:09:16.403 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:09:16.454 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:09:16.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.628+0000 7f7817200640 1 Processor -- start 2024-05-28T06:09:16.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.628+0000 7f7817200640 1 -- start start 2024-05-28T06:09:16.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.628+0000 7f7817200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78100cff30 0x7f781006f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:16.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.628+0000 7f7817200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f781006f6c0 0x7f78100cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:16.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.628+0000 7f7817200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f78100cd930 0x7f78100722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:16.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.628+0000 7f7817200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f781006fb00 con 0x7f78100cd930 2024-05-28T06:09:16.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.628+0000 7f7817200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f78100d0310 con 0x7f781006f6c0 2024-05-28T06:09:16.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.628+0000 7f7817200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f781015be20 con 0x7f78100cff30 2024-05-28T06:09:16.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.628+0000 7f7815200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f78100cd930 0x7f78100722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:16.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.628+0000 7f7815200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f78100cd930 0x7f78100722a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40516/0 (socket says 172.21.15.122:40516) 2024-05-28T06:09:16.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.628+0000 7f7815200640 1 -- 172.21.15.122:0/3404834562 learned_addr learned my addr 172.21.15.122:0/3404834562 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:16.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.628+0000 7f780f400640 1 --2- 172.21.15.122:0/3404834562 >> v2:172.21.15.153:3300/0 conn(0x7f781006f6c0 0x7f78100cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:16.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.628+0000 7f780fe00640 1 --2- 172.21.15.122:0/3404834562 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78100cff30 0x7f781006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:16.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.628+0000 7f7815200640 1 -- 172.21.15.122:0/3404834562 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78100cff30 msgr2=0x7f781006f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:16.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.628+0000 7f7815200640 1 --2- 172.21.15.122:0/3404834562 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78100cff30 0x7f781006f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:16.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.628+0000 7f7815200640 1 -- 172.21.15.122:0/3404834562 >> v2:172.21.15.153:3300/0 conn(0x7f781006f6c0 msgr2=0x7f78100cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:16.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.628+0000 7f7815200640 1 --2- 172.21.15.122:0/3404834562 >> v2:172.21.15.153:3300/0 conn(0x7f781006f6c0 0x7f78100cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:16.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.628+0000 7f7815200640 1 -- 172.21.15.122:0/3404834562 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f781015c100 con 0x7f78100cd930 2024-05-28T06:09:16.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.628+0000 7f780f400640 1 --2- 172.21.15.122:0/3404834562 >> v2:172.21.15.153:3300/0 conn(0x7f781006f6c0 0x7f78100cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:09:16.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.632+0000 7f7815200640 1 --2- 172.21.15.122:0/3404834562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78100cd930 0x7f78100722a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f781006fd00 tx=0x7f780801c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e69e10cd8c60bca server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:16.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.632+0000 7f780ea00640 1 -- 172.21.15.122:0/3404834562 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78080b0070 con 0x7f78100cd930 2024-05-28T06:09:16.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.632+0000 7f780ea00640 1 -- 172.21.15.122:0/3404834562 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78080ab600 con 0x7f78100cd930 2024-05-28T06:09:16.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.632+0000 7f780ea00640 1 -- 172.21.15.122:0/3404834562 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78080ab9d0 con 0x7f78100cd930 2024-05-28T06:09:16.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.632+0000 7f7817200640 1 -- 172.21.15.122:0/3404834562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78100cd930 msgr2=0x7f78100722a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:16.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.632+0000 7f7817200640 1 --2- 172.21.15.122:0/3404834562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78100cd930 0x7f78100722a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f781006fd00 tx=0x7f780801c230 comp rx=0 tx=0).stop 2024-05-28T06:09:16.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.632+0000 7f7817200640 1 -- 172.21.15.122:0/3404834562 shutdown_connections 2024-05-28T06:09:16.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.632+0000 7f7817200640 1 --2- 172.21.15.122:0/3404834562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78100cd930 0x7f78100722a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:16.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.632+0000 7f7817200640 1 --2- 172.21.15.122:0/3404834562 >> v2:172.21.15.153:3300/0 conn(0x7f781006f6c0 0x7f78100cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:16.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.632+0000 7f7817200640 1 --2- 172.21.15.122:0/3404834562 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78100cff30 0x7f781006f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:16.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.632+0000 7f7817200640 1 -- 172.21.15.122:0/3404834562 >> 172.21.15.122:0/3404834562 conn(0x7f781006bd90 msgr2=0x7f781006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:16.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.632+0000 7f7817200640 1 -- 172.21.15.122:0/3404834562 shutdown_connections 2024-05-28T06:09:16.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.632+0000 7f7817200640 1 -- 172.21.15.122:0/3404834562 wait complete. 2024-05-28T06:09:16.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f7817200640 1 Processor -- start 2024-05-28T06:09:16.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f7817200640 1 -- start start 2024-05-28T06:09:16.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f7817200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f781006f6c0 0x7f7810146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:16.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f7817200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78100cd930 0x7f781015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:16.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f7817200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78100cff30 0x7f78100aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:16.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f7817200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f78100cdee0 con 0x7f78100cd930 2024-05-28T06:09:16.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f7817200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f78100cdd60 con 0x7f781006f6c0 2024-05-28T06:09:16.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f7817200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f78100b49b0 con 0x7f78100cff30 2024-05-28T06:09:16.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f780f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78100cd930 0x7f781015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:16.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f780f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78100cd930 0x7f781015aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40520/0 (socket says 172.21.15.122:40520) 2024-05-28T06:09:16.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f780f400640 1 -- 172.21.15.122:0/4239087358 learned_addr learned my addr 172.21.15.122:0/4239087358 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:16.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f7815200640 1 --2- 172.21.15.122:0/4239087358 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78100cff30 0x7f78100aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:16.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f780fe00640 1 --2- 172.21.15.122:0/4239087358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f781006f6c0 0x7f7810146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:16.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f780f400640 1 -- 172.21.15.122:0/4239087358 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78100cff30 msgr2=0x7f78100aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:16.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f780f400640 1 --2- 172.21.15.122:0/4239087358 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78100cff30 0x7f78100aec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:16.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f780f400640 1 -- 172.21.15.122:0/4239087358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f781006f6c0 msgr2=0x7f7810146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:16.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f780f400640 1 --2- 172.21.15.122:0/4239087358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f781006f6c0 0x7f7810146e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:16.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f780f400640 1 -- 172.21.15.122:0/4239087358 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f781015b580 con 0x7f78100cd930 2024-05-28T06:09:16.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f780fe00640 1 --2- 172.21.15.122:0/4239087358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f781006f6c0 0x7f7810146e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:09:16.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f7815200640 1 --2- 172.21.15.122:0/4239087358 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78100cff30 0x7f78100aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:09:16.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f780f400640 1 --2- 172.21.15.122:0/4239087358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78100cd930 0x7f781015aa50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00e810 tx=0x7f77fc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:16.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f7807e00640 1 -- 172.21.15.122:0/4239087358 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc017070 con 0x7f78100cd930 2024-05-28T06:09:16.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f7807e00640 1 -- 172.21.15.122:0/4239087358 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77fc00c8d0 con 0x7f78100cd930 2024-05-28T06:09:16.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f7817200640 1 -- 172.21.15.122:0/4239087358 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78100ad8b0 con 0x7f78100cd930 2024-05-28T06:09:16.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f7807e00640 1 -- 172.21.15.122:0/4239087358 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc00f040 con 0x7f78100cd930 2024-05-28T06:09:16.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.636+0000 7f7817200640 1 -- 172.21.15.122:0/4239087358 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78100ade70 con 0x7f78100cd930 2024-05-28T06:09:16.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.640+0000 7f7817200640 1 -- 172.21.15.122:0/4239087358 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7810068c40 con 0x7f78100cd930 2024-05-28T06:09:16.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.640+0000 7f7807e00640 1 -- 172.21.15.122:0/4239087358 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f77fc01a070 con 0x7f78100cd930 2024-05-28T06:09:16.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.640+0000 7f7807e00640 1 --2- 172.21.15.122:0/4239087358 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f77f0068530 0x7f77f006a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:16.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.640+0000 7f7807e00640 1 -- 172.21.15.122:0/4239087358 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f77fc086a40 con 0x7f78100cd930 2024-05-28T06:09:16.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.640+0000 7f780fe00640 1 --2- 172.21.15.122:0/4239087358 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f77f0068530 0x7f77f006a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:16.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.640+0000 7f780fe00640 1 --2- 172.21.15.122:0/4239087358 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f77f0068530 0x7f77f006a9f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7800009ed0 tx=0x7f780000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:16.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.644+0000 7f7807e00640 1 -- 172.21.15.122:0/4239087358 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f77fc056c60 con 0x7f78100cd930 2024-05-28T06:09:16.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.804+0000 7f7817200640 1 -- 172.21.15.122:0/4239087358 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7810155f70 con 0x7f78100cd930 2024-05-28T06:09:16.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.804+0000 7f7807e00640 1 -- 172.21.15.122:0/4239087358 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16669 (secure 0 0 0) 0x7f77fc056560 con 0x7f78100cd930 2024-05-28T06:09:16.809 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:16.809 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":34,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:06:50.892168+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:06:47.799439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-28T06:06:48.236731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:09:16.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.808+0000 7f7817200640 1 -- 172.21.15.122:0/4239087358 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f77f0068530 msgr2=0x7f77f006a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:16.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.808+0000 7f7817200640 1 --2- 172.21.15.122:0/4239087358 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f77f0068530 0x7f77f006a9f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7800009ed0 tx=0x7f780000b040 comp rx=0 tx=0).stop 2024-05-28T06:09:16.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.808+0000 7f7817200640 1 -- 172.21.15.122:0/4239087358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78100cd930 msgr2=0x7f781015aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:16.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.808+0000 7f7817200640 1 --2- 172.21.15.122:0/4239087358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78100cd930 0x7f781015aa50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00e810 tx=0x7f77fc00ecd0 comp rx=0 tx=0).stop 2024-05-28T06:09:16.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.808+0000 7f7817200640 1 -- 172.21.15.122:0/4239087358 shutdown_connections 2024-05-28T06:09:16.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.808+0000 7f7817200640 1 --2- 172.21.15.122:0/4239087358 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f77f0068530 0x7f77f006a9f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:16.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.808+0000 7f7817200640 1 --2- 172.21.15.122:0/4239087358 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78100cff30 0x7f78100aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:16.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.808+0000 7f7817200640 1 --2- 172.21.15.122:0/4239087358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78100cd930 0x7f781015aa50 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:16.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.808+0000 7f7817200640 1 --2- 172.21.15.122:0/4239087358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f781006f6c0 0x7f7810146e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:16.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.808+0000 7f7817200640 1 -- 172.21.15.122:0/4239087358 >> 172.21.15.122:0/4239087358 conn(0x7f781006bd90 msgr2=0x7f781015e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:16.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.808+0000 7f7817200640 1 -- 172.21.15.122:0/4239087358 shutdown_connections 2024-05-28T06:09:16.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.808+0000 7f7817200640 1 -- 172.21.15.122:0/4239087358 wait complete. 2024-05-28T06:09:16.830 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-28T06:06:47.799439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-05-28T06:06:48.236731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:09:16.831 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:09:16.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.968+0000 7f72bfa00640 1 Processor -- start 2024-05-28T06:09:16.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.968+0000 7f72bfa00640 1 -- start start 2024-05-28T06:09:16.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.968+0000 7f72bfa00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f72b80d18f0 0x7f72b8169800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:16.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.968+0000 7f72bfa00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72b8162510 con 0x7f72b806dab0 2024-05-28T06:09:16.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.968+0000 7f72bfa00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72b81627f0 con 0x7f72b815ea50 2024-05-28T06:09:16.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.968+0000 7f72bfa00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f72b8163120 con 0x7f72b80d18f0 2024-05-28T06:09:16.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.968+0000 7f72b7e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f72b806dab0 0x7f72b815f540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:51512/0 (socket says 172.21.15.122:51512) 2024-05-28T06:09:16.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.968+0000 7f72b7e00640 1 -- 172.21.15.122:0/1499062182 learned_addr learned my addr 172.21.15.122:0/1499062182 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:16.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.968+0000 7f72bda00640 1 --2- 172.21.15.122:0/1499062182 >> v2:172.21.15.122:3300/0 conn(0x7f72b80d18f0 0x7f72b8169800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:16.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.968+0000 7f72b7400640 1 -- 172.21.15.122:0/1499062182 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 364753673 0 0) 0x7f72b8162510 con 0x7f72b806dab0 2024-05-28T06:09:16.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.968+0000 7f72b7400640 1 -- 172.21.15.122:0/1499062182 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f729c003530 con 0x7f72b806dab0 2024-05-28T06:09:16.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.968+0000 7f72bda00640 1 -- 172.21.15.122:0/1499062182 >> v1:172.21.15.153:6789/0 conn(0x7f72b815ea50 legacy=0x7f72b815ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:16.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.968+0000 7f72bda00640 1 -- 172.21.15.122:0/1499062182 >> v1:172.21.15.122:6789/0 conn(0x7f72b806dab0 legacy=0x7f72b815f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:16.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.968+0000 7f72bda00640 1 -- 172.21.15.122:0/1499062182 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b8162ad0 con 0x7f72b80d18f0 2024-05-28T06:09:16.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.972+0000 7f72bda00640 1 --2- 172.21.15.122:0/1499062182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72b80d18f0 0x7f72b8169800 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009d90 tx=0x7f72b001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98c3a41445bdb7c server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:16.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.972+0000 7f72b7400640 1 -- 172.21.15.122:0/1499062182 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b00b2070 con 0x7f72b80d18f0 2024-05-28T06:09:16.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.972+0000 7f72b7400640 1 -- 172.21.15.122:0/1499062182 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b00a5830 con 0x7f72b80d18f0 2024-05-28T06:09:16.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.972+0000 7f72b7400640 1 -- 172.21.15.122:0/1499062182 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b00a5c00 con 0x7f72b80d18f0 2024-05-28T06:09:16.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.972+0000 7f72bfa00640 1 -- 172.21.15.122:0/1499062182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72b80d18f0 msgr2=0x7f72b8169800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:16.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.972+0000 7f72bfa00640 1 --2- 172.21.15.122:0/1499062182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72b80d18f0 0x7f72b8169800 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009d90 tx=0x7f72b001c970 comp rx=0 tx=0).stop 2024-05-28T06:09:16.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.972+0000 7f72bfa00640 1 -- 172.21.15.122:0/1499062182 shutdown_connections 2024-05-28T06:09:16.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.972+0000 7f72bfa00640 1 --2- 172.21.15.122:0/1499062182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72b80d18f0 0x7f72b8169800 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:16.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.972+0000 7f72bfa00640 1 -- 172.21.15.122:0/1499062182 >> 172.21.15.122:0/1499062182 conn(0x7f72b80b4190 msgr2=0x7f72b80b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:16.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.972+0000 7f72bfa00640 1 -- 172.21.15.122:0/1499062182 shutdown_connections 2024-05-28T06:09:16.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.972+0000 7f72bfa00640 1 -- 172.21.15.122:0/1499062182 wait complete. 2024-05-28T06:09:16.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72bfa00640 1 Processor -- start 2024-05-28T06:09:16.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72bfa00640 1 -- start start 2024-05-28T06:09:16.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72bfa00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72b806dab0 0x7f72b8154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:16.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72bfa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72b80d18f0 0x7f72b815c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:16.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72bfa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72b815ea50 0x7f72b815cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:16.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72bfa00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f72b816c6e0 con 0x7f72b80d18f0 2024-05-28T06:09:16.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72bfa00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f72b816c560 con 0x7f72b815ea50 2024-05-28T06:09:16.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72bfa00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f72b816c860 con 0x7f72b806dab0 2024-05-28T06:09:16.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72b7e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72b80d18f0 0x7f72b815c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:16.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72b7e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72b80d18f0 0x7f72b815c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40548/0 (socket says 172.21.15.122:40548) 2024-05-28T06:09:16.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72b7e00640 1 -- 172.21.15.122:0/3621558748 learned_addr learned my addr 172.21.15.122:0/3621558748 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:16.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72bd000640 1 --2- 172.21.15.122:0/3621558748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72b806dab0 0x7f72b8154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:16.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72b7e00640 1 -- 172.21.15.122:0/3621558748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72b806dab0 msgr2=0x7f72b8154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:16.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72b7e00640 1 --2- 172.21.15.122:0/3621558748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72b806dab0 0x7f72b8154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:16.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72b7e00640 1 -- 172.21.15.122:0/3621558748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72b815ea50 msgr2=0x7f72b815cb80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-28T06:09:16.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72b7e00640 1 --2- 172.21.15.122:0/3621558748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72b815ea50 0x7f72b815cb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:16.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72b7e00640 1 -- 172.21.15.122:0/3621558748 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b80afee0 con 0x7f72b80d18f0 2024-05-28T06:09:16.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72bd000640 1 --2- 172.21.15.122:0/3621558748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72b806dab0 0x7f72b8154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:09:16.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72b7e00640 1 --2- 172.21.15.122:0/3621558748 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72b80d18f0 0x7f72b815c640 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f72a400c420 tx=0x7f72a400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:16.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72b4c00640 1 -- 172.21.15.122:0/3621558748 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a4017070 con 0x7f72b80d18f0 2024-05-28T06:09:16.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72b4c00640 1 -- 172.21.15.122:0/3621558748 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a4005cf0 con 0x7f72b80d18f0 2024-05-28T06:09:16.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72b4c00640 1 -- 172.21.15.122:0/3621558748 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a40072d0 con 0x7f72b80d18f0 2024-05-28T06:09:16.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72bfa00640 1 -- 172.21.15.122:0/3621558748 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b80b01c0 con 0x7f72b80d18f0 2024-05-28T06:09:16.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.976+0000 7f72bfa00640 1 -- 172.21.15.122:0/3621558748 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b8154e60 con 0x7f72b80d18f0 2024-05-28T06:09:16.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.980+0000 7f72bfa00640 1 -- 172.21.15.122:0/3621558748 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b8068c40 con 0x7f72b80d18f0 2024-05-28T06:09:16.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.980+0000 7f72b4c00640 1 -- 172.21.15.122:0/3621558748 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f72a401a070 con 0x7f72b80d18f0 2024-05-28T06:09:16.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.980+0000 7f72b4c00640 1 --2- 172.21.15.122:0/3621558748 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7298068530 0x7f729806a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:16.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.980+0000 7f72b4c00640 1 -- 172.21.15.122:0/3621558748 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f72a4085fe0 con 0x7f72b80d18f0 2024-05-28T06:09:16.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.980+0000 7f72bd000640 1 --2- 172.21.15.122:0/3621558748 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7298068530 0x7f729806a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:16.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.980+0000 7f72bd000640 1 --2- 172.21.15.122:0/3621558748 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7298068530 0x7f729806a9f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f72a8000f70 tx=0x7f72a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:16.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:16.984+0000 7f72b4c00640 1 -- 172.21.15.122:0/3621558748 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f72a4055d00 con 0x7f72b80d18f0 2024-05-28T06:09:17.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.144+0000 7f72bfa00640 1 -- 172.21.15.122:0/3621558748 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f72b80b4ea0 con 0x7f72b80d18f0 2024-05-28T06:09:17.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.144+0000 7f72b4c00640 1 -- 172.21.15.122:0/3621558748 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) ==== 93+0+10 (secure 0 0 0) 0x7f72a405a000 con 0x7f72b80d18f0 2024-05-28T06:09:17.149 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:09:17.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.148+0000 7f72bfa00640 1 -- 172.21.15.122:0/3621558748 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7298068530 msgr2=0x7f729806a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:17.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.148+0000 7f72bfa00640 1 --2- 172.21.15.122:0/3621558748 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7298068530 0x7f729806a9f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f72a8000f70 tx=0x7f72a8009040 comp rx=0 tx=0).stop 2024-05-28T06:09:17.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.148+0000 7f72bfa00640 1 -- 172.21.15.122:0/3621558748 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72b80d18f0 msgr2=0x7f72b815c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:17.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.148+0000 7f72bfa00640 1 --2- 172.21.15.122:0/3621558748 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72b80d18f0 0x7f72b815c640 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f72a400c420 tx=0x7f72a400c8e0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.148+0000 7f72bfa00640 1 -- 172.21.15.122:0/3621558748 shutdown_connections 2024-05-28T06:09:17.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.148+0000 7f72bfa00640 1 --2- 172.21.15.122:0/3621558748 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7298068530 0x7f729806a9f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.148+0000 7f72bfa00640 1 --2- 172.21.15.122:0/3621558748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72b815ea50 0x7f72b815cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.148+0000 7f72bfa00640 1 --2- 172.21.15.122:0/3621558748 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72b80d18f0 0x7f72b815c640 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.148+0000 7f72bfa00640 1 --2- 172.21.15.122:0/3621558748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72b806dab0 0x7f72b8154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.148+0000 7f72bfa00640 1 -- 172.21.15.122:0/3621558748 >> 172.21.15.122:0/3621558748 conn(0x7f72b80b4190 msgr2=0x7f72b80cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:17.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.148+0000 7f72bfa00640 1 -- 172.21.15.122:0/3621558748 shutdown_connections 2024-05-28T06:09:17.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.148+0000 7f72bfa00640 1 -- 172.21.15.122:0/3621558748 wait complete. 2024-05-28T06:09:17.169 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-28T06:09:17.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.304+0000 7f6b14000640 1 Processor -- start 2024-05-28T06:09:17.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.304+0000 7f6b14000640 1 -- start start 2024-05-28T06:09:17.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b14000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6b0c0cff30 0x7f6b0c06f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:17.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b14000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b0c0cdf00 con 0x7f6b0c06f6c0 2024-05-28T06:09:17.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b14000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b0c0d0310 con 0x7f6b0c0cdb00 2024-05-28T06:09:17.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b14000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6b0c06fb30 con 0x7f6b0c0cff30 2024-05-28T06:09:17.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b10c00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f6b0c06f6c0 0x7f6b0c0cd3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:51518/0 (socket says 172.21.15.122:51518) 2024-05-28T06:09:17.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b10c00640 1 -- 172.21.15.122:0/2486484659 learned_addr learned my addr 172.21.15.122:0/2486484659 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:17.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b11600640 1 --2- 172.21.15.122:0/2486484659 >> v2:172.21.15.153:3300/0 conn(0x7f6b0c0cff30 0x7f6b0c06f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:17.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b0be00640 1 -- 172.21.15.122:0/2486484659 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1429716182 0 0) 0x7f6af8001120 con 0x7f6b0c06f6c0 2024-05-28T06:09:17.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b0be00640 1 -- 172.21.15.122:0/2486484659 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6af4003530 con 0x7f6b0c06f6c0 2024-05-28T06:09:17.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b0be00640 1 -- 172.21.15.122:0/2486484659 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2798025750 0 0) 0x7f6af4003530 con 0x7f6b0c06f6c0 2024-05-28T06:09:17.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b0be00640 1 -- 172.21.15.122:0/2486484659 >> v2:172.21.15.153:3300/0 conn(0x7f6b0c0cff30 msgr2=0x7f6b0c06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:17.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b0be00640 1 --2- 172.21.15.122:0/2486484659 >> v2:172.21.15.153:3300/0 conn(0x7f6b0c0cff30 0x7f6b0c06f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b0be00640 1 -- 172.21.15.122:0/2486484659 >> v1:172.21.15.153:6789/0 conn(0x7f6b0c0cdb00 legacy=0x7f6b0c0b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:17.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b0be00640 1 -- 172.21.15.122:0/2486484659 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0c15be20 con 0x7f6b0c06f6c0 2024-05-28T06:09:17.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b0be00640 1 -- 172.21.15.122:0/2486484659 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f6af8001850 con 0x7f6b0c06f6c0 2024-05-28T06:09:17.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b0be00640 1 -- 172.21.15.122:0/2486484659 >> v1:172.21.15.122:6789/0 conn(0x7f6b0c06f6c0 legacy=0x7f6b0c0cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:17.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b0be00640 1 --2- 172.21.15.122:0/2486484659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6af40039c0 0x7f6af4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:17.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b0be00640 1 --2- 172.21.15.122:0/2486484659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6af4004810 0x7f6af4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:17.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b0be00640 1 --2- 172.21.15.122:0/2486484659 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6af40051d0 0x7f6af400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:17.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b0be00640 1 -- 172.21.15.122:0/2486484659 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c06fb30 con 0x7f6af40039c0 2024-05-28T06:09:17.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b0be00640 1 -- 172.21.15.122:0/2486484659 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6af400c070 con 0x7f6af4004810 2024-05-28T06:09:17.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b0be00640 1 -- 172.21.15.122:0/2486484659 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6af400c270 con 0x7f6af40051d0 2024-05-28T06:09:17.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b11600640 1 --2- 172.21.15.122:0/2486484659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6af40039c0 0x7f6af4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:17.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b10c00640 1 --2- 172.21.15.122:0/2486484659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6af4004810 0x7f6af4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:17.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b12000640 1 --2- 172.21.15.122:0/2486484659 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6af40051d0 0x7f6af400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:17.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b11600640 1 -- 172.21.15.122:0/2486484659 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6af40051d0 msgr2=0x7f6af400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:17.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b11600640 1 --2- 172.21.15.122:0/2486484659 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6af40051d0 0x7f6af400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b11600640 1 -- 172.21.15.122:0/2486484659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6af4004810 msgr2=0x7f6af4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:17.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b11600640 1 --2- 172.21.15.122:0/2486484659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6af4004810 0x7f6af4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b11600640 1 -- 172.21.15.122:0/2486484659 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af4003530 con 0x7f6af40039c0 2024-05-28T06:09:17.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.308+0000 7f6b12000640 1 -- 172.21.15.122:0/2486484659 reap_dead start 2024-05-28T06:09:17.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.312+0000 7f6b11600640 1 --2- 172.21.15.122:0/2486484659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6af40039c0 0x7f6af4003de0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009fc0 tx=0x7f6b0001cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94306c961d9288e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:17.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.312+0000 7f6b0be00640 1 -- 172.21.15.122:0/2486484659 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b000b2070 con 0x7f6af40039c0 2024-05-28T06:09:17.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.312+0000 7f6b0be00640 1 -- 172.21.15.122:0/2486484659 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b000a5b70 con 0x7f6af40039c0 2024-05-28T06:09:17.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.312+0000 7f6b0be00640 1 -- 172.21.15.122:0/2486484659 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b00009c10 con 0x7f6af40039c0 2024-05-28T06:09:17.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.312+0000 7f6b14000640 1 -- 172.21.15.122:0/2486484659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6af40039c0 msgr2=0x7f6af4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:17.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.312+0000 7f6b14000640 1 --2- 172.21.15.122:0/2486484659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6af40039c0 0x7f6af4003de0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009fc0 tx=0x7f6b0001cc70 comp rx=0 tx=0).stop 2024-05-28T06:09:17.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.312+0000 7f6b14000640 1 -- 172.21.15.122:0/2486484659 shutdown_connections 2024-05-28T06:09:17.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.312+0000 7f6b14000640 1 --2- 172.21.15.122:0/2486484659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6af40039c0 0x7f6af4003de0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.312+0000 7f6b14000640 1 -- 172.21.15.122:0/2486484659 >> 172.21.15.122:0/2486484659 conn(0x7f6b0c06bd90 msgr2=0x7f6b0c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:17.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.312+0000 7f6b14000640 1 -- 172.21.15.122:0/2486484659 shutdown_connections 2024-05-28T06:09:17.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.312+0000 7f6b14000640 1 -- 172.21.15.122:0/2486484659 wait complete. 2024-05-28T06:09:17.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.312+0000 7f6b14000640 1 Processor -- start 2024-05-28T06:09:17.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b14000640 1 -- start start 2024-05-28T06:09:17.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b14000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6af40039c0 0x7f6b0c1561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:17.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b14000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b0c150a90 0x7f6b0c15e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:17.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b14000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b0c14f8b0 0x7f6b0c14fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:17.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b14000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c0cd800 con 0x7f6b0c150a90 2024-05-28T06:09:17.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b14000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c15baf0 con 0x7f6b0c14f8b0 2024-05-28T06:09:17.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b14000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6b0c0cd980 con 0x7f6af40039c0 2024-05-28T06:09:17.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b10c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b0c150a90 0x7f6b0c15e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:17.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b10c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b0c150a90 0x7f6b0c15e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40566/0 (socket says 172.21.15.122:40566) 2024-05-28T06:09:17.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b11600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6af40039c0 0x7f6b0c1561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:17.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b10c00640 1 -- 172.21.15.122:0/2243836763 learned_addr learned my addr 172.21.15.122:0/2243836763 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:17.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b12000640 1 --2- 172.21.15.122:0/2243836763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b0c14f8b0 0x7f6b0c14fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:17.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b10c00640 1 -- 172.21.15.122:0/2243836763 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6af40039c0 msgr2=0x7f6b0c1561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:17.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b10c00640 1 --2- 172.21.15.122:0/2243836763 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6af40039c0 0x7f6b0c1561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b10c00640 1 -- 172.21.15.122:0/2243836763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b0c14f8b0 msgr2=0x7f6b0c14fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:17.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b10c00640 1 --2- 172.21.15.122:0/2243836763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b0c14f8b0 0x7f6b0c14fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b10c00640 1 -- 172.21.15.122:0/2243836763 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0c156a90 con 0x7f6b0c150a90 2024-05-28T06:09:17.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b10c00640 1 --2- 172.21.15.122:0/2243836763 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b0c150a90 0x7f6b0c15e5b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6af8007290 tx=0x7f6af8007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:17.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b09600640 1 -- 172.21.15.122:0/2243836763 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af800f920 con 0x7f6b0c150a90 2024-05-28T06:09:17.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b09600640 1 -- 172.21.15.122:0/2243836763 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6af8018070 con 0x7f6b0c150a90 2024-05-28T06:09:17.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b09600640 1 -- 172.21.15.122:0/2243836763 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af800fd00 con 0x7f6b0c150a90 2024-05-28T06:09:17.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b14000640 1 -- 172.21.15.122:0/2243836763 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b0c156d70 con 0x7f6b0c150a90 2024-05-28T06:09:17.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b14000640 1 -- 172.21.15.122:0/2243836763 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b0c157330 con 0x7f6b0c150a90 2024-05-28T06:09:17.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.316+0000 7f6b14000640 1 -- 172.21.15.122:0/2243836763 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b0c068c40 con 0x7f6b0c150a90 2024-05-28T06:09:17.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.320+0000 7f6b09600640 1 -- 172.21.15.122:0/2243836763 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f6af801d460 con 0x7f6b0c150a90 2024-05-28T06:09:17.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.320+0000 7f6b09600640 1 --2- 172.21.15.122:0/2243836763 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6aec068530 0x7f6aec06a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:17.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.320+0000 7f6b09600640 1 -- 172.21.15.122:0/2243836763 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6af8086cb0 con 0x7f6b0c150a90 2024-05-28T06:09:17.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.320+0000 7f6b11600640 1 --2- 172.21.15.122:0/2243836763 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6aec068530 0x7f6aec06a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:17.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.320+0000 7f6b11600640 1 --2- 172.21.15.122:0/2243836763 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6aec068530 0x7f6aec06a9f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6b000af000 tx=0x7f6b00004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:17.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.324+0000 7f6b09600640 1 -- 172.21.15.122:0/2243836763 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6b0c0cdf00 con 0x7f6b0c150a90 2024-05-28T06:09:17.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.388+0000 7f6b09600640 1 -- 172.21.15.122:0/2243836763 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f6af8053010 con 0x7f6b0c150a90 2024-05-28T06:09:17.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.484+0000 7f6b14000640 1 -- 172.21.15.122:0/2243836763 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6b0c155f70 con 0x7f6b0c150a90 2024-05-28T06:09:17.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.484+0000 7f6b09600640 1 -- 172.21.15.122:0/2243836763 <== mon.0 v2:172.21.15.122:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) ==== 104+0+11 (secure 0 0 0) 0x7f6af80570a0 con 0x7f6b0c150a90 2024-05-28T06:09:17.489 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 32 2024-05-28T06:09:17.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.488+0000 7f6b14000640 1 -- 172.21.15.122:0/2243836763 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6aec068530 msgr2=0x7f6aec06a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:17.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.488+0000 7f6b14000640 1 --2- 172.21.15.122:0/2243836763 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6aec068530 0x7f6aec06a9f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6b000af000 tx=0x7f6b00004ac0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.488+0000 7f6b14000640 1 -- 172.21.15.122:0/2243836763 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b0c150a90 msgr2=0x7f6b0c15e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:17.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.488+0000 7f6b14000640 1 --2- 172.21.15.122:0/2243836763 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b0c150a90 0x7f6b0c15e5b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6af8007290 tx=0x7f6af8007750 comp rx=0 tx=0).stop 2024-05-28T06:09:17.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.488+0000 7f6b14000640 1 -- 172.21.15.122:0/2243836763 shutdown_connections 2024-05-28T06:09:17.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.488+0000 7f6b14000640 1 --2- 172.21.15.122:0/2243836763 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6aec068530 0x7f6aec06a9f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.488+0000 7f6b14000640 1 --2- 172.21.15.122:0/2243836763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b0c14f8b0 0x7f6b0c14fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.488+0000 7f6b14000640 1 --2- 172.21.15.122:0/2243836763 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b0c150a90 0x7f6b0c15e5b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.488+0000 7f6b14000640 1 --2- 172.21.15.122:0/2243836763 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6af40039c0 0x7f6b0c1561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.488+0000 7f6b14000640 1 -- 172.21.15.122:0/2243836763 >> 172.21.15.122:0/2243836763 conn(0x7f6b0c06bd90 msgr2=0x7f6b0c15cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:17.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.488+0000 7f6b14000640 1 -- 172.21.15.122:0/2243836763 shutdown_connections 2024-05-28T06:09:17.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.488+0000 7f6b14000640 1 -- 172.21.15.122:0/2243836763 wait complete. 2024-05-28T06:09:17.510 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-28T06:09:17.650 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.644+0000 7f2ea5400640 1 Processor -- start 2024-05-28T06:09:17.650 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.644+0000 7f2ea5400640 1 -- start start 2024-05-28T06:09:17.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.648+0000 7f2ea5400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2ea006f780 0x7f2ea00b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:17.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.648+0000 7f2ea5400640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ea006df80 con 0x7f2ea00cf650 2024-05-28T06:09:17.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.648+0000 7f2ea5400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ea006e260 con 0x7f2ea00cfa30 2024-05-28T06:09:17.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.648+0000 7f2ea5400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f2ea00cd7d0 con 0x7f2ea006f780 2024-05-28T06:09:17.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.648+0000 7f2e9fe00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f2ea00cf650 0x7f2ea00b3470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:51530/0 (socket says 172.21.15.122:51530) 2024-05-28T06:09:17.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.648+0000 7f2e9fe00640 1 -- 172.21.15.122:0/2367360045 learned_addr learned my addr 172.21.15.122:0/2367360045 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:17.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.648+0000 7f2ea4a00640 1 --2- 172.21.15.122:0/2367360045 >> v2:172.21.15.153:3300/0 conn(0x7f2ea006f780 0x7f2ea00b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:17.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.648+0000 7f2e9ea00640 1 -- 172.21.15.122:0/2367360045 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2527822047 0 0) 0x7f2ea006df80 con 0x7f2ea00cf650 2024-05-28T06:09:17.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.648+0000 7f2e9ea00640 1 -- 172.21.15.122:0/2367360045 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e84003530 con 0x7f2ea00cf650 2024-05-28T06:09:17.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.648+0000 7f2ea4a00640 1 -- 172.21.15.122:0/2367360045 >> v1:172.21.15.153:6789/0 conn(0x7f2ea00cfa30 legacy=0x7f2ea015f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:17.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.648+0000 7f2ea4a00640 1 -- 172.21.15.122:0/2367360045 >> v1:172.21.15.122:6789/0 conn(0x7f2ea00cf650 legacy=0x7f2ea00b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:17.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.648+0000 7f2ea4a00640 1 -- 172.21.15.122:0/2367360045 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea00cdab0 con 0x7f2ea006f780 2024-05-28T06:09:17.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.652+0000 7f2ea4a00640 1 --2- 172.21.15.122:0/2367360045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ea006f780 0x7f2ea00b3b80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009d90 tx=0x7f2ea00b48d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85b57f1b0683e380 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:17.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.652+0000 7f2e9ea00640 1 -- 172.21.15.122:0/2367360045 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e980b2070 con 0x7f2ea006f780 2024-05-28T06:09:17.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.652+0000 7f2e9ea00640 1 -- 172.21.15.122:0/2367360045 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e980a5710 con 0x7f2ea006f780 2024-05-28T06:09:17.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.652+0000 7f2e9ea00640 1 -- 172.21.15.122:0/2367360045 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e980a5ae0 con 0x7f2ea006f780 2024-05-28T06:09:17.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.652+0000 7f2ea5400640 1 -- 172.21.15.122:0/2367360045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ea006f780 msgr2=0x7f2ea00b3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:17.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.652+0000 7f2ea5400640 1 --2- 172.21.15.122:0/2367360045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ea006f780 0x7f2ea00b3b80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009d90 tx=0x7f2ea00b48d0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.652+0000 7f2ea5400640 1 -- 172.21.15.122:0/2367360045 shutdown_connections 2024-05-28T06:09:17.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.652+0000 7f2ea5400640 1 --2- 172.21.15.122:0/2367360045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ea006f780 0x7f2ea00b3b80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.652+0000 7f2ea5400640 1 -- 172.21.15.122:0/2367360045 >> 172.21.15.122:0/2367360045 conn(0x7f2ea006b990 msgr2=0x7f2ea006bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:17.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.652+0000 7f2ea5400640 1 -- 172.21.15.122:0/2367360045 shutdown_connections 2024-05-28T06:09:17.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.652+0000 7f2ea5400640 1 -- 172.21.15.122:0/2367360045 wait complete. 2024-05-28T06:09:17.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.652+0000 7f2ea5400640 1 Processor -- start 2024-05-28T06:09:17.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.652+0000 7f2ea5400640 1 -- start start 2024-05-28T06:09:17.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.656+0000 7f2ea5400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ea006f780 0x7f2ea014f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:17.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.656+0000 7f2ea5400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ea00cf650 0x7f2ea0148010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:17.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.656+0000 7f2ea5400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ea00cfa30 0x7f2ea0152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:17.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.656+0000 7f2ea5400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea0169900 con 0x7f2ea00cf650 2024-05-28T06:09:17.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.656+0000 7f2ea5400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea0169780 con 0x7f2ea006f780 2024-05-28T06:09:17.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.656+0000 7f2ea5400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea0169a80 con 0x7f2ea00cfa30 2024-05-28T06:09:17.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.656+0000 7f2e9f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ea00cf650 0x7f2ea0148010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:17.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.656+0000 7f2e9f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ea00cf650 0x7f2ea0148010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40570/0 (socket says 172.21.15.122:40570) 2024-05-28T06:09:17.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.656+0000 7f2e9f400640 1 -- 172.21.15.122:0/43468141 learned_addr learned my addr 172.21.15.122:0/43468141 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:17.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.656+0000 7f2e9fe00640 1 --2- 172.21.15.122:0/43468141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ea006f780 0x7f2ea014f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:17.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.656+0000 7f2ea4a00640 1 --2- 172.21.15.122:0/43468141 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ea00cfa30 0x7f2ea0152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:17.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.656+0000 7f2e9f400640 1 -- 172.21.15.122:0/43468141 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ea00cfa30 msgr2=0x7f2ea0152620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:17.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.656+0000 7f2e9f400640 1 --2- 172.21.15.122:0/43468141 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ea00cfa30 0x7f2ea0152620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.656+0000 7f2e9f400640 1 -- 172.21.15.122:0/43468141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ea006f780 msgr2=0x7f2ea014f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:17.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.656+0000 7f2e9f400640 1 --2- 172.21.15.122:0/43468141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ea006f780 0x7f2ea014f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.656+0000 7f2e9f400640 1 -- 172.21.15.122:0/43468141 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea01511b0 con 0x7f2ea00cf650 2024-05-28T06:09:17.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.656+0000 7f2e9f400640 1 --2- 172.21.15.122:0/43468141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ea00cf650 0x7f2ea0148010 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00c450 tx=0x7f2e8c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:17.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.656+0000 7f2e97e00640 1 -- 172.21.15.122:0/43468141 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c016020 con 0x7f2ea00cf650 2024-05-28T06:09:17.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.656+0000 7f2e97e00640 1 -- 172.21.15.122:0/43468141 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e8c0052d0 con 0x7f2ea00cf650 2024-05-28T06:09:17.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.656+0000 7f2e97e00640 1 -- 172.21.15.122:0/43468141 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c007260 con 0x7f2ea00cf650 2024-05-28T06:09:17.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.656+0000 7f2ea5400640 1 -- 172.21.15.122:0/43468141 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea0148b20 con 0x7f2ea00cf650 2024-05-28T06:09:17.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.656+0000 7f2ea5400640 1 -- 172.21.15.122:0/43468141 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea01490e0 con 0x7f2ea00cf650 2024-05-28T06:09:17.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.656+0000 7f2ea5400640 1 -- 172.21.15.122:0/43468141 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ea01492e0 con 0x7f2ea00cf650 2024-05-28T06:09:17.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.660+0000 7f2e97e00640 1 -- 172.21.15.122:0/43468141 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f2e8c007400 con 0x7f2ea00cf650 2024-05-28T06:09:17.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.660+0000 7f2e97e00640 1 --2- 172.21.15.122:0/43468141 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2e80068650 0x7f2e8006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:17.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.660+0000 7f2e97e00640 1 -- 172.21.15.122:0/43468141 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2e8c086660 con 0x7f2ea00cf650 2024-05-28T06:09:17.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.660+0000 7f2e9fe00640 1 --2- 172.21.15.122:0/43468141 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2e80068650 0x7f2e8006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:17.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.660+0000 7f2e9fe00640 1 --2- 172.21.15.122:0/43468141 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2e80068650 0x7f2e8006ab10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2e900011f0 tx=0x7f2e90007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:17.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.664+0000 7f2e97e00640 1 -- 172.21.15.122:0/43468141 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2e8c020020 con 0x7f2ea00cf650 2024-05-28T06:09:17.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.820+0000 7f2ea5400640 1 -- 172.21.15.122:0/43468141 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2ea015fc60 con 0x7f2ea00cf650 2024-05-28T06:09:17.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.820+0000 7f2e97e00640 1 -- 172.21.15.122:0/43468141 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) ==== 100+0+11 (secure 0 0 0) 0x7f2e8c005480 con 0x7f2ea00cf650 2024-05-28T06:09:17.826 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 64 2024-05-28T06:09:17.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.824+0000 7f2ea5400640 1 -- 172.21.15.122:0/43468141 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2e80068650 msgr2=0x7f2e8006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:17.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.824+0000 7f2ea5400640 1 --2- 172.21.15.122:0/43468141 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2e80068650 0x7f2e8006ab10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2e900011f0 tx=0x7f2e90007d40 comp rx=0 tx=0).stop 2024-05-28T06:09:17.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.824+0000 7f2ea5400640 1 -- 172.21.15.122:0/43468141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ea00cf650 msgr2=0x7f2ea0148010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:17.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.824+0000 7f2ea5400640 1 --2- 172.21.15.122:0/43468141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ea00cf650 0x7f2ea0148010 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00c450 tx=0x7f2e8c00c910 comp rx=0 tx=0).stop 2024-05-28T06:09:17.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.824+0000 7f2ea5400640 1 -- 172.21.15.122:0/43468141 shutdown_connections 2024-05-28T06:09:17.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.824+0000 7f2ea5400640 1 --2- 172.21.15.122:0/43468141 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2e80068650 0x7f2e8006ab10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.824+0000 7f2ea5400640 1 --2- 172.21.15.122:0/43468141 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ea00cfa30 0x7f2ea0152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.824+0000 7f2ea5400640 1 --2- 172.21.15.122:0/43468141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ea00cf650 0x7f2ea0148010 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.824+0000 7f2ea5400640 1 --2- 172.21.15.122:0/43468141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ea006f780 0x7f2ea014f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.824+0000 7f2ea5400640 1 -- 172.21.15.122:0/43468141 >> 172.21.15.122:0/43468141 conn(0x7f2ea006b990 msgr2=0x7f2ea006e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:17.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.824+0000 7f2ea5400640 1 -- 172.21.15.122:0/43468141 shutdown_connections 2024-05-28T06:09:17.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.824+0000 7f2ea5400640 1 -- 172.21.15.122:0/43468141 wait complete. 2024-05-28T06:09:17.847 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-28T06:09:17.867 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:09:17.900 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:09:17.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.980+0000 7fea90800640 1 Processor -- start 2024-05-28T06:09:17.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.980+0000 7fea90800640 1 -- start start 2024-05-28T06:09:17.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.984+0000 7fea90800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fea8815eca0 0x7fea88073690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:17.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.984+0000 7fea90800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fea88073bd0 0x7fea880ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:17.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.984+0000 7fea90800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea880d0fe0 con 0x7fea8815e8c0 2024-05-28T06:09:17.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.984+0000 7fea90800640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fea88074040 con 0x7fea8815eca0 2024-05-28T06:09:17.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.984+0000 7fea90800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fea880d1440 con 0x7fea88073bd0 2024-05-28T06:09:17.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.984+0000 7fea8d400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fea8815eca0 0x7fea88073690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:17.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.984+0000 7fea8d400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fea8815eca0 0x7fea88073690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40574/0 (socket says 172.21.15.122:40574) 2024-05-28T06:09:17.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.984+0000 7fea8de00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fea8815e8c0 0x7fea8806f350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:51542/0 (socket says 172.21.15.122:51542) 2024-05-28T06:09:17.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.984+0000 7fea8d400640 1 -- 172.21.15.122:0/2233206791 learned_addr learned my addr 172.21.15.122:0/2233206791 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:17.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.984+0000 7fea8e800640 1 --2- 172.21.15.122:0/2233206791 >> v2:172.21.15.153:3300/0 conn(0x7fea88073bd0 0x7fea880ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:17.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.984+0000 7fea8d400640 1 -- 172.21.15.122:0/2233206791 >> v2:172.21.15.153:3300/0 conn(0x7fea88073bd0 msgr2=0x7fea880ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:17.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.984+0000 7fea8d400640 1 --2- 172.21.15.122:0/2233206791 >> v2:172.21.15.153:3300/0 conn(0x7fea88073bd0 0x7fea880ce190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.984+0000 7fea8ca00640 1 -- 172.21.15.122:0/2233206791 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1087178134 0 0) 0x7fea880d0fe0 con 0x7fea8815e8c0 2024-05-28T06:09:17.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.984+0000 7fea8d400640 1 -- 172.21.15.122:0/2233206791 >> v1:172.21.15.122:6789/0 conn(0x7fea8815e8c0 legacy=0x7fea8806f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:17.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.984+0000 7fea8d400640 1 -- 172.21.15.122:0/2233206791 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea880d1720 con 0x7fea8815eca0 2024-05-28T06:09:17.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.984+0000 7fea8e800640 1 --2- 172.21.15.122:0/2233206791 >> v2:172.21.15.153:3300/0 conn(0x7fea88073bd0 0x7fea880ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:09:17.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.988+0000 7fea8d400640 1 --2- 172.21.15.122:0/2233206791 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea8815eca0 0x7fea88073690 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fea8806ba30 tx=0x7fea7801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca71ce34c19307e server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:17.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.988+0000 7fea8ca00640 1 -- 172.21.15.122:0/2233206791 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea780b1070 con 0x7fea8815eca0 2024-05-28T06:09:17.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.988+0000 7fea8ca00640 1 -- 172.21.15.122:0/2233206791 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea780ac600 con 0x7fea8815eca0 2024-05-28T06:09:17.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.988+0000 7fea8ca00640 1 -- 172.21.15.122:0/2233206791 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea780ac9d0 con 0x7fea8815eca0 2024-05-28T06:09:17.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.988+0000 7fea90800640 1 -- 172.21.15.122:0/2233206791 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea8815eca0 msgr2=0x7fea88073690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:17.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.988+0000 7fea90800640 1 --2- 172.21.15.122:0/2233206791 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea8815eca0 0x7fea88073690 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fea8806ba30 tx=0x7fea7801c490 comp rx=0 tx=0).stop 2024-05-28T06:09:17.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.988+0000 7fea90800640 1 -- 172.21.15.122:0/2233206791 shutdown_connections 2024-05-28T06:09:17.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.988+0000 7fea90800640 1 --2- 172.21.15.122:0/2233206791 >> v2:172.21.15.153:3300/0 conn(0x7fea88073bd0 0x7fea880ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.988+0000 7fea90800640 1 --2- 172.21.15.122:0/2233206791 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea8815eca0 0x7fea88073690 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.988+0000 7fea90800640 1 -- 172.21.15.122:0/2233206791 >> 172.21.15.122:0/2233206791 conn(0x7fea880b6b20 msgr2=0x7fea880b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:17.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.988+0000 7fea90800640 1 -- 172.21.15.122:0/2233206791 shutdown_connections 2024-05-28T06:09:17.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.988+0000 7fea90800640 1 -- 172.21.15.122:0/2233206791 wait complete. 2024-05-28T06:09:17.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.988+0000 7fea90800640 1 Processor -- start 2024-05-28T06:09:17.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.988+0000 7fea90800640 1 -- start start 2024-05-28T06:09:17.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.988+0000 7fea90800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fea88073bd0 0x7fea8814bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:17.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.988+0000 7fea90800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea8815e8c0 0x7fea88157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:17.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.988+0000 7fea90800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea8815eca0 0x7fea880cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:17.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.988+0000 7fea90800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fea8806fa60 con 0x7fea8815eca0 2024-05-28T06:09:17.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.988+0000 7fea90800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fea880ceee0 con 0x7fea8815e8c0 2024-05-28T06:09:17.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.988+0000 7fea90800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fea8814c040 con 0x7fea88073bd0 2024-05-28T06:09:17.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.992+0000 7fea8e800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea8815eca0 0x7fea880cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:17.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.992+0000 7fea8e800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea8815eca0 0x7fea880cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40590/0 (socket says 172.21.15.122:40590) 2024-05-28T06:09:17.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.992+0000 7fea8e800640 1 -- 172.21.15.122:0/27624936 learned_addr learned my addr 172.21.15.122:0/27624936 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:17.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.992+0000 7fea8e800640 1 -- 172.21.15.122:0/27624936 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fea88073bd0 msgr2=0x7fea8814bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:17.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.992+0000 7fea8e800640 1 --2- 172.21.15.122:0/27624936 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fea88073bd0 0x7fea8814bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.992+0000 7fea8e800640 1 -- 172.21.15.122:0/27624936 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea8815e8c0 msgr2=0x7fea88157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:17.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.992+0000 7fea8e800640 1 --2- 172.21.15.122:0/27624936 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea8815e8c0 0x7fea88157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:17.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.992+0000 7fea8e800640 1 -- 172.21.15.122:0/27624936 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea880b2a50 con 0x7fea8815eca0 2024-05-28T06:09:17.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.992+0000 7fea8e800640 1 --2- 172.21.15.122:0/27624936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea8815eca0 0x7fea880cfb40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fea84009fd0 tx=0x7fea8400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:17.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.992+0000 7fea82000640 1 -- 172.21.15.122:0/27624936 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8401a070 con 0x7fea8815eca0 2024-05-28T06:09:17.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.992+0000 7fea82000640 1 -- 172.21.15.122:0/27624936 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea84003bc0 con 0x7fea8815eca0 2024-05-28T06:09:17.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.992+0000 7fea82000640 1 -- 172.21.15.122:0/27624936 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea84004030 con 0x7fea8815eca0 2024-05-28T06:09:17.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.992+0000 7fea90800640 1 -- 172.21.15.122:0/27624936 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea880b2d30 con 0x7fea8815eca0 2024-05-28T06:09:17.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.992+0000 7fea90800640 1 -- 172.21.15.122:0/27624936 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea88156480 con 0x7fea8815eca0 2024-05-28T06:09:17.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.992+0000 7fea90800640 1 -- 172.21.15.122:0/27624936 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea88068bd0 con 0x7fea8815eca0 2024-05-28T06:09:17.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.992+0000 7fea82000640 1 -- 172.21.15.122:0/27624936 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7fea8401d070 con 0x7fea8815eca0 2024-05-28T06:09:17.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.992+0000 7fea82000640 1 --2- 172.21.15.122:0/27624936 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fea6c068650 0x7fea6c06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:17.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.992+0000 7fea82000640 1 -- 172.21.15.122:0/27624936 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fea84087370 con 0x7fea8815eca0 2024-05-28T06:09:17.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.996+0000 7fea8de00640 1 --2- 172.21.15.122:0/27624936 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fea6c068650 0x7fea6c06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:17.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.996+0000 7fea8de00640 1 --2- 172.21.15.122:0/27624936 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fea6c068650 0x7fea6c06ab10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fea7c0011f0 tx=0x7fea7c007950 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:18.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:17.996+0000 7fea82000640 1 -- 172.21.15.122:0/27624936 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fea84010070 con 0x7fea8815eca0 2024-05-28T06:09:18.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.284+0000 7fea90800640 1 -- 172.21.15.122:0/27624936 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fea88155430 con 0x7fea8815eca0 2024-05-28T06:09:18.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.284+0000 7fea82000640 1 -- 172.21.15.122:0/27624936 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7fea840573b0 con 0x7fea8815eca0 2024-05-28T06:09:18.289 INFO:teuthology.orchestra.run.smithi122.stderr:listed 0 entries 2024-05-28T06:09:18.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.288+0000 7fea90800640 1 -- 172.21.15.122:0/27624936 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fea6c068650 msgr2=0x7fea6c06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:18.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.288+0000 7fea90800640 1 --2- 172.21.15.122:0/27624936 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fea6c068650 0x7fea6c06ab10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fea7c0011f0 tx=0x7fea7c007950 comp rx=0 tx=0).stop 2024-05-28T06:09:18.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.288+0000 7fea90800640 1 -- 172.21.15.122:0/27624936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea8815eca0 msgr2=0x7fea880cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:18.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.288+0000 7fea90800640 1 --2- 172.21.15.122:0/27624936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea8815eca0 0x7fea880cfb40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fea84009fd0 tx=0x7fea8400d560 comp rx=0 tx=0).stop 2024-05-28T06:09:18.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.288+0000 7fea90800640 1 -- 172.21.15.122:0/27624936 shutdown_connections 2024-05-28T06:09:18.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.288+0000 7fea90800640 1 --2- 172.21.15.122:0/27624936 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fea6c068650 0x7fea6c06ab10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:18.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.288+0000 7fea90800640 1 --2- 172.21.15.122:0/27624936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea8815eca0 0x7fea880cfb40 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:18.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.288+0000 7fea90800640 1 --2- 172.21.15.122:0/27624936 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea8815e8c0 0x7fea88157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:18.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.288+0000 7fea90800640 1 --2- 172.21.15.122:0/27624936 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fea88073bd0 0x7fea8814bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:18.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.288+0000 7fea90800640 1 -- 172.21.15.122:0/27624936 >> 172.21.15.122:0/27624936 conn(0x7fea880b6b20 msgr2=0x7fea880b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:18.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.288+0000 7fea90800640 1 -- 172.21.15.122:0/27624936 shutdown_connections 2024-05-28T06:09:18.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.288+0000 7fea90800640 1 -- 172.21.15.122:0/27624936 wait complete. 2024-05-28T06:09:18.325 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-28T06:09:18.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:09:18.325 DEBUG:teuthology.orchestra.run.smithi122:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-28T06:09:18.478 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2024-05-28T06:09:18.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:09:18.478 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-28T06:09:18.493 INFO:tasks.cephfs.mount:Terminating background process 2024-05-28T06:09:18.493 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:09:18.494 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:09:18.505 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350304k,nr_inodes=4087576,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5271 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-28T06:09:18.505 INFO:tasks.cephfs.mount:Terminating background process 2024-05-28T06:09:18.505 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:09:18.505 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:09:18.549 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350136k,nr_inodes=4087534,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2578 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-28T06:09:18.549 INFO:tasks.cephfs.mount:Terminating background process 2024-05-28T06:09:18.550 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:09:18.550 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:09:18.562 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350304k,nr_inodes=4087576,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5271 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-28T06:09:18.562 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:09:18.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.812+0000 7fedf9800640 1 Processor -- start 2024-05-28T06:09:18.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.812+0000 7fedf9800640 1 -- start start 2024-05-28T06:09:18.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.816+0000 7fedf9800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fedf4073c80 0x7fedf40d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:18.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.816+0000 7fedf9800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedf40b36b0 0x7fedf40b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:18.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.816+0000 7fedf9800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedf40b46c0 con 0x7fedf415ea20 2024-05-28T06:09:18.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.816+0000 7fedf9800640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fedf40b4040 con 0x7fedf4073c80 2024-05-28T06:09:18.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.816+0000 7fedf9800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fedf415ee00 con 0x7fedf40b36b0 2024-05-28T06:09:18.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.816+0000 7fedf2000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fedf4073c80 0x7fedf40d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:18.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.816+0000 7fedf2a00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fedf415ea20 0x7fedf40b4fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:40708/0 (socket says 172.21.15.122:40708) 2024-05-28T06:09:18.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.816+0000 7fedf2a00640 1 -- 172.21.15.122:0/975623710 learned_addr learned my addr 172.21.15.122:0/975623710 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:18.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.816+0000 7fedf3400640 1 --2- 172.21.15.122:0/975623710 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedf40b36b0 0x7fedf40b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:18.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.816+0000 7fedf2000640 1 -- 172.21.15.122:0/975623710 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedf40b36b0 msgr2=0x7fedf40b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:18.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.816+0000 7fedf2000640 1 --2- 172.21.15.122:0/975623710 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedf40b36b0 0x7fedf40b3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:18.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.816+0000 7fedf2000640 1 -- 172.21.15.122:0/975623710 >> v1:172.21.15.153:6789/0 conn(0x7fedf415ea20 legacy=0x7fedf40b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:18.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.816+0000 7fedf2000640 1 -- 172.21.15.122:0/975623710 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf40b49a0 con 0x7fedf4073c80 2024-05-28T06:09:18.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.816+0000 7fedf3400640 1 --2- 172.21.15.122:0/975623710 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedf40b36b0 0x7fedf40b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:09:18.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.824+0000 7fedf2000640 1 --2- 172.21.15.122:0/975623710 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedf4073c80 0x7fedf40d0e10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fede00097c0 tx=0x7fede001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2014c825686d6de6 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:18.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.824+0000 7fedf1600640 1 -- 172.21.15.122:0/975623710 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede00b2070 con 0x7fedf4073c80 2024-05-28T06:09:18.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.824+0000 7fedf1600640 1 -- 172.21.15.122:0/975623710 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede00ad640 con 0x7fedf4073c80 2024-05-28T06:09:18.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.824+0000 7fedf1600640 1 -- 172.21.15.122:0/975623710 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede00ada10 con 0x7fedf4073c80 2024-05-28T06:09:18.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.828+0000 7fedf9800640 1 -- 172.21.15.122:0/975623710 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedf4073c80 msgr2=0x7fedf40d0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:18.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.828+0000 7fedf9800640 1 --2- 172.21.15.122:0/975623710 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedf4073c80 0x7fedf40d0e10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fede00097c0 tx=0x7fede001c4a0 comp rx=0 tx=0).stop 2024-05-28T06:09:18.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.828+0000 7fedf9800640 1 -- 172.21.15.122:0/975623710 shutdown_connections 2024-05-28T06:09:18.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.828+0000 7fedf9800640 1 --2- 172.21.15.122:0/975623710 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedf40b36b0 0x7fedf40b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:18.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.828+0000 7fedf9800640 1 --2- 172.21.15.122:0/975623710 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedf4073c80 0x7fedf40d0e10 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:18.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.828+0000 7fedf9800640 1 -- 172.21.15.122:0/975623710 >> 172.21.15.122:0/975623710 conn(0x7fedf40b6c10 msgr2=0x7fedf40b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:18.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.828+0000 7fedf9800640 1 -- 172.21.15.122:0/975623710 shutdown_connections 2024-05-28T06:09:18.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.828+0000 7fedf9800640 1 -- 172.21.15.122:0/975623710 wait complete. 2024-05-28T06:09:18.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.832+0000 7fedf9800640 1 Processor -- start 2024-05-28T06:09:18.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.832+0000 7fedf9800640 1 -- start start 2024-05-28T06:09:18.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.832+0000 7fedf9800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedf4073c80 0x7fedf414b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:18.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.832+0000 7fedf9800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedf40b36b0 0x7fedf414a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:18.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.832+0000 7fedf9800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedf415ea20 0x7fedf4159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:18.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.832+0000 7fedf9800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fedf40ce960 con 0x7fedf415ea20 2024-05-28T06:09:18.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.832+0000 7fedf9800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fedf40b56d0 con 0x7fedf40b36b0 2024-05-28T06:09:18.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.832+0000 7fedf9800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fedf40ceae0 con 0x7fedf4073c80 2024-05-28T06:09:18.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.832+0000 7fedf2a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedf4073c80 0x7fedf414b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:18.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.832+0000 7fedf2a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedf4073c80 0x7fedf414b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:49868/0 (socket says 172.21.15.122:49868) 2024-05-28T06:09:18.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.832+0000 7fedf2a00640 1 -- 172.21.15.122:0/1146558520 learned_addr learned my addr 172.21.15.122:0/1146558520 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:18.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.836+0000 7fedf2a00640 1 -- 172.21.15.122:0/1146558520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedf40b36b0 msgr2=0x7fedf414a700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-28T06:09:18.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.836+0000 7fedf2a00640 1 --2- 172.21.15.122:0/1146558520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedf40b36b0 0x7fedf414a700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:18.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.836+0000 7fedf2a00640 1 -- 172.21.15.122:0/1146558520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedf415ea20 msgr2=0x7fedf4159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:18.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.836+0000 7fedf2a00640 1 --2- 172.21.15.122:0/1146558520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedf415ea20 0x7fedf4159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:18.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.836+0000 7fedf2a00640 1 -- 172.21.15.122:0/1146558520 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf41fbb50 con 0x7fedf4073c80 2024-05-28T06:09:18.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.836+0000 7fedf2a00640 1 --2- 172.21.15.122:0/1146558520 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedf4073c80 0x7fedf414b3f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fedec00ca70 tx=0x7fedec00cf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:18.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.836+0000 7fedeaa00640 1 -- 172.21.15.122:0/1146558520 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec017070 con 0x7fedf4073c80 2024-05-28T06:09:18.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.836+0000 7fedeaa00640 1 -- 172.21.15.122:0/1146558520 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedec00abd0 con 0x7fedf4073c80 2024-05-28T06:09:18.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.836+0000 7fedf9800640 1 -- 172.21.15.122:0/1146558520 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf41fbe30 con 0x7fedf4073c80 2024-05-28T06:09:18.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.836+0000 7fedeaa00640 1 -- 172.21.15.122:0/1146558520 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec012400 con 0x7fedf4073c80 2024-05-28T06:09:18.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.836+0000 7fedf9800640 1 -- 172.21.15.122:0/1146558520 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf41fc3f0 con 0x7fedf4073c80 2024-05-28T06:09:18.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.836+0000 7fedf9800640 1 -- 172.21.15.122:0/1146558520 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf40ceef0 con 0x7fedf4073c80 2024-05-28T06:09:18.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.840+0000 7fedeaa00640 1 -- 172.21.15.122:0/1146558520 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7fedec01a070 con 0x7fedf4073c80 2024-05-28T06:09:18.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.840+0000 7fedeaa00640 1 --2- 172.21.15.122:0/1146558520 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fedd4068650 0x7fedd406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:18.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.840+0000 7fedeaa00640 1 -- 172.21.15.122:0/1146558520 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 5765+0+0 (secure 0 0 0) 0x7fedec086d10 con 0x7fedf4073c80 2024-05-28T06:09:18.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.840+0000 7fedf2000640 1 --2- 172.21.15.122:0/1146558520 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fedd4068650 0x7fedd406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:18.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.844+0000 7fedf2000640 1 --2- 172.21.15.122:0/1146558520 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fedd4068650 0x7fedd406ab10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fede00af000 tx=0x7fede00a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:18.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:18.848+0000 7fedeaa00640 1 -- 172.21.15.122:0/1146558520 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fedec056e20 con 0x7fedf4073c80 2024-05-28T06:09:19.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.196+0000 7fedf9800640 1 -- 172.21.15.122:0/1146558520 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fedf4068c40 con 0x7fedf4073c80 2024-05-28T06:09:19.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.196+0000 7fedeaa00640 1 -- 172.21.15.122:0/1146558520 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5190 (secure 0 0 0) 0x7fedec056720 con 0x7fedf4073c80 2024-05-28T06:09:19.202 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:19.202 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1943879237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1943879237},{"type":"v1","addr":"172.21.15.153:6834","nonce":1943879237}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1104849441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1104849441},{"type":"v1","addr":"172.21.15.153:6835","nonce":1104849441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/560614408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":560614408},{"type":"v1","addr":"172.21.15.122:6835","nonce":560614408}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-28T06:06:49.284485+0000","modified":"2024-05-28T06:06:52.295560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1698676182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1698676182},{"type":"v1","addr":"172.21.15.122:6837","nonce":1698676182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5082,"qdb_cluster":[5082]},"id":2}]} 2024-05-28T06:09:19.202 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 19 2024-05-28T06:09:19.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.200+0000 7fedf9800640 1 -- 172.21.15.122:0/1146558520 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fedd4068650 msgr2=0x7fedd406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:19.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.200+0000 7fedf9800640 1 --2- 172.21.15.122:0/1146558520 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fedd4068650 0x7fedd406ab10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fede00af000 tx=0x7fede00a7070 comp rx=0 tx=0).stop 2024-05-28T06:09:19.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.200+0000 7fedf9800640 1 -- 172.21.15.122:0/1146558520 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedf4073c80 msgr2=0x7fedf414b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:19.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.200+0000 7fedf9800640 1 --2- 172.21.15.122:0/1146558520 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedf4073c80 0x7fedf414b3f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fedec00ca70 tx=0x7fedec00cf30 comp rx=0 tx=0).stop 2024-05-28T06:09:19.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.200+0000 7fedf9800640 1 -- 172.21.15.122:0/1146558520 shutdown_connections 2024-05-28T06:09:19.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.200+0000 7fedf9800640 1 --2- 172.21.15.122:0/1146558520 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fedd4068650 0x7fedd406ab10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:19.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.200+0000 7fedf9800640 1 --2- 172.21.15.122:0/1146558520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedf415ea20 0x7fedf4159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:19.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.200+0000 7fedf9800640 1 --2- 172.21.15.122:0/1146558520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedf40b36b0 0x7fedf414a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:19.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.200+0000 7fedf9800640 1 --2- 172.21.15.122:0/1146558520 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fedf4073c80 0x7fedf414b3f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:19.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.200+0000 7fedf9800640 1 -- 172.21.15.122:0/1146558520 >> 172.21.15.122:0/1146558520 conn(0x7fedf40b6c10 msgr2=0x7fedf415d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:19.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.200+0000 7fedf9800640 1 -- 172.21.15.122:0/1146558520 shutdown_connections 2024-05-28T06:09:19.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.200+0000 7fedf9800640 1 -- 172.21.15.122:0/1146558520 wait complete. 2024-05-28T06:09:19.237 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:09:19.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.456+0000 7f398f800640 1 Processor -- start 2024-05-28T06:09:19.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.460+0000 7f398f800640 1 -- start start 2024-05-28T06:09:19.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.460+0000 7f398f800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f39880c5d80 0x7f398809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:19.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.460+0000 7f398f800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f398806d300 con 0x7f39880b3cf0 2024-05-28T06:09:19.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.460+0000 7f398f800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39881641a0 con 0x7f39881639a0 2024-05-28T06:09:19.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.460+0000 7f398f800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f398806ccb0 con 0x7f39880c5d80 2024-05-28T06:09:19.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.460+0000 7f398d800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f39880b3cf0 0x7f39880b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:51548/0 (socket says 172.21.15.122:51548) 2024-05-28T06:09:19.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.460+0000 7f398d800640 1 -- 172.21.15.122:0/350132883 learned_addr learned my addr 172.21.15.122:0/350132883 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:19.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.460+0000 7f3987e00640 1 --2- 172.21.15.122:0/350132883 >> v2:172.21.15.153:3300/0 conn(0x7f39880c5d80 0x7f398809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:19.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.460+0000 7f3987400640 1 -- 172.21.15.122:0/350132883 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 339649790 0 0) 0x7f39881641a0 con 0x7f39881639a0 2024-05-28T06:09:19.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.460+0000 7f3987400640 1 -- 172.21.15.122:0/350132883 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3970003530 con 0x7f39881639a0 2024-05-28T06:09:19.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.460+0000 7f3987400640 1 -- 172.21.15.122:0/350132883 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2920517459 0 0) 0x7f39800013d0 con 0x7f39880b3cf0 2024-05-28T06:09:19.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.460+0000 7f3987400640 1 -- 172.21.15.122:0/350132883 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39881641a0 con 0x7f39880b3cf0 2024-05-28T06:09:19.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.460+0000 7f3987e00640 1 -- 172.21.15.122:0/350132883 >> v1:172.21.15.153:6789/0 conn(0x7f39881639a0 legacy=0x7f39880c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:19.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.460+0000 7f3987e00640 1 -- 172.21.15.122:0/350132883 >> v1:172.21.15.122:6789/0 conn(0x7f39880b3cf0 legacy=0x7f39880b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:19.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.460+0000 7f3987e00640 1 -- 172.21.15.122:0/350132883 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f398806cf90 con 0x7f39880c5d80 2024-05-28T06:09:19.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.464+0000 7f3987e00640 1 --2- 172.21.15.122:0/350132883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39880c5d80 0x7f398809aa40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f397c0097c0 tx=0x7f397c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b31c7c4359f64fa server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:19.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.468+0000 7f3987400640 1 -- 172.21.15.122:0/350132883 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c0b0070 con 0x7f39880c5d80 2024-05-28T06:09:19.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.468+0000 7f3987400640 1 -- 172.21.15.122:0/350132883 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f397c0ab600 con 0x7f39880c5d80 2024-05-28T06:09:19.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.468+0000 7f3987400640 1 -- 172.21.15.122:0/350132883 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c0ab9d0 con 0x7f39880c5d80 2024-05-28T06:09:19.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.468+0000 7f398f800640 1 -- 172.21.15.122:0/350132883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39880c5d80 msgr2=0x7f398809aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:19.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.468+0000 7f398f800640 1 --2- 172.21.15.122:0/350132883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39880c5d80 0x7f398809aa40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f397c0097c0 tx=0x7f397c01c410 comp rx=0 tx=0).stop 2024-05-28T06:09:19.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.468+0000 7f398f800640 1 -- 172.21.15.122:0/350132883 shutdown_connections 2024-05-28T06:09:19.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.468+0000 7f398f800640 1 --2- 172.21.15.122:0/350132883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39880c5d80 0x7f398809aa40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:19.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.468+0000 7f398f800640 1 -- 172.21.15.122:0/350132883 >> 172.21.15.122:0/350132883 conn(0x7f39880b4190 msgr2=0x7f39880b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:19.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.468+0000 7f398f800640 1 -- 172.21.15.122:0/350132883 shutdown_connections 2024-05-28T06:09:19.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.468+0000 7f398f800640 1 -- 172.21.15.122:0/350132883 wait complete. 2024-05-28T06:09:19.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.472+0000 7f398f800640 1 Processor -- start 2024-05-28T06:09:19.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.472+0000 7f398f800640 1 -- start start 2024-05-28T06:09:19.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.472+0000 7f398f800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39880b3cf0 0x7f3988151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:19.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.472+0000 7f398f800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39880c5d80 0x7f39880b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:19.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.472+0000 7f398f800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39881639a0 0x7f39880d1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:19.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.472+0000 7f398f800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3988171830 con 0x7f39880b3cf0 2024-05-28T06:09:19.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.472+0000 7f398f800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f39881716b0 con 0x7f39880c5d80 2024-05-28T06:09:19.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.472+0000 7f398f800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f39881719b0 con 0x7f39881639a0 2024-05-28T06:09:19.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.472+0000 7f398ce00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39880b3cf0 0x7f3988151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:19.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.472+0000 7f398ce00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39880b3cf0 0x7f3988151900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40622/0 (socket says 172.21.15.122:40622) 2024-05-28T06:09:19.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.472+0000 7f3987e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39880c5d80 0x7f39880b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:19.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.472+0000 7f398d800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39881639a0 0x7f39880d1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:19.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.472+0000 7f398ce00640 1 -- 172.21.15.122:0/1199653799 learned_addr learned my addr 172.21.15.122:0/1199653799 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:19.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.472+0000 7f3987e00640 1 -- 172.21.15.122:0/1199653799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39881639a0 msgr2=0x7f39880d1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:19.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.472+0000 7f3987e00640 1 --2- 172.21.15.122:0/1199653799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39881639a0 0x7f39880d1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:19.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.472+0000 7f3987e00640 1 -- 172.21.15.122:0/1199653799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39880b3cf0 msgr2=0x7f3988151900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:19.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.472+0000 7f3987e00640 1 --2- 172.21.15.122:0/1199653799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39880b3cf0 0x7f3988151900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:19.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.472+0000 7f3987e00640 1 -- 172.21.15.122:0/1199653799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39881585d0 con 0x7f39880c5d80 2024-05-28T06:09:19.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.472+0000 7f398ce00640 1 --2- 172.21.15.122:0/1199653799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39880b3cf0 0x7f3988151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:09:19.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.472+0000 7f3987e00640 1 --2- 172.21.15.122:0/1199653799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39880c5d80 0x7f39880b7f10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f397c0ab000 tx=0x7f397c0191b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:19.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.472+0000 7f3984c00640 1 -- 172.21.15.122:0/1199653799 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c0b8020 con 0x7f39880c5d80 2024-05-28T06:09:19.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.476+0000 7f3984c00640 1 -- 172.21.15.122:0/1199653799 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f397c0b4830 con 0x7f39880c5d80 2024-05-28T06:09:19.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.476+0000 7f398f800640 1 -- 172.21.15.122:0/1199653799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39881588b0 con 0x7f39880c5d80 2024-05-28T06:09:19.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.476+0000 7f3984c00640 1 -- 172.21.15.122:0/1199653799 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c0b0040 con 0x7f39880c5d80 2024-05-28T06:09:19.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.476+0000 7f398f800640 1 -- 172.21.15.122:0/1199653799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39881515f0 con 0x7f39880c5d80 2024-05-28T06:09:19.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.476+0000 7f398f800640 1 -- 172.21.15.122:0/1199653799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3988068c40 con 0x7f39880c5d80 2024-05-28T06:09:19.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.476+0000 7f3984c00640 1 -- 172.21.15.122:0/1199653799 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f397c0bb020 con 0x7f39880c5d80 2024-05-28T06:09:19.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.480+0000 7f3984c00640 1 --2- 172.21.15.122:0/1199653799 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3968068650 0x7f396806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:19.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.480+0000 7f3984c00640 1 -- 172.21.15.122:0/1199653799 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5765+0+0 (secure 0 0 0) 0x7f397c120b20 con 0x7f39880c5d80 2024-05-28T06:09:19.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.480+0000 7f398ce00640 1 --2- 172.21.15.122:0/1199653799 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3968068650 0x7f396806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:19.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.484+0000 7f398ce00640 1 --2- 172.21.15.122:0/1199653799 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3968068650 0x7f396806ab10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f39740011f0 tx=0x7f3974009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:19.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.488+0000 7f3984c00640 1 -- 172.21.15.122:0/1199653799 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f397c0c2030 con 0x7f39880c5d80 2024-05-28T06:09:19.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.812+0000 7f398f800640 1 -- 172.21.15.122:0/1199653799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39880b3ab0 con 0x7f39880c5d80 2024-05-28T06:09:19.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.816+0000 7f3984c00640 1 -- 172.21.15.122:0/1199653799 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16777 (secure 0 0 0) 0x7f397c016090 con 0x7f39880c5d80 2024-05-28T06:09:19.819 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:19.819 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":35,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:09:18.389359+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:06:47.799439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-28T06:06:48.236731+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":35,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:09:19.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.820+0000 7f398f800640 1 -- 172.21.15.122:0/1199653799 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3968068650 msgr2=0x7f396806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:19.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.820+0000 7f398f800640 1 --2- 172.21.15.122:0/1199653799 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3968068650 0x7f396806ab10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f39740011f0 tx=0x7f3974009040 comp rx=0 tx=0).stop 2024-05-28T06:09:19.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.820+0000 7f398f800640 1 -- 172.21.15.122:0/1199653799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39880c5d80 msgr2=0x7f39880b7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:19.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.820+0000 7f398f800640 1 --2- 172.21.15.122:0/1199653799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39880c5d80 0x7f39880b7f10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f397c0ab000 tx=0x7f397c0191b0 comp rx=0 tx=0).stop 2024-05-28T06:09:19.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.820+0000 7f398f800640 1 -- 172.21.15.122:0/1199653799 shutdown_connections 2024-05-28T06:09:19.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.820+0000 7f398f800640 1 --2- 172.21.15.122:0/1199653799 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3968068650 0x7f396806ab10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:19.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.820+0000 7f398f800640 1 --2- 172.21.15.122:0/1199653799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39881639a0 0x7f39880d1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:19.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.820+0000 7f398f800640 1 --2- 172.21.15.122:0/1199653799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39880c5d80 0x7f39880b7f10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:19.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.820+0000 7f398f800640 1 --2- 172.21.15.122:0/1199653799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39880b3cf0 0x7f3988151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:19.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.820+0000 7f398f800640 1 -- 172.21.15.122:0/1199653799 >> 172.21.15.122:0/1199653799 conn(0x7f39880b4190 msgr2=0x7f398815bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:19.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.820+0000 7f398f800640 1 -- 172.21.15.122:0/1199653799 shutdown_connections 2024-05-28T06:09:19.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:19.820+0000 7f398f800640 1 -- 172.21.15.122:0/1199653799 wait complete. 2024-05-28T06:09:19.856 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-28T06:06:47.799439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-05-28T06:06:48.236731+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 35, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:09:19.857 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:09:20.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.000+0000 7f98fce00640 1 Processor -- start 2024-05-28T06:09:20.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.000+0000 7f98fce00640 1 -- start start 2024-05-28T06:09:20.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.000+0000 7f98fce00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f98f806f890 0x7f98f80cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:20.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.000+0000 7f98fce00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98f80d0310 con 0x7f98f80cff30 2024-05-28T06:09:20.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.000+0000 7f98fce00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98f815be20 con 0x7f98f80cd930 2024-05-28T06:09:20.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.000+0000 7f98fce00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f98f815c100 con 0x7f98f806f890 2024-05-28T06:09:20.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.000+0000 7f98f5400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f98f806f890 0x7f98f80cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:20.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.000+0000 7f98f5400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f98f806f890 0x7f98f80cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40630/0 (socket says 172.21.15.122:40630) 2024-05-28T06:09:20.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.000+0000 7f98f5400640 1 -- 172.21.15.122:0/1806189749 learned_addr learned my addr 172.21.15.122:0/1806189749 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:20.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.000+0000 7f98f5400640 1 -- 172.21.15.122:0/1806189749 >> v1:172.21.15.153:6789/0 conn(0x7f98f80cd930 legacy=0x7f98f80b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:20.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.000+0000 7f98f5400640 1 -- 172.21.15.122:0/1806189749 >> v1:172.21.15.122:6789/0 conn(0x7f98f80cff30 legacy=0x7f98f806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:20.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.000+0000 7f98f5400640 1 -- 172.21.15.122:0/1806189749 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f815c3e0 con 0x7f98f806f890 2024-05-28T06:09:20.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.004+0000 7f98f5400640 1 --2- 172.21.15.122:0/1806189749 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f806f890 0x7f98f80cd3f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009870 tx=0x7f98e401e740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d47198a78c41bc server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:20.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.004+0000 7f98f4a00640 1 -- 172.21.15.122:0/1806189749 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e40a86b0 con 0x7f98f806f890 2024-05-28T06:09:20.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.004+0000 7f98f4a00640 1 -- 172.21.15.122:0/1806189749 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e40a8850 con 0x7f98f806f890 2024-05-28T06:09:20.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.004+0000 7f98f4a00640 1 -- 172.21.15.122:0/1806189749 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e40a8c20 con 0x7f98f806f890 2024-05-28T06:09:20.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.004+0000 7f98fce00640 1 -- 172.21.15.122:0/1806189749 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f806f890 msgr2=0x7f98f80cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:20.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.004+0000 7f98fce00640 1 --2- 172.21.15.122:0/1806189749 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f806f890 0x7f98f80cd3f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009870 tx=0x7f98e401e740 comp rx=0 tx=0).stop 2024-05-28T06:09:20.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.004+0000 7f98fce00640 1 -- 172.21.15.122:0/1806189749 shutdown_connections 2024-05-28T06:09:20.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.004+0000 7f98fce00640 1 --2- 172.21.15.122:0/1806189749 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f806f890 0x7f98f80cd3f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.004+0000 7f98fce00640 1 -- 172.21.15.122:0/1806189749 >> 172.21.15.122:0/1806189749 conn(0x7f98f806bd90 msgr2=0x7f98f806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:20.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.004+0000 7f98fce00640 1 -- 172.21.15.122:0/1806189749 shutdown_connections 2024-05-28T06:09:20.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.004+0000 7f98fce00640 1 -- 172.21.15.122:0/1806189749 wait complete. 2024-05-28T06:09:20.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98fce00640 1 Processor -- start 2024-05-28T06:09:20.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98fce00640 1 -- start start 2024-05-28T06:09:20.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98fce00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98f806f890 0x7f98f8147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:20.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98fce00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f80cd930 0x7f98f81539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:20.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98fce00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98f80cff30 0x7f98f8153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:20.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98fce00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f98f80b5a50 con 0x7f98f80cd930 2024-05-28T06:09:20.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98fce00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f98f80b58d0 con 0x7f98f80cff30 2024-05-28T06:09:20.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98fce00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f98f80b5bd0 con 0x7f98f806f890 2024-05-28T06:09:20.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98f5400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f80cd930 0x7f98f81539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:20.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98f5400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f80cd930 0x7f98f81539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40644/0 (socket says 172.21.15.122:40644) 2024-05-28T06:09:20.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98f5400640 1 -- 172.21.15.122:0/1942251571 learned_addr learned my addr 172.21.15.122:0/1942251571 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:20.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98f6800640 1 --2- 172.21.15.122:0/1942251571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98f80cff30 0x7f98f8153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:20.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98f5e00640 1 --2- 172.21.15.122:0/1942251571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98f806f890 0x7f98f8147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:20.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98f5400640 1 -- 172.21.15.122:0/1942251571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98f806f890 msgr2=0x7f98f8147dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:20.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98f5400640 1 --2- 172.21.15.122:0/1942251571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98f806f890 0x7f98f8147dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98f5400640 1 -- 172.21.15.122:0/1942251571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98f80cff30 msgr2=0x7f98f8153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:20.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98f5400640 1 --2- 172.21.15.122:0/1942251571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98f80cff30 0x7f98f8153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98f5400640 1 -- 172.21.15.122:0/1942251571 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f81fb0a0 con 0x7f98f80cd930 2024-05-28T06:09:20.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98f6800640 1 --2- 172.21.15.122:0/1942251571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98f80cff30 0x7f98f8153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:09:20.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98f5400640 1 --2- 172.21.15.122:0/1942251571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f80cd930 0x7f98f81539b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f98e40b2040 tx=0x7f98e401cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:20.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98ee000640 1 -- 172.21.15.122:0/1942251571 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e40ba630 con 0x7f98f80cd930 2024-05-28T06:09:20.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98ee000640 1 -- 172.21.15.122:0/1942251571 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e40bf070 con 0x7f98f80cd930 2024-05-28T06:09:20.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98ee000640 1 -- 172.21.15.122:0/1942251571 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e40baa30 con 0x7f98f80cd930 2024-05-28T06:09:20.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98fce00640 1 -- 172.21.15.122:0/1942251571 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98f81fb340 con 0x7f98f80cd930 2024-05-28T06:09:20.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.008+0000 7f98fce00640 1 -- 172.21.15.122:0/1942251571 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98f81fb900 con 0x7f98f80cd930 2024-05-28T06:09:20.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.012+0000 7f98fce00640 1 -- 172.21.15.122:0/1942251571 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98f8068c40 con 0x7f98f80cd930 2024-05-28T06:09:20.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.012+0000 7f98ee000640 1 -- 172.21.15.122:0/1942251571 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f98e40b7070 con 0x7f98f80cd930 2024-05-28T06:09:20.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.012+0000 7f98ee000640 1 --2- 172.21.15.122:0/1942251571 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f98d8068650 0x7f98d806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:20.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.012+0000 7f98ee000640 1 -- 172.21.15.122:0/1942251571 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5765+0+0 (secure 0 0 0) 0x7f98e41219c0 con 0x7f98f80cd930 2024-05-28T06:09:20.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.012+0000 7f98f5e00640 1 --2- 172.21.15.122:0/1942251571 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f98d8068650 0x7f98d806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:20.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.012+0000 7f98f5e00640 1 --2- 172.21.15.122:0/1942251571 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f98d8068650 0x7f98d806ab10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f98f8151660 tx=0x7f98e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:20.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.016+0000 7f98ee000640 1 -- 172.21.15.122:0/1942251571 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f98e4018360 con 0x7f98f80cd930 2024-05-28T06:09:20.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.176+0000 7f98fce00640 1 -- 172.21.15.122:0/1942251571 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f98f80afa70 con 0x7f98f80cd930 2024-05-28T06:09:20.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.176+0000 7f98ee000640 1 -- 172.21.15.122:0/1942251571 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) ==== 93+0+10 (secure 0 0 0) 0x7f98e40f1bc0 con 0x7f98f80cd930 2024-05-28T06:09:20.181 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:09:20.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.180+0000 7f98fce00640 1 -- 172.21.15.122:0/1942251571 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f98d8068650 msgr2=0x7f98d806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:20.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.180+0000 7f98fce00640 1 --2- 172.21.15.122:0/1942251571 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f98d8068650 0x7f98d806ab10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f98f8151660 tx=0x7f98e8009040 comp rx=0 tx=0).stop 2024-05-28T06:09:20.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.180+0000 7f98fce00640 1 -- 172.21.15.122:0/1942251571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f80cd930 msgr2=0x7f98f81539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:20.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.180+0000 7f98fce00640 1 --2- 172.21.15.122:0/1942251571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f80cd930 0x7f98f81539b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f98e40b2040 tx=0x7f98e401cf80 comp rx=0 tx=0).stop 2024-05-28T06:09:20.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.180+0000 7f98fce00640 1 -- 172.21.15.122:0/1942251571 shutdown_connections 2024-05-28T06:09:20.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.180+0000 7f98fce00640 1 --2- 172.21.15.122:0/1942251571 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f98d8068650 0x7f98d806ab10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.180+0000 7f98fce00640 1 --2- 172.21.15.122:0/1942251571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98f80cff30 0x7f98f8153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.180+0000 7f98fce00640 1 --2- 172.21.15.122:0/1942251571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f80cd930 0x7f98f81539b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.180+0000 7f98fce00640 1 --2- 172.21.15.122:0/1942251571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98f806f890 0x7f98f8147dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.180+0000 7f98fce00640 1 -- 172.21.15.122:0/1942251571 >> 172.21.15.122:0/1942251571 conn(0x7f98f806bd90 msgr2=0x7f98f806ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:20.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.180+0000 7f98fce00640 1 -- 172.21.15.122:0/1942251571 shutdown_connections 2024-05-28T06:09:20.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.180+0000 7f98fce00640 1 -- 172.21.15.122:0/1942251571 wait complete. 2024-05-28T06:09:20.202 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-28T06:09:20.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.336+0000 7fb102200640 1 Processor -- start 2024-05-28T06:09:20.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.340+0000 7fb102200640 1 -- start start 2024-05-28T06:09:20.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.340+0000 7fb102200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0fc0cff30 0x7fb0fc06f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:20.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.340+0000 7fb102200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb0fc0cdb00 0x7fb0fc0b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:20.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.340+0000 7fb102200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0fc0d0310 con 0x7fb0fc06f6c0 2024-05-28T06:09:20.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.340+0000 7fb102200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fb0fc06fb00 con 0x7fb0fc0cdb00 2024-05-28T06:09:20.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.340+0000 7fb102200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb0fc0cdf30 con 0x7fb0fc0cff30 2024-05-28T06:09:20.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.340+0000 7fb0fbe00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb0fc0cdb00 0x7fb0fc0b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:20.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.340+0000 7fb0fbe00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb0fc0cdb00 0x7fb0fc0b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40660/0 (socket says 172.21.15.122:40660) 2024-05-28T06:09:20.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.340+0000 7fb0fbe00640 1 -- 172.21.15.122:0/827600836 learned_addr learned my addr 172.21.15.122:0/827600836 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:20.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.340+0000 7fb0fb400640 1 --2- 172.21.15.122:0/827600836 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0fc0cff30 0x7fb0fc06f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:20.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.340+0000 7fb0fbe00640 1 -- 172.21.15.122:0/827600836 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0fc0cff30 msgr2=0x7fb0fc06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:20.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.340+0000 7fb0fbe00640 1 --2- 172.21.15.122:0/827600836 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0fc0cff30 0x7fb0fc06f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.340+0000 7fb0fbe00640 1 -- 172.21.15.122:0/827600836 >> v1:172.21.15.153:6789/0 conn(0x7fb0fc06f6c0 legacy=0x7fb0fc0cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:20.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.340+0000 7fb0fbe00640 1 -- 172.21.15.122:0/827600836 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0fc15be20 con 0x7fb0fc0cdb00 2024-05-28T06:09:20.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.344+0000 7fb0fbe00640 1 --2- 172.21.15.122:0/827600836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0fc0cdb00 0x7fb0fc0b49b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb0f400d150 tx=0x7fb0f401ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2559e709cf9e82 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:20.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.344+0000 7fb0faa00640 1 -- 172.21.15.122:0/827600836 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f40a7cd0 con 0x7fb0fc0cdb00 2024-05-28T06:09:20.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.344+0000 7fb0faa00640 1 -- 172.21.15.122:0/827600836 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f400b0d0 con 0x7fb0fc0cdb00 2024-05-28T06:09:20.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.344+0000 7fb0faa00640 1 -- 172.21.15.122:0/827600836 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4009600 con 0x7fb0fc0cdb00 2024-05-28T06:09:20.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.344+0000 7fb102200640 1 -- 172.21.15.122:0/827600836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0fc0cdb00 msgr2=0x7fb0fc0b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:20.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.344+0000 7fb102200640 1 --2- 172.21.15.122:0/827600836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0fc0cdb00 0x7fb0fc0b49b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb0f400d150 tx=0x7fb0f401ec00 comp rx=0 tx=0).stop 2024-05-28T06:09:20.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.344+0000 7fb102200640 1 -- 172.21.15.122:0/827600836 shutdown_connections 2024-05-28T06:09:20.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.344+0000 7fb102200640 1 --2- 172.21.15.122:0/827600836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0fc0cdb00 0x7fb0fc0b49b0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.344+0000 7fb102200640 1 --2- 172.21.15.122:0/827600836 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0fc0cff30 0x7fb0fc06f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.344+0000 7fb102200640 1 -- 172.21.15.122:0/827600836 >> 172.21.15.122:0/827600836 conn(0x7fb0fc06bd90 msgr2=0x7fb0fc06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:20.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.344+0000 7fb102200640 1 -- 172.21.15.122:0/827600836 shutdown_connections 2024-05-28T06:09:20.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.344+0000 7fb102200640 1 -- 172.21.15.122:0/827600836 wait complete. 2024-05-28T06:09:20.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.344+0000 7fb102200640 1 Processor -- start 2024-05-28T06:09:20.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.344+0000 7fb102200640 1 -- start start 2024-05-28T06:09:20.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb102200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0fc06f6c0 0x7fb0fc143c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:20.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb102200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0fc0cdb00 0x7fb0fc1433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:20.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb102200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0fc0cff30 0x7fb0fc147140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:20.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb102200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb0fc0b5700 con 0x7fb0fc0cff30 2024-05-28T06:09:20.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb102200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb0fc15baf0 con 0x7fb0fc06f6c0 2024-05-28T06:09:20.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb102200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb0fc0b5880 con 0x7fb0fc0cdb00 2024-05-28T06:09:20.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb0fbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0fc0cff30 0x7fb0fc147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:20.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb0fbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0fc0cff30 0x7fb0fc147140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40662/0 (socket says 172.21.15.122:40662) 2024-05-28T06:09:20.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb0fbe00640 1 -- 172.21.15.122:0/2658502536 learned_addr learned my addr 172.21.15.122:0/2658502536 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:20.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb0f2a00640 1 --2- 172.21.15.122:0/2658502536 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0fc0cdb00 0x7fb0fc1433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:20.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb0fb400640 1 --2- 172.21.15.122:0/2658502536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0fc06f6c0 0x7fb0fc143c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:20.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb0fbe00640 1 -- 172.21.15.122:0/2658502536 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0fc0cdb00 msgr2=0x7fb0fc1433d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:20.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb0fbe00640 1 --2- 172.21.15.122:0/2658502536 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0fc0cdb00 0x7fb0fc1433d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb0fbe00640 1 -- 172.21.15.122:0/2658502536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0fc06f6c0 msgr2=0x7fb0fc143c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:20.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb0fbe00640 1 --2- 172.21.15.122:0/2658502536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0fc06f6c0 0x7fb0fc143c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb0fbe00640 1 -- 172.21.15.122:0/2658502536 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0fc144460 con 0x7fb0fc0cff30 2024-05-28T06:09:20.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb0fbe00640 1 --2- 172.21.15.122:0/2658502536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0fc0cff30 0x7fb0fc147140 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb0f401c830 tx=0x7fb0f401b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:20.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb0f3e00640 1 -- 172.21.15.122:0/2658502536 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4009800 con 0x7fb0fc0cff30 2024-05-28T06:09:20.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb0f3e00640 1 -- 172.21.15.122:0/2658502536 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f40c0070 con 0x7fb0fc0cff30 2024-05-28T06:09:20.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb0f3e00640 1 -- 172.21.15.122:0/2658502536 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4009be0 con 0x7fb0fc0cff30 2024-05-28T06:09:20.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb102200640 1 -- 172.21.15.122:0/2658502536 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0fc144740 con 0x7fb0fc0cff30 2024-05-28T06:09:20.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb102200640 1 -- 172.21.15.122:0/2658502536 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0fc144d00 con 0x7fb0fc0cff30 2024-05-28T06:09:20.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb102200640 1 -- 172.21.15.122:0/2658502536 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0fc068c40 con 0x7fb0fc0cff30 2024-05-28T06:09:20.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.348+0000 7fb0f3e00640 1 -- 172.21.15.122:0/2658502536 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7fb0f40ba470 con 0x7fb0fc0cff30 2024-05-28T06:09:20.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.352+0000 7fb0f3e00640 1 --2- 172.21.15.122:0/2658502536 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb0d8068650 0x7fb0d806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:20.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.352+0000 7fb0f3e00640 1 -- 172.21.15.122:0/2658502536 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5765+0+0 (secure 0 0 0) 0x7fb0f4124100 con 0x7fb0fc0cff30 2024-05-28T06:09:20.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.352+0000 7fb0fb400640 1 --2- 172.21.15.122:0/2658502536 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb0d8068650 0x7fb0d806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:20.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.352+0000 7fb0fb400640 1 --2- 172.21.15.122:0/2658502536 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb0d8068650 0x7fb0d806ab10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009ac0 tx=0x7fb0ec009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:20.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.356+0000 7fb0f3e00640 1 -- 172.21.15.122:0/2658502536 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb0f4018820 con 0x7fb0fc0cff30 2024-05-28T06:09:20.517 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.512+0000 7fb102200640 1 -- 172.21.15.122:0/2658502536 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb0fc15af40 con 0x7fb0fc0cff30 2024-05-28T06:09:20.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.516+0000 7fb0f3e00640 1 -- 172.21.15.122:0/2658502536 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) ==== 104+0+11 (secure 0 0 0) 0x7fb0f40f3ec0 con 0x7fb0fc0cff30 2024-05-28T06:09:20.518 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 32 2024-05-28T06:09:20.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.516+0000 7fb102200640 1 -- 172.21.15.122:0/2658502536 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb0d8068650 msgr2=0x7fb0d806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:20.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.516+0000 7fb102200640 1 --2- 172.21.15.122:0/2658502536 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb0d8068650 0x7fb0d806ab10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009ac0 tx=0x7fb0ec009190 comp rx=0 tx=0).stop 2024-05-28T06:09:20.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.516+0000 7fb102200640 1 -- 172.21.15.122:0/2658502536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0fc0cff30 msgr2=0x7fb0fc147140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:20.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.516+0000 7fb102200640 1 --2- 172.21.15.122:0/2658502536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0fc0cff30 0x7fb0fc147140 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb0f401c830 tx=0x7fb0f401b9a0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.516+0000 7fb102200640 1 -- 172.21.15.122:0/2658502536 shutdown_connections 2024-05-28T06:09:20.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.516+0000 7fb102200640 1 --2- 172.21.15.122:0/2658502536 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb0d8068650 0x7fb0d806ab10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.516+0000 7fb102200640 1 --2- 172.21.15.122:0/2658502536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0fc0cff30 0x7fb0fc147140 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.516+0000 7fb102200640 1 --2- 172.21.15.122:0/2658502536 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0fc0cdb00 0x7fb0fc1433d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.516+0000 7fb102200640 1 --2- 172.21.15.122:0/2658502536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0fc06f6c0 0x7fb0fc143c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.516+0000 7fb102200640 1 -- 172.21.15.122:0/2658502536 >> 172.21.15.122:0/2658502536 conn(0x7fb0fc06bd90 msgr2=0x7fb0fc15b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:20.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.516+0000 7fb102200640 1 -- 172.21.15.122:0/2658502536 shutdown_connections 2024-05-28T06:09:20.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.516+0000 7fb102200640 1 -- 172.21.15.122:0/2658502536 wait complete. 2024-05-28T06:09:20.539 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-28T06:09:20.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.672+0000 7f7145400640 1 Processor -- start 2024-05-28T06:09:20.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.672+0000 7f7145400640 1 -- start start 2024-05-28T06:09:20.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.676+0000 7f7145400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71400cff30 0x7f714006f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:20.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.676+0000 7f7145400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f71400cdb00 0x7f71400b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:20.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.676+0000 7f7145400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71400d0310 con 0x7f714006f6c0 2024-05-28T06:09:20.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.676+0000 7f7145400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f714006fb00 con 0x7f71400cdb00 2024-05-28T06:09:20.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.676+0000 7f7145400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f71400cdf30 con 0x7f71400cff30 2024-05-28T06:09:20.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.676+0000 7f713f200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f71400cdb00 0x7f71400b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:20.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.676+0000 7f713f200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f71400cdb00 0x7f71400b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40676/0 (socket says 172.21.15.122:40676) 2024-05-28T06:09:20.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.676+0000 7f713f200640 1 -- 172.21.15.122:0/1370647780 learned_addr learned my addr 172.21.15.122:0/1370647780 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:20.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.676+0000 7f713f200640 1 -- 172.21.15.122:0/1370647780 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71400cff30 msgr2=0x7f714006f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:20.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.676+0000 7f713e800640 1 --2- 172.21.15.122:0/1370647780 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71400cff30 0x7f714006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:20.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.676+0000 7f713f200640 1 --2- 172.21.15.122:0/1370647780 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71400cff30 0x7f714006f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.676+0000 7f713f200640 1 -- 172.21.15.122:0/1370647780 >> v1:172.21.15.153:6789/0 conn(0x7f714006f6c0 legacy=0x7f71400cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:20.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.676+0000 7f713f200640 1 -- 172.21.15.122:0/1370647780 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f714015be20 con 0x7f71400cdb00 2024-05-28T06:09:20.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.676+0000 7f713e800640 1 --2- 172.21.15.122:0/1370647780 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71400cff30 0x7f714006f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:09:20.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.680+0000 7f713f200640 1 --2- 172.21.15.122:0/1370647780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71400cdb00 0x7f71400b49b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f71400b3b00 tx=0x7f713801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bac4ab26a09fe8 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:20.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.680+0000 7f713de00640 1 -- 172.21.15.122:0/1370647780 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71380a5800 con 0x7f71400cdb00 2024-05-28T06:09:20.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.680+0000 7f713de00640 1 -- 172.21.15.122:0/1370647780 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71380a59a0 con 0x7f71400cdb00 2024-05-28T06:09:20.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.680+0000 7f713de00640 1 -- 172.21.15.122:0/1370647780 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71380a5d70 con 0x7f71400cdb00 2024-05-28T06:09:20.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.680+0000 7f7145400640 1 -- 172.21.15.122:0/1370647780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71400cdb00 msgr2=0x7f71400b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:20.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.680+0000 7f7145400640 1 --2- 172.21.15.122:0/1370647780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71400cdb00 0x7f71400b49b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f71400b3b00 tx=0x7f713801c980 comp rx=0 tx=0).stop 2024-05-28T06:09:20.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.680+0000 7f7145400640 1 -- 172.21.15.122:0/1370647780 shutdown_connections 2024-05-28T06:09:20.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.680+0000 7f7145400640 1 --2- 172.21.15.122:0/1370647780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71400cdb00 0x7f71400b49b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.680+0000 7f7145400640 1 --2- 172.21.15.122:0/1370647780 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71400cff30 0x7f714006f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.680+0000 7f7145400640 1 -- 172.21.15.122:0/1370647780 >> 172.21.15.122:0/1370647780 conn(0x7f714006bd90 msgr2=0x7f714006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:20.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.680+0000 7f7145400640 1 -- 172.21.15.122:0/1370647780 shutdown_connections 2024-05-28T06:09:20.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.680+0000 7f7145400640 1 -- 172.21.15.122:0/1370647780 wait complete. 2024-05-28T06:09:20.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.680+0000 7f7145400640 1 Processor -- start 2024-05-28T06:09:20.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.680+0000 7f7145400640 1 -- start start 2024-05-28T06:09:20.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f7145400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f714006f6c0 0x7f7140147270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:20.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f7145400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71400cdb00 0x7f714014d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:20.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f7145400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71400cff30 0x7f714014d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:20.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f7145400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f71400b5700 con 0x7f71400cdb00 2024-05-28T06:09:20.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f7145400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f714015baf0 con 0x7f714006f6c0 2024-05-28T06:09:20.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f7145400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f71400b5880 con 0x7f71400cff30 2024-05-28T06:09:20.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f7135e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71400cdb00 0x7f714014d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:20.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f713e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f714006f6c0 0x7f7140147270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:20.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f7135e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71400cdb00 0x7f714014d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40688/0 (socket says 172.21.15.122:40688) 2024-05-28T06:09:20.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f7135e00640 1 -- 172.21.15.122:0/286838892 learned_addr learned my addr 172.21.15.122:0/286838892 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:20.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f713f200640 1 --2- 172.21.15.122:0/286838892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71400cff30 0x7f714014d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:20.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f7135e00640 1 -- 172.21.15.122:0/286838892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71400cff30 msgr2=0x7f714014d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:20.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f7135e00640 1 --2- 172.21.15.122:0/286838892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71400cff30 0x7f714014d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f7135e00640 1 -- 172.21.15.122:0/286838892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f714006f6c0 msgr2=0x7f7140147270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:20.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f7135e00640 1 --2- 172.21.15.122:0/286838892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f714006f6c0 0x7f7140147270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f7135e00640 1 -- 172.21.15.122:0/286838892 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f714014c3e0 con 0x7f71400cdb00 2024-05-28T06:09:20.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f7135e00640 1 --2- 172.21.15.122:0/286838892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71400cdb00 0x7f714014d2c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f712800c480 tx=0x7f712800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:20.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f7137400640 1 -- 172.21.15.122:0/286838892 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7128012830 con 0x7f71400cdb00 2024-05-28T06:09:20.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f7137400640 1 -- 172.21.15.122:0/286838892 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7128017070 con 0x7f71400cdb00 2024-05-28T06:09:20.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f7137400640 1 -- 172.21.15.122:0/286838892 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7128012c30 con 0x7f71400cdb00 2024-05-28T06:09:20.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f7145400640 1 -- 172.21.15.122:0/286838892 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f714014c6c0 con 0x7f71400cdb00 2024-05-28T06:09:20.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f7145400640 1 -- 172.21.15.122:0/286838892 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7140159960 con 0x7f71400cdb00 2024-05-28T06:09:20.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f7145400640 1 -- 172.21.15.122:0/286838892 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7140068c40 con 0x7f71400cdb00 2024-05-28T06:09:20.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.684+0000 7f7137400640 1 -- 172.21.15.122:0/286838892 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f712801c460 con 0x7f71400cdb00 2024-05-28T06:09:20.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.688+0000 7f7137400640 1 --2- 172.21.15.122:0/286838892 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f711c068650 0x7f711c06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:20.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.688+0000 7f7137400640 1 -- 172.21.15.122:0/286838892 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5765+0+0 (secure 0 0 0) 0x7f7128086ad0 con 0x7f71400cdb00 2024-05-28T06:09:20.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.688+0000 7f713e800640 1 --2- 172.21.15.122:0/286838892 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f711c068650 0x7f711c06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:20.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.688+0000 7f713e800640 1 --2- 172.21.15.122:0/286838892 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f711c068650 0x7f711c06ab10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f714014ded0 tx=0x7f7130008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:20.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.692+0000 7f7137400640 1 -- 172.21.15.122:0/286838892 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7128056700 con 0x7f71400cdb00 2024-05-28T06:09:20.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.848+0000 7f7145400640 1 -- 172.21.15.122:0/286838892 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f71400ccdf0 con 0x7f71400cdb00 2024-05-28T06:09:20.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.848+0000 7f7137400640 1 -- 172.21.15.122:0/286838892 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) ==== 100+0+11 (secure 0 0 0) 0x7f712805aa00 con 0x7f71400cdb00 2024-05-28T06:09:20.853 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 64 2024-05-28T06:09:20.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.852+0000 7f7145400640 1 -- 172.21.15.122:0/286838892 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f711c068650 msgr2=0x7f711c06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:20.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.852+0000 7f7145400640 1 --2- 172.21.15.122:0/286838892 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f711c068650 0x7f711c06ab10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f714014ded0 tx=0x7f7130008040 comp rx=0 tx=0).stop 2024-05-28T06:09:20.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.852+0000 7f7145400640 1 -- 172.21.15.122:0/286838892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71400cdb00 msgr2=0x7f714014d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:20.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.852+0000 7f7145400640 1 --2- 172.21.15.122:0/286838892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71400cdb00 0x7f714014d2c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f712800c480 tx=0x7f712800c940 comp rx=0 tx=0).stop 2024-05-28T06:09:20.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.852+0000 7f7145400640 1 -- 172.21.15.122:0/286838892 shutdown_connections 2024-05-28T06:09:20.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.852+0000 7f7145400640 1 --2- 172.21.15.122:0/286838892 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f711c068650 0x7f711c06ab10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.852+0000 7f7145400640 1 --2- 172.21.15.122:0/286838892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71400cff30 0x7f714014d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.852+0000 7f7145400640 1 --2- 172.21.15.122:0/286838892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71400cdb00 0x7f714014d2c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.852+0000 7f7145400640 1 --2- 172.21.15.122:0/286838892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f714006f6c0 0x7f7140147270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:20.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.852+0000 7f7145400640 1 -- 172.21.15.122:0/286838892 >> 172.21.15.122:0/286838892 conn(0x7f714006bd90 msgr2=0x7f714015df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:20.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.852+0000 7f7145400640 1 -- 172.21.15.122:0/286838892 shutdown_connections 2024-05-28T06:09:20.857 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:20.852+0000 7f7145400640 1 -- 172.21.15.122:0/286838892 wait complete. 2024-05-28T06:09:20.874 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:09:21.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.008+0000 7f26d6000640 1 Processor -- start 2024-05-28T06:09:21.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.008+0000 7f26d6000640 1 -- start start 2024-05-28T06:09:21.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26d6000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f26d0145fc0 0x7f26d015cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:21.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26d6000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26d00d06d0 con 0x7f26d015d1c0 2024-05-28T06:09:21.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26d6000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26d00d09b0 con 0x7f26d00b35f0 2024-05-28T06:09:21.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26d6000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f26d00d1250 con 0x7f26d0145fc0 2024-05-28T06:09:21.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26cea00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f26d015d1c0 0x7f26d00d1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:51562/0 (socket says 172.21.15.122:51562) 2024-05-28T06:09:21.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26cea00640 1 -- 172.21.15.122:0/3313458079 learned_addr learned my addr 172.21.15.122:0/3313458079 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:21.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26cf400640 1 --2- 172.21.15.122:0/3313458079 >> v2:172.21.15.153:3300/0 conn(0x7f26d0145fc0 0x7f26d015cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:21.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26ce000640 1 -- 172.21.15.122:0/3313458079 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4094874468 0 0) 0x7f26d00d06d0 con 0x7f26d015d1c0 2024-05-28T06:09:21.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26ce000640 1 -- 172.21.15.122:0/3313458079 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26b4003530 con 0x7f26d015d1c0 2024-05-28T06:09:21.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26ce000640 1 -- 172.21.15.122:0/3313458079 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 362144376 0 0) 0x7f26b4003530 con 0x7f26d015d1c0 2024-05-28T06:09:21.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26ce000640 1 -- 172.21.15.122:0/3313458079 >> v2:172.21.15.153:3300/0 conn(0x7f26d0145fc0 msgr2=0x7f26d015cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:21.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26ce000640 1 --2- 172.21.15.122:0/3313458079 >> v2:172.21.15.153:3300/0 conn(0x7f26d0145fc0 0x7f26d015cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26ce000640 1 -- 172.21.15.122:0/3313458079 >> v1:172.21.15.153:6789/0 conn(0x7f26d00b35f0 legacy=0x7f26d006bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:21.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26ce000640 1 -- 172.21.15.122:0/3313458079 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d00d0c90 con 0x7f26d015d1c0 2024-05-28T06:09:21.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26ce000640 1 -- 172.21.15.122:0/3313458079 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f26bc001680 con 0x7f26d015d1c0 2024-05-28T06:09:21.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26ce000640 1 -- 172.21.15.122:0/3313458079 >> v1:172.21.15.122:6789/0 conn(0x7f26d015d1c0 legacy=0x7f26d00d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:21.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26ce000640 1 --2- 172.21.15.122:0/3313458079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26b40039c0 0x7f26b4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:21.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26ce000640 1 --2- 172.21.15.122:0/3313458079 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26b4004810 0x7f26b4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:21.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26ce000640 1 --2- 172.21.15.122:0/3313458079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26b40051d0 0x7f26b400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:21.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26ce000640 1 -- 172.21.15.122:0/3313458079 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f26d00d1250 con 0x7f26b40039c0 2024-05-28T06:09:21.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26ce000640 1 -- 172.21.15.122:0/3313458079 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f26b400c020 con 0x7f26b40051d0 2024-05-28T06:09:21.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26ce000640 1 -- 172.21.15.122:0/3313458079 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f26b400c220 con 0x7f26b4004810 2024-05-28T06:09:21.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26cf400640 1 --2- 172.21.15.122:0/3313458079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26b40039c0 0x7f26b4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:21.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26cea00640 1 --2- 172.21.15.122:0/3313458079 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26b4004810 0x7f26b4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:21.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26cfe00640 1 --2- 172.21.15.122:0/3313458079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26b40051d0 0x7f26b400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:21.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26cf400640 1 -- 172.21.15.122:0/3313458079 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26b4004810 msgr2=0x7f26b4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:21.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26cf400640 1 --2- 172.21.15.122:0/3313458079 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26b4004810 0x7f26b4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26cf400640 1 -- 172.21.15.122:0/3313458079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26b40051d0 msgr2=0x7f26b400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:21.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26cf400640 1 --2- 172.21.15.122:0/3313458079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26b40051d0 0x7f26b400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26cf400640 1 -- 172.21.15.122:0/3313458079 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b4003530 con 0x7f26b40039c0 2024-05-28T06:09:21.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.012+0000 7f26cfe00640 1 -- 172.21.15.122:0/3313458079 reap_dead start 2024-05-28T06:09:21.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.016+0000 7f26cf400640 1 --2- 172.21.15.122:0/3313458079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26b40039c0 0x7f26b4003da0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f26c0009ae0 tx=0x7f26c001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e1b8dfa0dc21ed server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:21.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.016+0000 7f26ce000640 1 -- 172.21.15.122:0/3313458079 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c00b2070 con 0x7f26b40039c0 2024-05-28T06:09:21.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.016+0000 7f26ce000640 1 -- 172.21.15.122:0/3313458079 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26c00a5660 con 0x7f26b40039c0 2024-05-28T06:09:21.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.016+0000 7f26ce000640 1 -- 172.21.15.122:0/3313458079 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c00096b0 con 0x7f26b40039c0 2024-05-28T06:09:21.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.016+0000 7f26d6000640 1 -- 172.21.15.122:0/3313458079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26b40039c0 msgr2=0x7f26b4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:21.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.016+0000 7f26d6000640 1 --2- 172.21.15.122:0/3313458079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26b40039c0 0x7f26b4003da0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f26c0009ae0 tx=0x7f26c001ca70 comp rx=0 tx=0).stop 2024-05-28T06:09:21.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.016+0000 7f26d6000640 1 -- 172.21.15.122:0/3313458079 shutdown_connections 2024-05-28T06:09:21.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.016+0000 7f26d6000640 1 --2- 172.21.15.122:0/3313458079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26b40039c0 0x7f26b4003da0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.016+0000 7f26d6000640 1 -- 172.21.15.122:0/3313458079 >> 172.21.15.122:0/3313458079 conn(0x7f26d00b6c10 msgr2=0x7f26d00b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:21.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.016+0000 7f26d6000640 1 -- 172.21.15.122:0/3313458079 shutdown_connections 2024-05-28T06:09:21.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.016+0000 7f26d6000640 1 -- 172.21.15.122:0/3313458079 wait complete. 2024-05-28T06:09:21.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.016+0000 7f26d6000640 1 Processor -- start 2024-05-28T06:09:21.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.016+0000 7f26d6000640 1 -- start start 2024-05-28T06:09:21.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26d6000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26b40039c0 0x7f26d00ab410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:21.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26d6000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26d015bec0 0x7f26d0144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:21.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26d6000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26d01449b0 0x7f26d00a9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:21.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26d6000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f26d01463a0 con 0x7f26d01449b0 2024-05-28T06:09:21.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26d6000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f26d00d0380 con 0x7f26b40039c0 2024-05-28T06:09:21.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26d6000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f26d015cc80 con 0x7f26d015bec0 2024-05-28T06:09:21.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26cfe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26d01449b0 0x7f26d00a9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:21.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26cf400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26b40039c0 0x7f26d00ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:21.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26cfe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26d01449b0 0x7f26d00a9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40694/0 (socket says 172.21.15.122:40694) 2024-05-28T06:09:21.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26cfe00640 1 -- 172.21.15.122:0/2733415340 learned_addr learned my addr 172.21.15.122:0/2733415340 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:21.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26cea00640 1 --2- 172.21.15.122:0/2733415340 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26d015bec0 0x7f26d0144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:21.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26cfe00640 1 -- 172.21.15.122:0/2733415340 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26d015bec0 msgr2=0x7f26d0144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:21.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26cfe00640 1 --2- 172.21.15.122:0/2733415340 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26d015bec0 0x7f26d0144470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26cfe00640 1 -- 172.21.15.122:0/2733415340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26b40039c0 msgr2=0x7f26d00ab410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:21.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26cfe00640 1 --2- 172.21.15.122:0/2733415340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26b40039c0 0x7f26d00ab410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26cfe00640 1 -- 172.21.15.122:0/2733415340 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d0073e40 con 0x7f26d01449b0 2024-05-28T06:09:21.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26cfe00640 1 --2- 172.21.15.122:0/2733415340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26d01449b0 0x7f26d00a9790 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f26d00b6930 tx=0x7f26c8011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:21.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26c7400640 1 -- 172.21.15.122:0/2733415340 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c8010040 con 0x7f26d01449b0 2024-05-28T06:09:21.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26c7400640 1 -- 172.21.15.122:0/2733415340 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26c801a070 con 0x7f26d01449b0 2024-05-28T06:09:21.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26c7400640 1 -- 172.21.15.122:0/2733415340 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c8015410 con 0x7f26d01449b0 2024-05-28T06:09:21.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26d6000640 1 -- 172.21.15.122:0/2733415340 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26d01413e0 con 0x7f26d01449b0 2024-05-28T06:09:21.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26d6000640 1 -- 172.21.15.122:0/2733415340 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26d00aa650 con 0x7f26d01449b0 2024-05-28T06:09:21.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26d6000640 1 -- 172.21.15.122:0/2733415340 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26d0068c40 con 0x7f26d01449b0 2024-05-28T06:09:21.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.020+0000 7f26c7400640 1 -- 172.21.15.122:0/2733415340 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f26c80155b0 con 0x7f26d01449b0 2024-05-28T06:09:21.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.024+0000 7f26c7400640 1 --2- 172.21.15.122:0/2733415340 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f26b0068680 0x7f26b006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:21.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.024+0000 7f26c7400640 1 -- 172.21.15.122:0/2733415340 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5765+0+0 (secure 0 0 0) 0x7f26c808a020 con 0x7f26d01449b0 2024-05-28T06:09:21.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.024+0000 7f26cf400640 1 --2- 172.21.15.122:0/2733415340 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f26b0068680 0x7f26b006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:21.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.024+0000 7f26cf400640 1 --2- 172.21.15.122:0/2733415340 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f26b0068680 0x7f26b006ab40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f26c00af000 tx=0x7f26c00b7040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:21.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.028+0000 7f26c7400640 1 -- 172.21.15.122:0/2733415340 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f26d01413e0 con 0x7f26d01449b0 2024-05-28T06:09:21.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.216+0000 7f26d6000640 1 -- 172.21.15.122:0/2733415340 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26d0074010 con 0x7f26d01449b0 2024-05-28T06:09:21.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.216+0000 7f26c7400640 1 -- 172.21.15.122:0/2733415340 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5190 (secure 0 0 0) 0x7f26c8059c00 con 0x7f26d01449b0 2024-05-28T06:09:21.222 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:21.222 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1943879237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1943879237},{"type":"v1","addr":"172.21.15.153:6834","nonce":1943879237}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1104849441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1104849441},{"type":"v1","addr":"172.21.15.153:6835","nonce":1104849441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/560614408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":560614408},{"type":"v1","addr":"172.21.15.122:6835","nonce":560614408}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-28T06:06:49.284485+0000","modified":"2024-05-28T06:06:52.295560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1698676182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1698676182},{"type":"v1","addr":"172.21.15.122:6837","nonce":1698676182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5082,"qdb_cluster":[5082]},"id":2}]} 2024-05-28T06:09:21.222 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 19 2024-05-28T06:09:21.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.220+0000 7f26d6000640 1 -- 172.21.15.122:0/2733415340 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f26b0068680 msgr2=0x7f26b006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:21.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.220+0000 7f26d6000640 1 --2- 172.21.15.122:0/2733415340 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f26b0068680 0x7f26b006ab40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f26c00af000 tx=0x7f26c00b7040 comp rx=0 tx=0).stop 2024-05-28T06:09:21.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.220+0000 7f26d6000640 1 -- 172.21.15.122:0/2733415340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26d01449b0 msgr2=0x7f26d00a9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:21.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.220+0000 7f26d6000640 1 --2- 172.21.15.122:0/2733415340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26d01449b0 0x7f26d00a9790 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f26d00b6930 tx=0x7f26c8011f70 comp rx=0 tx=0).stop 2024-05-28T06:09:21.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.220+0000 7f26d6000640 1 -- 172.21.15.122:0/2733415340 shutdown_connections 2024-05-28T06:09:21.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.220+0000 7f26d6000640 1 --2- 172.21.15.122:0/2733415340 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f26b0068680 0x7f26b006ab40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.220+0000 7f26d6000640 1 --2- 172.21.15.122:0/2733415340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26d01449b0 0x7f26d00a9790 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.220+0000 7f26d6000640 1 --2- 172.21.15.122:0/2733415340 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26d015bec0 0x7f26d0144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.220+0000 7f26d6000640 1 --2- 172.21.15.122:0/2733415340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26b40039c0 0x7f26d00ab410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.220+0000 7f26d6000640 1 -- 172.21.15.122:0/2733415340 >> 172.21.15.122:0/2733415340 conn(0x7f26d00b6c10 msgr2=0x7f26d006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:21.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.220+0000 7f26d6000640 1 -- 172.21.15.122:0/2733415340 shutdown_connections 2024-05-28T06:09:21.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.220+0000 7f26d6000640 1 -- 172.21.15.122:0/2733415340 wait complete. 2024-05-28T06:09:21.243 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:09:21.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.376+0000 7f01e1000640 1 Processor -- start 2024-05-28T06:09:21.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.376+0000 7f01e1000640 1 -- start start 2024-05-28T06:09:21.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.380+0000 7f01e1000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f01dc1588b0 0x7f01dc06e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:21.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.380+0000 7f01e1000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f01dc15f4c0 0x7f01dc140580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:21.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.380+0000 7f01e1000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01dc141420 con 0x7f01dc15e8b0 2024-05-28T06:09:21.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.380+0000 7f01e1000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f01dc158c90 con 0x7f01dc15f4c0 2024-05-28T06:09:21.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.380+0000 7f01e1000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f01dc140e60 con 0x7f01dc1588b0 2024-05-28T06:09:21.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.380+0000 7f01d9400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f01dc15f4c0 0x7f01dc140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:21.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.380+0000 7f01d9400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f01dc15f4c0 0x7f01dc140580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40702/0 (socket says 172.21.15.122:40702) 2024-05-28T06:09:21.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.380+0000 7f01d9400640 1 -- 172.21.15.122:0/1705459623 learned_addr learned my addr 172.21.15.122:0/1705459623 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:21.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.380+0000 7f01da800640 1 --1- 172.21.15.122:0/1705459623 >> v1:172.21.15.122:6789/0 conn(0x7f01dc15e8b0 0x7f01dc0cf670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:51572/0 (socket says 172.21.15.122:51572) 2024-05-28T06:09:21.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.380+0000 7f01d9e00640 1 --2- 172.21.15.122:0/1705459623 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f01dc1588b0 0x7f01dc06e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:21.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.380+0000 7f01d9400640 1 -- 172.21.15.122:0/1705459623 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f01dc1588b0 msgr2=0x7f01dc06e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:21.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.380+0000 7f01d9400640 1 --2- 172.21.15.122:0/1705459623 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f01dc1588b0 0x7f01dc06e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.380+0000 7f01d9400640 1 -- 172.21.15.122:0/1705459623 >> v1:172.21.15.122:6789/0 conn(0x7f01dc15e8b0 legacy=0x7f01dc0cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:21.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.380+0000 7f01d9400640 1 -- 172.21.15.122:0/1705459623 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01dc141140 con 0x7f01dc15f4c0 2024-05-28T06:09:21.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.380+0000 7f01d8a00640 1 -- 172.21.15.122:0/1705459623 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1355339979 0 0) 0x7f01dc141420 con 0x7f01dc15e8b0 2024-05-28T06:09:21.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.380+0000 7f01d9400640 1 --2- 172.21.15.122:0/1705459623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01dc15f4c0 0x7f01dc140580 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009870 tx=0x7f01c801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1976f8e2bdc07664 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:21.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01d8a00640 1 -- 172.21.15.122:0/1705459623 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c80a9620 con 0x7f01dc15f4c0 2024-05-28T06:09:21.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01d8a00640 1 -- 172.21.15.122:0/1705459623 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01c80a97c0 con 0x7f01dc15f4c0 2024-05-28T06:09:21.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01d8a00640 1 -- 172.21.15.122:0/1705459623 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c80a9b90 con 0x7f01dc15f4c0 2024-05-28T06:09:21.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01e1000640 1 -- 172.21.15.122:0/1705459623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01dc15f4c0 msgr2=0x7f01dc140580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:21.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01e1000640 1 --2- 172.21.15.122:0/1705459623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01dc15f4c0 0x7f01dc140580 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009870 tx=0x7f01c801c560 comp rx=0 tx=0).stop 2024-05-28T06:09:21.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01e1000640 1 -- 172.21.15.122:0/1705459623 shutdown_connections 2024-05-28T06:09:21.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01e1000640 1 --2- 172.21.15.122:0/1705459623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01dc15f4c0 0x7f01dc140580 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01e1000640 1 --2- 172.21.15.122:0/1705459623 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f01dc1588b0 0x7f01dc06e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01e1000640 1 -- 172.21.15.122:0/1705459623 >> 172.21.15.122:0/1705459623 conn(0x7f01dc06bd90 msgr2=0x7f01dc06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:21.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01e1000640 1 -- 172.21.15.122:0/1705459623 shutdown_connections 2024-05-28T06:09:21.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01e1000640 1 -- 172.21.15.122:0/1705459623 wait complete. 2024-05-28T06:09:21.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01e1000640 1 Processor -- start 2024-05-28T06:09:21.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01e1000640 1 -- start start 2024-05-28T06:09:21.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01e1000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01dc1588b0 0x7f01dc15a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:21.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01e1000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01dc15e8b0 0x7f01dc138e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:21.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01e1000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f01dc15f4c0 0x7f01dc1556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:21.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01e1000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f01dc140c40 con 0x7f01dc1588b0 2024-05-28T06:09:21.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01e1000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f01dc140ac0 con 0x7f01dc15e8b0 2024-05-28T06:09:21.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01e1000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f01dc0d0190 con 0x7f01dc15f4c0 2024-05-28T06:09:21.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01d9e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01dc1588b0 0x7f01dc15a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:21.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01d9e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01dc1588b0 0x7f01dc15a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40718/0 (socket says 172.21.15.122:40718) 2024-05-28T06:09:21.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01d9e00640 1 -- 172.21.15.122:0/797750838 learned_addr learned my addr 172.21.15.122:0/797750838 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:21.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01d9400640 1 --2- 172.21.15.122:0/797750838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01dc15e8b0 0x7f01dc138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:21.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01da800640 1 --2- 172.21.15.122:0/797750838 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f01dc15f4c0 0x7f01dc1556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:21.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01d9e00640 1 -- 172.21.15.122:0/797750838 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f01dc15f4c0 msgr2=0x7f01dc1556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:21.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01d9e00640 1 --2- 172.21.15.122:0/797750838 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f01dc15f4c0 0x7f01dc1556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01d9e00640 1 -- 172.21.15.122:0/797750838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01dc15e8b0 msgr2=0x7f01dc138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:21.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01d9e00640 1 --2- 172.21.15.122:0/797750838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01dc15e8b0 0x7f01dc138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.384+0000 7f01d9e00640 1 -- 172.21.15.122:0/797750838 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01dc15ac20 con 0x7f01dc1588b0 2024-05-28T06:09:21.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.388+0000 7f01d9e00640 1 --2- 172.21.15.122:0/797750838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01dc1588b0 0x7f01dc15a640 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00efc0 tx=0x7f01cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:21.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.388+0000 7f01d2000640 1 -- 172.21.15.122:0/797750838 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01cc018020 con 0x7f01dc1588b0 2024-05-28T06:09:21.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.388+0000 7f01d2000640 1 -- 172.21.15.122:0/797750838 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01cc014480 con 0x7f01dc1588b0 2024-05-28T06:09:21.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.388+0000 7f01e1000640 1 -- 172.21.15.122:0/797750838 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01dc139fa0 con 0x7f01dc1588b0 2024-05-28T06:09:21.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.388+0000 7f01d2000640 1 -- 172.21.15.122:0/797750838 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01cc014850 con 0x7f01dc1588b0 2024-05-28T06:09:21.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.388+0000 7f01e1000640 1 -- 172.21.15.122:0/797750838 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01dc13deb0 con 0x7f01dc1588b0 2024-05-28T06:09:21.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.388+0000 7f01e1000640 1 -- 172.21.15.122:0/797750838 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01dc068c40 con 0x7f01dc1588b0 2024-05-28T06:09:21.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.388+0000 7f01d2000640 1 -- 172.21.15.122:0/797750838 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f01cc01b020 con 0x7f01dc1588b0 2024-05-28T06:09:21.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.388+0000 7f01d2000640 1 --2- 172.21.15.122:0/797750838 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f01bc068650 0x7f01bc06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:21.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.388+0000 7f01d2000640 1 -- 172.21.15.122:0/797750838 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5765+0+0 (secure 0 0 0) 0x7f01cc087d40 con 0x7f01dc1588b0 2024-05-28T06:09:21.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.388+0000 7f01d9400640 1 --2- 172.21.15.122:0/797750838 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f01bc068650 0x7f01bc06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:21.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.392+0000 7f01d9400640 1 --2- 172.21.15.122:0/797750838 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f01bc068650 0x7f01bc06ab10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f01c80ae000 tx=0x7f01c80b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:21.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.392+0000 7f01d2000640 1 -- 172.21.15.122:0/797750838 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f01cc022030 con 0x7f01dc1588b0 2024-05-28T06:09:21.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.552+0000 7f01e1000640 1 -- 172.21.15.122:0/797750838 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01dc0b37e0 con 0x7f01dc1588b0 2024-05-28T06:09:21.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.556+0000 7f01d2000640 1 -- 172.21.15.122:0/797750838 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16777 (secure 0 0 0) 0x7f01cc010040 con 0x7f01dc1588b0 2024-05-28T06:09:21.558 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:21.558 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":35,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:09:18.389359+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:06:47.799439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-28T06:06:48.236731+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":35,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:09:21.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.556+0000 7f01e1000640 1 -- 172.21.15.122:0/797750838 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f01bc068650 msgr2=0x7f01bc06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:21.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.556+0000 7f01e1000640 1 --2- 172.21.15.122:0/797750838 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f01bc068650 0x7f01bc06ab10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f01c80ae000 tx=0x7f01c80b3040 comp rx=0 tx=0).stop 2024-05-28T06:09:21.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.556+0000 7f01e1000640 1 -- 172.21.15.122:0/797750838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01dc1588b0 msgr2=0x7f01dc15a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:21.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.556+0000 7f01e1000640 1 --2- 172.21.15.122:0/797750838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01dc1588b0 0x7f01dc15a640 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00efc0 tx=0x7f01cc00c490 comp rx=0 tx=0).stop 2024-05-28T06:09:21.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.556+0000 7f01e1000640 1 -- 172.21.15.122:0/797750838 shutdown_connections 2024-05-28T06:09:21.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.556+0000 7f01e1000640 1 --2- 172.21.15.122:0/797750838 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f01bc068650 0x7f01bc06ab10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.556+0000 7f01e1000640 1 --2- 172.21.15.122:0/797750838 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f01dc15f4c0 0x7f01dc1556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.556+0000 7f01e1000640 1 --2- 172.21.15.122:0/797750838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01dc15e8b0 0x7f01dc138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.556+0000 7f01e1000640 1 --2- 172.21.15.122:0/797750838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01dc1588b0 0x7f01dc15a640 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.556+0000 7f01e1000640 1 -- 172.21.15.122:0/797750838 >> 172.21.15.122:0/797750838 conn(0x7f01dc06bd90 msgr2=0x7f01dc13cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:21.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.556+0000 7f01e1000640 1 -- 172.21.15.122:0/797750838 shutdown_connections 2024-05-28T06:09:21.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.556+0000 7f01e1000640 1 -- 172.21.15.122:0/797750838 wait complete. 2024-05-28T06:09:21.580 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-28T06:09:21.580 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:09:21.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.712+0000 7fda25000640 1 Processor -- start 2024-05-28T06:09:21.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.712+0000 7fda25000640 1 -- start start 2024-05-28T06:09:21.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.712+0000 7fda25000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fda200b59c0 0x7fda200cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:21.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.712+0000 7fda25000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda200d0310 con 0x7fda2006f890 2024-05-28T06:09:21.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.712+0000 7fda25000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda2015be20 con 0x7fda200cff30 2024-05-28T06:09:21.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.712+0000 7fda25000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fda2015c100 con 0x7fda200b59c0 2024-05-28T06:09:21.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.712+0000 7fda15400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fda2006f890 0x7fda200cd3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:51578/0 (socket says 172.21.15.122:51578) 2024-05-28T06:09:21.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.712+0000 7fda15400640 1 -- 172.21.15.122:0/3504834623 learned_addr learned my addr 172.21.15.122:0/3504834623 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:21.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.712+0000 7fda1e800640 1 --2- 172.21.15.122:0/3504834623 >> v2:172.21.15.153:3300/0 conn(0x7fda200b59c0 0x7fda200cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:21.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda1d400640 1 -- 172.21.15.122:0/3504834623 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4161786489 0 0) 0x7fda200d0310 con 0x7fda2006f890 2024-05-28T06:09:21.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda1d400640 1 -- 172.21.15.122:0/3504834623 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda04003530 con 0x7fda2006f890 2024-05-28T06:09:21.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda1d400640 1 -- 172.21.15.122:0/3504834623 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3202546284 0 0) 0x7fda2015be20 con 0x7fda200cff30 2024-05-28T06:09:21.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda1d400640 1 -- 172.21.15.122:0/3504834623 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda200d0310 con 0x7fda200cff30 2024-05-28T06:09:21.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda1d400640 1 -- 172.21.15.122:0/3504834623 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2410570454 0 0) 0x7fda04003530 con 0x7fda2006f890 2024-05-28T06:09:21.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda1d400640 1 -- 172.21.15.122:0/3504834623 >> v2:172.21.15.153:3300/0 conn(0x7fda200b59c0 msgr2=0x7fda200cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:21.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda1d400640 1 --2- 172.21.15.122:0/3504834623 >> v2:172.21.15.153:3300/0 conn(0x7fda200b59c0 0x7fda200cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda1d400640 1 -- 172.21.15.122:0/3504834623 >> v1:172.21.15.153:6789/0 conn(0x7fda200cff30 legacy=0x7fda2006f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:21.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda1d400640 1 -- 172.21.15.122:0/3504834623 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda2015c3e0 con 0x7fda2006f890 2024-05-28T06:09:21.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda1d400640 1 -- 172.21.15.122:0/3504834623 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7fda08001a00 con 0x7fda2006f890 2024-05-28T06:09:21.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda1d400640 1 -- 172.21.15.122:0/3504834623 >> v1:172.21.15.122:6789/0 conn(0x7fda2006f890 legacy=0x7fda200cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:21.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda1d400640 1 --2- 172.21.15.122:0/3504834623 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda04003b50 0x7fda04003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:21.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda1d400640 1 --2- 172.21.15.122:0/3504834623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda04004810 0x7fda04004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:21.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda1d400640 1 --2- 172.21.15.122:0/3504834623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda040051d0 0x7fda0400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:21.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda1d400640 1 -- 172.21.15.122:0/3504834623 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fda2015c100 con 0x7fda04004810 2024-05-28T06:09:21.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda1d400640 1 -- 172.21.15.122:0/3504834623 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fda0400c050 con 0x7fda040051d0 2024-05-28T06:09:21.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda1d400640 1 -- 172.21.15.122:0/3504834623 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fda0400c250 con 0x7fda04003b50 2024-05-28T06:09:21.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda15400640 1 --2- 172.21.15.122:0/3504834623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda04004810 0x7fda04004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:21.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda1de00640 1 --2- 172.21.15.122:0/3504834623 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda04003b50 0x7fda04003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:21.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda1e800640 1 --2- 172.21.15.122:0/3504834623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda040051d0 0x7fda0400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:21.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda15400640 1 -- 172.21.15.122:0/3504834623 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda04003b50 msgr2=0x7fda04003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:21.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda15400640 1 --2- 172.21.15.122:0/3504834623 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda04003b50 0x7fda04003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda15400640 1 -- 172.21.15.122:0/3504834623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda040051d0 msgr2=0x7fda0400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:21.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda15400640 1 --2- 172.21.15.122:0/3504834623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda040051d0 0x7fda0400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda15400640 1 -- 172.21.15.122:0/3504834623 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda04003530 con 0x7fda04004810 2024-05-28T06:09:21.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda1e800640 1 --2- 172.21.15.122:0/3504834623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda040051d0 0x7fda0400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:09:21.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.716+0000 7fda1e800640 1 -- 172.21.15.122:0/3504834623 reap_dead start 2024-05-28T06:09:21.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.720+0000 7fda15400640 1 --2- 172.21.15.122:0/3504834623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda04004810 0x7fda04004c90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fda0800a7e0 tx=0x7fda0801d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac27a13a0b19e03 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:21.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.720+0000 7fda1d400640 1 -- 172.21.15.122:0/3504834623 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0800a430 con 0x7fda04004810 2024-05-28T06:09:21.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.720+0000 7fda1d400640 1 -- 172.21.15.122:0/3504834623 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda080ad650 con 0x7fda04004810 2024-05-28T06:09:21.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.720+0000 7fda1d400640 1 -- 172.21.15.122:0/3504834623 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda080ada80 con 0x7fda04004810 2024-05-28T06:09:21.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.720+0000 7fda25000640 1 -- 172.21.15.122:0/3504834623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda04004810 msgr2=0x7fda04004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:21.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.720+0000 7fda25000640 1 --2- 172.21.15.122:0/3504834623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda04004810 0x7fda04004c90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fda0800a7e0 tx=0x7fda0801d2c0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.720+0000 7fda25000640 1 -- 172.21.15.122:0/3504834623 shutdown_connections 2024-05-28T06:09:21.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.720+0000 7fda25000640 1 --2- 172.21.15.122:0/3504834623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda04004810 0x7fda04004c90 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.720+0000 7fda25000640 1 -- 172.21.15.122:0/3504834623 >> 172.21.15.122:0/3504834623 conn(0x7fda2006bd90 msgr2=0x7fda2006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:21.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.720+0000 7fda25000640 1 -- 172.21.15.122:0/3504834623 shutdown_connections 2024-05-28T06:09:21.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.720+0000 7fda25000640 1 -- 172.21.15.122:0/3504834623 wait complete. 2024-05-28T06:09:21.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.720+0000 7fda25000640 1 Processor -- start 2024-05-28T06:09:21.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.720+0000 7fda25000640 1 -- start start 2024-05-28T06:09:21.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.720+0000 7fda25000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda04004810 0x7fda200b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:21.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.720+0000 7fda25000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda201f12d0 0x7fda2014af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:21.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.720+0000 7fda25000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda200b2450 0x7fda200b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:21.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.720+0000 7fda25000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fda200cd3f0 con 0x7fda201f12d0 2024-05-28T06:09:21.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.720+0000 7fda25000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fda2015baf0 con 0x7fda200b2450 2024-05-28T06:09:21.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.720+0000 7fda25000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fda200cd570 con 0x7fda04004810 2024-05-28T06:09:21.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.724+0000 7fda15400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda201f12d0 0x7fda2014af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:21.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.724+0000 7fda15400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda201f12d0 0x7fda2014af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40734/0 (socket says 172.21.15.122:40734) 2024-05-28T06:09:21.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.724+0000 7fda15400640 1 -- 172.21.15.122:0/1089590768 learned_addr learned my addr 172.21.15.122:0/1089590768 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:21.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.724+0000 7fda1de00640 1 --2- 172.21.15.122:0/1089590768 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda04004810 0x7fda200b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:21.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.724+0000 7fda1e800640 1 --2- 172.21.15.122:0/1089590768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda200b2450 0x7fda200b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:21.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.724+0000 7fda15400640 1 -- 172.21.15.122:0/1089590768 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda04004810 msgr2=0x7fda200b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:21.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.724+0000 7fda15400640 1 --2- 172.21.15.122:0/1089590768 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda04004810 0x7fda200b0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.724+0000 7fda15400640 1 -- 172.21.15.122:0/1089590768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda200b2450 msgr2=0x7fda200b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:21.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.724+0000 7fda15400640 1 --2- 172.21.15.122:0/1089590768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda200b2450 0x7fda200b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.724+0000 7fda15400640 1 -- 172.21.15.122:0/1089590768 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda200b0710 con 0x7fda201f12d0 2024-05-28T06:09:21.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.724+0000 7fda15400640 1 --2- 172.21.15.122:0/1089590768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda201f12d0 0x7fda2014af00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fda08001c80 tx=0x7fda04005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:21.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.724+0000 7fda16a00640 1 -- 172.21.15.122:0/1089590768 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda080bb070 con 0x7fda201f12d0 2024-05-28T06:09:21.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.724+0000 7fda16a00640 1 -- 172.21.15.122:0/1089590768 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda080ad430 con 0x7fda201f12d0 2024-05-28T06:09:21.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.724+0000 7fda25000640 1 -- 172.21.15.122:0/1089590768 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda200b09f0 con 0x7fda201f12d0 2024-05-28T06:09:21.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.724+0000 7fda16a00640 1 -- 172.21.15.122:0/1089590768 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda08001a00 con 0x7fda201f12d0 2024-05-28T06:09:21.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.724+0000 7fda25000640 1 -- 172.21.15.122:0/1089590768 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda200b0fb0 con 0x7fda201f12d0 2024-05-28T06:09:21.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.724+0000 7fda25000640 1 -- 172.21.15.122:0/1089590768 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda20068c40 con 0x7fda201f12d0 2024-05-28T06:09:21.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.724+0000 7fda16a00640 1 -- 172.21.15.122:0/1089590768 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7fda080be070 con 0x7fda201f12d0 2024-05-28T06:09:21.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.724+0000 7fda16a00640 1 --2- 172.21.15.122:0/1089590768 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd9fc068650 0x7fd9fc06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:21.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.728+0000 7fda16a00640 1 -- 172.21.15.122:0/1089590768 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5765+0+0 (secure 0 0 0) 0x7fda081210f0 con 0x7fda201f12d0 2024-05-28T06:09:21.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.728+0000 7fda1de00640 1 --2- 172.21.15.122:0/1089590768 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd9fc068650 0x7fd9fc06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:21.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.728+0000 7fda1de00640 1 --2- 172.21.15.122:0/1089590768 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd9fc068650 0x7fd9fc06ab10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fda10005630 tx=0x7fda10009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:21.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.732+0000 7fda16a00640 1 -- 172.21.15.122:0/1089590768 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fda08016fd0 con 0x7fda201f12d0 2024-05-28T06:09:21.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.928+0000 7fda25000640 1 -- 172.21.15.122:0/1089590768 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda200cdec0 con 0x7fda201f12d0 2024-05-28T06:09:21.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.928+0000 7fda16a00640 1 -- 172.21.15.122:0/1089590768 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5190 (secure 0 0 0) 0x7fda080f11d0 con 0x7fda201f12d0 2024-05-28T06:09:21.931 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:21.932 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1943879237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1943879237},{"type":"v1","addr":"172.21.15.153:6834","nonce":1943879237}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1104849441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1104849441},{"type":"v1","addr":"172.21.15.153:6835","nonce":1104849441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/560614408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":560614408},{"type":"v1","addr":"172.21.15.122:6835","nonce":560614408}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-28T06:06:49.284485+0000","modified":"2024-05-28T06:06:52.295560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1698676182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1698676182},{"type":"v1","addr":"172.21.15.122:6837","nonce":1698676182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5082,"qdb_cluster":[5082]},"id":2}]} 2024-05-28T06:09:21.933 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 19 2024-05-28T06:09:21.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.928+0000 7fda25000640 1 -- 172.21.15.122:0/1089590768 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd9fc068650 msgr2=0x7fd9fc06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:21.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.928+0000 7fda25000640 1 --2- 172.21.15.122:0/1089590768 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd9fc068650 0x7fd9fc06ab10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fda10005630 tx=0x7fda10009040 comp rx=0 tx=0).stop 2024-05-28T06:09:21.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.928+0000 7fda25000640 1 -- 172.21.15.122:0/1089590768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda201f12d0 msgr2=0x7fda2014af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:21.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.928+0000 7fda25000640 1 --2- 172.21.15.122:0/1089590768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda201f12d0 0x7fda2014af00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fda08001c80 tx=0x7fda04005840 comp rx=0 tx=0).stop 2024-05-28T06:09:21.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.928+0000 7fda25000640 1 -- 172.21.15.122:0/1089590768 shutdown_connections 2024-05-28T06:09:21.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.928+0000 7fda25000640 1 --2- 172.21.15.122:0/1089590768 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd9fc068650 0x7fd9fc06ab10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.928+0000 7fda25000640 1 --2- 172.21.15.122:0/1089590768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda200b2450 0x7fda200b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.928+0000 7fda25000640 1 --2- 172.21.15.122:0/1089590768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda201f12d0 0x7fda2014af00 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.928+0000 7fda25000640 1 --2- 172.21.15.122:0/1089590768 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda04004810 0x7fda200b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:21.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.928+0000 7fda25000640 1 -- 172.21.15.122:0/1089590768 >> 172.21.15.122:0/1089590768 conn(0x7fda2006bd90 msgr2=0x7fda2015aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:21.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.928+0000 7fda25000640 1 -- 172.21.15.122:0/1089590768 shutdown_connections 2024-05-28T06:09:21.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:21.928+0000 7fda25000640 1 -- 172.21.15.122:0/1089590768 wait complete. 2024-05-28T06:09:21.952 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:09:22.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.084+0000 7f8a30a00640 1 Processor -- start 2024-05-28T06:09:22.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.084+0000 7f8a30a00640 1 -- start start 2024-05-28T06:09:22.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.084+0000 7f8a30a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a2c0b58d0 0x7f8a2c0b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:22.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.084+0000 7f8a30a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8a2c0ce4f0 0x7f8a2c0ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:22.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.084+0000 7f8a30a00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a2c0b61f0 con 0x7f8a2c0722a0 2024-05-28T06:09:22.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.084+0000 7f8a30a00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f8a2c15d970 con 0x7f8a2c0ce4f0 2024-05-28T06:09:22.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.084+0000 7f8a30a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8a2c15dc50 con 0x7f8a2c0b58d0 2024-05-28T06:09:22.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.084+0000 7f8a21400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8a2c0ce4f0 0x7f8a2c0ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:22.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.084+0000 7f8a2a800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f8a2c0722a0 0x7f8a2c072730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:51584/0 (socket says 172.21.15.122:51584) 2024-05-28T06:09:22.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.084+0000 7f8a2a800640 1 -- 172.21.15.122:0/3262858971 learned_addr learned my addr 172.21.15.122:0/3262858971 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:22.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.088+0000 7f8a29e00640 1 --2- 172.21.15.122:0/3262858971 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a2c0b58d0 0x7f8a2c0b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:22.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.088+0000 7f8a21400640 1 -- 172.21.15.122:0/3262858971 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a2c0b58d0 msgr2=0x7f8a2c0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:22.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.088+0000 7f8a21400640 1 --2- 172.21.15.122:0/3262858971 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a2c0b58d0 0x7f8a2c0b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:22.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.088+0000 7f8a21400640 1 -- 172.21.15.122:0/3262858971 >> v1:172.21.15.122:6789/0 conn(0x7f8a2c0722a0 legacy=0x7f8a2c072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:22.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.088+0000 7f8a21400640 1 -- 172.21.15.122:0/3262858971 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2c15df30 con 0x7f8a2c0ce4f0 2024-05-28T06:09:22.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.088+0000 7f8a29400640 1 -- 172.21.15.122:0/3262858971 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1347647312 0 0) 0x7f8a2c0b61f0 con 0x7f8a2c0722a0 2024-05-28T06:09:22.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.088+0000 7f8a21400640 1 --2- 172.21.15.122:0/3262858971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a2c0ce4f0 0x7f8a2c0ce950 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8a140097c0 tx=0x7f8a1401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b784d69a0640ce2 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:22.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.088+0000 7f8a29400640 1 -- 172.21.15.122:0/3262858971 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a140ab610 con 0x7f8a2c0ce4f0 2024-05-28T06:09:22.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.088+0000 7f8a29400640 1 -- 172.21.15.122:0/3262858971 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a140b0070 con 0x7f8a2c0ce4f0 2024-05-28T06:09:22.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.088+0000 7f8a29400640 1 -- 172.21.15.122:0/3262858971 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a140ab9d0 con 0x7f8a2c0ce4f0 2024-05-28T06:09:22.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.088+0000 7f8a30a00640 1 -- 172.21.15.122:0/3262858971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a2c0ce4f0 msgr2=0x7f8a2c0ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:22.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.088+0000 7f8a30a00640 1 --2- 172.21.15.122:0/3262858971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a2c0ce4f0 0x7f8a2c0ce950 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8a140097c0 tx=0x7f8a1401c470 comp rx=0 tx=0).stop 2024-05-28T06:09:22.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a30a00640 1 -- 172.21.15.122:0/3262858971 shutdown_connections 2024-05-28T06:09:22.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a30a00640 1 --2- 172.21.15.122:0/3262858971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a2c0ce4f0 0x7f8a2c0ce950 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:22.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a30a00640 1 --2- 172.21.15.122:0/3262858971 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a2c0b58d0 0x7f8a2c0b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:22.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a30a00640 1 -- 172.21.15.122:0/3262858971 >> 172.21.15.122:0/3262858971 conn(0x7f8a2c06bd90 msgr2=0x7f8a2c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:22.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a30a00640 1 -- 172.21.15.122:0/3262858971 shutdown_connections 2024-05-28T06:09:22.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a30a00640 1 -- 172.21.15.122:0/3262858971 wait complete. 2024-05-28T06:09:22.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a30a00640 1 Processor -- start 2024-05-28T06:09:22.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a30a00640 1 -- start start 2024-05-28T06:09:22.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a30a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a2c0722a0 0x7f8a2c0b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:22.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a30a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a2c0b58d0 0x7f8a2c143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:22.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a30a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a2c0ce4f0 0x7f8a2c13a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:22.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a30a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c0cf010 con 0x7f8a2c0ce4f0 2024-05-28T06:09:22.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a30a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c0cee90 con 0x7f8a2c0b58d0 2024-05-28T06:09:22.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a30a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8a2c169a60 con 0x7f8a2c0722a0 2024-05-28T06:09:22.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a2a800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a2c0ce4f0 0x7f8a2c13a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:22.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a2a800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a2c0ce4f0 0x7f8a2c13a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40764/0 (socket says 172.21.15.122:40764) 2024-05-28T06:09:22.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a2a800640 1 -- 172.21.15.122:0/3705117423 learned_addr learned my addr 172.21.15.122:0/3705117423 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:22.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a21400640 1 --2- 172.21.15.122:0/3705117423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a2c0b58d0 0x7f8a2c143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:22.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a29e00640 1 --2- 172.21.15.122:0/3705117423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a2c0722a0 0x7f8a2c0b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:22.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a2a800640 1 -- 172.21.15.122:0/3705117423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a2c0722a0 msgr2=0x7f8a2c0b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:22.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a2a800640 1 --2- 172.21.15.122:0/3705117423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a2c0722a0 0x7f8a2c0b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:22.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a2a800640 1 -- 172.21.15.122:0/3705117423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a2c0b58d0 msgr2=0x7f8a2c143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:22.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a2a800640 1 --2- 172.21.15.122:0/3705117423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a2c0b58d0 0x7f8a2c143bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:22.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a2a800640 1 -- 172.21.15.122:0/3705117423 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2c141d30 con 0x7f8a2c0ce4f0 2024-05-28T06:09:22.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a2a800640 1 --2- 172.21.15.122:0/3705117423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a2c0ce4f0 0x7f8a2c13a340 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8a2400c7a0 tx=0x7f8a2400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:22.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a22a00640 1 -- 172.21.15.122:0/3705117423 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a24018070 con 0x7f8a2c0ce4f0 2024-05-28T06:09:22.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a22a00640 1 -- 172.21.15.122:0/3705117423 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a2400a640 con 0x7f8a2c0ce4f0 2024-05-28T06:09:22.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a22a00640 1 -- 172.21.15.122:0/3705117423 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2400aab0 con 0x7f8a2c0ce4f0 2024-05-28T06:09:22.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.092+0000 7f8a30a00640 1 -- 172.21.15.122:0/3705117423 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a2c142010 con 0x7f8a2c0ce4f0 2024-05-28T06:09:22.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.096+0000 7f8a30a00640 1 -- 172.21.15.122:0/3705117423 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a2c13a880 con 0x7f8a2c0ce4f0 2024-05-28T06:09:22.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.096+0000 7f8a30a00640 1 -- 172.21.15.122:0/3705117423 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a2c068c40 con 0x7f8a2c0ce4f0 2024-05-28T06:09:22.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.096+0000 7f8a22a00640 1 -- 172.21.15.122:0/3705117423 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f8a2400ac50 con 0x7f8a2c0ce4f0 2024-05-28T06:09:22.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.096+0000 7f8a22a00640 1 --2- 172.21.15.122:0/3705117423 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8a08068650 0x7f8a0806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:22.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.096+0000 7f8a22a00640 1 -- 172.21.15.122:0/3705117423 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5765+0+0 (secure 0 0 0) 0x7f8a240863b0 con 0x7f8a2c0ce4f0 2024-05-28T06:09:22.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.096+0000 7f8a29e00640 1 --2- 172.21.15.122:0/3705117423 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8a08068650 0x7f8a0806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:22.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.096+0000 7f8a29e00640 1 --2- 172.21.15.122:0/3705117423 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8a08068650 0x7f8a0806ab10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c007a60 tx=0x7f8a1c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:22.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.100+0000 7f8a22a00640 1 -- 172.21.15.122:0/3705117423 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8a24055fe0 con 0x7f8a2c0ce4f0 2024-05-28T06:09:22.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.288+0000 7f8a30a00640 1 -- 172.21.15.122:0/3705117423 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a2c13cd30 con 0x7f8a2c0ce4f0 2024-05-28T06:09:22.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.288+0000 7f8a22a00640 1 -- 172.21.15.122:0/3705117423 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5190 (secure 0 0 0) 0x7f8a2405a2e0 con 0x7f8a2c0ce4f0 2024-05-28T06:09:22.294 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:22.294 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1943879237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1943879237},{"type":"v1","addr":"172.21.15.153:6834","nonce":1943879237}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1104849441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1104849441},{"type":"v1","addr":"172.21.15.153:6835","nonce":1104849441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/560614408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":560614408},{"type":"v1","addr":"172.21.15.122:6835","nonce":560614408}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-28T06:06:49.284485+0000","modified":"2024-05-28T06:06:52.295560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1698676182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1698676182},{"type":"v1","addr":"172.21.15.122:6837","nonce":1698676182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5082,"qdb_cluster":[5082]},"id":2}]} 2024-05-28T06:09:22.294 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 19 2024-05-28T06:09:22.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.292+0000 7f8a30a00640 1 -- 172.21.15.122:0/3705117423 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8a08068650 msgr2=0x7f8a0806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:22.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.292+0000 7f8a30a00640 1 --2- 172.21.15.122:0/3705117423 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8a08068650 0x7f8a0806ab10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c007a60 tx=0x7f8a1c008040 comp rx=0 tx=0).stop 2024-05-28T06:09:22.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.292+0000 7f8a30a00640 1 -- 172.21.15.122:0/3705117423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a2c0ce4f0 msgr2=0x7f8a2c13a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:22.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.292+0000 7f8a30a00640 1 --2- 172.21.15.122:0/3705117423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a2c0ce4f0 0x7f8a2c13a340 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8a2400c7a0 tx=0x7f8a2400cc60 comp rx=0 tx=0).stop 2024-05-28T06:09:22.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.292+0000 7f8a30a00640 1 -- 172.21.15.122:0/3705117423 shutdown_connections 2024-05-28T06:09:22.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.292+0000 7f8a30a00640 1 --2- 172.21.15.122:0/3705117423 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8a08068650 0x7f8a0806ab10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:22.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.292+0000 7f8a30a00640 1 --2- 172.21.15.122:0/3705117423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a2c0ce4f0 0x7f8a2c13a340 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:22.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.292+0000 7f8a30a00640 1 --2- 172.21.15.122:0/3705117423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a2c0b58d0 0x7f8a2c143bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:22.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.292+0000 7f8a30a00640 1 --2- 172.21.15.122:0/3705117423 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a2c0722a0 0x7f8a2c0b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:22.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.292+0000 7f8a30a00640 1 -- 172.21.15.122:0/3705117423 >> 172.21.15.122:0/3705117423 conn(0x7f8a2c06bd90 msgr2=0x7f8a2c13c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:22.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.292+0000 7f8a30a00640 1 -- 172.21.15.122:0/3705117423 shutdown_connections 2024-05-28T06:09:22.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.292+0000 7f8a30a00640 1 -- 172.21.15.122:0/3705117423 wait complete. 2024-05-28T06:09:22.316 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:09:22.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f7073800640 1 Processor -- start 2024-05-28T06:09:22.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f7073800640 1 -- start start 2024-05-28T06:09:22.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f7073800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f706c0ce4f0 0x7f706c0ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:22.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f7073800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f706c15d970 con 0x7f706c15e730 2024-05-28T06:09:22.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f7073800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f706c15dc50 con 0x7f706c0b58d0 2024-05-28T06:09:22.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f7073800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f706c15df30 con 0x7f706c0ce4f0 2024-05-28T06:09:22.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f7071800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f706c15e730 0x7f706c15eba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:51590/0 (socket says 172.21.15.122:51590) 2024-05-28T06:09:22.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f7071800640 1 -- 172.21.15.122:0/1687487490 learned_addr learned my addr 172.21.15.122:0/1687487490 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:22.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f706be00640 1 --2- 172.21.15.122:0/1687487490 >> v2:172.21.15.153:3300/0 conn(0x7f706c0ce4f0 0x7f706c0ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:22.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f706b400640 1 -- 172.21.15.122:0/1687487490 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3727762494 0 0) 0x7f706c15d970 con 0x7f706c15e730 2024-05-28T06:09:22.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f706b400640 1 -- 172.21.15.122:0/1687487490 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7050003530 con 0x7f706c15e730 2024-05-28T06:09:22.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f706b400640 1 -- 172.21.15.122:0/1687487490 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 574235897 0 0) 0x7f706c15dc50 con 0x7f706c0b58d0 2024-05-28T06:09:22.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f706b400640 1 -- 172.21.15.122:0/1687487490 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f706c15d970 con 0x7f706c0b58d0 2024-05-28T06:09:22.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f706b400640 1 -- 172.21.15.122:0/1687487490 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2289405812 0 0) 0x7f7050003530 con 0x7f706c15e730 2024-05-28T06:09:22.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f706b400640 1 -- 172.21.15.122:0/1687487490 >> v2:172.21.15.153:3300/0 conn(0x7f706c0ce4f0 msgr2=0x7f706c0ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:22.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f706b400640 1 --2- 172.21.15.122:0/1687487490 >> v2:172.21.15.153:3300/0 conn(0x7f706c0ce4f0 0x7f706c0ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:22.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f706b400640 1 -- 172.21.15.122:0/1687487490 >> v1:172.21.15.153:6789/0 conn(0x7f706c0b58d0 legacy=0x7f706c0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:22.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f706b400640 1 -- 172.21.15.122:0/1687487490 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f706c15e210 con 0x7f706c15e730 2024-05-28T06:09:22.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f706b400640 1 -- 172.21.15.122:0/1687487490 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f7064001980 con 0x7f706c15e730 2024-05-28T06:09:22.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f706be00640 1 --2- 172.21.15.122:0/1687487490 >> v2:172.21.15.153:3300/0 conn(0x7f706c0ce4f0 0x7f706c0ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:09:22.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f706b400640 1 -- 172.21.15.122:0/1687487490 >> v1:172.21.15.122:6789/0 conn(0x7f706c15e730 legacy=0x7f706c15eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:22.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f706b400640 1 --2- 172.21.15.122:0/1687487490 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7050003b50 0x7f7050003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:22.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f706b400640 1 --2- 172.21.15.122:0/1687487490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7050004810 0x7f7050004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:22.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f706b400640 1 --2- 172.21.15.122:0/1687487490 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70500051d0 0x7f705000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:22.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f706b400640 1 -- 172.21.15.122:0/1687487490 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f706c15df30 con 0x7f7050003b50 2024-05-28T06:09:22.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f706b400640 1 -- 172.21.15.122:0/1687487490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f705000c050 con 0x7f7050004810 2024-05-28T06:09:22.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.452+0000 7f706b400640 1 -- 172.21.15.122:0/1687487490 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f705000c250 con 0x7f70500051d0 2024-05-28T06:09:22.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.456+0000 7f7070e00640 1 --2- 172.21.15.122:0/1687487490 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7050003b50 0x7f7050003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:22.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.456+0000 7f706be00640 1 --2- 172.21.15.122:0/1687487490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7050004810 0x7f7050004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:22.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.456+0000 7f7071800640 1 --2- 172.21.15.122:0/1687487490 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70500051d0 0x7f705000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:22.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.456+0000 7f7070e00640 1 -- 172.21.15.122:0/1687487490 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70500051d0 msgr2=0x7f705000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:22.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.456+0000 7f7070e00640 1 --2- 172.21.15.122:0/1687487490 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70500051d0 0x7f705000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:22.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.456+0000 7f7070e00640 1 -- 172.21.15.122:0/1687487490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7050004810 msgr2=0x7f7050004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:22.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.456+0000 7f7070e00640 1 --2- 172.21.15.122:0/1687487490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7050004810 0x7f7050004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:22.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.456+0000 7f7070e00640 1 -- 172.21.15.122:0/1687487490 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7050003530 con 0x7f7050003b50 2024-05-28T06:09:22.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.456+0000 7f7071800640 1 --2- 172.21.15.122:0/1687487490 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70500051d0 0x7f705000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:09:22.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.456+0000 7f7071800640 1 -- 172.21.15.122:0/1687487490 reap_dead start 2024-05-28T06:09:22.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.456+0000 7f7070e00640 1 --2- 172.21.15.122:0/1687487490 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7050003b50 0x7f7050003f50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f70540018d0 tx=0x7f705401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2755ac22366af9 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:22.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.456+0000 7f706b400640 1 -- 172.21.15.122:0/1687487490 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7054001520 con 0x7f7050003b50 2024-05-28T06:09:22.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.456+0000 7f706b400640 1 -- 172.21.15.122:0/1687487490 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70540052f0 con 0x7f7050003b50 2024-05-28T06:09:22.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.456+0000 7f706b400640 1 -- 172.21.15.122:0/1687487490 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7054003840 con 0x7f7050003b50 2024-05-28T06:09:22.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.456+0000 7f7073800640 1 -- 172.21.15.122:0/1687487490 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7050003b50 msgr2=0x7f7050003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:22.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.456+0000 7f7073800640 1 --2- 172.21.15.122:0/1687487490 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7050003b50 0x7f7050003f50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f70540018d0 tx=0x7f705401c560 comp rx=0 tx=0).stop 2024-05-28T06:09:22.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f7073800640 1 -- 172.21.15.122:0/1687487490 shutdown_connections 2024-05-28T06:09:22.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f7073800640 1 --2- 172.21.15.122:0/1687487490 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7050003b50 0x7f7050003f50 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:22.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f7073800640 1 -- 172.21.15.122:0/1687487490 >> 172.21.15.122:0/1687487490 conn(0x7f706c06bd90 msgr2=0x7f706c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:22.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f7073800640 1 -- 172.21.15.122:0/1687487490 shutdown_connections 2024-05-28T06:09:22.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f7073800640 1 -- 172.21.15.122:0/1687487490 wait complete. 2024-05-28T06:09:22.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f7073800640 1 Processor -- start 2024-05-28T06:09:22.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f7073800640 1 -- start start 2024-05-28T06:09:22.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f7073800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7050003b50 0x7f706c0ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:22.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f7073800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f706c1ec950 0x7f706c1ea160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:22.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f7073800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f706c0aeb40 0x7f706c0aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:22.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f7073800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f706c072420 con 0x7f7050003b50 2024-05-28T06:09:22.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f7073800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f706c0722a0 con 0x7f706c1ec950 2024-05-28T06:09:22.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f7073800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f706c0725a0 con 0x7f706c0aeb40 2024-05-28T06:09:22.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f7070e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7050003b50 0x7f706c0ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:22.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f7070e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7050003b50 0x7f706c0ccdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40776/0 (socket says 172.21.15.122:40776) 2024-05-28T06:09:22.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f7070e00640 1 -- 172.21.15.122:0/6578608 learned_addr learned my addr 172.21.15.122:0/6578608 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:22.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f706be00640 1 --2- 172.21.15.122:0/6578608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f706c1ec950 0x7f706c1ea160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:22.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f7071800640 1 --2- 172.21.15.122:0/6578608 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f706c0aeb40 0x7f706c0aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:22.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f7070e00640 1 -- 172.21.15.122:0/6578608 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f706c0aeb40 msgr2=0x7f706c0aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:22.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f7070e00640 1 --2- 172.21.15.122:0/6578608 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f706c0aeb40 0x7f706c0aefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:22.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f7070e00640 1 -- 172.21.15.122:0/6578608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f706c1ec950 msgr2=0x7f706c1ea160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:22.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f7070e00640 1 --2- 172.21.15.122:0/6578608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f706c1ec950 0x7f706c1ea160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:22.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f7070e00640 1 -- 172.21.15.122:0/6578608 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f706c1eaa60 con 0x7f7050003b50 2024-05-28T06:09:22.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.460+0000 7f7070e00640 1 --2- 172.21.15.122:0/6578608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7050003b50 0x7f706c0ccdc0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f705401c390 tx=0x7f7050005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:22.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.464+0000 7f7068c00640 1 -- 172.21.15.122:0/6578608 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70540054a0 con 0x7f7050003b50 2024-05-28T06:09:22.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.464+0000 7f7068c00640 1 -- 172.21.15.122:0/6578608 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7054001500 con 0x7f7050003b50 2024-05-28T06:09:22.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.464+0000 7f7068c00640 1 -- 172.21.15.122:0/6578608 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7054003de0 con 0x7f7050003b50 2024-05-28T06:09:22.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.464+0000 7f7073800640 1 -- 172.21.15.122:0/6578608 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f706c1ead40 con 0x7f7050003b50 2024-05-28T06:09:22.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.464+0000 7f7073800640 1 -- 172.21.15.122:0/6578608 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f706c1f83f0 con 0x7f7050003b50 2024-05-28T06:09:22.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.464+0000 7f7073800640 1 -- 172.21.15.122:0/6578608 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f706c068c40 con 0x7f7050003b50 2024-05-28T06:09:22.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.464+0000 7f7068c00640 1 -- 172.21.15.122:0/6578608 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f70540067e0 con 0x7f7050003b50 2024-05-28T06:09:22.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.464+0000 7f7068c00640 1 --2- 172.21.15.122:0/6578608 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7048068650 0x7f704806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:22.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.464+0000 7f7068c00640 1 -- 172.21.15.122:0/6578608 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5765+0+0 (secure 0 0 0) 0x7f70541212a0 con 0x7f7050003b50 2024-05-28T06:09:22.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.464+0000 7f706be00640 1 --2- 172.21.15.122:0/6578608 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7048068650 0x7f704806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:22.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.464+0000 7f706be00640 1 --2- 172.21.15.122:0/6578608 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7048068650 0x7f704806ab10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f706c02db60 tx=0x7f705c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:22.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.468+0000 7f7068c00640 1 -- 172.21.15.122:0/6578608 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f70540bb020 con 0x7f7050003b50 2024-05-28T06:09:22.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.632+0000 7f7073800640 1 -- 172.21.15.122:0/6578608 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f706c144e30 con 0x7f7050003b50 2024-05-28T06:09:22.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.632+0000 7f7068c00640 1 -- 172.21.15.122:0/6578608 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16777 (secure 0 0 0) 0x7f7054016270 con 0x7f7050003b50 2024-05-28T06:09:22.638 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:22.638 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":35,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:09:18.389359+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:06:47.799439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-28T06:06:48.236731+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":35,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:09:22.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.636+0000 7f7073800640 1 -- 172.21.15.122:0/6578608 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7048068650 msgr2=0x7f704806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:22.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.636+0000 7f7073800640 1 --2- 172.21.15.122:0/6578608 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7048068650 0x7f704806ab10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f706c02db60 tx=0x7f705c008040 comp rx=0 tx=0).stop 2024-05-28T06:09:22.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.636+0000 7f7073800640 1 -- 172.21.15.122:0/6578608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7050003b50 msgr2=0x7f706c0ccdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:22.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.636+0000 7f7073800640 1 --2- 172.21.15.122:0/6578608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7050003b50 0x7f706c0ccdc0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f705401c390 tx=0x7f7050005840 comp rx=0 tx=0).stop 2024-05-28T06:09:22.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.636+0000 7f7073800640 1 -- 172.21.15.122:0/6578608 shutdown_connections 2024-05-28T06:09:22.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.636+0000 7f7073800640 1 --2- 172.21.15.122:0/6578608 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7048068650 0x7f704806ab10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:22.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.636+0000 7f7073800640 1 --2- 172.21.15.122:0/6578608 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f706c0aeb40 0x7f706c0aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:22.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.636+0000 7f7073800640 1 --2- 172.21.15.122:0/6578608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f706c1ec950 0x7f706c1ea160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:22.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.636+0000 7f7073800640 1 --2- 172.21.15.122:0/6578608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7050003b50 0x7f706c0ccdc0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:22.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.636+0000 7f7073800640 1 -- 172.21.15.122:0/6578608 >> 172.21.15.122:0/6578608 conn(0x7f706c06bd90 msgr2=0x7f706c145350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:22.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.636+0000 7f7073800640 1 -- 172.21.15.122:0/6578608 shutdown_connections 2024-05-28T06:09:22.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.636+0000 7f7073800640 1 -- 172.21.15.122:0/6578608 wait complete. 2024-05-28T06:09:22.660 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-28T06:09:22.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.792+0000 7ff6efe00640 1 Processor -- start 2024-05-28T06:09:22.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.792+0000 7ff6efe00640 1 -- start start 2024-05-28T06:09:22.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.796+0000 7ff6efe00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff6e80cec70 0x7ff6e8146010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:22.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.796+0000 7ff6efe00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6e806f7e0 con 0x7ff6e8145b80 2024-05-28T06:09:22.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.796+0000 7ff6efe00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6e806e030 con 0x7ff6e8142d30 2024-05-28T06:09:22.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.796+0000 7ff6efe00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7ff6e806ec40 con 0x7ff6e80cec70 2024-05-28T06:09:22.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.796+0000 7ff6ede00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff6e80cec70 0x7ff6e8146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:22.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.796+0000 7ff6ede00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff6e80cec70 0x7ff6e8146010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40788/0 (socket says 172.21.15.122:40788) 2024-05-28T06:09:22.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.796+0000 7ff6ede00640 1 -- 172.21.15.122:0/4187300013 learned_addr learned my addr 172.21.15.122:0/4187300013 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:22.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.796+0000 7ff6eca00640 1 --1- 172.21.15.122:0/4187300013 >> v1:172.21.15.122:6789/0 conn(0x7ff6e8145b80 0x7ff6e80ce560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:51598/0 (socket says 172.21.15.122:51598) 2024-05-28T06:09:22.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.796+0000 7ff6ede00640 1 -- 172.21.15.122:0/4187300013 >> v1:172.21.15.153:6789/0 conn(0x7ff6e8142d30 legacy=0x7ff6e806f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:22.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.796+0000 7ff6ede00640 1 -- 172.21.15.122:0/4187300013 >> v1:172.21.15.122:6789/0 conn(0x7ff6e8145b80 legacy=0x7ff6e80ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:22.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.796+0000 7ff6ede00640 1 -- 172.21.15.122:0/4187300013 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e806e310 con 0x7ff6e80cec70 2024-05-28T06:09:22.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.796+0000 7ff6e7e00640 1 -- 172.21.15.122:0/4187300013 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3640847492 0 0) 0x7ff6e806f7e0 con 0x7ff6e8145b80 2024-05-28T06:09:22.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.800+0000 7ff6ede00640 1 --2- 172.21.15.122:0/4187300013 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6e80cec70 0x7ff6e8146010 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0009e50 tx=0x7ff6e001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8895973207dc6f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:22.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.800+0000 7ff6e7e00640 1 -- 172.21.15.122:0/4187300013 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e00a5830 con 0x7ff6e80cec70 2024-05-28T06:09:22.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.800+0000 7ff6e7e00640 1 -- 172.21.15.122:0/4187300013 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e00a59d0 con 0x7ff6e80cec70 2024-05-28T06:09:22.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.800+0000 7ff6e7e00640 1 -- 172.21.15.122:0/4187300013 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e00a5da0 con 0x7ff6e80cec70 2024-05-28T06:09:22.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.800+0000 7ff6efe00640 1 -- 172.21.15.122:0/4187300013 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6e80cec70 msgr2=0x7ff6e8146010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:22.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.800+0000 7ff6efe00640 1 --2- 172.21.15.122:0/4187300013 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6e80cec70 0x7ff6e8146010 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0009e50 tx=0x7ff6e001c970 comp rx=0 tx=0).stop 2024-05-28T06:09:22.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.800+0000 7ff6efe00640 1 -- 172.21.15.122:0/4187300013 shutdown_connections 2024-05-28T06:09:22.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.800+0000 7ff6efe00640 1 --2- 172.21.15.122:0/4187300013 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6e80cec70 0x7ff6e8146010 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:22.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.800+0000 7ff6efe00640 1 -- 172.21.15.122:0/4187300013 >> 172.21.15.122:0/4187300013 conn(0x7ff6e8062a40 msgr2=0x7ff6e806b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:22.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.800+0000 7ff6efe00640 1 -- 172.21.15.122:0/4187300013 shutdown_connections 2024-05-28T06:09:22.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.800+0000 7ff6efe00640 1 -- 172.21.15.122:0/4187300013 wait complete. 2024-05-28T06:09:22.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.800+0000 7ff6efe00640 1 Processor -- start 2024-05-28T06:09:22.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.800+0000 7ff6efe00640 1 -- start start 2024-05-28T06:09:22.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.800+0000 7ff6efe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6e80cec70 0x7ff6e80ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:22.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.800+0000 7ff6efe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6e8142d30 0x7ff6e81615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:22.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.800+0000 7ff6efe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6e8145b80 0x7ff6e815e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:22.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.800+0000 7ff6efe00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e8143290 con 0x7ff6e8142d30 2024-05-28T06:09:22.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.800+0000 7ff6efe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e8143110 con 0x7ff6e80cec70 2024-05-28T06:09:22.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.800+0000 7ff6efe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e816a840 con 0x7ff6e8145b80 2024-05-28T06:09:22.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.800+0000 7ff6eca00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6e8142d30 0x7ff6e81615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:22.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.804+0000 7ff6eca00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6e8142d30 0x7ff6e81615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40796/0 (socket says 172.21.15.122:40796) 2024-05-28T06:09:22.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.804+0000 7ff6eca00640 1 -- 172.21.15.122:0/2921536974 learned_addr learned my addr 172.21.15.122:0/2921536974 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:22.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.804+0000 7ff6ed400640 1 --2- 172.21.15.122:0/2921536974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6e80cec70 0x7ff6e80ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:22.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.804+0000 7ff6ede00640 1 --2- 172.21.15.122:0/2921536974 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6e8145b80 0x7ff6e815e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:22.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.804+0000 7ff6eca00640 1 -- 172.21.15.122:0/2921536974 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6e8145b80 msgr2=0x7ff6e815e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:22.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.804+0000 7ff6eca00640 1 --2- 172.21.15.122:0/2921536974 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6e8145b80 0x7ff6e815e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:22.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.804+0000 7ff6eca00640 1 -- 172.21.15.122:0/2921536974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6e80cec70 msgr2=0x7ff6e80ae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:22.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.804+0000 7ff6eca00640 1 --2- 172.21.15.122:0/2921536974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6e80cec70 0x7ff6e80ae340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:22.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.804+0000 7ff6eca00640 1 -- 172.21.15.122:0/2921536974 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e80b3320 con 0x7ff6e8142d30 2024-05-28T06:09:22.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.804+0000 7ff6ede00640 1 --2- 172.21.15.122:0/2921536974 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6e8145b80 0x7ff6e815e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:09:22.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.804+0000 7ff6ed400640 1 --2- 172.21.15.122:0/2921536974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6e80cec70 0x7ff6e80ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:09:22.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.804+0000 7ff6eca00640 1 --2- 172.21.15.122:0/2921536974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6e8142d30 0x7ff6e81615e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400c4a0 tx=0x7ff6d400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:22.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.804+0000 7ff6e5600640 1 -- 172.21.15.122:0/2921536974 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4018070 con 0x7ff6e8142d30 2024-05-28T06:09:22.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.804+0000 7ff6e5600640 1 -- 172.21.15.122:0/2921536974 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d40074e0 con 0x7ff6e8142d30 2024-05-28T06:09:22.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.804+0000 7ff6efe00640 1 -- 172.21.15.122:0/2921536974 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e80b3600 con 0x7ff6e8142d30 2024-05-28T06:09:22.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.804+0000 7ff6e5600640 1 -- 172.21.15.122:0/2921536974 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4004a30 con 0x7ff6e8142d30 2024-05-28T06:09:22.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.804+0000 7ff6efe00640 1 -- 172.21.15.122:0/2921536974 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e80b3bc0 con 0x7ff6e8142d30 2024-05-28T06:09:22.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.804+0000 7ff6efe00640 1 -- 172.21.15.122:0/2921536974 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6e8068bd0 con 0x7ff6e8142d30 2024-05-28T06:09:22.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.804+0000 7ff6e5600640 1 -- 172.21.15.122:0/2921536974 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7ff6d401b070 con 0x7ff6e8142d30 2024-05-28T06:09:22.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.804+0000 7ff6e5600640 1 --2- 172.21.15.122:0/2921536974 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff6c8068650 0x7ff6c806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:22.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.804+0000 7ff6e5600640 1 -- 172.21.15.122:0/2921536974 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5765+0+0 (secure 0 0 0) 0x7ff6d40860e0 con 0x7ff6e8142d30 2024-05-28T06:09:22.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.808+0000 7ff6ed400640 1 --2- 172.21.15.122:0/2921536974 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff6c8068650 0x7ff6c806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:22.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.808+0000 7ff6ed400640 1 --2- 172.21.15.122:0/2921536974 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff6c8068650 0x7ff6c806ab10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc000f70 tx=0x7ff6dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:22.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:22.808+0000 7ff6e5600640 1 -- 172.21.15.122:0/2921536974 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff6d40563a0 con 0x7ff6e8142d30 2024-05-28T06:09:23.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.004+0000 7ff6efe00640 1 -- 172.21.15.122:0/2921536974 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff6e80cdd70 con 0x7ff6e8142d30 2024-05-28T06:09:23.008 INFO:tasks.ceph.mon.a.smithi122.stderr:2024-05-28T06:09:23.004+0000 7f3c04000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-28T06:09:23.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.008+0000 7ff6e5600640 1 -- 172.21.15.122:0/2921536974 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) ==== 161+0+0 (secure 0 0 0) 0x7ff6d4055ca0 con 0x7ff6e8142d30 2024-05-28T06:09:23.011 INFO:teuthology.orchestra.run.smithi122.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-28T06:09:23.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.008+0000 7ff6efe00640 1 -- 172.21.15.122:0/2921536974 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff6c8068650 msgr2=0x7ff6c806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:23.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.008+0000 7ff6efe00640 1 --2- 172.21.15.122:0/2921536974 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff6c8068650 0x7ff6c806ab10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc000f70 tx=0x7ff6dc009040 comp rx=0 tx=0).stop 2024-05-28T06:09:23.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.008+0000 7ff6efe00640 1 -- 172.21.15.122:0/2921536974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6e8142d30 msgr2=0x7ff6e81615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:23.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.008+0000 7ff6efe00640 1 --2- 172.21.15.122:0/2921536974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6e8142d30 0x7ff6e81615e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400c4a0 tx=0x7ff6d400c960 comp rx=0 tx=0).stop 2024-05-28T06:09:23.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.008+0000 7ff6efe00640 1 -- 172.21.15.122:0/2921536974 shutdown_connections 2024-05-28T06:09:23.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.008+0000 7ff6efe00640 1 --2- 172.21.15.122:0/2921536974 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff6c8068650 0x7ff6c806ab10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:23.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.008+0000 7ff6efe00640 1 --2- 172.21.15.122:0/2921536974 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff6e8145b80 0x7ff6e815e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:23.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.008+0000 7ff6efe00640 1 --2- 172.21.15.122:0/2921536974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6e8142d30 0x7ff6e81615e0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:23.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.008+0000 7ff6efe00640 1 --2- 172.21.15.122:0/2921536974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6e80cec70 0x7ff6e80ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:23.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.008+0000 7ff6efe00640 1 -- 172.21.15.122:0/2921536974 >> 172.21.15.122:0/2921536974 conn(0x7ff6e8062a40 msgr2=0x7ff6e80b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:23.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.012+0000 7ff6efe00640 1 -- 172.21.15.122:0/2921536974 shutdown_connections 2024-05-28T06:09:23.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.012+0000 7ff6efe00640 1 -- 172.21.15.122:0/2921536974 wait complete. 2024-05-28T06:09:23.036 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-28T06:09:23.080 INFO:tasks.ceph.mds.a.smithi122.stdout:starting mds.a at 2024-05-28T06:09:23.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.172+0000 7efe94a00640 1 Processor -- start 2024-05-28T06:09:23.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.172+0000 7efe94a00640 1 -- start start 2024-05-28T06:09:23.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.176+0000 7efe94a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efe900cff30 0x7efe9006f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:23.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.176+0000 7efe94a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe9006f6c0 0x7efe900cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:23.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.176+0000 7efe94a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe900d0310 con 0x7efe900cd930 2024-05-28T06:09:23.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.176+0000 7efe94a00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7efe9006fb00 con 0x7efe900cff30 2024-05-28T06:09:23.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.176+0000 7efe94a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efe9015be20 con 0x7efe9006f6c0 2024-05-28T06:09:23.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.176+0000 7efe8de00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efe900cff30 0x7efe9006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:23.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.176+0000 7efe8de00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efe900cff30 0x7efe9006f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40824/0 (socket says 172.21.15.122:40824) 2024-05-28T06:09:23.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.176+0000 7efe8de00640 1 -- 172.21.15.122:0/2982441288 learned_addr learned my addr 172.21.15.122:0/2982441288 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:23.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.176+0000 7efe85400640 1 --2- 172.21.15.122:0/2982441288 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe9006f6c0 0x7efe900cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:23.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.176+0000 7efe8de00640 1 -- 172.21.15.122:0/2982441288 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe9006f6c0 msgr2=0x7efe900cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:23.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.176+0000 7efe8de00640 1 --2- 172.21.15.122:0/2982441288 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe9006f6c0 0x7efe900cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:23.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.176+0000 7efe8de00640 1 -- 172.21.15.122:0/2982441288 >> v1:172.21.15.153:6789/0 conn(0x7efe900cd930 legacy=0x7efe900722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:23.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.176+0000 7efe8de00640 1 -- 172.21.15.122:0/2982441288 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9015c100 con 0x7efe900cff30 2024-05-28T06:09:23.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.176+0000 7efe85400640 1 --2- 172.21.15.122:0/2982441288 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe9006f6c0 0x7efe900cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:09:23.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.180+0000 7efe8de00640 1 --2- 172.21.15.122:0/2982441288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe900cff30 0x7efe9006f180 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7efe80009870 tx=0x7efe8001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87df35d6ff14ec10 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:23.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.180+0000 7efe8d400640 1 -- 172.21.15.122:0/2982441288 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe800a95f0 con 0x7efe900cff30 2024-05-28T06:09:23.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.180+0000 7efe8d400640 1 -- 172.21.15.122:0/2982441288 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe800a9790 con 0x7efe900cff30 2024-05-28T06:09:23.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.180+0000 7efe8d400640 1 -- 172.21.15.122:0/2982441288 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe800a9b60 con 0x7efe900cff30 2024-05-28T06:09:23.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.180+0000 7efe94a00640 1 -- 172.21.15.122:0/2982441288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe900cff30 msgr2=0x7efe9006f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:23.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.180+0000 7efe94a00640 1 --2- 172.21.15.122:0/2982441288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe900cff30 0x7efe9006f180 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7efe80009870 tx=0x7efe8001c530 comp rx=0 tx=0).stop 2024-05-28T06:09:23.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.180+0000 7efe94a00640 1 -- 172.21.15.122:0/2982441288 shutdown_connections 2024-05-28T06:09:23.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.180+0000 7efe94a00640 1 --2- 172.21.15.122:0/2982441288 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe9006f6c0 0x7efe900cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:23.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.180+0000 7efe94a00640 1 --2- 172.21.15.122:0/2982441288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe900cff30 0x7efe9006f180 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:23.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.180+0000 7efe94a00640 1 -- 172.21.15.122:0/2982441288 >> 172.21.15.122:0/2982441288 conn(0x7efe9006bd90 msgr2=0x7efe9006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:23.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.180+0000 7efe94a00640 1 -- 172.21.15.122:0/2982441288 shutdown_connections 2024-05-28T06:09:23.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.180+0000 7efe94a00640 1 -- 172.21.15.122:0/2982441288 wait complete. 2024-05-28T06:09:23.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.180+0000 7efe94a00640 1 Processor -- start 2024-05-28T06:09:23.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.180+0000 7efe94a00640 1 -- start start 2024-05-28T06:09:23.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.180+0000 7efe94a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe9006f6c0 0x7efe900b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:23.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.180+0000 7efe94a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe900cd930 0x7efe900aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:23.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.180+0000 7efe94a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe900cff30 0x7efe9006e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:23.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.180+0000 7efe94a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efe900cdec0 con 0x7efe9006f6c0 2024-05-28T06:09:23.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.180+0000 7efe94a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efe900cdd40 con 0x7efe900cff30 2024-05-28T06:09:23.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.180+0000 7efe94a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efe900b59c0 con 0x7efe900cd930 2024-05-28T06:09:23.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.184+0000 7efe8de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe9006f6c0 0x7efe900b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:23.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.184+0000 7efe8de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe9006f6c0 0x7efe900b2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40834/0 (socket says 172.21.15.122:40834) 2024-05-28T06:09:23.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.184+0000 7efe8de00640 1 -- 172.21.15.122:0/1794865211 learned_addr learned my addr 172.21.15.122:0/1794865211 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:23.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.184+0000 7efe8e800640 1 --2- 172.21.15.122:0/1794865211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe900cff30 0x7efe9006e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:23.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.184+0000 7efe85400640 1 --2- 172.21.15.122:0/1794865211 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe900cd930 0x7efe900aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:23.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.184+0000 7efe8de00640 1 -- 172.21.15.122:0/1794865211 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe900cd930 msgr2=0x7efe900aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:23.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.184+0000 7efe8de00640 1 --2- 172.21.15.122:0/1794865211 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe900cd930 0x7efe900aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:23.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.184+0000 7efe8de00640 1 -- 172.21.15.122:0/1794865211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe900cff30 msgr2=0x7efe9006e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:23.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.184+0000 7efe8de00640 1 --2- 172.21.15.122:0/1794865211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe900cff30 0x7efe9006e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:23.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.184+0000 7efe8de00640 1 -- 172.21.15.122:0/1794865211 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9015ae90 con 0x7efe9006f6c0 2024-05-28T06:09:23.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.184+0000 7efe8de00640 1 --2- 172.21.15.122:0/1794865211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe9006f6c0 0x7efe900b2b40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7efe800ab040 tx=0x7efe8001ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:23.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.184+0000 7efe86a00640 1 -- 172.21.15.122:0/1794865211 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe800b1800 con 0x7efe9006f6c0 2024-05-28T06:09:23.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.184+0000 7efe86a00640 1 -- 172.21.15.122:0/1794865211 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe800b19c0 con 0x7efe9006f6c0 2024-05-28T06:09:23.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.184+0000 7efe86a00640 1 -- 172.21.15.122:0/1794865211 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe800b1db0 con 0x7efe9006f6c0 2024-05-28T06:09:23.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.184+0000 7efe94a00640 1 -- 172.21.15.122:0/1794865211 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe900b3080 con 0x7efe9006f6c0 2024-05-28T06:09:23.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.184+0000 7efe94a00640 1 -- 172.21.15.122:0/1794865211 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe9015a0d0 con 0x7efe9006f6c0 2024-05-28T06:09:23.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.184+0000 7efe94a00640 1 -- 172.21.15.122:0/1794865211 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe90068c40 con 0x7efe9006f6c0 2024-05-28T06:09:23.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.184+0000 7efe86a00640 1 -- 172.21.15.122:0/1794865211 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7efe800bc450 con 0x7efe9006f6c0 2024-05-28T06:09:23.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.188+0000 7efe86a00640 1 --2- 172.21.15.122:0/1794865211 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe6c068650 0x7efe6c06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:23.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.188+0000 7efe86a00640 1 -- 172.21.15.122:0/1794865211 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5823+0+0 (secure 0 0 0) 0x7efe80121aa0 con 0x7efe9006f6c0 2024-05-28T06:09:23.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.188+0000 7efe85400640 1 --2- 172.21.15.122:0/1794865211 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe6c068650 0x7efe6c06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:23.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.188+0000 7efe85400640 1 --2- 172.21.15.122:0/1794865211 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe6c068650 0x7efe6c06ab10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efe901fa980 tx=0x7efe78008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:23.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.192+0000 7efe86a00640 1 -- 172.21.15.122:0/1794865211 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efe800ad020 con 0x7efe9006f6c0 2024-05-28T06:09:23.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:23.384+0000 7efe94a00640 1 -- 172.21.15.122:0/1794865211 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7efe90155f70 con 0x7efe9006f6c0 2024-05-28T06:09:24.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.016+0000 7efe86a00640 1 -- 172.21.15.122:0/1794865211 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7efe80016150 con 0x7efe9006f6c0 2024-05-28T06:09:24.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.016+0000 7efe94a00640 1 -- 172.21.15.122:0/1794865211 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe6c068650 msgr2=0x7efe6c06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:24.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.016+0000 7efe94a00640 1 --2- 172.21.15.122:0/1794865211 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe6c068650 0x7efe6c06ab10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efe901fa980 tx=0x7efe78008040 comp rx=0 tx=0).stop 2024-05-28T06:09:24.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.016+0000 7efe94a00640 1 -- 172.21.15.122:0/1794865211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe9006f6c0 msgr2=0x7efe900b2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:24.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.016+0000 7efe94a00640 1 --2- 172.21.15.122:0/1794865211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe9006f6c0 0x7efe900b2b40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7efe800ab040 tx=0x7efe8001ad70 comp rx=0 tx=0).stop 2024-05-28T06:09:24.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.020+0000 7efe94a00640 1 -- 172.21.15.122:0/1794865211 shutdown_connections 2024-05-28T06:09:24.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.020+0000 7efe94a00640 1 --2- 172.21.15.122:0/1794865211 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efe6c068650 0x7efe6c06ab10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:24.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.020+0000 7efe94a00640 1 --2- 172.21.15.122:0/1794865211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe900cff30 0x7efe9006e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:24.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.020+0000 7efe94a00640 1 --2- 172.21.15.122:0/1794865211 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe900cd930 0x7efe900aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:24.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.020+0000 7efe94a00640 1 --2- 172.21.15.122:0/1794865211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe9006f6c0 0x7efe900b2b40 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:24.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.020+0000 7efe94a00640 1 -- 172.21.15.122:0/1794865211 >> 172.21.15.122:0/1794865211 conn(0x7efe9006bd90 msgr2=0x7efe9015e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:24.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.020+0000 7efe94a00640 1 -- 172.21.15.122:0/1794865211 shutdown_connections 2024-05-28T06:09:24.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.020+0000 7efe94a00640 1 -- 172.21.15.122:0/1794865211 wait complete. 2024-05-28T06:09:24.046 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-28T06:09:24.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.228+0000 7f8b18e00640 1 Processor -- start 2024-05-28T06:09:24.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.228+0000 7f8b18e00640 1 -- start start 2024-05-28T06:09:24.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.228+0000 7f8b18e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8b140ce4f0 0x7f8b140ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:24.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.228+0000 7f8b18e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b1415e730 0x7f8b1415ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:24.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.228+0000 7f8b18e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b1415d970 con 0x7f8b140b58d0 2024-05-28T06:09:24.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.228+0000 7f8b18e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8b1415dc50 con 0x7f8b140ce4f0 2024-05-28T06:09:24.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.228+0000 7f8b18e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8b1415df30 con 0x7f8b1415e730 2024-05-28T06:09:24.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.228+0000 7f8b11e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f8b140b58d0 0x7f8b140b5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:51612/0 (socket says 172.21.15.122:51612) 2024-05-28T06:09:24.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.228+0000 7f8b11e00640 1 -- 172.21.15.122:0/2504319006 learned_addr learned my addr 172.21.15.122:0/2504319006 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:24.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.228+0000 7f8b11400640 1 --2- 172.21.15.122:0/2504319006 >> v2:172.21.15.153:3300/0 conn(0x7f8b140ce4f0 0x7f8b140ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:24.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.228+0000 7f8b12800640 1 --2- 172.21.15.122:0/2504319006 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b1415e730 0x7f8b1415ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:24.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.228+0000 7f8b10a00640 1 -- 172.21.15.122:0/2504319006 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3335988553 0 0) 0x7f8b1415d970 con 0x7f8b140b58d0 2024-05-28T06:09:24.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.228+0000 7f8b10a00640 1 -- 172.21.15.122:0/2504319006 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8af8003530 con 0x7f8b140b58d0 2024-05-28T06:09:24.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b10a00640 1 -- 172.21.15.122:0/2504319006 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2189262232 0 0) 0x7f8af8003530 con 0x7f8b140b58d0 2024-05-28T06:09:24.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b10a00640 1 -- 172.21.15.122:0/2504319006 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b1415e730 msgr2=0x7f8b1415ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:24.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b10a00640 1 --2- 172.21.15.122:0/2504319006 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b1415e730 0x7f8b1415ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:24.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b10a00640 1 -- 172.21.15.122:0/2504319006 >> v2:172.21.15.153:3300/0 conn(0x7f8b140ce4f0 msgr2=0x7f8b140ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:24.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b10a00640 1 --2- 172.21.15.122:0/2504319006 >> v2:172.21.15.153:3300/0 conn(0x7f8b140ce4f0 0x7f8b140ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:24.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b10a00640 1 -- 172.21.15.122:0/2504319006 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1415e210 con 0x7f8b140b58d0 2024-05-28T06:09:24.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b10a00640 1 -- 172.21.15.122:0/2504319006 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f8b04001680 con 0x7f8b140b58d0 2024-05-28T06:09:24.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b10a00640 1 -- 172.21.15.122:0/2504319006 >> v1:172.21.15.122:6789/0 conn(0x7f8b140b58d0 legacy=0x7f8b140b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:24.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b10a00640 1 --2- 172.21.15.122:0/2504319006 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b1415e730 0x7f8af80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:24.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b10a00640 1 --2- 172.21.15.122:0/2504319006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8af8003f40 0x7f8af8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:24.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b10a00640 1 --2- 172.21.15.122:0/2504319006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af8004d50 0x7f8af80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:24.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b10a00640 1 -- 172.21.15.122:0/2504319006 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1415dc50 con 0x7f8af8004d50 2024-05-28T06:09:24.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b10a00640 1 -- 172.21.15.122:0/2504319006 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1415df30 con 0x7f8af8003f40 2024-05-28T06:09:24.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b10a00640 1 -- 172.21.15.122:0/2504319006 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8af800b9d0 con 0x7f8b1415e730 2024-05-28T06:09:24.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b12800640 1 --2- 172.21.15.122:0/2504319006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af8004d50 0x7f8af80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:24.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b11e00640 1 --2- 172.21.15.122:0/2504319006 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b1415e730 0x7f8af80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:24.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b11400640 1 --2- 172.21.15.122:0/2504319006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8af8003f40 0x7f8af8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:24.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b12800640 1 -- 172.21.15.122:0/2504319006 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b1415e730 msgr2=0x7f8af80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:24.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b12800640 1 --2- 172.21.15.122:0/2504319006 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b1415e730 0x7f8af80039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:24.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b12800640 1 -- 172.21.15.122:0/2504319006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8af8003f40 msgr2=0x7f8af8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:24.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b12800640 1 --2- 172.21.15.122:0/2504319006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8af8003f40 0x7f8af8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:24.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b12800640 1 -- 172.21.15.122:0/2504319006 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af8003530 con 0x7f8af8004d50 2024-05-28T06:09:24.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b11400640 1 --2- 172.21.15.122:0/2504319006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8af8003f40 0x7f8af8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:09:24.238 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.232+0000 7f8b12800640 1 --2- 172.21.15.122:0/2504319006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af8004d50 0x7f8af80051d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c009fc0 tx=0x7f8b0c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b35e1ce50272ae server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:24.238 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b10a00640 1 -- 172.21.15.122:0/2504319006 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c0b2070 con 0x7f8af8004d50 2024-05-28T06:09:24.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b10a00640 1 -- 172.21.15.122:0/2504319006 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b0c0a5c90 con 0x7f8af8004d50 2024-05-28T06:09:24.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b10a00640 1 -- 172.21.15.122:0/2504319006 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c009c10 con 0x7f8af8004d50 2024-05-28T06:09:24.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b18e00640 1 -- 172.21.15.122:0/2504319006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af8004d50 msgr2=0x7f8af80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:24.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b18e00640 1 --2- 172.21.15.122:0/2504319006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af8004d50 0x7f8af80051d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c009fc0 tx=0x7f8b0c01cc20 comp rx=0 tx=0).stop 2024-05-28T06:09:24.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b12800640 1 -- 172.21.15.122:0/2504319006 reap_dead start 2024-05-28T06:09:24.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b18e00640 1 -- 172.21.15.122:0/2504319006 shutdown_connections 2024-05-28T06:09:24.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b18e00640 1 -- 172.21.15.122:0/2504319006 >> 172.21.15.122:0/2504319006 conn(0x7f8b1406bd90 msgr2=0x7f8b1406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:24.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b18e00640 1 -- 172.21.15.122:0/2504319006 shutdown_connections 2024-05-28T06:09:24.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b18e00640 1 -- 172.21.15.122:0/2504319006 wait complete. 2024-05-28T06:09:24.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b18e00640 1 Processor -- start 2024-05-28T06:09:24.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b18e00640 1 -- start start 2024-05-28T06:09:24.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b18e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af8004d50 0x7f8b1415c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:24.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b18e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b141444c0 0x7f8b14144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:24.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b18e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b140ada50 0x7f8b140aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:24.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b18e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8b140cf040 con 0x7f8af8004d50 2024-05-28T06:09:24.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b18e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8b140ceec0 con 0x7f8b140ada50 2024-05-28T06:09:24.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b18e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8b14146260 con 0x7f8b141444c0 2024-05-28T06:09:24.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b11e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af8004d50 0x7f8b1415c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:24.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b11e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af8004d50 0x7f8b1415c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40842/0 (socket says 172.21.15.122:40842) 2024-05-28T06:09:24.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b11e00640 1 -- 172.21.15.122:0/4291579868 learned_addr learned my addr 172.21.15.122:0/4291579868 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:24.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b11e00640 1 -- 172.21.15.122:0/4291579868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b141444c0 msgr2=0x7f8b14144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:24.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b11e00640 1 --2- 172.21.15.122:0/4291579868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b141444c0 0x7f8b14144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:24.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b11e00640 1 -- 172.21.15.122:0/4291579868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b140ada50 msgr2=0x7f8b140aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:24.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b11e00640 1 --2- 172.21.15.122:0/4291579868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b140ada50 0x7f8b140aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:24.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.236+0000 7f8b11e00640 1 -- 172.21.15.122:0/4291579868 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b140ae410 con 0x7f8af8004d50 2024-05-28T06:09:24.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.240+0000 7f8b11e00640 1 --2- 172.21.15.122:0/4291579868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af8004d50 0x7f8b1415c090 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400e920 tx=0x7f8b0400ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:24.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.240+0000 7f8b0a000640 1 -- 172.21.15.122:0/4291579868 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0400c850 con 0x7f8af8004d50 2024-05-28T06:09:24.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.240+0000 7f8b0a000640 1 -- 172.21.15.122:0/4291579868 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b04018070 con 0x7f8af8004d50 2024-05-28T06:09:24.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.240+0000 7f8b18e00640 1 -- 172.21.15.122:0/4291579868 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b1415c5d0 con 0x7f8af8004d50 2024-05-28T06:09:24.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.240+0000 7f8b0a000640 1 -- 172.21.15.122:0/4291579868 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0400cc10 con 0x7f8af8004d50 2024-05-28T06:09:24.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.240+0000 7f8b18e00640 1 -- 172.21.15.122:0/4291579868 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b140ae9a0 con 0x7f8af8004d50 2024-05-28T06:09:24.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.240+0000 7f8b18e00640 1 -- 172.21.15.122:0/4291579868 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b14068c40 con 0x7f8af8004d50 2024-05-28T06:09:24.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.240+0000 7f8b0a000640 1 -- 172.21.15.122:0/4291579868 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f8b0401d460 con 0x7f8af8004d50 2024-05-28T06:09:24.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.240+0000 7f8b0a000640 1 --2- 172.21.15.122:0/4291579868 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8af40685f0 0x7f8af406aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:24.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.240+0000 7f8b0a000640 1 -- 172.21.15.122:0/4291579868 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5823+0+0 (secure 0 0 0) 0x7f8b04086ee0 con 0x7f8af8004d50 2024-05-28T06:09:24.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.240+0000 7f8b11400640 1 --2- 172.21.15.122:0/4291579868 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8af40685f0 0x7f8af406aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:24.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.240+0000 7f8b11400640 1 --2- 172.21.15.122:0/4291579868 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8af40685f0 0x7f8af406aab0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8b140af5d0 tx=0x7f8b00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:24.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.244+0000 7f8b0a000640 1 -- 172.21.15.122:0/4291579868 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8b04057050 con 0x7f8af8004d50 2024-05-28T06:09:24.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:24.408+0000 7f8b18e00640 1 -- 172.21.15.122:0/4291579868 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8b140afd60 con 0x7f8af8004d50 2024-05-28T06:09:25.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.048+0000 7f8b0a000640 1 -- 172.21.15.122:0/4291579868 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) ==== 181+0+0 (secure 0 0 0) 0x7f8b04056950 con 0x7f8af8004d50 2024-05-28T06:09:25.053 INFO:teuthology.orchestra.run.smithi122.stderr:pool 'cephfs_metadata' removed 2024-05-28T06:09:25.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.052+0000 7f8b18e00640 1 -- 172.21.15.122:0/4291579868 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8af40685f0 msgr2=0x7f8af406aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:25.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.052+0000 7f8b18e00640 1 --2- 172.21.15.122:0/4291579868 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8af40685f0 0x7f8af406aab0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8b140af5d0 tx=0x7f8b00008040 comp rx=0 tx=0).stop 2024-05-28T06:09:25.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.052+0000 7f8b18e00640 1 -- 172.21.15.122:0/4291579868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af8004d50 msgr2=0x7f8b1415c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:25.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.052+0000 7f8b18e00640 1 --2- 172.21.15.122:0/4291579868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af8004d50 0x7f8b1415c090 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400e920 tx=0x7f8b0400ede0 comp rx=0 tx=0).stop 2024-05-28T06:09:25.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.052+0000 7f8b18e00640 1 -- 172.21.15.122:0/4291579868 shutdown_connections 2024-05-28T06:09:25.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.052+0000 7f8b18e00640 1 --2- 172.21.15.122:0/4291579868 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8af40685f0 0x7f8af406aab0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:25.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.052+0000 7f8b18e00640 1 --2- 172.21.15.122:0/4291579868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b140ada50 0x7f8b140aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:25.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.052+0000 7f8b18e00640 1 --2- 172.21.15.122:0/4291579868 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b141444c0 0x7f8b14144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:25.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.052+0000 7f8b18e00640 1 --2- 172.21.15.122:0/4291579868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af8004d50 0x7f8b1415c090 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:25.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.052+0000 7f8b18e00640 1 -- 172.21.15.122:0/4291579868 >> 172.21.15.122:0/4291579868 conn(0x7f8b1406bd90 msgr2=0x7f8b14145430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:25.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.052+0000 7f8b18e00640 1 -- 172.21.15.122:0/4291579868 shutdown_connections 2024-05-28T06:09:25.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.052+0000 7f8b18e00640 1 -- 172.21.15.122:0/4291579868 wait complete. 2024-05-28T06:09:25.080 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-28T06:09:25.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.220+0000 7fb2db200640 1 Processor -- start 2024-05-28T06:09:25.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.220+0000 7fb2db200640 1 -- start start 2024-05-28T06:09:25.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.220+0000 7fb2db200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb2d40cff30 0x7fb2d406f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:25.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.220+0000 7fb2db200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb2d406f6c0 0x7fb2d40cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:25.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.220+0000 7fb2db200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d40d0310 con 0x7fb2d40cd930 2024-05-28T06:09:25.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.220+0000 7fb2db200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fb2d406fb30 con 0x7fb2d406f6c0 2024-05-28T06:09:25.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.220+0000 7fb2db200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb2d415be20 con 0x7fb2d40cff30 2024-05-28T06:09:25.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.220+0000 7fb2cb400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb2d406f6c0 0x7fb2d40cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:25.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.220+0000 7fb2cb400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb2d406f6c0 0x7fb2d40cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40852/0 (socket says 172.21.15.122:40852) 2024-05-28T06:09:25.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.220+0000 7fb2cb400640 1 -- 172.21.15.122:0/1729996049 learned_addr learned my addr 172.21.15.122:0/1729996049 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:25.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.220+0000 7fb2d3e00640 1 --2- 172.21.15.122:0/1729996049 >> v2:172.21.15.153:3300/0 conn(0x7fb2d40cff30 0x7fb2d406f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:25.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.220+0000 7fb2cb400640 1 -- 172.21.15.122:0/1729996049 >> v2:172.21.15.153:3300/0 conn(0x7fb2d40cff30 msgr2=0x7fb2d406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:25.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.220+0000 7fb2cb400640 1 --2- 172.21.15.122:0/1729996049 >> v2:172.21.15.153:3300/0 conn(0x7fb2d40cff30 0x7fb2d406f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:25.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.220+0000 7fb2cb400640 1 -- 172.21.15.122:0/1729996049 >> v1:172.21.15.153:6789/0 conn(0x7fb2d40cd930 legacy=0x7fb2d40722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:25.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.220+0000 7fb2cb400640 1 -- 172.21.15.122:0/1729996049 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d415c100 con 0x7fb2d406f6c0 2024-05-28T06:09:25.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.224+0000 7fb2cb400640 1 --2- 172.21.15.122:0/1729996049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2d406f6c0 0x7fb2d40cd3f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40b3dc0 tx=0x7fb2bc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60300fa165e59272 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:25.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.224+0000 7fb2d3400640 1 -- 172.21.15.122:0/1729996049 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc0aa650 con 0x7fb2d406f6c0 2024-05-28T06:09:25.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.224+0000 7fb2d3400640 1 -- 172.21.15.122:0/1729996049 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2bc0af070 con 0x7fb2d406f6c0 2024-05-28T06:09:25.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.224+0000 7fb2d3400640 1 -- 172.21.15.122:0/1729996049 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc0aaa10 con 0x7fb2d406f6c0 2024-05-28T06:09:25.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.224+0000 7fb2db200640 1 -- 172.21.15.122:0/1729996049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2d406f6c0 msgr2=0x7fb2d40cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:25.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.224+0000 7fb2db200640 1 --2- 172.21.15.122:0/1729996049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2d406f6c0 0x7fb2d40cd3f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40b3dc0 tx=0x7fb2bc01c4f0 comp rx=0 tx=0).stop 2024-05-28T06:09:25.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.224+0000 7fb2db200640 1 -- 172.21.15.122:0/1729996049 shutdown_connections 2024-05-28T06:09:25.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.224+0000 7fb2db200640 1 --2- 172.21.15.122:0/1729996049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2d406f6c0 0x7fb2d40cd3f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:25.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.224+0000 7fb2db200640 1 --2- 172.21.15.122:0/1729996049 >> v2:172.21.15.153:3300/0 conn(0x7fb2d40cff30 0x7fb2d406f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:25.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.224+0000 7fb2db200640 1 -- 172.21.15.122:0/1729996049 >> 172.21.15.122:0/1729996049 conn(0x7fb2d406bd90 msgr2=0x7fb2d406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:25.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.224+0000 7fb2db200640 1 -- 172.21.15.122:0/1729996049 shutdown_connections 2024-05-28T06:09:25.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.224+0000 7fb2db200640 1 -- 172.21.15.122:0/1729996049 wait complete. 2024-05-28T06:09:25.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2db200640 1 Processor -- start 2024-05-28T06:09:25.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2db200640 1 -- start start 2024-05-28T06:09:25.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2db200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2d406f6c0 0x7fb2d4142e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:25.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2db200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2d40cd930 0x7fb2d415a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:25.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2db200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2d40cff30 0x7fb2d415aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:25.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2db200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d40cde90 con 0x7fb2d40cd930 2024-05-28T06:09:25.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2db200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d40cdd10 con 0x7fb2d406f6c0 2024-05-28T06:09:25.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2db200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb2d40b59c0 con 0x7fb2d40cff30 2024-05-28T06:09:25.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2cb400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2d40cd930 0x7fb2d415a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:25.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2cb400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2d40cd930 0x7fb2d415a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40862/0 (socket says 172.21.15.122:40862) 2024-05-28T06:09:25.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2cb400640 1 -- 172.21.15.122:0/3723658328 learned_addr learned my addr 172.21.15.122:0/3723658328 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:25.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2d3e00640 1 --2- 172.21.15.122:0/3723658328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2d406f6c0 0x7fb2d4142e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:25.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2d9200640 1 --2- 172.21.15.122:0/3723658328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2d40cff30 0x7fb2d415aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:25.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2cb400640 1 -- 172.21.15.122:0/3723658328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2d40cff30 msgr2=0x7fb2d415aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:25.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2cb400640 1 --2- 172.21.15.122:0/3723658328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2d40cff30 0x7fb2d415aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:25.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2cb400640 1 -- 172.21.15.122:0/3723658328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2d406f6c0 msgr2=0x7fb2d4142e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:25.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2cb400640 1 --2- 172.21.15.122:0/3723658328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2d406f6c0 0x7fb2d4142e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:25.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2cb400640 1 -- 172.21.15.122:0/3723658328 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d40758d0 con 0x7fb2d40cd930 2024-05-28T06:09:25.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2d3e00640 1 --2- 172.21.15.122:0/3723658328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2d406f6c0 0x7fb2d4142e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:09:25.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2cb400640 1 --2- 172.21.15.122:0/3723658328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2d40cd930 0x7fb2d415a5a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc019100 tx=0x7fb2bc01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:25.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2d0c00640 1 -- 172.21.15.122:0/3723658328 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc0bd5f0 con 0x7fb2d40cd930 2024-05-28T06:09:25.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2d0c00640 1 -- 172.21.15.122:0/3723658328 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2bc0a6040 con 0x7fb2d40cd930 2024-05-28T06:09:25.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2d0c00640 1 -- 172.21.15.122:0/3723658328 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc0bd990 con 0x7fb2d40cd930 2024-05-28T06:09:25.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2db200640 1 -- 172.21.15.122:0/3723658328 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d40ae710 con 0x7fb2d40cd930 2024-05-28T06:09:25.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.228+0000 7fb2db200640 1 -- 172.21.15.122:0/3723658328 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d40aecd0 con 0x7fb2d40cd930 2024-05-28T06:09:25.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.232+0000 7fb2db200640 1 -- 172.21.15.122:0/3723658328 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2d4068c40 con 0x7fb2d40cd930 2024-05-28T06:09:25.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.232+0000 7fb2d0c00640 1 -- 172.21.15.122:0/3723658328 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7fb2bc0b33f0 con 0x7fb2d40cd930 2024-05-28T06:09:25.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.232+0000 7fb2d0c00640 1 --2- 172.21.15.122:0/3723658328 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb2b0068680 0x7fb2b006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:25.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.232+0000 7fb2d0c00640 1 -- 172.21.15.122:0/3723658328 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5357+0+0 (secure 0 0 0) 0x7fb2bc120f50 con 0x7fb2d40cd930 2024-05-28T06:09:25.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.232+0000 7fb2d3e00640 1 --2- 172.21.15.122:0/3723658328 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb2b0068680 0x7fb2b006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:25.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.232+0000 7fb2d3e00640 1 --2- 172.21.15.122:0/3723658328 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb2b0068680 0x7fb2b006ab40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4009b10 tx=0x7fb2c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:25.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.236+0000 7fb2d0c00640 1 -- 172.21.15.122:0/3723658328 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb2bc016110 con 0x7fb2d40cd930 2024-05-28T06:09:25.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:25.396+0000 7fb2db200640 1 -- 172.21.15.122:0/3723658328 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb2d40ccdf0 con 0x7fb2d40cd930 2024-05-28T06:09:26.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.056+0000 7fb2d0c00640 1 -- 172.21.15.122:0/3723658328 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) ==== 169+0+0 (secure 0 0 0) 0x7fb2bc0f0b80 con 0x7fb2d40cd930 2024-05-28T06:09:26.061 INFO:teuthology.orchestra.run.smithi122.stderr:pool 'cephfs_data' removed 2024-05-28T06:09:26.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.064+0000 7fb2db200640 1 -- 172.21.15.122:0/3723658328 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb2b0068680 msgr2=0x7fb2b006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:26.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.064+0000 7fb2db200640 1 --2- 172.21.15.122:0/3723658328 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb2b0068680 0x7fb2b006ab40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4009b10 tx=0x7fb2c4008040 comp rx=0 tx=0).stop 2024-05-28T06:09:26.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.064+0000 7fb2db200640 1 -- 172.21.15.122:0/3723658328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2d40cd930 msgr2=0x7fb2d415a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:26.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.064+0000 7fb2db200640 1 --2- 172.21.15.122:0/3723658328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2d40cd930 0x7fb2d415a5a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc019100 tx=0x7fb2bc01ad30 comp rx=0 tx=0).stop 2024-05-28T06:09:26.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.064+0000 7fb2db200640 1 -- 172.21.15.122:0/3723658328 shutdown_connections 2024-05-28T06:09:26.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.064+0000 7fb2db200640 1 --2- 172.21.15.122:0/3723658328 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb2b0068680 0x7fb2b006ab40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:26.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.064+0000 7fb2db200640 1 --2- 172.21.15.122:0/3723658328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2d40cff30 0x7fb2d415aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:26.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.064+0000 7fb2db200640 1 --2- 172.21.15.122:0/3723658328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2d40cd930 0x7fb2d415a5a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:26.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.064+0000 7fb2db200640 1 --2- 172.21.15.122:0/3723658328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2d406f6c0 0x7fb2d4142e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:26.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.064+0000 7fb2db200640 1 -- 172.21.15.122:0/3723658328 >> 172.21.15.122:0/3723658328 conn(0x7fb2d406bd90 msgr2=0x7fb2d4072270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:26.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.064+0000 7fb2db200640 1 -- 172.21.15.122:0/3723658328 shutdown_connections 2024-05-28T06:09:26.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.064+0000 7fb2db200640 1 -- 172.21.15.122:0/3723658328 wait complete. 2024-05-28T06:09:26.101 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-28T06:09:26.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.244+0000 7f95ca400640 1 Processor -- start 2024-05-28T06:09:26.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.244+0000 7f95ca400640 1 -- start start 2024-05-28T06:09:26.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.248+0000 7f95ca400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f95c40729b0 0x7f95c40afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:26.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.248+0000 7f95ca400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95c40adac0 0x7f95c406e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:26.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.248+0000 7f95ca400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95c40adf30 con 0x7f95c4147410 2024-05-28T06:09:26.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.248+0000 7f95ca400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f95c40b5310 con 0x7f95c40729b0 2024-05-28T06:09:26.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.248+0000 7f95ca400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f95c406e5b0 con 0x7f95c40adac0 2024-05-28T06:09:26.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.248+0000 7f95baa00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f95c40729b0 0x7f95c40afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:26.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.248+0000 7f95baa00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f95c40729b0 0x7f95c40afd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44508/0 (socket says 172.21.15.122:44508) 2024-05-28T06:09:26.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.248+0000 7f95baa00640 1 -- 172.21.15.122:0/3453628593 learned_addr learned my addr 172.21.15.122:0/3453628593 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:26.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.248+0000 7f95baa00640 1 -- 172.21.15.122:0/3453628593 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95c40adac0 msgr2=0x7f95c406e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:26.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.248+0000 7f95baa00640 1 --2- 172.21.15.122:0/3453628593 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95c40adac0 0x7f95c406e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:26.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.248+0000 7f95baa00640 1 -- 172.21.15.122:0/3453628593 >> v1:172.21.15.153:6789/0 conn(0x7f95c4147410 legacy=0x7f95c40722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:26.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.248+0000 7f95baa00640 1 -- 172.21.15.122:0/3453628593 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c406e7f0 con 0x7f95c40729b0 2024-05-28T06:09:26.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.248+0000 7f95baa00640 1 --2- 172.21.15.122:0/3453628593 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95c40729b0 0x7f95c40afd30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f95ac009870 tx=0x7f95ac01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d873b05bc88486 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:26.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.252+0000 7f95c2a00640 1 -- 172.21.15.122:0/3453628593 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac0b0070 con 0x7f95c40729b0 2024-05-28T06:09:26.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.252+0000 7f95c2a00640 1 -- 172.21.15.122:0/3453628593 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95ac0ab600 con 0x7f95c40729b0 2024-05-28T06:09:26.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.252+0000 7f95c2a00640 1 -- 172.21.15.122:0/3453628593 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac0ab9d0 con 0x7f95c40729b0 2024-05-28T06:09:26.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.252+0000 7f95ca400640 1 -- 172.21.15.122:0/3453628593 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95c40729b0 msgr2=0x7f95c40afd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:26.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.252+0000 7f95ca400640 1 --2- 172.21.15.122:0/3453628593 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95c40729b0 0x7f95c40afd30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f95ac009870 tx=0x7f95ac01c520 comp rx=0 tx=0).stop 2024-05-28T06:09:26.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.252+0000 7f95ca400640 1 -- 172.21.15.122:0/3453628593 shutdown_connections 2024-05-28T06:09:26.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.252+0000 7f95ca400640 1 --2- 172.21.15.122:0/3453628593 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95c40adac0 0x7f95c406e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:26.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.252+0000 7f95ca400640 1 --2- 172.21.15.122:0/3453628593 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95c40729b0 0x7f95c40afd30 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:26.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.252+0000 7f95ca400640 1 -- 172.21.15.122:0/3453628593 >> 172.21.15.122:0/3453628593 conn(0x7f95c406bd90 msgr2=0x7f95c406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:26.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.252+0000 7f95ca400640 1 -- 172.21.15.122:0/3453628593 shutdown_connections 2024-05-28T06:09:26.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.252+0000 7f95ca400640 1 -- 172.21.15.122:0/3453628593 wait complete. 2024-05-28T06:09:26.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.252+0000 7f95ca400640 1 Processor -- start 2024-05-28T06:09:26.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.252+0000 7f95ca400640 1 -- start start 2024-05-28T06:09:26.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.252+0000 7f95ca400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95c40729b0 0x7f95c413ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:26.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.252+0000 7f95ca400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95c40adac0 0x7f95c41410d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:26.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.252+0000 7f95ca400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95c4147410 0x7f95c4141610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:26.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.252+0000 7f95ca400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f95c4147970 con 0x7f95c40adac0 2024-05-28T06:09:26.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.252+0000 7f95ca400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f95c41477f0 con 0x7f95c4147410 2024-05-28T06:09:26.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.252+0000 7f95ca400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f95c40b6270 con 0x7f95c40729b0 2024-05-28T06:09:26.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.252+0000 7f95baa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95c40adac0 0x7f95c41410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:26.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.256+0000 7f95baa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95c40adac0 0x7f95c41410d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44518/0 (socket says 172.21.15.122:44518) 2024-05-28T06:09:26.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.256+0000 7f95baa00640 1 -- 172.21.15.122:0/2322601548 learned_addr learned my addr 172.21.15.122:0/2322601548 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:26.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.256+0000 7f95c3e00640 1 --2- 172.21.15.122:0/2322601548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95c4147410 0x7f95c4141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:26.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.256+0000 7f95c3400640 1 --2- 172.21.15.122:0/2322601548 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95c40729b0 0x7f95c413ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:26.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.256+0000 7f95baa00640 1 -- 172.21.15.122:0/2322601548 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95c40729b0 msgr2=0x7f95c413ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:26.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.256+0000 7f95baa00640 1 --2- 172.21.15.122:0/2322601548 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95c40729b0 0x7f95c413ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:26.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.256+0000 7f95baa00640 1 -- 172.21.15.122:0/2322601548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95c4147410 msgr2=0x7f95c4141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:26.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.256+0000 7f95baa00640 1 --2- 172.21.15.122:0/2322601548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95c4147410 0x7f95c4141610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:26.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.256+0000 7f95baa00640 1 -- 172.21.15.122:0/2322601548 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c4141c40 con 0x7f95c40adac0 2024-05-28T06:09:26.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.256+0000 7f95baa00640 1 --2- 172.21.15.122:0/2322601548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95c40adac0 0x7f95c41410d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f95ac01abd0 tx=0x7f95ac0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:26.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.256+0000 7f95bbe00640 1 -- 172.21.15.122:0/2322601548 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac0b0040 con 0x7f95c40adac0 2024-05-28T06:09:26.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.256+0000 7f95bbe00640 1 -- 172.21.15.122:0/2322601548 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95ac0b4620 con 0x7f95c40adac0 2024-05-28T06:09:26.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.256+0000 7f95ca400640 1 -- 172.21.15.122:0/2322601548 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c41fb450 con 0x7f95c40adac0 2024-05-28T06:09:26.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.256+0000 7f95bbe00640 1 -- 172.21.15.122:0/2322601548 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac0b4a10 con 0x7f95c40adac0 2024-05-28T06:09:26.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.256+0000 7f95ca400640 1 -- 172.21.15.122:0/2322601548 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c41fba10 con 0x7f95c40adac0 2024-05-28T06:09:26.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.256+0000 7f95ca400640 1 -- 172.21.15.122:0/2322601548 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95c4068c40 con 0x7f95c40adac0 2024-05-28T06:09:26.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.256+0000 7f95bbe00640 1 -- 172.21.15.122:0/2322601548 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f95ac0ab4c0 con 0x7f95c40adac0 2024-05-28T06:09:26.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.256+0000 7f95bbe00640 1 --2- 172.21.15.122:0/2322601548 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f95a0068650 0x7f95a006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:26.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.256+0000 7f95bbe00640 1 -- 172.21.15.122:0/2322601548 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f95ac120960 con 0x7f95c40adac0 2024-05-28T06:09:26.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.260+0000 7f95c3400640 1 --2- 172.21.15.122:0/2322601548 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f95a0068650 0x7f95a006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:26.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.260+0000 7f95c3400640 1 --2- 172.21.15.122:0/2322601548 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f95a0068650 0x7f95a006ab10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f95b4009f20 tx=0x7f95b40094d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:26.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.260+0000 7f95bbe00640 1 -- 172.21.15.122:0/2322601548 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f95ac016110 con 0x7f95c40adac0 2024-05-28T06:09:26.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.420+0000 7f95ca400640 1 -- 172.21.15.122:0/2322601548 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f95c406fbb0 con 0x7f95c40adac0 2024-05-28T06:09:26.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.424+0000 7f95bbe00640 1 -- 172.21.15.122:0/2322601548 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f95ac0ba2b0 con 0x7f95c40adac0 2024-05-28T06:09:26.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.424+0000 7f95ca400640 1 -- 172.21.15.122:0/2322601548 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f95a0068650 msgr2=0x7f95a006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:26.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.424+0000 7f95ca400640 1 --2- 172.21.15.122:0/2322601548 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f95a0068650 0x7f95a006ab10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f95b4009f20 tx=0x7f95b40094d0 comp rx=0 tx=0).stop 2024-05-28T06:09:26.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.424+0000 7f95ca400640 1 -- 172.21.15.122:0/2322601548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95c40adac0 msgr2=0x7f95c41410d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:26.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.424+0000 7f95ca400640 1 --2- 172.21.15.122:0/2322601548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95c40adac0 0x7f95c41410d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f95ac01abd0 tx=0x7f95ac0192c0 comp rx=0 tx=0).stop 2024-05-28T06:09:26.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.424+0000 7f95ca400640 1 -- 172.21.15.122:0/2322601548 shutdown_connections 2024-05-28T06:09:26.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.424+0000 7f95ca400640 1 --2- 172.21.15.122:0/2322601548 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f95a0068650 0x7f95a006ab10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:26.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.424+0000 7f95ca400640 1 --2- 172.21.15.122:0/2322601548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95c4147410 0x7f95c4141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:26.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.424+0000 7f95ca400640 1 --2- 172.21.15.122:0/2322601548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95c40adac0 0x7f95c41410d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:26.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.424+0000 7f95ca400640 1 --2- 172.21.15.122:0/2322601548 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95c40729b0 0x7f95c413ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:26.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.424+0000 7f95ca400640 1 -- 172.21.15.122:0/2322601548 >> 172.21.15.122:0/2322601548 conn(0x7f95c406bd90 msgr2=0x7f95c4162bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:26.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.424+0000 7f95ca400640 1 -- 172.21.15.122:0/2322601548 shutdown_connections 2024-05-28T06:09:26.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.424+0000 7f95ca400640 1 -- 172.21.15.122:0/2322601548 wait complete. 2024-05-28T06:09:26.449 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone' 2024-05-28T06:09:26.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.588+0000 7f21dba00640 1 Processor -- start 2024-05-28T06:09:26.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.588+0000 7f21dba00640 1 -- start start 2024-05-28T06:09:26.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.592+0000 7f21dba00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d40b58d0 0x7f21d40b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:26.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.592+0000 7f21dba00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f21d415e730 0x7f21d415ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:26.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.592+0000 7f21dba00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21d40b61f0 con 0x7f21d40ce4f0 2024-05-28T06:09:26.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.592+0000 7f21dba00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f21d415d970 con 0x7f21d415e730 2024-05-28T06:09:26.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.592+0000 7f21dba00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f21d415dc50 con 0x7f21d40b58d0 2024-05-28T06:09:26.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.592+0000 7f21d9a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f21d415e730 0x7f21d415ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:26.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.592+0000 7f21d9000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d40b58d0 0x7f21d40b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:26.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.592+0000 7f21d9a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f21d415e730 0x7f21d415ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:56500/0 (socket says 172.21.15.122:56500) 2024-05-28T06:09:26.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.592+0000 7f21d9a00640 1 -- 172.21.15.122:0/891296534 learned_addr learned my addr 172.21.15.122:0/891296534 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:26.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.592+0000 7f21d9a00640 1 -- 172.21.15.122:0/891296534 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d40b58d0 msgr2=0x7f21d40b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:26.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.592+0000 7f21d9a00640 1 --2- 172.21.15.122:0/891296534 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d40b58d0 0x7f21d40b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:26.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.592+0000 7f21d9a00640 1 -- 172.21.15.122:0/891296534 >> v1:172.21.15.153:6789/0 conn(0x7f21d40ce4f0 legacy=0x7f21d40ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:26.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.592+0000 7f21d9a00640 1 -- 172.21.15.122:0/891296534 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d415df30 con 0x7f21d415e730 2024-05-28T06:09:26.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.596+0000 7f21d9a00640 1 --2- 172.21.15.122:0/891296534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d415e730 0x7f21d415ebc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f21cc009870 tx=0x7f21cc01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bd54b3931289683 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:26.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.596+0000 7f21d3400640 1 -- 172.21.15.122:0/891296534 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc0ab5f0 con 0x7f21d415e730 2024-05-28T06:09:26.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.596+0000 7f21d3400640 1 -- 172.21.15.122:0/891296534 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21cc0b0070 con 0x7f21d415e730 2024-05-28T06:09:26.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.596+0000 7f21d3400640 1 -- 172.21.15.122:0/891296534 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc0ab9b0 con 0x7f21d415e730 2024-05-28T06:09:26.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.596+0000 7f21dba00640 1 -- 172.21.15.122:0/891296534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d415e730 msgr2=0x7f21d415ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:26.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.596+0000 7f21dba00640 1 --2- 172.21.15.122:0/891296534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d415e730 0x7f21d415ebc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f21cc009870 tx=0x7f21cc01c560 comp rx=0 tx=0).stop 2024-05-28T06:09:26.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.596+0000 7f21dba00640 1 -- 172.21.15.122:0/891296534 shutdown_connections 2024-05-28T06:09:26.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.596+0000 7f21dba00640 1 --2- 172.21.15.122:0/891296534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d415e730 0x7f21d415ebc0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:26.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.596+0000 7f21dba00640 1 --2- 172.21.15.122:0/891296534 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d40b58d0 0x7f21d40b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:26.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.596+0000 7f21dba00640 1 -- 172.21.15.122:0/891296534 >> 172.21.15.122:0/891296534 conn(0x7f21d406bd90 msgr2=0x7f21d406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:26.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.596+0000 7f21dba00640 1 -- 172.21.15.122:0/891296534 shutdown_connections 2024-05-28T06:09:26.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.596+0000 7f21dba00640 1 -- 172.21.15.122:0/891296534 wait complete. 2024-05-28T06:09:26.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.596+0000 7f21dba00640 1 Processor -- start 2024-05-28T06:09:26.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.596+0000 7f21dba00640 1 -- start start 2024-05-28T06:09:26.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21dba00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d40b58d0 0x7f21d41399d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:26.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21dba00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d40ce4f0 0x7f21d4139f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:26.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21dba00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21d415e730 0x7f21d415b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:26.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21dba00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f21d41693d0 con 0x7f21d415e730 2024-05-28T06:09:26.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21dba00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f21d4169250 con 0x7f21d40ce4f0 2024-05-28T06:09:26.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21dba00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f21d4169550 con 0x7f21d40b58d0 2024-05-28T06:09:26.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21d9a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21d415e730 0x7f21d415b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:26.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21d9000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d40b58d0 0x7f21d41399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:26.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21d9000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d40b58d0 0x7f21d41399d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:49344/0 (socket says 172.21.15.122:49344) 2024-05-28T06:09:26.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21d9a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21d415e730 0x7f21d415b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44530/0 (socket says 172.21.15.122:44530) 2024-05-28T06:09:26.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21d9000640 1 -- 172.21.15.122:0/3124908969 learned_addr learned my addr 172.21.15.122:0/3124908969 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:26.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21d3e00640 1 --2- 172.21.15.122:0/3124908969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d40ce4f0 0x7f21d4139f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:26.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21d9000640 1 -- 172.21.15.122:0/3124908969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d40ce4f0 msgr2=0x7f21d4139f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:26.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21d9000640 1 --2- 172.21.15.122:0/3124908969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d40ce4f0 0x7f21d4139f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:26.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21d9000640 1 -- 172.21.15.122:0/3124908969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21d415e730 msgr2=0x7f21d415b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:26.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21d9000640 1 --2- 172.21.15.122:0/3124908969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21d415e730 0x7f21d415b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:26.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21d9000640 1 -- 172.21.15.122:0/3124908969 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d40af360 con 0x7f21d40b58d0 2024-05-28T06:09:26.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21d9000640 1 --2- 172.21.15.122:0/3124908969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d40b58d0 0x7f21d41399d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f21c400efc0 tx=0x7f21c400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:26.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21d0c00640 1 -- 172.21.15.122:0/3124908969 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c4018020 con 0x7f21d40b58d0 2024-05-28T06:09:26.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21d0c00640 1 -- 172.21.15.122:0/3124908969 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c4014480 con 0x7f21d40b58d0 2024-05-28T06:09:26.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21d0c00640 1 -- 172.21.15.122:0/3124908969 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c4014850 con 0x7f21d40b58d0 2024-05-28T06:09:26.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21dba00640 1 -- 172.21.15.122:0/3124908969 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d4159da0 con 0x7f21d40b58d0 2024-05-28T06:09:26.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21dba00640 1 -- 172.21.15.122:0/3124908969 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d40b40d0 con 0x7f21d40b58d0 2024-05-28T06:09:26.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.600+0000 7f21dba00640 1 -- 172.21.15.122:0/3124908969 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21d40b42d0 con 0x7f21d40b58d0 2024-05-28T06:09:26.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.604+0000 7f21d0c00640 1 -- 172.21.15.122:0/3124908969 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f21c401b020 con 0x7f21d40b58d0 2024-05-28T06:09:26.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.604+0000 7f21d0c00640 1 --2- 172.21.15.122:0/3124908969 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f21b4068650 0x7f21b406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:26.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.604+0000 7f21d0c00640 1 -- 172.21.15.122:0/3124908969 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f21c4087d60 con 0x7f21d40b58d0 2024-05-28T06:09:26.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.604+0000 7f21d3e00640 1 --2- 172.21.15.122:0/3124908969 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f21b4068650 0x7f21b406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:26.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.604+0000 7f21d3e00640 1 --2- 172.21.15.122:0/3124908969 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f21b4068650 0x7f21b406ab10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f21d40cd7f0 tx=0x7f21c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:26.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.608+0000 7f21d0c00640 1 -- 172.21.15.122:0/3124908969 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f21c4022070 con 0x7f21d40b58d0 2024-05-28T06:09:26.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:26.828+0000 7f21dba00640 1 -- 172.21.15.122:0/3124908969 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone"]} v 0) -- 0x7f21d4068c40 con 0x7f21d40b58d0 2024-05-28T06:09:27.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.068+0000 7f21d0c00640 1 -- 172.21.15.122:0/3124908969 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone"]}]=0 v185) ==== 160+0+0 (secure 0 0 0) 0x7f21c4010040 con 0x7f21d40b58d0 2024-05-28T06:09:27.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.068+0000 7f21dba00640 1 -- 172.21.15.122:0/3124908969 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f21b4068650 msgr2=0x7f21b406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:27.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.068+0000 7f21dba00640 1 --2- 172.21.15.122:0/3124908969 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f21b4068650 0x7f21b406ab10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f21d40cd7f0 tx=0x7f21c0009040 comp rx=0 tx=0).stop 2024-05-28T06:09:27.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.068+0000 7f21dba00640 1 -- 172.21.15.122:0/3124908969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d40b58d0 msgr2=0x7f21d41399d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:27.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.068+0000 7f21dba00640 1 --2- 172.21.15.122:0/3124908969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d40b58d0 0x7f21d41399d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f21c400efc0 tx=0x7f21c400c490 comp rx=0 tx=0).stop 2024-05-28T06:09:27.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.068+0000 7f21dba00640 1 -- 172.21.15.122:0/3124908969 shutdown_connections 2024-05-28T06:09:27.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.068+0000 7f21dba00640 1 --2- 172.21.15.122:0/3124908969 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f21b4068650 0x7f21b406ab10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.068+0000 7f21dba00640 1 --2- 172.21.15.122:0/3124908969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21d415e730 0x7f21d415b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.068+0000 7f21dba00640 1 --2- 172.21.15.122:0/3124908969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d40ce4f0 0x7f21d4139f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.068+0000 7f21dba00640 1 --2- 172.21.15.122:0/3124908969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d40b58d0 0x7f21d41399d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.068+0000 7f21dba00640 1 -- 172.21.15.122:0/3124908969 >> 172.21.15.122:0/3124908969 conn(0x7f21d406bd90 msgr2=0x7f21d4145180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:27.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.068+0000 7f21dba00640 1 -- 172.21.15.122:0/3124908969 shutdown_connections 2024-05-28T06:09:27.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.068+0000 7f21dba00640 1 -- 172.21.15.122:0/3124908969 wait complete. 2024-05-28T06:09:27.091 INFO:tasks.cephfs_test_runner:Test that when one clone is in progress, one progress bar is printed ... ok 2024-05-28T06:09:27.092 INFO:tasks.cephfs_test_runner:Starting test: test_progress_bars_for_4_clones (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that one progress bar is printed when number of clone jobs is 2024-05-28T06:09:27.092 INFO:tasks.cephfs_test_runner:test_progress_bars_for_4_clones (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-28T06:09:27.092 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:09:27.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.224+0000 7f7f0da00640 1 Processor -- start 2024-05-28T06:09:27.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.224+0000 7f7f0da00640 1 -- start start 2024-05-28T06:09:27.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.224+0000 7f7f0da00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f080b58d0 0x7f7f080b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:27.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.224+0000 7f7f0da00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7f080ce4f0 0x7f7f080ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:27.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.224+0000 7f7f0da00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7f080722a0 0x7f7f08072730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:27.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.224+0000 7f7f0da00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f7f080b61f0 con 0x7f7f080722a0 2024-05-28T06:09:27.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.224+0000 7f7f0da00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7f0815d970 con 0x7f7f080ce4f0 2024-05-28T06:09:27.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.224+0000 7f7f0da00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7f0815dc50 con 0x7f7f080b58d0 2024-05-28T06:09:27.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.224+0000 7f7f07400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7f080722a0 0x7f7f08072730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:27.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.224+0000 7f7f07400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7f080722a0 0x7f7f08072730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44532/0 (socket says 172.21.15.122:44532) 2024-05-28T06:09:27.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.224+0000 7f7f07400640 1 -- 172.21.15.122:0/314185524 learned_addr learned my addr 172.21.15.122:0/314185524 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:27.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.224+0000 7f7f06a00640 1 --2- 172.21.15.122:0/314185524 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f080b58d0 0x7f7f080b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:27.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.224+0000 7f7f06000640 1 --2- 172.21.15.122:0/314185524 >> v2:172.21.15.153:3300/0 conn(0x7f7f080ce4f0 0x7f7f080ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:27.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.224+0000 7f7f07400640 1 -- 172.21.15.122:0/314185524 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f080b58d0 msgr2=0x7f7f080b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:27.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.224+0000 7f7f07400640 1 --2- 172.21.15.122:0/314185524 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f080b58d0 0x7f7f080b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.224+0000 7f7f07400640 1 -- 172.21.15.122:0/314185524 >> v2:172.21.15.153:3300/0 conn(0x7f7f080ce4f0 msgr2=0x7f7f080ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:27.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.224+0000 7f7f07400640 1 --2- 172.21.15.122:0/314185524 >> v2:172.21.15.153:3300/0 conn(0x7f7f080ce4f0 0x7f7f080ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.224+0000 7f7f07400640 1 -- 172.21.15.122:0/314185524 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0815df30 con 0x7f7f080722a0 2024-05-28T06:09:27.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.224+0000 7f7f06a00640 1 --2- 172.21.15.122:0/314185524 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f080b58d0 0x7f7f080b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:09:27.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.228+0000 7f7f07400640 1 --2- 172.21.15.122:0/314185524 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f080722a0 0x7f7f08072730 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7f08070160 tx=0x7f7f0001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830c1d349474a0a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:27.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.228+0000 7f7f05600640 1 -- 172.21.15.122:0/314185524 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f000a5840 con 0x7f7f080722a0 2024-05-28T06:09:27.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.228+0000 7f7f05600640 1 -- 172.21.15.122:0/314185524 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f000a59e0 con 0x7f7f080722a0 2024-05-28T06:09:27.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.228+0000 7f7f05600640 1 -- 172.21.15.122:0/314185524 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f000a5db0 con 0x7f7f080722a0 2024-05-28T06:09:27.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.228+0000 7f7f0da00640 1 -- 172.21.15.122:0/314185524 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f080722a0 msgr2=0x7f7f08072730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:27.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.228+0000 7f7f0da00640 1 --2- 172.21.15.122:0/314185524 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f080722a0 0x7f7f08072730 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7f08070160 tx=0x7f7f0001c9c0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.228+0000 7f7f0da00640 1 -- 172.21.15.122:0/314185524 shutdown_connections 2024-05-28T06:09:27.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.228+0000 7f7f0da00640 1 --2- 172.21.15.122:0/314185524 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f080722a0 0x7f7f08072730 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.228+0000 7f7f0da00640 1 --2- 172.21.15.122:0/314185524 >> v2:172.21.15.153:3300/0 conn(0x7f7f080ce4f0 0x7f7f080ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.228+0000 7f7f0da00640 1 --2- 172.21.15.122:0/314185524 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f080b58d0 0x7f7f080b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.228+0000 7f7f0da00640 1 -- 172.21.15.122:0/314185524 >> 172.21.15.122:0/314185524 conn(0x7f7f0806bd90 msgr2=0x7f7f0806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:27.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.228+0000 7f7f0da00640 1 -- 172.21.15.122:0/314185524 shutdown_connections 2024-05-28T06:09:27.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.228+0000 7f7f0da00640 1 -- 172.21.15.122:0/314185524 wait complete. 2024-05-28T06:09:27.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7f0da00640 1 Processor -- start 2024-05-28T06:09:27.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7f0da00640 1 -- start start 2024-05-28T06:09:27.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7f0da00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f080722a0 0x7f7f0815c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:27.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7f0da00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f080b58d0 0x7f7f0813f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:27.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7f0da00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f080ce4f0 0x7f7f08144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:27.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7f0da00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7f08146260 con 0x7f7f080722a0 2024-05-28T06:09:27.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7f0da00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7f080cee90 con 0x7f7f080b58d0 2024-05-28T06:09:27.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7f0da00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7f08141700 con 0x7f7f080ce4f0 2024-05-28T06:09:27.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7f06a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f080722a0 0x7f7f0815c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:27.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7f06a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f080722a0 0x7f7f0815c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44540/0 (socket says 172.21.15.122:44540) 2024-05-28T06:09:27.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7f06a00640 1 -- 172.21.15.122:0/3869331935 learned_addr learned my addr 172.21.15.122:0/3869331935 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:27.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7f06000640 1 --2- 172.21.15.122:0/3869331935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f080b58d0 0x7f7f0813f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:27.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7f07400640 1 --2- 172.21.15.122:0/3869331935 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f080ce4f0 0x7f7f08144d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:27.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7f06a00640 1 -- 172.21.15.122:0/3869331935 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f080ce4f0 msgr2=0x7f7f08144d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:27.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7f06a00640 1 --2- 172.21.15.122:0/3869331935 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f080ce4f0 0x7f7f08144d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7f06a00640 1 -- 172.21.15.122:0/3869331935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f080b58d0 msgr2=0x7f7f0813f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:27.238 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7f06a00640 1 --2- 172.21.15.122:0/3869331935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f080b58d0 0x7f7f0813f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.238 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7f06a00640 1 -- 172.21.15.122:0/3869331935 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f081419e0 con 0x7f7f080722a0 2024-05-28T06:09:27.238 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7f06a00640 1 --2- 172.21.15.122:0/3869331935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f080722a0 0x7f7f0815c110 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800d800 tx=0x7f7ef800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:27.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7efea00640 1 -- 172.21.15.122:0/3869331935 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef800b6c0 con 0x7f7f080722a0 2024-05-28T06:09:27.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7efea00640 1 -- 172.21.15.122:0/3869331935 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ef8019070 con 0x7f7f080722a0 2024-05-28T06:09:27.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7efea00640 1 -- 172.21.15.122:0/3869331935 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef800baa0 con 0x7f7f080722a0 2024-05-28T06:09:27.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7f0da00640 1 -- 172.21.15.122:0/3869331935 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f08141cc0 con 0x7f7f080722a0 2024-05-28T06:09:27.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.232+0000 7f7f0da00640 1 -- 172.21.15.122:0/3869331935 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f0813fcb0 con 0x7f7f080722a0 2024-05-28T06:09:27.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.236+0000 7f7f0da00640 1 -- 172.21.15.122:0/3869331935 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f08068c40 con 0x7f7f080722a0 2024-05-28T06:09:27.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.236+0000 7f7efea00640 1 -- 172.21.15.122:0/3869331935 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f7ef800bc40 con 0x7f7f080722a0 2024-05-28T06:09:27.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.236+0000 7f7efea00640 1 --2- 172.21.15.122:0/3869331935 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7ee8068650 0x7f7ee806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:27.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.236+0000 7f7efea00640 1 -- 172.21.15.122:0/3869331935 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f7ef8086f20 con 0x7f7f080722a0 2024-05-28T06:09:27.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.236+0000 7f7f06000640 1 --2- 172.21.15.122:0/3869331935 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7ee8068650 0x7f7ee806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:27.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.236+0000 7f7f06000640 1 --2- 172.21.15.122:0/3869331935 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7ee8068650 0x7f7ee806ab10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7f0813b950 tx=0x7f7ef4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:27.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.240+0000 7f7efea00640 1 -- 172.21.15.122:0/3869331935 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7ef8057490 con 0x7f7f080722a0 2024-05-28T06:09:27.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.400+0000 7f7f0da00640 1 -- 172.21.15.122:0/3869331935 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f0813da10 con 0x7f7f080722a0 2024-05-28T06:09:27.406 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.404+0000 7f7efea00640 1 -- 172.21.15.122:0/3869331935 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+13022 (secure 0 0 0) 0x7f7ef8056d90 con 0x7f7f080722a0 2024-05-28T06:09:27.406 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:27.407 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":39,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:09:26.054905+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.122:6837/1698676182":"2024-05-29T06:09:23.009784+0000","172.21.15.122:6836/1698676182":"2024-05-29T06:09:23.009784+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:09:27.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.404+0000 7f7f0da00640 1 -- 172.21.15.122:0/3869331935 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7ee8068650 msgr2=0x7f7ee806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:27.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.404+0000 7f7f0da00640 1 --2- 172.21.15.122:0/3869331935 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7ee8068650 0x7f7ee806ab10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7f0813b950 tx=0x7f7ef4008040 comp rx=0 tx=0).stop 2024-05-28T06:09:27.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.404+0000 7f7f0da00640 1 -- 172.21.15.122:0/3869331935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f080722a0 msgr2=0x7f7f0815c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:27.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.404+0000 7f7f0da00640 1 --2- 172.21.15.122:0/3869331935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f080722a0 0x7f7f0815c110 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800d800 tx=0x7f7ef800dcc0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.404+0000 7f7f0da00640 1 -- 172.21.15.122:0/3869331935 shutdown_connections 2024-05-28T06:09:27.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.404+0000 7f7f0da00640 1 --2- 172.21.15.122:0/3869331935 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7ee8068650 0x7f7ee806ab10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.404+0000 7f7f0da00640 1 --2- 172.21.15.122:0/3869331935 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f080ce4f0 0x7f7f08144d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.404+0000 7f7f0da00640 1 --2- 172.21.15.122:0/3869331935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f080b58d0 0x7f7f0813f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.404+0000 7f7f0da00640 1 --2- 172.21.15.122:0/3869331935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f080722a0 0x7f7f0815c110 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.404+0000 7f7f0da00640 1 -- 172.21.15.122:0/3869331935 >> 172.21.15.122:0/3869331935 conn(0x7f7f0806bd90 msgr2=0x7f7f08074d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:27.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.404+0000 7f7f0da00640 1 -- 172.21.15.122:0/3869331935 shutdown_connections 2024-05-28T06:09:27.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.404+0000 7f7f0da00640 1 -- 172.21.15.122:0/3869331935 wait complete. 2024-05-28T06:09:27.428 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:09:27.428 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:09:27.566 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.564+0000 7fa868e00640 1 Processor -- start 2024-05-28T06:09:27.567 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.564+0000 7fa868e00640 1 -- start start 2024-05-28T06:09:27.568 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.564+0000 7fa868e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa86406f890 0x7fa8640cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:27.568 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.564+0000 7fa868e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8640cd930 0x7fa8640b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:27.568 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.564+0000 7fa868e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8640d0310 con 0x7fa8640cff30 2024-05-28T06:09:27.568 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.564+0000 7fa868e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa86415be20 con 0x7fa86406f890 2024-05-28T06:09:27.568 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.564+0000 7fa868e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa86415c100 con 0x7fa8640cd930 2024-05-28T06:09:27.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.564+0000 7fa861400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa86406f890 0x7fa8640cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:27.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.564+0000 7fa862800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8640cd930 0x7fa8640b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:27.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.564+0000 7fa861e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa8640cff30 0x7fa86406f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:51078/0 (socket says 172.21.15.122:51078) 2024-05-28T06:09:27.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.564+0000 7fa861e00640 1 -- 172.21.15.122:0/2162239186 learned_addr learned my addr 172.21.15.122:0/2162239186 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:27.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.564+0000 7fa861400640 1 -- 172.21.15.122:0/2162239186 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8640cd930 msgr2=0x7fa8640b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:27.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.564+0000 7fa860a00640 1 -- 172.21.15.122:0/2162239186 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3279774309 0 0) 0x7fa8640d0310 con 0x7fa8640cff30 2024-05-28T06:09:27.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.564+0000 7fa861400640 1 --2- 172.21.15.122:0/2162239186 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8640cd930 0x7fa8640b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.564+0000 7fa861400640 1 -- 172.21.15.122:0/2162239186 >> v1:172.21.15.153:6789/0 conn(0x7fa8640cff30 legacy=0x7fa86406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:27.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.564+0000 7fa861400640 1 -- 172.21.15.122:0/2162239186 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa86415c3e0 con 0x7fa86406f890 2024-05-28T06:09:27.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.564+0000 7fa862800640 1 --2- 172.21.15.122:0/2162239186 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8640cd930 0x7fa8640b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:09:27.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.568+0000 7fa861400640 1 --2- 172.21.15.122:0/2162239186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa86406f890 0x7fa8640cd3f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa85000ba60 tx=0x7fa85001eb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9c46b07758f3688 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:27.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.568+0000 7fa860a00640 1 -- 172.21.15.122:0/2162239186 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8500b4070 con 0x7fa86406f890 2024-05-28T06:09:27.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.568+0000 7fa860a00640 1 -- 172.21.15.122:0/2162239186 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8500a7bb0 con 0x7fa86406f890 2024-05-28T06:09:27.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.568+0000 7fa860a00640 1 -- 172.21.15.122:0/2162239186 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8500af440 con 0x7fa86406f890 2024-05-28T06:09:27.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.568+0000 7fa868e00640 1 -- 172.21.15.122:0/2162239186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa86406f890 msgr2=0x7fa8640cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:27.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.568+0000 7fa868e00640 1 --2- 172.21.15.122:0/2162239186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa86406f890 0x7fa8640cd3f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa85000ba60 tx=0x7fa85001eb40 comp rx=0 tx=0).stop 2024-05-28T06:09:27.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.568+0000 7fa868e00640 1 -- 172.21.15.122:0/2162239186 shutdown_connections 2024-05-28T06:09:27.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.568+0000 7fa868e00640 1 --2- 172.21.15.122:0/2162239186 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8640cd930 0x7fa8640b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.568+0000 7fa868e00640 1 --2- 172.21.15.122:0/2162239186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa86406f890 0x7fa8640cd3f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.568+0000 7fa868e00640 1 -- 172.21.15.122:0/2162239186 >> 172.21.15.122:0/2162239186 conn(0x7fa86406bd90 msgr2=0x7fa86406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:27.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.568+0000 7fa868e00640 1 -- 172.21.15.122:0/2162239186 shutdown_connections 2024-05-28T06:09:27.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.568+0000 7fa868e00640 1 -- 172.21.15.122:0/2162239186 wait complete. 2024-05-28T06:09:27.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa868e00640 1 Processor -- start 2024-05-28T06:09:27.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa868e00640 1 -- start start 2024-05-28T06:09:27.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa868e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa86406f890 0x7fa86414cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:27.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa868e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8640cd930 0x7fa86414d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:27.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa868e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8640cff30 0x7fa8640ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:27.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa868e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa8640b5700 con 0x7fa86406f890 2024-05-28T06:09:27.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa868e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa8640b5880 con 0x7fa8640cd930 2024-05-28T06:09:27.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa868e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa8640b5a00 con 0x7fa8640cff30 2024-05-28T06:09:27.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa861e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa86406f890 0x7fa86414cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:27.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa861e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa86406f890 0x7fa86414cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44542/0 (socket says 172.21.15.122:44542) 2024-05-28T06:09:27.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa861e00640 1 -- 172.21.15.122:0/2623756596 learned_addr learned my addr 172.21.15.122:0/2623756596 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:27.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa862800640 1 --2- 172.21.15.122:0/2623756596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8640cff30 0x7fa8640ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:27.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa861400640 1 --2- 172.21.15.122:0/2623756596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8640cd930 0x7fa86414d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:27.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa861e00640 1 -- 172.21.15.122:0/2623756596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8640cff30 msgr2=0x7fa8640ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:27.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa861e00640 1 --2- 172.21.15.122:0/2623756596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8640cff30 0x7fa8640ad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa861e00640 1 -- 172.21.15.122:0/2623756596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8640cd930 msgr2=0x7fa86414d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:27.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa861e00640 1 --2- 172.21.15.122:0/2623756596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8640cd930 0x7fa86414d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa861e00640 1 -- 172.21.15.122:0/2623756596 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8640ae630 con 0x7fa86406f890 2024-05-28T06:09:27.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa861e00640 1 --2- 172.21.15.122:0/2623756596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa86406f890 0x7fa86414cb00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa854007fd0 tx=0x7fa85400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:27.578 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa85a000640 1 -- 172.21.15.122:0/2623756596 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa854017070 con 0x7fa86406f890 2024-05-28T06:09:27.578 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa85a000640 1 -- 172.21.15.122:0/2623756596 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa854005d10 con 0x7fa86406f890 2024-05-28T06:09:27.578 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa868e00640 1 -- 172.21.15.122:0/2623756596 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8640ae910 con 0x7fa86406f890 2024-05-28T06:09:27.578 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa85a000640 1 -- 172.21.15.122:0/2623756596 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa854007310 con 0x7fa86406f890 2024-05-28T06:09:27.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.572+0000 7fa868e00640 1 -- 172.21.15.122:0/2623756596 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa864152f40 con 0x7fa86406f890 2024-05-28T06:09:27.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.576+0000 7fa868e00640 1 -- 172.21.15.122:0/2623756596 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa864068c40 con 0x7fa86406f890 2024-05-28T06:09:27.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.576+0000 7fa85a000640 1 -- 172.21.15.122:0/2623756596 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7fa85401a070 con 0x7fa86406f890 2024-05-28T06:09:27.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.576+0000 7fa85a000640 1 --2- 172.21.15.122:0/2623756596 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa844068650 0x7fa84406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:27.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.576+0000 7fa85a000640 1 -- 172.21.15.122:0/2623756596 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7fa854085e70 con 0x7fa86406f890 2024-05-28T06:09:27.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.576+0000 7fa861400640 1 --2- 172.21.15.122:0/2623756596 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa844068650 0x7fa84406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:27.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.576+0000 7fa861400640 1 --2- 172.21.15.122:0/2623756596 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa844068650 0x7fa84406ab10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa8500b1000 tx=0x7fa850008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:27.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.580+0000 7fa85a000640 1 -- 172.21.15.122:0/2623756596 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa854056470 con 0x7fa86406f890 2024-05-28T06:09:27.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.736+0000 7fa868e00640 1 -- 172.21.15.122:0/2623756596 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa8640ccdf0 con 0x7fa86406f890 2024-05-28T06:09:27.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.740+0000 7fa85a000640 1 -- 172.21.15.122:0/2623756596 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) ==== 93+0+10 (secure 0 0 0) 0x7fa854055d70 con 0x7fa86406f890 2024-05-28T06:09:27.742 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:09:27.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.740+0000 7fa868e00640 1 -- 172.21.15.122:0/2623756596 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa844068650 msgr2=0x7fa84406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:27.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.740+0000 7fa868e00640 1 --2- 172.21.15.122:0/2623756596 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa844068650 0x7fa84406ab10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa8500b1000 tx=0x7fa850008040 comp rx=0 tx=0).stop 2024-05-28T06:09:27.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.740+0000 7fa868e00640 1 -- 172.21.15.122:0/2623756596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa86406f890 msgr2=0x7fa86414cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:27.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.740+0000 7fa868e00640 1 --2- 172.21.15.122:0/2623756596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa86406f890 0x7fa86414cb00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa854007fd0 tx=0x7fa85400c8e0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.740+0000 7fa868e00640 1 -- 172.21.15.122:0/2623756596 shutdown_connections 2024-05-28T06:09:27.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.740+0000 7fa868e00640 1 --2- 172.21.15.122:0/2623756596 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa844068650 0x7fa84406ab10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.740+0000 7fa868e00640 1 --2- 172.21.15.122:0/2623756596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8640cff30 0x7fa8640ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.740+0000 7fa868e00640 1 --2- 172.21.15.122:0/2623756596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8640cd930 0x7fa86414d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.740+0000 7fa868e00640 1 --2- 172.21.15.122:0/2623756596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa86406f890 0x7fa86414cb00 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.740+0000 7fa868e00640 1 -- 172.21.15.122:0/2623756596 >> 172.21.15.122:0/2623756596 conn(0x7fa86406bd90 msgr2=0x7fa86406eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:27.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.740+0000 7fa868e00640 1 -- 172.21.15.122:0/2623756596 shutdown_connections 2024-05-28T06:09:27.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.740+0000 7fa868e00640 1 -- 172.21.15.122:0/2623756596 wait complete. 2024-05-28T06:09:27.763 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones' 2024-05-28T06:09:27.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.896+0000 7f1910c00640 1 Processor -- start 2024-05-28T06:09:27.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.896+0000 7f1910c00640 1 -- start start 2024-05-28T06:09:27.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.896+0000 7f1910c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f190c06f890 0x7f190c0cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:27.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.896+0000 7f1910c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f190c0d0310 con 0x7f190c0cd930 2024-05-28T06:09:27.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.896+0000 7f1910c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f190c15be20 con 0x7f190c0cff30 2024-05-28T06:09:27.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.896+0000 7f1910c00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f190c15c100 con 0x7f190c06f890 2024-05-28T06:09:27.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.896+0000 7f1909400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f190c06f890 0x7f190c0cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:27.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.896+0000 7f1909400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f190c06f890 0x7f190c0cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44546/0 (socket says 172.21.15.122:44546) 2024-05-28T06:09:27.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.896+0000 7f1909400640 1 -- 172.21.15.122:0/4242764785 learned_addr learned my addr 172.21.15.122:0/4242764785 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:27.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.896+0000 7f1909400640 1 -- 172.21.15.122:0/4242764785 >> v1:172.21.15.153:6789/0 conn(0x7f190c0cff30 legacy=0x7f190c06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:27.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.896+0000 7f1909400640 1 -- 172.21.15.122:0/4242764785 >> v1:172.21.15.122:6789/0 conn(0x7f190c0cd930 legacy=0x7f190c0b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:27.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.896+0000 7f1909400640 1 -- 172.21.15.122:0/4242764785 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f190c15c3e0 con 0x7f190c06f890 2024-05-28T06:09:27.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.896+0000 7f1908a00640 1 -- 172.21.15.122:0/4242764785 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1966236655 0 0) 0x7f190c0d0310 con 0x7f190c0cd930 2024-05-28T06:09:27.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.900+0000 7f1909400640 1 --2- 172.21.15.122:0/4242764785 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f190c06f890 0x7f190c0cd3f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f18fc009870 tx=0x7f18fc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76078a19fa0f098 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:27.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.900+0000 7f1908a00640 1 -- 172.21.15.122:0/4242764785 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc0aa5f0 con 0x7f190c06f890 2024-05-28T06:09:27.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.900+0000 7f1908a00640 1 -- 172.21.15.122:0/4242764785 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18fc0af070 con 0x7f190c06f890 2024-05-28T06:09:27.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.900+0000 7f1908a00640 1 -- 172.21.15.122:0/4242764785 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc0aa9b0 con 0x7f190c06f890 2024-05-28T06:09:27.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.900+0000 7f1910c00640 1 -- 172.21.15.122:0/4242764785 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f190c06f890 msgr2=0x7f190c0cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:27.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.900+0000 7f1910c00640 1 --2- 172.21.15.122:0/4242764785 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f190c06f890 0x7f190c0cd3f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f18fc009870 tx=0x7f18fc01c4f0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.900+0000 7f1910c00640 1 -- 172.21.15.122:0/4242764785 shutdown_connections 2024-05-28T06:09:27.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.900+0000 7f1910c00640 1 --2- 172.21.15.122:0/4242764785 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f190c06f890 0x7f190c0cd3f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.900+0000 7f1910c00640 1 -- 172.21.15.122:0/4242764785 >> 172.21.15.122:0/4242764785 conn(0x7f190c06bd90 msgr2=0x7f190c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:27.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.900+0000 7f1910c00640 1 -- 172.21.15.122:0/4242764785 shutdown_connections 2024-05-28T06:09:27.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.900+0000 7f1910c00640 1 -- 172.21.15.122:0/4242764785 wait complete. 2024-05-28T06:09:27.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f1910c00640 1 Processor -- start 2024-05-28T06:09:27.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f1910c00640 1 -- start start 2024-05-28T06:09:27.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f1910c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f190c06f890 0x7f190c152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:27.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f1910c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f190c0cd930 0x7f190c0b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:27.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f1910c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f190c0cff30 0x7f190c150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:27.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f1910c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f190c0b5a50 con 0x7f190c0cff30 2024-05-28T06:09:27.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f1910c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f190c0b58d0 con 0x7f190c0cd930 2024-05-28T06:09:27.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f1910c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f190c0b5bd0 con 0x7f190c06f890 2024-05-28T06:09:27.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f190a800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f190c0cff30 0x7f190c150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:27.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f190a800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f190c0cff30 0x7f190c150370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44556/0 (socket says 172.21.15.122:44556) 2024-05-28T06:09:27.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f190a800640 1 -- 172.21.15.122:0/3226760708 learned_addr learned my addr 172.21.15.122:0/3226760708 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:27.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f1909e00640 1 --2- 172.21.15.122:0/3226760708 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f190c06f890 0x7f190c152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:27.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f1909400640 1 --2- 172.21.15.122:0/3226760708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f190c0cd930 0x7f190c0b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:27.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f190a800640 1 -- 172.21.15.122:0/3226760708 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f190c06f890 msgr2=0x7f190c152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:27.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f190a800640 1 --2- 172.21.15.122:0/3226760708 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f190c06f890 0x7f190c152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f190a800640 1 -- 172.21.15.122:0/3226760708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f190c0cd930 msgr2=0x7f190c0b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:27.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f190a800640 1 --2- 172.21.15.122:0/3226760708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f190c0cd930 0x7f190c0b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:27.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f190a800640 1 -- 172.21.15.122:0/3226760708 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f190c1572a0 con 0x7f190c0cff30 2024-05-28T06:09:27.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f1909e00640 1 --2- 172.21.15.122:0/3226760708 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f190c06f890 0x7f190c152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:09:27.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f1909400640 1 --2- 172.21.15.122:0/3226760708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f190c0cd930 0x7f190c0b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:09:27.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f190a800640 1 --2- 172.21.15.122:0/3226760708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f190c0cff30 0x7f190c150370 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f190400c780 tx=0x7f190400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:27.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f1902000640 1 -- 172.21.15.122:0/3226760708 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1904003db0 con 0x7f190c0cff30 2024-05-28T06:09:27.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f1902000640 1 -- 172.21.15.122:0/3226760708 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1904005070 con 0x7f190c0cff30 2024-05-28T06:09:27.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f1902000640 1 -- 172.21.15.122:0/3226760708 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1904005460 con 0x7f190c0cff30 2024-05-28T06:09:27.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f1910c00640 1 -- 172.21.15.122:0/3226760708 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f190c157580 con 0x7f190c0cff30 2024-05-28T06:09:27.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f1910c00640 1 -- 172.21.15.122:0/3226760708 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f190c157b40 con 0x7f190c0cff30 2024-05-28T06:09:27.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.904+0000 7f1910c00640 1 -- 172.21.15.122:0/3226760708 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f190c068c40 con 0x7f190c0cff30 2024-05-28T06:09:27.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.908+0000 7f1902000640 1 -- 172.21.15.122:0/3226760708 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f1904005600 con 0x7f190c0cff30 2024-05-28T06:09:27.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.908+0000 7f1902000640 1 --2- 172.21.15.122:0/3226760708 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f18e8068650 0x7f18e806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:27.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.908+0000 7f1902000640 1 -- 172.21.15.122:0/3226760708 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f1904086ab0 con 0x7f190c0cff30 2024-05-28T06:09:27.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.908+0000 7f1909e00640 1 --2- 172.21.15.122:0/3226760708 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f18e8068650 0x7f18e806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:27.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.908+0000 7f1909e00640 1 --2- 172.21.15.122:0/3226760708 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f18e8068650 0x7f18e806ab10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f18f4003ec0 tx=0x7f18f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:27.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:27.912+0000 7f1902000640 1 -- 172.21.15.122:0/3226760708 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1904057070 con 0x7f190c0cff30 2024-05-28T06:09:28.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:28.124+0000 7f1910c00640 1 -- 172.21.15.122:0/3226760708 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones"]} v 0) -- 0x7f190c155f70 con 0x7f190c0cff30 2024-05-28T06:09:29.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.068+0000 7f1902000640 1 -- 172.21.15.122:0/3226760708 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones"]}]=0 v187) ==== 165+0+0 (secure 0 0 0) 0x7f1904056970 con 0x7f190c0cff30 2024-05-28T06:09:29.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.072+0000 7f1910c00640 1 -- 172.21.15.122:0/3226760708 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f18e8068650 msgr2=0x7f18e806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:29.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.072+0000 7f1910c00640 1 --2- 172.21.15.122:0/3226760708 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f18e8068650 0x7f18e806ab10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f18f4003ec0 tx=0x7f18f4009040 comp rx=0 tx=0).stop 2024-05-28T06:09:29.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.072+0000 7f1910c00640 1 -- 172.21.15.122:0/3226760708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f190c0cff30 msgr2=0x7f190c150370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:29.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.072+0000 7f1910c00640 1 --2- 172.21.15.122:0/3226760708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f190c0cff30 0x7f190c150370 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f190400c780 tx=0x7f190400cc40 comp rx=0 tx=0).stop 2024-05-28T06:09:29.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.072+0000 7f1910c00640 1 -- 172.21.15.122:0/3226760708 shutdown_connections 2024-05-28T06:09:29.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.072+0000 7f1910c00640 1 --2- 172.21.15.122:0/3226760708 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f18e8068650 0x7f18e806ab10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:29.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.072+0000 7f1910c00640 1 --2- 172.21.15.122:0/3226760708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f190c0cff30 0x7f190c150370 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:29.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.072+0000 7f1910c00640 1 --2- 172.21.15.122:0/3226760708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f190c0cd930 0x7f190c0b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:29.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.072+0000 7f1910c00640 1 --2- 172.21.15.122:0/3226760708 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f190c06f890 0x7f190c152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:29.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.072+0000 7f1910c00640 1 -- 172.21.15.122:0/3226760708 >> 172.21.15.122:0/3226760708 conn(0x7f190c06bd90 msgr2=0x7f190c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:29.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.072+0000 7f1910c00640 1 -- 172.21.15.122:0/3226760708 shutdown_connections 2024-05-28T06:09:29.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.072+0000 7f1910c00640 1 -- 172.21.15.122:0/3226760708 wait complete. 2024-05-28T06:09:29.098 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-28T06:09:29.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.236+0000 7f8c48200640 1 Processor -- start 2024-05-28T06:09:29.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.236+0000 7f8c48200640 1 -- start start 2024-05-28T06:09:29.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.236+0000 7f8c48200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8c40147410 0x7f8c400afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:29.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.236+0000 7f8c48200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c400adac0 0x7f8c4006e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:29.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.236+0000 7f8c48200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c400adf20 con 0x7f8c400722a0 2024-05-28T06:09:29.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.236+0000 7f8c48200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f8c400b5310 con 0x7f8c40147410 2024-05-28T06:09:29.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.236+0000 7f8c48200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8c4006e5b0 con 0x7f8c400adac0 2024-05-28T06:09:29.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.236+0000 7f8c45800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8c40147410 0x7f8c400afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:29.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.240+0000 7f8c45800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8c40147410 0x7f8c400afd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44572/0 (socket says 172.21.15.122:44572) 2024-05-28T06:09:29.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.240+0000 7f8c45800640 1 -- 172.21.15.122:0/2472521550 learned_addr learned my addr 172.21.15.122:0/2472521550 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:29.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.240+0000 7f8c46200640 1 --1- 172.21.15.122:0/2472521550 >> v1:172.21.15.122:6789/0 conn(0x7f8c400722a0 0x7f8c400b5a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:51628/0 (socket says 172.21.15.122:51628) 2024-05-28T06:09:29.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.240+0000 7f8c44e00640 1 --2- 172.21.15.122:0/2472521550 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c400adac0 0x7f8c4006e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:29.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.240+0000 7f8c45800640 1 -- 172.21.15.122:0/2472521550 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c400adac0 msgr2=0x7f8c4006e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:29.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.240+0000 7f8c45800640 1 --2- 172.21.15.122:0/2472521550 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c400adac0 0x7f8c4006e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:29.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.240+0000 7f8c45800640 1 -- 172.21.15.122:0/2472521550 >> v1:172.21.15.122:6789/0 conn(0x7f8c400722a0 legacy=0x7f8c400b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:29.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.240+0000 7f8c45800640 1 -- 172.21.15.122:0/2472521550 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4006e7f0 con 0x7f8c40147410 2024-05-28T06:09:29.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.240+0000 7f8c3fe00640 1 -- 172.21.15.122:0/2472521550 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 711864288 0 0) 0x7f8c38001120 con 0x7f8c400722a0 2024-05-28T06:09:29.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.240+0000 7f8c45800640 1 --2- 172.21.15.122:0/2472521550 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c40147410 0x7f8c400afd30 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8c34009e50 tx=0x7f8c3401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb978a6f65c1d74 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:29.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.240+0000 7f8c3fe00640 1 -- 172.21.15.122:0/2472521550 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c340a5700 con 0x7f8c40147410 2024-05-28T06:09:29.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.240+0000 7f8c3fe00640 1 -- 172.21.15.122:0/2472521550 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c340a58a0 con 0x7f8c40147410 2024-05-28T06:09:29.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.240+0000 7f8c3fe00640 1 -- 172.21.15.122:0/2472521550 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c340a5c70 con 0x7f8c40147410 2024-05-28T06:09:29.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c48200640 1 -- 172.21.15.122:0/2472521550 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c40147410 msgr2=0x7f8c400afd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:29.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c48200640 1 --2- 172.21.15.122:0/2472521550 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c40147410 0x7f8c400afd30 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8c34009e50 tx=0x7f8c3401ca30 comp rx=0 tx=0).stop 2024-05-28T06:09:29.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c48200640 1 -- 172.21.15.122:0/2472521550 shutdown_connections 2024-05-28T06:09:29.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c48200640 1 --2- 172.21.15.122:0/2472521550 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c400adac0 0x7f8c4006e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:29.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c48200640 1 --2- 172.21.15.122:0/2472521550 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c40147410 0x7f8c400afd30 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:29.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c48200640 1 -- 172.21.15.122:0/2472521550 >> 172.21.15.122:0/2472521550 conn(0x7f8c4006bd90 msgr2=0x7f8c4006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:29.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c48200640 1 -- 172.21.15.122:0/2472521550 shutdown_connections 2024-05-28T06:09:29.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c48200640 1 -- 172.21.15.122:0/2472521550 wait complete. 2024-05-28T06:09:29.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c48200640 1 Processor -- start 2024-05-28T06:09:29.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c48200640 1 -- start start 2024-05-28T06:09:29.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c48200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c400722a0 0x7f8c40145650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:29.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c48200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c400adac0 0x7f8c4013f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:29.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c48200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c40147410 0x7f8c40161030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:29.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c48200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8c401477f0 con 0x7f8c400722a0 2024-05-28T06:09:29.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c48200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8c40072b00 con 0x7f8c40147410 2024-05-28T06:09:29.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c48200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8c40147970 con 0x7f8c400adac0 2024-05-28T06:09:29.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c45800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c400722a0 0x7f8c40145650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:29.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c45800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c400722a0 0x7f8c40145650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44580/0 (socket says 172.21.15.122:44580) 2024-05-28T06:09:29.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c45800640 1 -- 172.21.15.122:0/4006903273 learned_addr learned my addr 172.21.15.122:0/4006903273 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:29.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c45800640 1 -- 172.21.15.122:0/4006903273 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c400adac0 msgr2=0x7f8c4013f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:29.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c45800640 1 --2- 172.21.15.122:0/4006903273 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c400adac0 0x7f8c4013f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:29.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c45800640 1 -- 172.21.15.122:0/4006903273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c40147410 msgr2=0x7f8c40161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:29.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c45800640 1 --2- 172.21.15.122:0/4006903273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c40147410 0x7f8c40161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:29.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c45800640 1 -- 172.21.15.122:0/4006903273 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c400b1440 con 0x7f8c400722a0 2024-05-28T06:09:29.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.244+0000 7f8c45800640 1 --2- 172.21.15.122:0/4006903273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c400722a0 0x7f8c40145650 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8c340af040 tx=0x7f8c340197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:29.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.248+0000 7f8c3d600640 1 -- 172.21.15.122:0/4006903273 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c340b8670 con 0x7f8c400722a0 2024-05-28T06:09:29.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.248+0000 7f8c3d600640 1 -- 172.21.15.122:0/4006903273 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c340be070 con 0x7f8c400722a0 2024-05-28T06:09:29.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.248+0000 7f8c3d600640 1 -- 172.21.15.122:0/4006903273 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c340b8a70 con 0x7f8c400722a0 2024-05-28T06:09:29.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.248+0000 7f8c48200640 1 -- 172.21.15.122:0/4006903273 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c40160590 con 0x7f8c400722a0 2024-05-28T06:09:29.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.248+0000 7f8c48200640 1 -- 172.21.15.122:0/4006903273 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c40160250 con 0x7f8c400722a0 2024-05-28T06:09:29.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.248+0000 7f8c48200640 1 -- 172.21.15.122:0/4006903273 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c40068c40 con 0x7f8c400722a0 2024-05-28T06:09:29.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.248+0000 7f8c3d600640 1 -- 172.21.15.122:0/4006903273 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f8c340b8c10 con 0x7f8c400722a0 2024-05-28T06:09:29.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.248+0000 7f8c3d600640 1 --2- 172.21.15.122:0/4006903273 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8c20068680 0x7f8c2006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:29.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.248+0000 7f8c3d600640 1 -- 172.21.15.122:0/4006903273 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f8c34121720 con 0x7f8c400722a0 2024-05-28T06:09:29.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.248+0000 7f8c44e00640 1 --2- 172.21.15.122:0/4006903273 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8c20068680 0x7f8c2006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:29.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.252+0000 7f8c44e00640 1 --2- 172.21.15.122:0/4006903273 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8c20068680 0x7f8c2006ab40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8c40141670 tx=0x7f8c2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:29.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.252+0000 7f8c3d600640 1 -- 172.21.15.122:0/4006903273 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8c340c7020 con 0x7f8c400722a0 2024-05-28T06:09:29.417 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.412+0000 7f8c48200640 1 -- 172.21.15.122:0/4006903273 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8c4006c690 con 0x7f8c400722a0 2024-05-28T06:09:29.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.416+0000 7f8c3d600640 1 -- 172.21.15.122:0/4006903273 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f8c34016620 con 0x7f8c400722a0 2024-05-28T06:09:29.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.420+0000 7f8c48200640 1 -- 172.21.15.122:0/4006903273 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8c20068680 msgr2=0x7f8c2006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:29.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.420+0000 7f8c48200640 1 --2- 172.21.15.122:0/4006903273 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8c20068680 0x7f8c2006ab40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8c40141670 tx=0x7f8c2c008040 comp rx=0 tx=0).stop 2024-05-28T06:09:29.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.420+0000 7f8c48200640 1 -- 172.21.15.122:0/4006903273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c400722a0 msgr2=0x7f8c40145650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:29.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.420+0000 7f8c48200640 1 --2- 172.21.15.122:0/4006903273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c400722a0 0x7f8c40145650 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8c340af040 tx=0x7f8c340197d0 comp rx=0 tx=0).stop 2024-05-28T06:09:29.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.420+0000 7f8c48200640 1 -- 172.21.15.122:0/4006903273 shutdown_connections 2024-05-28T06:09:29.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.420+0000 7f8c48200640 1 --2- 172.21.15.122:0/4006903273 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8c20068680 0x7f8c2006ab40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:29.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.420+0000 7f8c48200640 1 --2- 172.21.15.122:0/4006903273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c40147410 0x7f8c40161030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:29.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.420+0000 7f8c48200640 1 --2- 172.21.15.122:0/4006903273 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c400adac0 0x7f8c4013f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:29.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.420+0000 7f8c48200640 1 --2- 172.21.15.122:0/4006903273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c400722a0 0x7f8c40145650 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:29.424 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.420+0000 7f8c48200640 1 -- 172.21.15.122:0/4006903273 >> 172.21.15.122:0/4006903273 conn(0x7f8c4006bd90 msgr2=0x7f8c4013d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:29.424 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.420+0000 7f8c48200640 1 -- 172.21.15.122:0/4006903273 shutdown_connections 2024-05-28T06:09:29.424 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.420+0000 7f8c48200640 1 -- 172.21.15.122:0/4006903273 wait complete. 2024-05-28T06:09:29.441 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-28T06:09:29.442 DEBUG:teuthology.orchestra.run.smithi122:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-28T06:09:29.526 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-28T06:09:29.629 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-28T06:09:29.630 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:09:29.630 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:09:29.638 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350136k,nr_inodes=4087534,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2578 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-28T06:09:29.638 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:09:29.638 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:09:29.647 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350304k,nr_inodes=4087576,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5271 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-28T06:09:29.647 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:09:29.647 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:09:29.689 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350136k,nr_inodes=4087534,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2578 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-28T06:09:29.689 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:09:29.689 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:09:29.699 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350304k,nr_inodes=4087576,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5271 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-28T06:09:29.699 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-28T06:09:29.699 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:09:29.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.868+0000 7f4c1d000640 1 Processor -- start 2024-05-28T06:09:29.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.868+0000 7f4c1d000640 1 -- start start 2024-05-28T06:09:29.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.868+0000 7f4c1d000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4c180d0270 0x7f4c1809b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:29.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.868+0000 7f4c1d000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4c1815d7e0 0x7f4c180cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:29.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.868+0000 7f4c1d000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c1815dc70 con 0x7f4c180d0c80 2024-05-28T06:09:29.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.868+0000 7f4c1d000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f4c180d0830 con 0x7f4c1815d7e0 2024-05-28T06:09:29.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.868+0000 7f4c1d000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f4c1809aa40 con 0x7f4c180d0270 2024-05-28T06:09:29.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.868+0000 7f4c15e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f4c180d0c80 0x7f4c180d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:51636/0 (socket says 172.21.15.122:51636) 2024-05-28T06:09:29.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.868+0000 7f4c15e00640 1 -- 172.21.15.122:0/2511510965 learned_addr learned my addr 172.21.15.122:0/2511510965 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:29.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.868+0000 7f4c16800640 1 --2- 172.21.15.122:0/2511510965 >> v2:172.21.15.122:3300/0 conn(0x7f4c1815d7e0 0x7f4c180cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:29.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.868+0000 7f4c15400640 1 --2- 172.21.15.122:0/2511510965 >> v2:172.21.15.153:3300/0 conn(0x7f4c180d0270 0x7f4c1809b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:29.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.868+0000 7f4c16800640 1 -- 172.21.15.122:0/2511510965 >> v2:172.21.15.153:3300/0 conn(0x7f4c180d0270 msgr2=0x7f4c1809b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:29.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.868+0000 7f4c16800640 1 --2- 172.21.15.122:0/2511510965 >> v2:172.21.15.153:3300/0 conn(0x7f4c180d0270 0x7f4c1809b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:29.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.868+0000 7f4c16800640 1 -- 172.21.15.122:0/2511510965 >> v1:172.21.15.122:6789/0 conn(0x7f4c180d0c80 legacy=0x7f4c180d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:29.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.868+0000 7f4c16800640 1 -- 172.21.15.122:0/2511510965 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1809ad20 con 0x7f4c1815d7e0 2024-05-28T06:09:29.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.868+0000 7f4c15400640 1 --2- 172.21.15.122:0/2511510965 >> v2:172.21.15.153:3300/0 conn(0x7f4c180d0270 0x7f4c1809b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:09:29.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.872+0000 7f4c16800640 1 --2- 172.21.15.122:0/2511510965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c1815d7e0 0x7f4c180cd1b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4c180a06f0 tx=0x7f4c1001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46cfaed0be95e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:29.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.872+0000 7f4c14a00640 1 -- 172.21.15.122:0/2511510965 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c100b2070 con 0x7f4c1815d7e0 2024-05-28T06:09:29.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.872+0000 7f4c14a00640 1 -- 172.21.15.122:0/2511510965 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c100a5840 con 0x7f4c1815d7e0 2024-05-28T06:09:29.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.872+0000 7f4c14a00640 1 -- 172.21.15.122:0/2511510965 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c100a5c10 con 0x7f4c1815d7e0 2024-05-28T06:09:29.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.872+0000 7f4c1d000640 1 -- 172.21.15.122:0/2511510965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c1815d7e0 msgr2=0x7f4c180cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:29.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.872+0000 7f4c1d000640 1 --2- 172.21.15.122:0/2511510965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c1815d7e0 0x7f4c180cd1b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4c180a06f0 tx=0x7f4c1001c870 comp rx=0 tx=0).stop 2024-05-28T06:09:29.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.872+0000 7f4c1d000640 1 -- 172.21.15.122:0/2511510965 shutdown_connections 2024-05-28T06:09:29.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.872+0000 7f4c1d000640 1 --2- 172.21.15.122:0/2511510965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c1815d7e0 0x7f4c180cd1b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:29.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.872+0000 7f4c1d000640 1 --2- 172.21.15.122:0/2511510965 >> v2:172.21.15.153:3300/0 conn(0x7f4c180d0270 0x7f4c1809b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:29.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.872+0000 7f4c1d000640 1 -- 172.21.15.122:0/2511510965 >> 172.21.15.122:0/2511510965 conn(0x7f4c180b4190 msgr2=0x7f4c180b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:29.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.872+0000 7f4c1d000640 1 -- 172.21.15.122:0/2511510965 shutdown_connections 2024-05-28T06:09:29.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.872+0000 7f4c1d000640 1 -- 172.21.15.122:0/2511510965 wait complete. 2024-05-28T06:09:29.878 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c1d000640 1 Processor -- start 2024-05-28T06:09:29.878 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c1d000640 1 -- start start 2024-05-28T06:09:29.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c1d000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c180d0270 0x7f4c18156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:29.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c1d000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c180d0c80 0x7f4c1815f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:29.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c1d000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c1815d7e0 0x7f4c1815b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:29.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c1d000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4c181697c0 con 0x7f4c180d0270 2024-05-28T06:09:29.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c1d000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4c18169640 con 0x7f4c180d0c80 2024-05-28T06:09:29.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c1d000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4c18169940 con 0x7f4c1815d7e0 2024-05-28T06:09:29.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c15e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c180d0270 0x7f4c18156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:29.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c15e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c180d0270 0x7f4c18156d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44586/0 (socket says 172.21.15.122:44586) 2024-05-28T06:09:29.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c15e00640 1 -- 172.21.15.122:0/3422069480 learned_addr learned my addr 172.21.15.122:0/3422069480 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:29.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c15400640 1 --2- 172.21.15.122:0/3422069480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c180d0c80 0x7f4c1815f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:29.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c16800640 1 --2- 172.21.15.122:0/3422069480 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c1815d7e0 0x7f4c1815b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:29.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c15e00640 1 -- 172.21.15.122:0/3422069480 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c1815d7e0 msgr2=0x7f4c1815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:29.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c15e00640 1 --2- 172.21.15.122:0/3422069480 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c1815d7e0 0x7f4c1815b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:29.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c15e00640 1 -- 172.21.15.122:0/3422069480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c180d0c80 msgr2=0x7f4c1815f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:29.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c15e00640 1 --2- 172.21.15.122:0/3422069480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c180d0c80 0x7f4c1815f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:29.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c15e00640 1 -- 172.21.15.122:0/3422069480 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c18157ce0 con 0x7f4c180d0270 2024-05-28T06:09:29.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c15400640 1 --2- 172.21.15.122:0/3422069480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c180d0c80 0x7f4c1815f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:09:29.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c16800640 1 --2- 172.21.15.122:0/3422069480 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c1815d7e0 0x7f4c1815b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:09:29.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c15e00640 1 --2- 172.21.15.122:0/3422069480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c180d0270 0x7f4c18156d00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800c3a0 tx=0x7f4c0800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:29.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c0e000640 1 -- 172.21.15.122:0/3422069480 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c08017070 con 0x7f4c180d0270 2024-05-28T06:09:29.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c0e000640 1 -- 172.21.15.122:0/3422069480 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c08005cf0 con 0x7f4c180d0270 2024-05-28T06:09:29.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c0e000640 1 -- 172.21.15.122:0/3422069480 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c080072f0 con 0x7f4c180d0270 2024-05-28T06:09:29.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c1d000640 1 -- 172.21.15.122:0/3422069480 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c18157240 con 0x7f4c180d0270 2024-05-28T06:09:29.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.876+0000 7f4c1d000640 1 -- 172.21.15.122:0/3422069480 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c18157f80 con 0x7f4c180d0270 2024-05-28T06:09:29.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.880+0000 7f4c1d000640 1 -- 172.21.15.122:0/3422069480 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c18068c40 con 0x7f4c180d0270 2024-05-28T06:09:29.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.880+0000 7f4c0e000640 1 -- 172.21.15.122:0/3422069480 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f4c0801a070 con 0x7f4c180d0270 2024-05-28T06:09:29.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.880+0000 7f4c0e000640 1 --2- 172.21.15.122:0/3422069480 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4bf8068680 0x7f4bf806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:29.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.880+0000 7f4c0e000640 1 -- 172.21.15.122:0/3422069480 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f4c08085eb0 con 0x7f4c180d0270 2024-05-28T06:09:29.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.880+0000 7f4c15400640 1 --2- 172.21.15.122:0/3422069480 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4bf8068680 0x7f4bf806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:29.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.880+0000 7f4c15400640 1 --2- 172.21.15.122:0/3422069480 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4bf8068680 0x7f4bf806ab40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4c18071de0 tx=0x7f4c04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:29.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:29.884+0000 7f4c0e000640 1 -- 172.21.15.122:0/3422069480 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4c08056390 con 0x7f4c180d0270 2024-05-28T06:09:30.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.080+0000 7f4c1d000640 1 -- 172.21.15.122:0/3422069480 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c180b8620 con 0x7f4c180d0270 2024-05-28T06:09:30.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.080+0000 7f4c0e000640 1 -- 172.21.15.122:0/3422069480 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+3878 (secure 0 0 0) 0x7f4c08055c90 con 0x7f4c180d0270 2024-05-28T06:09:30.085 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:30.085 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1943879237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1943879237},{"type":"v1","addr":"172.21.15.153:6834","nonce":1943879237}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1104849441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1104849441},{"type":"v1","addr":"172.21.15.153:6835","nonce":1104849441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/560614408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":560614408},{"type":"v1","addr":"172.21.15.122:6835","nonce":560614408}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1717460107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1717460107},{"type":"v1","addr":"172.21.15.122:6837","nonce":1717460107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[]} 2024-05-28T06:09:30.085 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 21 2024-05-28T06:09:30.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.084+0000 7f4c1d000640 1 -- 172.21.15.122:0/3422069480 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4bf8068680 msgr2=0x7f4bf806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:30.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.084+0000 7f4c1d000640 1 --2- 172.21.15.122:0/3422069480 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4bf8068680 0x7f4bf806ab40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4c18071de0 tx=0x7f4c04008040 comp rx=0 tx=0).stop 2024-05-28T06:09:30.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.084+0000 7f4c1d000640 1 -- 172.21.15.122:0/3422069480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c180d0270 msgr2=0x7f4c18156d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:30.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.084+0000 7f4c1d000640 1 --2- 172.21.15.122:0/3422069480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c180d0270 0x7f4c18156d00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800c3a0 tx=0x7f4c0800c860 comp rx=0 tx=0).stop 2024-05-28T06:09:30.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.084+0000 7f4c1d000640 1 -- 172.21.15.122:0/3422069480 shutdown_connections 2024-05-28T06:09:30.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.084+0000 7f4c1d000640 1 --2- 172.21.15.122:0/3422069480 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4bf8068680 0x7f4bf806ab40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:30.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.084+0000 7f4c1d000640 1 --2- 172.21.15.122:0/3422069480 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c1815d7e0 0x7f4c1815b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:30.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.084+0000 7f4c1d000640 1 --2- 172.21.15.122:0/3422069480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c180d0c80 0x7f4c1815f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:30.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.084+0000 7f4c1d000640 1 --2- 172.21.15.122:0/3422069480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c180d0270 0x7f4c18156d00 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:30.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.084+0000 7f4c1d000640 1 -- 172.21.15.122:0/3422069480 >> 172.21.15.122:0/3422069480 conn(0x7f4c180b4190 msgr2=0x7f4c180b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:30.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.084+0000 7f4c1d000640 1 -- 172.21.15.122:0/3422069480 shutdown_connections 2024-05-28T06:09:30.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.084+0000 7f4c1d000640 1 -- 172.21.15.122:0/3422069480 wait complete. 2024-05-28T06:09:30.106 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-28T06:09:30.106 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-28T06:09:30.106 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-28T06:09:30.106 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:09:30.106 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-28T06:09:30.106 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-28T06:09:30.107 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-28T06:09:30.107 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:09:30.107 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-28T06:09:30.107 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-28T06:09:30.107 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-28T06:09:30.107 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:09:30.107 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-28T06:09:30.108 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-28T06:09:30.108 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-28T06:09:30.108 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:09:30.119 INFO:tasks.ceph.mds.c:Stopped 2024-05-28T06:09:30.119 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-28T06:09:30.120 INFO:tasks.ceph.mds.a:Stopped 2024-05-28T06:09:30.120 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-28T06:09:30.121 INFO:tasks.ceph.mds.b:Stopped 2024-05-28T06:09:30.122 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-28T06:09:30.122 INFO:tasks.ceph.mds.d:Stopped 2024-05-28T06:09:30.123 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-28T06:09:30.168 INFO:tasks.ceph.mds.c:Started 2024-05-28T06:09:30.168 DEBUG:teuthology.parallel:result is None 2024-05-28T06:09:30.169 INFO:tasks.ceph.mds.a:Started 2024-05-28T06:09:30.169 DEBUG:teuthology.parallel:result is None 2024-05-28T06:09:30.170 INFO:tasks.ceph.mds.b:Started 2024-05-28T06:09:30.170 DEBUG:teuthology.parallel:result is None 2024-05-28T06:09:30.171 INFO:tasks.ceph.mds.d:Started 2024-05-28T06:09:30.172 DEBUG:teuthology.parallel:result is None 2024-05-28T06:09:30.172 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-28T06:09:30.254 INFO:tasks.ceph.mds.c.smithi122.stdout:starting mds.c at 2024-05-28T06:09:30.255 INFO:tasks.ceph.mds.a.smithi122.stdout:starting mds.a at 2024-05-28T06:09:30.261 INFO:tasks.ceph.mds.b.smithi153.stdout:starting mds.b at 2024-05-28T06:09:30.262 INFO:tasks.ceph.mds.d.smithi153.stdout:starting mds.d at 2024-05-28T06:09:30.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.312+0000 7f7e53e00640 1 Processor -- start 2024-05-28T06:09:30.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.312+0000 7f7e53e00640 1 -- start start 2024-05-28T06:09:30.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.312+0000 7f7e53e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7e4c15c860 0x7f7e4c0d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:30.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.312+0000 7f7e53e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e4c0d1030 0x7f7e4c0b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:30.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.312+0000 7f7e53e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e4c0b3430 con 0x7f7e4c0b2c00 2024-05-28T06:09:30.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.312+0000 7f7e53e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f7e4c0cd080 con 0x7f7e4c15c860 2024-05-28T06:09:30.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.312+0000 7f7e53e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7e4c0d1490 con 0x7f7e4c0d1030 2024-05-28T06:09:30.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.312+0000 7f7e51400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7e4c15c860 0x7f7e4c0d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:30.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.312+0000 7f7e51e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f7e4c0b2c00 0x7f7e4c160410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:51640/0 (socket says 172.21.15.122:51640) 2024-05-28T06:09:30.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.312+0000 7f7e51400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7e4c15c860 0x7f7e4c0d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44638/0 (socket says 172.21.15.122:44638) 2024-05-28T06:09:30.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.312+0000 7f7e51e00640 1 -- 172.21.15.122:0/2740857063 learned_addr learned my addr 172.21.15.122:0/2740857063 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:30.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.312+0000 7f7e50a00640 1 --2- 172.21.15.122:0/2740857063 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e4c0d1030 0x7f7e4c0b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:30.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.316+0000 7f7e51400640 1 -- 172.21.15.122:0/2740857063 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e4c0d1030 msgr2=0x7f7e4c0b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:30.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.316+0000 7f7e51400640 1 --2- 172.21.15.122:0/2740857063 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e4c0d1030 0x7f7e4c0b26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:30.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.316+0000 7f7e51400640 1 -- 172.21.15.122:0/2740857063 >> v1:172.21.15.122:6789/0 conn(0x7f7e4c0b2c00 legacy=0x7f7e4c160410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:30.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.316+0000 7f7e51400640 1 -- 172.21.15.122:0/2740857063 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e4c0b3710 con 0x7f7e4c15c860 2024-05-28T06:09:30.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.316+0000 7f7e4be00640 1 -- 172.21.15.122:0/2740857063 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4145483339 0 0) 0x7f7e4c0b3430 con 0x7f7e4c0b2c00 2024-05-28T06:09:30.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.316+0000 7f7e51400640 1 --2- 172.21.15.122:0/2740857063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e4c15c860 0x7f7e4c0d0af0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7e400097c0 tx=0x7f7e4001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7159950e9b2d3e34 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:30.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.316+0000 7f7e4be00640 1 -- 172.21.15.122:0/2740857063 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e400b2070 con 0x7f7e4c15c860 2024-05-28T06:09:30.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.316+0000 7f7e4be00640 1 -- 172.21.15.122:0/2740857063 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e400ad640 con 0x7f7e4c15c860 2024-05-28T06:09:30.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.316+0000 7f7e4be00640 1 -- 172.21.15.122:0/2740857063 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e400ada10 con 0x7f7e4c15c860 2024-05-28T06:09:30.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.316+0000 7f7e53e00640 1 -- 172.21.15.122:0/2740857063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e4c15c860 msgr2=0x7f7e4c0d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:30.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.316+0000 7f7e53e00640 1 --2- 172.21.15.122:0/2740857063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e4c15c860 0x7f7e4c0d0af0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7e400097c0 tx=0x7f7e4001c4a0 comp rx=0 tx=0).stop 2024-05-28T06:09:30.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.316+0000 7f7e53e00640 1 -- 172.21.15.122:0/2740857063 shutdown_connections 2024-05-28T06:09:30.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.316+0000 7f7e53e00640 1 --2- 172.21.15.122:0/2740857063 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e4c0d1030 0x7f7e4c0b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:30.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.316+0000 7f7e53e00640 1 --2- 172.21.15.122:0/2740857063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e4c15c860 0x7f7e4c0d0af0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:30.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.316+0000 7f7e53e00640 1 -- 172.21.15.122:0/2740857063 >> 172.21.15.122:0/2740857063 conn(0x7f7e4c0d26a0 msgr2=0x7f7e4c0d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:30.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.316+0000 7f7e53e00640 1 -- 172.21.15.122:0/2740857063 shutdown_connections 2024-05-28T06:09:30.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.316+0000 7f7e53e00640 1 -- 172.21.15.122:0/2740857063 wait complete. 2024-05-28T06:09:30.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e53e00640 1 Processor -- start 2024-05-28T06:09:30.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e53e00640 1 -- start start 2024-05-28T06:09:30.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e53e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e4c0b2c00 0x7f7e4c0c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:30.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e53e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e4c0d1030 0x7f7e4c14b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:30.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e53e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e4c15c860 0x7f7e4c152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:30.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e53e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c0b31d0 con 0x7f7e4c0d1030 2024-05-28T06:09:30.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e53e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c0b3050 con 0x7f7e4c0b2c00 2024-05-28T06:09:30.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e53e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7e4c169750 con 0x7f7e4c15c860 2024-05-28T06:09:30.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e50a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e4c0d1030 0x7f7e4c14b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:30.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e50a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e4c0d1030 0x7f7e4c14b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44648/0 (socket says 172.21.15.122:44648) 2024-05-28T06:09:30.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e50a00640 1 -- 172.21.15.122:0/3961178882 learned_addr learned my addr 172.21.15.122:0/3961178882 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:30.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e51400640 1 --2- 172.21.15.122:0/3961178882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e4c0b2c00 0x7f7e4c0c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:30.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e51e00640 1 --2- 172.21.15.122:0/3961178882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e4c15c860 0x7f7e4c152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:30.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e51400640 1 -- 172.21.15.122:0/3961178882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e4c15c860 msgr2=0x7f7e4c152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:30.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e51400640 1 --2- 172.21.15.122:0/3961178882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e4c15c860 0x7f7e4c152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:30.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e51400640 1 -- 172.21.15.122:0/3961178882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e4c0d1030 msgr2=0x7f7e4c14b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:30.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e51400640 1 --2- 172.21.15.122:0/3961178882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e4c0d1030 0x7f7e4c14b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:30.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e51400640 1 -- 172.21.15.122:0/3961178882 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e4c0c7700 con 0x7f7e4c0b2c00 2024-05-28T06:09:30.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e50a00640 1 --2- 172.21.15.122:0/3961178882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e4c0d1030 0x7f7e4c14b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:09:30.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e51400640 1 --2- 172.21.15.122:0/3961178882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e4c0b2c00 0x7f7e4c0c71c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c074170 tx=0x7f7e40019240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:30.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e49600640 1 -- 172.21.15.122:0/3961178882 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e400b2040 con 0x7f7e4c0b2c00 2024-05-28T06:09:30.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e49600640 1 -- 172.21.15.122:0/3961178882 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e40004020 con 0x7f7e4c0b2c00 2024-05-28T06:09:30.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e49600640 1 -- 172.21.15.122:0/3961178882 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40006e20 con 0x7f7e4c0b2c00 2024-05-28T06:09:30.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e53e00640 1 -- 172.21.15.122:0/3961178882 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e4c0c7bf0 con 0x7f7e4c0b2c00 2024-05-28T06:09:30.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.320+0000 7f7e53e00640 1 -- 172.21.15.122:0/3961178882 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e4c0c81b0 con 0x7f7e4c0b2c00 2024-05-28T06:09:30.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.324+0000 7f7e53e00640 1 -- 172.21.15.122:0/3961178882 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e4c068bd0 con 0x7f7e4c0b2c00 2024-05-28T06:09:30.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-05-28T06:09:30.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-05-28T06:09:30.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-05-28T06:09:30.330 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.324+0000 7f7e49600640 1 -- 172.21.15.122:0/3961178882 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f7e400bf060 con 0x7f7e4c0b2c00 2024-05-28T06:09:30.330 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.324+0000 7f7e49600640 1 --2- 172.21.15.122:0/3961178882 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7e2c068650 0x7f7e2c06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:30.330 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.324+0000 7f7e49600640 1 -- 172.21.15.122:0/3961178882 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f7e4011fbc0 con 0x7f7e4c0b2c00 2024-05-28T06:09:30.330 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.324+0000 7f7e50a00640 1 --2- 172.21.15.122:0/3961178882 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7e2c068650 0x7f7e2c06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:30.330 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.324+0000 7f7e50a00640 1 --2- 172.21.15.122:0/3961178882 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7e2c068650 0x7f7e2c06ab10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0b2a60 tx=0x7f7e38009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:30.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.328+0000 7f7e49600640 1 -- 172.21.15.122:0/3961178882 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7e40016090 con 0x7f7e4c0b2c00 2024-05-28T06:09:30.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:30.496+0000 7f7e53e00640 1 -- 172.21.15.122:0/3961178882 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7e4c0b8620 con 0x7f7e4c0b2c00 2024-05-28T06:09:31.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.096+0000 7f7e49600640 1 -- 172.21.15.122:0/3961178882 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v41) ==== 97+0+0 (secure 0 0 0) 0x7f7e400efb20 con 0x7f7e4c0b2c00 2024-05-28T06:09:31.098 INFO:teuthology.orchestra.run.smithi122.stderr: removed all blocklist entries 2024-05-28T06:09:31.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.096+0000 7f7e53e00640 1 -- 172.21.15.122:0/3961178882 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7e2c068650 msgr2=0x7f7e2c06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:31.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.096+0000 7f7e53e00640 1 --2- 172.21.15.122:0/3961178882 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7e2c068650 0x7f7e2c06ab10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0b2a60 tx=0x7f7e38009190 comp rx=0 tx=0).stop 2024-05-28T06:09:31.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.096+0000 7f7e53e00640 1 -- 172.21.15.122:0/3961178882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e4c0b2c00 msgr2=0x7f7e4c0c71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:31.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.096+0000 7f7e53e00640 1 --2- 172.21.15.122:0/3961178882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e4c0b2c00 0x7f7e4c0c71c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c074170 tx=0x7f7e40019240 comp rx=0 tx=0).stop 2024-05-28T06:09:31.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.096+0000 7f7e53e00640 1 -- 172.21.15.122:0/3961178882 shutdown_connections 2024-05-28T06:09:31.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.096+0000 7f7e53e00640 1 --2- 172.21.15.122:0/3961178882 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7e2c068650 0x7f7e2c06ab10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.096+0000 7f7e53e00640 1 --2- 172.21.15.122:0/3961178882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e4c15c860 0x7f7e4c152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.096+0000 7f7e53e00640 1 --2- 172.21.15.122:0/3961178882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e4c0d1030 0x7f7e4c14b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.096+0000 7f7e53e00640 1 --2- 172.21.15.122:0/3961178882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e4c0b2c00 0x7f7e4c0c71c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.096+0000 7f7e53e00640 1 -- 172.21.15.122:0/3961178882 >> 172.21.15.122:0/3961178882 conn(0x7f7e4c0d26a0 msgr2=0x7f7e4c074d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:31.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.096+0000 7f7e53e00640 1 -- 172.21.15.122:0/3961178882 shutdown_connections 2024-05-28T06:09:31.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.096+0000 7f7e53e00640 1 -- 172.21.15.122:0/3961178882 wait complete. 2024-05-28T06:09:31.122 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-28T06:09:31.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.260+0000 7fb037200640 1 Processor -- start 2024-05-28T06:09:31.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.260+0000 7fb037200640 1 -- start start 2024-05-28T06:09:31.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.264+0000 7fb037200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb03815ebe0 0x7fb03809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:31.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.264+0000 7fb037200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb0380cd5d0 0x7fb0380cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:31.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.264+0000 7fb037200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb03809bfd0 con 0x7fb0380d0580 2024-05-28T06:09:31.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.264+0000 7fb037200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fb0380c8c10 con 0x7fb0380cd5d0 2024-05-28T06:09:31.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.264+0000 7fb037200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb0380c8ef0 con 0x7fb03815ebe0 2024-05-28T06:09:31.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.264+0000 7fb036800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb0380cd5d0 0x7fb0380cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:31.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.264+0000 7fb02d400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fb0380d0580 0x7fb03809af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:51652/0 (socket says 172.21.15.122:51652) 2024-05-28T06:09:31.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.264+0000 7fb02d400640 1 -- 172.21.15.122:0/778840804 learned_addr learned my addr 172.21.15.122:0/778840804 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:31.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.264+0000 7fb035e00640 1 --2- 172.21.15.122:0/778840804 >> v2:172.21.15.153:3300/0 conn(0x7fb03815ebe0 0x7fb03809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:31.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.264+0000 7fb036800640 1 -- 172.21.15.122:0/778840804 >> v2:172.21.15.153:3300/0 conn(0x7fb03815ebe0 msgr2=0x7fb03809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:31.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.264+0000 7fb036800640 1 --2- 172.21.15.122:0/778840804 >> v2:172.21.15.153:3300/0 conn(0x7fb03815ebe0 0x7fb03809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.264+0000 7fb036800640 1 -- 172.21.15.122:0/778840804 >> v1:172.21.15.122:6789/0 conn(0x7fb0380d0580 legacy=0x7fb03809af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:31.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.264+0000 7fb035400640 1 -- 172.21.15.122:0/778840804 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2611762810 0 0) 0x7fb03809bfd0 con 0x7fb0380d0580 2024-05-28T06:09:31.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.264+0000 7fb036800640 1 -- 172.21.15.122:0/778840804 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0380d0f90 con 0x7fb0380cd5d0 2024-05-28T06:09:31.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.268+0000 7fb036800640 1 --2- 172.21.15.122:0/778840804 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0380cd5d0 0x7fb0380cda20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb03806ffd0 tx=0x7fb03001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab85e24d178e53a server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:31.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.268+0000 7fb035400640 1 -- 172.21.15.122:0/778840804 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0300b2070 con 0x7fb0380cd5d0 2024-05-28T06:09:31.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.268+0000 7fb035400640 1 -- 172.21.15.122:0/778840804 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0300a5900 con 0x7fb0380cd5d0 2024-05-28T06:09:31.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.268+0000 7fb035400640 1 -- 172.21.15.122:0/778840804 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0300a5cd0 con 0x7fb0380cd5d0 2024-05-28T06:09:31.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.268+0000 7fb037200640 1 -- 172.21.15.122:0/778840804 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0380cd5d0 msgr2=0x7fb0380cda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:31.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.268+0000 7fb037200640 1 --2- 172.21.15.122:0/778840804 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0380cd5d0 0x7fb0380cda20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb03806ffd0 tx=0x7fb03001c930 comp rx=0 tx=0).stop 2024-05-28T06:09:31.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.268+0000 7fb037200640 1 -- 172.21.15.122:0/778840804 shutdown_connections 2024-05-28T06:09:31.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.268+0000 7fb037200640 1 --2- 172.21.15.122:0/778840804 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0380cd5d0 0x7fb0380cda20 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.268+0000 7fb037200640 1 --2- 172.21.15.122:0/778840804 >> v2:172.21.15.153:3300/0 conn(0x7fb03815ebe0 0x7fb03809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.268+0000 7fb037200640 1 -- 172.21.15.122:0/778840804 >> 172.21.15.122:0/778840804 conn(0x7fb0380d2470 msgr2=0x7fb0380d2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:31.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.268+0000 7fb037200640 1 -- 172.21.15.122:0/778840804 shutdown_connections 2024-05-28T06:09:31.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.268+0000 7fb037200640 1 -- 172.21.15.122:0/778840804 wait complete. 2024-05-28T06:09:31.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.268+0000 7fb037200640 1 Processor -- start 2024-05-28T06:09:31.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.268+0000 7fb037200640 1 -- start start 2024-05-28T06:09:31.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb037200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0380cd5d0 0x7fb0380b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:31.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb037200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0380d0580 0x7fb038153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:31.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb037200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb03815ebe0 0x7fb0380ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:31.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb037200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb03816b9c0 con 0x7fb0380d0580 2024-05-28T06:09:31.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb037200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb03816b840 con 0x7fb03815ebe0 2024-05-28T06:09:31.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb037200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb03816bb40 con 0x7fb0380cd5d0 2024-05-28T06:09:31.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb02d400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0380d0580 0x7fb038153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:31.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb02d400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0380d0580 0x7fb038153990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44662/0 (socket says 172.21.15.122:44662) 2024-05-28T06:09:31.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb02d400640 1 -- 172.21.15.122:0/1910086640 learned_addr learned my addr 172.21.15.122:0/1910086640 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:31.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb036800640 1 --2- 172.21.15.122:0/1910086640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb03815ebe0 0x7fb0380ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:31.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb035e00640 1 --2- 172.21.15.122:0/1910086640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0380cd5d0 0x7fb0380b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:31.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb02d400640 1 -- 172.21.15.122:0/1910086640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0380cd5d0 msgr2=0x7fb0380b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:31.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb02d400640 1 --2- 172.21.15.122:0/1910086640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0380cd5d0 0x7fb0380b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb02d400640 1 -- 172.21.15.122:0/1910086640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb03815ebe0 msgr2=0x7fb0380ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:31.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb02d400640 1 --2- 172.21.15.122:0/1910086640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb03815ebe0 0x7fb0380ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb02d400640 1 -- 172.21.15.122:0/1910086640 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0380c9540 con 0x7fb0380d0580 2024-05-28T06:09:31.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb02d400640 1 --2- 172.21.15.122:0/1910086640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0380d0580 0x7fb038153990 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb02000c520 tx=0x7fb02000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:31.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb02ea00640 1 -- 172.21.15.122:0/1910086640 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020018070 con 0x7fb0380d0580 2024-05-28T06:09:31.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb02ea00640 1 -- 172.21.15.122:0/1910086640 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0200074e0 con 0x7fb0380d0580 2024-05-28T06:09:31.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb037200640 1 -- 172.21.15.122:0/1910086640 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0381541f0 con 0x7fb0380d0580 2024-05-28T06:09:31.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb02ea00640 1 -- 172.21.15.122:0/1910086640 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0200049f0 con 0x7fb0380d0580 2024-05-28T06:09:31.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb037200640 1 -- 172.21.15.122:0/1910086640 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0380c9ae0 con 0x7fb0380d0580 2024-05-28T06:09:31.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb037200640 1 -- 172.21.15.122:0/1910086640 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb038075620 con 0x7fb0380d0580 2024-05-28T06:09:31.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.272+0000 7fb02ea00640 1 -- 172.21.15.122:0/1910086640 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7fb02001b070 con 0x7fb0380d0580 2024-05-28T06:09:31.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.276+0000 7fb02ea00640 1 --2- 172.21.15.122:0/1910086640 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb014068650 0x7fb01406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:31.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.276+0000 7fb02ea00640 1 -- 172.21.15.122:0/1910086640 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4857+0+0 (secure 0 0 0) 0x7fb020085e80 con 0x7fb0380d0580 2024-05-28T06:09:31.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.276+0000 7fb035e00640 1 --2- 172.21.15.122:0/1910086640 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb014068650 0x7fb01406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:31.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.276+0000 7fb035e00640 1 --2- 172.21.15.122:0/1910086640 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb014068650 0x7fb01406ab10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb028007a60 tx=0x7fb028008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:31.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.280+0000 7fb02ea00640 1 -- 172.21.15.122:0/1910086640 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb020055df0 con 0x7fb0380d0580 2024-05-28T06:09:31.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.488+0000 7fb037200640 1 -- 172.21.15.122:0/1910086640 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb03809bdb0 con 0x7fb0380d0580 2024-05-28T06:09:31.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.488+0000 7fb02ea00640 1 -- 172.21.15.122:0/1910086640 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7fb02005a0f0 con 0x7fb0380d0580 2024-05-28T06:09:31.493 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:31.493 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:09:31.493 INFO:teuthology.orchestra.run.smithi122.stdout: "auth_dump": [ 2024-05-28T06:09:31.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:31.493 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "mds.a", 2024-05-28T06:09:31.494 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQABdFVm1w+ENBAApIn8Y6gj7tEWLXulaHDeUQ==", 2024-05-28T06:09:31.494 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:09:31.494 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:09:31.494 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow *", 2024-05-28T06:09:31.494 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow *", 2024-05-28T06:09:31.494 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:09:31.494 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:31.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:31.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:31.494 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "mds.b", 2024-05-28T06:09:31.494 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQACdFVmGk7xBBAAMqLBLe5planzHBjA6ArHRw==", 2024-05-28T06:09:31.494 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:09:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:09:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow *", 2024-05-28T06:09:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow *", 2024-05-28T06:09:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:09:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "mds.c", 2024-05-28T06:09:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQACdFVmFGgJABAA77ul3s2asGb5MaqgumfSug==", 2024-05-28T06:09:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:09:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:09:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow *", 2024-05-28T06:09:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow *", 2024-05-28T06:09:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:09:31.495 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "mds.d", 2024-05-28T06:09:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQACdFVmJ6bgDhAAyvzv5Q6Q10llEPpP2ZrVMw==", 2024-05-28T06:09:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:09:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:09:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow *", 2024-05-28T06:09:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow *", 2024-05-28T06:09:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:09:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:31.496 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.0", 2024-05-28T06:09:31.497 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAFdFVmyeJQGBAAvF5HlH71HfNSzHJgrGQSeQ==", 2024-05-28T06:09:31.497 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:09:31.497 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:09:31.497 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:09:31.497 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:09:31.497 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:31.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:31.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:31.497 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.1", 2024-05-28T06:09:31.497 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAIdFVm1gb0IhAAfdRRFfamBuhL6VC4fKnd6A==", 2024-05-28T06:09:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:09:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:09:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:09:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:09:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.2", 2024-05-28T06:09:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQALdFVm7g3HLBAA9HywQrCOoZa52bOHJc8Nkw==", 2024-05-28T06:09:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:09:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:09:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:09:31.498 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:09:31.499 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:31.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:31.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:31.499 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.3", 2024-05-28T06:09:31.499 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAOdFVmo7kHOBAATvO+5IkILjPjVVGK09HAQw==", 2024-05-28T06:09:31.499 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:09:31.499 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:09:31.499 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:09:31.499 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:09:31.499 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.4", 2024-05-28T06:09:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAUdFVmlS0xMBAAnznRAYw5OO6Cgn/cfRrcfA==", 2024-05-28T06:09:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:09:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:09:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:09:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:09:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.5", 2024-05-28T06:09:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAXdFVmCcjTORAALJZO51S0QxuOlJVBtTl25A==", 2024-05-28T06:09:31.500 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:09:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:09:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:09:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:09:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.6", 2024-05-28T06:09:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAbdFVmMl0ABxAAPNjpXSKXvza1dAIaFCdesw==", 2024-05-28T06:09:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:09:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:09:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:09:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:09:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:31.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.7", 2024-05-28T06:09:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAedFVmA7ufDxAAPQwbA2Cb+c5sHN6cA1cwbQ==", 2024-05-28T06:09:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:09:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:09:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:09:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:09:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "client.0", 2024-05-28T06:09:31.502 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQACdFVm0fSmExAAkwJTGq732gbcMsBbs84lWw==", 2024-05-28T06:09:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:09:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:09:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow r", 2024-05-28T06:09:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-28T06:09:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "client.1", 2024-05-28T06:09:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQACdFVmrapoHRAAgM01mt0lQsXP/W8G1QETmQ==", 2024-05-28T06:09:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:09:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:09:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow r", 2024-05-28T06:09:31.503 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow rw", 2024-05-28T06:09:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow rwx" 2024-05-28T06:09:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "client.2", 2024-05-28T06:09:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQACdFVmekj8GRAA2pS9myP+ygZmUImxnfgjiw==", 2024-05-28T06:09:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:09:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:09:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow r", 2024-05-28T06:09:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow rw", 2024-05-28T06:09:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow rwx" 2024-05-28T06:09:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:31.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:31.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:31.505 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "client.3", 2024-05-28T06:09:31.505 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQACdFVmwRh0IxAACbmN8+zTza+A3aB9xeRRRg==", 2024-05-28T06:09:31.505 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:09:31.505 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:09:31.505 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow r", 2024-05-28T06:09:31.505 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow rw", 2024-05-28T06:09:31.505 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow rwx" 2024-05-28T06:09:31.505 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:31.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:31.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:31.506 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "client.admin", 2024-05-28T06:09:31.506 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQABdFVmkLXlFxAAP8CCUVIxQMti8qk4wrU4Hw==", 2024-05-28T06:09:31.506 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:09:31.506 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow *", 2024-05-28T06:09:31.506 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow *", 2024-05-28T06:09:31.506 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow *", 2024-05-28T06:09:31.506 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:09:31.506 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:31.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:31.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:31.506 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "mgr.x", 2024-05-28T06:09:31.506 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQABdFVmyM6lLxAACnc16i7218VDdALiqlbb0A==", 2024-05-28T06:09:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:09:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow *", 2024-05-28T06:09:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile mgr", 2024-05-28T06:09:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:09:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:09:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "mgr.y", 2024-05-28T06:09:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQABdFVmnI6oKxAARwnXRnNv2SZ59/x+YyuO6g==", 2024-05-28T06:09:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:09:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow *", 2024-05-28T06:09:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile mgr", 2024-05-28T06:09:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:09:31.507 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:31.508 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:31.508 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-05-28T06:09:31.508 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:09:31.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.492+0000 7fb037200640 1 -- 172.21.15.122:0/1910086640 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb014068650 msgr2=0x7fb01406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:31.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.492+0000 7fb037200640 1 --2- 172.21.15.122:0/1910086640 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb014068650 0x7fb01406ab10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb028007a60 tx=0x7fb028008040 comp rx=0 tx=0).stop 2024-05-28T06:09:31.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.492+0000 7fb037200640 1 -- 172.21.15.122:0/1910086640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0380d0580 msgr2=0x7fb038153990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:31.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.492+0000 7fb037200640 1 --2- 172.21.15.122:0/1910086640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0380d0580 0x7fb038153990 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb02000c520 tx=0x7fb02000c9e0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.492+0000 7fb037200640 1 -- 172.21.15.122:0/1910086640 shutdown_connections 2024-05-28T06:09:31.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.492+0000 7fb037200640 1 --2- 172.21.15.122:0/1910086640 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb014068650 0x7fb01406ab10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.492+0000 7fb037200640 1 --2- 172.21.15.122:0/1910086640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb03815ebe0 0x7fb0380ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.492+0000 7fb037200640 1 --2- 172.21.15.122:0/1910086640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0380d0580 0x7fb038153990 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.492+0000 7fb037200640 1 --2- 172.21.15.122:0/1910086640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0380cd5d0 0x7fb0380b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.492+0000 7fb037200640 1 -- 172.21.15.122:0/1910086640 >> 172.21.15.122:0/1910086640 conn(0x7fb0380d2470 msgr2=0x7fb03809aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:31.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.492+0000 7fb037200640 1 -- 172.21.15.122:0/1910086640 shutdown_connections 2024-05-28T06:09:31.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.492+0000 7fb037200640 1 -- 172.21.15.122:0/1910086640 wait complete. 2024-05-28T06:09:31.516 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:09:31.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.648+0000 7f5ffe200640 1 Processor -- start 2024-05-28T06:09:31.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.648+0000 7f5ffe200640 1 -- start start 2024-05-28T06:09:31.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.648+0000 7f5ffe200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ff815f740 0x7f5ff8167240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:31.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.648+0000 7f5ffe200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff815d970 con 0x7f5ff80ce4f0 2024-05-28T06:09:31.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.648+0000 7f5ffe200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff815dc50 con 0x7f5ff80b58d0 2024-05-28T06:09:31.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.648+0000 7f5ffe200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff815df30 con 0x7f5ff815f740 2024-05-28T06:09:31.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5feea00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f5ff80ce4f0 0x7f5ff80ce980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:51658/0 (socket says 172.21.15.122:51658) 2024-05-28T06:09:31.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5feea00640 1 -- 172.21.15.122:0/1614727101 learned_addr learned my addr 172.21.15.122:0/1614727101 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:31.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff7e00640 1 --2- 172.21.15.122:0/1614727101 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ff815f740 0x7f5ff8167240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:31.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff6a00640 1 -- 172.21.15.122:0/1614727101 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3263656439 0 0) 0x7f5ff815d970 con 0x7f5ff80ce4f0 2024-05-28T06:09:31.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff6a00640 1 -- 172.21.15.122:0/1614727101 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fdc003530 con 0x7f5ff80ce4f0 2024-05-28T06:09:31.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff6a00640 1 -- 172.21.15.122:0/1614727101 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2462408406 0 0) 0x7f5ff815dc50 con 0x7f5ff80b58d0 2024-05-28T06:09:31.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff6a00640 1 -- 172.21.15.122:0/1614727101 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ff815d970 con 0x7f5ff80b58d0 2024-05-28T06:09:31.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff6a00640 1 -- 172.21.15.122:0/1614727101 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 365860159 0 0) 0x7f5fdc003530 con 0x7f5ff80ce4f0 2024-05-28T06:09:31.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff6a00640 1 -- 172.21.15.122:0/1614727101 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ff815f740 msgr2=0x7f5ff8167240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:31.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff6a00640 1 --2- 172.21.15.122:0/1614727101 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ff815f740 0x7f5ff8167240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff6a00640 1 -- 172.21.15.122:0/1614727101 >> v1:172.21.15.153:6789/0 conn(0x7f5ff80b58d0 legacy=0x7f5ff80b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:31.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff6a00640 1 -- 172.21.15.122:0/1614727101 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff815e210 con 0x7f5ff80ce4f0 2024-05-28T06:09:31.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff6a00640 1 -- 172.21.15.122:0/1614727101 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f5fe0001680 con 0x7f5ff80ce4f0 2024-05-28T06:09:31.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff6a00640 1 -- 172.21.15.122:0/1614727101 >> v1:172.21.15.122:6789/0 conn(0x7f5ff80ce4f0 legacy=0x7f5ff80ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:31.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff6a00640 1 --2- 172.21.15.122:0/1614727101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5fdc003b80 0x7f5fdc003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:31.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff6a00640 1 --2- 172.21.15.122:0/1614727101 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ff815f740 0x7f5fdc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:31.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff6a00640 1 --2- 172.21.15.122:0/1614727101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fdc004d50 0x7f5fdc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:31.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff6a00640 1 -- 172.21.15.122:0/1614727101 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff815df30 con 0x7f5fdc003b80 2024-05-28T06:09:31.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff6a00640 1 -- 172.21.15.122:0/1614727101 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5fdc00ba80 con 0x7f5fdc004d50 2024-05-28T06:09:31.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff6a00640 1 -- 172.21.15.122:0/1614727101 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5fdc00bc80 con 0x7f5ff815f740 2024-05-28T06:09:31.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff7400640 1 --2- 172.21.15.122:0/1614727101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5fdc003b80 0x7f5fdc003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:31.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff7e00640 1 --2- 172.21.15.122:0/1614727101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fdc004d50 0x7f5fdc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:31.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5feea00640 1 --2- 172.21.15.122:0/1614727101 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ff815f740 0x7f5fdc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:31.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff7400640 1 -- 172.21.15.122:0/1614727101 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ff815f740 msgr2=0x7f5fdc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:31.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff7400640 1 --2- 172.21.15.122:0/1614727101 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ff815f740 0x7f5fdc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff7400640 1 -- 172.21.15.122:0/1614727101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fdc004d50 msgr2=0x7f5fdc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:31.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff7400640 1 --2- 172.21.15.122:0/1614727101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fdc004d50 0x7f5fdc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.652+0000 7f5ff7400640 1 -- 172.21.15.122:0/1614727101 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fdc003530 con 0x7f5fdc003b80 2024-05-28T06:09:31.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.656+0000 7f5ff7400640 1 --2- 172.21.15.122:0/1614727101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5fdc003b80 0x7f5fdc003f80 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80018d0 tx=0x7f5fe801c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a2ee38ef04957 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:31.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.656+0000 7f5ff6a00640 1 -- 172.21.15.122:0/1614727101 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8001520 con 0x7f5fdc003b80 2024-05-28T06:09:31.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.656+0000 7f5ff6a00640 1 -- 172.21.15.122:0/1614727101 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe80052f0 con 0x7f5fdc003b80 2024-05-28T06:09:31.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.656+0000 7f5ff6a00640 1 -- 172.21.15.122:0/1614727101 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8003840 con 0x7f5fdc003b80 2024-05-28T06:09:31.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.656+0000 7f5ffe200640 1 -- 172.21.15.122:0/1614727101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5fdc003b80 msgr2=0x7f5fdc003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:31.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.656+0000 7f5ffe200640 1 --2- 172.21.15.122:0/1614727101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5fdc003b80 0x7f5fdc003f80 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80018d0 tx=0x7f5fe801c580 comp rx=0 tx=0).stop 2024-05-28T06:09:31.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.656+0000 7f5ff7e00640 1 -- 172.21.15.122:0/1614727101 reap_dead start 2024-05-28T06:09:31.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.656+0000 7f5ffe200640 1 -- 172.21.15.122:0/1614727101 shutdown_connections 2024-05-28T06:09:31.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.656+0000 7f5ffe200640 1 -- 172.21.15.122:0/1614727101 >> 172.21.15.122:0/1614727101 conn(0x7f5ff806bd90 msgr2=0x7f5ff806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:31.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.656+0000 7f5ffe200640 1 -- 172.21.15.122:0/1614727101 shutdown_connections 2024-05-28T06:09:31.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.656+0000 7f5ffe200640 1 -- 172.21.15.122:0/1614727101 wait complete. 2024-05-28T06:09:31.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.656+0000 7f5ffe200640 1 Processor -- start 2024-05-28T06:09:31.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.656+0000 7f5ffe200640 1 -- start start 2024-05-28T06:09:31.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.656+0000 7f5ffe200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fdc003b80 0x7f5ff8136cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:31.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.656+0000 7f5ffe200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ff815c070 0x7f5ff815b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:31.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.656+0000 7f5ffe200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ff81431a0 0x7f5ff8143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:31.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.656+0000 7f5ffe200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff8167de0 con 0x7f5ff815c070 2024-05-28T06:09:31.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.656+0000 7f5ffe200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff8167c60 con 0x7f5ff81431a0 2024-05-28T06:09:31.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.660+0000 7f5ffe200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff8167f60 con 0x7f5fdc003b80 2024-05-28T06:09:31.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.660+0000 7f5feea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ff815c070 0x7f5ff815b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:31.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.660+0000 7f5feea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ff815c070 0x7f5ff815b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44674/0 (socket says 172.21.15.122:44674) 2024-05-28T06:09:31.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.660+0000 7f5feea00640 1 -- 172.21.15.122:0/3673550310 learned_addr learned my addr 172.21.15.122:0/3673550310 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:31.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.660+0000 7f5ff7e00640 1 --2- 172.21.15.122:0/3673550310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ff81431a0 0x7f5ff8143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:31.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.660+0000 7f5ff7400640 1 --2- 172.21.15.122:0/3673550310 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fdc003b80 0x7f5ff8136cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:31.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.660+0000 7f5feea00640 1 -- 172.21.15.122:0/3673550310 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fdc003b80 msgr2=0x7f5ff8136cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:31.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.660+0000 7f5feea00640 1 --2- 172.21.15.122:0/3673550310 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fdc003b80 0x7f5ff8136cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.660+0000 7f5feea00640 1 -- 172.21.15.122:0/3673550310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ff81431a0 msgr2=0x7f5ff8143620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:31.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.660+0000 7f5feea00640 1 --2- 172.21.15.122:0/3673550310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ff81431a0 0x7f5ff8143620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.660+0000 7f5feea00640 1 -- 172.21.15.122:0/3673550310 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff80cdac0 con 0x7f5ff815c070 2024-05-28T06:09:31.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.660+0000 7f5ff7400640 1 --2- 172.21.15.122:0/3673550310 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fdc003b80 0x7f5ff8136cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:09:31.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.660+0000 7f5feea00640 1 --2- 172.21.15.122:0/3673550310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ff815c070 0x7f5ff815b810 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000e710 tx=0x7f5fe000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:31.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.660+0000 7f5fefe00640 1 -- 172.21.15.122:0/3673550310 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe000ee20 con 0x7f5ff815c070 2024-05-28T06:09:31.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.660+0000 7f5fefe00640 1 -- 172.21.15.122:0/3673550310 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe0018070 con 0x7f5ff815c070 2024-05-28T06:09:31.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.660+0000 7f5fefe00640 1 -- 172.21.15.122:0/3673550310 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe000cb10 con 0x7f5ff815c070 2024-05-28T06:09:31.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.660+0000 7f5ffe200640 1 -- 172.21.15.122:0/3673550310 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff8137590 con 0x7f5ff815c070 2024-05-28T06:09:31.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.660+0000 7f5ffe200640 1 -- 172.21.15.122:0/3673550310 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff813fe30 con 0x7f5ff815c070 2024-05-28T06:09:31.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.660+0000 7f5ffe200640 1 -- 172.21.15.122:0/3673550310 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff8068c40 con 0x7f5ff815c070 2024-05-28T06:09:31.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.660+0000 7f5fefe00640 1 -- 172.21.15.122:0/3673550310 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f5fe000ccb0 con 0x7f5ff815c070 2024-05-28T06:09:31.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.664+0000 7f5fefe00640 1 --2- 172.21.15.122:0/3673550310 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5fd4068650 0x7f5fd406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:31.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.664+0000 7f5fefe00640 1 -- 172.21.15.122:0/3673550310 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4857+0+0 (secure 0 0 0) 0x7f5fe00868d0 con 0x7f5ff815c070 2024-05-28T06:09:31.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.664+0000 7f5ff7400640 1 --2- 172.21.15.122:0/3673550310 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5fd4068650 0x7f5fd406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:31.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.664+0000 7f5ff7400640 1 --2- 172.21.15.122:0/3673550310 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5fd4068650 0x7f5fd406ab10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80ac000 tx=0x7f5fe80a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:31.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.668+0000 7f5fefe00640 1 -- 172.21.15.122:0/3673550310 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5fe0056f20 con 0x7f5ff815c070 2024-05-28T06:09:31.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.828+0000 7f5ffe200640 1 -- 172.21.15.122:0/3673550310 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ff813e4e0 con 0x7f5ff815c070 2024-05-28T06:09:31.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.828+0000 7f5fefe00640 1 -- 172.21.15.122:0/3673550310 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+12891 (secure 0 0 0) 0x7f5fe0056820 con 0x7f5ff815c070 2024-05-28T06:09:31.831 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:31.831 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":43,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:09:31.106129+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:09:31.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.828+0000 7f5ffe200640 1 -- 172.21.15.122:0/3673550310 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5fd4068650 msgr2=0x7f5fd406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:31.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.828+0000 7f5ffe200640 1 --2- 172.21.15.122:0/3673550310 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5fd4068650 0x7f5fd406ab10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80ac000 tx=0x7f5fe80a6000 comp rx=0 tx=0).stop 2024-05-28T06:09:31.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.828+0000 7f5ffe200640 1 -- 172.21.15.122:0/3673550310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ff815c070 msgr2=0x7f5ff815b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:31.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.828+0000 7f5ffe200640 1 --2- 172.21.15.122:0/3673550310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ff815c070 0x7f5ff815b810 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000e710 tx=0x7f5fe000ebd0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.828+0000 7f5ffe200640 1 -- 172.21.15.122:0/3673550310 shutdown_connections 2024-05-28T06:09:31.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.828+0000 7f5ffe200640 1 --2- 172.21.15.122:0/3673550310 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5fd4068650 0x7f5fd406ab10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.828+0000 7f5ffe200640 1 --2- 172.21.15.122:0/3673550310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ff81431a0 0x7f5ff8143620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.828+0000 7f5ffe200640 1 --2- 172.21.15.122:0/3673550310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ff815c070 0x7f5ff815b810 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.828+0000 7f5ffe200640 1 --2- 172.21.15.122:0/3673550310 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5fdc003b80 0x7f5ff8136cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.828+0000 7f5ffe200640 1 -- 172.21.15.122:0/3673550310 >> 172.21.15.122:0/3673550310 conn(0x7f5ff806bd90 msgr2=0x7f5ff8074d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:31.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.828+0000 7f5ffe200640 1 -- 172.21.15.122:0/3673550310 shutdown_connections 2024-05-28T06:09:31.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.828+0000 7f5ffe200640 1 -- 172.21.15.122:0/3673550310 wait complete. 2024-05-28T06:09:31.853 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:09:31.854 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:09:31.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.988+0000 7f82b2800640 1 Processor -- start 2024-05-28T06:09:31.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.988+0000 7f82b2800640 1 -- start start 2024-05-28T06:09:31.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.992+0000 7f82b2800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82ac0cff30 0x7f82ac06f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:31.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.992+0000 7f82b2800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f82ac0cdb00 0x7f82ac0b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:31.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.992+0000 7f82b2800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82ac0d0310 con 0x7f82ac06f6c0 2024-05-28T06:09:31.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.992+0000 7f82b2800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f82ac06fb00 con 0x7f82ac0cdb00 2024-05-28T06:09:31.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.992+0000 7f82b2800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f82ac0cdf30 con 0x7f82ac0cff30 2024-05-28T06:09:31.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.992+0000 7f82ab400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82ac0cff30 0x7f82ac06f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:31.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.992+0000 7f82abe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f82ac0cdb00 0x7f82ac0b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:31.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.992+0000 7f82ab400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82ac0cff30 0x7f82ac06f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:49500/0 (socket says 172.21.15.122:49500) 2024-05-28T06:09:31.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.992+0000 7f82ab400640 1 -- 172.21.15.122:0/4255476278 learned_addr learned my addr 172.21.15.122:0/4255476278 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:31.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.992+0000 7f82aaa00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f82ac06f6c0 0x7f82ac0cd3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:51126/0 (socket says 172.21.15.122:51126) 2024-05-28T06:09:31.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.992+0000 7f82ab400640 1 -- 172.21.15.122:0/4255476278 >> v2:172.21.15.153:3300/0 conn(0x7f82ac0cdb00 msgr2=0x7f82ac0b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:31.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.992+0000 7f82ab400640 1 --2- 172.21.15.122:0/4255476278 >> v2:172.21.15.153:3300/0 conn(0x7f82ac0cdb00 0x7f82ac0b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:31.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.992+0000 7f82ab400640 1 -- 172.21.15.122:0/4255476278 >> v1:172.21.15.153:6789/0 conn(0x7f82ac06f6c0 legacy=0x7f82ac0cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:31.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.992+0000 7f82ab400640 1 -- 172.21.15.122:0/4255476278 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82ac15be20 con 0x7f82ac0cff30 2024-05-28T06:09:31.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.992+0000 7f82abe00640 1 --2- 172.21.15.122:0/4255476278 >> v2:172.21.15.153:3300/0 conn(0x7f82ac0cdb00 0x7f82ac0b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:09:31.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.996+0000 7f82ab400640 1 --2- 172.21.15.122:0/4255476278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82ac0cff30 0x7f82ac06f180 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f829c00bb10 tx=0x7f829c01ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d21ef60514db1477 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:31.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.996+0000 7f82aa000640 1 -- 172.21.15.122:0/4255476278 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c0b4070 con 0x7f82ac0cff30 2024-05-28T06:09:31.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.996+0000 7f82aa000640 1 -- 172.21.15.122:0/4255476278 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829c0a7cd0 con 0x7f82ac0cff30 2024-05-28T06:09:31.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.996+0000 7f82aa000640 1 -- 172.21.15.122:0/4255476278 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c0af660 con 0x7f82ac0cff30 2024-05-28T06:09:31.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.996+0000 7f82b2800640 1 -- 172.21.15.122:0/4255476278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82ac0cff30 msgr2=0x7f82ac06f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:31.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.996+0000 7f82b2800640 1 --2- 172.21.15.122:0/4255476278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82ac0cff30 0x7f82ac06f180 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f829c00bb10 tx=0x7f829c01ec00 comp rx=0 tx=0).stop 2024-05-28T06:09:31.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.996+0000 7f82b2800640 1 -- 172.21.15.122:0/4255476278 shutdown_connections 2024-05-28T06:09:31.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.996+0000 7f82b2800640 1 --2- 172.21.15.122:0/4255476278 >> v2:172.21.15.153:3300/0 conn(0x7f82ac0cdb00 0x7f82ac0b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:32.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.996+0000 7f82b2800640 1 --2- 172.21.15.122:0/4255476278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82ac0cff30 0x7f82ac06f180 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:32.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.996+0000 7f82b2800640 1 -- 172.21.15.122:0/4255476278 >> 172.21.15.122:0/4255476278 conn(0x7f82ac06bd90 msgr2=0x7f82ac06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:32.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.996+0000 7f82b2800640 1 -- 172.21.15.122:0/4255476278 shutdown_connections 2024-05-28T06:09:32.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.996+0000 7f82b2800640 1 -- 172.21.15.122:0/4255476278 wait complete. 2024-05-28T06:09:32.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.996+0000 7f82b2800640 1 Processor -- start 2024-05-28T06:09:32.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:31.996+0000 7f82b2800640 1 -- start start 2024-05-28T06:09:32.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82b2800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82ac06f6c0 0x7f82ac148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:32.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82b2800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82ac0cdb00 0x7f82ac144370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:32.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82b2800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82ac0cff30 0x7f82ac154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:32.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82b2800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f82ac0b5700 con 0x7f82ac0cdb00 2024-05-28T06:09:32.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82b2800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f82ac15baf0 con 0x7f82ac0cff30 2024-05-28T06:09:32.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82b2800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f82ac0b5880 con 0x7f82ac06f6c0 2024-05-28T06:09:32.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82aaa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82ac0cdb00 0x7f82ac144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:32.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82ab400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82ac06f6c0 0x7f82ac148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:32.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82aaa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82ac0cdb00 0x7f82ac144370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44678/0 (socket says 172.21.15.122:44678) 2024-05-28T06:09:32.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82aaa00640 1 -- 172.21.15.122:0/3340724381 learned_addr learned my addr 172.21.15.122:0/3340724381 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:32.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82abe00640 1 --2- 172.21.15.122:0/3340724381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82ac0cff30 0x7f82ac154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:32.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82aaa00640 1 -- 172.21.15.122:0/3340724381 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82ac06f6c0 msgr2=0x7f82ac148460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:32.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82aaa00640 1 --2- 172.21.15.122:0/3340724381 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82ac06f6c0 0x7f82ac148460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:32.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82aaa00640 1 -- 172.21.15.122:0/3340724381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82ac0cff30 msgr2=0x7f82ac154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:32.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82aaa00640 1 --2- 172.21.15.122:0/3340724381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82ac0cff30 0x7f82ac154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:32.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82aaa00640 1 -- 172.21.15.122:0/3340724381 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82ac144c40 con 0x7f82ac0cdb00 2024-05-28T06:09:32.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82ab400640 1 --2- 172.21.15.122:0/3340724381 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82ac06f6c0 0x7f82ac148460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:09:32.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82aaa00640 1 --2- 172.21.15.122:0/3340724381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82ac0cdb00 0x7f82ac144370 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f829800c420 tx=0x7f829800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:32.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82a3400640 1 -- 172.21.15.122:0/3340724381 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82980074e0 con 0x7f82ac0cdb00 2024-05-28T06:09:32.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82a3400640 1 -- 172.21.15.122:0/3340724381 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82980076a0 con 0x7f82ac0cdb00 2024-05-28T06:09:32.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82a3400640 1 -- 172.21.15.122:0/3340724381 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8298004a30 con 0x7f82ac0cdb00 2024-05-28T06:09:32.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82b2800640 1 -- 172.21.15.122:0/3340724381 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82ac144ee0 con 0x7f82ac0cdb00 2024-05-28T06:09:32.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82b2800640 1 -- 172.21.15.122:0/3340724381 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82ac1466b0 con 0x7f82ac0cdb00 2024-05-28T06:09:32.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82b2800640 1 -- 172.21.15.122:0/3340724381 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82ac068c40 con 0x7f82ac0cdb00 2024-05-28T06:09:32.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.000+0000 7f82a3400640 1 -- 172.21.15.122:0/3340724381 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f829801a020 con 0x7f82ac0cdb00 2024-05-28T06:09:32.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.004+0000 7f82a3400640 1 --2- 172.21.15.122:0/3340724381 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f828c068650 0x7f828c06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:32.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.004+0000 7f82a3400640 1 -- 172.21.15.122:0/3340724381 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4857+0+0 (secure 0 0 0) 0x7f82980861a0 con 0x7f82ac0cdb00 2024-05-28T06:09:32.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.004+0000 7f82ab400640 1 --2- 172.21.15.122:0/3340724381 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f828c068650 0x7f828c06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:32.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.004+0000 7f82ab400640 1 --2- 172.21.15.122:0/3340724381 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f828c068650 0x7f828c06ab10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f829c0b1000 tx=0x7f829c0a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:32.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.008+0000 7f82a3400640 1 -- 172.21.15.122:0/3340724381 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8298056760 con 0x7f82ac0cdb00 2024-05-28T06:09:32.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.168+0000 7f82b2800640 1 -- 172.21.15.122:0/3340724381 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f82ac0ccdf0 con 0x7f82ac0cdb00 2024-05-28T06:09:32.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.168+0000 7f82a3400640 1 -- 172.21.15.122:0/3340724381 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) ==== 93+0+10 (secure 0 0 0) 0x7f8298056060 con 0x7f82ac0cdb00 2024-05-28T06:09:32.173 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:09:32.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.172+0000 7f82b2800640 1 -- 172.21.15.122:0/3340724381 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f828c068650 msgr2=0x7f828c06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:32.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.172+0000 7f82b2800640 1 --2- 172.21.15.122:0/3340724381 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f828c068650 0x7f828c06ab10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f829c0b1000 tx=0x7f829c0a9070 comp rx=0 tx=0).stop 2024-05-28T06:09:32.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.172+0000 7f82b2800640 1 -- 172.21.15.122:0/3340724381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82ac0cdb00 msgr2=0x7f82ac144370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:32.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.172+0000 7f82b2800640 1 --2- 172.21.15.122:0/3340724381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82ac0cdb00 0x7f82ac144370 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f829800c420 tx=0x7f829800c820 comp rx=0 tx=0).stop 2024-05-28T06:09:32.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.172+0000 7f82b2800640 1 -- 172.21.15.122:0/3340724381 shutdown_connections 2024-05-28T06:09:32.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.172+0000 7f82b2800640 1 --2- 172.21.15.122:0/3340724381 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f828c068650 0x7f828c06ab10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:32.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.172+0000 7f82b2800640 1 --2- 172.21.15.122:0/3340724381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82ac0cff30 0x7f82ac154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:32.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.172+0000 7f82b2800640 1 --2- 172.21.15.122:0/3340724381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82ac0cdb00 0x7f82ac144370 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:32.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.172+0000 7f82b2800640 1 --2- 172.21.15.122:0/3340724381 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82ac06f6c0 0x7f82ac148460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:32.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.172+0000 7f82b2800640 1 -- 172.21.15.122:0/3340724381 >> 172.21.15.122:0/3340724381 conn(0x7f82ac06bd90 msgr2=0x7f82ac15a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:32.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.172+0000 7f82b2800640 1 -- 172.21.15.122:0/3340724381 shutdown_connections 2024-05-28T06:09:32.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.172+0000 7f82b2800640 1 -- 172.21.15.122:0/3340724381 wait complete. 2024-05-28T06:09:32.194 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-28T06:09:32.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.328+0000 7f6b29600640 1 Processor -- start 2024-05-28T06:09:32.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.328+0000 7f6b29600640 1 -- start start 2024-05-28T06:09:32.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.328+0000 7f6b29600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b24160510 0x7f6b2409b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:32.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.328+0000 7f6b29600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6b241608f0 0x7f6b2415d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:32.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.328+0000 7f6b29600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b240cd3c0 con 0x7f6b2409b990 2024-05-28T06:09:32.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.328+0000 7f6b29600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6b240cd6a0 con 0x7f6b241608f0 2024-05-28T06:09:32.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.328+0000 7f6b29600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6b240cd980 con 0x7f6b24160510 2024-05-28T06:09:32.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.328+0000 7f6b23400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f6b2409b990 0x7f6b240d00a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:51668/0 (socket says 172.21.15.122:51668) 2024-05-28T06:09:32.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.328+0000 7f6b23400640 1 -- 172.21.15.122:0/746624252 learned_addr learned my addr 172.21.15.122:0/746624252 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:32.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.328+0000 7f6b23e00640 1 --2- 172.21.15.122:0/746624252 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b24160510 0x7f6b2409b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:32.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.328+0000 7f6b28c00640 1 --2- 172.21.15.122:0/746624252 >> v2:172.21.15.153:3300/0 conn(0x7f6b241608f0 0x7f6b2415d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:32.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.332+0000 7f6b22a00640 1 -- 172.21.15.122:0/746624252 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3576355681 0 0) 0x7f6b240cd3c0 con 0x7f6b2409b990 2024-05-28T06:09:32.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.332+0000 7f6b22a00640 1 -- 172.21.15.122:0/746624252 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b08003530 con 0x7f6b2409b990 2024-05-28T06:09:32.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.332+0000 7f6b23e00640 1 -- 172.21.15.122:0/746624252 >> v2:172.21.15.153:3300/0 conn(0x7f6b241608f0 msgr2=0x7f6b2415d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:32.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.332+0000 7f6b23e00640 1 --2- 172.21.15.122:0/746624252 >> v2:172.21.15.153:3300/0 conn(0x7f6b241608f0 0x7f6b2415d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:32.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.332+0000 7f6b23e00640 1 -- 172.21.15.122:0/746624252 >> v1:172.21.15.122:6789/0 conn(0x7f6b2409b990 legacy=0x7f6b240d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:32.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.332+0000 7f6b22a00640 1 -- 172.21.15.122:0/746624252 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2726650790 0 0) 0x7f6b08003530 con 0x7f6b2409b990 2024-05-28T06:09:32.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.332+0000 7f6b23e00640 1 -- 172.21.15.122:0/746624252 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b240cdc60 con 0x7f6b24160510 2024-05-28T06:09:32.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.332+0000 7f6b28c00640 1 --2- 172.21.15.122:0/746624252 >> v2:172.21.15.153:3300/0 conn(0x7f6b241608f0 0x7f6b2415d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:09:32.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.332+0000 7f6b23e00640 1 --2- 172.21.15.122:0/746624252 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b24160510 0x7f6b2409b450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6b14009d90 tx=0x7f6b1401f080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=975f45c6824125b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:32.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.332+0000 7f6b22a00640 1 -- 172.21.15.122:0/746624252 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b140b5070 con 0x7f6b24160510 2024-05-28T06:09:32.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.332+0000 7f6b22a00640 1 -- 172.21.15.122:0/746624252 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b140a8bd0 con 0x7f6b24160510 2024-05-28T06:09:32.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.332+0000 7f6b22a00640 1 -- 172.21.15.122:0/746624252 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b10001680 con 0x7f6b24160510 2024-05-28T06:09:32.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b29600640 1 -- 172.21.15.122:0/746624252 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b24160510 msgr2=0x7f6b2409b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:32.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b29600640 1 --2- 172.21.15.122:0/746624252 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b24160510 0x7f6b2409b450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6b14009d90 tx=0x7f6b1401f080 comp rx=0 tx=0).stop 2024-05-28T06:09:32.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b29600640 1 -- 172.21.15.122:0/746624252 shutdown_connections 2024-05-28T06:09:32.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b29600640 1 --2- 172.21.15.122:0/746624252 >> v2:172.21.15.153:3300/0 conn(0x7f6b241608f0 0x7f6b2415d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:32.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b29600640 1 --2- 172.21.15.122:0/746624252 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b24160510 0x7f6b2409b450 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:32.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b29600640 1 -- 172.21.15.122:0/746624252 >> 172.21.15.122:0/746624252 conn(0x7f6b240d24d0 msgr2=0x7f6b240d28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:32.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b29600640 1 -- 172.21.15.122:0/746624252 shutdown_connections 2024-05-28T06:09:32.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b29600640 1 -- 172.21.15.122:0/746624252 wait complete. 2024-05-28T06:09:32.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b29600640 1 Processor -- start 2024-05-28T06:09:32.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b29600640 1 -- start start 2024-05-28T06:09:32.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b29600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b24160510 0x7f6b2414b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:32.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b29600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b241608f0 0x7f6b240cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:32.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b29600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b240cbe20 0x7f6b240b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:32.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b29600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6b240d07b0 con 0x7f6b241608f0 2024-05-28T06:09:32.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b29600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6b240cd050 con 0x7f6b240cbe20 2024-05-28T06:09:32.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b29600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6b240d0930 con 0x7f6b24160510 2024-05-28T06:09:32.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b23400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b241608f0 0x7f6b240cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:32.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b23400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b241608f0 0x7f6b240cb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44688/0 (socket says 172.21.15.122:44688) 2024-05-28T06:09:32.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b23400640 1 -- 172.21.15.122:0/4155450579 learned_addr learned my addr 172.21.15.122:0/4155450579 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:32.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b23e00640 1 --2- 172.21.15.122:0/4155450579 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b24160510 0x7f6b2414b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:32.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b28c00640 1 --2- 172.21.15.122:0/4155450579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b240cbe20 0x7f6b240b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:32.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b23400640 1 -- 172.21.15.122:0/4155450579 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b24160510 msgr2=0x7f6b2414b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:32.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b23400640 1 --2- 172.21.15.122:0/4155450579 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b24160510 0x7f6b2414b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:32.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b23400640 1 -- 172.21.15.122:0/4155450579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b240cbe20 msgr2=0x7f6b240b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:32.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b23400640 1 --2- 172.21.15.122:0/4155450579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b240cbe20 0x7f6b240b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:32.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b23400640 1 -- 172.21.15.122:0/4155450579 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b240cc2c0 con 0x7f6b241608f0 2024-05-28T06:09:32.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b23e00640 1 --2- 172.21.15.122:0/4155450579 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b24160510 0x7f6b2414b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:09:32.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.336+0000 7f6b28c00640 1 --2- 172.21.15.122:0/4155450579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b240cbe20 0x7f6b240b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:09:32.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.340+0000 7f6b23400640 1 --2- 172.21.15.122:0/4155450579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b241608f0 0x7f6b240cb8e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000c750 tx=0x7f6b1000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:32.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.340+0000 7f6b1be00640 1 -- 172.21.15.122:0/4155450579 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b10005ae0 con 0x7f6b241608f0 2024-05-28T06:09:32.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.340+0000 7f6b1be00640 1 -- 172.21.15.122:0/4155450579 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b10005ca0 con 0x7f6b241608f0 2024-05-28T06:09:32.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.340+0000 7f6b29600640 1 -- 172.21.15.122:0/4155450579 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b2415e010 con 0x7f6b241608f0 2024-05-28T06:09:32.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.340+0000 7f6b1be00640 1 -- 172.21.15.122:0/4155450579 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b100072b0 con 0x7f6b241608f0 2024-05-28T06:09:32.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.340+0000 7f6b29600640 1 -- 172.21.15.122:0/4155450579 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b2415e5d0 con 0x7f6b241608f0 2024-05-28T06:09:32.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.340+0000 7f6b29600640 1 -- 172.21.15.122:0/4155450579 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b2415e7d0 con 0x7f6b241608f0 2024-05-28T06:09:32.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.340+0000 7f6b1be00640 1 -- 172.21.15.122:0/4155450579 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f6b10007450 con 0x7f6b241608f0 2024-05-28T06:09:32.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.340+0000 7f6b1be00640 1 --2- 172.21.15.122:0/4155450579 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6b04068680 0x7f6b0406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:32.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.340+0000 7f6b1be00640 1 -- 172.21.15.122:0/4155450579 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4857+0+0 (secure 0 0 0) 0x7f6b10086a20 con 0x7f6b241608f0 2024-05-28T06:09:32.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.344+0000 7f6b23e00640 1 --2- 172.21.15.122:0/4155450579 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6b04068680 0x7f6b0406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:32.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.344+0000 7f6b23e00640 1 --2- 172.21.15.122:0/4155450579 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6b04068680 0x7f6b0406ab40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6b140b2000 tx=0x7f6b140aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:32.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.348+0000 7f6b1be00640 1 -- 172.21.15.122:0/4155450579 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6b2415e7d0 con 0x7f6b241608f0 2024-05-28T06:09:32.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.504+0000 7f6b29600640 1 -- 172.21.15.122:0/4155450579 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6b24075620 con 0x7f6b241608f0 2024-05-28T06:09:32.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.508+0000 7f6b1be00640 1 -- 172.21.15.122:0/4155450579 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v43) ==== 84+0+65 (secure 0 0 0) 0x7f6b10056fb0 con 0x7f6b241608f0 2024-05-28T06:09:32.510 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:32.510 INFO:teuthology.orchestra.run.smithi122.stdout:[ 2024-05-28T06:09:32.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:32.510 INFO:teuthology.orchestra.run.smithi122.stdout: "poolnum": 1, 2024-05-28T06:09:32.510 INFO:teuthology.orchestra.run.smithi122.stdout: "poolname": ".mgr" 2024-05-28T06:09:32.511 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:32.511 INFO:teuthology.orchestra.run.smithi122.stdout:] 2024-05-28T06:09:32.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.508+0000 7f6b29600640 1 -- 172.21.15.122:0/4155450579 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6b04068680 msgr2=0x7f6b0406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:32.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.508+0000 7f6b29600640 1 --2- 172.21.15.122:0/4155450579 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6b04068680 0x7f6b0406ab40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6b140b2000 tx=0x7f6b140aa070 comp rx=0 tx=0).stop 2024-05-28T06:09:32.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.508+0000 7f6b29600640 1 -- 172.21.15.122:0/4155450579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b241608f0 msgr2=0x7f6b240cb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:32.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.508+0000 7f6b29600640 1 --2- 172.21.15.122:0/4155450579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b241608f0 0x7f6b240cb8e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000c750 tx=0x7f6b1000cc10 comp rx=0 tx=0).stop 2024-05-28T06:09:32.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.508+0000 7f6b29600640 1 -- 172.21.15.122:0/4155450579 shutdown_connections 2024-05-28T06:09:32.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.508+0000 7f6b29600640 1 --2- 172.21.15.122:0/4155450579 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6b04068680 0x7f6b0406ab40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:32.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.508+0000 7f6b29600640 1 --2- 172.21.15.122:0/4155450579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b240cbe20 0x7f6b240b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:32.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.508+0000 7f6b29600640 1 --2- 172.21.15.122:0/4155450579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b241608f0 0x7f6b240cb8e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:32.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.508+0000 7f6b29600640 1 --2- 172.21.15.122:0/4155450579 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b24160510 0x7f6b2414b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:32.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.508+0000 7f6b29600640 1 -- 172.21.15.122:0/4155450579 >> 172.21.15.122:0/4155450579 conn(0x7f6b240d24d0 msgr2=0x7f6b240710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:32.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.508+0000 7f6b29600640 1 -- 172.21.15.122:0/4155450579 shutdown_connections 2024-05-28T06:09:32.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.508+0000 7f6b29600640 1 -- 172.21.15.122:0/4155450579 wait complete. 2024-05-28T06:09:32.532 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-28T06:09:32.532 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-28T06:09:32.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.668+0000 7fa871800640 1 Processor -- start 2024-05-28T06:09:32.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.668+0000 7fa871800640 1 -- start start 2024-05-28T06:09:32.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.668+0000 7fa871800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa86c15e7a0 0x7fa86c06cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:32.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.668+0000 7fa871800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa86c0b42d0 0x7fa86c0add80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:32.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.668+0000 7fa871800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa86c06be00 con 0x7fa86c162e90 2024-05-28T06:09:32.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.668+0000 7fa871800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa86c06c0e0 con 0x7fa86c0b42d0 2024-05-28T06:09:32.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.668+0000 7fa871800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa86c06c3c0 con 0x7fa86c15e7a0 2024-05-28T06:09:32.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.668+0000 7fa86a000640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fa86c162e90 0x7fa86c0b3bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:51678/0 (socket says 172.21.15.122:51678) 2024-05-28T06:09:32.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.668+0000 7fa86a000640 1 -- 172.21.15.122:0/2138431354 learned_addr learned my addr 172.21.15.122:0/2138431354 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:32.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.668+0000 7fa86aa00640 1 --2- 172.21.15.122:0/2138431354 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa86c15e7a0 0x7fa86c06cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:32.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.668+0000 7fa86b400640 1 --2- 172.21.15.122:0/2138431354 >> v2:172.21.15.153:3300/0 conn(0x7fa86c0b42d0 0x7fa86c0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:32.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.668+0000 7fa869600640 1 -- 172.21.15.122:0/2138431354 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1645356028 0 0) 0x7fa86c06be00 con 0x7fa86c162e90 2024-05-28T06:09:32.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.668+0000 7fa869600640 1 -- 172.21.15.122:0/2138431354 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa850003530 con 0x7fa86c162e90 2024-05-28T06:09:32.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.668+0000 7fa86aa00640 1 -- 172.21.15.122:0/2138431354 >> v2:172.21.15.153:3300/0 conn(0x7fa86c0b42d0 msgr2=0x7fa86c0add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:32.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.668+0000 7fa86aa00640 1 --2- 172.21.15.122:0/2138431354 >> v2:172.21.15.153:3300/0 conn(0x7fa86c0b42d0 0x7fa86c0add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:32.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.668+0000 7fa86aa00640 1 -- 172.21.15.122:0/2138431354 >> v1:172.21.15.122:6789/0 conn(0x7fa86c162e90 legacy=0x7fa86c0b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:32.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.668+0000 7fa86aa00640 1 -- 172.21.15.122:0/2138431354 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa86c06c6a0 con 0x7fa86c15e7a0 2024-05-28T06:09:32.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.668+0000 7fa86b400640 1 --2- 172.21.15.122:0/2138431354 >> v2:172.21.15.153:3300/0 conn(0x7fa86c0b42d0 0x7fa86c0add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:09:32.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.672+0000 7fa86aa00640 1 --2- 172.21.15.122:0/2138431354 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa86c15e7a0 0x7fa86c06cea0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0097c0 tx=0x7fa85c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90562cc9d1d6affd server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:32.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.672+0000 7fa869600640 1 -- 172.21.15.122:0/2138431354 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c0aa5f0 con 0x7fa86c15e7a0 2024-05-28T06:09:32.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.672+0000 7fa869600640 1 -- 172.21.15.122:0/2138431354 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa85c0af070 con 0x7fa86c15e7a0 2024-05-28T06:09:32.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.672+0000 7fa869600640 1 -- 172.21.15.122:0/2138431354 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c0aa9b0 con 0x7fa86c15e7a0 2024-05-28T06:09:32.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.672+0000 7fa871800640 1 -- 172.21.15.122:0/2138431354 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa86c15e7a0 msgr2=0x7fa86c06cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:32.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.672+0000 7fa871800640 1 --2- 172.21.15.122:0/2138431354 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa86c15e7a0 0x7fa86c06cea0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0097c0 tx=0x7fa85c01c470 comp rx=0 tx=0).stop 2024-05-28T06:09:32.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.672+0000 7fa871800640 1 -- 172.21.15.122:0/2138431354 shutdown_connections 2024-05-28T06:09:32.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.672+0000 7fa871800640 1 --2- 172.21.15.122:0/2138431354 >> v2:172.21.15.153:3300/0 conn(0x7fa86c0b42d0 0x7fa86c0add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:32.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.672+0000 7fa871800640 1 --2- 172.21.15.122:0/2138431354 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa86c15e7a0 0x7fa86c06cea0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:32.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.672+0000 7fa871800640 1 -- 172.21.15.122:0/2138431354 >> 172.21.15.122:0/2138431354 conn(0x7fa86c0b3130 msgr2=0x7fa86c0d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:32.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.672+0000 7fa871800640 1 -- 172.21.15.122:0/2138431354 shutdown_connections 2024-05-28T06:09:32.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.672+0000 7fa871800640 1 -- 172.21.15.122:0/2138431354 wait complete. 2024-05-28T06:09:32.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa871800640 1 Processor -- start 2024-05-28T06:09:32.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa871800640 1 -- start start 2024-05-28T06:09:32.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa871800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa86c0b42d0 0x7fa86c1561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:32.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa871800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa86c15e7a0 0x7fa86c0d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:32.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa871800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa86c162e90 0x7fa86c15c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:32.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa871800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa86c15ed00 con 0x7fa86c162e90 2024-05-28T06:09:32.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa871800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa86c15eb80 con 0x7fa86c0b42d0 2024-05-28T06:09:32.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa871800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa86c06b990 con 0x7fa86c15e7a0 2024-05-28T06:09:32.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa86b400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa86c162e90 0x7fa86c15c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:32.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa86b400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa86c162e90 0x7fa86c15c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44696/0 (socket says 172.21.15.122:44696) 2024-05-28T06:09:32.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa86b400640 1 -- 172.21.15.122:0/2070851111 learned_addr learned my addr 172.21.15.122:0/2070851111 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:32.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa86aa00640 1 --2- 172.21.15.122:0/2070851111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa86c0b42d0 0x7fa86c1561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:32.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa86a000640 1 --2- 172.21.15.122:0/2070851111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa86c15e7a0 0x7fa86c0d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:32.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa86b400640 1 -- 172.21.15.122:0/2070851111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa86c15e7a0 msgr2=0x7fa86c0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:32.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa86b400640 1 --2- 172.21.15.122:0/2070851111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa86c15e7a0 0x7fa86c0d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:32.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa86b400640 1 -- 172.21.15.122:0/2070851111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa86c0b42d0 msgr2=0x7fa86c1561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:32.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa86b400640 1 --2- 172.21.15.122:0/2070851111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa86c0b42d0 0x7fa86c1561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:32.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa86b400640 1 -- 172.21.15.122:0/2070851111 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa86c156870 con 0x7fa86c162e90 2024-05-28T06:09:32.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa86b400640 1 --2- 172.21.15.122:0/2070851111 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa86c162e90 0x7fa86c15c7c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa864009ea0 tx=0x7fa864009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:32.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa862a00640 1 -- 172.21.15.122:0/2070851111 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa864018030 con 0x7fa86c162e90 2024-05-28T06:09:32.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa862a00640 1 -- 172.21.15.122:0/2070851111 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa86400cde0 con 0x7fa86c162e90 2024-05-28T06:09:32.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa871800640 1 -- 172.21.15.122:0/2070851111 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa86c154da0 con 0x7fa86c162e90 2024-05-28T06:09:32.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa862a00640 1 -- 172.21.15.122:0/2070851111 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa864003bc0 con 0x7fa86c162e90 2024-05-28T06:09:32.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.676+0000 7fa871800640 1 -- 172.21.15.122:0/2070851111 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa86c156e10 con 0x7fa86c162e90 2024-05-28T06:09:32.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.680+0000 7fa871800640 1 -- 172.21.15.122:0/2070851111 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa86c068c40 con 0x7fa86c162e90 2024-05-28T06:09:32.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.680+0000 7fa862a00640 1 -- 172.21.15.122:0/2070851111 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7fa86401b070 con 0x7fa86c162e90 2024-05-28T06:09:32.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.680+0000 7fa862a00640 1 --2- 172.21.15.122:0/2070851111 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa84c068650 0x7fa84c06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:32.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.680+0000 7fa862a00640 1 -- 172.21.15.122:0/2070851111 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4857+0+0 (secure 0 0 0) 0x7fa864087580 con 0x7fa86c162e90 2024-05-28T06:09:32.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.680+0000 7fa86aa00640 1 --2- 172.21.15.122:0/2070851111 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa84c068650 0x7fa84c06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:32.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.680+0000 7fa86aa00640 1 --2- 172.21.15.122:0/2070851111 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa84c068650 0x7fa84c06ab10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0ae000 tx=0x7fa85c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:32.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.684+0000 7fa862a00640 1 -- 172.21.15.122:0/2070851111 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa864022070 con 0x7fa86c162e90 2024-05-28T06:09:32.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:32.840+0000 7fa871800640 1 -- 172.21.15.122:0/2070851111 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa86c0d18e0 con 0x7fa86c162e90 2024-05-28T06:09:33.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.108+0000 7fa862a00640 1 -- 172.21.15.122:0/2070851111 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v44) ==== 138+0+0 (secure 0 0 0) 0x7fa864010040 con 0x7fa86c162e90 2024-05-28T06:09:33.111 INFO:teuthology.orchestra.run.smithi122.stderr:pool 'cephfs_metadata' created 2024-05-28T06:09:33.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.108+0000 7fa871800640 1 -- 172.21.15.122:0/2070851111 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa84c068650 msgr2=0x7fa84c06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:33.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.108+0000 7fa871800640 1 --2- 172.21.15.122:0/2070851111 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa84c068650 0x7fa84c06ab10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0ae000 tx=0x7fa85c0a7000 comp rx=0 tx=0).stop 2024-05-28T06:09:33.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.108+0000 7fa871800640 1 -- 172.21.15.122:0/2070851111 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa86c162e90 msgr2=0x7fa86c15c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:33.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.108+0000 7fa871800640 1 --2- 172.21.15.122:0/2070851111 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa86c162e90 0x7fa86c15c7c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa864009ea0 tx=0x7fa864009f90 comp rx=0 tx=0).stop 2024-05-28T06:09:33.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.108+0000 7fa871800640 1 -- 172.21.15.122:0/2070851111 shutdown_connections 2024-05-28T06:09:33.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.112+0000 7fa871800640 1 --2- 172.21.15.122:0/2070851111 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa84c068650 0x7fa84c06ab10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:33.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.112+0000 7fa871800640 1 --2- 172.21.15.122:0/2070851111 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa86c162e90 0x7fa86c15c7c0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:33.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.112+0000 7fa871800640 1 --2- 172.21.15.122:0/2070851111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa86c15e7a0 0x7fa86c0d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:33.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.112+0000 7fa871800640 1 --2- 172.21.15.122:0/2070851111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa86c0b42d0 0x7fa86c1561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:33.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.112+0000 7fa871800640 1 -- 172.21.15.122:0/2070851111 >> 172.21.15.122:0/2070851111 conn(0x7fa86c0b3130 msgr2=0x7fa86c0b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:33.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.112+0000 7fa871800640 1 -- 172.21.15.122:0/2070851111 shutdown_connections 2024-05-28T06:09:33.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.112+0000 7fa871800640 1 -- 172.21.15.122:0/2070851111 wait complete. 2024-05-28T06:09:33.137 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-28T06:09:33.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.276+0000 7f709e400640 1 Processor -- start 2024-05-28T06:09:33.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.276+0000 7f709e400640 1 -- start start 2024-05-28T06:09:33.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.280+0000 7f709e400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70980b58d0 0x7f70980b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:33.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.280+0000 7f709e400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f70980ce4f0 0x7f70980ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:33.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.280+0000 7f709e400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70980b61f0 con 0x7f70980722a0 2024-05-28T06:09:33.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.280+0000 7f709e400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f709815d970 con 0x7f70980ce4f0 2024-05-28T06:09:33.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.280+0000 7f709e400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f709815dc50 con 0x7f70980b58d0 2024-05-28T06:09:33.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.280+0000 7f7097400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70980b58d0 0x7f70980b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:33.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.280+0000 7f708ea00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f70980ce4f0 0x7f70980ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:33.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.280+0000 7f7097e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f70980722a0 0x7f7098072730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:51132/0 (socket says 172.21.15.122:51132) 2024-05-28T06:09:33.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.280+0000 7f7097e00640 1 -- 172.21.15.122:0/2850358852 learned_addr learned my addr 172.21.15.122:0/2850358852 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:33.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.280+0000 7f708ea00640 1 -- 172.21.15.122:0/2850358852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70980b58d0 msgr2=0x7f70980b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:33.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.280+0000 7f708ea00640 1 --2- 172.21.15.122:0/2850358852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70980b58d0 0x7f70980b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:33.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.280+0000 7f708ea00640 1 -- 172.21.15.122:0/2850358852 >> v1:172.21.15.153:6789/0 conn(0x7f70980722a0 legacy=0x7f7098072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:33.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.280+0000 7f708ea00640 1 -- 172.21.15.122:0/2850358852 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709815df30 con 0x7f70980ce4f0 2024-05-28T06:09:33.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.284+0000 7f708ea00640 1 --2- 172.21.15.122:0/2850358852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70980ce4f0 0x7f70980ce950 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f70800097c0 tx=0x7f708001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d88564c859252a0b server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:33.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.284+0000 7f7096a00640 1 -- 172.21.15.122:0/2850358852 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70800ab610 con 0x7f70980ce4f0 2024-05-28T06:09:33.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.284+0000 7f7096a00640 1 -- 172.21.15.122:0/2850358852 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70800b0070 con 0x7f70980ce4f0 2024-05-28T06:09:33.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.284+0000 7f7096a00640 1 -- 172.21.15.122:0/2850358852 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70800ab9d0 con 0x7f70980ce4f0 2024-05-28T06:09:33.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.284+0000 7f709e400640 1 -- 172.21.15.122:0/2850358852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70980ce4f0 msgr2=0x7f70980ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:33.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.284+0000 7f709e400640 1 --2- 172.21.15.122:0/2850358852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70980ce4f0 0x7f70980ce950 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f70800097c0 tx=0x7f708001c470 comp rx=0 tx=0).stop 2024-05-28T06:09:33.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.284+0000 7f709e400640 1 -- 172.21.15.122:0/2850358852 shutdown_connections 2024-05-28T06:09:33.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.284+0000 7f709e400640 1 --2- 172.21.15.122:0/2850358852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70980ce4f0 0x7f70980ce950 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:33.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.284+0000 7f709e400640 1 --2- 172.21.15.122:0/2850358852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70980b58d0 0x7f70980b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:33.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.284+0000 7f709e400640 1 -- 172.21.15.122:0/2850358852 >> 172.21.15.122:0/2850358852 conn(0x7f709806bd90 msgr2=0x7f709806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:33.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.284+0000 7f709e400640 1 -- 172.21.15.122:0/2850358852 shutdown_connections 2024-05-28T06:09:33.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.284+0000 7f709e400640 1 -- 172.21.15.122:0/2850358852 wait complete. 2024-05-28T06:09:33.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.284+0000 7f709e400640 1 Processor -- start 2024-05-28T06:09:33.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.284+0000 7f709e400640 1 -- start start 2024-05-28T06:09:33.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.288+0000 7f709e400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70980722a0 0x7f7098143080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:33.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.288+0000 7f709e400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70980b58d0 0x7f7098144070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:33.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.288+0000 7f709e400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70980ce4f0 0x7f709813bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:33.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.288+0000 7f709e400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f70980cf010 con 0x7f70980722a0 2024-05-28T06:09:33.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.288+0000 7f709e400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f70980cee90 con 0x7f70980b58d0 2024-05-28T06:09:33.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.288+0000 7f709e400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7098169a60 con 0x7f70980ce4f0 2024-05-28T06:09:33.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.288+0000 7f7097400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70980722a0 0x7f7098143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:33.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.288+0000 7f7097400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70980722a0 0x7f7098143080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44702/0 (socket says 172.21.15.122:44702) 2024-05-28T06:09:33.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.288+0000 7f7097400640 1 -- 172.21.15.122:0/961402185 learned_addr learned my addr 172.21.15.122:0/961402185 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:33.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.288+0000 7f708ea00640 1 --2- 172.21.15.122:0/961402185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70980b58d0 0x7f7098144070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:33.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.288+0000 7f7097e00640 1 --2- 172.21.15.122:0/961402185 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70980ce4f0 0x7f709813bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:33.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.288+0000 7f7097400640 1 -- 172.21.15.122:0/961402185 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70980ce4f0 msgr2=0x7f709813bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:33.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.288+0000 7f7097400640 1 --2- 172.21.15.122:0/961402185 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70980ce4f0 0x7f709813bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:33.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.288+0000 7f7097400640 1 -- 172.21.15.122:0/961402185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70980b58d0 msgr2=0x7f7098144070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:33.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.288+0000 7f7097400640 1 --2- 172.21.15.122:0/961402185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70980b58d0 0x7f7098144070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:33.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.288+0000 7f7097400640 1 -- 172.21.15.122:0/961402185 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70980b1730 con 0x7f70980722a0 2024-05-28T06:09:33.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.288+0000 7f7097400640 1 --2- 172.21.15.122:0/961402185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70980722a0 0x7f7098143080 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f708800e930 tx=0x7f708800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:33.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.288+0000 7f708fe00640 1 -- 172.21.15.122:0/961402185 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088017070 con 0x7f70980722a0 2024-05-28T06:09:33.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.288+0000 7f708fe00640 1 -- 172.21.15.122:0/961402185 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f708800ca00 con 0x7f70980722a0 2024-05-28T06:09:33.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.288+0000 7f708fe00640 1 -- 172.21.15.122:0/961402185 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708800cdb0 con 0x7f70980722a0 2024-05-28T06:09:33.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.288+0000 7f709e400640 1 -- 172.21.15.122:0/961402185 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70980b1a10 con 0x7f70980722a0 2024-05-28T06:09:33.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.288+0000 7f709e400640 1 -- 172.21.15.122:0/961402185 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70980b1fd0 con 0x7f70980722a0 2024-05-28T06:09:33.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.288+0000 7f709e400640 1 -- 172.21.15.122:0/961402185 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7098068c40 con 0x7f70980722a0 2024-05-28T06:09:33.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.292+0000 7f708fe00640 1 -- 172.21.15.122:0/961402185 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f708801a070 con 0x7f70980722a0 2024-05-28T06:09:33.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.292+0000 7f708fe00640 1 --2- 172.21.15.122:0/961402185 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7074068680 0x7f707406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:33.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.292+0000 7f708fe00640 1 -- 172.21.15.122:0/961402185 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5227+0+0 (secure 0 0 0) 0x7f7088087360 con 0x7f70980722a0 2024-05-28T06:09:33.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.292+0000 7f708ea00640 1 --2- 172.21.15.122:0/961402185 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7074068680 0x7f707406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:33.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.292+0000 7f708ea00640 1 --2- 172.21.15.122:0/961402185 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7074068680 0x7f707406ab40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f70800af000 tx=0x7f70800a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:33.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.296+0000 7f708fe00640 1 -- 172.21.15.122:0/961402185 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7088057260 con 0x7f70980722a0 2024-05-28T06:09:33.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:33.452+0000 7f709e400640 1 -- 172.21.15.122:0/961402185 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f70980ceb90 con 0x7f70980722a0 2024-05-28T06:09:34.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.116+0000 7f708fe00640 1 -- 172.21.15.122:0/961402185 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v45) ==== 170+0+0 (secure 0 0 0) 0x7f708805b560 con 0x7f70980722a0 2024-05-28T06:09:34.118 INFO:teuthology.orchestra.run.smithi122.stderr:pool 'cephfs_data' created 2024-05-28T06:09:34.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.116+0000 7f709e400640 1 -- 172.21.15.122:0/961402185 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7074068680 msgr2=0x7f707406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:34.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.116+0000 7f709e400640 1 --2- 172.21.15.122:0/961402185 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7074068680 0x7f707406ab40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f70800af000 tx=0x7f70800a7000 comp rx=0 tx=0).stop 2024-05-28T06:09:34.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.116+0000 7f709e400640 1 -- 172.21.15.122:0/961402185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70980722a0 msgr2=0x7f7098143080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:34.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.116+0000 7f709e400640 1 --2- 172.21.15.122:0/961402185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70980722a0 0x7f7098143080 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f708800e930 tx=0x7f708800edf0 comp rx=0 tx=0).stop 2024-05-28T06:09:34.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.116+0000 7f709e400640 1 -- 172.21.15.122:0/961402185 shutdown_connections 2024-05-28T06:09:34.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.116+0000 7f709e400640 1 --2- 172.21.15.122:0/961402185 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7074068680 0x7f707406ab40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:34.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.116+0000 7f709e400640 1 --2- 172.21.15.122:0/961402185 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70980ce4f0 0x7f709813bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:34.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.116+0000 7f709e400640 1 --2- 172.21.15.122:0/961402185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70980b58d0 0x7f7098144070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:34.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.116+0000 7f709e400640 1 --2- 172.21.15.122:0/961402185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70980722a0 0x7f7098143080 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:34.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.116+0000 7f709e400640 1 -- 172.21.15.122:0/961402185 >> 172.21.15.122:0/961402185 conn(0x7f709806bd90 msgr2=0x7f7098144950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:34.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.116+0000 7f709e400640 1 -- 172.21.15.122:0/961402185 shutdown_connections 2024-05-28T06:09:34.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.116+0000 7f709e400640 1 -- 172.21.15.122:0/961402185 wait complete. 2024-05-28T06:09:34.157 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-28T06:09:34.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.292+0000 7f864d200640 1 Processor -- start 2024-05-28T06:09:34.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.292+0000 7f864d200640 1 -- start start 2024-05-28T06:09:34.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.296+0000 7f864d200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f86480b4df0 0x7f86480b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:34.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.296+0000 7f864d200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86480b4350 con 0x7f864806cf70 2024-05-28T06:09:34.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.296+0000 7f864d200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f864815c570 con 0x7f86480d0390 2024-05-28T06:09:34.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.296+0000 7f864d200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f864815c850 con 0x7f86480b4df0 2024-05-28T06:09:34.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.296+0000 7f8647400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f86480b4df0 0x7f86480b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:34.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.296+0000 7f8647400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f86480b4df0 0x7f86480b3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44716/0 (socket says 172.21.15.122:44716) 2024-05-28T06:09:34.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.296+0000 7f8647400640 1 -- 172.21.15.122:0/2311111830 learned_addr learned my addr 172.21.15.122:0/2311111830 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:34.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.296+0000 7f8647400640 1 -- 172.21.15.122:0/2311111830 >> v1:172.21.15.153:6789/0 conn(0x7f86480d0390 legacy=0x7f86480cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:34.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.296+0000 7f8647400640 1 -- 172.21.15.122:0/2311111830 >> v1:172.21.15.122:6789/0 conn(0x7f864806cf70 legacy=0x7f86480b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:34.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.296+0000 7f8646a00640 1 -- 172.21.15.122:0/2311111830 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1902457494 0 0) 0x7f86480b4350 con 0x7f864806cf70 2024-05-28T06:09:34.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.296+0000 7f8647400640 1 -- 172.21.15.122:0/2311111830 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86480ceb40 con 0x7f86480b4df0 2024-05-28T06:09:34.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.300+0000 7f8647400640 1 --2- 172.21.15.122:0/2311111830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86480b4df0 0x7f86480b3b20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f863800d150 tx=0x7f863801eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7969194460512015 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:34.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.300+0000 7f8646a00640 1 -- 172.21.15.122:0/2311111830 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863800b2d0 con 0x7f86480b4df0 2024-05-28T06:09:34.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.300+0000 7f8646a00640 1 -- 172.21.15.122:0/2311111830 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f863800b470 con 0x7f86480b4df0 2024-05-28T06:09:34.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.300+0000 7f8646a00640 1 -- 172.21.15.122:0/2311111830 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86380a7b40 con 0x7f86480b4df0 2024-05-28T06:09:34.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.300+0000 7f864d200640 1 -- 172.21.15.122:0/2311111830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86480b4df0 msgr2=0x7f86480b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:34.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.300+0000 7f864d200640 1 --2- 172.21.15.122:0/2311111830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86480b4df0 0x7f86480b3b20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f863800d150 tx=0x7f863801eb70 comp rx=0 tx=0).stop 2024-05-28T06:09:34.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.300+0000 7f864d200640 1 -- 172.21.15.122:0/2311111830 shutdown_connections 2024-05-28T06:09:34.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.300+0000 7f864d200640 1 --2- 172.21.15.122:0/2311111830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86480b4df0 0x7f86480b3b20 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:34.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.300+0000 7f864d200640 1 -- 172.21.15.122:0/2311111830 >> 172.21.15.122:0/2311111830 conn(0x7f86480b30d0 msgr2=0x7f86480d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:34.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.300+0000 7f864d200640 1 -- 172.21.15.122:0/2311111830 shutdown_connections 2024-05-28T06:09:34.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.300+0000 7f864d200640 1 -- 172.21.15.122:0/2311111830 wait complete. 2024-05-28T06:09:34.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.300+0000 7f864d200640 1 Processor -- start 2024-05-28T06:09:34.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.300+0000 7f864d200640 1 -- start start 2024-05-28T06:09:34.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.304+0000 7f864d200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f864806cf70 0x7f864814c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:34.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.304+0000 7f864d200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86480b4df0 0x7f86481f7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:34.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.304+0000 7f864d200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f86480d0390 0x7f864815e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:34.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.304+0000 7f864d200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f86480cfa50 con 0x7f86480b4df0 2024-05-28T06:09:34.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.304+0000 7f864d200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f86480ce7f0 con 0x7f864806cf70 2024-05-28T06:09:34.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.304+0000 7f864d200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f86480cfbd0 con 0x7f86480d0390 2024-05-28T06:09:34.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.304+0000 7f863ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86480b4df0 0x7f86481f7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:34.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.304+0000 7f863ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86480b4df0 0x7f86481f7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44732/0 (socket says 172.21.15.122:44732) 2024-05-28T06:09:34.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.304+0000 7f863ea00640 1 -- 172.21.15.122:0/767571547 learned_addr learned my addr 172.21.15.122:0/767571547 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:34.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.304+0000 7f8647400640 1 --2- 172.21.15.122:0/767571547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f864806cf70 0x7f864814c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:34.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.304+0000 7f8647e00640 1 --2- 172.21.15.122:0/767571547 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f86480d0390 0x7f864815e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:34.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.304+0000 7f863ea00640 1 -- 172.21.15.122:0/767571547 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f86480d0390 msgr2=0x7f864815e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:34.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.304+0000 7f863ea00640 1 --2- 172.21.15.122:0/767571547 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f86480d0390 0x7f864815e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:34.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.304+0000 7f863ea00640 1 -- 172.21.15.122:0/767571547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f864806cf70 msgr2=0x7f864814c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:34.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.304+0000 7f863ea00640 1 --2- 172.21.15.122:0/767571547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f864806cf70 0x7f864814c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:34.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.304+0000 7f863ea00640 1 -- 172.21.15.122:0/767571547 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f864815d850 con 0x7f86480b4df0 2024-05-28T06:09:34.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.304+0000 7f863ea00640 1 --2- 172.21.15.122:0/767571547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86480b4df0 0x7f86481f7190 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f863000c500 tx=0x7f863000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:34.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.304+0000 7f863fe00640 1 -- 172.21.15.122:0/767571547 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8630016020 con 0x7f86480b4df0 2024-05-28T06:09:34.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.304+0000 7f863fe00640 1 -- 172.21.15.122:0/767571547 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8630005220 con 0x7f86480b4df0 2024-05-28T06:09:34.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.304+0000 7f864d200640 1 -- 172.21.15.122:0/767571547 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f864815db30 con 0x7f86480b4df0 2024-05-28T06:09:34.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.304+0000 7f863fe00640 1 -- 172.21.15.122:0/767571547 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8630007030 con 0x7f86480b4df0 2024-05-28T06:09:34.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.304+0000 7f864d200640 1 -- 172.21.15.122:0/767571547 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f864814e490 con 0x7f86480b4df0 2024-05-28T06:09:34.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.304+0000 7f864d200640 1 -- 172.21.15.122:0/767571547 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8648075620 con 0x7f86480b4df0 2024-05-28T06:09:34.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.308+0000 7f863fe00640 1 -- 172.21.15.122:0/767571547 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f86300071f0 con 0x7f86480b4df0 2024-05-28T06:09:34.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.308+0000 7f863fe00640 1 --2- 172.21.15.122:0/767571547 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8624068650 0x7f862406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:34.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.308+0000 7f863fe00640 1 -- 172.21.15.122:0/767571547 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5609+0+0 (secure 0 0 0) 0x7f86300867b0 con 0x7f86480b4df0 2024-05-28T06:09:34.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.308+0000 7f8647400640 1 --2- 172.21.15.122:0/767571547 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8624068650 0x7f862406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:34.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.308+0000 7f8647400640 1 --2- 172.21.15.122:0/767571547 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8624068650 0x7f862406ab10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f86380b0000 tx=0x7f86380a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:34.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.312+0000 7f863fe00640 1 -- 172.21.15.122:0/767571547 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8630020020 con 0x7f86480b4df0 2024-05-28T06:09:34.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:34.504+0000 7f864d200640 1 -- 172.21.15.122:0/767571547 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f86480d15f0 con 0x7f86480b4df0 2024-05-28T06:09:35.132 INFO:teuthology.orchestra.run.smithi122.stderr:new fs with metadata pool 6 and data pool 7 2024-05-28T06:09:35.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.128+0000 7f863fe00640 1 -- 172.21.15.122:0/767571547 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v24) ==== 172+0+0 (secure 0 0 0) 0x7f8630056a50 con 0x7f86480b4df0 2024-05-28T06:09:35.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.136+0000 7f864d200640 1 -- 172.21.15.122:0/767571547 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8624068650 msgr2=0x7f862406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:35.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.136+0000 7f864d200640 1 --2- 172.21.15.122:0/767571547 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8624068650 0x7f862406ab10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f86380b0000 tx=0x7f86380a9070 comp rx=0 tx=0).stop 2024-05-28T06:09:35.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.136+0000 7f864d200640 1 -- 172.21.15.122:0/767571547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86480b4df0 msgr2=0x7f86481f7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:35.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.136+0000 7f864d200640 1 --2- 172.21.15.122:0/767571547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86480b4df0 0x7f86481f7190 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f863000c500 tx=0x7f863000c9c0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.136+0000 7f864d200640 1 -- 172.21.15.122:0/767571547 shutdown_connections 2024-05-28T06:09:35.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.136+0000 7f864d200640 1 --2- 172.21.15.122:0/767571547 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8624068650 0x7f862406ab10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.136+0000 7f864d200640 1 --2- 172.21.15.122:0/767571547 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f86480d0390 0x7f864815e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.136+0000 7f864d200640 1 --2- 172.21.15.122:0/767571547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86480b4df0 0x7f86481f7190 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.136+0000 7f864d200640 1 --2- 172.21.15.122:0/767571547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f864806cf70 0x7f864814c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.136+0000 7f864d200640 1 -- 172.21.15.122:0/767571547 >> 172.21.15.122:0/767571547 conn(0x7f86480b30d0 msgr2=0x7f86480b5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:35.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.140+0000 7f864d200640 1 -- 172.21.15.122:0/767571547 shutdown_connections 2024-05-28T06:09:35.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.140+0000 7f864d200640 1 -- 172.21.15.122:0/767571547 wait complete. 2024-05-28T06:09:35.177 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:09:35.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.312+0000 7fda69000640 1 Processor -- start 2024-05-28T06:09:35.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.312+0000 7fda69000640 1 -- start start 2024-05-28T06:09:35.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.312+0000 7fda69000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fda6406f890 0x7fda640cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:35.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.312+0000 7fda69000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fda640cd930 0x7fda640b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:35.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.312+0000 7fda69000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda640d0310 con 0x7fda640cff30 2024-05-28T06:09:35.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.312+0000 7fda69000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fda6415be20 con 0x7fda640cd930 2024-05-28T06:09:35.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.312+0000 7fda69000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fda6415c100 con 0x7fda6406f890 2024-05-28T06:09:35.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.312+0000 7fda61e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fda640cff30 0x7fda6406f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:51702/0 (socket says 172.21.15.122:51702) 2024-05-28T06:09:35.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.312+0000 7fda61e00640 1 -- 172.21.15.122:0/4221337084 learned_addr learned my addr 172.21.15.122:0/4221337084 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:35.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.312+0000 7fda62800640 1 --2- 172.21.15.122:0/4221337084 >> v2:172.21.15.122:3300/0 conn(0x7fda640cd930 0x7fda640b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:35.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.312+0000 7fda59400640 1 --2- 172.21.15.122:0/4221337084 >> v2:172.21.15.153:3300/0 conn(0x7fda6406f890 0x7fda640cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:35.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.312+0000 7fda61400640 1 -- 172.21.15.122:0/4221337084 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2855545582 0 0) 0x7fda640d0310 con 0x7fda640cff30 2024-05-28T06:09:35.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.312+0000 7fda61400640 1 -- 172.21.15.122:0/4221337084 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda48005740 con 0x7fda640cff30 2024-05-28T06:09:35.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.312+0000 7fda62800640 1 -- 172.21.15.122:0/4221337084 >> v2:172.21.15.153:3300/0 conn(0x7fda6406f890 msgr2=0x7fda640cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:35.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.312+0000 7fda62800640 1 --2- 172.21.15.122:0/4221337084 >> v2:172.21.15.153:3300/0 conn(0x7fda6406f890 0x7fda640cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.312+0000 7fda62800640 1 -- 172.21.15.122:0/4221337084 >> v1:172.21.15.122:6789/0 conn(0x7fda640cff30 legacy=0x7fda6406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:35.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.312+0000 7fda62800640 1 -- 172.21.15.122:0/4221337084 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6415c3e0 con 0x7fda640cd930 2024-05-28T06:09:35.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.316+0000 7fda62800640 1 --2- 172.21.15.122:0/4221337084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda640cd930 0x7fda640b49b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fda64073340 tx=0x7fda5c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e090e9c311963bc server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:35.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.316+0000 7fda61400640 1 -- 172.21.15.122:0/4221337084 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c0ab5f0 con 0x7fda640cd930 2024-05-28T06:09:35.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.316+0000 7fda61400640 1 -- 172.21.15.122:0/4221337084 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda5c0b0070 con 0x7fda640cd930 2024-05-28T06:09:35.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.316+0000 7fda61400640 1 -- 172.21.15.122:0/4221337084 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c0ab9b0 con 0x7fda640cd930 2024-05-28T06:09:35.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.316+0000 7fda69000640 1 -- 172.21.15.122:0/4221337084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda640cd930 msgr2=0x7fda640b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:35.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.316+0000 7fda69000640 1 --2- 172.21.15.122:0/4221337084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda640cd930 0x7fda640b49b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fda64073340 tx=0x7fda5c01c450 comp rx=0 tx=0).stop 2024-05-28T06:09:35.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.316+0000 7fda69000640 1 -- 172.21.15.122:0/4221337084 shutdown_connections 2024-05-28T06:09:35.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.316+0000 7fda69000640 1 --2- 172.21.15.122:0/4221337084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda640cd930 0x7fda640b49b0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.316+0000 7fda69000640 1 --2- 172.21.15.122:0/4221337084 >> v2:172.21.15.153:3300/0 conn(0x7fda6406f890 0x7fda640cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.316+0000 7fda69000640 1 -- 172.21.15.122:0/4221337084 >> 172.21.15.122:0/4221337084 conn(0x7fda6406bd90 msgr2=0x7fda6406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:35.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.316+0000 7fda69000640 1 -- 172.21.15.122:0/4221337084 shutdown_connections 2024-05-28T06:09:35.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.316+0000 7fda69000640 1 -- 172.21.15.122:0/4221337084 wait complete. 2024-05-28T06:09:35.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda69000640 1 Processor -- start 2024-05-28T06:09:35.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda69000640 1 -- start start 2024-05-28T06:09:35.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda69000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda6406f890 0x7fda64149c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:35.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda69000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda640cd930 0x7fda64158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:35.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda69000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda640cff30 0x7fda6414be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:35.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda69000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fda640b5880 con 0x7fda640cd930 2024-05-28T06:09:35.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda69000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fda640b5700 con 0x7fda6406f890 2024-05-28T06:09:35.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda69000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fda640b5a00 con 0x7fda640cff30 2024-05-28T06:09:35.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda59400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda640cd930 0x7fda64158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:35.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda59400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda640cd930 0x7fda64158ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44760/0 (socket says 172.21.15.122:44760) 2024-05-28T06:09:35.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda59400640 1 -- 172.21.15.122:0/1782240526 learned_addr learned my addr 172.21.15.122:0/1782240526 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:35.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda61e00640 1 --2- 172.21.15.122:0/1782240526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda6406f890 0x7fda64149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:35.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda62800640 1 --2- 172.21.15.122:0/1782240526 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda640cff30 0x7fda6414be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:35.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda59400640 1 -- 172.21.15.122:0/1782240526 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda640cff30 msgr2=0x7fda6414be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:35.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda59400640 1 --2- 172.21.15.122:0/1782240526 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda640cff30 0x7fda6414be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda59400640 1 -- 172.21.15.122:0/1782240526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda6406f890 msgr2=0x7fda64149c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:35.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda59400640 1 --2- 172.21.15.122:0/1782240526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda6406f890 0x7fda64149c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda59400640 1 -- 172.21.15.122:0/1782240526 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda64148e80 con 0x7fda640cd930 2024-05-28T06:09:35.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda59400640 1 --2- 172.21.15.122:0/1782240526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda640cd930 0x7fda64158ab0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00e930 tx=0x7fda4c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:35.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda5aa00640 1 -- 172.21.15.122:0/1782240526 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c017070 con 0x7fda640cd930 2024-05-28T06:09:35.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda5aa00640 1 -- 172.21.15.122:0/1782240526 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda4c00ca00 con 0x7fda640cd930 2024-05-28T06:09:35.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda5aa00640 1 -- 172.21.15.122:0/1782240526 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c00cdd0 con 0x7fda640cd930 2024-05-28T06:09:35.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda69000640 1 -- 172.21.15.122:0/1782240526 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda64149160 con 0x7fda640cd930 2024-05-28T06:09:35.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.320+0000 7fda69000640 1 -- 172.21.15.122:0/1782240526 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda6414c370 con 0x7fda640cd930 2024-05-28T06:09:35.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.324+0000 7fda69000640 1 -- 172.21.15.122:0/1782240526 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda64068c40 con 0x7fda640cd930 2024-05-28T06:09:35.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.324+0000 7fda5aa00640 1 -- 172.21.15.122:0/1782240526 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7fda4c01a070 con 0x7fda640cd930 2024-05-28T06:09:35.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.324+0000 7fda5aa00640 1 --2- 172.21.15.122:0/1782240526 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fda40068680 0x7fda4006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:35.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.324+0000 7fda5aa00640 1 -- 172.21.15.122:0/1782240526 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fda4c086cf0 con 0x7fda640cd930 2024-05-28T06:09:35.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.324+0000 7fda61e00640 1 --2- 172.21.15.122:0/1782240526 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fda40068680 0x7fda4006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:35.330 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.328+0000 7fda61e00640 1 --2- 172.21.15.122:0/1782240526 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fda40068680 0x7fda4006ab40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fda54005c10 tx=0x7fda54009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:35.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.328+0000 7fda5aa00640 1 -- 172.21.15.122:0/1782240526 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fda4c056a20 con 0x7fda640cd930 2024-05-28T06:09:35.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.492+0000 7fda69000640 1 -- 172.21.15.122:0/1782240526 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda64155f70 con 0x7fda640cd930 2024-05-28T06:09:35.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.492+0000 7fda5aa00640 1 -- 172.21.15.122:0/1782240526 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16626 (secure 0 0 0) 0x7fda4c05ad20 con 0x7fda640cd930 2024-05-28T06:09:35.495 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:35.495 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":46,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:09:34.510537+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:09:32.856007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-28T06:09:33.467043+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:09:35.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.492+0000 7fda69000640 1 -- 172.21.15.122:0/1782240526 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fda40068680 msgr2=0x7fda4006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:35.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.492+0000 7fda69000640 1 --2- 172.21.15.122:0/1782240526 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fda40068680 0x7fda4006ab40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fda54005c10 tx=0x7fda54009040 comp rx=0 tx=0).stop 2024-05-28T06:09:35.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.492+0000 7fda69000640 1 -- 172.21.15.122:0/1782240526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda640cd930 msgr2=0x7fda64158ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:35.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.492+0000 7fda69000640 1 --2- 172.21.15.122:0/1782240526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda640cd930 0x7fda64158ab0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00e930 tx=0x7fda4c00edf0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.492+0000 7fda69000640 1 -- 172.21.15.122:0/1782240526 shutdown_connections 2024-05-28T06:09:35.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.492+0000 7fda69000640 1 --2- 172.21.15.122:0/1782240526 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fda40068680 0x7fda4006ab40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.492+0000 7fda69000640 1 --2- 172.21.15.122:0/1782240526 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda640cff30 0x7fda6414be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.492+0000 7fda69000640 1 --2- 172.21.15.122:0/1782240526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda640cd930 0x7fda64158ab0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.492+0000 7fda69000640 1 --2- 172.21.15.122:0/1782240526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda6406f890 0x7fda64149c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.492+0000 7fda69000640 1 -- 172.21.15.122:0/1782240526 >> 172.21.15.122:0/1782240526 conn(0x7fda6406bd90 msgr2=0x7fda6406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:35.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.492+0000 7fda69000640 1 -- 172.21.15.122:0/1782240526 shutdown_connections 2024-05-28T06:09:35.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.492+0000 7fda69000640 1 -- 172.21.15.122:0/1782240526 wait complete. 2024-05-28T06:09:35.518 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:09:35.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.652+0000 7f9f05a00640 1 Processor -- start 2024-05-28T06:09:35.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.652+0000 7f9f05a00640 1 -- start start 2024-05-28T06:09:35.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.652+0000 7f9f05a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9f0015ea50 0x7f9f0015ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:35.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.652+0000 7f9f05a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9f0015f370 0x7f9f0015f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:35.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.652+0000 7f9f05a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f00162510 con 0x7f9f0006caa0 2024-05-28T06:09:35.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.652+0000 7f9f05a00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f9f00163120 con 0x7f9f0015ea50 2024-05-28T06:09:35.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.652+0000 7f9f05a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9f001627f0 con 0x7f9f0015f370 2024-05-28T06:09:35.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.652+0000 7f9efea00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9f0015ea50 0x7f9f0015ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:35.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.652+0000 7f9efea00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9f0015ea50 0x7f9f0015ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48462/0 (socket says 172.21.15.122:48462) 2024-05-28T06:09:35.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.652+0000 7f9efea00640 1 -- 172.21.15.122:0/3367474464 learned_addr learned my addr 172.21.15.122:0/3367474464 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:35.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.652+0000 7f9efe000640 1 --2- 172.21.15.122:0/3367474464 >> v2:172.21.15.153:3300/0 conn(0x7f9f0015f370 0x7f9f0015f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:35.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.652+0000 7f9efea00640 1 -- 172.21.15.122:0/3367474464 >> v2:172.21.15.153:3300/0 conn(0x7f9f0015f370 msgr2=0x7f9f0015f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:35.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.652+0000 7f9efea00640 1 --2- 172.21.15.122:0/3367474464 >> v2:172.21.15.153:3300/0 conn(0x7f9f0015f370 0x7f9f0015f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.652+0000 7f9efea00640 1 -- 172.21.15.122:0/3367474464 >> v1:172.21.15.153:6789/0 conn(0x7f9f0006caa0 legacy=0x7f9f0006cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:35.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.652+0000 7f9efea00640 1 -- 172.21.15.122:0/3367474464 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f00162ad0 con 0x7f9f0015ea50 2024-05-28T06:09:35.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.656+0000 7f9efea00640 1 --2- 172.21.15.122:0/3367474464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f0015ea50 0x7f9f0015ee30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9f000d21b0 tx=0x7f9ef001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7073b6fdb818595e server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:35.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.656+0000 7f9efd600640 1 -- 172.21.15.122:0/3367474464 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef00a5750 con 0x7f9f0015ea50 2024-05-28T06:09:35.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.656+0000 7f9efd600640 1 -- 172.21.15.122:0/3367474464 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ef00a58f0 con 0x7f9f0015ea50 2024-05-28T06:09:35.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.656+0000 7f9efd600640 1 -- 172.21.15.122:0/3367474464 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef00a5cc0 con 0x7f9f0015ea50 2024-05-28T06:09:35.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.656+0000 7f9f05a00640 1 -- 172.21.15.122:0/3367474464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f0015ea50 msgr2=0x7f9f0015ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:35.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.656+0000 7f9f05a00640 1 --2- 172.21.15.122:0/3367474464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f0015ea50 0x7f9f0015ee30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9f000d21b0 tx=0x7f9ef001c980 comp rx=0 tx=0).stop 2024-05-28T06:09:35.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.656+0000 7f9f05a00640 1 -- 172.21.15.122:0/3367474464 shutdown_connections 2024-05-28T06:09:35.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.656+0000 7f9f05a00640 1 --2- 172.21.15.122:0/3367474464 >> v2:172.21.15.153:3300/0 conn(0x7f9f0015f370 0x7f9f0015f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.656+0000 7f9f05a00640 1 --2- 172.21.15.122:0/3367474464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f0015ea50 0x7f9f0015ee30 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.656+0000 7f9f05a00640 1 -- 172.21.15.122:0/3367474464 >> 172.21.15.122:0/3367474464 conn(0x7f9f000b4190 msgr2=0x7f9f000b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:35.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.656+0000 7f9f05a00640 1 -- 172.21.15.122:0/3367474464 shutdown_connections 2024-05-28T06:09:35.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.656+0000 7f9f05a00640 1 -- 172.21.15.122:0/3367474464 wait complete. 2024-05-28T06:09:35.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9f05a00640 1 Processor -- start 2024-05-28T06:09:35.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9f05a00640 1 -- start start 2024-05-28T06:09:35.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9f05a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f0006caa0 0x7f9f0014f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:35.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9f05a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f0015ea50 0x7f9f0015d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:35.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9f05a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f0015f370 0x7f9f001508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:35.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9f05a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0016b990 con 0x7f9f0015ea50 2024-05-28T06:09:35.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9f05a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0016b810 con 0x7f9f0006caa0 2024-05-28T06:09:35.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9f05a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9f0016bb10 con 0x7f9f0015f370 2024-05-28T06:09:35.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9efe000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f0015ea50 0x7f9f0015d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:35.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9efe000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f0015ea50 0x7f9f0015d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48474/0 (socket says 172.21.15.122:48474) 2024-05-28T06:09:35.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9efe000640 1 -- 172.21.15.122:0/187799285 learned_addr learned my addr 172.21.15.122:0/187799285 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:35.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9efea00640 1 --2- 172.21.15.122:0/187799285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f0006caa0 0x7f9f0014f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:35.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9eff400640 1 --2- 172.21.15.122:0/187799285 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f0015f370 0x7f9f001508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:35.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9efe000640 1 -- 172.21.15.122:0/187799285 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f0015f370 msgr2=0x7f9f001508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:35.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9efe000640 1 --2- 172.21.15.122:0/187799285 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f0015f370 0x7f9f001508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9efe000640 1 -- 172.21.15.122:0/187799285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f0006caa0 msgr2=0x7f9f0014f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:35.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9efe000640 1 --2- 172.21.15.122:0/187799285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f0006caa0 0x7f9f0014f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9efe000640 1 -- 172.21.15.122:0/187799285 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f000af6f0 con 0x7f9f0015ea50 2024-05-28T06:09:35.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9efe000640 1 --2- 172.21.15.122:0/187799285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f0015ea50 0x7f9f0015d990 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00d5f0 tx=0x7f9eec00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:35.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9ef6a00640 1 -- 172.21.15.122:0/187799285 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec0125f0 con 0x7f9f0015ea50 2024-05-28T06:09:35.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9ef6a00640 1 -- 172.21.15.122:0/187799285 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eec019070 con 0x7f9f0015ea50 2024-05-28T06:09:35.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9f05a00640 1 -- 172.21.15.122:0/187799285 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f000af9d0 con 0x7f9f0015ea50 2024-05-28T06:09:35.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9ef6a00640 1 -- 172.21.15.122:0/187799285 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec0129b0 con 0x7f9f0015ea50 2024-05-28T06:09:35.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9f05a00640 1 -- 172.21.15.122:0/187799285 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f000af3a0 con 0x7f9f0015ea50 2024-05-28T06:09:35.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.660+0000 7f9f05a00640 1 -- 172.21.15.122:0/187799285 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f00068c40 con 0x7f9f0015ea50 2024-05-28T06:09:35.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.664+0000 7f9ef6a00640 1 -- 172.21.15.122:0/187799285 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f9eec012b50 con 0x7f9f0015ea50 2024-05-28T06:09:35.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.664+0000 7f9ef6a00640 1 --2- 172.21.15.122:0/187799285 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9ee0068650 0x7f9ee006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:35.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.664+0000 7f9ef6a00640 1 -- 172.21.15.122:0/187799285 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f9eec087190 con 0x7f9f0015ea50 2024-05-28T06:09:35.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.664+0000 7f9efea00640 1 --2- 172.21.15.122:0/187799285 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9ee0068650 0x7f9ee006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:35.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.664+0000 7f9efea00640 1 --2- 172.21.15.122:0/187799285 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9ee0068650 0x7f9ee006ab10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00ae000 tx=0x7f9ef00a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:35.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.668+0000 7f9ef6a00640 1 -- 172.21.15.122:0/187799285 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9eec0573c0 con 0x7f9f0015ea50 2024-05-28T06:09:35.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.828+0000 7f9f05a00640 1 -- 172.21.15.122:0/187799285 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f000afba0 con 0x7f9f0015ea50 2024-05-28T06:09:35.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.828+0000 7f9ef6a00640 1 -- 172.21.15.122:0/187799285 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16626 (secure 0 0 0) 0x7f9eec056cc0 con 0x7f9f0015ea50 2024-05-28T06:09:35.831 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:35.832 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":46,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:09:34.510537+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:09:32.856007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-28T06:09:33.467043+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:09:35.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.828+0000 7f9f05a00640 1 -- 172.21.15.122:0/187799285 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9ee0068650 msgr2=0x7f9ee006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:35.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.828+0000 7f9f05a00640 1 --2- 172.21.15.122:0/187799285 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9ee0068650 0x7f9ee006ab10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00ae000 tx=0x7f9ef00a7070 comp rx=0 tx=0).stop 2024-05-28T06:09:35.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.828+0000 7f9f05a00640 1 -- 172.21.15.122:0/187799285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f0015ea50 msgr2=0x7f9f0015d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:35.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.828+0000 7f9f05a00640 1 --2- 172.21.15.122:0/187799285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f0015ea50 0x7f9f0015d990 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00d5f0 tx=0x7f9eec00dab0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.828+0000 7f9f05a00640 1 -- 172.21.15.122:0/187799285 shutdown_connections 2024-05-28T06:09:35.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.828+0000 7f9f05a00640 1 --2- 172.21.15.122:0/187799285 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9ee0068650 0x7f9ee006ab10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.828+0000 7f9f05a00640 1 --2- 172.21.15.122:0/187799285 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f0015f370 0x7f9f001508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.828+0000 7f9f05a00640 1 --2- 172.21.15.122:0/187799285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f0015ea50 0x7f9f0015d990 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.828+0000 7f9f05a00640 1 --2- 172.21.15.122:0/187799285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f0006caa0 0x7f9f0014f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.828+0000 7f9f05a00640 1 -- 172.21.15.122:0/187799285 >> 172.21.15.122:0/187799285 conn(0x7f9f000b4190 msgr2=0x7f9f00070950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:35.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.828+0000 7f9f05a00640 1 -- 172.21.15.122:0/187799285 shutdown_connections 2024-05-28T06:09:35.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.828+0000 7f9f05a00640 1 -- 172.21.15.122:0/187799285 wait complete. 2024-05-28T06:09:35.853 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-28T06:09:35.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.988+0000 7fc000a00640 1 Processor -- start 2024-05-28T06:09:35.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.988+0000 7fc000a00640 1 -- start start 2024-05-28T06:09:35.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.988+0000 7fc000a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbffc0b58d0 0x7fbffc0b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:35.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.988+0000 7fc000a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbffc15e730 0x7fbffc15eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:35.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.988+0000 7fc000a00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbffc0b61f0 con 0x7fbffc0ce4f0 2024-05-28T06:09:35.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.988+0000 7fc000a00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fbffc15d970 con 0x7fbffc0b58d0 2024-05-28T06:09:35.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.988+0000 7fc000a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fbffc15dc50 con 0x7fbffc15e730 2024-05-28T06:09:35.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.992+0000 7fbff9e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbffc0b58d0 0x7fbffc0b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:35.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.992+0000 7fbff9e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbffc0b58d0 0x7fbffc0b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48488/0 (socket says 172.21.15.122:48488) 2024-05-28T06:09:35.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.992+0000 7fbff9e00640 1 -- 172.21.15.122:0/3282272576 learned_addr learned my addr 172.21.15.122:0/3282272576 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:35.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.992+0000 7fbff1400640 1 --1- 172.21.15.122:0/3282272576 >> v1:172.21.15.122:6789/0 conn(0x7fbffc0ce4f0 0x7fbffc0ce980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:48914/0 (socket says 172.21.15.122:48914) 2024-05-28T06:09:35.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.992+0000 7fbffa800640 1 --2- 172.21.15.122:0/3282272576 >> v2:172.21.15.153:3300/0 conn(0x7fbffc15e730 0x7fbffc15eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:35.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.992+0000 7fbff9e00640 1 -- 172.21.15.122:0/3282272576 >> v2:172.21.15.153:3300/0 conn(0x7fbffc15e730 msgr2=0x7fbffc15eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:35.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.992+0000 7fbff9e00640 1 --2- 172.21.15.122:0/3282272576 >> v2:172.21.15.153:3300/0 conn(0x7fbffc15e730 0x7fbffc15eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.992+0000 7fbff9e00640 1 -- 172.21.15.122:0/3282272576 >> v1:172.21.15.122:6789/0 conn(0x7fbffc0ce4f0 legacy=0x7fbffc0ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:35.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.992+0000 7fbff9e00640 1 -- 172.21.15.122:0/3282272576 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbffc15df30 con 0x7fbffc0b58d0 2024-05-28T06:09:35.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.992+0000 7fbff9e00640 1 --2- 172.21.15.122:0/3282272576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbffc0b58d0 0x7fbffc0b5cb0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0b02c0 tx=0x7fbfec01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e74d71977d990f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:35.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.992+0000 7fbff9400640 1 -- 172.21.15.122:0/3282272576 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0a5750 con 0x7fbffc0b58d0 2024-05-28T06:09:35.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.992+0000 7fbff9400640 1 -- 172.21.15.122:0/3282272576 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfec0a58f0 con 0x7fbffc0b58d0 2024-05-28T06:09:35.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.992+0000 7fbff9400640 1 -- 172.21.15.122:0/3282272576 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0a5cc0 con 0x7fbffc0b58d0 2024-05-28T06:09:35.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fc000a00640 1 -- 172.21.15.122:0/3282272576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbffc0b58d0 msgr2=0x7fbffc0b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:35.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fc000a00640 1 --2- 172.21.15.122:0/3282272576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbffc0b58d0 0x7fbffc0b5cb0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0b02c0 tx=0x7fbfec01c9f0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fc000a00640 1 -- 172.21.15.122:0/3282272576 shutdown_connections 2024-05-28T06:09:35.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fc000a00640 1 --2- 172.21.15.122:0/3282272576 >> v2:172.21.15.153:3300/0 conn(0x7fbffc15e730 0x7fbffc15eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fc000a00640 1 --2- 172.21.15.122:0/3282272576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbffc0b58d0 0x7fbffc0b5cb0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:35.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fc000a00640 1 -- 172.21.15.122:0/3282272576 >> 172.21.15.122:0/3282272576 conn(0x7fbffc06bd90 msgr2=0x7fbffc06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:35.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fc000a00640 1 -- 172.21.15.122:0/3282272576 shutdown_connections 2024-05-28T06:09:35.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fc000a00640 1 -- 172.21.15.122:0/3282272576 wait complete. 2024-05-28T06:09:35.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fc000a00640 1 Processor -- start 2024-05-28T06:09:35.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fc000a00640 1 -- start start 2024-05-28T06:09:36.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fc000a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbffc0b58d0 0x7fbffc15bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:36.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fc000a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbffc0ce4f0 0x7fbffc13b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:36.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fc000a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbffc15e730 0x7fbffc158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:36.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fc000a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbffc1693d0 con 0x7fbffc0b58d0 2024-05-28T06:09:36.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fc000a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbffc169250 con 0x7fbffc0ce4f0 2024-05-28T06:09:36.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fc000a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbffc169550 con 0x7fbffc15e730 2024-05-28T06:09:36.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fbff9e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbffc0b58d0 0x7fbffc15bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:36.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fbff9e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbffc0b58d0 0x7fbffc15bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48504/0 (socket says 172.21.15.122:48504) 2024-05-28T06:09:36.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fbff9e00640 1 -- 172.21.15.122:0/2262558108 learned_addr learned my addr 172.21.15.122:0/2262558108 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:36.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fbff9e00640 1 -- 172.21.15.122:0/2262558108 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbffc15e730 msgr2=0x7fbffc158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:36.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fbff9e00640 1 --2- 172.21.15.122:0/2262558108 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbffc15e730 0x7fbffc158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:36.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fbff9e00640 1 -- 172.21.15.122:0/2262558108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbffc0ce4f0 msgr2=0x7fbffc13b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:36.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fbff9e00640 1 --2- 172.21.15.122:0/2262558108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbffc0ce4f0 0x7fbffc13b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:36.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fbff9e00640 1 -- 172.21.15.122:0/2262558108 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbffc1599d0 con 0x7fbffc0b58d0 2024-05-28T06:09:36.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fbff9e00640 1 --2- 172.21.15.122:0/2262558108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbffc0b58d0 0x7fbffc15bba0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbfec01a620 tx=0x7fbfec019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:36.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:35.996+0000 7fbff2a00640 1 -- 172.21.15.122:0/2262558108 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0bc020 con 0x7fbffc0b58d0 2024-05-28T06:09:36.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:36.000+0000 7fbff2a00640 1 -- 172.21.15.122:0/2262558108 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfec0b8670 con 0x7fbffc0b58d0 2024-05-28T06:09:36.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:36.000+0000 7fbff2a00640 1 -- 172.21.15.122:0/2262558108 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0b8a60 con 0x7fbffc0b58d0 2024-05-28T06:09:36.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:36.000+0000 7fc000a00640 1 -- 172.21.15.122:0/2262558108 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbffc15b0c0 con 0x7fbffc0b58d0 2024-05-28T06:09:36.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:36.000+0000 7fc000a00640 1 -- 172.21.15.122:0/2262558108 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbffc15b680 con 0x7fbffc0b58d0 2024-05-28T06:09:36.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:36.000+0000 7fc000a00640 1 -- 172.21.15.122:0/2262558108 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbffc068c40 con 0x7fbffc0b58d0 2024-05-28T06:09:36.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:36.000+0000 7fbff2a00640 1 -- 172.21.15.122:0/2262558108 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7fbfec0bf020 con 0x7fbffc0b58d0 2024-05-28T06:09:36.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:36.000+0000 7fbff2a00640 1 --2- 172.21.15.122:0/2262558108 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fbfd8068680 0x7fbfd806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:36.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:36.000+0000 7fbff2a00640 1 -- 172.21.15.122:0/2262558108 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fbfec121700 con 0x7fbffc0b58d0 2024-05-28T06:09:36.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:36.000+0000 7fbff1400640 1 --2- 172.21.15.122:0/2262558108 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fbfd8068680 0x7fbfd806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:36.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:36.004+0000 7fbff1400640 1 --2- 172.21.15.122:0/2262558108 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fbfd8068680 0x7fbfd806ab40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4000f70 tx=0x7fbfe4007a00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:36.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:36.004+0000 7fbff2a00640 1 -- 172.21.15.122:0/2262558108 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbfec0c7020 con 0x7fbffc0b58d0 2024-05-28T06:09:36.204 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:36.200+0000 7fc000a00640 1 -- 172.21.15.122:0/2262558108 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fbffc06e5d0 con 0x7fbffc0b58d0 2024-05-28T06:09:37.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-05-28T06:09:37.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-05-28T06:09:37.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-05-28T06:09:37.100 INFO:tasks.ceph.mds.a.smithi122.stderr:2024-05-28T06:09:37.100+0000 7f542dc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-28T06:09:37.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.136+0000 7fbff2a00640 1 -- 172.21.15.122:0/2262558108 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v27) ==== 118+0+0 (secure 0 0 0) 0x7fbfec0165e0 con 0x7fbffc0b58d0 2024-05-28T06:09:37.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.140+0000 7fc000a00640 1 -- 172.21.15.122:0/2262558108 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fbfd8068680 msgr2=0x7fbfd806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:37.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.140+0000 7fc000a00640 1 --2- 172.21.15.122:0/2262558108 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fbfd8068680 0x7fbfd806ab40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4000f70 tx=0x7fbfe4007a00 comp rx=0 tx=0).stop 2024-05-28T06:09:37.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.140+0000 7fc000a00640 1 -- 172.21.15.122:0/2262558108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbffc0b58d0 msgr2=0x7fbffc15bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:37.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.140+0000 7fc000a00640 1 --2- 172.21.15.122:0/2262558108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbffc0b58d0 0x7fbffc15bba0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbfec01a620 tx=0x7fbfec019790 comp rx=0 tx=0).stop 2024-05-28T06:09:37.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.140+0000 7fc000a00640 1 -- 172.21.15.122:0/2262558108 shutdown_connections 2024-05-28T06:09:37.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.140+0000 7fc000a00640 1 --2- 172.21.15.122:0/2262558108 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fbfd8068680 0x7fbfd806ab40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:37.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.140+0000 7fc000a00640 1 --2- 172.21.15.122:0/2262558108 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbffc15e730 0x7fbffc158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:37.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.140+0000 7fc000a00640 1 --2- 172.21.15.122:0/2262558108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbffc0ce4f0 0x7fbffc13b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:37.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.140+0000 7fc000a00640 1 --2- 172.21.15.122:0/2262558108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbffc0b58d0 0x7fbffc15bba0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:37.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.140+0000 7fc000a00640 1 -- 172.21.15.122:0/2262558108 >> 172.21.15.122:0/2262558108 conn(0x7fbffc06bd90 msgr2=0x7fbffc0b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:37.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.140+0000 7fc000a00640 1 -- 172.21.15.122:0/2262558108 shutdown_connections 2024-05-28T06:09:37.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.140+0000 7fc000a00640 1 -- 172.21.15.122:0/2262558108 wait complete. 2024-05-28T06:09:37.167 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-28T06:09:37.167 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-28T06:09:37.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.308+0000 7f546ca00640 1 Processor -- start 2024-05-28T06:09:37.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.308+0000 7f546ca00640 1 -- start start 2024-05-28T06:09:37.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.308+0000 7f546ca00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5468161ff0 0x7f54680d1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:37.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.308+0000 7f546ca00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f546806cc60 0x7f546809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:37.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.308+0000 7f546ca00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54680ccb80 con 0x7f546809af80 2024-05-28T06:09:37.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.308+0000 7f546ca00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f54680cce60 con 0x7f5468161ff0 2024-05-28T06:09:37.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.308+0000 7f546ca00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f54680cd140 con 0x7f546806cc60 2024-05-28T06:09:37.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.312+0000 7f5467400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5468161ff0 0x7f54680d1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:37.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.312+0000 7f5467400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5468161ff0 0x7f54680d1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48506/0 (socket says 172.21.15.122:48506) 2024-05-28T06:09:37.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.312+0000 7f5467400640 1 -- 172.21.15.122:0/1118407501 learned_addr learned my addr 172.21.15.122:0/1118407501 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:37.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.312+0000 7f545ea00640 1 --2- 172.21.15.122:0/1118407501 >> v2:172.21.15.153:3300/0 conn(0x7f546806cc60 0x7f546809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:37.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.312+0000 7f5467400640 1 -- 172.21.15.122:0/1118407501 >> v2:172.21.15.153:3300/0 conn(0x7f546806cc60 msgr2=0x7f546809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:37.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.312+0000 7f5467400640 1 --2- 172.21.15.122:0/1118407501 >> v2:172.21.15.153:3300/0 conn(0x7f546806cc60 0x7f546809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:37.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.312+0000 7f5467400640 1 -- 172.21.15.122:0/1118407501 >> v1:172.21.15.153:6789/0 conn(0x7f546809af80 legacy=0x7f546806d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:37.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.312+0000 7f5467400640 1 -- 172.21.15.122:0/1118407501 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54680cd420 con 0x7f5468161ff0 2024-05-28T06:09:37.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.312+0000 7f5467400640 1 --2- 172.21.15.122:0/1118407501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5468161ff0 0x7f54680d1270 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f546806e3b0 tx=0x7f545801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f7d70dfab2102b server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:37.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.312+0000 7f5466a00640 1 -- 172.21.15.122:0/1118407501 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546806e080 con 0x7f5468161ff0 2024-05-28T06:09:37.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.312+0000 7f5466a00640 1 -- 172.21.15.122:0/1118407501 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54580a56c0 con 0x7f5468161ff0 2024-05-28T06:09:37.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.312+0000 7f5466a00640 1 -- 172.21.15.122:0/1118407501 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54580a5a90 con 0x7f5468161ff0 2024-05-28T06:09:37.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f546ca00640 1 -- 172.21.15.122:0/1118407501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5468161ff0 msgr2=0x7f54680d1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:37.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f546ca00640 1 --2- 172.21.15.122:0/1118407501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5468161ff0 0x7f54680d1270 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f546806e3b0 tx=0x7f545801c9f0 comp rx=0 tx=0).stop 2024-05-28T06:09:37.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f546ca00640 1 -- 172.21.15.122:0/1118407501 shutdown_connections 2024-05-28T06:09:37.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f546ca00640 1 --2- 172.21.15.122:0/1118407501 >> v2:172.21.15.153:3300/0 conn(0x7f546806cc60 0x7f546809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:37.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f546ca00640 1 --2- 172.21.15.122:0/1118407501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5468161ff0 0x7f54680d1270 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:37.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f546ca00640 1 -- 172.21.15.122:0/1118407501 >> 172.21.15.122:0/1118407501 conn(0x7f54680b3f80 msgr2=0x7f54680b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:37.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f546ca00640 1 -- 172.21.15.122:0/1118407501 shutdown_connections 2024-05-28T06:09:37.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f546ca00640 1 -- 172.21.15.122:0/1118407501 wait complete. 2024-05-28T06:09:37.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f546ca00640 1 Processor -- start 2024-05-28T06:09:37.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f546ca00640 1 -- start start 2024-05-28T06:09:37.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f546ca00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f546806cc60 0x7f5468070180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:37.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f546ca00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f546809af80 0x7f546815aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:37.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f546ca00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5468161ff0 0x7f546815b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:37.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f546ca00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f546816b980 con 0x7f546809af80 2024-05-28T06:09:37.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f546ca00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f546816b800 con 0x7f546806cc60 2024-05-28T06:09:37.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f546ca00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f546816bb00 con 0x7f5468161ff0 2024-05-28T06:09:37.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f545ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f546809af80 0x7f546815aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:37.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f545ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f546809af80 0x7f546815aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48510/0 (socket says 172.21.15.122:48510) 2024-05-28T06:09:37.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f545ea00640 1 -- 172.21.15.122:0/3922998236 learned_addr learned my addr 172.21.15.122:0/3922998236 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:37.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f545ea00640 1 -- 172.21.15.122:0/3922998236 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5468161ff0 msgr2=0x7f546815b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:37.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f545ea00640 1 --2- 172.21.15.122:0/3922998236 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5468161ff0 0x7f546815b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:37.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f545ea00640 1 -- 172.21.15.122:0/3922998236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f546806cc60 msgr2=0x7f5468070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:37.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f5467400640 1 --2- 172.21.15.122:0/3922998236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f546806cc60 0x7f5468070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:37.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f545ea00640 1 --2- 172.21.15.122:0/3922998236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f546806cc60 0x7f5468070180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:37.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f545ea00640 1 -- 172.21.15.122:0/3922998236 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f546815a330 con 0x7f546809af80 2024-05-28T06:09:37.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.316+0000 7f5467400640 1 --2- 172.21.15.122:0/3922998236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f546806cc60 0x7f5468070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:09:37.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.320+0000 7f545ea00640 1 --2- 172.21.15.122:0/3922998236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f546809af80 0x7f546815aaf0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f545000e8a0 tx=0x7f545000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:37.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.320+0000 7f545fe00640 1 -- 172.21.15.122:0/3922998236 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5450017070 con 0x7f546809af80 2024-05-28T06:09:37.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.320+0000 7f545fe00640 1 -- 172.21.15.122:0/3922998236 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f545000c940 con 0x7f546809af80 2024-05-28T06:09:37.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.320+0000 7f546ca00640 1 -- 172.21.15.122:0/3922998236 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54680cc2e0 con 0x7f546809af80 2024-05-28T06:09:37.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.320+0000 7f545fe00640 1 -- 172.21.15.122:0/3922998236 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545000ccf0 con 0x7f546809af80 2024-05-28T06:09:37.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.320+0000 7f546ca00640 1 -- 172.21.15.122:0/3922998236 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54680706c0 con 0x7f546809af80 2024-05-28T06:09:37.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.320+0000 7f546ca00640 1 -- 172.21.15.122:0/3922998236 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5468075620 con 0x7f546809af80 2024-05-28T06:09:37.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.320+0000 7f545fe00640 1 -- 172.21.15.122:0/3922998236 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f545001a070 con 0x7f546809af80 2024-05-28T06:09:37.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.320+0000 7f545fe00640 1 --2- 172.21.15.122:0/3922998236 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5444068650 0x7f544406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:37.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.320+0000 7f545fe00640 1 -- 172.21.15.122:0/3922998236 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f5450087110 con 0x7f546809af80 2024-05-28T06:09:37.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.320+0000 7f5467400640 1 --2- 172.21.15.122:0/3922998236 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5444068650 0x7f544406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:37.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.324+0000 7f5467400640 1 --2- 172.21.15.122:0/3922998236 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5444068650 0x7f544406ab10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f54580ae000 tx=0x7f54580a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:37.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.324+0000 7f545fe00640 1 -- 172.21.15.122:0/3922998236 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f54500572f0 con 0x7f546809af80 2024-05-28T06:09:37.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:37.524+0000 7f546ca00640 1 -- 172.21.15.122:0/3922998236 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f54680b2a20 con 0x7f546809af80 2024-05-28T06:09:38.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.144+0000 7f545fe00640 1 -- 172.21.15.122:0/3922998236 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f5450056bf0 con 0x7f546809af80 2024-05-28T06:09:38.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.148+0000 7f546ca00640 1 -- 172.21.15.122:0/3922998236 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5444068650 msgr2=0x7f544406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:38.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.148+0000 7f546ca00640 1 --2- 172.21.15.122:0/3922998236 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5444068650 0x7f544406ab10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f54580ae000 tx=0x7f54580a7070 comp rx=0 tx=0).stop 2024-05-28T06:09:38.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.148+0000 7f546ca00640 1 -- 172.21.15.122:0/3922998236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f546809af80 msgr2=0x7f546815aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:38.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.148+0000 7f546ca00640 1 --2- 172.21.15.122:0/3922998236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f546809af80 0x7f546815aaf0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f545000e8a0 tx=0x7f545000eca0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.148+0000 7f546ca00640 1 -- 172.21.15.122:0/3922998236 shutdown_connections 2024-05-28T06:09:38.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.148+0000 7f546ca00640 1 --2- 172.21.15.122:0/3922998236 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5444068650 0x7f544406ab10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.148+0000 7f546ca00640 1 --2- 172.21.15.122:0/3922998236 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5468161ff0 0x7f546815b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.148+0000 7f546ca00640 1 --2- 172.21.15.122:0/3922998236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f546809af80 0x7f546815aaf0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.148+0000 7f546ca00640 1 --2- 172.21.15.122:0/3922998236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f546806cc60 0x7f5468070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.148+0000 7f546ca00640 1 -- 172.21.15.122:0/3922998236 >> 172.21.15.122:0/3922998236 conn(0x7f54680b3f80 msgr2=0x7f54680b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:38.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.148+0000 7f546ca00640 1 -- 172.21.15.122:0/3922998236 shutdown_connections 2024-05-28T06:09:38.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.148+0000 7f546ca00640 1 -- 172.21.15.122:0/3922998236 wait complete. 2024-05-28T06:09:38.172 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-28T06:09:38.172 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:09:38.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.304+0000 7f78a0e00640 1 Processor -- start 2024-05-28T06:09:38.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.304+0000 7f78a0e00640 1 -- start start 2024-05-28T06:09:38.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.308+0000 7f78a0e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f789c15ea20 0x7f789c0d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:38.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.308+0000 7f78a0e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f789c0b36b0 0x7f789c0b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:38.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.308+0000 7f78a0e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f789c0b46c0 con 0x7f789c073c80 2024-05-28T06:09:38.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.308+0000 7f78a0e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f789c0b4040 con 0x7f789c0b36b0 2024-05-28T06:09:38.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.308+0000 7f78a0e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f789c15ee00 con 0x7f789c15ea20 2024-05-28T06:09:38.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.308+0000 7f7891400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f789c073c80 0x7f789c0b4fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:48924/0 (socket says 172.21.15.122:48924) 2024-05-28T06:09:38.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.308+0000 7f7891400640 1 -- 172.21.15.122:0/4199507399 learned_addr learned my addr 172.21.15.122:0/4199507399 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:38.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.308+0000 7f789a800640 1 --2- 172.21.15.122:0/4199507399 >> v2:172.21.15.122:3300/0 conn(0x7f789c0b36b0 0x7f789c0b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:38.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.308+0000 7f7899e00640 1 --2- 172.21.15.122:0/4199507399 >> v2:172.21.15.153:3300/0 conn(0x7f789c15ea20 0x7f789c0d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:38.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.308+0000 7f7899400640 1 -- 172.21.15.122:0/4199507399 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 375365392 0 0) 0x7f789c0b46c0 con 0x7f789c073c80 2024-05-28T06:09:38.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.308+0000 7f7899400640 1 -- 172.21.15.122:0/4199507399 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7880003530 con 0x7f789c073c80 2024-05-28T06:09:38.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.308+0000 7f789a800640 1 -- 172.21.15.122:0/4199507399 >> v2:172.21.15.153:3300/0 conn(0x7f789c15ea20 msgr2=0x7f789c0d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:38.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.308+0000 7f789a800640 1 --2- 172.21.15.122:0/4199507399 >> v2:172.21.15.153:3300/0 conn(0x7f789c15ea20 0x7f789c0d0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.308+0000 7f789a800640 1 -- 172.21.15.122:0/4199507399 >> v1:172.21.15.122:6789/0 conn(0x7f789c073c80 legacy=0x7f789c0b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:38.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.308+0000 7f789a800640 1 -- 172.21.15.122:0/4199507399 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f789c0b49a0 con 0x7f789c0b36b0 2024-05-28T06:09:38.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.308+0000 7f7899e00640 1 --2- 172.21.15.122:0/4199507399 >> v2:172.21.15.153:3300/0 conn(0x7f789c15ea20 0x7f789c0d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:09:38.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.312+0000 7f789a800640 1 --2- 172.21.15.122:0/4199507399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f789c0b36b0 0x7f789c0b3b00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f789c06f360 tx=0x7f789401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93ba829924ea3b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:38.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.312+0000 7f7899400640 1 -- 172.21.15.122:0/4199507399 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78940b2070 con 0x7f789c0b36b0 2024-05-28T06:09:38.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.312+0000 7f7899400640 1 -- 172.21.15.122:0/4199507399 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78940a5900 con 0x7f789c0b36b0 2024-05-28T06:09:38.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.312+0000 7f7899400640 1 -- 172.21.15.122:0/4199507399 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78940a5cd0 con 0x7f789c0b36b0 2024-05-28T06:09:38.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.312+0000 7f78a0e00640 1 -- 172.21.15.122:0/4199507399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f789c0b36b0 msgr2=0x7f789c0b3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:38.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.312+0000 7f78a0e00640 1 --2- 172.21.15.122:0/4199507399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f789c0b36b0 0x7f789c0b3b00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f789c06f360 tx=0x7f789401c930 comp rx=0 tx=0).stop 2024-05-28T06:09:38.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.312+0000 7f78a0e00640 1 -- 172.21.15.122:0/4199507399 shutdown_connections 2024-05-28T06:09:38.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.312+0000 7f78a0e00640 1 --2- 172.21.15.122:0/4199507399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f789c0b36b0 0x7f789c0b3b00 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.312+0000 7f78a0e00640 1 --2- 172.21.15.122:0/4199507399 >> v2:172.21.15.153:3300/0 conn(0x7f789c15ea20 0x7f789c0d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.312+0000 7f78a0e00640 1 -- 172.21.15.122:0/4199507399 >> 172.21.15.122:0/4199507399 conn(0x7f789c0b6c10 msgr2=0x7f789c0b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:38.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.312+0000 7f78a0e00640 1 -- 172.21.15.122:0/4199507399 shutdown_connections 2024-05-28T06:09:38.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.312+0000 7f78a0e00640 1 -- 172.21.15.122:0/4199507399 wait complete. 2024-05-28T06:09:38.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.312+0000 7f78a0e00640 1 Processor -- start 2024-05-28T06:09:38.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.312+0000 7f78a0e00640 1 -- start start 2024-05-28T06:09:38.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f78a0e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f789c073c80 0x7f789c14ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:38.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f78a0e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f789c0b36b0 0x7f789c158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:38.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f78a0e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f789c15ea20 0x7f789c159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:38.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f78a0e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f789c0ce960 con 0x7f789c0b36b0 2024-05-28T06:09:38.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f78a0e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f789c0b56d0 con 0x7f789c073c80 2024-05-28T06:09:38.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f78a0e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f789c0ceae0 con 0x7f789c15ea20 2024-05-28T06:09:38.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f7891400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f789c0b36b0 0x7f789c158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:38.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f7891400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f789c0b36b0 0x7f789c158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48540/0 (socket says 172.21.15.122:48540) 2024-05-28T06:09:38.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f7891400640 1 -- 172.21.15.122:0/2560092150 learned_addr learned my addr 172.21.15.122:0/2560092150 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:38.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f789a800640 1 --2- 172.21.15.122:0/2560092150 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f789c15ea20 0x7f789c159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:38.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f7899e00640 1 --2- 172.21.15.122:0/2560092150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f789c073c80 0x7f789c14ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:38.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f7891400640 1 -- 172.21.15.122:0/2560092150 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f789c15ea20 msgr2=0x7f789c159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:38.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f7891400640 1 --2- 172.21.15.122:0/2560092150 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f789c15ea20 0x7f789c159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f7891400640 1 -- 172.21.15.122:0/2560092150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f789c073c80 msgr2=0x7f789c14ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:38.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f7891400640 1 --2- 172.21.15.122:0/2560092150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f789c073c80 0x7f789c14ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f7891400640 1 -- 172.21.15.122:0/2560092150 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f789c0cc9b0 con 0x7f789c0b36b0 2024-05-28T06:09:38.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f7891400640 1 --2- 172.21.15.122:0/2560092150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f789c0b36b0 0x7f789c158e20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f788400c480 tx=0x7f788400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:38.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f7892a00640 1 -- 172.21.15.122:0/2560092150 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7884017070 con 0x7f789c0b36b0 2024-05-28T06:09:38.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f7892a00640 1 -- 172.21.15.122:0/2560092150 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7884005cf0 con 0x7f789c0b36b0 2024-05-28T06:09:38.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f78a0e00640 1 -- 172.21.15.122:0/2560092150 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f789c0ccc90 con 0x7f789c0b36b0 2024-05-28T06:09:38.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f7892a00640 1 -- 172.21.15.122:0/2560092150 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7884007290 con 0x7f789c0b36b0 2024-05-28T06:09:38.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f78a0e00640 1 -- 172.21.15.122:0/2560092150 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f789c0cd250 con 0x7f789c0b36b0 2024-05-28T06:09:38.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f78a0e00640 1 -- 172.21.15.122:0/2560092150 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f789c068c40 con 0x7f789c0b36b0 2024-05-28T06:09:38.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.316+0000 7f7892a00640 1 -- 172.21.15.122:0/2560092150 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f788401a070 con 0x7f789c0b36b0 2024-05-28T06:09:38.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.320+0000 7f7892a00640 1 --2- 172.21.15.122:0/2560092150 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7878068680 0x7f787806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:38.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.320+0000 7f7892a00640 1 -- 172.21.15.122:0/2560092150 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f78840861f0 con 0x7f789c0b36b0 2024-05-28T06:09:38.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.320+0000 7f7899e00640 1 --2- 172.21.15.122:0/2560092150 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7878068680 0x7f787806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:38.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.320+0000 7f7899e00640 1 --2- 172.21.15.122:0/2560092150 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7878068680 0x7f787806ab40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f789c073b00 tx=0x7f788c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:38.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.324+0000 7f7892a00640 1 -- 172.21.15.122:0/2560092150 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f78840564b0 con 0x7f789c0b36b0 2024-05-28T06:09:38.517 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.512+0000 7f78a0e00640 1 -- 172.21.15.122:0/2560092150 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f789c153f30 con 0x7f789c0b36b0 2024-05-28T06:09:38.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.516+0000 7f7892a00640 1 -- 172.21.15.122:0/2560092150 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5184 (secure 0 0 0) 0x7f7884055db0 con 0x7f789c0b36b0 2024-05-28T06:09:38.518 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:38.518 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5482,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/257060312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":257060312},{"type":"v1","addr":"172.21.15.153:6834","nonce":257060312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5485,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/573898687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":573898687},{"type":"v1","addr":"172.21.15.153:6835","nonce":573898687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/246840682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":246840682},{"type":"v1","addr":"172.21.15.122:6836","nonce":246840682}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-28T06:09:34.510484+0000","modified":"2024-05-28T06:09:37.531081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1627568336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1627568336},{"type":"v1","addr":"172.21.15.122:6837","nonce":1627568336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":3}]} 2024-05-28T06:09:38.518 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 28 2024-05-28T06:09:38.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.516+0000 7f78a0e00640 1 -- 172.21.15.122:0/2560092150 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7878068680 msgr2=0x7f787806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:38.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.516+0000 7f78a0e00640 1 --2- 172.21.15.122:0/2560092150 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7878068680 0x7f787806ab40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f789c073b00 tx=0x7f788c008040 comp rx=0 tx=0).stop 2024-05-28T06:09:38.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.516+0000 7f78a0e00640 1 -- 172.21.15.122:0/2560092150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f789c0b36b0 msgr2=0x7f789c158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:38.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.516+0000 7f78a0e00640 1 --2- 172.21.15.122:0/2560092150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f789c0b36b0 0x7f789c158e20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f788400c480 tx=0x7f788400c940 comp rx=0 tx=0).stop 2024-05-28T06:09:38.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.516+0000 7f78a0e00640 1 -- 172.21.15.122:0/2560092150 shutdown_connections 2024-05-28T06:09:38.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.516+0000 7f78a0e00640 1 --2- 172.21.15.122:0/2560092150 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7878068680 0x7f787806ab40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.516+0000 7f78a0e00640 1 --2- 172.21.15.122:0/2560092150 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f789c15ea20 0x7f789c159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.516+0000 7f78a0e00640 1 --2- 172.21.15.122:0/2560092150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f789c0b36b0 0x7f789c158e20 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.516+0000 7f78a0e00640 1 --2- 172.21.15.122:0/2560092150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f789c073c80 0x7f789c14ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.516+0000 7f78a0e00640 1 -- 172.21.15.122:0/2560092150 >> 172.21.15.122:0/2560092150 conn(0x7f789c0b6c10 msgr2=0x7f789c14fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:38.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.516+0000 7f78a0e00640 1 -- 172.21.15.122:0/2560092150 shutdown_connections 2024-05-28T06:09:38.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.516+0000 7f78a0e00640 1 -- 172.21.15.122:0/2560092150 wait complete. 2024-05-28T06:09:38.539 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:09:38.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.672+0000 7f057ea00640 1 Processor -- start 2024-05-28T06:09:38.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.672+0000 7f057ea00640 1 -- start start 2024-05-28T06:09:38.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.672+0000 7f057ea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05780d0c80 0x7f057809b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:38.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.672+0000 7f057ea00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f057815d7e0 0x7f05780cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:38.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.672+0000 7f057ea00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f057815dc70 con 0x7f05780d0270 2024-05-28T06:09:38.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.672+0000 7f057ea00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f05780d0830 con 0x7f057815d7e0 2024-05-28T06:09:38.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.672+0000 7f057ea00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f057809aa40 con 0x7f05780d0c80 2024-05-28T06:09:38.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f056fe00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f05780d0270 0x7f05780d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:48940/0 (socket says 172.21.15.122:48940) 2024-05-28T06:09:38.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f056fe00640 1 -- 172.21.15.122:0/1511275282 learned_addr learned my addr 172.21.15.122:0/1511275282 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:38.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f0577e00640 1 --2- 172.21.15.122:0/1511275282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05780d0c80 0x7f057809b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:38.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f057ca00640 1 --2- 172.21.15.122:0/1511275282 >> v2:172.21.15.153:3300/0 conn(0x7f057815d7e0 0x7f05780cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:38.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f0577400640 1 -- 172.21.15.122:0/1511275282 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3979316928 0 0) 0x7f057815dc70 con 0x7f05780d0270 2024-05-28T06:09:38.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f0577400640 1 -- 172.21.15.122:0/1511275282 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f055c003530 con 0x7f05780d0270 2024-05-28T06:09:38.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f0577400640 1 -- 172.21.15.122:0/1511275282 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1920334702 0 0) 0x7f055c003530 con 0x7f05780d0270 2024-05-28T06:09:38.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f0577400640 1 -- 172.21.15.122:0/1511275282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05780d0c80 msgr2=0x7f057809b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:38.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f0577400640 1 --2- 172.21.15.122:0/1511275282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05780d0c80 0x7f057809b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f0577400640 1 -- 172.21.15.122:0/1511275282 >> v2:172.21.15.153:3300/0 conn(0x7f057815d7e0 msgr2=0x7f05780cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:38.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f0577400640 1 --2- 172.21.15.122:0/1511275282 >> v2:172.21.15.153:3300/0 conn(0x7f057815d7e0 0x7f05780cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f0577400640 1 -- 172.21.15.122:0/1511275282 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f057809ad20 con 0x7f05780d0270 2024-05-28T06:09:38.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f0577400640 1 -- 172.21.15.122:0/1511275282 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f0560001680 con 0x7f05780d0270 2024-05-28T06:09:38.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f0577400640 1 -- 172.21.15.122:0/1511275282 >> v1:172.21.15.122:6789/0 conn(0x7f05780d0270 legacy=0x7f05780d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:38.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f0577400640 1 --2- 172.21.15.122:0/1511275282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05780d0c80 0x7f055c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:38.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f0577400640 1 --2- 172.21.15.122:0/1511275282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f055c003f40 0x7f055c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:38.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f0577400640 1 --2- 172.21.15.122:0/1511275282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f055c004d50 0x7f055c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:38.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f0577400640 1 -- 172.21.15.122:0/1511275282 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f05780d0830 con 0x7f055c004d50 2024-05-28T06:09:38.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f0577400640 1 -- 172.21.15.122:0/1511275282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f057809aa40 con 0x7f055c003f40 2024-05-28T06:09:38.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f0577400640 1 -- 172.21.15.122:0/1511275282 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f055c00ba20 con 0x7f05780d0c80 2024-05-28T06:09:38.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f057ca00640 1 --2- 172.21.15.122:0/1511275282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f055c004d50 0x7f055c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:38.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f056fe00640 1 --2- 172.21.15.122:0/1511275282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f055c003f40 0x7f055c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:38.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f0577e00640 1 --2- 172.21.15.122:0/1511275282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05780d0c80 0x7f055c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:38.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f057ca00640 1 -- 172.21.15.122:0/1511275282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05780d0c80 msgr2=0x7f055c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:38.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f057ca00640 1 --2- 172.21.15.122:0/1511275282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05780d0c80 0x7f055c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f057ca00640 1 -- 172.21.15.122:0/1511275282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f055c003f40 msgr2=0x7f055c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:38.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f057ca00640 1 --2- 172.21.15.122:0/1511275282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f055c003f40 0x7f055c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.676+0000 7f057ca00640 1 -- 172.21.15.122:0/1511275282 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055c003530 con 0x7f055c004d50 2024-05-28T06:09:38.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.680+0000 7f057ca00640 1 --2- 172.21.15.122:0/1511275282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f055c004d50 0x7f055c0051d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f057000e170 tx=0x7f057001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1c4ef2289763a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:38.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.680+0000 7f0577400640 1 -- 172.21.15.122:0/1511275282 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05700b0070 con 0x7f055c004d50 2024-05-28T06:09:38.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.680+0000 7f0577400640 1 -- 172.21.15.122:0/1511275282 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05700ab600 con 0x7f055c004d50 2024-05-28T06:09:38.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.680+0000 7f0577400640 1 -- 172.21.15.122:0/1511275282 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0570009c10 con 0x7f055c004d50 2024-05-28T06:09:38.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.680+0000 7f057ea00640 1 -- 172.21.15.122:0/1511275282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f055c004d50 msgr2=0x7f055c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:38.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.680+0000 7f057ea00640 1 --2- 172.21.15.122:0/1511275282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f055c004d50 0x7f055c0051d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f057000e170 tx=0x7f057001c950 comp rx=0 tx=0).stop 2024-05-28T06:09:38.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.680+0000 7f057ca00640 1 -- 172.21.15.122:0/1511275282 reap_dead start 2024-05-28T06:09:38.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.680+0000 7f057ea00640 1 -- 172.21.15.122:0/1511275282 shutdown_connections 2024-05-28T06:09:38.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.680+0000 7f057ea00640 1 -- 172.21.15.122:0/1511275282 >> 172.21.15.122:0/1511275282 conn(0x7f05780b4190 msgr2=0x7f05780b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:38.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.680+0000 7f057ea00640 1 -- 172.21.15.122:0/1511275282 shutdown_connections 2024-05-28T06:09:38.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.680+0000 7f057ea00640 1 -- 172.21.15.122:0/1511275282 wait complete. 2024-05-28T06:09:38.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.680+0000 7f057ea00640 1 Processor -- start 2024-05-28T06:09:38.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.680+0000 7f057ea00640 1 -- start start 2024-05-28T06:09:38.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f057ea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f055c004d50 0x7f05780ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:38.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f057ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05780c8940 0x7f05780cb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:38.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f057ea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05780c8dc0 0x7f05780cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:38.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f057ea00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f05780cdc80 con 0x7f05780c8940 2024-05-28T06:09:38.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f057ea00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f05780cdb00 con 0x7f05780c8dc0 2024-05-28T06:09:38.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f057ea00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f05780cde00 con 0x7f055c004d50 2024-05-28T06:09:38.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f056fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05780c8940 0x7f05780cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:38.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f056fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05780c8940 0x7f05780cb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48556/0 (socket says 172.21.15.122:48556) 2024-05-28T06:09:38.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f056fe00640 1 -- 172.21.15.122:0/245207708 learned_addr learned my addr 172.21.15.122:0/245207708 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:38.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f0577e00640 1 --2- 172.21.15.122:0/245207708 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f055c004d50 0x7f05780ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:38.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f057ca00640 1 --2- 172.21.15.122:0/245207708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05780c8dc0 0x7f05780cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:38.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f056fe00640 1 -- 172.21.15.122:0/245207708 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f055c004d50 msgr2=0x7f05780ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:38.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f056fe00640 1 --2- 172.21.15.122:0/245207708 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f055c004d50 0x7f05780ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f056fe00640 1 -- 172.21.15.122:0/245207708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05780c8dc0 msgr2=0x7f05780cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:38.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f056fe00640 1 --2- 172.21.15.122:0/245207708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05780c8dc0 0x7f05780cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f056fe00640 1 -- 172.21.15.122:0/245207708 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05781581f0 con 0x7f05780c8940 2024-05-28T06:09:38.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f056fe00640 1 --2- 172.21.15.122:0/245207708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05780c8940 0x7f05780cb360 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0560012550 tx=0x7f0560012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:38.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f0574c00640 1 -- 172.21.15.122:0/245207708 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056001c070 con 0x7f05780c8940 2024-05-28T06:09:38.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f0574c00640 1 -- 172.21.15.122:0/245207708 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0560014810 con 0x7f05780c8940 2024-05-28T06:09:38.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f0574c00640 1 -- 172.21.15.122:0/245207708 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0560014c00 con 0x7f05780c8940 2024-05-28T06:09:38.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f057ea00640 1 -- 172.21.15.122:0/245207708 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0578149a40 con 0x7f05780c8940 2024-05-28T06:09:38.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f057ea00640 1 -- 172.21.15.122:0/245207708 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05780caa40 con 0x7f05780c8940 2024-05-28T06:09:38.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f057ea00640 1 -- 172.21.15.122:0/245207708 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0578068c40 con 0x7f05780c8940 2024-05-28T06:09:38.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.684+0000 7f0574c00640 1 -- 172.21.15.122:0/245207708 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f056001f070 con 0x7f05780c8940 2024-05-28T06:09:38.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.688+0000 7f0574c00640 1 --2- 172.21.15.122:0/245207708 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0554068650 0x7f055406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:38.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.688+0000 7f0574c00640 1 -- 172.21.15.122:0/245207708 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f05600897c0 con 0x7f05780c8940 2024-05-28T06:09:38.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.688+0000 7f0577e00640 1 --2- 172.21.15.122:0/245207708 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0554068650 0x7f055406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:38.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.688+0000 7f0577e00640 1 --2- 172.21.15.122:0/245207708 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0554068650 0x7f055406ab10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0568009be0 tx=0x7f0568009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:38.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.692+0000 7f0574c00640 1 -- 172.21.15.122:0/245207708 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f05781581f0 con 0x7f05780c8940 2024-05-28T06:09:38.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.852+0000 7f057ea00640 1 -- 172.21.15.122:0/245207708 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05780b8620 con 0x7f05780c8940 2024-05-28T06:09:38.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.852+0000 7f0574c00640 1 -- 172.21.15.122:0/245207708 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16613 (secure 0 0 0) 0x7f05600593e0 con 0x7f05780c8940 2024-05-28T06:09:38.856 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:38.856 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":47,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:09:36.131186+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:09:32.856007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-28T06:09:33.467043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:09:38.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.856+0000 7f057ea00640 1 -- 172.21.15.122:0/245207708 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0554068650 msgr2=0x7f055406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:38.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.856+0000 7f057ea00640 1 --2- 172.21.15.122:0/245207708 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0554068650 0x7f055406ab10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0568009be0 tx=0x7f0568009190 comp rx=0 tx=0).stop 2024-05-28T06:09:38.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.856+0000 7f057ea00640 1 -- 172.21.15.122:0/245207708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05780c8940 msgr2=0x7f05780cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:38.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.856+0000 7f057ea00640 1 --2- 172.21.15.122:0/245207708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05780c8940 0x7f05780cb360 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0560012550 tx=0x7f0560012950 comp rx=0 tx=0).stop 2024-05-28T06:09:38.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.856+0000 7f057ea00640 1 -- 172.21.15.122:0/245207708 shutdown_connections 2024-05-28T06:09:38.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.856+0000 7f057ea00640 1 --2- 172.21.15.122:0/245207708 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0554068650 0x7f055406ab10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.856+0000 7f057ea00640 1 --2- 172.21.15.122:0/245207708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05780c8dc0 0x7f05780cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.856+0000 7f057ea00640 1 --2- 172.21.15.122:0/245207708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05780c8940 0x7f05780cb360 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.856+0000 7f057ea00640 1 --2- 172.21.15.122:0/245207708 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f055c004d50 0x7f05780ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:38.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.856+0000 7f057ea00640 1 -- 172.21.15.122:0/245207708 >> 172.21.15.122:0/245207708 conn(0x7f05780b4190 msgr2=0x7f05780cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:38.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.856+0000 7f057ea00640 1 -- 172.21.15.122:0/245207708 shutdown_connections 2024-05-28T06:09:38.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:38.856+0000 7f057ea00640 1 -- 172.21.15.122:0/245207708 wait complete. 2024-05-28T06:09:38.877 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-28T06:09:38.877 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-28T06:09:39.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.008+0000 7fb03da00640 1 Processor -- start 2024-05-28T06:09:39.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.008+0000 7fb03da00640 1 -- start start 2024-05-28T06:09:39.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.012+0000 7fb03da00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0380b59c0 0x7fb0380cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:39.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.012+0000 7fb03da00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0380d0310 con 0x7fb0380cff30 2024-05-28T06:09:39.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.012+0000 7fb03da00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb03815be20 con 0x7fb03806f890 2024-05-28T06:09:39.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.012+0000 7fb03da00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb03815c100 con 0x7fb0380b59c0 2024-05-28T06:09:39.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.012+0000 7fb036a00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fb0380cff30 0x7fb03806f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:48942/0 (socket says 172.21.15.122:48942) 2024-05-28T06:09:39.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.012+0000 7fb036a00640 1 -- 172.21.15.122:0/3196417249 learned_addr learned my addr 172.21.15.122:0/3196417249 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:39.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.012+0000 7fb037400640 1 --2- 172.21.15.122:0/3196417249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0380b59c0 0x7fb0380cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:39.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.012+0000 7fb036000640 1 -- 172.21.15.122:0/3196417249 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1549726625 0 0) 0x7fb0380d0310 con 0x7fb0380cff30 2024-05-28T06:09:39.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.012+0000 7fb036000640 1 -- 172.21.15.122:0/3196417249 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb01c003530 con 0x7fb0380cff30 2024-05-28T06:09:39.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.012+0000 7fb036000640 1 -- 172.21.15.122:0/3196417249 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 60095076 0 0) 0x7fb03815be20 con 0x7fb03806f890 2024-05-28T06:09:39.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.012+0000 7fb036000640 1 -- 172.21.15.122:0/3196417249 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0380d0310 con 0x7fb03806f890 2024-05-28T06:09:39.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.012+0000 7fb037400640 1 -- 172.21.15.122:0/3196417249 >> v1:172.21.15.153:6789/0 conn(0x7fb03806f890 legacy=0x7fb0380cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:39.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.012+0000 7fb037400640 1 -- 172.21.15.122:0/3196417249 >> v1:172.21.15.122:6789/0 conn(0x7fb0380cff30 legacy=0x7fb03806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:39.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.012+0000 7fb037400640 1 -- 172.21.15.122:0/3196417249 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb03815c3e0 con 0x7fb0380b59c0 2024-05-28T06:09:39.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.016+0000 7fb037400640 1 --2- 172.21.15.122:0/3196417249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0380b59c0 0x7fb0380cdb00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb030009dc0 tx=0x7fb03001c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56bea83ca335bb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:39.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.016+0000 7fb036000640 1 -- 172.21.15.122:0/3196417249 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0300b2070 con 0x7fb0380b59c0 2024-05-28T06:09:39.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.016+0000 7fb036000640 1 -- 172.21.15.122:0/3196417249 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0300a59c0 con 0x7fb0380b59c0 2024-05-28T06:09:39.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.016+0000 7fb036000640 1 -- 172.21.15.122:0/3196417249 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0300a5d90 con 0x7fb0380b59c0 2024-05-28T06:09:39.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.016+0000 7fb03da00640 1 -- 172.21.15.122:0/3196417249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0380b59c0 msgr2=0x7fb0380cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:39.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.016+0000 7fb03da00640 1 --2- 172.21.15.122:0/3196417249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0380b59c0 0x7fb0380cdb00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb030009dc0 tx=0x7fb03001c960 comp rx=0 tx=0).stop 2024-05-28T06:09:39.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.016+0000 7fb03da00640 1 -- 172.21.15.122:0/3196417249 shutdown_connections 2024-05-28T06:09:39.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.016+0000 7fb03da00640 1 --2- 172.21.15.122:0/3196417249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0380b59c0 0x7fb0380cdb00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.016+0000 7fb03da00640 1 -- 172.21.15.122:0/3196417249 >> 172.21.15.122:0/3196417249 conn(0x7fb03806bd90 msgr2=0x7fb03806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:39.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.016+0000 7fb03da00640 1 -- 172.21.15.122:0/3196417249 shutdown_connections 2024-05-28T06:09:39.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.016+0000 7fb03da00640 1 -- 172.21.15.122:0/3196417249 wait complete. 2024-05-28T06:09:39.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.016+0000 7fb03da00640 1 Processor -- start 2024-05-28T06:09:39.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.016+0000 7fb03da00640 1 -- start start 2024-05-28T06:09:39.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb03da00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb03806f890 0x7fb038154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:39.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb03da00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0380b59c0 0x7fb0381f6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:39.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb03da00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0380cff30 0x7fb03814a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:39.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb03da00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb03806e400 con 0x7fb0380b59c0 2024-05-28T06:09:39.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb03da00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb03806e280 con 0x7fb03806f890 2024-05-28T06:09:39.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb03da00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb03806e580 con 0x7fb0380cff30 2024-05-28T06:09:39.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb02e000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0380b59c0 0x7fb0381f6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:39.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb02e000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0380b59c0 0x7fb0381f6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48566/0 (socket says 172.21.15.122:48566) 2024-05-28T06:09:39.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb02e000640 1 -- 172.21.15.122:0/1808310130 learned_addr learned my addr 172.21.15.122:0/1808310130 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:39.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb036a00640 1 --2- 172.21.15.122:0/1808310130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb03806f890 0x7fb038154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:39.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb037400640 1 --2- 172.21.15.122:0/1808310130 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0380cff30 0x7fb03814a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:39.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb02e000640 1 -- 172.21.15.122:0/1808310130 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0380cff30 msgr2=0x7fb03814a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:39.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb02e000640 1 --2- 172.21.15.122:0/1808310130 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0380cff30 0x7fb03814a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb02e000640 1 -- 172.21.15.122:0/1808310130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb03806f890 msgr2=0x7fb038154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:39.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb02e000640 1 --2- 172.21.15.122:0/1808310130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb03806f890 0x7fb038154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb02e000640 1 -- 172.21.15.122:0/1808310130 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0380b2760 con 0x7fb0380b59c0 2024-05-28T06:09:39.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb02e000640 1 --2- 172.21.15.122:0/1808310130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0380b59c0 0x7fb0381f6fc0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb02000c410 tx=0x7fb02000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:39.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb02f400640 1 -- 172.21.15.122:0/1808310130 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020017070 con 0x7fb0380b59c0 2024-05-28T06:09:39.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb02f400640 1 -- 172.21.15.122:0/1808310130 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0200052f0 con 0x7fb0380b59c0 2024-05-28T06:09:39.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb02f400640 1 -- 172.21.15.122:0/1808310130 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020003840 con 0x7fb0380b59c0 2024-05-28T06:09:39.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb03da00640 1 -- 172.21.15.122:0/1808310130 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0380b2a40 con 0x7fb0380b59c0 2024-05-28T06:09:39.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb03da00640 1 -- 172.21.15.122:0/1808310130 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0380b3000 con 0x7fb0380b59c0 2024-05-28T06:09:39.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb03da00640 1 -- 172.21.15.122:0/1808310130 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb038068c40 con 0x7fb0380b59c0 2024-05-28T06:09:39.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.020+0000 7fb02f400640 1 -- 172.21.15.122:0/1808310130 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7fb02001a070 con 0x7fb0380b59c0 2024-05-28T06:09:39.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.024+0000 7fb02f400640 1 --2- 172.21.15.122:0/1808310130 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb014068680 0x7fb01406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:39.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.024+0000 7fb02f400640 1 -- 172.21.15.122:0/1808310130 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7fb020086120 con 0x7fb0380b59c0 2024-05-28T06:09:39.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.024+0000 7fb036a00640 1 --2- 172.21.15.122:0/1808310130 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb014068680 0x7fb01406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:39.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.024+0000 7fb036a00640 1 --2- 172.21.15.122:0/1808310130 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb014068680 0x7fb01406ab40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb028000f70 tx=0x7fb028007d00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:39.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.028+0000 7fb02f400640 1 -- 172.21.15.122:0/1808310130 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb020055d90 con 0x7fb0380b59c0 2024-05-28T06:09:39.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.180+0000 7fb03da00640 1 -- 172.21.15.122:0/1808310130 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb038147780 con 0x7fb014068680 2024-05-28T06:09:39.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.188+0000 7fb02f400640 1 -- 172.21.15.122:0/1808310130 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237198 (secure 0 0 0) 0x7fb028001420 con 0x7fb014068680 2024-05-28T06:09:39.195 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:39.197 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-05-28T06:09:39.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.192+0000 7fb03da00640 1 -- 172.21.15.122:0/1808310130 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb014068680 msgr2=0x7fb01406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:39.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.192+0000 7fb03da00640 1 --2- 172.21.15.122:0/1808310130 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb014068680 0x7fb01406ab40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb028000f70 tx=0x7fb028007d00 comp rx=0 tx=0).stop 2024-05-28T06:09:39.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.192+0000 7fb03da00640 1 -- 172.21.15.122:0/1808310130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0380b59c0 msgr2=0x7fb0381f6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:39.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.192+0000 7fb03da00640 1 --2- 172.21.15.122:0/1808310130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0380b59c0 0x7fb0381f6fc0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb02000c410 tx=0x7fb02000c8d0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.192+0000 7fb03da00640 1 -- 172.21.15.122:0/1808310130 shutdown_connections 2024-05-28T06:09:39.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.192+0000 7fb03da00640 1 --2- 172.21.15.122:0/1808310130 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb014068680 0x7fb01406ab40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.192+0000 7fb03da00640 1 --2- 172.21.15.122:0/1808310130 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0380cff30 0x7fb03814a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.192+0000 7fb03da00640 1 --2- 172.21.15.122:0/1808310130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0380b59c0 0x7fb0381f6fc0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.192+0000 7fb03da00640 1 --2- 172.21.15.122:0/1808310130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb03806f890 0x7fb038154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.192+0000 7fb03da00640 1 -- 172.21.15.122:0/1808310130 >> 172.21.15.122:0/1808310130 conn(0x7fb03806bd90 msgr2=0x7fb038155760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:39.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.192+0000 7fb03da00640 1 -- 172.21.15.122:0/1808310130 shutdown_connections 2024-05-28T06:09:39.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.192+0000 7fb03da00640 1 -- 172.21.15.122:0/1808310130 wait complete. 2024-05-28T06:09:39.215 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-05-28T06:09:37.292774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":275344,"kb_used_data":5084,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754699376,"statfs":{"total":773094113280,"available":772812161024,"internally_reserved":0,"allocated":5206016,"data_stored":2795095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":276614705},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.178691"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:34.113632+0000","last_change":"2024-05-28T06:09:34.113632+0000","last_active":"2024-05-28T06:09:34.113632+0000","last_peered":"2024-05-28T06:09:34.113632+0000","last_clean":"2024-05-28T06:09:34.113632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:34.113632+0000","last_undegraded":"2024-05-28T06:09:34.113632+0000","last_fullsized":"2024-05-28T06:09:34.113632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-28T06:09:33.111015+0000","last_change":"2024-05-28T06:09:33.111015+0000","last_active":"2024-05-28T06:09:33.111015+0000","last_peered":"2024-05-28T06:09:33.111015+0000","last_clean":"2024-05-28T06:09:33.111015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-28T06:09:33.111015+0000","last_undegraded":"2024-05-28T06:09:33.111015+0000","last_fullsized":"2024-05-28T06:09:33.111015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":209,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-05-28T06:09:31.227727+0000","last_change":"2024-05-28T06:05:38.517922+0000","last_active":"2024-05-28T06:09:31.227727+0000","last_peered":"2024-05-28T06:09:31.227727+0000","last_clean":"2024-05-28T06:09:31.227727+0000","last_became_active":"2024-05-28T06:05:38.514745+0000","last_became_peered":"2024-05-28T06:05:38.514745+0000","last_unstale":"2024-05-28T06:09:31.227727+0000","last_undegraded":"2024-05-28T06:09:31.227727+0000","last_fullsized":"2024-05-28T06:09:31.227727+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_clean_scrub_stamp":"2024-05-28T06:05:37.485018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:23:27.978203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36416,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335424,"statfs":{"total":96636764160,"available":96599474176,"internally_reserved":0,"allocated":1097728,"data_stored":792795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31676,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":503808,"data_stored":202427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35840,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336000,"statfs":{"total":96636764160,"available":96600064000,"internally_reserved":0,"allocated":503808,"data_stored":202427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35820,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336020,"statfs":{"total":96636764160,"available":96600084480,"internally_reserved":0,"allocated":491520,"data_stored":197370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35832,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336008,"statfs":{"total":96636764160,"available":96600072192,"internally_reserved":0,"allocated":503808,"data_stored":202427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31676,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":503808,"data_stored":202427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35832,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336008,"statfs":{"total":96636764160,"available":96600072192,"internally_reserved":0,"allocated":503808,"data_stored":202427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1097728,"data_stored":792795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-28T06:09:39.219 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-28T06:09:39.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.392+0000 7fe43c400640 1 Processor -- start 2024-05-28T06:09:39.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.396+0000 7fe43c400640 1 -- start start 2024-05-28T06:09:39.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.396+0000 7fe43c400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe43415ea50 0x7fe43415ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:39.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.396+0000 7fe43c400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe43415f370 0x7fe43415f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:39.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.396+0000 7fe43c400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe43406caa0 0x7fe43406cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:39.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.396+0000 7fe43c400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fe434163120 con 0x7fe43415f370 2024-05-28T06:09:39.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.396+0000 7fe43c400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe434162510 con 0x7fe43406caa0 2024-05-28T06:09:39.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.396+0000 7fe43c400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe4341627f0 con 0x7fe43415ea50 2024-05-28T06:09:39.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.396+0000 7fe439000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe43415f370 0x7fe43415f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:39.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.396+0000 7fe439000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe43415f370 0x7fe43415f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48574/0 (socket says 172.21.15.122:48574) 2024-05-28T06:09:39.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.396+0000 7fe439000640 1 -- 172.21.15.122:0/310773683 learned_addr learned my addr 172.21.15.122:0/310773683 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:39.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.396+0000 7fe439a00640 1 --2- 172.21.15.122:0/310773683 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe43415ea50 0x7fe43415ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:39.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.396+0000 7fe43a400640 1 --2- 172.21.15.122:0/310773683 >> v2:172.21.15.153:3300/0 conn(0x7fe43406caa0 0x7fe43406cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:39.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.396+0000 7fe439000640 1 -- 172.21.15.122:0/310773683 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe43415ea50 msgr2=0x7fe43415ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:39.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.396+0000 7fe439000640 1 --2- 172.21.15.122:0/310773683 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe43415ea50 0x7fe43415ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.396+0000 7fe439000640 1 -- 172.21.15.122:0/310773683 >> v2:172.21.15.153:3300/0 conn(0x7fe43406caa0 msgr2=0x7fe43406cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:39.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.396+0000 7fe439000640 1 --2- 172.21.15.122:0/310773683 >> v2:172.21.15.153:3300/0 conn(0x7fe43406caa0 0x7fe43406cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.396+0000 7fe439000640 1 -- 172.21.15.122:0/310773683 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe434162ad0 con 0x7fe43415f370 2024-05-28T06:09:39.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.400+0000 7fe439000640 1 --2- 172.21.15.122:0/310773683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe43415f370 0x7fe43415f790 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe434074010 tx=0x7fe42001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6c0bac413773d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:39.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.400+0000 7fe433e00640 1 -- 172.21.15.122:0/310773683 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4200a7070 con 0x7fe43415f370 2024-05-28T06:09:39.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.400+0000 7fe433e00640 1 -- 172.21.15.122:0/310773683 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4200b0070 con 0x7fe43415f370 2024-05-28T06:09:39.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.400+0000 7fe433e00640 1 -- 172.21.15.122:0/310773683 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4200ab890 con 0x7fe43415f370 2024-05-28T06:09:39.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.400+0000 7fe43c400640 1 -- 172.21.15.122:0/310773683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe43415f370 msgr2=0x7fe43415f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:39.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.400+0000 7fe43c400640 1 --2- 172.21.15.122:0/310773683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe43415f370 0x7fe43415f790 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe434074010 tx=0x7fe42001c4f0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.400+0000 7fe43c400640 1 -- 172.21.15.122:0/310773683 shutdown_connections 2024-05-28T06:09:39.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.400+0000 7fe43c400640 1 --2- 172.21.15.122:0/310773683 >> v2:172.21.15.153:3300/0 conn(0x7fe43406caa0 0x7fe43406cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.400+0000 7fe43c400640 1 --2- 172.21.15.122:0/310773683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe43415f370 0x7fe43415f790 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.400+0000 7fe43c400640 1 --2- 172.21.15.122:0/310773683 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe43415ea50 0x7fe43415ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.400+0000 7fe43c400640 1 -- 172.21.15.122:0/310773683 >> 172.21.15.122:0/310773683 conn(0x7fe4340b4190 msgr2=0x7fe4340b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:39.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.400+0000 7fe43c400640 1 -- 172.21.15.122:0/310773683 shutdown_connections 2024-05-28T06:09:39.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.400+0000 7fe43c400640 1 -- 172.21.15.122:0/310773683 wait complete. 2024-05-28T06:09:39.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.400+0000 7fe43c400640 1 Processor -- start 2024-05-28T06:09:39.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.400+0000 7fe43c400640 1 -- start start 2024-05-28T06:09:39.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe43c400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe43406caa0 0x7fe43409d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:39.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe43c400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe43415ea50 0x7fe43414cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:39.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe43c400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe43415f370 0x7fe43409f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:39.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe43c400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe4340d0a60 con 0x7fe43415f370 2024-05-28T06:09:39.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe43c400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe4340d08e0 con 0x7fe43406caa0 2024-05-28T06:09:39.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe43c400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe4340d0be0 con 0x7fe43415ea50 2024-05-28T06:09:39.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe43a400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe43415f370 0x7fe43409f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:39.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe43a400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe43415f370 0x7fe43409f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48590/0 (socket says 172.21.15.122:48590) 2024-05-28T06:09:39.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe43a400640 1 -- 172.21.15.122:0/776833917 learned_addr learned my addr 172.21.15.122:0/776833917 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:39.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe439a00640 1 --2- 172.21.15.122:0/776833917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe43406caa0 0x7fe43409d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:39.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe439000640 1 --2- 172.21.15.122:0/776833917 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe43415ea50 0x7fe43414cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:39.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe43a400640 1 -- 172.21.15.122:0/776833917 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe43415ea50 msgr2=0x7fe43414cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:39.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe43a400640 1 --2- 172.21.15.122:0/776833917 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe43415ea50 0x7fe43414cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe43a400640 1 -- 172.21.15.122:0/776833917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe43406caa0 msgr2=0x7fe43409d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:39.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe43a400640 1 --2- 172.21.15.122:0/776833917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe43406caa0 0x7fe43409d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe43a400640 1 -- 172.21.15.122:0/776833917 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe43414cff0 con 0x7fe43415f370 2024-05-28T06:09:39.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe43a400640 1 --2- 172.21.15.122:0/776833917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe43415f370 0x7fe43409f0e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00d830 tx=0x7fe42c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:39.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe431600640 1 -- 172.21.15.122:0/776833917 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c00b6c0 con 0x7fe43415f370 2024-05-28T06:09:39.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe431600640 1 -- 172.21.15.122:0/776833917 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe42c019070 con 0x7fe43415f370 2024-05-28T06:09:39.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe431600640 1 -- 172.21.15.122:0/776833917 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c00baa0 con 0x7fe43415f370 2024-05-28T06:09:39.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe43c400640 1 -- 172.21.15.122:0/776833917 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe43409f950 con 0x7fe43415f370 2024-05-28T06:09:39.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe43c400640 1 -- 172.21.15.122:0/776833917 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe43409ff10 con 0x7fe43415f370 2024-05-28T06:09:39.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe43c400640 1 -- 172.21.15.122:0/776833917 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe434068c40 con 0x7fe43415f370 2024-05-28T06:09:39.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.404+0000 7fe431600640 1 -- 172.21.15.122:0/776833917 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7fe42c01e460 con 0x7fe43415f370 2024-05-28T06:09:39.411 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.408+0000 7fe431600640 1 --2- 172.21.15.122:0/776833917 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe414068650 0x7fe41406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:39.411 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.408+0000 7fe431600640 1 -- 172.21.15.122:0/776833917 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7fe42c0873f0 con 0x7fe43415f370 2024-05-28T06:09:39.411 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.408+0000 7fe439a00640 1 --2- 172.21.15.122:0/776833917 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe414068650 0x7fe41406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:39.411 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.408+0000 7fe439a00640 1 --2- 172.21.15.122:0/776833917 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe414068650 0x7fe41406ab10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe428003ab0 tx=0x7fe4280098d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:39.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.412+0000 7fe431600640 1 -- 172.21.15.122:0/776833917 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe42c056fd0 con 0x7fe43415f370 2024-05-28T06:09:39.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.564+0000 7fe43c400640 1 -- 172.21.15.122:0/776833917 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe4340b4ea0 con 0x7fe414068650 2024-05-28T06:09:39.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.572+0000 7fe431600640 1 -- 172.21.15.122:0/776833917 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251959 (secure 0 0 0) 0x7fe4340b4ea0 con 0x7fe414068650 2024-05-28T06:09:39.579 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:39.580 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-05-28T06:09:39.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.576+0000 7fe43c400640 1 -- 172.21.15.122:0/776833917 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe414068650 msgr2=0x7fe41406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:39.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.576+0000 7fe43c400640 1 --2- 172.21.15.122:0/776833917 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe414068650 0x7fe41406ab10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe428003ab0 tx=0x7fe4280098d0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.576+0000 7fe43c400640 1 -- 172.21.15.122:0/776833917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe43415f370 msgr2=0x7fe43409f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:39.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.576+0000 7fe43c400640 1 --2- 172.21.15.122:0/776833917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe43415f370 0x7fe43409f0e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00d830 tx=0x7fe42c00dcf0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.576+0000 7fe43c400640 1 -- 172.21.15.122:0/776833917 shutdown_connections 2024-05-28T06:09:39.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.576+0000 7fe43c400640 1 --2- 172.21.15.122:0/776833917 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe414068650 0x7fe41406ab10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.576+0000 7fe43c400640 1 --2- 172.21.15.122:0/776833917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe43415f370 0x7fe43409f0e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.576+0000 7fe43c400640 1 --2- 172.21.15.122:0/776833917 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe43415ea50 0x7fe43414cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.576+0000 7fe43c400640 1 --2- 172.21.15.122:0/776833917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe43406caa0 0x7fe43409d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.576+0000 7fe43c400640 1 -- 172.21.15.122:0/776833917 >> 172.21.15.122:0/776833917 conn(0x7fe4340b4190 msgr2=0x7fe4340702e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:39.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.576+0000 7fe43c400640 1 -- 172.21.15.122:0/776833917 shutdown_connections 2024-05-28T06:09:39.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.576+0000 7fe43c400640 1 -- 172.21.15.122:0/776833917 wait complete. 2024-05-28T06:09:39.599 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-05-28T06:09:39.293092+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":275796,"kb_used_data":5532,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754698924,"statfs":{"total":773094113280,"available":772811698176,"internally_reserved":0,"allocated":5664768,"data_stored":2999944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":276614705},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001140"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.139200+0000","last_change":"2024-05-28T06:09:35.147090+0000","last_active":"2024-05-28T06:09:36.139200+0000","last_peered":"2024-05-28T06:09:36.139200+0000","last_clean":"2024-05-28T06:09:36.139200+0000","last_became_active":"2024-05-28T06:09:35.145898+0000","last_became_peered":"2024-05-28T06:09:35.145898+0000","last_unstale":"2024-05-28T06:09:36.139200+0000","last_undegraded":"2024-05-28T06:09:36.139200+0000","last_fullsized":"2024-05-28T06:09:36.139200+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:03:17.930782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401357+0000","last_change":"2024-05-28T06:09:35.161316+0000","last_active":"2024-05-28T06:09:36.401357+0000","last_peered":"2024-05-28T06:09:36.401357+0000","last_clean":"2024-05-28T06:09:36.401357+0000","last_became_active":"2024-05-28T06:09:35.161012+0000","last_became_peered":"2024-05-28T06:09:35.161012+0000","last_unstale":"2024-05-28T06:09:36.401357+0000","last_undegraded":"2024-05-28T06:09:36.401357+0000","last_fullsized":"2024-05-28T06:09:36.401357+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:52:43.190369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.149009+0000","last_change":"2024-05-28T06:09:35.138087+0000","last_active":"2024-05-28T06:09:36.149009+0000","last_peered":"2024-05-28T06:09:36.149009+0000","last_clean":"2024-05-28T06:09:36.149009+0000","last_became_active":"2024-05-28T06:09:35.137764+0000","last_became_peered":"2024-05-28T06:09:35.137764+0000","last_unstale":"2024-05-28T06:09:36.149009+0000","last_undegraded":"2024-05-28T06:09:36.149009+0000","last_fullsized":"2024-05-28T06:09:36.149009+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:52:30.774242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401506+0000","last_change":"2024-05-28T06:09:35.159819+0000","last_active":"2024-05-28T06:09:36.401506+0000","last_peered":"2024-05-28T06:09:36.401506+0000","last_clean":"2024-05-28T06:09:36.401506+0000","last_became_active":"2024-05-28T06:09:35.153905+0000","last_became_peered":"2024-05-28T06:09:35.153905+0000","last_unstale":"2024-05-28T06:09:36.401506+0000","last_undegraded":"2024-05-28T06:09:36.401506+0000","last_fullsized":"2024-05-28T06:09:36.401506+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:30:23.573452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.400975+0000","last_change":"2024-05-28T06:09:35.145408+0000","last_active":"2024-05-28T06:09:36.400975+0000","last_peered":"2024-05-28T06:09:36.400975+0000","last_clean":"2024-05-28T06:09:36.400975+0000","last_became_active":"2024-05-28T06:09:35.145123+0000","last_became_peered":"2024-05-28T06:09:35.145123+0000","last_unstale":"2024-05-28T06:09:36.400975+0000","last_undegraded":"2024-05-28T06:09:36.400975+0000","last_fullsized":"2024-05-28T06:09:36.400975+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:43:49.065320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.138556+0000","last_change":"2024-05-28T06:09:35.143125+0000","last_active":"2024-05-28T06:09:36.138556+0000","last_peered":"2024-05-28T06:09:36.138556+0000","last_clean":"2024-05-28T06:09:36.138556+0000","last_became_active":"2024-05-28T06:09:35.142823+0000","last_became_peered":"2024-05-28T06:09:35.142823+0000","last_unstale":"2024-05-28T06:09:36.138556+0000","last_undegraded":"2024-05-28T06:09:36.138556+0000","last_fullsized":"2024-05-28T06:09:36.138556+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:50:57.578063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.138797+0000","last_change":"2024-05-28T06:09:35.150392+0000","last_active":"2024-05-28T06:09:36.138797+0000","last_peered":"2024-05-28T06:09:36.138797+0000","last_clean":"2024-05-28T06:09:36.138797+0000","last_became_active":"2024-05-28T06:09:35.150033+0000","last_became_peered":"2024-05-28T06:09:35.150033+0000","last_unstale":"2024-05-28T06:09:36.138797+0000","last_undegraded":"2024-05-28T06:09:36.138797+0000","last_fullsized":"2024-05-28T06:09:36.138797+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:52:43.190369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.400963+0000","last_change":"2024-05-28T06:09:35.153500+0000","last_active":"2024-05-28T06:09:36.400963+0000","last_peered":"2024-05-28T06:09:36.400963+0000","last_clean":"2024-05-28T06:09:36.400963+0000","last_became_active":"2024-05-28T06:09:35.153195+0000","last_became_peered":"2024-05-28T06:09:35.153195+0000","last_unstale":"2024-05-28T06:09:36.400963+0000","last_undegraded":"2024-05-28T06:09:36.400963+0000","last_fullsized":"2024-05-28T06:09:36.400963+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:14:44.022178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401582+0000","last_change":"2024-05-28T06:09:35.160823+0000","last_active":"2024-05-28T06:09:36.401582+0000","last_peered":"2024-05-28T06:09:36.401582+0000","last_clean":"2024-05-28T06:09:36.401582+0000","last_became_active":"2024-05-28T06:09:35.160576+0000","last_became_peered":"2024-05-28T06:09:35.160576+0000","last_unstale":"2024-05-28T06:09:36.401582+0000","last_undegraded":"2024-05-28T06:09:36.401582+0000","last_fullsized":"2024-05-28T06:09:36.401582+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:01:45.059778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401918+0000","last_change":"2024-05-28T06:09:35.153176+0000","last_active":"2024-05-28T06:09:36.401918+0000","last_peered":"2024-05-28T06:09:36.401918+0000","last_clean":"2024-05-28T06:09:36.401918+0000","last_became_active":"2024-05-28T06:09:35.152903+0000","last_became_peered":"2024-05-28T06:09:35.152903+0000","last_unstale":"2024-05-28T06:09:36.401918+0000","last_undegraded":"2024-05-28T06:09:36.401918+0000","last_fullsized":"2024-05-28T06:09:36.401918+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:16:58.271386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401492+0000","last_change":"2024-05-28T06:09:35.152499+0000","last_active":"2024-05-28T06:09:36.401492+0000","last_peered":"2024-05-28T06:09:36.401492+0000","last_clean":"2024-05-28T06:09:36.401492+0000","last_became_active":"2024-05-28T06:09:35.150034+0000","last_became_peered":"2024-05-28T06:09:35.150034+0000","last_unstale":"2024-05-28T06:09:36.401492+0000","last_undegraded":"2024-05-28T06:09:36.401492+0000","last_fullsized":"2024-05-28T06:09:36.401492+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:25:28.299205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401138+0000","last_change":"2024-05-28T06:09:35.141628+0000","last_active":"2024-05-28T06:09:36.401138+0000","last_peered":"2024-05-28T06:09:36.401138+0000","last_clean":"2024-05-28T06:09:36.401138+0000","last_became_active":"2024-05-28T06:09:35.141109+0000","last_became_peered":"2024-05-28T06:09:35.141109+0000","last_unstale":"2024-05-28T06:09:36.401138+0000","last_undegraded":"2024-05-28T06:09:36.401138+0000","last_fullsized":"2024-05-28T06:09:36.401138+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:25:04.303220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.139295+0000","last_change":"2024-05-28T06:09:35.139095+0000","last_active":"2024-05-28T06:09:36.139295+0000","last_peered":"2024-05-28T06:09:36.139295+0000","last_clean":"2024-05-28T06:09:36.139295+0000","last_became_active":"2024-05-28T06:09:35.138827+0000","last_became_peered":"2024-05-28T06:09:35.138827+0000","last_unstale":"2024-05-28T06:09:36.139295+0000","last_undegraded":"2024-05-28T06:09:36.139295+0000","last_fullsized":"2024-05-28T06:09:36.139295+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:25:30.284298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401273+0000","last_change":"2024-05-28T06:09:35.152390+0000","last_active":"2024-05-28T06:09:36.401273+0000","last_peered":"2024-05-28T06:09:36.401273+0000","last_clean":"2024-05-28T06:09:36.401273+0000","last_became_active":"2024-05-28T06:09:35.149553+0000","last_became_peered":"2024-05-28T06:09:35.149553+0000","last_unstale":"2024-05-28T06:09:36.401273+0000","last_undegraded":"2024-05-28T06:09:36.401273+0000","last_fullsized":"2024-05-28T06:09:36.401273+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:26:57.014224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.138508+0000","last_change":"2024-05-28T06:09:35.137222+0000","last_active":"2024-05-28T06:09:36.138508+0000","last_peered":"2024-05-28T06:09:36.138508+0000","last_clean":"2024-05-28T06:09:36.138508+0000","last_became_active":"2024-05-28T06:09:35.136654+0000","last_became_peered":"2024-05-28T06:09:35.136654+0000","last_unstale":"2024-05-28T06:09:36.138508+0000","last_undegraded":"2024-05-28T06:09:36.138508+0000","last_fullsized":"2024-05-28T06:09:36.138508+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:45:47.669538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401204+0000","last_change":"2024-05-28T06:09:35.154454+0000","last_active":"2024-05-28T06:09:36.401204+0000","last_peered":"2024-05-28T06:09:36.401204+0000","last_clean":"2024-05-28T06:09:36.401204+0000","last_became_active":"2024-05-28T06:09:35.153984+0000","last_became_peered":"2024-05-28T06:09:35.153984+0000","last_unstale":"2024-05-28T06:09:36.401204+0000","last_undegraded":"2024-05-28T06:09:36.401204+0000","last_fullsized":"2024-05-28T06:09:36.401204+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:42:07.642630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.149041+0000","last_change":"2024-05-28T06:09:35.143830+0000","last_active":"2024-05-28T06:09:36.149041+0000","last_peered":"2024-05-28T06:09:36.149041+0000","last_clean":"2024-05-28T06:09:36.149041+0000","last_became_active":"2024-05-28T06:09:35.137219+0000","last_became_peered":"2024-05-28T06:09:35.137219+0000","last_unstale":"2024-05-28T06:09:36.149041+0000","last_undegraded":"2024-05-28T06:09:36.149041+0000","last_fullsized":"2024-05-28T06:09:36.149041+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:43:49.065320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.149000+0000","last_change":"2024-05-28T06:09:35.164064+0000","last_active":"2024-05-28T06:09:36.149000+0000","last_peered":"2024-05-28T06:09:36.149000+0000","last_clean":"2024-05-28T06:09:36.149000+0000","last_became_active":"2024-05-28T06:09:35.163776+0000","last_became_peered":"2024-05-28T06:09:35.163776+0000","last_unstale":"2024-05-28T06:09:36.149000+0000","last_undegraded":"2024-05-28T06:09:36.149000+0000","last_fullsized":"2024-05-28T06:09:36.149000+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:09:02.843722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.402266+0000","last_change":"2024-05-28T06:09:35.166113+0000","last_active":"2024-05-28T06:09:36.402266+0000","last_peered":"2024-05-28T06:09:36.402266+0000","last_clean":"2024-05-28T06:09:36.402266+0000","last_became_active":"2024-05-28T06:09:35.165911+0000","last_became_peered":"2024-05-28T06:09:35.165911+0000","last_unstale":"2024-05-28T06:09:36.402266+0000","last_undegraded":"2024-05-28T06:09:36.402266+0000","last_fullsized":"2024-05-28T06:09:36.402266+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:14:44.022178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.139496+0000","last_change":"2024-05-28T06:09:35.155115+0000","last_active":"2024-05-28T06:09:36.139496+0000","last_peered":"2024-05-28T06:09:36.139496+0000","last_clean":"2024-05-28T06:09:36.139496+0000","last_became_active":"2024-05-28T06:09:35.154851+0000","last_became_peered":"2024-05-28T06:09:35.154851+0000","last_unstale":"2024-05-28T06:09:36.139496+0000","last_undegraded":"2024-05-28T06:09:36.139496+0000","last_fullsized":"2024-05-28T06:09:36.139496+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:15:37.130324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.138803+0000","last_change":"2024-05-28T06:09:35.145491+0000","last_active":"2024-05-28T06:09:36.138803+0000","last_peered":"2024-05-28T06:09:36.138803+0000","last_clean":"2024-05-28T06:09:36.138803+0000","last_became_active":"2024-05-28T06:09:35.145241+0000","last_became_peered":"2024-05-28T06:09:35.145241+0000","last_unstale":"2024-05-28T06:09:36.138803+0000","last_undegraded":"2024-05-28T06:09:36.138803+0000","last_fullsized":"2024-05-28T06:09:36.138803+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:10:56.631821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401416+0000","last_change":"2024-05-28T06:09:35.153191+0000","last_active":"2024-05-28T06:09:36.401416+0000","last_peered":"2024-05-28T06:09:36.401416+0000","last_clean":"2024-05-28T06:09:36.401416+0000","last_became_active":"2024-05-28T06:09:35.152885+0000","last_became_peered":"2024-05-28T06:09:35.152885+0000","last_unstale":"2024-05-28T06:09:36.401416+0000","last_undegraded":"2024-05-28T06:09:36.401416+0000","last_fullsized":"2024-05-28T06:09:36.401416+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:00:13.537948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401728+0000","last_change":"2024-05-28T06:09:35.143667+0000","last_active":"2024-05-28T06:09:36.401728+0000","last_peered":"2024-05-28T06:09:36.401728+0000","last_clean":"2024-05-28T06:09:36.401728+0000","last_became_active":"2024-05-28T06:09:35.143341+0000","last_became_peered":"2024-05-28T06:09:35.143341+0000","last_unstale":"2024-05-28T06:09:36.401728+0000","last_undegraded":"2024-05-28T06:09:36.401728+0000","last_fullsized":"2024-05-28T06:09:36.401728+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:17:00.238632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401360+0000","last_change":"2024-05-28T06:09:35.151613+0000","last_active":"2024-05-28T06:09:36.401360+0000","last_peered":"2024-05-28T06:09:36.401360+0000","last_clean":"2024-05-28T06:09:36.401360+0000","last_became_active":"2024-05-28T06:09:35.151351+0000","last_became_peered":"2024-05-28T06:09:35.151351+0000","last_unstale":"2024-05-28T06:09:36.401360+0000","last_undegraded":"2024-05-28T06:09:36.401360+0000","last_fullsized":"2024-05-28T06:09:36.401360+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:18:28.238661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.402076+0000","last_change":"2024-05-28T06:09:35.158000+0000","last_active":"2024-05-28T06:09:36.402076+0000","last_peered":"2024-05-28T06:09:36.402076+0000","last_clean":"2024-05-28T06:09:36.402076+0000","last_became_active":"2024-05-28T06:09:35.157730+0000","last_became_peered":"2024-05-28T06:09:35.157730+0000","last_unstale":"2024-05-28T06:09:36.402076+0000","last_undegraded":"2024-05-28T06:09:36.402076+0000","last_fullsized":"2024-05-28T06:09:36.402076+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:19:38.231598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.139669+0000","last_change":"2024-05-28T06:09:35.141519+0000","last_active":"2024-05-28T06:09:36.139669+0000","last_peered":"2024-05-28T06:09:36.139669+0000","last_clean":"2024-05-28T06:09:36.139669+0000","last_became_active":"2024-05-28T06:09:35.141256+0000","last_became_peered":"2024-05-28T06:09:35.141256+0000","last_unstale":"2024-05-28T06:09:36.139669+0000","last_undegraded":"2024-05-28T06:09:36.139669+0000","last_fullsized":"2024-05-28T06:09:36.139669+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:42:07.642630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.148940+0000","last_change":"2024-05-28T06:09:35.136105+0000","last_active":"2024-05-28T06:09:36.148940+0000","last_peered":"2024-05-28T06:09:36.148940+0000","last_clean":"2024-05-28T06:09:36.148940+0000","last_became_active":"2024-05-28T06:09:35.135786+0000","last_became_peered":"2024-05-28T06:09:35.135786+0000","last_unstale":"2024-05-28T06:09:36.148940+0000","last_undegraded":"2024-05-28T06:09:36.148940+0000","last_fullsized":"2024-05-28T06:09:36.148940+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:38:52.999299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401135+0000","last_change":"2024-05-28T06:09:35.141745+0000","last_active":"2024-05-28T06:09:36.401135+0000","last_peered":"2024-05-28T06:09:36.401135+0000","last_clean":"2024-05-28T06:09:36.401135+0000","last_became_active":"2024-05-28T06:09:35.141466+0000","last_became_peered":"2024-05-28T06:09:35.141466+0000","last_unstale":"2024-05-28T06:09:36.401135+0000","last_undegraded":"2024-05-28T06:09:36.401135+0000","last_fullsized":"2024-05-28T06:09:36.401135+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:15:05.860393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.402182+0000","last_change":"2024-05-28T06:09:35.148648+0000","last_active":"2024-05-28T06:09:36.402182+0000","last_peered":"2024-05-28T06:09:36.402182+0000","last_clean":"2024-05-28T06:09:36.402182+0000","last_became_active":"2024-05-28T06:09:35.148354+0000","last_became_peered":"2024-05-28T06:09:35.148354+0000","last_unstale":"2024-05-28T06:09:36.402182+0000","last_undegraded":"2024-05-28T06:09:36.402182+0000","last_fullsized":"2024-05-28T06:09:36.402182+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:53:38.708981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.148750+0000","last_change":"2024-05-28T06:09:35.136461+0000","last_active":"2024-05-28T06:09:36.148750+0000","last_peered":"2024-05-28T06:09:36.148750+0000","last_clean":"2024-05-28T06:09:36.148750+0000","last_became_active":"2024-05-28T06:09:35.136150+0000","last_became_peered":"2024-05-28T06:09:35.136150+0000","last_unstale":"2024-05-28T06:09:36.148750+0000","last_undegraded":"2024-05-28T06:09:36.148750+0000","last_fullsized":"2024-05-28T06:09:36.148750+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:16:58.271386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.138843+0000","last_change":"2024-05-28T06:09:35.136999+0000","last_active":"2024-05-28T06:09:36.138843+0000","last_peered":"2024-05-28T06:09:36.138843+0000","last_clean":"2024-05-28T06:09:36.138843+0000","last_became_active":"2024-05-28T06:09:35.136311+0000","last_became_peered":"2024-05-28T06:09:35.136311+0000","last_unstale":"2024-05-28T06:09:36.138843+0000","last_undegraded":"2024-05-28T06:09:36.138843+0000","last_fullsized":"2024-05-28T06:09:36.138843+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:00:53.988622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.138685+0000","last_change":"2024-05-28T06:09:35.144739+0000","last_active":"2024-05-28T06:09:36.138685+0000","last_peered":"2024-05-28T06:09:36.138685+0000","last_clean":"2024-05-28T06:09:36.138685+0000","last_became_active":"2024-05-28T06:09:35.144501+0000","last_became_peered":"2024-05-28T06:09:35.144501+0000","last_unstale":"2024-05-28T06:09:36.138685+0000","last_undegraded":"2024-05-28T06:09:36.138685+0000","last_fullsized":"2024-05-28T06:09:36.138685+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:18:41.390737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401588+0000","last_change":"2024-05-28T06:09:35.142791+0000","last_active":"2024-05-28T06:09:36.401588+0000","last_peered":"2024-05-28T06:09:36.401588+0000","last_clean":"2024-05-28T06:09:36.401588+0000","last_became_active":"2024-05-28T06:09:35.142534+0000","last_became_peered":"2024-05-28T06:09:35.142534+0000","last_unstale":"2024-05-28T06:09:36.401588+0000","last_undegraded":"2024-05-28T06:09:36.401588+0000","last_fullsized":"2024-05-28T06:09:36.401588+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:41:11.338059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.139314+0000","last_change":"2024-05-28T06:09:34.150890+0000","last_active":"2024-05-28T06:09:36.139314+0000","last_peered":"2024-05-28T06:09:36.139314+0000","last_clean":"2024-05-28T06:09:36.139314+0000","last_became_active":"2024-05-28T06:09:34.150580+0000","last_became_peered":"2024-05-28T06:09:34.150580+0000","last_unstale":"2024-05-28T06:09:36.139314+0000","last_undegraded":"2024-05-28T06:09:36.139314+0000","last_fullsized":"2024-05-28T06:09:36.139314+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:59:54.563980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.402112+0000","last_change":"2024-05-28T06:09:35.150271+0000","last_active":"2024-05-28T06:09:36.402112+0000","last_peered":"2024-05-28T06:09:36.402112+0000","last_clean":"2024-05-28T06:09:36.402112+0000","last_became_active":"2024-05-28T06:09:35.149964+0000","last_became_peered":"2024-05-28T06:09:35.149964+0000","last_unstale":"2024-05-28T06:09:36.402112+0000","last_undegraded":"2024-05-28T06:09:36.402112+0000","last_fullsized":"2024-05-28T06:09:36.402112+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:00:08.879351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.149117+0000","last_change":"2024-05-28T06:09:34.151225+0000","last_active":"2024-05-28T06:09:36.149117+0000","last_peered":"2024-05-28T06:09:36.149117+0000","last_clean":"2024-05-28T06:09:36.149117+0000","last_became_active":"2024-05-28T06:09:34.151009+0000","last_became_peered":"2024-05-28T06:09:34.151009+0000","last_unstale":"2024-05-28T06:09:36.149117+0000","last_undegraded":"2024-05-28T06:09:36.149117+0000","last_fullsized":"2024-05-28T06:09:36.149117+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:14:43.019560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401396+0000","last_change":"2024-05-28T06:09:35.139099+0000","last_active":"2024-05-28T06:09:36.401396+0000","last_peered":"2024-05-28T06:09:36.401396+0000","last_clean":"2024-05-28T06:09:36.401396+0000","last_became_active":"2024-05-28T06:09:35.138791+0000","last_became_peered":"2024-05-28T06:09:35.138791+0000","last_unstale":"2024-05-28T06:09:36.401396+0000","last_undegraded":"2024-05-28T06:09:36.401396+0000","last_fullsized":"2024-05-28T06:09:36.401396+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:05:08.129556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401901+0000","last_change":"2024-05-28T06:09:34.139572+0000","last_active":"2024-05-28T06:09:36.401901+0000","last_peered":"2024-05-28T06:09:36.401901+0000","last_clean":"2024-05-28T06:09:36.401901+0000","last_became_active":"2024-05-28T06:09:34.139243+0000","last_became_peered":"2024-05-28T06:09:34.139243+0000","last_unstale":"2024-05-28T06:09:36.401901+0000","last_undegraded":"2024-05-28T06:09:36.401901+0000","last_fullsized":"2024-05-28T06:09:36.401901+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:40:08.533032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401946+0000","last_change":"2024-05-28T06:09:35.157557+0000","last_active":"2024-05-28T06:09:36.401946+0000","last_peered":"2024-05-28T06:09:36.401946+0000","last_clean":"2024-05-28T06:09:36.401946+0000","last_became_active":"2024-05-28T06:09:35.156143+0000","last_became_peered":"2024-05-28T06:09:35.156143+0000","last_unstale":"2024-05-28T06:09:36.401946+0000","last_undegraded":"2024-05-28T06:09:36.401946+0000","last_fullsized":"2024-05-28T06:09:36.401946+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:00:13.537948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.139143+0000","last_change":"2024-05-28T06:09:34.147796+0000","last_active":"2024-05-28T06:09:36.139143+0000","last_peered":"2024-05-28T06:09:36.139143+0000","last_clean":"2024-05-28T06:09:36.139143+0000","last_became_active":"2024-05-28T06:09:34.147311+0000","last_became_peered":"2024-05-28T06:09:34.147311+0000","last_unstale":"2024-05-28T06:09:36.139143+0000","last_undegraded":"2024-05-28T06:09:36.139143+0000","last_fullsized":"2024-05-28T06:09:36.139143+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:16:57.268768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.148771+0000","last_change":"2024-05-28T06:09:35.147785+0000","last_active":"2024-05-28T06:09:36.148771+0000","last_peered":"2024-05-28T06:09:36.148771+0000","last_clean":"2024-05-28T06:09:36.148771+0000","last_became_active":"2024-05-28T06:09:35.147157+0000","last_became_peered":"2024-05-28T06:09:35.147157+0000","last_unstale":"2024-05-28T06:09:36.148771+0000","last_undegraded":"2024-05-28T06:09:36.148771+0000","last_fullsized":"2024-05-28T06:09:36.148771+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:59:55.566598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.138834+0000","last_change":"2024-05-28T06:09:34.141951+0000","last_active":"2024-05-28T06:09:36.138834+0000","last_peered":"2024-05-28T06:09:36.138834+0000","last_clean":"2024-05-28T06:09:36.138834+0000","last_became_active":"2024-05-28T06:09:34.141646+0000","last_became_peered":"2024-05-28T06:09:34.141646+0000","last_unstale":"2024-05-28T06:09:36.138834+0000","last_undegraded":"2024-05-28T06:09:36.138834+0000","last_fullsized":"2024-05-28T06:09:36.138834+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:09:01.841104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.402134+0000","last_change":"2024-05-28T06:09:35.164233+0000","last_active":"2024-05-28T06:09:36.402134+0000","last_peered":"2024-05-28T06:09:36.402134+0000","last_clean":"2024-05-28T06:09:36.402134+0000","last_became_active":"2024-05-28T06:09:35.161230+0000","last_became_peered":"2024-05-28T06:09:35.161230+0000","last_unstale":"2024-05-28T06:09:36.402134+0000","last_undegraded":"2024-05-28T06:09:36.402134+0000","last_fullsized":"2024-05-28T06:09:36.402134+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:59:55.566598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.148968+0000","last_change":"2024-05-28T06:09:34.138041+0000","last_active":"2024-05-28T06:09:36.148968+0000","last_peered":"2024-05-28T06:09:36.148968+0000","last_clean":"2024-05-28T06:09:36.148968+0000","last_became_active":"2024-05-28T06:09:34.136968+0000","last_became_peered":"2024-05-28T06:09:34.136968+0000","last_unstale":"2024-05-28T06:09:36.148968+0000","last_undegraded":"2024-05-28T06:09:36.148968+0000","last_fullsized":"2024-05-28T06:09:36.148968+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:40:08.533032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401161+0000","last_change":"2024-05-28T06:09:35.150055+0000","last_active":"2024-05-28T06:09:36.401161+0000","last_peered":"2024-05-28T06:09:36.401161+0000","last_clean":"2024-05-28T06:09:36.401161+0000","last_became_active":"2024-05-28T06:09:35.149765+0000","last_became_peered":"2024-05-28T06:09:35.149765+0000","last_unstale":"2024-05-28T06:09:36.401161+0000","last_undegraded":"2024-05-28T06:09:36.401161+0000","last_fullsized":"2024-05-28T06:09:36.401161+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:12:38.888713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401215+0000","last_change":"2024-05-28T06:09:34.136923+0000","last_active":"2024-05-28T06:09:36.401215+0000","last_peered":"2024-05-28T06:09:36.401215+0000","last_clean":"2024-05-28T06:09:36.401215+0000","last_became_active":"2024-05-28T06:09:34.136274+0000","last_became_peered":"2024-05-28T06:09:34.136274+0000","last_unstale":"2024-05-28T06:09:36.401215+0000","last_undegraded":"2024-05-28T06:09:36.401215+0000","last_fullsized":"2024-05-28T06:09:36.401215+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:01:44.057160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401613+0000","last_change":"2024-05-28T06:09:35.144719+0000","last_active":"2024-05-28T06:09:36.401613+0000","last_peered":"2024-05-28T06:09:36.401613+0000","last_clean":"2024-05-28T06:09:36.401613+0000","last_became_active":"2024-05-28T06:09:35.144413+0000","last_became_peered":"2024-05-28T06:09:35.144413+0000","last_unstale":"2024-05-28T06:09:36.401613+0000","last_undegraded":"2024-05-28T06:09:36.401613+0000","last_fullsized":"2024-05-28T06:09:36.401613+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:59:36.382815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.402106+0000","last_change":"2024-05-28T06:09:34.147293+0000","last_active":"2024-05-28T06:09:36.402106+0000","last_peered":"2024-05-28T06:09:36.402106+0000","last_clean":"2024-05-28T06:09:36.402106+0000","last_became_active":"2024-05-28T06:09:34.147038+0000","last_became_peered":"2024-05-28T06:09:34.147038+0000","last_unstale":"2024-05-28T06:09:36.402106+0000","last_undegraded":"2024-05-28T06:09:36.402106+0000","last_fullsized":"2024-05-28T06:09:36.402106+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:47:49.110622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.148954+0000","last_change":"2024-05-28T06:09:35.164040+0000","last_active":"2024-05-28T06:09:36.148954+0000","last_peered":"2024-05-28T06:09:36.148954+0000","last_clean":"2024-05-28T06:09:36.148954+0000","last_became_active":"2024-05-28T06:09:35.163770+0000","last_became_peered":"2024-05-28T06:09:35.163770+0000","last_unstale":"2024-05-28T06:09:36.148954+0000","last_undegraded":"2024-05-28T06:09:36.148954+0000","last_fullsized":"2024-05-28T06:09:36.148954+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:27:52.894674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.149147+0000","last_change":"2024-05-28T06:09:34.141129+0000","last_active":"2024-05-28T06:09:36.149147+0000","last_peered":"2024-05-28T06:09:36.149147+0000","last_clean":"2024-05-28T06:09:36.149147+0000","last_became_active":"2024-05-28T06:09:34.140760+0000","last_became_peered":"2024-05-28T06:09:34.140760+0000","last_unstale":"2024-05-28T06:09:36.149147+0000","last_undegraded":"2024-05-28T06:09:36.149147+0000","last_fullsized":"2024-05-28T06:09:36.149147+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:36:45.727826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.139430+0000","last_change":"2024-05-28T06:09:35.144908+0000","last_active":"2024-05-28T06:09:36.139430+0000","last_peered":"2024-05-28T06:09:36.139430+0000","last_clean":"2024-05-28T06:09:36.139430+0000","last_became_active":"2024-05-28T06:09:35.144607+0000","last_became_peered":"2024-05-28T06:09:35.144607+0000","last_unstale":"2024-05-28T06:09:36.139430+0000","last_undegraded":"2024-05-28T06:09:36.139430+0000","last_fullsized":"2024-05-28T06:09:36.139430+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:23:05.193918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.402007+0000","last_change":"2024-05-28T06:09:34.141172+0000","last_active":"2024-05-28T06:09:36.402007+0000","last_peered":"2024-05-28T06:09:36.402007+0000","last_clean":"2024-05-28T06:09:36.402007+0000","last_became_active":"2024-05-28T06:09:34.140822+0000","last_became_peered":"2024-05-28T06:09:34.140822+0000","last_unstale":"2024-05-28T06:09:36.402007+0000","last_undegraded":"2024-05-28T06:09:36.402007+0000","last_fullsized":"2024-05-28T06:09:36.402007+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:52:37.261641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.139080+0000","last_change":"2024-05-28T06:09:35.142150+0000","last_active":"2024-05-28T06:09:36.139080+0000","last_peered":"2024-05-28T06:09:36.139080+0000","last_clean":"2024-05-28T06:09:36.139080+0000","last_became_active":"2024-05-28T06:09:35.141857+0000","last_became_peered":"2024-05-28T06:09:35.141857+0000","last_unstale":"2024-05-28T06:09:36.139080+0000","last_undegraded":"2024-05-28T06:09:36.139080+0000","last_fullsized":"2024-05-28T06:09:36.139080+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:44:13.717966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.139319+0000","last_change":"2024-05-28T06:09:34.153542+0000","last_active":"2024-05-28T06:09:36.139319+0000","last_peered":"2024-05-28T06:09:36.139319+0000","last_clean":"2024-05-28T06:09:36.139319+0000","last_became_active":"2024-05-28T06:09:34.153227+0000","last_became_peered":"2024-05-28T06:09:34.153227+0000","last_unstale":"2024-05-28T06:09:36.139319+0000","last_undegraded":"2024-05-28T06:09:36.139319+0000","last_fullsized":"2024-05-28T06:09:36.139319+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:59:54.563980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.139067+0000","last_change":"2024-05-28T06:09:35.150628+0000","last_active":"2024-05-28T06:09:36.139067+0000","last_peered":"2024-05-28T06:09:36.139067+0000","last_clean":"2024-05-28T06:09:36.139067+0000","last_became_active":"2024-05-28T06:09:35.150038+0000","last_became_peered":"2024-05-28T06:09:35.150038+0000","last_unstale":"2024-05-28T06:09:36.139067+0000","last_undegraded":"2024-05-28T06:09:36.139067+0000","last_fullsized":"2024-05-28T06:09:36.139067+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:32:30.428219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":20,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.139473+0000","last_change":"2024-05-28T06:09:34.138083+0000","last_active":"2024-05-28T06:09:36.139473+0000","last_peered":"2024-05-28T06:09:36.139473+0000","last_clean":"2024-05-28T06:09:36.139473+0000","last_became_active":"2024-05-28T06:09:34.137814+0000","last_became_peered":"2024-05-28T06:09:34.137814+0000","last_unstale":"2024-05-28T06:09:36.139473+0000","last_undegraded":"2024-05-28T06:09:36.139473+0000","last_fullsized":"2024-05-28T06:09:36.139473+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:57:21.580775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.402109+0000","last_change":"2024-05-28T06:09:35.163938+0000","last_active":"2024-05-28T06:09:36.402109+0000","last_peered":"2024-05-28T06:09:36.402109+0000","last_clean":"2024-05-28T06:09:36.402109+0000","last_became_active":"2024-05-28T06:09:35.163631+0000","last_became_peered":"2024-05-28T06:09:35.163631+0000","last_unstale":"2024-05-28T06:09:36.402109+0000","last_undegraded":"2024-05-28T06:09:36.402109+0000","last_fullsized":"2024-05-28T06:09:36.402109+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:50:00.197861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.138918+0000","last_change":"2024-05-28T06:09:34.144065+0000","last_active":"2024-05-28T06:09:36.138918+0000","last_peered":"2024-05-28T06:09:36.138918+0000","last_clean":"2024-05-28T06:09:36.138918+0000","last_became_active":"2024-05-28T06:09:34.143707+0000","last_became_peered":"2024-05-28T06:09:34.143707+0000","last_unstale":"2024-05-28T06:09:36.138918+0000","last_undegraded":"2024-05-28T06:09:36.138918+0000","last_fullsized":"2024-05-28T06:09:36.138918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:52:29.771624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401503+0000","last_change":"2024-05-28T06:09:35.152954+0000","last_active":"2024-05-28T06:09:36.401503+0000","last_peered":"2024-05-28T06:09:36.401503+0000","last_clean":"2024-05-28T06:09:36.401503+0000","last_became_active":"2024-05-28T06:09:35.152649+0000","last_became_peered":"2024-05-28T06:09:35.152649+0000","last_unstale":"2024-05-28T06:09:36.401503+0000","last_undegraded":"2024-05-28T06:09:36.401503+0000","last_fullsized":"2024-05-28T06:09:36.401503+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:18:44.274700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.139188+0000","last_change":"2024-05-28T06:09:34.149020+0000","last_active":"2024-05-28T06:09:36.139188+0000","last_peered":"2024-05-28T06:09:36.139188+0000","last_clean":"2024-05-28T06:09:36.139188+0000","last_became_active":"2024-05-28T06:09:34.148735+0000","last_became_peered":"2024-05-28T06:09:34.148735+0000","last_unstale":"2024-05-28T06:09:36.139188+0000","last_undegraded":"2024-05-28T06:09:36.139188+0000","last_fullsized":"2024-05-28T06:09:36.139188+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:06:31.741843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.138519+0000","last_change":"2024-05-28T06:09:35.143208+0000","last_active":"2024-05-28T06:09:36.138519+0000","last_peered":"2024-05-28T06:09:36.138519+0000","last_clean":"2024-05-28T06:09:36.138519+0000","last_became_active":"2024-05-28T06:09:35.142916+0000","last_became_peered":"2024-05-28T06:09:35.142916+0000","last_unstale":"2024-05-28T06:09:36.138519+0000","last_undegraded":"2024-05-28T06:09:36.138519+0000","last_fullsized":"2024-05-28T06:09:36.138519+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:07:09.789246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.138849+0000","last_change":"2024-05-28T06:09:34.143895+0000","last_active":"2024-05-28T06:09:36.138849+0000","last_peered":"2024-05-28T06:09:36.138849+0000","last_clean":"2024-05-28T06:09:36.138849+0000","last_became_active":"2024-05-28T06:09:34.143590+0000","last_became_peered":"2024-05-28T06:09:34.143590+0000","last_unstale":"2024-05-28T06:09:36.138849+0000","last_undegraded":"2024-05-28T06:09:36.138849+0000","last_fullsized":"2024-05-28T06:09:36.138849+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:27:51.892057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.138857+0000","last_change":"2024-05-28T06:09:35.147063+0000","last_active":"2024-05-28T06:09:36.138857+0000","last_peered":"2024-05-28T06:09:36.138857+0000","last_clean":"2024-05-28T06:09:36.138857+0000","last_became_active":"2024-05-28T06:09:35.143725+0000","last_became_peered":"2024-05-28T06:09:35.143725+0000","last_unstale":"2024-05-28T06:09:36.138857+0000","last_undegraded":"2024-05-28T06:09:36.138857+0000","last_fullsized":"2024-05-28T06:09:36.138857+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:05:08.129556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"46'8","reported_seq":22,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401949+0000","last_change":"2024-05-28T06:09:34.145630+0000","last_active":"2024-05-28T06:09:36.401949+0000","last_peered":"2024-05-28T06:09:36.401949+0000","last_clean":"2024-05-28T06:09:36.401949+0000","last_became_active":"2024-05-28T06:09:34.144263+0000","last_became_peered":"2024-05-28T06:09:34.144263+0000","last_unstale":"2024-05-28T06:09:36.401949+0000","last_undegraded":"2024-05-28T06:09:36.401949+0000","last_fullsized":"2024-05-28T06:09:36.401949+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:18:40.388119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.139827+0000","last_change":"2024-05-28T06:09:35.142916+0000","last_active":"2024-05-28T06:09:36.139827+0000","last_peered":"2024-05-28T06:09:36.139827+0000","last_clean":"2024-05-28T06:09:36.139827+0000","last_became_active":"2024-05-28T06:09:35.142652+0000","last_became_peered":"2024-05-28T06:09:35.142652+0000","last_unstale":"2024-05-28T06:09:36.139827+0000","last_undegraded":"2024-05-28T06:09:36.139827+0000","last_fullsized":"2024-05-28T06:09:36.139827+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:18:28.238661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.139866+0000","last_change":"2024-05-28T06:09:34.138090+0000","last_active":"2024-05-28T06:09:36.139866+0000","last_peered":"2024-05-28T06:09:36.139866+0000","last_clean":"2024-05-28T06:09:36.139866+0000","last_became_active":"2024-05-28T06:09:34.137804+0000","last_became_peered":"2024-05-28T06:09:34.137804+0000","last_unstale":"2024-05-28T06:09:36.139866+0000","last_undegraded":"2024-05-28T06:09:36.139866+0000","last_fullsized":"2024-05-28T06:09:36.139866+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:45:49.871607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401911+0000","last_change":"2024-05-28T06:09:35.161697+0000","last_active":"2024-05-28T06:09:36.401911+0000","last_peered":"2024-05-28T06:09:36.401911+0000","last_clean":"2024-05-28T06:09:36.401911+0000","last_became_active":"2024-05-28T06:09:35.160255+0000","last_became_peered":"2024-05-28T06:09:35.160255+0000","last_unstale":"2024-05-28T06:09:36.401911+0000","last_undegraded":"2024-05-28T06:09:36.401911+0000","last_fullsized":"2024-05-28T06:09:36.401911+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:53:28.493576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.149111+0000","last_change":"2024-05-28T06:09:34.142710+0000","last_active":"2024-05-28T06:09:36.149111+0000","last_peered":"2024-05-28T06:09:36.149111+0000","last_clean":"2024-05-28T06:09:36.149111+0000","last_became_active":"2024-05-28T06:09:34.142396+0000","last_became_peered":"2024-05-28T06:09:34.142396+0000","last_unstale":"2024-05-28T06:09:36.149111+0000","last_undegraded":"2024-05-28T06:09:36.149111+0000","last_fullsized":"2024-05-28T06:09:36.149111+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:12:37.886096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401967+0000","last_change":"2024-05-28T06:09:35.154856+0000","last_active":"2024-05-28T06:09:36.401967+0000","last_peered":"2024-05-28T06:09:36.401967+0000","last_clean":"2024-05-28T06:09:36.401967+0000","last_became_active":"2024-05-28T06:09:35.154504+0000","last_became_peered":"2024-05-28T06:09:35.154504+0000","last_unstale":"2024-05-28T06:09:36.401967+0000","last_undegraded":"2024-05-28T06:09:36.401967+0000","last_fullsized":"2024-05-28T06:09:36.401967+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:20:08.854066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401228+0000","last_change":"2024-05-28T06:09:34.142908+0000","last_active":"2024-05-28T06:09:36.401228+0000","last_peered":"2024-05-28T06:09:36.401228+0000","last_clean":"2024-05-28T06:09:36.401228+0000","last_became_active":"2024-05-28T06:09:34.140614+0000","last_became_peered":"2024-05-28T06:09:34.140614+0000","last_unstale":"2024-05-28T06:09:36.401228+0000","last_undegraded":"2024-05-28T06:09:36.401228+0000","last_fullsized":"2024-05-28T06:09:36.401228+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:06:31.741843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.402112+0000","last_change":"2024-05-28T06:09:35.150581+0000","last_active":"2024-05-28T06:09:36.402112+0000","last_peered":"2024-05-28T06:09:36.402112+0000","last_clean":"2024-05-28T06:09:36.402112+0000","last_became_active":"2024-05-28T06:09:35.149467+0000","last_became_peered":"2024-05-28T06:09:35.149467+0000","last_unstale":"2024-05-28T06:09:36.402112+0000","last_undegraded":"2024-05-28T06:09:36.402112+0000","last_fullsized":"2024-05-28T06:09:36.402112+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:40:09.535650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.139152+0000","last_change":"2024-05-28T06:09:34.146569+0000","last_active":"2024-05-28T06:09:36.139152+0000","last_peered":"2024-05-28T06:09:36.139152+0000","last_clean":"2024-05-28T06:09:36.139152+0000","last_became_active":"2024-05-28T06:09:34.145789+0000","last_became_peered":"2024-05-28T06:09:34.145789+0000","last_unstale":"2024-05-28T06:09:36.139152+0000","last_undegraded":"2024-05-28T06:09:36.139152+0000","last_fullsized":"2024-05-28T06:09:36.139152+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:38:51.996681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.138737+0000","last_change":"2024-05-28T06:09:35.141908+0000","last_active":"2024-05-28T06:09:36.138737+0000","last_peered":"2024-05-28T06:09:36.138737+0000","last_clean":"2024-05-28T06:09:36.138737+0000","last_became_active":"2024-05-28T06:09:35.141640+0000","last_became_peered":"2024-05-28T06:09:35.141640+0000","last_unstale":"2024-05-28T06:09:36.138737+0000","last_undegraded":"2024-05-28T06:09:36.138737+0000","last_fullsized":"2024-05-28T06:09:36.138737+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:28:19.532393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.139020+0000","last_change":"2024-05-28T06:09:34.141717+0000","last_active":"2024-05-28T06:09:36.139020+0000","last_peered":"2024-05-28T06:09:36.139020+0000","last_clean":"2024-05-28T06:09:36.139020+0000","last_became_active":"2024-05-28T06:09:34.141434+0000","last_became_peered":"2024-05-28T06:09:34.141434+0000","last_unstale":"2024-05-28T06:09:36.139020+0000","last_undegraded":"2024-05-28T06:09:36.139020+0000","last_fullsized":"2024-05-28T06:09:36.139020+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:43:48.062702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401113+0000","last_change":"2024-05-28T06:09:35.140258+0000","last_active":"2024-05-28T06:09:36.401113+0000","last_peered":"2024-05-28T06:09:36.401113+0000","last_clean":"2024-05-28T06:09:36.401113+0000","last_became_active":"2024-05-28T06:09:35.139940+0000","last_became_peered":"2024-05-28T06:09:35.139940+0000","last_unstale":"2024-05-28T06:09:36.401113+0000","last_undegraded":"2024-05-28T06:09:36.401113+0000","last_fullsized":"2024-05-28T06:09:36.401113+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:26:57.014224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.400953+0000","last_change":"2024-05-28T06:09:34.148787+0000","last_active":"2024-05-28T06:09:36.400953+0000","last_peered":"2024-05-28T06:09:36.400953+0000","last_clean":"2024-05-28T06:09:36.400953+0000","last_became_active":"2024-05-28T06:09:34.147641+0000","last_became_peered":"2024-05-28T06:09:34.147641+0000","last_unstale":"2024-05-28T06:09:36.400953+0000","last_undegraded":"2024-05-28T06:09:36.400953+0000","last_fullsized":"2024-05-28T06:09:36.400953+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:53:27.490958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.138821+0000","last_change":"2024-05-28T06:09:35.139723+0000","last_active":"2024-05-28T06:09:36.138821+0000","last_peered":"2024-05-28T06:09:36.138821+0000","last_clean":"2024-05-28T06:09:36.138821+0000","last_became_active":"2024-05-28T06:09:35.139391+0000","last_became_peered":"2024-05-28T06:09:35.139391+0000","last_unstale":"2024-05-28T06:09:36.138821+0000","last_undegraded":"2024-05-28T06:09:36.138821+0000","last_fullsized":"2024-05-28T06:09:36.138821+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:23:11.888576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401330+0000","last_change":"2024-05-28T06:09:34.141888+0000","last_active":"2024-05-28T06:09:36.401330+0000","last_peered":"2024-05-28T06:09:36.401330+0000","last_clean":"2024-05-28T06:09:36.401330+0000","last_became_active":"2024-05-28T06:09:34.141625+0000","last_became_peered":"2024-05-28T06:09:34.141625+0000","last_unstale":"2024-05-28T06:09:36.401330+0000","last_undegraded":"2024-05-28T06:09:36.401330+0000","last_fullsized":"2024-05-28T06:09:36.401330+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:31:27.838907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401272+0000","last_change":"2024-05-28T06:09:35.152697+0000","last_active":"2024-05-28T06:09:36.401272+0000","last_peered":"2024-05-28T06:09:36.401272+0000","last_clean":"2024-05-28T06:09:36.401272+0000","last_became_active":"2024-05-28T06:09:35.152396+0000","last_became_peered":"2024-05-28T06:09:35.152396+0000","last_unstale":"2024-05-28T06:09:36.401272+0000","last_undegraded":"2024-05-28T06:09:36.401272+0000","last_fullsized":"2024-05-28T06:09:36.401272+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:41:11.338059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.138737+0000","last_change":"2024-05-28T06:09:34.153832+0000","last_active":"2024-05-28T06:09:36.138737+0000","last_peered":"2024-05-28T06:09:36.138737+0000","last_clean":"2024-05-28T06:09:36.138737+0000","last_became_active":"2024-05-28T06:09:34.153425+0000","last_became_peered":"2024-05-28T06:09:34.153425+0000","last_unstale":"2024-05-28T06:09:36.138737+0000","last_undegraded":"2024-05-28T06:09:36.138737+0000","last_fullsized":"2024-05-28T06:09:36.138737+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:53:27.490958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.402250+0000","last_change":"2024-05-28T06:09:35.166121+0000","last_active":"2024-05-28T06:09:36.402250+0000","last_peered":"2024-05-28T06:09:36.402250+0000","last_clean":"2024-05-28T06:09:36.402250+0000","last_became_active":"2024-05-28T06:09:35.165903+0000","last_became_peered":"2024-05-28T06:09:35.165903+0000","last_unstale":"2024-05-28T06:09:36.402250+0000","last_undegraded":"2024-05-28T06:09:36.402250+0000","last_fullsized":"2024-05-28T06:09:36.402250+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:36:46.730443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"47'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.148699+0000","last_change":"2024-05-28T06:09:34.136199+0000","last_active":"2024-05-28T06:09:36.148699+0000","last_peered":"2024-05-28T06:09:36.148699+0000","last_clean":"2024-05-28T06:09:36.148699+0000","last_became_active":"2024-05-28T06:09:34.135937+0000","last_became_peered":"2024-05-28T06:09:34.135937+0000","last_unstale":"2024-05-28T06:09:36.148699+0000","last_undegraded":"2024-05-28T06:09:36.148699+0000","last_fullsized":"2024-05-28T06:09:36.148699+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:44:47.741430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401751+0000","last_change":"2024-05-28T06:09:35.150008+0000","last_active":"2024-05-28T06:09:36.401751+0000","last_peered":"2024-05-28T06:09:36.401751+0000","last_clean":"2024-05-28T06:09:36.401751+0000","last_became_active":"2024-05-28T06:09:35.141910+0000","last_became_peered":"2024-05-28T06:09:35.141910+0000","last_unstale":"2024-05-28T06:09:36.401751+0000","last_undegraded":"2024-05-28T06:09:36.401751+0000","last_fullsized":"2024-05-28T06:09:36.401751+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:06:32.744461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.139344+0000","last_change":"2024-05-28T06:09:34.153003+0000","last_active":"2024-05-28T06:09:36.139344+0000","last_peered":"2024-05-28T06:09:36.139344+0000","last_clean":"2024-05-28T06:09:36.139344+0000","last_became_active":"2024-05-28T06:09:34.151958+0000","last_became_peered":"2024-05-28T06:09:34.151958+0000","last_unstale":"2024-05-28T06:09:36.139344+0000","last_undegraded":"2024-05-28T06:09:36.139344+0000","last_fullsized":"2024-05-28T06:09:36.139344+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:38:51.996681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.139237+0000","last_change":"2024-05-28T06:09:35.152866+0000","last_active":"2024-05-28T06:09:36.139237+0000","last_peered":"2024-05-28T06:09:36.139237+0000","last_clean":"2024-05-28T06:09:36.139237+0000","last_became_active":"2024-05-28T06:09:35.152603+0000","last_became_peered":"2024-05-28T06:09:35.152603+0000","last_unstale":"2024-05-28T06:09:36.139237+0000","last_undegraded":"2024-05-28T06:09:36.139237+0000","last_fullsized":"2024-05-28T06:09:36.139237+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:15:12.247541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401069+0000","last_change":"2024-05-28T06:09:34.136890+0000","last_active":"2024-05-28T06:09:36.401069+0000","last_peered":"2024-05-28T06:09:36.401069+0000","last_clean":"2024-05-28T06:09:36.401069+0000","last_became_active":"2024-05-28T06:09:34.136447+0000","last_became_peered":"2024-05-28T06:09:34.136447+0000","last_unstale":"2024-05-28T06:09:36.401069+0000","last_undegraded":"2024-05-28T06:09:36.401069+0000","last_fullsized":"2024-05-28T06:09:36.401069+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:00:07.876734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.138763+0000","last_change":"2024-05-28T06:09:35.143710+0000","last_active":"2024-05-28T06:09:36.138763+0000","last_peered":"2024-05-28T06:09:36.138763+0000","last_clean":"2024-05-28T06:09:36.138763+0000","last_became_active":"2024-05-28T06:09:35.143457+0000","last_became_peered":"2024-05-28T06:09:35.143457+0000","last_unstale":"2024-05-28T06:09:36.138763+0000","last_undegraded":"2024-05-28T06:09:36.138763+0000","last_fullsized":"2024-05-28T06:09:36.138763+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:22:34.802490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.139134+0000","last_change":"2024-05-28T06:09:34.152503+0000","last_active":"2024-05-28T06:09:36.139134+0000","last_peered":"2024-05-28T06:09:36.139134+0000","last_clean":"2024-05-28T06:09:36.139134+0000","last_became_active":"2024-05-28T06:09:34.152227+0000","last_became_peered":"2024-05-28T06:09:34.152227+0000","last_unstale":"2024-05-28T06:09:36.139134+0000","last_undegraded":"2024-05-28T06:09:36.139134+0000","last_fullsized":"2024-05-28T06:09:36.139134+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:44:47.741430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.138687+0000","last_change":"2024-05-28T06:09:35.142508+0000","last_active":"2024-05-28T06:09:36.138687+0000","last_peered":"2024-05-28T06:09:36.138687+0000","last_clean":"2024-05-28T06:09:36.138687+0000","last_became_active":"2024-05-28T06:09:35.142254+0000","last_became_peered":"2024-05-28T06:09:35.142254+0000","last_unstale":"2024-05-28T06:09:36.138687+0000","last_undegraded":"2024-05-28T06:09:36.138687+0000","last_fullsized":"2024-05-28T06:09:36.138687+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:10:14.564327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.148949+0000","last_change":"2024-05-28T06:09:34.135939+0000","last_active":"2024-05-28T06:09:36.148949+0000","last_peered":"2024-05-28T06:09:36.148949+0000","last_clean":"2024-05-28T06:09:36.148949+0000","last_became_active":"2024-05-28T06:09:34.135611+0000","last_became_peered":"2024-05-28T06:09:34.135611+0000","last_unstale":"2024-05-28T06:09:36.148949+0000","last_undegraded":"2024-05-28T06:09:36.148949+0000","last_fullsized":"2024-05-28T06:09:36.148949+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:53:37.706363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.400861+0000","last_change":"2024-05-28T06:09:35.141078+0000","last_active":"2024-05-28T06:09:36.400861+0000","last_peered":"2024-05-28T06:09:36.400861+0000","last_clean":"2024-05-28T06:09:36.400861+0000","last_became_active":"2024-05-28T06:09:35.140791+0000","last_became_peered":"2024-05-28T06:09:35.140791+0000","last_unstale":"2024-05-28T06:09:36.400861+0000","last_undegraded":"2024-05-28T06:09:36.400861+0000","last_fullsized":"2024-05-28T06:09:36.400861+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:52:30.774242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.400917+0000","last_change":"2024-05-28T06:09:34.144921+0000","last_active":"2024-05-28T06:09:36.400917+0000","last_peered":"2024-05-28T06:09:36.400917+0000","last_clean":"2024-05-28T06:09:36.400917+0000","last_became_active":"2024-05-28T06:09:34.144584+0000","last_became_peered":"2024-05-28T06:09:34.144584+0000","last_unstale":"2024-05-28T06:09:36.400917+0000","last_undegraded":"2024-05-28T06:09:36.400917+0000","last_fullsized":"2024-05-28T06:09:36.400917+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:49:59.195243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.148751+0000","last_change":"2024-05-28T06:09:35.146115+0000","last_active":"2024-05-28T06:09:36.148751+0000","last_peered":"2024-05-28T06:09:36.148751+0000","last_clean":"2024-05-28T06:09:36.148751+0000","last_became_active":"2024-05-28T06:09:35.143419+0000","last_became_peered":"2024-05-28T06:09:35.143419+0000","last_unstale":"2024-05-28T06:09:36.148751+0000","last_undegraded":"2024-05-28T06:09:36.148751+0000","last_fullsized":"2024-05-28T06:09:36.148751+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:44:48.744048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.402031+0000","last_change":"2024-05-28T06:09:34.147278+0000","last_active":"2024-05-28T06:09:36.402031+0000","last_peered":"2024-05-28T06:09:36.402031+0000","last_clean":"2024-05-28T06:09:36.402031+0000","last_became_active":"2024-05-28T06:09:34.146046+0000","last_became_peered":"2024-05-28T06:09:34.146046+0000","last_unstale":"2024-05-28T06:09:36.402031+0000","last_undegraded":"2024-05-28T06:09:36.402031+0000","last_fullsized":"2024-05-28T06:09:36.402031+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:16:00.184036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401932+0000","last_change":"2024-05-28T06:09:35.152315+0000","last_active":"2024-05-28T06:09:36.401932+0000","last_peered":"2024-05-28T06:09:36.401932+0000","last_clean":"2024-05-28T06:09:36.401932+0000","last_became_active":"2024-05-28T06:09:35.150338+0000","last_became_peered":"2024-05-28T06:09:35.150338+0000","last_unstale":"2024-05-28T06:09:36.401932+0000","last_undegraded":"2024-05-28T06:09:36.401932+0000","last_fullsized":"2024-05-28T06:09:36.401932+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:34.113632+0000","last_clean_scrub_stamp":"2024-05-28T06:09:34.113632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:44:48.744048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.401446+0000","last_change":"2024-05-28T06:09:34.138925+0000","last_active":"2024-05-28T06:09:36.401446+0000","last_peered":"2024-05-28T06:09:36.401446+0000","last_clean":"2024-05-28T06:09:36.401446+0000","last_became_active":"2024-05-28T06:09:34.138499+0000","last_became_peered":"2024-05-28T06:09:34.138499+0000","last_unstale":"2024-05-28T06:09:36.401446+0000","last_undegraded":"2024-05-28T06:09:36.401446+0000","last_fullsized":"2024-05-28T06:09:36.401446+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:09:33.111015+0000","last_clean_scrub_stamp":"2024-05-28T06:09:33.111015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:30:22.570834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":217,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-28T06:09:36.138977+0000","last_change":"2024-05-28T06:05:38.517922+0000","last_active":"2024-05-28T06:09:36.138977+0000","last_peered":"2024-05-28T06:09:36.138977+0000","last_clean":"2024-05-28T06:09:36.138977+0000","last_became_active":"2024-05-28T06:05:38.514745+0000","last_became_peered":"2024-05-28T06:05:38.514745+0000","last_unstale":"2024-05-28T06:09:36.138977+0000","last_undegraded":"2024-05-28T06:09:36.138977+0000","last_fullsized":"2024-05-28T06:09:36.138977+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_clean_scrub_stamp":"2024-05-28T06:05:37.485018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:23:27.978203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36468,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335372,"statfs":{"total":96636764160,"available":96599420928,"internally_reserved":0,"allocated":1150976,"data_stored":818044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":561152,"data_stored":228258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35880,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335960,"statfs":{"total":96636764160,"available":96600023040,"internally_reserved":0,"allocated":544768,"data_stored":221356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35892,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335948,"statfs":{"total":96636764160,"available":96600010752,"internally_reserved":0,"allocated":565248,"data_stored":229198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35896,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335944,"statfs":{"total":96636764160,"available":96600006656,"internally_reserved":0,"allocated":565248,"data_stored":228224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":569344,"data_stored":229220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35888,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335952,"statfs":{"total":96636764160,"available":96600014848,"internally_reserved":0,"allocated":557056,"data_stored":227656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32308,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339532,"statfs":{"total":96636764160,"available":96603680768,"internally_reserved":0,"allocated":1150976,"data_stored":817988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-28T06:09:39.603 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-28T06:09:39.604 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-28T06:09:39.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.784+0000 7f88e6000640 1 Processor -- start 2024-05-28T06:09:39.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.784+0000 7f88e6000640 1 -- start start 2024-05-28T06:09:39.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.784+0000 7f88e6000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f88e00cff30 0x7f88e006f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:39.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.784+0000 7f88e6000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88e00cdf00 con 0x7f88e00cdb00 2024-05-28T06:09:39.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.784+0000 7f88e6000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88e00d0310 con 0x7f88e006f6c0 2024-05-28T06:09:39.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.784+0000 7f88e6000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f88e006fb30 con 0x7f88e00cff30 2024-05-28T06:09:39.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.784+0000 7f88df400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f88e00cff30 0x7f88e006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:39.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.784+0000 7f88dfe00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f88e00cdb00 0x7f88e00b49b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:48950/0 (socket says 172.21.15.122:48950) 2024-05-28T06:09:39.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.784+0000 7f88dfe00640 1 -- 172.21.15.122:0/1988214470 learned_addr learned my addr 172.21.15.122:0/1988214470 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:39.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.788+0000 7f88df400640 1 -- 172.21.15.122:0/1988214470 >> v1:172.21.15.153:6789/0 conn(0x7f88e006f6c0 legacy=0x7f88e00cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:39.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.788+0000 7f88df400640 1 -- 172.21.15.122:0/1988214470 >> v1:172.21.15.122:6789/0 conn(0x7f88e00cdb00 legacy=0x7f88e00b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:39.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.788+0000 7f88df400640 1 -- 172.21.15.122:0/1988214470 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e015be20 con 0x7f88e00cff30 2024-05-28T06:09:39.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.788+0000 7f88df400640 1 --2- 172.21.15.122:0/1988214470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88e00cff30 0x7f88e006f180 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f88d00097c0 tx=0x7f88d001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db817d23b67b0a0e server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:39.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.788+0000 7f88dea00640 1 -- 172.21.15.122:0/1988214470 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d00ab430 con 0x7f88e00cff30 2024-05-28T06:09:39.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.788+0000 7f88dea00640 1 -- 172.21.15.122:0/1988214470 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d00b0070 con 0x7f88e00cff30 2024-05-28T06:09:39.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.788+0000 7f88dea00640 1 -- 172.21.15.122:0/1988214470 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d00ab7f0 con 0x7f88e00cff30 2024-05-28T06:09:39.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.788+0000 7f88e6000640 1 -- 172.21.15.122:0/1988214470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88e00cff30 msgr2=0x7f88e006f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:39.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.788+0000 7f88e6000640 1 --2- 172.21.15.122:0/1988214470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88e00cff30 0x7f88e006f180 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f88d00097c0 tx=0x7f88d001c430 comp rx=0 tx=0).stop 2024-05-28T06:09:39.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.788+0000 7f88e6000640 1 -- 172.21.15.122:0/1988214470 shutdown_connections 2024-05-28T06:09:39.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.788+0000 7f88e6000640 1 --2- 172.21.15.122:0/1988214470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88e00cff30 0x7f88e006f180 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.788+0000 7f88e6000640 1 -- 172.21.15.122:0/1988214470 >> 172.21.15.122:0/1988214470 conn(0x7f88e006bd90 msgr2=0x7f88e006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:39.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.788+0000 7f88e6000640 1 -- 172.21.15.122:0/1988214470 shutdown_connections 2024-05-28T06:09:39.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88e6000640 1 -- 172.21.15.122:0/1988214470 wait complete. 2024-05-28T06:09:39.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88e6000640 1 Processor -- start 2024-05-28T06:09:39.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88e6000640 1 -- start start 2024-05-28T06:09:39.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88e6000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88e006f6c0 0x7f88e0139700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:39.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88e6000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88e00cdb00 0x7f88e0155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:39.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88e6000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88e00cff30 0x7f88e014d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:39.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88e6000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f88e00b58d0 con 0x7f88e006f6c0 2024-05-28T06:09:39.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88e6000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f88e015baf0 con 0x7f88e00cff30 2024-05-28T06:09:39.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88e6000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f88e00b5a50 con 0x7f88e00cdb00 2024-05-28T06:09:39.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88df400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88e006f6c0 0x7f88e0139700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:39.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88df400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88e006f6c0 0x7f88e0139700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48606/0 (socket says 172.21.15.122:48606) 2024-05-28T06:09:39.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88df400640 1 -- 172.21.15.122:0/3572436316 learned_addr learned my addr 172.21.15.122:0/3572436316 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:39.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88dfe00640 1 --2- 172.21.15.122:0/3572436316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88e00cff30 0x7f88e014d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:39.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88d7e00640 1 --2- 172.21.15.122:0/3572436316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88e00cdb00 0x7f88e0155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:39.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88df400640 1 -- 172.21.15.122:0/3572436316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88e00cdb00 msgr2=0x7f88e0155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:39.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88df400640 1 --2- 172.21.15.122:0/3572436316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88e00cdb00 0x7f88e0155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88df400640 1 -- 172.21.15.122:0/3572436316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88e00cff30 msgr2=0x7f88e014d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:39.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88df400640 1 --2- 172.21.15.122:0/3572436316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88e00cff30 0x7f88e014d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:39.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88df400640 1 -- 172.21.15.122:0/3572436316 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e00b2580 con 0x7f88e006f6c0 2024-05-28T06:09:39.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88dfe00640 1 --2- 172.21.15.122:0/3572436316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88e00cff30 0x7f88e014d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:09:39.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88d7e00640 1 --2- 172.21.15.122:0/3572436316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88e00cdb00 0x7f88e0155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:09:39.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88df400640 1 --2- 172.21.15.122:0/3572436316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88e006f6c0 0x7f88e0139700 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f88d0019040 tx=0x7f88d001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:39.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88d7400640 1 -- 172.21.15.122:0/3572436316 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d00bf610 con 0x7f88e006f6c0 2024-05-28T06:09:39.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88d7400640 1 -- 172.21.15.122:0/3572436316 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d00bf7d0 con 0x7f88e006f6c0 2024-05-28T06:09:39.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88d7400640 1 -- 172.21.15.122:0/3572436316 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d00bfbc0 con 0x7f88e006f6c0 2024-05-28T06:09:39.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.792+0000 7f88e6000640 1 -- 172.21.15.122:0/3572436316 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88e00b2860 con 0x7f88e006f6c0 2024-05-28T06:09:39.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.796+0000 7f88e6000640 1 -- 172.21.15.122:0/3572436316 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88e00b2e20 con 0x7f88e006f6c0 2024-05-28T06:09:39.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.796+0000 7f88e6000640 1 -- 172.21.15.122:0/3572436316 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88e0068c40 con 0x7f88e006f6c0 2024-05-28T06:09:39.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.796+0000 7f88d7400640 1 -- 172.21.15.122:0/3572436316 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f88d00bd020 con 0x7f88e006f6c0 2024-05-28T06:09:39.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.796+0000 7f88d7400640 1 --2- 172.21.15.122:0/3572436316 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f88bc068650 0x7f88bc06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:39.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.796+0000 7f88d7400640 1 -- 172.21.15.122:0/3572436316 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f88d00a8020 con 0x7f88e006f6c0 2024-05-28T06:09:39.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.796+0000 7f88d7e00640 1 --2- 172.21.15.122:0/3572436316 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f88bc068650 0x7f88bc06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:39.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.796+0000 7f88d7e00640 1 --2- 172.21.15.122:0/3572436316 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f88bc068650 0x7f88bc06ab10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f88e0151170 tx=0x7f88c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:39.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:39.800+0000 7f88d7400640 1 -- 172.21.15.122:0/3572436316 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f88d0016050 con 0x7f88e006f6c0 2024-05-28T06:09:40.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.012+0000 7f88e6000640 1 -- 172.21.15.122:0/3572436316 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f88e0155f70 con 0x7f88e006f6c0 2024-05-28T06:09:40.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.016+0000 7f88d7400640 1 -- 172.21.15.122:0/3572436316 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f88d00f1510 con 0x7f88e006f6c0 2024-05-28T06:09:40.018 INFO:teuthology.orchestra.run.smithi122.stdout:[client.0] 2024-05-28T06:09:40.018 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQACdFVm0fSmExAAkwJTGq732gbcMsBbs84lWw== 2024-05-28T06:09:40.019 INFO:teuthology.orchestra.run.smithi122.stdout: caps mds = "allow" 2024-05-28T06:09:40.019 INFO:teuthology.orchestra.run.smithi122.stdout: caps mon = "allow r" 2024-05-28T06:09:40.019 INFO:teuthology.orchestra.run.smithi122.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-28T06:09:40.019 INFO:teuthology.orchestra.run.smithi122.stderr:updated caps for client.0 2024-05-28T06:09:40.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.016+0000 7f88e6000640 1 -- 172.21.15.122:0/3572436316 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f88bc068650 msgr2=0x7f88bc06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:40.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.016+0000 7f88e6000640 1 --2- 172.21.15.122:0/3572436316 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f88bc068650 0x7f88bc06ab10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f88e0151170 tx=0x7f88c8009040 comp rx=0 tx=0).stop 2024-05-28T06:09:40.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.016+0000 7f88e6000640 1 -- 172.21.15.122:0/3572436316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88e006f6c0 msgr2=0x7f88e0139700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:40.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.016+0000 7f88e6000640 1 --2- 172.21.15.122:0/3572436316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88e006f6c0 0x7f88e0139700 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f88d0019040 tx=0x7f88d001ac70 comp rx=0 tx=0).stop 2024-05-28T06:09:40.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.016+0000 7f88e6000640 1 -- 172.21.15.122:0/3572436316 shutdown_connections 2024-05-28T06:09:40.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.016+0000 7f88e6000640 1 --2- 172.21.15.122:0/3572436316 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f88bc068650 0x7f88bc06ab10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.016+0000 7f88e6000640 1 --2- 172.21.15.122:0/3572436316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88e00cff30 0x7f88e014d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.016+0000 7f88e6000640 1 --2- 172.21.15.122:0/3572436316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88e00cdb00 0x7f88e0155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.016+0000 7f88e6000640 1 --2- 172.21.15.122:0/3572436316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88e006f6c0 0x7f88e0139700 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.016+0000 7f88e6000640 1 -- 172.21.15.122:0/3572436316 >> 172.21.15.122:0/3572436316 conn(0x7f88e006bd90 msgr2=0x7f88e006e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:40.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.016+0000 7f88e6000640 1 -- 172.21.15.122:0/3572436316 shutdown_connections 2024-05-28T06:09:40.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.016+0000 7f88e6000640 1 -- 172.21.15.122:0/3572436316 wait complete. 2024-05-28T06:09:40.041 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:09:40.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.176+0000 7f7b53a00640 1 Processor -- start 2024-05-28T06:09:40.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.176+0000 7f7b53a00640 1 -- start start 2024-05-28T06:09:40.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b53a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7b4c15f740 0x7f7b4c167240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b53a00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b4c15d970 con 0x7f7b4c0b58d0 2024-05-28T06:09:40.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b53a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b4c15dc50 con 0x7f7b4c0ce4f0 2024-05-28T06:09:40.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b53a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7b4c15df30 con 0x7f7b4c15f740 2024-05-28T06:09:40.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b51000640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f7b4c0b58d0 0x7f7b4c0b5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:48964/0 (socket says 172.21.15.122:48964) 2024-05-28T06:09:40.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b51000640 1 -- 172.21.15.122:0/1793330402 learned_addr learned my addr 172.21.15.122:0/1793330402 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:40.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b4b400640 1 -- 172.21.15.122:0/1793330402 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4055009246 0 0) 0x7f7b4c15d970 con 0x7f7b4c0b58d0 2024-05-28T06:09:40.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b4b400640 1 -- 172.21.15.122:0/1793330402 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b30003530 con 0x7f7b4c0b58d0 2024-05-28T06:09:40.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b51a00640 1 --2- 172.21.15.122:0/1793330402 >> v2:172.21.15.153:3300/0 conn(0x7f7b4c15f740 0x7f7b4c167240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:40.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b4b400640 1 -- 172.21.15.122:0/1793330402 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1572716606 0 0) 0x7f7b30003530 con 0x7f7b4c0b58d0 2024-05-28T06:09:40.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b4b400640 1 -- 172.21.15.122:0/1793330402 >> v2:172.21.15.153:3300/0 conn(0x7f7b4c15f740 msgr2=0x7f7b4c167240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:40.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b4b400640 1 --2- 172.21.15.122:0/1793330402 >> v2:172.21.15.153:3300/0 conn(0x7f7b4c15f740 0x7f7b4c167240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b4b400640 1 -- 172.21.15.122:0/1793330402 >> v1:172.21.15.153:6789/0 conn(0x7f7b4c0ce4f0 legacy=0x7f7b4c0ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:40.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b4b400640 1 -- 172.21.15.122:0/1793330402 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b4c15e210 con 0x7f7b4c0b58d0 2024-05-28T06:09:40.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b4b400640 1 -- 172.21.15.122:0/1793330402 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f7b34001680 con 0x7f7b4c0b58d0 2024-05-28T06:09:40.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b4b400640 1 -- 172.21.15.122:0/1793330402 >> v1:172.21.15.122:6789/0 conn(0x7f7b4c0b58d0 legacy=0x7f7b4c0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:40.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b4b400640 1 --2- 172.21.15.122:0/1793330402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b300039c0 0x7f7b30003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b4b400640 1 --2- 172.21.15.122:0/1793330402 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b30004810 0x7f7b30004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b4b400640 1 --2- 172.21.15.122:0/1793330402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b300051d0 0x7f7b3000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b4b400640 1 -- 172.21.15.122:0/1793330402 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c15df30 con 0x7f7b300051d0 2024-05-28T06:09:40.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b4b400640 1 -- 172.21.15.122:0/1793330402 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3000c070 con 0x7f7b300039c0 2024-05-28T06:09:40.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b4b400640 1 -- 172.21.15.122:0/1793330402 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7b3000c270 con 0x7f7b30004810 2024-05-28T06:09:40.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b51a00640 1 --2- 172.21.15.122:0/1793330402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b300051d0 0x7f7b3000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:40.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b51000640 1 --2- 172.21.15.122:0/1793330402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b300039c0 0x7f7b30003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:40.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b4be00640 1 --2- 172.21.15.122:0/1793330402 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b30004810 0x7f7b30004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:40.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b51a00640 1 -- 172.21.15.122:0/1793330402 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b30004810 msgr2=0x7f7b30004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:40.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b51a00640 1 --2- 172.21.15.122:0/1793330402 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b30004810 0x7f7b30004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b51a00640 1 -- 172.21.15.122:0/1793330402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b300039c0 msgr2=0x7f7b30003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:40.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b51a00640 1 --2- 172.21.15.122:0/1793330402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b300039c0 0x7f7b30003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.180+0000 7f7b51a00640 1 -- 172.21.15.122:0/1793330402 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b30003530 con 0x7f7b300051d0 2024-05-28T06:09:40.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.184+0000 7f7b51a00640 1 -- 172.21.15.122:0/1793330402 reap_dead start 2024-05-28T06:09:40.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.184+0000 7f7b51a00640 1 --2- 172.21.15.122:0/1793330402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b300051d0 0x7f7b3000b9d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009fc0 tx=0x7f7b4401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23205958b512c469 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:40.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.184+0000 7f7b4b400640 1 -- 172.21.15.122:0/1793330402 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b44009c10 con 0x7f7b300051d0 2024-05-28T06:09:40.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.184+0000 7f7b4b400640 1 -- 172.21.15.122:0/1793330402 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b440a5cd0 con 0x7f7b300051d0 2024-05-28T06:09:40.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.184+0000 7f7b4b400640 1 -- 172.21.15.122:0/1793330402 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b44003be0 con 0x7f7b300051d0 2024-05-28T06:09:40.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.184+0000 7f7b53a00640 1 -- 172.21.15.122:0/1793330402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b300051d0 msgr2=0x7f7b3000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:40.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.184+0000 7f7b53a00640 1 --2- 172.21.15.122:0/1793330402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b300051d0 0x7f7b3000b9d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009fc0 tx=0x7f7b4401ccc0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.184+0000 7f7b53a00640 1 -- 172.21.15.122:0/1793330402 shutdown_connections 2024-05-28T06:09:40.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.184+0000 7f7b53a00640 1 --2- 172.21.15.122:0/1793330402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b300051d0 0x7f7b3000b9d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.184+0000 7f7b53a00640 1 -- 172.21.15.122:0/1793330402 >> 172.21.15.122:0/1793330402 conn(0x7f7b4c06bd90 msgr2=0x7f7b4c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:40.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.184+0000 7f7b53a00640 1 -- 172.21.15.122:0/1793330402 shutdown_connections 2024-05-28T06:09:40.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.184+0000 7f7b53a00640 1 -- 172.21.15.122:0/1793330402 wait complete. 2024-05-28T06:09:40.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.184+0000 7f7b53a00640 1 Processor -- start 2024-05-28T06:09:40.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b53a00640 1 -- start start 2024-05-28T06:09:40.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b53a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b300051d0 0x7f7b4c1f5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b53a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4c1f72e0 0x7f7b4c0ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b53a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b4c0aebe0 0x7f7b4c13fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b53a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c146260 con 0x7f7b4c1f72e0 2024-05-28T06:09:40.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b53a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c0b5cb0 con 0x7f7b300051d0 2024-05-28T06:09:40.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b53a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7b4c0b3eb0 con 0x7f7b4c0aebe0 2024-05-28T06:09:40.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b4be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4c1f72e0 0x7f7b4c0ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:40.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b51000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b300051d0 0x7f7b4c1f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:40.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b51000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b300051d0 0x7f7b4c1f5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:60458/0 (socket says 172.21.15.122:60458) 2024-05-28T06:09:40.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b51000640 1 -- 172.21.15.122:0/1442521741 learned_addr learned my addr 172.21.15.122:0/1442521741 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:40.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b51a00640 1 --2- 172.21.15.122:0/1442521741 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b4c0aebe0 0x7f7b4c13fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:40.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b4be00640 1 -- 172.21.15.122:0/1442521741 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b4c0aebe0 msgr2=0x7f7b4c13fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:40.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b4be00640 1 --2- 172.21.15.122:0/1442521741 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b4c0aebe0 0x7f7b4c13fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b4be00640 1 -- 172.21.15.122:0/1442521741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b300051d0 msgr2=0x7f7b4c1f5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:40.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b4be00640 1 --2- 172.21.15.122:0/1442521741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b300051d0 0x7f7b4c1f5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b4be00640 1 -- 172.21.15.122:0/1442521741 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b4c140a70 con 0x7f7b4c1f72e0 2024-05-28T06:09:40.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b4be00640 1 --2- 172.21.15.122:0/1442521741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4c1f72e0 0x7f7b4c0ae6a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00e390 tx=0x7f7b3c00e850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:40.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b48c00640 1 -- 172.21.15.122:0/1442521741 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c019070 con 0x7f7b4c1f72e0 2024-05-28T06:09:40.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b48c00640 1 -- 172.21.15.122:0/1442521741 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b3c0052e0 con 0x7f7b4c1f72e0 2024-05-28T06:09:40.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b48c00640 1 -- 172.21.15.122:0/1442521741 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c003840 con 0x7f7b4c1f72e0 2024-05-28T06:09:40.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b53a00640 1 -- 172.21.15.122:0/1442521741 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b4c0b3860 con 0x7f7b4c1f72e0 2024-05-28T06:09:40.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b53a00640 1 -- 172.21.15.122:0/1442521741 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b4c1f7760 con 0x7f7b4c1f72e0 2024-05-28T06:09:40.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.188+0000 7f7b53a00640 1 -- 172.21.15.122:0/1442521741 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b4c0adc80 con 0x7f7b4c1f72e0 2024-05-28T06:09:40.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.192+0000 7f7b48c00640 1 -- 172.21.15.122:0/1442521741 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f7b3c01c070 con 0x7f7b4c1f72e0 2024-05-28T06:09:40.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.192+0000 7f7b48c00640 1 --2- 172.21.15.122:0/1442521741 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7b28068650 0x7f7b2806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.192+0000 7f7b48c00640 1 -- 172.21.15.122:0/1442521741 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f7b3c086420 con 0x7f7b4c1f72e0 2024-05-28T06:09:40.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.192+0000 7f7b51000640 1 --2- 172.21.15.122:0/1442521741 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7b28068650 0x7f7b2806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:40.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.192+0000 7f7b51000640 1 --2- 172.21.15.122:0/1442521741 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7b28068650 0x7f7b2806ab10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7b34001ce0 tx=0x7f7b34001c70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:40.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.196+0000 7f7b48c00640 1 -- 172.21.15.122:0/1442521741 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7b4c0adc80 con 0x7f7b4c1f72e0 2024-05-28T06:09:40.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.388+0000 7f7b53a00640 1 -- 172.21.15.122:0/1442521741 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b4c068c40 con 0x7f7b4c1f72e0 2024-05-28T06:09:40.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.388+0000 7f7b48c00640 1 -- 172.21.15.122:0/1442521741 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5184 (secure 0 0 0) 0x7f7b3c056000 con 0x7f7b4c1f72e0 2024-05-28T06:09:40.391 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:09:40.391 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5482,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/257060312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":257060312},{"type":"v1","addr":"172.21.15.153:6834","nonce":257060312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5485,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/573898687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":573898687},{"type":"v1","addr":"172.21.15.153:6835","nonce":573898687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/246840682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":246840682},{"type":"v1","addr":"172.21.15.122:6836","nonce":246840682}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-28T06:09:34.510484+0000","modified":"2024-05-28T06:09:37.531081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1627568336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1627568336},{"type":"v1","addr":"172.21.15.122:6837","nonce":1627568336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":3}]} 2024-05-28T06:09:40.391 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 28 2024-05-28T06:09:40.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.388+0000 7f7b53a00640 1 -- 172.21.15.122:0/1442521741 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7b28068650 msgr2=0x7f7b2806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:40.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.388+0000 7f7b53a00640 1 --2- 172.21.15.122:0/1442521741 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7b28068650 0x7f7b2806ab10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7b34001ce0 tx=0x7f7b34001c70 comp rx=0 tx=0).stop 2024-05-28T06:09:40.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.388+0000 7f7b53a00640 1 -- 172.21.15.122:0/1442521741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4c1f72e0 msgr2=0x7f7b4c0ae6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:40.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.388+0000 7f7b53a00640 1 --2- 172.21.15.122:0/1442521741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4c1f72e0 0x7f7b4c0ae6a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00e390 tx=0x7f7b3c00e850 comp rx=0 tx=0).stop 2024-05-28T06:09:40.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.388+0000 7f7b53a00640 1 -- 172.21.15.122:0/1442521741 shutdown_connections 2024-05-28T06:09:40.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.388+0000 7f7b53a00640 1 --2- 172.21.15.122:0/1442521741 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7b28068650 0x7f7b2806ab10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.388+0000 7f7b53a00640 1 --2- 172.21.15.122:0/1442521741 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b4c0aebe0 0x7f7b4c13fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.388+0000 7f7b53a00640 1 --2- 172.21.15.122:0/1442521741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4c1f72e0 0x7f7b4c0ae6a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.388+0000 7f7b53a00640 1 --2- 172.21.15.122:0/1442521741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b300051d0 0x7f7b4c1f5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.388+0000 7f7b53a00640 1 -- 172.21.15.122:0/1442521741 >> 172.21.15.122:0/1442521741 conn(0x7f7b4c06bd90 msgr2=0x7f7b4c142fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:40.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.388+0000 7f7b53a00640 1 -- 172.21.15.122:0/1442521741 shutdown_connections 2024-05-28T06:09:40.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.388+0000 7f7b53a00640 1 -- 172.21.15.122:0/1442521741 wait complete. 2024-05-28T06:09:40.814 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-28T06:09:34.510484+0000', 'modified': '2024-05-28T06:09:37.531081+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5679}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5679': {'gid': 5679, 'name': 'a', 'rank': 0, 'incarnation': 24, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.122:6837/1627568336', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6835', 'nonce': 1627568336}, {'type': 'v1', 'addr': '172.21.15.122:6837', 'nonce': 1627568336}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5679, 'qdb_cluster': [5679]} 2024-05-28T06:09:40.814 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-28T06:09:40.814 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-28T06:09:40.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.952+0000 7fabf6800640 1 Processor -- start 2024-05-28T06:09:40.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.952+0000 7fabf6800640 1 -- start start 2024-05-28T06:09:40.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.952+0000 7fabf6800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fabf009b150 0x7fabf00b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.952+0000 7fabf6800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fabf015f900 0x7fabf0071010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.952+0000 7fabf6800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabf0162e60 con 0x7fabf015e990 2024-05-28T06:09:40.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.952+0000 7fabf6800640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fabf015fd90 con 0x7fabf015f900 2024-05-28T06:09:40.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.952+0000 7fabf6800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fabf0163140 con 0x7fabf009b150 2024-05-28T06:09:40.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.952+0000 7fabf5400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fabf015e990 0x7fabf009aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:48974/0 (socket says 172.21.15.122:48974) 2024-05-28T06:09:40.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.952+0000 7fabf5400640 1 -- 172.21.15.122:0/3804542527 learned_addr learned my addr 172.21.15.122:0/3804542527 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:40.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.952+0000 7fabf5e00640 1 --2- 172.21.15.122:0/3804542527 >> v2:172.21.15.122:3300/0 conn(0x7fabf015f900 0x7fabf0071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:40.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.952+0000 7fabf4a00640 1 --2- 172.21.15.122:0/3804542527 >> v2:172.21.15.153:3300/0 conn(0x7fabf009b150 0x7fabf00b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:40.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.952+0000 7fabefe00640 1 -- 172.21.15.122:0/3804542527 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 671320187 0 0) 0x7fabf0162e60 con 0x7fabf015e990 2024-05-28T06:09:40.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.952+0000 7fabefe00640 1 -- 172.21.15.122:0/3804542527 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabd8003530 con 0x7fabf015e990 2024-05-28T06:09:40.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.952+0000 7fabf5e00640 1 -- 172.21.15.122:0/3804542527 >> v2:172.21.15.153:3300/0 conn(0x7fabf009b150 msgr2=0x7fabf00b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:40.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.952+0000 7fabf5e00640 1 --2- 172.21.15.122:0/3804542527 >> v2:172.21.15.153:3300/0 conn(0x7fabf009b150 0x7fabf00b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.952+0000 7fabf5e00640 1 -- 172.21.15.122:0/3804542527 >> v1:172.21.15.122:6789/0 conn(0x7fabf015e990 legacy=0x7fabf009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:40.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.952+0000 7fabf5e00640 1 -- 172.21.15.122:0/3804542527 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf015f100 con 0x7fabf015f900 2024-05-28T06:09:40.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.956+0000 7fabf5e00640 1 --2- 172.21.15.122:0/3804542527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabf015f900 0x7fabf0071010 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fabf00d01f0 tx=0x7fabe801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3e266d37a1e53f server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:40.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.956+0000 7fabefe00640 1 -- 172.21.15.122:0/3804542527 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe80b2070 con 0x7fabf015f900 2024-05-28T06:09:40.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.956+0000 7fabefe00640 1 -- 172.21.15.122:0/3804542527 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabe80a5870 con 0x7fabf015f900 2024-05-28T06:09:40.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.956+0000 7fabefe00640 1 -- 172.21.15.122:0/3804542527 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe80a5c20 con 0x7fabf015f900 2024-05-28T06:09:40.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.956+0000 7fabf6800640 1 -- 172.21.15.122:0/3804542527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabf015f900 msgr2=0x7fabf0071010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:40.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.956+0000 7fabf6800640 1 --2- 172.21.15.122:0/3804542527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabf015f900 0x7fabf0071010 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fabf00d01f0 tx=0x7fabe801c8a0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.956+0000 7fabf6800640 1 -- 172.21.15.122:0/3804542527 shutdown_connections 2024-05-28T06:09:40.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.956+0000 7fabf6800640 1 --2- 172.21.15.122:0/3804542527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabf015f900 0x7fabf0071010 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.956+0000 7fabf6800640 1 --2- 172.21.15.122:0/3804542527 >> v2:172.21.15.153:3300/0 conn(0x7fabf009b150 0x7fabf00b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.956+0000 7fabf6800640 1 -- 172.21.15.122:0/3804542527 >> 172.21.15.122:0/3804542527 conn(0x7fabf00d2440 msgr2=0x7fabf00d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:40.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.956+0000 7fabf6800640 1 -- 172.21.15.122:0/3804542527 shutdown_connections 2024-05-28T06:09:40.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.956+0000 7fabf6800640 1 -- 172.21.15.122:0/3804542527 wait complete. 2024-05-28T06:09:40.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabf6800640 1 Processor -- start 2024-05-28T06:09:40.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabf6800640 1 -- start start 2024-05-28T06:09:40.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabf6800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf009b150 0x7fabf0153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabf6800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabf015e990 0x7fabf01538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabf6800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf015f900 0x7fabf00b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabf6800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fabf00d1220 con 0x7fabf015e990 2024-05-28T06:09:40.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabf6800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fabf00d10a0 con 0x7fabf015f900 2024-05-28T06:09:40.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabf6800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fabf00d13a0 con 0x7fabf009b150 2024-05-28T06:09:40.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabf4a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabf015e990 0x7fabf01538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:40.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabf4a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabf015e990 0x7fabf01538e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48652/0 (socket says 172.21.15.122:48652) 2024-05-28T06:09:40.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabf4a00640 1 -- 172.21.15.122:0/1828103526 learned_addr learned my addr 172.21.15.122:0/1828103526 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:40.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabf5e00640 1 --2- 172.21.15.122:0/1828103526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf015f900 0x7fabf00b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:40.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabf4a00640 1 -- 172.21.15.122:0/1828103526 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf009b150 msgr2=0x7fabf0153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:40.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabf4a00640 1 --2- 172.21.15.122:0/1828103526 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf009b150 0x7fabf0153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabf4a00640 1 -- 172.21.15.122:0/1828103526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf015f900 msgr2=0x7fabf00b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:40.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabf4a00640 1 --2- 172.21.15.122:0/1828103526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf015f900 0x7fabf00b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabf4a00640 1 -- 172.21.15.122:0/1828103526 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf0068cd0 con 0x7fabf015e990 2024-05-28T06:09:40.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabf5e00640 1 --2- 172.21.15.122:0/1828103526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf015f900 0x7fabf00b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:09:40.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabf4a00640 1 --2- 172.21.15.122:0/1828103526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabf015e990 0x7fabf01538e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fabdc00e900 tx=0x7fabdc00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:40.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabed600640 1 -- 172.21.15.122:0/1828103526 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabdc017070 con 0x7fabf015e990 2024-05-28T06:09:40.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabed600640 1 -- 172.21.15.122:0/1828103526 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabdc00ca00 con 0x7fabf015e990 2024-05-28T06:09:40.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabf6800640 1 -- 172.21.15.122:0/1828103526 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabf01542c0 con 0x7fabf015e990 2024-05-28T06:09:40.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabed600640 1 -- 172.21.15.122:0/1828103526 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabdc00cdf0 con 0x7fabf015e990 2024-05-28T06:09:40.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.960+0000 7fabf6800640 1 -- 172.21.15.122:0/1828103526 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabf0154880 con 0x7fabf015e990 2024-05-28T06:09:40.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.964+0000 7fabed600640 1 -- 172.21.15.122:0/1828103526 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7fabdc01a070 con 0x7fabf015e990 2024-05-28T06:09:40.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.964+0000 7fabed600640 1 --2- 172.21.15.122:0/1828103526 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fabd0068650 0x7fabd006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.964+0000 7fabed600640 1 -- 172.21.15.122:0/1828103526 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7fabdc086dc0 con 0x7fabf015e990 2024-05-28T06:09:40.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.964+0000 7fabf5400640 1 --2- 172.21.15.122:0/1828103526 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fabd0068650 0x7fabd006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:40.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.964+0000 7fabfb28f000 1 Processor -- start 2024-05-28T06:09:40.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.964+0000 7fabfb28f000 1 -- start start 2024-05-28T06:09:40.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.964+0000 7fabf5400640 1 --2- 172.21.15.122:0/1828103526 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fabd0068650 0x7fabd006ab10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fabe4007fd0 tx=0x7fabe4007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:40.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.964+0000 7fabfb28f000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6d1c120 0x5650f6d1c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.964+0000 7fabfb28f000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650f6d1ca40 0x5650f6ccf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.964+0000 7fabfb28f000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650f6ccf650 0x5650f6ccfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.964+0000 7fabfb28f000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5650f6b20420 con 0x5650f6d1c120 2024-05-28T06:09:40.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.964+0000 7fabfb28f000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5650f6ababf0 con 0x5650f6d1ca40 2024-05-28T06:09:40.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.964+0000 7fabfb28f000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5650f6b1c3e0 con 0x5650f6ccf650 2024-05-28T06:09:40.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.964+0000 7fabf5400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6d1c120 0x5650f6d1c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:40.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.964+0000 7fabf5400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6d1c120 0x5650f6d1c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48660/0 (socket says 172.21.15.122:48660) 2024-05-28T06:09:40.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.964+0000 7fabf5400640 1 -- 172.21.15.122:0/1389335596 learned_addr learned my addr 172.21.15.122:0/1389335596 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:40.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabf5400640 1 -- 172.21.15.122:0/1389335596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650f6ccf650 msgr2=0x5650f6ccfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:40.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabf5400640 1 --2- 172.21.15.122:0/1389335596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650f6ccf650 0x5650f6ccfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabf5400640 1 -- 172.21.15.122:0/1389335596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650f6d1ca40 msgr2=0x5650f6ccf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:40.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabf5400640 1 --2- 172.21.15.122:0/1389335596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650f6d1ca40 0x5650f6ccf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabf5400640 1 -- 172.21.15.122:0/1389335596 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650f6bc8450 con 0x5650f6d1c120 2024-05-28T06:09:40.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabf5400640 1 --2- 172.21.15.122:0/1389335596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6d1c120 0x5650f6d1c500 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fabe4005d70 tx=0x7fabe400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d397fddaf0d9dbd6 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:40.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabe2000640 1 -- 172.21.15.122:0/1389335596 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe4005e60 con 0x5650f6d1c120 2024-05-28T06:09:40.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabe2000640 1 -- 172.21.15.122:0/1389335596 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabe4007560 con 0x5650f6d1c120 2024-05-28T06:09:40.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabe2000640 1 -- 172.21.15.122:0/1389335596 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe4016b90 con 0x5650f6d1c120 2024-05-28T06:09:40.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabfb28f000 1 -- 172.21.15.122:0/1389335596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6d1c120 msgr2=0x5650f6d1c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:40.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabfb28f000 1 --2- 172.21.15.122:0/1389335596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6d1c120 0x5650f6d1c500 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fabe4005d70 tx=0x7fabe400f000 comp rx=0 tx=0).stop 2024-05-28T06:09:40.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabfb28f000 1 -- 172.21.15.122:0/1389335596 shutdown_connections 2024-05-28T06:09:40.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabfb28f000 1 --2- 172.21.15.122:0/1389335596 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650f6ccf650 0x5650f6ccfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabfb28f000 1 --2- 172.21.15.122:0/1389335596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650f6d1ca40 0x5650f6ccf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabfb28f000 1 --2- 172.21.15.122:0/1389335596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6d1c120 0x5650f6d1c500 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabfb28f000 1 -- 172.21.15.122:0/1389335596 >> 172.21.15.122:0/1389335596 conn(0x5650f6cfcec0 msgr2=0x5650f6cff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:40.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabfb28f000 1 -- 172.21.15.122:0/1389335596 shutdown_connections 2024-05-28T06:09:40.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabfb28f000 1 -- 172.21.15.122:0/1389335596 wait complete. 2024-05-28T06:09:40.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabfb28f000 1 -- start start 2024-05-28T06:09:40.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabfb28f000 1 Processor -- start 2024-05-28T06:09:40.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabfb28f000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650f6ccf650 0x5650f6cd4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabfb28f000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6d1c120 0x5650f6cd5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabfb28f000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650f6d1ca40 0x5650f6cd55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabfb28f000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5650f6ac0ec0 con 0x5650f6d1c120 2024-05-28T06:09:40.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabfb28f000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5650f6ba1120 con 0x5650f6ccf650 2024-05-28T06:09:40.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabfb28f000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5650f6b2b350 con 0x5650f6d1ca40 2024-05-28T06:09:40.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabfb28f000 10 client.0 _ll_register_callbacks cb 0x5650f6afd4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-28T06:09:40.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabf4a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6d1c120 0x5650f6cd5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:40.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabf4a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6d1c120 0x5650f6cd5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48676/0 (socket says 172.21.15.122:48676) 2024-05-28T06:09:40.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabf4a00640 1 -- 172.21.15.122:0/780333852 learned_addr learned my addr 172.21.15.122:0/780333852 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:40.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabf5400640 1 --2- 172.21.15.122:0/780333852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650f6ccf650 0x5650f6cd4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:40.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabf5e00640 1 --2- 172.21.15.122:0/780333852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650f6d1ca40 0x5650f6cd55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:40.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabf4a00640 1 -- 172.21.15.122:0/780333852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650f6d1ca40 msgr2=0x5650f6cd55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:40.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabf4a00640 1 --2- 172.21.15.122:0/780333852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650f6d1ca40 0x5650f6cd55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabf4a00640 1 -- 172.21.15.122:0/780333852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650f6ccf650 msgr2=0x5650f6cd4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:40.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabf4a00640 1 --2- 172.21.15.122:0/780333852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650f6ccf650 0x5650f6cd4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabf4a00640 1 -- 172.21.15.122:0/780333852 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650f6b65f80 con 0x5650f6d1c120 2024-05-28T06:09:40.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabf5400640 1 --2- 172.21.15.122:0/780333852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650f6ccf650 0x5650f6cd4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:09:40.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabf5e00640 1 --2- 172.21.15.122:0/780333852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650f6d1ca40 0x5650f6cd55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:09:40.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabf4a00640 1 --2- 172.21.15.122:0/780333852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6d1c120 0x5650f6cd5080 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fabdc056910 tx=0x7fabdc0571c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ccc48c03c489cdf server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:40.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.968+0000 7fabd6a00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-28T06:09:40.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabd6a00640 1 -- 172.21.15.122:0/780333852 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabdc021070 con 0x5650f6d1c120 2024-05-28T06:09:40.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabd6a00640 1 -- 172.21.15.122:0/780333852 <== mon.0 v2:172.21.15.122:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7fabdc055dd0 con 0x5650f6d1c120 2024-05-28T06:09:40.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabfb28f000 1 -- 172.21.15.122:0/780333852 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabe4007560 con 0x5650f6d1c120 2024-05-28T06:09:40.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabd6a00640 1 -- 172.21.15.122:0/780333852 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fabdc05f560 con 0x5650f6d1c120 2024-05-28T06:09:40.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabfb28f000 10 client.5823 fetch_fsmap learned FSMap version 28 2024-05-28T06:09:40.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabfb28f000 1 -- 172.21.15.122:0/780333852 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x5650f6af9f00 con 0x5650f6d1c120 2024-05-28T06:09:40.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabd6a00640 1 -- 172.21.15.122:0/780333852 <== mon.0 v2:172.21.15.122:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabe4007560 con 0x5650f6d1c120 2024-05-28T06:09:40.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabd6a00640 1 -- 172.21.15.122:0/780333852 <== mon.0 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 3494+0+0 (secure 0 0 0) 0x7fabdc024060 con 0x5650f6d1c120 2024-05-28T06:09:40.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabfb28f000 10 client.5823 fetch_fsmap finished waiting for FSMap version 28 2024-05-28T06:09:40.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabfb28f000 10 client.5823 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-28T06:09:40.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabfb28f000 20 client.5823 populate_metadata read hostname 'smithi122' 2024-05-28T06:09:40.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabfb28f000 1 --2- 172.21.15.122:0/780333852 >> [v2:172.21.15.122:6835/1627568336,v1:172.21.15.122:6837/1627568336] conn(0x5650f6d2b3c0 0x5650f6d2d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabfb28f000 4 client.5823 mds_command: new command op to 5679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-28T06:09:40.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabfb28f000 1 -- 172.21.15.122:0/780333852 --> [v2:172.21.15.122:6835/1627568336,v1:172.21.15.122:6837/1627568336] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650f6ab9bc0 con 0x5650f6d2b3c0 2024-05-28T06:09:40.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabf5400640 1 --2- 172.21.15.122:0/780333852 >> [v2:172.21.15.122:6835/1627568336,v1:172.21.15.122:6837/1627568336] conn(0x5650f6d2b3c0 0x5650f6d2d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:40.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabf5400640 1 --2- 172.21.15.122:0/780333852 >> [v2:172.21.15.122:6835/1627568336,v1:172.21.15.122:6837/1627568336] conn(0x5650f6d2b3c0 0x5650f6d2d7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9664c4f389ebeeb2 server_cookie=89490ecf11b48d33 in_seq=0 out_seq=0 2024-05-28T06:09:40.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabd6a00640 10 client.5823 ms_handle_connect on v2:172.21.15.122:6835/1627568336 2024-05-28T06:09:40.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabd6a00640 1 -- 172.21.15.122:0/780333852 <== mds.0 v2:172.21.15.122:6835/1627568336 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5650f6ab9bc0 con 0x5650f6d2b3c0 2024-05-28T06:09:40.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabd6a00640 10 client.5823 handle_command_reply: tid=0 2024-05-28T06:09:40.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabfb28f000 1 client.5823 shutdown 2024-05-28T06:09:40.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabfb28f000 1 -- 172.21.15.122:0/780333852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6d1c120 msgr2=0x5650f6cd5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:40.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabfb28f000 1 --2- 172.21.15.122:0/780333852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6d1c120 0x5650f6cd5080 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fabdc056910 tx=0x7fabdc0571c0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabfb28f000 1 -- 172.21.15.122:0/780333852 shutdown_connections 2024-05-28T06:09:40.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabfb28f000 1 --2- 172.21.15.122:0/780333852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650f6d1ca40 0x5650f6cd55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabfb28f000 1 --2- 172.21.15.122:0/780333852 >> [v2:172.21.15.122:6835/1627568336,v1:172.21.15.122:6837/1627568336] conn(0x5650f6d2b3c0 0x5650f6d2d7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabfb28f000 1 --2- 172.21.15.122:0/780333852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6d1c120 0x5650f6cd5080 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabfb28f000 1 --2- 172.21.15.122:0/780333852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650f6ccf650 0x5650f6cd4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabd6a00640 0 client.5823 ms_handle_reset on v2:172.21.15.122:6835/1627568336 2024-05-28T06:09:40.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabfb28f000 1 -- 172.21.15.122:0/780333852 >> 172.21.15.122:0/780333852 conn(0x5650f6cfcec0 msgr2=0x5650f6cff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:40.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabfb28f000 1 -- 172.21.15.122:0/780333852 shutdown_connections 2024-05-28T06:09:40.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabfb28f000 1 -- 172.21.15.122:0/780333852 wait complete. 2024-05-28T06:09:40.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.972+0000 7fabfb28f000 20 client.5823 trim_cache size 0 max 16384 2024-05-28T06:09:40.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.988+0000 7fabfb28f000 1 Processor -- start 2024-05-28T06:09:40.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabfb28f000 1 -- start start 2024-05-28T06:09:40.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabfb28f000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6ccf650 0x5650f6cce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabfb28f000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650f6d1c120 0x5650f6cced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabfb28f000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650f6d1ca40 0x5650f6d2d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:40.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabfb28f000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fabf015d2c0 con 0x5650f6ccf650 2024-05-28T06:09:40.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabfb28f000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fabf01422e0 con 0x5650f6d1ca40 2024-05-28T06:09:40.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabfb28f000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fabf015cc70 con 0x5650f6d1c120 2024-05-28T06:09:40.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabf5400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6ccf650 0x5650f6cce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:40.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabf5400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6ccf650 0x5650f6cce810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48692/0 (socket says 172.21.15.122:48692) 2024-05-28T06:09:40.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabf5400640 1 -- 172.21.15.122:0/223549088 learned_addr learned my addr 172.21.15.122:0/223549088 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:40.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabf4a00640 1 --2- 172.21.15.122:0/223549088 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650f6d1c120 0x5650f6cced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:40.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabf5e00640 1 --2- 172.21.15.122:0/223549088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650f6d1ca40 0x5650f6d2d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:40.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabf5400640 1 -- 172.21.15.122:0/223549088 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650f6d1c120 msgr2=0x5650f6cced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:40.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabf5400640 1 --2- 172.21.15.122:0/223549088 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650f6d1c120 0x5650f6cced50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabf5400640 1 -- 172.21.15.122:0/223549088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650f6d1ca40 msgr2=0x5650f6d2d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:40.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabf5400640 1 --2- 172.21.15.122:0/223549088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650f6d1ca40 0x5650f6d2d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:40.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabf5400640 1 -- 172.21.15.122:0/223549088 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650f6aa6e80 con 0x5650f6ccf650 2024-05-28T06:09:40.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabf5400640 1 --2- 172.21.15.122:0/223549088 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6ccf650 0x5650f6cce810 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fabe4001210 tx=0x7fabe4007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112c4fd5a3a9a77b server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:40.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabe1600640 1 -- 172.21.15.122:0/223549088 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe402f070 con 0x5650f6ccf650 2024-05-28T06:09:40.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabe1600640 1 -- 172.21.15.122:0/223549088 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabe40168d0 con 0x5650f6ccf650 2024-05-28T06:09:40.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabe1600640 1 -- 172.21.15.122:0/223549088 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe4016cc0 con 0x5650f6ccf650 2024-05-28T06:09:40.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabfb28f000 1 -- 172.21.15.122:0/223549088 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6ccf650 msgr2=0x5650f6cce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:41.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabfb28f000 1 --2- 172.21.15.122:0/223549088 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6ccf650 0x5650f6cce810 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fabe4001210 tx=0x7fabe4007000 comp rx=0 tx=0).stop 2024-05-28T06:09:41.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabfb28f000 1 -- 172.21.15.122:0/223549088 shutdown_connections 2024-05-28T06:09:41.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabfb28f000 1 --2- 172.21.15.122:0/223549088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650f6d1ca40 0x5650f6d2d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabfb28f000 1 --2- 172.21.15.122:0/223549088 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650f6d1c120 0x5650f6cced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabfb28f000 1 --2- 172.21.15.122:0/223549088 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6ccf650 0x5650f6cce810 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabfb28f000 1 -- 172.21.15.122:0/223549088 >> 172.21.15.122:0/223549088 conn(0x5650f6cfcec0 msgr2=0x5650f6cce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:41.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabfb28f000 1 -- 172.21.15.122:0/223549088 shutdown_connections 2024-05-28T06:09:41.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabfb28f000 1 -- 172.21.15.122:0/223549088 wait complete. 2024-05-28T06:09:41.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabfb28f000 1 -- start start 2024-05-28T06:09:41.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.992+0000 7fabfb28f000 1 Processor -- start 2024-05-28T06:09:41.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6ccf650 0x5650f6d301f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:41.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650f6d1c120 0x5650f6d47340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:41.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650f6d1ca40 0x5650f6d47880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:41.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5650f6b1f730 con 0x5650f6ccf650 2024-05-28T06:09:41.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5650f6aec9e0 con 0x5650f6d1ca40 2024-05-28T06:09:41.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x5650f6b24a50 con 0x5650f6d1c120 2024-05-28T06:09:41.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 10 client.0 _ll_register_callbacks cb 0x7fabdc00ef70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-28T06:09:41.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabf5400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6ccf650 0x5650f6d301f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:41.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabf5400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6ccf650 0x5650f6d301f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48698/0 (socket says 172.21.15.122:48698) 2024-05-28T06:09:41.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabf5400640 1 -- 172.21.15.122:0/233200877 learned_addr learned my addr 172.21.15.122:0/233200877 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:41.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabf4a00640 1 --2- 172.21.15.122:0/233200877 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650f6d1c120 0x5650f6d47340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:41.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabf5e00640 1 --2- 172.21.15.122:0/233200877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650f6d1ca40 0x5650f6d47880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:41.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabf5400640 1 -- 172.21.15.122:0/233200877 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650f6d1c120 msgr2=0x5650f6d47340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:41.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabf5400640 1 --2- 172.21.15.122:0/233200877 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650f6d1c120 0x5650f6d47340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabf5400640 1 -- 172.21.15.122:0/233200877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650f6d1ca40 msgr2=0x5650f6d47880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:41.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabf5400640 1 --2- 172.21.15.122:0/233200877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650f6d1ca40 0x5650f6d47880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabf5400640 1 -- 172.21.15.122:0/233200877 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650f6ae8b30 con 0x5650f6ccf650 2024-05-28T06:09:41.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabf5400640 1 --2- 172.21.15.122:0/233200877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6ccf650 0x5650f6d301f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x5650f6aeb7e0 tx=0x7fabe4001160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7161381185cce61a server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:41.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabd6a00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-28T06:09:41.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabd6a00640 1 -- 172.21.15.122:0/233200877 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe402f070 con 0x5650f6ccf650 2024-05-28T06:09:41.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabd6a00640 1 -- 172.21.15.122:0/233200877 <== mon.0 v2:172.21.15.122:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7fabe4016c90 con 0x5650f6ccf650 2024-05-28T06:09:41.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 1 -- 172.21.15.122:0/233200877 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabe40168d0 con 0x5650f6ccf650 2024-05-28T06:09:41.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabd6a00640 1 -- 172.21.15.122:0/233200877 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fabe403d050 con 0x5650f6ccf650 2024-05-28T06:09:41.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 10 client.5829 fetch_fsmap learned FSMap version 28 2024-05-28T06:09:41.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 1 -- 172.21.15.122:0/233200877 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x5650f6ba15b0 con 0x5650f6ccf650 2024-05-28T06:09:41.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabd6a00640 1 -- 172.21.15.122:0/233200877 <== mon.0 v2:172.21.15.122:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabe40168d0 con 0x5650f6ccf650 2024-05-28T06:09:41.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabd6a00640 1 -- 172.21.15.122:0/233200877 <== mon.0 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 3494+0+0 (secure 0 0 0) 0x7fabe4040020 con 0x5650f6ccf650 2024-05-28T06:09:41.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 10 client.5829 fetch_fsmap finished waiting for FSMap version 28 2024-05-28T06:09:41.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 10 client.5829 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-28T06:09:41.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 20 client.5829 populate_metadata read hostname 'smithi122' 2024-05-28T06:09:41.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 1 --2- 172.21.15.122:0/233200877 >> [v2:172.21.15.122:6835/1627568336,v1:172.21.15.122:6837/1627568336] conn(0x5650f6d47dc0 0x5650f6d8afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:41.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 4 client.5829 mds_command: new command op to 5679 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-28T06:09:41.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 1 -- 172.21.15.122:0/233200877 --> [v2:172.21.15.122:6835/1627568336,v1:172.21.15.122:6837/1627568336] -- command(tid 0: {"prefix": "status"}) -- 0x5650f6b2de40 con 0x5650f6d47dc0 2024-05-28T06:09:41.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabf4a00640 1 --2- 172.21.15.122:0/233200877 >> [v2:172.21.15.122:6835/1627568336,v1:172.21.15.122:6837/1627568336] conn(0x5650f6d47dc0 0x5650f6d8afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:41.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabf4a00640 1 --2- 172.21.15.122:0/233200877 >> [v2:172.21.15.122:6835/1627568336,v1:172.21.15.122:6837/1627568336] conn(0x5650f6d47dc0 0x5650f6d8afb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2ead84c64947054 server_cookie=e518495c269305b9 in_seq=0 out_seq=0 2024-05-28T06:09:41.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabd6a00640 10 client.5829 ms_handle_connect on v2:172.21.15.122:6835/1627568336 2024-05-28T06:09:41.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabd6a00640 1 -- 172.21.15.122:0/233200877 <== mds.0 v2:172.21.15.122:6835/1627568336 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x5650f6b2de40 con 0x5650f6d47dc0 2024-05-28T06:09:41.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabd6a00640 10 client.5829 handle_command_reply: tid=0 2024-05-28T06:09:41.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 1 client.5829 shutdown 2024-05-28T06:09:41.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 1 -- 172.21.15.122:0/233200877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6ccf650 msgr2=0x5650f6d301f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:41.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 1 --2- 172.21.15.122:0/233200877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6ccf650 0x5650f6d301f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x5650f6aeb7e0 tx=0x7fabe4001160 comp rx=0 tx=0).stop 2024-05-28T06:09:41.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 1 -- 172.21.15.122:0/233200877 shutdown_connections 2024-05-28T06:09:41.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 1 --2- 172.21.15.122:0/233200877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5650f6d1ca40 0x5650f6d47880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 1 --2- 172.21.15.122:0/233200877 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5650f6d1c120 0x5650f6d47340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 1 --2- 172.21.15.122:0/233200877 >> [v2:172.21.15.122:6835/1627568336,v1:172.21.15.122:6837/1627568336] conn(0x5650f6d47dc0 0x5650f6d8afb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 1 --2- 172.21.15.122:0/233200877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650f6ccf650 0x5650f6d301f0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 1 -- 172.21.15.122:0/233200877 >> 172.21.15.122:0/233200877 conn(0x5650f6cfcec0 msgr2=0x5650f6cce810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:41.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabd6a00640 0 client.5829 ms_handle_reset on v2:172.21.15.122:6835/1627568336 2024-05-28T06:09:41.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 1 -- 172.21.15.122:0/233200877 shutdown_connections 2024-05-28T06:09:41.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 1 -- 172.21.15.122:0/233200877 wait complete. 2024-05-28T06:09:41.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:40.996+0000 7fabfb28f000 20 client.5829 trim_cache size 0 max 16384 2024-05-28T06:09:41.005 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:09:41.006 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:09:41.006 INFO:teuthology.orchestra.run.smithi122.stdout: "whoami": 0, 2024-05-28T06:09:41.006 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 5679, 2024-05-28T06:09:41.006 INFO:teuthology.orchestra.run.smithi122.stdout: "want_state": "up:active", 2024-05-28T06:09:41.006 INFO:teuthology.orchestra.run.smithi122.stdout: "state": "up:active", 2024-05-28T06:09:41.006 INFO:teuthology.orchestra.run.smithi122.stdout: "fs_name": "cephfs", 2024-05-28T06:09:41.006 INFO:teuthology.orchestra.run.smithi122.stdout: "rank_uptime": 5.86933946, 2024-05-28T06:09:41.006 INFO:teuthology.orchestra.run.smithi122.stdout: "mdsmap_epoch": 28, 2024-05-28T06:09:41.006 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_epoch": 47, 2024-05-28T06:09:41.007 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_epoch_barrier": 47, 2024-05-28T06:09:41.007 INFO:teuthology.orchestra.run.smithi122.stdout: "uptime": 10.740680830000001 2024-05-28T06:09:41.007 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:09:41.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.000+0000 7fabf6800640 1 -- 172.21.15.122:0/1828103526 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fabd0068650 msgr2=0x7fabd006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:41.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.000+0000 7fabf6800640 1 --2- 172.21.15.122:0/1828103526 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fabd0068650 0x7fabd006ab10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fabe4007fd0 tx=0x7fabe4007900 comp rx=0 tx=0).stop 2024-05-28T06:09:41.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.000+0000 7fabf6800640 1 -- 172.21.15.122:0/1828103526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabf015e990 msgr2=0x7fabf01538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:41.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.000+0000 7fabf6800640 1 --2- 172.21.15.122:0/1828103526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabf015e990 0x7fabf01538e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fabdc00e900 tx=0x7fabdc00edc0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.000+0000 7fabf6800640 1 -- 172.21.15.122:0/1828103526 shutdown_connections 2024-05-28T06:09:41.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.000+0000 7fabf6800640 1 --2- 172.21.15.122:0/1828103526 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fabd0068650 0x7fabd006ab10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.000+0000 7fabf6800640 1 --2- 172.21.15.122:0/1828103526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf015f900 0x7fabf00b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.000+0000 7fabf6800640 1 --2- 172.21.15.122:0/1828103526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabf015e990 0x7fabf01538e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.000+0000 7fabf6800640 1 --2- 172.21.15.122:0/1828103526 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf009b150 0x7fabf0153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.000+0000 7fabf6800640 1 -- 172.21.15.122:0/1828103526 >> 172.21.15.122:0/1828103526 conn(0x7fabf00d2440 msgr2=0x7fabf006d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:41.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.000+0000 7fabf6800640 1 -- 172.21.15.122:0/1828103526 shutdown_connections 2024-05-28T06:09:41.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.000+0000 7fabf6800640 1 -- 172.21.15.122:0/1828103526 wait complete. 2024-05-28T06:09:41.021 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-28T06:09:41.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.156+0000 7f3071000640 1 Processor -- start 2024-05-28T06:09:41.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.156+0000 7f3071000640 1 -- start start 2024-05-28T06:09:41.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.156+0000 7f3071000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f306c073c80 0x7f306c0d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:41.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.156+0000 7f3071000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f306c0b36b0 0x7f306c0b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:41.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.156+0000 7f3071000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f306c0b46c0 con 0x7f306c15ea20 2024-05-28T06:09:41.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.156+0000 7f3071000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f306c0b4040 con 0x7f306c073c80 2024-05-28T06:09:41.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.156+0000 7f3071000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f306c15ee00 con 0x7f306c0b36b0 2024-05-28T06:09:41.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.156+0000 7f3063e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f306c073c80 0x7f306c0d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:41.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.156+0000 7f3063e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f306c073c80 0x7f306c0d0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48710/0 (socket says 172.21.15.122:48710) 2024-05-28T06:09:41.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.156+0000 7f3069e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f306c15ea20 0x7f306c0b4fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:48980/0 (socket says 172.21.15.122:48980) 2024-05-28T06:09:41.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.156+0000 7f3063e00640 1 -- 172.21.15.122:0/3443949601 learned_addr learned my addr 172.21.15.122:0/3443949601 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:41.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.156+0000 7f306a800640 1 --2- 172.21.15.122:0/3443949601 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f306c0b36b0 0x7f306c0b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:41.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.156+0000 7f3063e00640 1 -- 172.21.15.122:0/3443949601 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f306c0b36b0 msgr2=0x7f306c0b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:41.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.156+0000 7f3063e00640 1 --2- 172.21.15.122:0/3443949601 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f306c0b36b0 0x7f306c0b3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.156+0000 7f3063e00640 1 -- 172.21.15.122:0/3443949601 >> v1:172.21.15.122:6789/0 conn(0x7f306c15ea20 legacy=0x7f306c0b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:41.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.156+0000 7f3063e00640 1 -- 172.21.15.122:0/3443949601 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f306c0b49a0 con 0x7f306c073c80 2024-05-28T06:09:41.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.156+0000 7f3069400640 1 -- 172.21.15.122:0/3443949601 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1071759761 0 0) 0x7f306c0b46c0 con 0x7f306c15ea20 2024-05-28T06:09:41.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.160+0000 7f3063e00640 1 --2- 172.21.15.122:0/3443949601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f306c073c80 0x7f306c0d0e10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3054009870 tx=0x7f305401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e8a52381c4a4ba server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:41.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.160+0000 7f3069400640 1 -- 172.21.15.122:0/3443949601 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30540ab650 con 0x7f306c073c80 2024-05-28T06:09:41.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.160+0000 7f3069400640 1 -- 172.21.15.122:0/3443949601 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30540b0070 con 0x7f306c073c80 2024-05-28T06:09:41.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.160+0000 7f3069400640 1 -- 172.21.15.122:0/3443949601 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30540aba10 con 0x7f306c073c80 2024-05-28T06:09:41.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.160+0000 7f3071000640 1 -- 172.21.15.122:0/3443949601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f306c073c80 msgr2=0x7f306c0d0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:41.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.160+0000 7f3071000640 1 --2- 172.21.15.122:0/3443949601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f306c073c80 0x7f306c0d0e10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3054009870 tx=0x7f305401c560 comp rx=0 tx=0).stop 2024-05-28T06:09:41.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.160+0000 7f3071000640 1 -- 172.21.15.122:0/3443949601 shutdown_connections 2024-05-28T06:09:41.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.160+0000 7f3071000640 1 --2- 172.21.15.122:0/3443949601 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f306c0b36b0 0x7f306c0b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.160+0000 7f3071000640 1 --2- 172.21.15.122:0/3443949601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f306c073c80 0x7f306c0d0e10 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.160+0000 7f3071000640 1 -- 172.21.15.122:0/3443949601 >> 172.21.15.122:0/3443949601 conn(0x7f306c0b6c10 msgr2=0x7f306c0b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:41.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.160+0000 7f3071000640 1 -- 172.21.15.122:0/3443949601 shutdown_connections 2024-05-28T06:09:41.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.160+0000 7f3071000640 1 -- 172.21.15.122:0/3443949601 wait complete. 2024-05-28T06:09:41.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3071000640 1 Processor -- start 2024-05-28T06:09:41.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3071000640 1 -- start start 2024-05-28T06:09:41.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3071000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f306c073c80 0x7f306c14b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:41.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3071000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f306c0b36b0 0x7f306c0d0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:41.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3071000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f306c15ea20 0x7f306c0ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:41.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3071000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f306c0ce960 con 0x7f306c0b36b0 2024-05-28T06:09:41.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3071000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f306c0b56d0 con 0x7f306c15ea20 2024-05-28T06:09:41.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3071000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f306c0ceae0 con 0x7f306c073c80 2024-05-28T06:09:41.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3063e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f306c0b36b0 0x7f306c0d0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:41.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3063e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f306c0b36b0 0x7f306c0d0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48712/0 (socket says 172.21.15.122:48712) 2024-05-28T06:09:41.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3063e00640 1 -- 172.21.15.122:0/1187518300 learned_addr learned my addr 172.21.15.122:0/1187518300 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:41.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3069e00640 1 --2- 172.21.15.122:0/1187518300 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f306c073c80 0x7f306c14b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:41.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f306a800640 1 --2- 172.21.15.122:0/1187518300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f306c15ea20 0x7f306c0ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:41.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3063e00640 1 -- 172.21.15.122:0/1187518300 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f306c073c80 msgr2=0x7f306c14b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:41.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3063e00640 1 --2- 172.21.15.122:0/1187518300 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f306c073c80 0x7f306c14b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3063e00640 1 -- 172.21.15.122:0/1187518300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f306c15ea20 msgr2=0x7f306c0ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:41.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3063e00640 1 --2- 172.21.15.122:0/1187518300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f306c15ea20 0x7f306c0ca8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3063e00640 1 -- 172.21.15.122:0/1187518300 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f306c0d0b60 con 0x7f306c0b36b0 2024-05-28T06:09:41.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3063e00640 1 --2- 172.21.15.122:0/1187518300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f306c0b36b0 0x7f306c0d0620 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f30540ad040 tx=0x7f305401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:41.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3062000640 1 -- 172.21.15.122:0/1187518300 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30540be5f0 con 0x7f306c0b36b0 2024-05-28T06:09:41.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3062000640 1 -- 172.21.15.122:0/1187518300 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30540be7b0 con 0x7f306c0b36b0 2024-05-28T06:09:41.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3062000640 1 -- 172.21.15.122:0/1187518300 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30540beba0 con 0x7f306c0b36b0 2024-05-28T06:09:41.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3071000640 1 -- 172.21.15.122:0/1187518300 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f306c14bce0 con 0x7f306c0b36b0 2024-05-28T06:09:41.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3071000640 1 -- 172.21.15.122:0/1187518300 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f306c159e30 con 0x7f306c0b36b0 2024-05-28T06:09:41.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.164+0000 7f3071000640 1 -- 172.21.15.122:0/1187518300 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f306c068c40 con 0x7f306c0b36b0 2024-05-28T06:09:41.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.168+0000 7f3062000640 1 -- 172.21.15.122:0/1187518300 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f30540b43f0 con 0x7f306c0b36b0 2024-05-28T06:09:41.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.168+0000 7f3062000640 1 --2- 172.21.15.122:0/1187518300 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3048068650 0x7f304806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:41.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.168+0000 7f3062000640 1 -- 172.21.15.122:0/1187518300 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f3054121710 con 0x7f306c0b36b0 2024-05-28T06:09:41.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.168+0000 7f3069e00640 1 --2- 172.21.15.122:0/1187518300 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3048068650 0x7f304806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:41.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.168+0000 7f3069e00640 1 --2- 172.21.15.122:0/1187518300 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3048068650 0x7f304806ab10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f305c000f70 tx=0x7f305c007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:41.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.172+0000 7f3062000640 1 -- 172.21.15.122:0/1187518300 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3054016150 con 0x7f306c0b36b0 2024-05-28T06:09:41.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.368+0000 7f3071000640 1 -- 172.21.15.122:0/1187518300 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f306c14c990 con 0x7f306c0b36b0 2024-05-28T06:09:41.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.368+0000 7f3062000640 1 -- 172.21.15.122:0/1187518300 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+73 (secure 0 0 0) 0x7f30540f1370 con 0x7f306c0b36b0 2024-05-28T06:09:41.372 INFO:teuthology.orchestra.run.smithi122.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-28T06:09:41.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.372+0000 7f3071000640 1 -- 172.21.15.122:0/1187518300 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3048068650 msgr2=0x7f304806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:41.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.372+0000 7f3071000640 1 --2- 172.21.15.122:0/1187518300 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3048068650 0x7f304806ab10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f305c000f70 tx=0x7f305c007c10 comp rx=0 tx=0).stop 2024-05-28T06:09:41.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.372+0000 7f3071000640 1 -- 172.21.15.122:0/1187518300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f306c0b36b0 msgr2=0x7f306c0d0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:41.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.372+0000 7f3071000640 1 --2- 172.21.15.122:0/1187518300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f306c0b36b0 0x7f306c0d0620 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f30540ad040 tx=0x7f305401ada0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.372+0000 7f3071000640 1 -- 172.21.15.122:0/1187518300 shutdown_connections 2024-05-28T06:09:41.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.372+0000 7f3071000640 1 --2- 172.21.15.122:0/1187518300 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3048068650 0x7f304806ab10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.372+0000 7f3071000640 1 --2- 172.21.15.122:0/1187518300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f306c15ea20 0x7f306c0ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.372+0000 7f3071000640 1 --2- 172.21.15.122:0/1187518300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f306c0b36b0 0x7f306c0d0620 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.372+0000 7f3071000640 1 --2- 172.21.15.122:0/1187518300 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f306c073c80 0x7f306c14b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:41.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.372+0000 7f3071000640 1 -- 172.21.15.122:0/1187518300 >> 172.21.15.122:0/1187518300 conn(0x7f306c0b6c10 msgr2=0x7f306c074d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:41.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.372+0000 7f3071000640 1 -- 172.21.15.122:0/1187518300 shutdown_connections 2024-05-28T06:09:41.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41.372+0000 7f3071000640 1 -- 172.21.15.122:0/1187518300 wait complete. 2024-05-28T06:09:41.392 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-28T06:09:41.392 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-28T06:09:41.392 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi122.front.sepia.ceph.com 2024-05-28T06:09:41.392 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-28T06:09:41.392 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-28T06:09:41.393 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-28T06:09:41.393 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-28T06:09:41.393 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-28T06:09:41.393 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-28T06:09:41.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:09:41.393 DEBUG:teuthology.orchestra.run.smithi122:> ip addr 2024-05-28T06:09:41.402 INFO:teuthology.orchestra.run.smithi122.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-28T06:09:41.402 INFO:teuthology.orchestra.run.smithi122.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-28T06:09:41.403 INFO:teuthology.orchestra.run.smithi122.stdout: inet 127.0.0.1/8 scope host lo 2024-05-28T06:09:41.403 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:09:41.403 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 ::1/128 scope host 2024-05-28T06:09:41.403 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:09:41.403 INFO:teuthology.orchestra.run.smithi122.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-28T06:09:41.403 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e4 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:09:41.403 INFO:teuthology.orchestra.run.smithi122.stdout: altname enp7s0f0 2024-05-28T06:09:41.403 INFO:teuthology.orchestra.run.smithi122.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-28T06:09:41.403 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e5 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:09:41.403 INFO:teuthology.orchestra.run.smithi122.stdout: altname enp7s0f1 2024-05-28T06:09:41.403 INFO:teuthology.orchestra.run.smithi122.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-28T06:09:41.403 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:14 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:09:41.403 INFO:teuthology.orchestra.run.smithi122.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-28T06:09:41.404 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:15 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:09:41.404 INFO:teuthology.orchestra.run.smithi122.stdout: inet 172.21.15.122/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-28T06:09:41.404 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft 42241sec preferred_lft 42241sec 2024-05-28T06:09:41.404 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::ec4:7aff:fe8f:d515/64 scope link 2024-05-28T06:09:41.404 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:09:41.404 INFO:teuthology.orchestra.run.smithi122.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-28T06:09:41.404 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 02:42:4d:d8:1b:5f brd ff:ff:ff:ff:ff:ff 2024-05-28T06:09:41.404 INFO:teuthology.orchestra.run.smithi122.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-28T06:09:41.404 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:09:41.404 INFO:teuthology.orchestra.run.smithi122.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-28T06:09:41.404 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-28T06:09:41.404 INFO:teuthology.orchestra.run.smithi122.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-28T06:09:41.404 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:09:41.405 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-28T06:09:41.405 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:09:41.405 INFO:teuthology.orchestra.run.smithi122.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-28T06:09:41.405 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-28T06:09:41.405 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-28T06:09:41.405 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:09:41.405 INFO:teuthology.orchestra.run.smithi122.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-28T06:09:41.405 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-28T06:09:41.405 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-28T06:09:41.405 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:09:41.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:09:41.406 DEBUG:teuthology.orchestra.run.smithi122:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-28T06:09:41.462 INFO:teuthology.orchestra.run.smithi122.stdout:1 2024-05-28T06:09:41.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:09:41.485 DEBUG:teuthology.orchestra.run.smithi122:> route 2024-05-28T06:09:41.541 INFO:teuthology.orchestra.run.smithi122.stdout:Kernel IP routing table 2024-05-28T06:09:41.541 INFO:teuthology.orchestra.run.smithi122.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-28T06:09:41.541 INFO:teuthology.orchestra.run.smithi122.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-28T06:09:41.541 INFO:teuthology.orchestra.run.smithi122.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-28T06:09:41.541 INFO:teuthology.orchestra.run.smithi122.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-28T06:09:41.541 INFO:teuthology.orchestra.run.smithi122.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-28T06:09:41.541 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-28T06:09:41.541 INFO:teuthology.orchestra.run.smithi122.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-28T06:09:41.541 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-28T06:09:41.541 INFO:teuthology.orchestra.run.smithi122.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-28T06:09:41.541 INFO:teuthology.orchestra.run.smithi122.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-28T06:09:41.542 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-28T06:09:41.542 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-05-28T06:09:41.542 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-28T06:09:41.542 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-28T06:09:41.542 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-28T06:09:41.542 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-05-28T06:09:41.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:09:41.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:09:41.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:09:41.674 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2024-05-28T06:09:41.725 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-28T06:09:41.725 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-28T06:09:41.726 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-28T06:09:41.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:09:41.726 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set brx.0 up 2024-05-28T06:09:41.795 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-28T06:09:41.795 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-28T06:09:41.845 INFO:teuthology.orchestra.run.smithi122.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-28T06:09:41.846 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-28T06:09:41.846 DEBUG:teuthology.orchestra.run.smithi122:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-28T06:09:41.900 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-28T06:09:41.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:09:41.901 DEBUG:teuthology.orchestra.run.smithi122:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-28T06:09:41.988 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-28T06:09:41.988 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-28T06:09:41.988 INFO:teuthology.orchestra.run.smithi122.stdout:invalid new device string format 2024-05-28T06:09:42.003 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-28T06:09:42.003 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-28T06:09:42.003 INFO:teuthology.orchestra.run.smithi122.stdout:invalid new device string format 2024-05-28T06:09:42.004 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.122:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-05-28T06:09:42.004 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-28T06:09:42.013 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-28T06:09:42.013 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-28T06:09:42.013 INFO:teuthology.orchestra.run.smithi122.stdout:invalid new device string format 2024-05-28T06:09:42.013 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.122:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-05-28T06:09:42.013 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-28T06:09:42.013 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.122:6789,172.21.15.153:6789,172.21.15.153:6790" 2024-05-28T06:09:42.013 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.122:6789,172.21.15.153:6789,172.21.15.153:6790:/ 2024-05-28T06:09:42.013 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=e63a9349-baf2-4247-95d1-eb8599fad84f" will pass to kernel 2024-05-28T06:09:42.017 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-28T06:09:42.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:09:42.017 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-28T06:09:42.080 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-28T06:09:42.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-28T06:09:42.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:09:42.191 INFO:teuthology.orchestra.run.smithi122.stdout:client5602 2024-05-28T06:09:42.191 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:09:42.191 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:09:42.201 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-28T06:09:42.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.384+0000 7f4904e00640 1 Processor -- start 2024-05-28T06:09:42.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.384+0000 7f4904e00640 1 -- start start 2024-05-28T06:09:42.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.384+0000 7f4904e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f490006f890 0x7f49000cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:42.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.384+0000 7f4904e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f49000cd930 0x7f49000b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:42.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.384+0000 7f4904e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49000d0310 con 0x7f49000cff30 2024-05-28T06:09:42.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.384+0000 7f4904e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f490015be20 con 0x7f490006f890 2024-05-28T06:09:42.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.384+0000 7f4904e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f490015c100 con 0x7f49000cd930 2024-05-28T06:09:42.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.384+0000 7f48fde00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f49000cff30 0x7f490006f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:48996/0 (socket says 172.21.15.122:48996) 2024-05-28T06:09:42.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.384+0000 7f48fde00640 1 -- 172.21.15.122:0/760933064 learned_addr learned my addr 172.21.15.122:0/760933064 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:42.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.384+0000 7f48fd400640 1 --2- 172.21.15.122:0/760933064 >> v2:172.21.15.122:3300/0 conn(0x7f490006f890 0x7f49000cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:42.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.384+0000 7f48fe800640 1 --2- 172.21.15.122:0/760933064 >> v2:172.21.15.153:3300/0 conn(0x7f49000cd930 0x7f49000b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:42.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.384+0000 7f48fd400640 1 -- 172.21.15.122:0/760933064 >> v2:172.21.15.153:3300/0 conn(0x7f49000cd930 msgr2=0x7f49000b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:42.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.384+0000 7f48fd400640 1 --2- 172.21.15.122:0/760933064 >> v2:172.21.15.153:3300/0 conn(0x7f49000cd930 0x7f49000b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:42.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.384+0000 7f48fd400640 1 -- 172.21.15.122:0/760933064 >> v1:172.21.15.122:6789/0 conn(0x7f49000cff30 legacy=0x7f490006f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:42.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.384+0000 7f48fd400640 1 -- 172.21.15.122:0/760933064 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f490015c3e0 con 0x7f490006f890 2024-05-28T06:09:42.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.384+0000 7f48fca00640 1 -- 172.21.15.122:0/760933064 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2678157878 0 0) 0x7f49000d0310 con 0x7f49000cff30 2024-05-28T06:09:42.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.384+0000 7f48fe800640 1 --2- 172.21.15.122:0/760933064 >> v2:172.21.15.153:3300/0 conn(0x7f49000cd930 0x7f49000b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:09:42.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.388+0000 7f48fd400640 1 --2- 172.21.15.122:0/760933064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f490006f890 0x7f49000cd3f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f490015f040 tx=0x7f48ec01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b96e6a7f1a764fc server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:42.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.388+0000 7f48fca00640 1 -- 172.21.15.122:0/760933064 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec0ab5f0 con 0x7f490006f890 2024-05-28T06:09:42.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.388+0000 7f48fca00640 1 -- 172.21.15.122:0/760933064 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ec0b0070 con 0x7f490006f890 2024-05-28T06:09:42.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.388+0000 7f48fca00640 1 -- 172.21.15.122:0/760933064 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec0ab9b0 con 0x7f490006f890 2024-05-28T06:09:42.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.388+0000 7f4904e00640 1 -- 172.21.15.122:0/760933064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f490006f890 msgr2=0x7f49000cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:42.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.388+0000 7f4904e00640 1 --2- 172.21.15.122:0/760933064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f490006f890 0x7f49000cd3f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f490015f040 tx=0x7f48ec01c450 comp rx=0 tx=0).stop 2024-05-28T06:09:42.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.388+0000 7f4904e00640 1 -- 172.21.15.122:0/760933064 shutdown_connections 2024-05-28T06:09:42.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.388+0000 7f4904e00640 1 --2- 172.21.15.122:0/760933064 >> v2:172.21.15.153:3300/0 conn(0x7f49000cd930 0x7f49000b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:42.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.388+0000 7f4904e00640 1 --2- 172.21.15.122:0/760933064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f490006f890 0x7f49000cd3f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:42.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.388+0000 7f4904e00640 1 -- 172.21.15.122:0/760933064 >> 172.21.15.122:0/760933064 conn(0x7f490006bd90 msgr2=0x7f490006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:42.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.388+0000 7f4904e00640 1 -- 172.21.15.122:0/760933064 shutdown_connections 2024-05-28T06:09:42.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.388+0000 7f4904e00640 1 -- 172.21.15.122:0/760933064 wait complete. 2024-05-28T06:09:42.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.388+0000 7f4904e00640 1 Processor -- start 2024-05-28T06:09:42.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f4904e00640 1 -- start start 2024-05-28T06:09:42.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f4904e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f490006f890 0x7f49000b1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:42.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f4904e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49000cd930 0x7f4900146570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:42.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f4904e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49000cff30 0x7f49001569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:42.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f4904e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f49000b5880 con 0x7f49000cff30 2024-05-28T06:09:42.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f4904e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f49000b5700 con 0x7f490006f890 2024-05-28T06:09:42.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f4904e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f49000b5a00 con 0x7f49000cd930 2024-05-28T06:09:42.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f48fe800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49000cff30 0x7f49001569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:42.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f48fe800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49000cff30 0x7f49001569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48728/0 (socket says 172.21.15.122:48728) 2024-05-28T06:09:42.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f48fe800640 1 -- 172.21.15.122:0/364437972 learned_addr learned my addr 172.21.15.122:0/364437972 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:42.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f48fde00640 1 --2- 172.21.15.122:0/364437972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f490006f890 0x7f49000b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:42.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f48fd400640 1 --2- 172.21.15.122:0/364437972 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49000cd930 0x7f4900146570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:42.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f48fe800640 1 -- 172.21.15.122:0/364437972 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49000cd930 msgr2=0x7f4900146570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:42.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f48fe800640 1 --2- 172.21.15.122:0/364437972 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49000cd930 0x7f4900146570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:42.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f48fe800640 1 -- 172.21.15.122:0/364437972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f490006f890 msgr2=0x7f49000b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:42.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f48fe800640 1 --2- 172.21.15.122:0/364437972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f490006f890 0x7f49000b1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:42.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f48fe800640 1 -- 172.21.15.122:0/364437972 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49000730e0 con 0x7f49000cff30 2024-05-28T06:09:42.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f48fe800640 1 --2- 172.21.15.122:0/364437972 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49000cff30 0x7f49001569a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f48f800cef0 tx=0x7f48f800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:42.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f48f6000640 1 -- 172.21.15.122:0/364437972 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f801a070 con 0x7f49000cff30 2024-05-28T06:09:42.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f48f6000640 1 -- 172.21.15.122:0/364437972 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48f800d860 con 0x7f49000cff30 2024-05-28T06:09:42.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f48f6000640 1 -- 172.21.15.122:0/364437972 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f800dc50 con 0x7f49000cff30 2024-05-28T06:09:42.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f4904e00640 1 -- 172.21.15.122:0/364437972 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4900157540 con 0x7f49000cff30 2024-05-28T06:09:42.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f4904e00640 1 -- 172.21.15.122:0/364437972 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4900157b00 con 0x7f49000cff30 2024-05-28T06:09:42.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.392+0000 7f4904e00640 1 -- 172.21.15.122:0/364437972 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4900068c40 con 0x7f49000cff30 2024-05-28T06:09:42.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.396+0000 7f48f6000640 1 -- 172.21.15.122:0/364437972 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f48f801d070 con 0x7f49000cff30 2024-05-28T06:09:42.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.396+0000 7f48f6000640 1 --2- 172.21.15.122:0/364437972 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f48e0068650 0x7f48e006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:42.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.396+0000 7f48f6000640 1 -- 172.21.15.122:0/364437972 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f48f80875f0 con 0x7f49000cff30 2024-05-28T06:09:42.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.396+0000 7f48fde00640 1 --2- 172.21.15.122:0/364437972 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f48e0068650 0x7f48e006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:42.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.396+0000 7f48fde00640 1 --2- 172.21.15.122:0/364437972 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f48e0068650 0x7f48e006ab10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f48f0000f70 tx=0x7f48f0007df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:42.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.400+0000 7f48f6000640 1 -- 172.21.15.122:0/364437972 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f48f80571d0 con 0x7f49000cff30 2024-05-28T06:09:42.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:42.592+0000 7f4904e00640 1 -- 172.21.15.122:0/364437972 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f4900155f70 con 0x7f49000cff30 2024-05-28T06:09:43.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.164+0000 7f48f6000640 1 -- 172.21.15.122:0/364437972 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v29) ==== 136+0+0 (secure 0 0 0) 0x7f48f805b4d0 con 0x7f49000cff30 2024-05-28T06:09:43.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.168+0000 7f4904e00640 1 -- 172.21.15.122:0/364437972 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f48e0068650 msgr2=0x7f48e006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:43.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.168+0000 7f4904e00640 1 --2- 172.21.15.122:0/364437972 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f48e0068650 0x7f48e006ab10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f48f0000f70 tx=0x7f48f0007df0 comp rx=0 tx=0).stop 2024-05-28T06:09:43.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.168+0000 7f4904e00640 1 -- 172.21.15.122:0/364437972 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49000cff30 msgr2=0x7f49001569a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:43.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.168+0000 7f4904e00640 1 --2- 172.21.15.122:0/364437972 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49000cff30 0x7f49001569a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f48f800cef0 tx=0x7f48f800a710 comp rx=0 tx=0).stop 2024-05-28T06:09:43.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.168+0000 7f4904e00640 1 -- 172.21.15.122:0/364437972 shutdown_connections 2024-05-28T06:09:43.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.168+0000 7f4904e00640 1 --2- 172.21.15.122:0/364437972 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f48e0068650 0x7f48e006ab10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:43.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.168+0000 7f4904e00640 1 --2- 172.21.15.122:0/364437972 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49000cff30 0x7f49001569a0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:43.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.168+0000 7f4904e00640 1 --2- 172.21.15.122:0/364437972 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49000cd930 0x7f4900146570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:43.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.168+0000 7f4904e00640 1 --2- 172.21.15.122:0/364437972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f490006f890 0x7f49000b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:43.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.168+0000 7f4904e00640 1 -- 172.21.15.122:0/364437972 >> 172.21.15.122:0/364437972 conn(0x7f490006bd90 msgr2=0x7f490006c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:43.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.168+0000 7f4904e00640 1 -- 172.21.15.122:0/364437972 shutdown_connections 2024-05-28T06:09:43.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.168+0000 7f4904e00640 1 -- 172.21.15.122:0/364437972 wait complete. 2024-05-28T06:09:43.192 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-28T06:09:43.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fcb000640 1 Processor -- start 2024-05-28T06:09:43.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fcb000640 1 -- start start 2024-05-28T06:09:43.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fcb000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7fc40b3d30 0x7f7fc40d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:43.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fcb000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fc415db90 con 0x7f7fc415d7b0 2024-05-28T06:09:43.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fcb000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fc406b990 con 0x7f7fc415cc10 2024-05-28T06:09:43.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fcb000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7fc406bc50 con 0x7f7fc40b3d30 2024-05-28T06:09:43.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fc3e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f7fc415d7b0 0x7f7fc40b3620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:49000/0 (socket says 172.21.15.122:49000) 2024-05-28T06:09:43.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fc3e00640 1 -- 172.21.15.122:0/3914446317 learned_addr learned my addr 172.21.15.122:0/3914446317 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:43.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fc3400640 1 -- 172.21.15.122:0/3914446317 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2909427020 0 0) 0x7f7fc415db90 con 0x7f7fc415d7b0 2024-05-28T06:09:43.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fbb400640 1 --2- 172.21.15.122:0/3914446317 >> v2:172.21.15.153:3300/0 conn(0x7f7fc40b3d30 0x7f7fc40d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:43.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fc3400640 1 -- 172.21.15.122:0/3914446317 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fa8003530 con 0x7f7fc415d7b0 2024-05-28T06:09:43.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fc3400640 1 -- 172.21.15.122:0/3914446317 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3165407799 0 0) 0x7f7fa8003530 con 0x7f7fc415d7b0 2024-05-28T06:09:43.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fc3400640 1 -- 172.21.15.122:0/3914446317 >> v2:172.21.15.153:3300/0 conn(0x7f7fc40b3d30 msgr2=0x7f7fc40d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:43.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fc3400640 1 --2- 172.21.15.122:0/3914446317 >> v2:172.21.15.153:3300/0 conn(0x7f7fc40b3d30 0x7f7fc40d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:43.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fc3400640 1 -- 172.21.15.122:0/3914446317 >> v1:172.21.15.153:6789/0 conn(0x7f7fc415cc10 legacy=0x7f7fc40d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:43.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fc3400640 1 -- 172.21.15.122:0/3914446317 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc406bf30 con 0x7f7fc415d7b0 2024-05-28T06:09:43.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fc3400640 1 -- 172.21.15.122:0/3914446317 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f7fb4001680 con 0x7f7fc415d7b0 2024-05-28T06:09:43.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fc3400640 1 -- 172.21.15.122:0/3914446317 >> v1:172.21.15.122:6789/0 conn(0x7f7fc415d7b0 legacy=0x7f7fc40b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:43.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fc3400640 1 --2- 172.21.15.122:0/3914446317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fa80039c0 0x7f7fa8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:43.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fc3400640 1 --2- 172.21.15.122:0/3914446317 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa8004810 0x7f7fa8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:43.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fc3400640 1 --2- 172.21.15.122:0/3914446317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fa80051d0 0x7f7fa800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:43.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fc3400640 1 -- 172.21.15.122:0/3914446317 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc406bc50 con 0x7f7fa80039c0 2024-05-28T06:09:43.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fc3400640 1 -- 172.21.15.122:0/3914446317 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa800c070 con 0x7f7fa80051d0 2024-05-28T06:09:43.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.328+0000 7f7fc3400640 1 -- 172.21.15.122:0/3914446317 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7fa800c270 con 0x7f7fa8004810 2024-05-28T06:09:43.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.332+0000 7f7fc3e00640 1 --2- 172.21.15.122:0/3914446317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fa80039c0 0x7f7fa8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:43.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.332+0000 7f7fbb400640 1 --2- 172.21.15.122:0/3914446317 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa8004810 0x7f7fa8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:43.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.332+0000 7f7fc9000640 1 --2- 172.21.15.122:0/3914446317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fa80051d0 0x7f7fa800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:43.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.332+0000 7f7fc3e00640 1 -- 172.21.15.122:0/3914446317 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa8004810 msgr2=0x7f7fa8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:43.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.332+0000 7f7fc3e00640 1 --2- 172.21.15.122:0/3914446317 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa8004810 0x7f7fa8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:43.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.332+0000 7f7fc3e00640 1 -- 172.21.15.122:0/3914446317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fa80051d0 msgr2=0x7f7fa800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:43.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.332+0000 7f7fc3e00640 1 --2- 172.21.15.122:0/3914446317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fa80051d0 0x7f7fa800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:43.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.332+0000 7f7fc3e00640 1 -- 172.21.15.122:0/3914446317 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa8003530 con 0x7f7fa80039c0 2024-05-28T06:09:43.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.332+0000 7f7fc9000640 1 --2- 172.21.15.122:0/3914446317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fa80051d0 0x7f7fa800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:09:43.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.332+0000 7f7fc9000640 1 -- 172.21.15.122:0/3914446317 reap_dead start 2024-05-28T06:09:43.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.332+0000 7f7fc3e00640 1 --2- 172.21.15.122:0/3914446317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fa80039c0 0x7f7fa8003de0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f7fb400c210 tx=0x7f7fb401cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98f0686f3b25743 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:43.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.332+0000 7f7fc3400640 1 -- 172.21.15.122:0/3914446317 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4007d40 con 0x7f7fa80039c0 2024-05-28T06:09:43.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.332+0000 7f7fc3400640 1 -- 172.21.15.122:0/3914446317 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb40a9070 con 0x7f7fa80039c0 2024-05-28T06:09:43.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.332+0000 7f7fc3400640 1 -- 172.21.15.122:0/3914446317 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb40a5df0 con 0x7f7fa80039c0 2024-05-28T06:09:43.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.332+0000 7f7fcb000640 1 -- 172.21.15.122:0/3914446317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fa80039c0 msgr2=0x7f7fa8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:43.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.332+0000 7f7fcb000640 1 --2- 172.21.15.122:0/3914446317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fa80039c0 0x7f7fa8003de0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f7fb400c210 tx=0x7f7fb401cc70 comp rx=0 tx=0).stop 2024-05-28T06:09:43.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fcb000640 1 -- 172.21.15.122:0/3914446317 shutdown_connections 2024-05-28T06:09:43.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fcb000640 1 --2- 172.21.15.122:0/3914446317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fa80039c0 0x7f7fa8003de0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:43.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fcb000640 1 -- 172.21.15.122:0/3914446317 >> 172.21.15.122:0/3914446317 conn(0x7f7fc40b6c10 msgr2=0x7f7fc40b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:43.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fcb000640 1 -- 172.21.15.122:0/3914446317 shutdown_connections 2024-05-28T06:09:43.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fcb000640 1 -- 172.21.15.122:0/3914446317 wait complete. 2024-05-28T06:09:43.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fcb000640 1 Processor -- start 2024-05-28T06:09:43.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fcb000640 1 -- start start 2024-05-28T06:09:43.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fcb000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fa80039c0 0x7f7fc4152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:43.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fcb000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fc41eca30 0x7f7fc415f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:43.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fcb000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fc41eceb0 0x7f7fc415f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:43.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fcb000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc40d1000 con 0x7f7fa80039c0 2024-05-28T06:09:43.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fcb000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc40d0e80 con 0x7f7fc41eceb0 2024-05-28T06:09:43.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fcb000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc40d1180 con 0x7f7fc41eca30 2024-05-28T06:09:43.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fc3e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fa80039c0 0x7f7fc4152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:43.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fc3e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fa80039c0 0x7f7fc4152bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48746/0 (socket says 172.21.15.122:48746) 2024-05-28T06:09:43.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fc3e00640 1 -- 172.21.15.122:0/3327579351 learned_addr learned my addr 172.21.15.122:0/3327579351 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:43.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fbb400640 1 --2- 172.21.15.122:0/3327579351 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fc41eca30 0x7f7fc415f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:43.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fc9000640 1 --2- 172.21.15.122:0/3327579351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fc41eceb0 0x7f7fc415f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:43.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fc3e00640 1 -- 172.21.15.122:0/3327579351 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fc41eca30 msgr2=0x7f7fc415f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:43.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fc3e00640 1 --2- 172.21.15.122:0/3327579351 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fc41eca30 0x7f7fc415f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:43.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fc3e00640 1 -- 172.21.15.122:0/3327579351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fc41eceb0 msgr2=0x7f7fc415f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:43.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fc3e00640 1 --2- 172.21.15.122:0/3327579351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fc41eceb0 0x7f7fc415f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:43.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fc3e00640 1 -- 172.21.15.122:0/3327579351 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc41ebce0 con 0x7f7fa80039c0 2024-05-28T06:09:43.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fbb400640 1 --2- 172.21.15.122:0/3327579351 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fc41eca30 0x7f7fc415f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:09:43.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fc3e00640 1 --2- 172.21.15.122:0/3327579351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fa80039c0 0x7f7fc4152bd0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7fb401caa0 tx=0x7f7fa8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:43.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fc0c00640 1 -- 172.21.15.122:0/3327579351 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb40bc070 con 0x7f7fa80039c0 2024-05-28T06:09:43.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.336+0000 7f7fc0c00640 1 -- 172.21.15.122:0/3327579351 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb4000ee0 con 0x7f7fa80039c0 2024-05-28T06:09:43.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.340+0000 7f7fc0c00640 1 -- 172.21.15.122:0/3327579351 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4007d40 con 0x7f7fa80039c0 2024-05-28T06:09:43.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.340+0000 7f7fcb000640 1 -- 172.21.15.122:0/3327579351 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc41ebf50 con 0x7f7fa80039c0 2024-05-28T06:09:43.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.340+0000 7f7fcb000640 1 -- 172.21.15.122:0/3327579351 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc41ec510 con 0x7f7fa80039c0 2024-05-28T06:09:43.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.340+0000 7f7fcb000640 1 -- 172.21.15.122:0/3327579351 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc4068bd0 con 0x7f7fa80039c0 2024-05-28T06:09:43.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.340+0000 7f7fc0c00640 1 -- 172.21.15.122:0/3327579351 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f7fb4007140 con 0x7f7fa80039c0 2024-05-28T06:09:43.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.340+0000 7f7fc0c00640 1 --2- 172.21.15.122:0/3327579351 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7fa0068680 0x7f7fa006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:43.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.340+0000 7f7fc0c00640 1 -- 172.21.15.122:0/3327579351 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f7fb4120230 con 0x7f7fa80039c0 2024-05-28T06:09:43.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.340+0000 7f7fbb400640 1 --2- 172.21.15.122:0/3327579351 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7fa0068680 0x7f7fa006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:43.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.340+0000 7f7fbb400640 1 --2- 172.21.15.122:0/3327579351 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7fa0068680 0x7f7fa006ab40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7fc40d2020 tx=0x7f7fac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:43.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.344+0000 7f7fc0c00640 1 -- 172.21.15.122:0/3327579351 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7fb40169b0 con 0x7f7fa80039c0 2024-05-28T06:09:43.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.524+0000 7f7fcb000640 1 -- 172.21.15.122:0/3327579351 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f7fc415c8f0 con 0x7f7fa0068680 2024-05-28T06:09:43.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.524+0000 7f7fc0c00640 1 -- 172.21.15.122:0/3327579351 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f7fc415c8f0 con 0x7f7fa0068680 2024-05-28T06:09:43.529 INFO:teuthology.orchestra.run.smithi122.stdout:[ 2024-05-28T06:09:43.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:09:43.529 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "cephfs" 2024-05-28T06:09:43.529 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:09:43.529 INFO:teuthology.orchestra.run.smithi122.stdout:] 2024-05-28T06:09:43.531 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.528+0000 7f7fcb000640 1 -- 172.21.15.122:0/3327579351 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7fa0068680 msgr2=0x7f7fa006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:43.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.528+0000 7f7fcb000640 1 --2- 172.21.15.122:0/3327579351 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7fa0068680 0x7f7fa006ab40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7fc40d2020 tx=0x7f7fac008040 comp rx=0 tx=0).stop 2024-05-28T06:09:43.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.528+0000 7f7fcb000640 1 -- 172.21.15.122:0/3327579351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fa80039c0 msgr2=0x7f7fc4152bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:43.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.528+0000 7f7fcb000640 1 --2- 172.21.15.122:0/3327579351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fa80039c0 0x7f7fc4152bd0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7fb401caa0 tx=0x7f7fa8005840 comp rx=0 tx=0).stop 2024-05-28T06:09:43.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.528+0000 7f7fcb000640 1 -- 172.21.15.122:0/3327579351 shutdown_connections 2024-05-28T06:09:43.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.528+0000 7f7fcb000640 1 --2- 172.21.15.122:0/3327579351 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7fa0068680 0x7f7fa006ab40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:43.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.528+0000 7f7fcb000640 1 --2- 172.21.15.122:0/3327579351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fc41eceb0 0x7f7fc415f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:43.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.528+0000 7f7fcb000640 1 --2- 172.21.15.122:0/3327579351 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fc41eca30 0x7f7fc415f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:43.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.528+0000 7f7fcb000640 1 --2- 172.21.15.122:0/3327579351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fa80039c0 0x7f7fc4152bd0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:43.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.528+0000 7f7fcb000640 1 -- 172.21.15.122:0/3327579351 >> 172.21.15.122:0/3327579351 conn(0x7f7fc40b6c10 msgr2=0x7f7fc40b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:43.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.528+0000 7f7fcb000640 1 -- 172.21.15.122:0/3327579351 shutdown_connections 2024-05-28T06:09:43.533 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.528+0000 7f7fcb000640 1 -- 172.21.15.122:0/3327579351 wait complete. 2024-05-28T06:09:43.551 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-28T06:09:43.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.688+0000 7fe1df400640 1 Processor -- start 2024-05-28T06:09:43.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.688+0000 7fe1df400640 1 -- start start 2024-05-28T06:09:43.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.688+0000 7fe1df400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe1d8158aa0 0x7fe1d8158e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:43.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.688+0000 7fe1df400640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d815f620 con 0x7fe1d815edd0 2024-05-28T06:09:43.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.688+0000 7fe1df400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d815f900 con 0x7fe1d806e070 2024-05-28T06:09:43.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.688+0000 7fe1df400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fe1d815fbe0 con 0x7fe1d8158aa0 2024-05-28T06:09:43.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.688+0000 7fe1dca00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe1d8158aa0 0x7fe1d8158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:43.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.688+0000 7fe1dca00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe1d8158aa0 0x7fe1d8158e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48750/0 (socket says 172.21.15.122:48750) 2024-05-28T06:09:43.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.688+0000 7fe1dca00640 1 -- 172.21.15.122:0/3603971077 learned_addr learned my addr 172.21.15.122:0/3603971077 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:43.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.692+0000 7fe1dca00640 1 -- 172.21.15.122:0/3603971077 >> v1:172.21.15.153:6789/0 conn(0x7fe1d806e070 legacy=0x7fe1d80b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:43.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.692+0000 7fe1dca00640 1 -- 172.21.15.122:0/3603971077 >> v1:172.21.15.122:6789/0 conn(0x7fe1d815edd0 legacy=0x7fe1d8162af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:43.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.692+0000 7fe1dca00640 1 -- 172.21.15.122:0/3603971077 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d81625d0 con 0x7fe1d8158aa0 2024-05-28T06:09:43.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.692+0000 7fe1dca00640 1 --2- 172.21.15.122:0/3603971077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1d8158aa0 0x7fe1d8158e80 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009870 tx=0x7fe1cc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374f81edac79983 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:43.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.692+0000 7fe1d7400640 1 -- 172.21.15.122:0/3603971077 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0b2070 con 0x7fe1d8158aa0 2024-05-28T06:09:43.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.692+0000 7fe1d7400640 1 -- 172.21.15.122:0/3603971077 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1cc0a9070 con 0x7fe1d8158aa0 2024-05-28T06:09:43.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.692+0000 7fe1d7400640 1 -- 172.21.15.122:0/3603971077 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0ad880 con 0x7fe1d8158aa0 2024-05-28T06:09:43.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.692+0000 7fe1df400640 1 -- 172.21.15.122:0/3603971077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1d8158aa0 msgr2=0x7fe1d8158e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:43.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.692+0000 7fe1df400640 1 --2- 172.21.15.122:0/3603971077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1d8158aa0 0x7fe1d8158e80 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009870 tx=0x7fe1cc01c560 comp rx=0 tx=0).stop 2024-05-28T06:09:43.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.692+0000 7fe1df400640 1 -- 172.21.15.122:0/3603971077 shutdown_connections 2024-05-28T06:09:43.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.692+0000 7fe1df400640 1 --2- 172.21.15.122:0/3603971077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1d8158aa0 0x7fe1d8158e80 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:43.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.692+0000 7fe1df400640 1 -- 172.21.15.122:0/3603971077 >> 172.21.15.122:0/3603971077 conn(0x7fe1d80700f0 msgr2=0x7fe1d806b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:43.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.692+0000 7fe1df400640 1 -- 172.21.15.122:0/3603971077 shutdown_connections 2024-05-28T06:09:43.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.692+0000 7fe1df400640 1 -- 172.21.15.122:0/3603971077 wait complete. 2024-05-28T06:09:43.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.696+0000 7fe1df400640 1 Processor -- start 2024-05-28T06:09:43.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.696+0000 7fe1df400640 1 -- start start 2024-05-28T06:09:43.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.696+0000 7fe1df400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1d806e070 0x7fe1d8158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:43.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.696+0000 7fe1df400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d8158aa0 0x7fe1d80afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:43.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.696+0000 7fe1df400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1d815edd0 0x7fe1d80cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:43.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.696+0000 7fe1df400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d816d100 con 0x7fe1d815edd0 2024-05-28T06:09:43.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.696+0000 7fe1df400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d816cf80 con 0x7fe1d8158aa0 2024-05-28T06:09:43.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.696+0000 7fe1df400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d816d280 con 0x7fe1d806e070 2024-05-28T06:09:43.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.696+0000 7fe1dd400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1d815edd0 0x7fe1d80cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:43.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.696+0000 7fe1dd400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1d815edd0 0x7fe1d80cf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48766/0 (socket says 172.21.15.122:48766) 2024-05-28T06:09:43.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.696+0000 7fe1dd400640 1 -- 172.21.15.122:0/3856332199 learned_addr learned my addr 172.21.15.122:0/3856332199 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:43.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.696+0000 7fe1dca00640 1 --2- 172.21.15.122:0/3856332199 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1d806e070 0x7fe1d8158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:43.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.696+0000 7fe1dd400640 1 -- 172.21.15.122:0/3856332199 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1d806e070 msgr2=0x7fe1d8158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:43.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.696+0000 7fe1dd400640 1 --2- 172.21.15.122:0/3856332199 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1d806e070 0x7fe1d8158180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:43.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.696+0000 7fe1dd400640 1 -- 172.21.15.122:0/3856332199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d8158aa0 msgr2=0x7fe1d80afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:43.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.696+0000 7fe1d7e00640 1 --2- 172.21.15.122:0/3856332199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d8158aa0 0x7fe1d80afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:43.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.696+0000 7fe1dd400640 1 --2- 172.21.15.122:0/3856332199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d8158aa0 0x7fe1d80afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:43.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.696+0000 7fe1dd400640 1 -- 172.21.15.122:0/3856332199 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d80cfe00 con 0x7fe1d815edd0 2024-05-28T06:09:43.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.696+0000 7fe1dca00640 1 --2- 172.21.15.122:0/3856332199 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1d806e070 0x7fe1d8158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:09:43.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.696+0000 7fe1d7e00640 1 --2- 172.21.15.122:0/3856332199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d8158aa0 0x7fe1d80afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:09:43.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.696+0000 7fe1dd400640 1 --2- 172.21.15.122:0/3856332199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1d815edd0 0x7fe1d80cf8c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000c7a0 tx=0x7fe1d000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:43.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.696+0000 7fe1d4c00640 1 -- 172.21.15.122:0/3856332199 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0003b80 con 0x7fe1d815edd0 2024-05-28T06:09:43.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.700+0000 7fe1d4c00640 1 -- 172.21.15.122:0/3856332199 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1d0003d20 con 0x7fe1d815edd0 2024-05-28T06:09:43.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.700+0000 7fe1d4c00640 1 -- 172.21.15.122:0/3856332199 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d000aa90 con 0x7fe1d815edd0 2024-05-28T06:09:43.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.700+0000 7fe1df400640 1 -- 172.21.15.122:0/3856332199 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d80aee40 con 0x7fe1d815edd0 2024-05-28T06:09:43.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.700+0000 7fe1df400640 1 -- 172.21.15.122:0/3856332199 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d80af400 con 0x7fe1d815edd0 2024-05-28T06:09:43.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.700+0000 7fe1df400640 1 -- 172.21.15.122:0/3856332199 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1d8068c40 con 0x7fe1d815edd0 2024-05-28T06:09:43.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.700+0000 7fe1d4c00640 1 -- 172.21.15.122:0/3856332199 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7fe1d000ac30 con 0x7fe1d815edd0 2024-05-28T06:09:43.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.700+0000 7fe1d4c00640 1 --2- 172.21.15.122:0/3856332199 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe1b8068680 0x7fe1b806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:43.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.700+0000 7fe1d4c00640 1 -- 172.21.15.122:0/3856332199 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7fe1d0086cc0 con 0x7fe1d815edd0 2024-05-28T06:09:43.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.700+0000 7fe1dca00640 1 --2- 172.21.15.122:0/3856332199 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe1b8068680 0x7fe1b806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:43.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.700+0000 7fe1dca00640 1 --2- 172.21.15.122:0/3856332199 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe1b8068680 0x7fe1b806ab40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0af000 tx=0x7fe1cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:43.708 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.704+0000 7fe1d4c00640 1 -- 172.21.15.122:0/3856332199 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe1d008d080 con 0x7fe1d815edd0 2024-05-28T06:09:43.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.864+0000 7fe1df400640 1 -- 172.21.15.122:0/3856332199 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fe1d8139d20 con 0x7fe1d815edd0 2024-05-28T06:09:43.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.864+0000 7fe1d4c00640 1 -- 172.21.15.122:0/3856332199 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7fe1d0056f80 con 0x7fe1d815edd0 2024-05-28T06:09:43.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.864+0000 7fe1df400640 1 -- 172.21.15.122:0/3856332199 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe1b8068680 msgr2=0x7fe1b806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:43.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.864+0000 7fe1df400640 1 --2- 172.21.15.122:0/3856332199 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe1b8068680 0x7fe1b806ab40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0af000 tx=0x7fe1cc008040 comp rx=0 tx=0).stop 2024-05-28T06:09:43.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.864+0000 7fe1df400640 1 -- 172.21.15.122:0/3856332199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1d815edd0 msgr2=0x7fe1d80cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:43.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.864+0000 7fe1df400640 1 --2- 172.21.15.122:0/3856332199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1d815edd0 0x7fe1d80cf8c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000c7a0 tx=0x7fe1d000cc60 comp rx=0 tx=0).stop 2024-05-28T06:09:43.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.864+0000 7fe1df400640 1 -- 172.21.15.122:0/3856332199 shutdown_connections 2024-05-28T06:09:43.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.864+0000 7fe1df400640 1 --2- 172.21.15.122:0/3856332199 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe1b8068680 0x7fe1b806ab40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:43.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.864+0000 7fe1df400640 1 --2- 172.21.15.122:0/3856332199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1d815edd0 0x7fe1d80cf8c0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:43.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.864+0000 7fe1df400640 1 --2- 172.21.15.122:0/3856332199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d8158aa0 0x7fe1d80afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:43.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.864+0000 7fe1df400640 1 --2- 172.21.15.122:0/3856332199 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1d806e070 0x7fe1d8158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:43.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.864+0000 7fe1df400640 1 -- 172.21.15.122:0/3856332199 >> 172.21.15.122:0/3856332199 conn(0x7fe1d80700f0 msgr2=0x7fe1d8074d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:43.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.864+0000 7fe1df400640 1 -- 172.21.15.122:0/3856332199 shutdown_connections 2024-05-28T06:09:43.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:43.864+0000 7fe1df400640 1 -- 172.21.15.122:0/3856332199 wait complete. 2024-05-28T06:09:43.888 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-28T06:09:44.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.024+0000 7fceb3e00640 1 Processor -- start 2024-05-28T06:09:44.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.024+0000 7fceb3e00640 1 -- start start 2024-05-28T06:09:44.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.028+0000 7fceb3e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fceb4144cc0 0x7fceb40b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:44.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.028+0000 7fceb3e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fceb40cd7e0 0x7fceb406f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:44.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.028+0000 7fceb3e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fceb40b4f30 con 0x7fceb406ef40 2024-05-28T06:09:44.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.028+0000 7fceb3e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fceb406f8e0 con 0x7fceb40cd7e0 2024-05-28T06:09:44.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.028+0000 7fceb3e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fceb40cdd20 con 0x7fceb4144cc0 2024-05-28T06:09:44.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.028+0000 7fceb3400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fceb40cd7e0 0x7fceb406f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:44.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.028+0000 7fceb3400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fceb40cd7e0 0x7fceb406f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48772/0 (socket says 172.21.15.122:48772) 2024-05-28T06:09:44.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.028+0000 7fceb3400640 1 -- 172.21.15.122:0/2228589874 learned_addr learned my addr 172.21.15.122:0/2228589874 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:44.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.028+0000 7fceb2000640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fceb406ef40 0x7fceb40cd0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:49018/0 (socket says 172.21.15.122:49018) 2024-05-28T06:09:44.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.028+0000 7fceb2a00640 1 --2- 172.21.15.122:0/2228589874 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fceb4144cc0 0x7fceb40b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:44.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.028+0000 7fceb3400640 1 -- 172.21.15.122:0/2228589874 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fceb4144cc0 msgr2=0x7fceb40b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:44.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.028+0000 7fceb3400640 1 --2- 172.21.15.122:0/2228589874 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fceb4144cc0 0x7fceb40b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:44.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.028+0000 7fceb3400640 1 -- 172.21.15.122:0/2228589874 >> v1:172.21.15.122:6789/0 conn(0x7fceb406ef40 legacy=0x7fceb40cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:44.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.028+0000 7fceb3400640 1 -- 172.21.15.122:0/2228589874 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceb40b3c30 con 0x7fceb40cd7e0 2024-05-28T06:09:44.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.032+0000 7fceb3400640 1 --2- 172.21.15.122:0/2228589874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceb40cd7e0 0x7fceb406f3a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fceac009e50 tx=0x7fceac01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1066ff6173d8fa server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:44.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.032+0000 7fceb1600640 1 -- 172.21.15.122:0/2228589874 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac0a5770 con 0x7fceb40cd7e0 2024-05-28T06:09:44.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.032+0000 7fceb1600640 1 -- 172.21.15.122:0/2228589874 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceac0a5910 con 0x7fceb40cd7e0 2024-05-28T06:09:44.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.032+0000 7fceb1600640 1 -- 172.21.15.122:0/2228589874 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac0a5ce0 con 0x7fceb40cd7e0 2024-05-28T06:09:44.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.032+0000 7fceb3e00640 1 -- 172.21.15.122:0/2228589874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceb40cd7e0 msgr2=0x7fceb406f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:44.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.032+0000 7fceb3e00640 1 --2- 172.21.15.122:0/2228589874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceb40cd7e0 0x7fceb406f3a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fceac009e50 tx=0x7fceac01c9a0 comp rx=0 tx=0).stop 2024-05-28T06:09:44.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.032+0000 7fceb3e00640 1 -- 172.21.15.122:0/2228589874 shutdown_connections 2024-05-28T06:09:44.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.032+0000 7fceb3e00640 1 --2- 172.21.15.122:0/2228589874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceb40cd7e0 0x7fceb406f3a0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:44.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.032+0000 7fceb3e00640 1 --2- 172.21.15.122:0/2228589874 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fceb4144cc0 0x7fceb40b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:44.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.032+0000 7fceb3e00640 1 -- 172.21.15.122:0/2228589874 >> 172.21.15.122:0/2228589874 conn(0x7fceb40b2170 msgr2=0x7fceb40b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:44.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.032+0000 7fceb3e00640 1 -- 172.21.15.122:0/2228589874 shutdown_connections 2024-05-28T06:09:44.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.032+0000 7fceb3e00640 1 -- 172.21.15.122:0/2228589874 wait complete. 2024-05-28T06:09:44.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.032+0000 7fceb3e00640 1 Processor -- start 2024-05-28T06:09:44.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.032+0000 7fceb3e00640 1 -- start start 2024-05-28T06:09:44.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceb3e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fceb406ef40 0x7fceb413a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:44.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceb3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fceb40cd7e0 0x7fceb4143b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:44.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceb3e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceb4144cc0 0x7fceb413c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:44.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceb3e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fceb415c460 con 0x7fceb4144cc0 2024-05-28T06:09:44.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceb3e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fceb415c2e0 con 0x7fceb40cd7e0 2024-05-28T06:09:44.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceb3e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fceb415c5e0 con 0x7fceb406ef40 2024-05-28T06:09:44.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceb3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceb4144cc0 0x7fceb413c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:44.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceb3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceb4144cc0 0x7fceb413c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48780/0 (socket says 172.21.15.122:48780) 2024-05-28T06:09:44.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceb3400640 1 -- 172.21.15.122:0/586580562 learned_addr learned my addr 172.21.15.122:0/586580562 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:44.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceb2a00640 1 --2- 172.21.15.122:0/586580562 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fceb406ef40 0x7fceb413a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:44.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceb2000640 1 --2- 172.21.15.122:0/586580562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fceb40cd7e0 0x7fceb4143b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:44.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceb3400640 1 -- 172.21.15.122:0/586580562 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fceb406ef40 msgr2=0x7fceb413a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:44.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceb3400640 1 --2- 172.21.15.122:0/586580562 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fceb406ef40 0x7fceb413a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:44.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceb3400640 1 -- 172.21.15.122:0/586580562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fceb40cd7e0 msgr2=0x7fceb4143b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:44.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceb3400640 1 --2- 172.21.15.122:0/586580562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fceb40cd7e0 0x7fceb4143b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:44.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceb3400640 1 -- 172.21.15.122:0/586580562 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceb413ad70 con 0x7fceb4144cc0 2024-05-28T06:09:44.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceb3400640 1 --2- 172.21.15.122:0/586580562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceb4144cc0 0x7fceb413c450 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fceac0af040 tx=0x7fceac019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:44.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceaaa00640 1 -- 172.21.15.122:0/586580562 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac0bc020 con 0x7fceb4144cc0 2024-05-28T06:09:44.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceaaa00640 1 -- 172.21.15.122:0/586580562 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceac0b8670 con 0x7fceb4144cc0 2024-05-28T06:09:44.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceaaa00640 1 -- 172.21.15.122:0/586580562 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac0b8a60 con 0x7fceb4144cc0 2024-05-28T06:09:44.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceb3e00640 1 -- 172.21.15.122:0/586580562 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceb413b050 con 0x7fceb4144cc0 2024-05-28T06:09:44.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceb3e00640 1 -- 172.21.15.122:0/586580562 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceb413b610 con 0x7fceb4144cc0 2024-05-28T06:09:44.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceb3e00640 1 -- 172.21.15.122:0/586580562 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceb4075620 con 0x7fceb4144cc0 2024-05-28T06:09:44.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.036+0000 7fceaaa00640 1 -- 172.21.15.122:0/586580562 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7fceac0bf020 con 0x7fceb4144cc0 2024-05-28T06:09:44.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.040+0000 7fceaaa00640 1 --2- 172.21.15.122:0/586580562 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fce94068650 0x7fce9406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:44.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.040+0000 7fceaaa00640 1 -- 172.21.15.122:0/586580562 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7fceac121d70 con 0x7fceb4144cc0 2024-05-28T06:09:44.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.040+0000 7fceb2a00640 1 --2- 172.21.15.122:0/586580562 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fce94068650 0x7fce9406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:44.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.040+0000 7fceb2a00640 1 --2- 172.21.15.122:0/586580562 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fce94068650 0x7fce9406ab10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcea400b930 tx=0x7fcea4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:44.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.044+0000 7fceaaa00640 1 -- 172.21.15.122:0/586580562 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fceac0c6030 con 0x7fceb4144cc0 2024-05-28T06:09:44.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.228+0000 7fceb3e00640 1 -- 172.21.15.122:0/586580562 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7fceb415db90 con 0x7fce94068650 2024-05-28T06:09:44.238 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:09:44.236+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:09:44.238 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:09:44.236+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:09:44.238 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:09:44.236+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:09:44.239 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:09:44.236+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:09:44.239 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:09:44.236+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:09:44.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.268+0000 7fceaaa00640 1 -- 172.21.15.122:0/586580562 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fceb415db90 con 0x7fce94068650 2024-05-28T06:09:44.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.272+0000 7fceb3e00640 1 -- 172.21.15.122:0/586580562 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fce94068650 msgr2=0x7fce9406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:44.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.272+0000 7fceb3e00640 1 --2- 172.21.15.122:0/586580562 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fce94068650 0x7fce9406ab10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcea400b930 tx=0x7fcea4008040 comp rx=0 tx=0).stop 2024-05-28T06:09:44.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.272+0000 7fceb3e00640 1 -- 172.21.15.122:0/586580562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceb4144cc0 msgr2=0x7fceb413c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:44.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.272+0000 7fceb3e00640 1 --2- 172.21.15.122:0/586580562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceb4144cc0 0x7fceb413c450 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fceac0af040 tx=0x7fceac019740 comp rx=0 tx=0).stop 2024-05-28T06:09:44.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.272+0000 7fceb3e00640 1 -- 172.21.15.122:0/586580562 shutdown_connections 2024-05-28T06:09:44.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.272+0000 7fceb3e00640 1 --2- 172.21.15.122:0/586580562 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fce94068650 0x7fce9406ab10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:44.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.272+0000 7fceb3e00640 1 --2- 172.21.15.122:0/586580562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceb4144cc0 0x7fceb413c450 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:44.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.272+0000 7fceb3e00640 1 --2- 172.21.15.122:0/586580562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fceb40cd7e0 0x7fceb4143b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:44.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.272+0000 7fceb3e00640 1 --2- 172.21.15.122:0/586580562 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fceb406ef40 0x7fceb413a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:44.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.272+0000 7fceb3e00640 1 -- 172.21.15.122:0/586580562 >> 172.21.15.122:0/586580562 conn(0x7fceb40b2170 msgr2=0x7fceb40cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:44.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.272+0000 7fceb3e00640 1 -- 172.21.15.122:0/586580562 shutdown_connections 2024-05-28T06:09:44.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.272+0000 7fceb3e00640 1 -- 172.21.15.122:0/586580562 wait complete. 2024-05-28T06:09:44.293 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-28T06:09:44.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.428+0000 7f34fbe00640 1 Processor -- start 2024-05-28T06:09:44.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.428+0000 7f34fbe00640 1 -- start start 2024-05-28T06:09:44.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.432+0000 7f34fbe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f34fc15c890 0x7f34fc0d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:44.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.432+0000 7f34fbe00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f34fc0b3630 0x7f34fc0d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:44.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.432+0000 7f34fbe00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34fc0b1e90 con 0x7f34fc0d05a0 2024-05-28T06:09:44.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.432+0000 7f34fbe00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f34fc0cddb0 con 0x7f34fc0b3630 2024-05-28T06:09:44.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.432+0000 7f34fbe00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f34fc0ce090 con 0x7f34fc15c890 2024-05-28T06:09:44.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.432+0000 7f34fb400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f34fc0b3630 0x7f34fc0d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:44.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.432+0000 7f34fa000640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f34fc0d05a0 0x7f34fc09aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:49026/0 (socket says 172.21.15.122:49026) 2024-05-28T06:09:44.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.432+0000 7f34fa000640 1 -- 172.21.15.122:0/2049412279 learned_addr learned my addr 172.21.15.122:0/2049412279 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:09:44.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.432+0000 7f34faa00640 1 --2- 172.21.15.122:0/2049412279 >> v2:172.21.15.153:3300/0 conn(0x7f34fc15c890 0x7f34fc0d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:44.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.432+0000 7f34fb400640 1 -- 172.21.15.122:0/2049412279 >> v2:172.21.15.153:3300/0 conn(0x7f34fc15c890 msgr2=0x7f34fc0d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:09:44.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.432+0000 7f34fb400640 1 --2- 172.21.15.122:0/2049412279 >> v2:172.21.15.153:3300/0 conn(0x7f34fc15c890 0x7f34fc0d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:44.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.432+0000 7f34fb400640 1 -- 172.21.15.122:0/2049412279 >> v1:172.21.15.122:6789/0 conn(0x7f34fc0d05a0 legacy=0x7f34fc09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:44.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.432+0000 7f34f9600640 1 -- 172.21.15.122:0/2049412279 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 983284403 0 0) 0x7f34fc0b1e90 con 0x7f34fc0d05a0 2024-05-28T06:09:44.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.432+0000 7f34fb400640 1 -- 172.21.15.122:0/2049412279 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34fc0b2100 con 0x7f34fc0b3630 2024-05-28T06:09:44.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.432+0000 7f34faa00640 1 --2- 172.21.15.122:0/2049412279 >> v2:172.21.15.153:3300/0 conn(0x7f34fc15c890 0x7f34fc0d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:09:44.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.432+0000 7f34fb400640 1 --2- 172.21.15.122:0/2049412279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34fc0b3630 0x7f34fc0d0a50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f34fc073260 tx=0x7f34f401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7270193c717a7c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:44.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.432+0000 7f34f9600640 1 -- 172.21.15.122:0/2049412279 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f40b2070 con 0x7f34fc0b3630 2024-05-28T06:09:44.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.436+0000 7f34f9600640 1 -- 172.21.15.122:0/2049412279 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34f40a5950 con 0x7f34fc0b3630 2024-05-28T06:09:44.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.436+0000 7f34f9600640 1 -- 172.21.15.122:0/2049412279 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f40a5d20 con 0x7f34fc0b3630 2024-05-28T06:09:44.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.436+0000 7f34fbe00640 1 -- 172.21.15.122:0/2049412279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34fc0b3630 msgr2=0x7f34fc0d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:44.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.436+0000 7f34fbe00640 1 --2- 172.21.15.122:0/2049412279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34fc0b3630 0x7f34fc0d0a50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f34fc073260 tx=0x7f34f401c930 comp rx=0 tx=0).stop 2024-05-28T06:09:44.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.436+0000 7f34fbe00640 1 -- 172.21.15.122:0/2049412279 shutdown_connections 2024-05-28T06:09:44.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.436+0000 7f34fbe00640 1 --2- 172.21.15.122:0/2049412279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34fc0b3630 0x7f34fc0d0a50 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:44.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.436+0000 7f34fbe00640 1 --2- 172.21.15.122:0/2049412279 >> v2:172.21.15.153:3300/0 conn(0x7f34fc15c890 0x7f34fc0d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:44.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.436+0000 7f34fbe00640 1 -- 172.21.15.122:0/2049412279 >> 172.21.15.122:0/2049412279 conn(0x7f34fc0b3f80 msgr2=0x7f34fc0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:44.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.436+0000 7f34fbe00640 1 -- 172.21.15.122:0/2049412279 shutdown_connections 2024-05-28T06:09:44.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.436+0000 7f34fbe00640 1 -- 172.21.15.122:0/2049412279 wait complete. 2024-05-28T06:09:44.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.436+0000 7f34fbe00640 1 Processor -- start 2024-05-28T06:09:44.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.436+0000 7f34fbe00640 1 -- start start 2024-05-28T06:09:44.442 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.436+0000 7f34fbe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34fc0b3630 0x7f34fc0c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:44.442 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.436+0000 7f34fbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34fc0d05a0 0x7f34fc155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:44.442 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.436+0000 7f34fbe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f34fc15c890 0x7f34fc06ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:44.442 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.436+0000 7f34fbe00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f34fc09bcf0 con 0x7f34fc0d05a0 2024-05-28T06:09:44.442 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.436+0000 7f34fbe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f34fc09bb70 con 0x7f34fc0b3630 2024-05-28T06:09:44.442 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.436+0000 7f34fbe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f34fc1692c0 con 0x7f34fc15c890 2024-05-28T06:09:44.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.436+0000 7f34fa000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34fc0d05a0 0x7f34fc155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:44.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.436+0000 7f34fa000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34fc0d05a0 0x7f34fc155ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48822/0 (socket says 172.21.15.122:48822) 2024-05-28T06:09:44.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.436+0000 7f34fa000640 1 -- 172.21.15.122:0/2399676326 learned_addr learned my addr 172.21.15.122:0/2399676326 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:09:44.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.436+0000 7f34faa00640 1 --2- 172.21.15.122:0/2399676326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34fc0b3630 0x7f34fc0c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:44.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.436+0000 7f34fb400640 1 --2- 172.21.15.122:0/2399676326 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f34fc15c890 0x7f34fc06ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:44.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.440+0000 7f34fa000640 1 -- 172.21.15.122:0/2399676326 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f34fc15c890 msgr2=0x7f34fc06ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:44.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.440+0000 7f34fa000640 1 --2- 172.21.15.122:0/2399676326 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f34fc15c890 0x7f34fc06ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:44.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.440+0000 7f34fa000640 1 -- 172.21.15.122:0/2399676326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34fc0b3630 msgr2=0x7f34fc0c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:44.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.440+0000 7f34fa000640 1 --2- 172.21.15.122:0/2399676326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34fc0b3630 0x7f34fc0c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:44.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.440+0000 7f34fa000640 1 -- 172.21.15.122:0/2399676326 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34fc0b3b80 con 0x7f34fc0d05a0 2024-05-28T06:09:44.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.440+0000 7f34fa000640 1 --2- 172.21.15.122:0/2399676326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34fc0d05a0 0x7f34fc155ae0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f34e80011f0 tx=0x7f34e800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:44.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.440+0000 7f34f2a00640 1 -- 172.21.15.122:0/2399676326 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e8018070 con 0x7f34fc0d05a0 2024-05-28T06:09:44.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.440+0000 7f34f2a00640 1 -- 172.21.15.122:0/2399676326 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34e80074e0 con 0x7f34fc0d05a0 2024-05-28T06:09:44.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.440+0000 7f34f2a00640 1 -- 172.21.15.122:0/2399676326 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e8004a10 con 0x7f34fc0d05a0 2024-05-28T06:09:44.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.440+0000 7f34fbe00640 1 -- 172.21.15.122:0/2399676326 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34fc0c75a0 con 0x7f34fc0d05a0 2024-05-28T06:09:44.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.440+0000 7f34fbe00640 1 -- 172.21.15.122:0/2399676326 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34fc0ce9d0 con 0x7f34fc0d05a0 2024-05-28T06:09:44.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.440+0000 7f34fbe00640 1 -- 172.21.15.122:0/2399676326 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34fc075620 con 0x7f34fc0d05a0 2024-05-28T06:09:44.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.440+0000 7f34f2a00640 1 -- 172.21.15.122:0/2399676326 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f34e801b070 con 0x7f34fc0d05a0 2024-05-28T06:09:44.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.440+0000 7f34f2a00640 1 --2- 172.21.15.122:0/2399676326 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f34dc068680 0x7f34dc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:09:44.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.440+0000 7f34f2a00640 1 -- 172.21.15.122:0/2399676326 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f34e80860c0 con 0x7f34fc0d05a0 2024-05-28T06:09:44.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.440+0000 7f34faa00640 1 --2- 172.21.15.122:0/2399676326 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f34dc068680 0x7f34dc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:09:44.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.444+0000 7f34faa00640 1 --2- 172.21.15.122:0/2399676326 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f34dc068680 0x7f34dc06ab40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f34ec006fd0 tx=0x7f34ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:09:44.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.448+0000 7f34f2a00640 1 -- 172.21.15.122:0/2399676326 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f34e8056330 con 0x7f34fc0d05a0 2024-05-28T06:09:44.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.628+0000 7f34fbe00640 1 -- 172.21.15.122:0/2399676326 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f34fc0af7f0 con 0x7f34dc068680 2024-05-28T06:09:44.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.636+0000 7f34f2a00640 1 -- 172.21.15.122:0/2399676326 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f34fc0af7f0 con 0x7f34dc068680 2024-05-28T06:09:44.638 INFO:teuthology.orchestra.run.smithi122.stdout:/volumes/_nogroup/sv1/ddba6cb4-beee-4b84-a37a-1205e585a7fc 2024-05-28T06:09:44.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.636+0000 7f34fbe00640 1 -- 172.21.15.122:0/2399676326 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f34dc068680 msgr2=0x7f34dc06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:44.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.636+0000 7f34fbe00640 1 --2- 172.21.15.122:0/2399676326 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f34dc068680 0x7f34dc06ab40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f34ec006fd0 tx=0x7f34ec008040 comp rx=0 tx=0).stop 2024-05-28T06:09:44.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.636+0000 7f34fbe00640 1 -- 172.21.15.122:0/2399676326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34fc0d05a0 msgr2=0x7f34fc155ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:09:44.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.636+0000 7f34fbe00640 1 --2- 172.21.15.122:0/2399676326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34fc0d05a0 0x7f34fc155ae0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f34e80011f0 tx=0x7f34e800c9b0 comp rx=0 tx=0).stop 2024-05-28T06:09:44.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.636+0000 7f34fbe00640 1 -- 172.21.15.122:0/2399676326 shutdown_connections 2024-05-28T06:09:44.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.636+0000 7f34fbe00640 1 --2- 172.21.15.122:0/2399676326 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f34dc068680 0x7f34dc06ab40 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:44.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.636+0000 7f34fbe00640 1 --2- 172.21.15.122:0/2399676326 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f34fc15c890 0x7f34fc06ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:44.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.636+0000 7f34fbe00640 1 --2- 172.21.15.122:0/2399676326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34fc0d05a0 0x7f34fc155ae0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:44.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.636+0000 7f34fbe00640 1 --2- 172.21.15.122:0/2399676326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34fc0b3630 0x7f34fc0c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:09:44.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.636+0000 7f34fbe00640 1 -- 172.21.15.122:0/2399676326 >> 172.21.15.122:0/2399676326 conn(0x7f34fc0b3f80 msgr2=0x7f34fc0b0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:09:44.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.636+0000 7f34fbe00640 1 -- 172.21.15.122:0/2399676326 shutdown_connections 2024-05-28T06:09:44.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:09:44.636+0000 7f34fbe00640 1 -- 172.21.15.122:0/2399676326 wait complete. 2024-05-28T06:09:44.660 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 10 files each 1024MB size under directory volumes/_nogroup/sv1/ddba6cb4-beee-4b84-a37a-1205e585a7fc 2024-05-28T06:09:44.660 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:09:44.660 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:09:44.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:09:44.669 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/ddba6cb4-beee-4b84-a37a-1205e585a7fc/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-28T06:09:47.975 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:09:47.979 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:09:54.418 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records in 2024-05-28T06:09:54.418 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records out 2024-05-28T06:09:54.418 INFO:teuthology.orchestra.run.smithi122.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 9.68599 s, 111 MB/s 2024-05-28T06:09:54.419 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:09:54.419 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:09:54.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:09:54.428 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/ddba6cb4-beee-4b84-a37a-1205e585a7fc/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-28T06:10:04.349 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records in 2024-05-28T06:10:04.349 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records out 2024-05-28T06:10:04.350 INFO:teuthology.orchestra.run.smithi122.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 9.86718 s, 109 MB/s 2024-05-28T06:10:04.351 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:10:04.351 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:10:04.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:10:04.360 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/ddba6cb4-beee-4b84-a37a-1205e585a7fc/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-28T06:10:13.646 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records in 2024-05-28T06:10:13.646 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records out 2024-05-28T06:10:13.646 INFO:teuthology.orchestra.run.smithi122.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 9.23586 s, 116 MB/s 2024-05-28T06:10:13.648 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:10:13.648 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:10:13.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:10:13.658 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/ddba6cb4-beee-4b84-a37a-1205e585a7fc/subvolume_file.3 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-28T06:10:18.037 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:10:18.040 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:10:23.222 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records in 2024-05-28T06:10:23.222 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records out 2024-05-28T06:10:23.222 INFO:teuthology.orchestra.run.smithi122.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 9.51226 s, 113 MB/s 2024-05-28T06:10:23.223 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:10:23.223 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:10:23.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:10:23.232 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/ddba6cb4-beee-4b84-a37a-1205e585a7fc/subvolume_file.4 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-28T06:10:32.411 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records in 2024-05-28T06:10:32.411 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records out 2024-05-28T06:10:32.411 INFO:teuthology.orchestra.run.smithi122.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 9.12971 s, 118 MB/s 2024-05-28T06:10:32.412 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:10:32.413 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:10:32.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:10:32.422 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/ddba6cb4-beee-4b84-a37a-1205e585a7fc/subvolume_file.5 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-28T06:10:41.893 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records in 2024-05-28T06:10:41.893 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records out 2024-05-28T06:10:41.893 INFO:teuthology.orchestra.run.smithi122.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 9.41964 s, 114 MB/s 2024-05-28T06:10:41.895 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:10:41.895 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:10:41.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:10:41.903 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/ddba6cb4-beee-4b84-a37a-1205e585a7fc/subvolume_file.6 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-28T06:10:48.092 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:10:48.103 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:10:50.872 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records in 2024-05-28T06:10:50.872 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records out 2024-05-28T06:10:50.872 INFO:teuthology.orchestra.run.smithi122.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.91208 s, 120 MB/s 2024-05-28T06:10:50.873 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:10:50.874 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:10:50.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:10:50.883 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/ddba6cb4-beee-4b84-a37a-1205e585a7fc/subvolume_file.7 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-28T06:11:00.041 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records in 2024-05-28T06:11:00.042 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records out 2024-05-28T06:11:00.042 INFO:teuthology.orchestra.run.smithi122.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 9.10435 s, 118 MB/s 2024-05-28T06:11:00.043 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:11:00.043 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:11:00.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:11:00.052 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/ddba6cb4-beee-4b84-a37a-1205e585a7fc/subvolume_file.8 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-28T06:11:09.418 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records in 2024-05-28T06:11:09.419 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records out 2024-05-28T06:11:09.419 INFO:teuthology.orchestra.run.smithi122.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 9.31631 s, 115 MB/s 2024-05-28T06:11:09.420 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:11:09.420 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:11:09.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:11:09.429 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/ddba6cb4-beee-4b84-a37a-1205e585a7fc/subvolume_file.9 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-28T06:11:18.159 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:11:18.162 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:11:18.936 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records in 2024-05-28T06:11:18.937 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records out 2024-05-28T06:11:18.937 INFO:teuthology.orchestra.run.smithi122.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 9.45037 s, 114 MB/s 2024-05-28T06:11:18.938 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-28T06:11:19.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.079+0000 7f06efc00640 1 Processor -- start 2024-05-28T06:11:19.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.079+0000 7f06efc00640 1 -- start start 2024-05-28T06:11:19.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.079+0000 7f06efc00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f06e80b58d0 0x7f06e80b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:19.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.079+0000 7f06efc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06e815e730 0x7f06e815ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:19.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.079+0000 7f06efc00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06e80b61f0 con 0x7f06e80ce4f0 2024-05-28T06:11:19.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.079+0000 7f06efc00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f06e815d970 con 0x7f06e80b58d0 2024-05-28T06:11:19.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.079+0000 7f06efc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f06e815dc50 con 0x7f06e815e730 2024-05-28T06:11:19.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.079+0000 7f06ed200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f06e80b58d0 0x7f06e80b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:19.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.079+0000 7f06edc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06e815e730 0x7f06e815ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:19.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.079+0000 7f06ed200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f06e80b58d0 0x7f06e80b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:58798/0 (socket says 172.21.15.122:58798) 2024-05-28T06:11:19.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.079+0000 7f06ed200640 1 -- 172.21.15.122:0/429027796 learned_addr learned my addr 172.21.15.122:0/429027796 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:19.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.083+0000 7f06ed200640 1 -- 172.21.15.122:0/429027796 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06e815e730 msgr2=0x7f06e815ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:11:19.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.083+0000 7f06ed200640 1 --2- 172.21.15.122:0/429027796 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06e815e730 0x7f06e815ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:19.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.083+0000 7f06ed200640 1 -- 172.21.15.122:0/429027796 >> v1:172.21.15.153:6789/0 conn(0x7f06e80ce4f0 legacy=0x7f06e80ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:19.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.083+0000 7f06ed200640 1 -- 172.21.15.122:0/429027796 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e815df30 con 0x7f06e80b58d0 2024-05-28T06:11:19.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.083+0000 7f06e7400640 1 -- 172.21.15.122:0/429027796 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4001490842 0 0) 0x7f06e80b61f0 con 0x7f06e80ce4f0 2024-05-28T06:11:19.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.083+0000 7f06ed200640 1 --2- 172.21.15.122:0/429027796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e80b58d0 0x7f06e80b5cb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009870 tx=0x7f06dc01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67991746492b3ebe server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:19.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.083+0000 7f06e7400640 1 -- 172.21.15.122:0/429027796 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc0ab5f0 con 0x7f06e80b58d0 2024-05-28T06:11:19.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.083+0000 7f06e7400640 1 -- 172.21.15.122:0/429027796 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06dc0b0070 con 0x7f06e80b58d0 2024-05-28T06:11:19.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.083+0000 7f06e7400640 1 -- 172.21.15.122:0/429027796 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc0ab9b0 con 0x7f06e80b58d0 2024-05-28T06:11:19.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06efc00640 1 -- 172.21.15.122:0/429027796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e80b58d0 msgr2=0x7f06e80b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:19.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06efc00640 1 --2- 172.21.15.122:0/429027796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e80b58d0 0x7f06e80b5cb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009870 tx=0x7f06dc01c560 comp rx=0 tx=0).stop 2024-05-28T06:11:19.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06efc00640 1 -- 172.21.15.122:0/429027796 shutdown_connections 2024-05-28T06:11:19.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06efc00640 1 --2- 172.21.15.122:0/429027796 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06e815e730 0x7f06e815ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:19.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06efc00640 1 --2- 172.21.15.122:0/429027796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e80b58d0 0x7f06e80b5cb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:19.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06efc00640 1 -- 172.21.15.122:0/429027796 >> 172.21.15.122:0/429027796 conn(0x7f06e806bd90 msgr2=0x7f06e806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:19.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06efc00640 1 -- 172.21.15.122:0/429027796 shutdown_connections 2024-05-28T06:11:19.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06efc00640 1 -- 172.21.15.122:0/429027796 wait complete. 2024-05-28T06:11:19.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06efc00640 1 Processor -- start 2024-05-28T06:11:19.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06efc00640 1 -- start start 2024-05-28T06:11:19.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06efc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06e80b58d0 0x7f06e813f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:19.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06efc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e80ce4f0 0x7f06e815a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:19.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06efc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06e815e730 0x7f06e813d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:19.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06efc00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f06e81693d0 con 0x7f06e815e730 2024-05-28T06:11:19.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06efc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f06e8169250 con 0x7f06e80ce4f0 2024-05-28T06:11:19.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06efc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f06e8169550 con 0x7f06e80b58d0 2024-05-28T06:11:19.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06edc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06e815e730 0x7f06e813d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:19.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06edc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06e815e730 0x7f06e813d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:33596/0 (socket says 172.21.15.122:33596) 2024-05-28T06:11:19.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06edc00640 1 -- 172.21.15.122:0/3302230032 learned_addr learned my addr 172.21.15.122:0/3302230032 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:19.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06ed200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06e80b58d0 0x7f06e813f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:19.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06e7e00640 1 --2- 172.21.15.122:0/3302230032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e80ce4f0 0x7f06e815a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:19.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06edc00640 1 -- 172.21.15.122:0/3302230032 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06e80b58d0 msgr2=0x7f06e813f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:19.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06edc00640 1 --2- 172.21.15.122:0/3302230032 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06e80b58d0 0x7f06e813f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:19.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06edc00640 1 -- 172.21.15.122:0/3302230032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e80ce4f0 msgr2=0x7f06e815a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:19.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06edc00640 1 --2- 172.21.15.122:0/3302230032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e80ce4f0 0x7f06e815a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:19.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.087+0000 7f06edc00640 1 -- 172.21.15.122:0/3302230032 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e813e0c0 con 0x7f06e815e730 2024-05-28T06:11:19.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.091+0000 7f06edc00640 1 --2- 172.21.15.122:0/3302230032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06e815e730 0x7f06e813d690 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f06e000efc0 tx=0x7f06e000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:19.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.091+0000 7f06e4c00640 1 -- 172.21.15.122:0/3302230032 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0018020 con 0x7f06e815e730 2024-05-28T06:11:19.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.091+0000 7f06e4c00640 1 -- 172.21.15.122:0/3302230032 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e0014480 con 0x7f06e815e730 2024-05-28T06:11:19.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.091+0000 7f06efc00640 1 -- 172.21.15.122:0/3302230032 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e813e3a0 con 0x7f06e815e730 2024-05-28T06:11:19.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.091+0000 7f06e4c00640 1 -- 172.21.15.122:0/3302230032 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0014870 con 0x7f06e815e730 2024-05-28T06:11:19.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.091+0000 7f06efc00640 1 -- 172.21.15.122:0/3302230032 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e813ec40 con 0x7f06e815e730 2024-05-28T06:11:19.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.091+0000 7f06efc00640 1 -- 172.21.15.122:0/3302230032 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e813e570 con 0x7f06e815e730 2024-05-28T06:11:19.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.091+0000 7f06e4c00640 1 -- 172.21.15.122:0/3302230032 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 12) ==== 88242+0+0 (secure 0 0 0) 0x7f06e001b020 con 0x7f06e815e730 2024-05-28T06:11:19.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.091+0000 7f06e4c00640 1 --2- 172.21.15.122:0/3302230032 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f06c8068650 0x7f06c806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:19.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.091+0000 7f06e4c00640 1 -- 172.21.15.122:0/3302230032 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7f06e0087b50 con 0x7f06e815e730 2024-05-28T06:11:19.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.091+0000 7f06ed200640 1 --2- 172.21.15.122:0/3302230032 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f06c8068650 0x7f06c806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:19.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.095+0000 7f06ed200640 1 --2- 172.21.15.122:0/3302230032 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f06c8068650 0x7f06c806ab10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0af000 tx=0x7f06dc0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:19.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.095+0000 7f06e4c00640 1 -- 172.21.15.122:0/3302230032 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f06e0022030 con 0x7f06e815e730 2024-05-28T06:11:19.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.283+0000 7f06efc00640 1 -- 172.21.15.122:0/3302230032 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f06e8076020 con 0x7f06c8068650 2024-05-28T06:11:19.287 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:19.287+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:19.288 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:19.287+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:19.288 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:19.287+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:19.288 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:19.287+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:19.288 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:19.287+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:19.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.311+0000 7f06e4c00640 1 -- 172.21.15.122:0/3302230032 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f06dc0b0040 con 0x7f06c8068650 2024-05-28T06:11:19.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.311+0000 7f06efc00640 1 -- 172.21.15.122:0/3302230032 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f06c8068650 msgr2=0x7f06c806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:19.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.311+0000 7f06efc00640 1 --2- 172.21.15.122:0/3302230032 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f06c8068650 0x7f06c806ab10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0af000 tx=0x7f06dc0a7000 comp rx=0 tx=0).stop 2024-05-28T06:11:19.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.311+0000 7f06efc00640 1 -- 172.21.15.122:0/3302230032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06e815e730 msgr2=0x7f06e813d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:19.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.311+0000 7f06efc00640 1 --2- 172.21.15.122:0/3302230032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06e815e730 0x7f06e813d690 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f06e000efc0 tx=0x7f06e000c490 comp rx=0 tx=0).stop 2024-05-28T06:11:19.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.311+0000 7f06efc00640 1 -- 172.21.15.122:0/3302230032 shutdown_connections 2024-05-28T06:11:19.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.311+0000 7f06efc00640 1 --2- 172.21.15.122:0/3302230032 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f06c8068650 0x7f06c806ab10 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:19.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.311+0000 7f06efc00640 1 --2- 172.21.15.122:0/3302230032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06e815e730 0x7f06e813d690 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:19.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.311+0000 7f06efc00640 1 --2- 172.21.15.122:0/3302230032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e80ce4f0 0x7f06e815a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:19.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.311+0000 7f06efc00640 1 --2- 172.21.15.122:0/3302230032 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06e80b58d0 0x7f06e813f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:19.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.311+0000 7f06efc00640 1 -- 172.21.15.122:0/3302230032 >> 172.21.15.122:0/3302230032 conn(0x7f06e806bd90 msgr2=0x7f06e80b0650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:19.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.311+0000 7f06efc00640 1 -- 172.21.15.122:0/3302230032 shutdown_connections 2024-05-28T06:11:19.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.311+0000 7f06efc00640 1 -- 172.21.15.122:0/3302230032 wait complete. 2024-05-28T06:11:19.330 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-28T06:11:19.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.471+0000 7f28ae000640 1 Processor -- start 2024-05-28T06:11:19.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.471+0000 7f28ae000640 1 -- start start 2024-05-28T06:11:19.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.475+0000 7f28ae000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f28a809b080 0x7f28a80b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:19.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.475+0000 7f28ae000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28a80d0bf0 con 0x7f28a809aca0 2024-05-28T06:11:19.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.475+0000 7f28ae000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28a80d0eb0 con 0x7f28a8160240 2024-05-28T06:11:19.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.475+0000 7f28ae000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f28a80b5460 con 0x7f28a809b080 2024-05-28T06:11:19.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.475+0000 7f28a7400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f28a809aca0 0x7f28a815fb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:45664/0 (socket says 172.21.15.122:45664) 2024-05-28T06:11:19.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.475+0000 7f28a7400640 1 -- 172.21.15.122:0/2126876047 learned_addr learned my addr 172.21.15.122:0/2126876047 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:11:19.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.475+0000 7f28a7e00640 1 --2- 172.21.15.122:0/2126876047 >> v2:172.21.15.153:3300/0 conn(0x7f28a809b080 0x7f28a80b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:19.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.475+0000 7f28a6000640 1 -- 172.21.15.122:0/2126876047 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2601638379 0 0) 0x7f28a80d0bf0 con 0x7f28a809aca0 2024-05-28T06:11:19.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.475+0000 7f28a6000640 1 -- 172.21.15.122:0/2126876047 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f288c003530 con 0x7f28a809aca0 2024-05-28T06:11:19.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.475+0000 7f28a6000640 1 -- 172.21.15.122:0/2126876047 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 793531088 0 0) 0x7f28a80d0eb0 con 0x7f28a8160240 2024-05-28T06:11:19.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.475+0000 7f28a6000640 1 -- 172.21.15.122:0/2126876047 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28a80d0bf0 con 0x7f28a8160240 2024-05-28T06:11:19.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.475+0000 7f28a7e00640 1 -- 172.21.15.122:0/2126876047 >> v1:172.21.15.153:6789/0 conn(0x7f28a8160240 legacy=0x7f28a80b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:19.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.475+0000 7f28a7e00640 1 -- 172.21.15.122:0/2126876047 >> v1:172.21.15.122:6789/0 conn(0x7f28a809aca0 legacy=0x7f28a815fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:19.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.475+0000 7f28a7e00640 1 -- 172.21.15.122:0/2126876047 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a80d1190 con 0x7f28a809b080 2024-05-28T06:11:19.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.479+0000 7f28a7e00640 1 --2- 172.21.15.122:0/2126876047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28a809b080 0x7f28a80b35b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009d90 tx=0x7f28a001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d0da7dd42daf91c server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:19.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.479+0000 7f28a6000640 1 -- 172.21.15.122:0/2126876047 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a00b2070 con 0x7f28a809b080 2024-05-28T06:11:19.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.479+0000 7f28a6000640 1 -- 172.21.15.122:0/2126876047 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28a00a59c0 con 0x7f28a809b080 2024-05-28T06:11:19.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.479+0000 7f28a6000640 1 -- 172.21.15.122:0/2126876047 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a00a5d90 con 0x7f28a809b080 2024-05-28T06:11:19.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.479+0000 7f28ae000640 1 -- 172.21.15.122:0/2126876047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28a809b080 msgr2=0x7f28a80b35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:19.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.479+0000 7f28ae000640 1 --2- 172.21.15.122:0/2126876047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28a809b080 0x7f28a80b35b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009d90 tx=0x7f28a001c970 comp rx=0 tx=0).stop 2024-05-28T06:11:19.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.479+0000 7f28ae000640 1 -- 172.21.15.122:0/2126876047 shutdown_connections 2024-05-28T06:11:19.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.479+0000 7f28ae000640 1 --2- 172.21.15.122:0/2126876047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28a809b080 0x7f28a80b35b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:19.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.479+0000 7f28ae000640 1 -- 172.21.15.122:0/2126876047 >> 172.21.15.122:0/2126876047 conn(0x7f28a80b4100 msgr2=0x7f28a80b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:19.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.479+0000 7f28ae000640 1 -- 172.21.15.122:0/2126876047 shutdown_connections 2024-05-28T06:11:19.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.479+0000 7f28ae000640 1 -- 172.21.15.122:0/2126876047 wait complete. 2024-05-28T06:11:19.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.479+0000 7f28ae000640 1 Processor -- start 2024-05-28T06:11:19.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.479+0000 7f28ae000640 1 -- start start 2024-05-28T06:11:19.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f28ae000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28a809aca0 0x7f28a8164b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:19.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f28ae000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28a809b080 0x7f28a8158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:19.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f28ae000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28a8160240 0x7f28a8166260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:19.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f28ae000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f28a80b6ba0 con 0x7f28a809aca0 2024-05-28T06:11:19.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f28ae000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f28a80b6a20 con 0x7f28a809b080 2024-05-28T06:11:19.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f28ae000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f28a816a760 con 0x7f28a8160240 2024-05-28T06:11:19.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f28a7400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28a809aca0 0x7f28a8164b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:19.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f28a7400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28a809aca0 0x7f28a8164b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:33620/0 (socket says 172.21.15.122:33620) 2024-05-28T06:11:19.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f28a7400640 1 -- 172.21.15.122:0/2542318118 learned_addr learned my addr 172.21.15.122:0/2542318118 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:19.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f28a6a00640 1 --2- 172.21.15.122:0/2542318118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28a809b080 0x7f28a8158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:19.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f28a7e00640 1 --2- 172.21.15.122:0/2542318118 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28a8160240 0x7f28a8166260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:19.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f28a7400640 1 -- 172.21.15.122:0/2542318118 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28a8160240 msgr2=0x7f28a8166260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:19.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f28a7400640 1 --2- 172.21.15.122:0/2542318118 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28a8160240 0x7f28a8166260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:19.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f28a7400640 1 -- 172.21.15.122:0/2542318118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28a809b080 msgr2=0x7f28a8158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:19.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f28a7400640 1 --2- 172.21.15.122:0/2542318118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28a809b080 0x7f28a8158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:19.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f28a7400640 1 -- 172.21.15.122:0/2542318118 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a81590d0 con 0x7f28a809aca0 2024-05-28T06:11:19.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f28a7400640 1 --2- 172.21.15.122:0/2542318118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28a809aca0 0x7f28a8164b30 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f289800c500 tx=0x7f289800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:19.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f289f400640 1 -- 172.21.15.122:0/2542318118 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2898017070 con 0x7f28a809aca0 2024-05-28T06:11:19.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f289f400640 1 -- 172.21.15.122:0/2542318118 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2898005cf0 con 0x7f28a809aca0 2024-05-28T06:11:19.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f28ae000640 1 -- 172.21.15.122:0/2542318118 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a81651c0 con 0x7f28a809aca0 2024-05-28T06:11:19.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f289f400640 1 -- 172.21.15.122:0/2542318118 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2898007330 con 0x7f28a809aca0 2024-05-28T06:11:19.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f28ae000640 1 -- 172.21.15.122:0/2542318118 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a8165780 con 0x7f28a809aca0 2024-05-28T06:11:19.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f28ae000640 1 -- 172.21.15.122:0/2542318118 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28a8068c40 con 0x7f28a809aca0 2024-05-28T06:11:19.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.483+0000 7f289f400640 1 -- 172.21.15.122:0/2542318118 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 13) ==== 88293+0+0 (secure 0 0 0) 0x7f289801a070 con 0x7f28a809aca0 2024-05-28T06:11:19.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.487+0000 7f289f400640 1 --2- 172.21.15.122:0/2542318118 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2888068710 0x7f288806abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:19.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.487+0000 7f289f400640 1 -- 172.21.15.122:0/2542318118 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7f2898086280 con 0x7f28a809aca0 2024-05-28T06:11:19.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.487+0000 7f28a6a00640 1 --2- 172.21.15.122:0/2542318118 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2888068710 0x7f288806abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:19.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.487+0000 7f28a6a00640 1 --2- 172.21.15.122:0/2542318118 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2888068710 0x7f288806abd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f28a81595c0 tx=0x7f2894009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:19.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.491+0000 7f289f400640 1 -- 172.21.15.122:0/2542318118 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2898055df0 con 0x7f28a809aca0 2024-05-28T06:11:19.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.671+0000 7f28ae000640 1 -- 172.21.15.122:0/2542318118 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f28a8076020 con 0x7f2888068710 2024-05-28T06:11:19.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.679+0000 7f289f400640 1 -- 172.21.15.122:0/2542318118 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f2894001cd0 con 0x7f2888068710 2024-05-28T06:11:19.677 INFO:teuthology.orchestra.run.smithi122.stdout:/volumes/_nogroup/sv1/ddba6cb4-beee-4b84-a37a-1205e585a7fc 2024-05-28T06:11:19.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.679+0000 7f28ae000640 1 -- 172.21.15.122:0/2542318118 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2888068710 msgr2=0x7f288806abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:19.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.679+0000 7f28ae000640 1 --2- 172.21.15.122:0/2542318118 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2888068710 0x7f288806abd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f28a81595c0 tx=0x7f2894009040 comp rx=0 tx=0).stop 2024-05-28T06:11:19.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.679+0000 7f28ae000640 1 -- 172.21.15.122:0/2542318118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28a809aca0 msgr2=0x7f28a8164b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:19.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.679+0000 7f28ae000640 1 --2- 172.21.15.122:0/2542318118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28a809aca0 0x7f28a8164b30 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f289800c500 tx=0x7f289800c9c0 comp rx=0 tx=0).stop 2024-05-28T06:11:19.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.679+0000 7f28ae000640 1 -- 172.21.15.122:0/2542318118 shutdown_connections 2024-05-28T06:11:19.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.679+0000 7f28ae000640 1 --2- 172.21.15.122:0/2542318118 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2888068710 0x7f288806abd0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:19.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.679+0000 7f28ae000640 1 --2- 172.21.15.122:0/2542318118 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28a8160240 0x7f28a8166260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:19.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.679+0000 7f28ae000640 1 --2- 172.21.15.122:0/2542318118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28a809b080 0x7f28a8158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:19.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.679+0000 7f28ae000640 1 --2- 172.21.15.122:0/2542318118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28a809aca0 0x7f28a8164b30 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:19.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.679+0000 7f28ae000640 1 -- 172.21.15.122:0/2542318118 >> 172.21.15.122:0/2542318118 conn(0x7f28a80b4100 msgr2=0x7f28a8071990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:19.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.679+0000 7f28ae000640 1 -- 172.21.15.122:0/2542318118 shutdown_connections 2024-05-28T06:11:19.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:19.679+0000 7f28ae000640 1 -- 172.21.15.122:0/2542318118 wait complete. 2024-05-28T06:11:19.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:11:19.699 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/ddba6cb4-beee-4b84-a37a-1205e585a7fc 2024-05-28T06:11:19.699 DEBUG:teuthology.orchestra.run.smithi122:> ) 2024-05-28T06:11:19.708 INFO:teuthology.orchestra.run.smithi122.stdout:# file: volumes/_nogroup/sv1/ddba6cb4-beee-4b84-a37a-1205e585a7fc 2024-05-28T06:11:19.708 INFO:teuthology.orchestra.run.smithi122.stdout:ceph.dir.rbytes="10488365056" 2024-05-28T06:11:19.708 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:11:19.709 INFO:tasks.cephfs.test_volumes:r_size = 10488365056 exp_size = 10737418240 2024-05-28T06:11:21.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:11:21.711 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/ddba6cb4-beee-4b84-a37a-1205e585a7fc 2024-05-28T06:11:21.711 DEBUG:teuthology.orchestra.run.smithi122:> ) 2024-05-28T06:11:21.721 INFO:teuthology.orchestra.run.smithi122.stdout:# file: volumes/_nogroup/sv1/ddba6cb4-beee-4b84-a37a-1205e585a7fc 2024-05-28T06:11:21.722 INFO:teuthology.orchestra.run.smithi122.stdout:ceph.dir.rbytes="10737418240" 2024-05-28T06:11:21.722 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:11:21.723 INFO:tasks.cephfs.test_volumes:r_size = 10737418240 exp_size = 10737418240 2024-05-28T06:11:21.723 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone24471 2024-05-28T06:11:21.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.915+0000 7fa3faa00640 1 Processor -- start 2024-05-28T06:11:21.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.915+0000 7fa3faa00640 1 -- start start 2024-05-28T06:11:21.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.915+0000 7fa3faa00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa3f40ce6e0 0x7fa3f40d1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:21.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.915+0000 7fa3faa00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3f40d18c0 con 0x7fa3f406dbc0 2024-05-28T06:11:21.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.915+0000 7fa3faa00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3f40ccbf0 con 0x7fa3f415ebe0 2024-05-28T06:11:21.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.915+0000 7fa3faa00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa3f40cd240 con 0x7fa3f40ce6e0 2024-05-28T06:11:21.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.915+0000 7fa3f8c00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fa3f406dbc0 0x7fa3f40c8170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:45676/0 (socket says 172.21.15.122:45676) 2024-05-28T06:11:21.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.915+0000 7fa3f8c00640 1 -- 172.21.15.122:0/3321130614 learned_addr learned my addr 172.21.15.122:0/3321130614 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:11:21.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.915+0000 7fa3fa000640 1 --2- 172.21.15.122:0/3321130614 >> v2:172.21.15.153:3300/0 conn(0x7fa3f40ce6e0 0x7fa3f40d1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:21.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.915+0000 7fa3f3e00640 1 -- 172.21.15.122:0/3321130614 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3173532906 0 0) 0x7fa3f40d18c0 con 0x7fa3f406dbc0 2024-05-28T06:11:21.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.915+0000 7fa3f3e00640 1 -- 172.21.15.122:0/3321130614 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3dc003530 con 0x7fa3f406dbc0 2024-05-28T06:11:21.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.915+0000 7fa3fa000640 1 -- 172.21.15.122:0/3321130614 >> v1:172.21.15.153:6789/0 conn(0x7fa3f415ebe0 legacy=0x7fa3f406d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:21.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.915+0000 7fa3fa000640 1 -- 172.21.15.122:0/3321130614 >> v1:172.21.15.122:6789/0 conn(0x7fa3f406dbc0 legacy=0x7fa3f40c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:21.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.915+0000 7fa3fa000640 1 -- 172.21.15.122:0/3321130614 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f40cced0 con 0x7fa3f40ce6e0 2024-05-28T06:11:21.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.919+0000 7fa3fa000640 1 --2- 172.21.15.122:0/3321130614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3f40ce6e0 0x7fa3f40d1220 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec009d90 tx=0x7fa3ec01c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=908096fa927033ad server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:21.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.919+0000 7fa3f3e00640 1 -- 172.21.15.122:0/3321130614 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec0b2070 con 0x7fa3f40ce6e0 2024-05-28T06:11:21.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.919+0000 7fa3f3e00640 1 -- 172.21.15.122:0/3321130614 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3ec0a59d0 con 0x7fa3f40ce6e0 2024-05-28T06:11:21.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.919+0000 7fa3f3e00640 1 -- 172.21.15.122:0/3321130614 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec0a5da0 con 0x7fa3f40ce6e0 2024-05-28T06:11:21.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.919+0000 7fa3faa00640 1 -- 172.21.15.122:0/3321130614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3f40ce6e0 msgr2=0x7fa3f40d1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:21.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.919+0000 7fa3faa00640 1 --2- 172.21.15.122:0/3321130614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3f40ce6e0 0x7fa3f40d1220 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec009d90 tx=0x7fa3ec01c930 comp rx=0 tx=0).stop 2024-05-28T06:11:21.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.919+0000 7fa3faa00640 1 -- 172.21.15.122:0/3321130614 shutdown_connections 2024-05-28T06:11:21.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.919+0000 7fa3faa00640 1 --2- 172.21.15.122:0/3321130614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3f40ce6e0 0x7fa3f40d1220 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:21.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.919+0000 7fa3faa00640 1 -- 172.21.15.122:0/3321130614 >> 172.21.15.122:0/3321130614 conn(0x7fa3f40b3ff0 msgr2=0x7fa3f40b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:21.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.919+0000 7fa3faa00640 1 -- 172.21.15.122:0/3321130614 shutdown_connections 2024-05-28T06:11:21.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.919+0000 7fa3faa00640 1 -- 172.21.15.122:0/3321130614 wait complete. 2024-05-28T06:11:21.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.919+0000 7fa3faa00640 1 Processor -- start 2024-05-28T06:11:21.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3faa00640 1 -- start start 2024-05-28T06:11:21.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3faa00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3f406dbc0 0x7fa3f4157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:21.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3faa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3f40ce6e0 0x7fa3f414e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:21.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3faa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3f415ebe0 0x7fa3f40c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:21.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3faa00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f416ce30 con 0x7fa3f40ce6e0 2024-05-28T06:11:21.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3faa00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f40c8ea0 con 0x7fa3f415ebe0 2024-05-28T06:11:21.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3faa00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa3f416cfb0 con 0x7fa3f406dbc0 2024-05-28T06:11:21.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3f8c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3f40ce6e0 0x7fa3f414e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:21.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3f8c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3f40ce6e0 0x7fa3f414e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:33634/0 (socket says 172.21.15.122:33634) 2024-05-28T06:11:21.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3f8c00640 1 -- 172.21.15.122:0/2811439844 learned_addr learned my addr 172.21.15.122:0/2811439844 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:21.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3f9600640 1 --2- 172.21.15.122:0/2811439844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3f406dbc0 0x7fa3f4157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:21.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3fa000640 1 --2- 172.21.15.122:0/2811439844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3f415ebe0 0x7fa3f40c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:21.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3f8c00640 1 -- 172.21.15.122:0/2811439844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3f406dbc0 msgr2=0x7fa3f4157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:21.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3f8c00640 1 --2- 172.21.15.122:0/2811439844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3f406dbc0 0x7fa3f4157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:21.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3f8c00640 1 -- 172.21.15.122:0/2811439844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3f415ebe0 msgr2=0x7fa3f40c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:21.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3f8c00640 1 --2- 172.21.15.122:0/2811439844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3f415ebe0 0x7fa3f40c6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:21.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3f8c00640 1 -- 172.21.15.122:0/2811439844 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f40b6ff0 con 0x7fa3f40ce6e0 2024-05-28T06:11:21.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3f8c00640 1 --2- 172.21.15.122:0/2811439844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3f40ce6e0 0x7fa3f414e950 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000c450 tx=0x7fa3e000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:21.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3f1600640 1 -- 172.21.15.122:0/2811439844 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e0017070 con 0x7fa3f40ce6e0 2024-05-28T06:11:21.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3f1600640 1 -- 172.21.15.122:0/2811439844 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3e0005cf0 con 0x7fa3f40ce6e0 2024-05-28T06:11:21.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3f1600640 1 -- 172.21.15.122:0/2811439844 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e0007270 con 0x7fa3f40ce6e0 2024-05-28T06:11:21.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3faa00640 1 -- 172.21.15.122:0/2811439844 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f41578c0 con 0x7fa3f40ce6e0 2024-05-28T06:11:21.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3faa00640 1 -- 172.21.15.122:0/2811439844 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f40b7570 con 0x7fa3f40ce6e0 2024-05-28T06:11:21.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.923+0000 7fa3faa00640 1 -- 172.21.15.122:0/2811439844 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3f4075620 con 0x7fa3f40ce6e0 2024-05-28T06:11:21.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.927+0000 7fa3f1600640 1 -- 172.21.15.122:0/2811439844 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 13) ==== 88293+0+0 (secure 0 0 0) 0x7fa3e001a070 con 0x7fa3f40ce6e0 2024-05-28T06:11:21.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.927+0000 7fa3f1600640 1 --2- 172.21.15.122:0/2811439844 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa3d4068710 0x7fa3d406abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:21.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.927+0000 7fa3f1600640 1 -- 172.21.15.122:0/2811439844 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7fa3e0086290 con 0x7fa3f40ce6e0 2024-05-28T06:11:21.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.927+0000 7fa3f9600640 1 --2- 172.21.15.122:0/2811439844 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa3d4068710 0x7fa3d406abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:21.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.927+0000 7fa3f9600640 1 --2- 172.21.15.122:0/2811439844 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa3d4068710 0x7fa3d406abd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa3f41fb290 tx=0x7fa3e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:21.929 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:21.931+0000 7fa3f1600640 1 -- 172.21.15.122:0/2811439844 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa3e0055c70 con 0x7fa3f40ce6e0 2024-05-28T06:11:22.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.119+0000 7fa3faa00640 1 -- 172.21.15.122:0/2811439844 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone24471", "target": ["mon-mgr", ""]}) -- 0x7fa3f40d2280 con 0x7fa3d4068710 2024-05-28T06:11:22.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.179+0000 7fa3f1600640 1 -- 172.21.15.122:0/2811439844 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa3f40d2280 con 0x7fa3d4068710 2024-05-28T06:11:22.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.179+0000 7fa3faa00640 1 -- 172.21.15.122:0/2811439844 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa3d4068710 msgr2=0x7fa3d406abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:22.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.179+0000 7fa3faa00640 1 --2- 172.21.15.122:0/2811439844 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa3d4068710 0x7fa3d406abd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa3f41fb290 tx=0x7fa3e8009040 comp rx=0 tx=0).stop 2024-05-28T06:11:22.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.179+0000 7fa3faa00640 1 -- 172.21.15.122:0/2811439844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3f40ce6e0 msgr2=0x7fa3f414e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:22.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.179+0000 7fa3faa00640 1 --2- 172.21.15.122:0/2811439844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3f40ce6e0 0x7fa3f414e950 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000c450 tx=0x7fa3e000c910 comp rx=0 tx=0).stop 2024-05-28T06:11:22.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.179+0000 7fa3faa00640 1 -- 172.21.15.122:0/2811439844 shutdown_connections 2024-05-28T06:11:22.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.179+0000 7fa3faa00640 1 --2- 172.21.15.122:0/2811439844 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa3d4068710 0x7fa3d406abd0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:22.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.179+0000 7fa3faa00640 1 --2- 172.21.15.122:0/2811439844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3f415ebe0 0x7fa3f40c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:22.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.179+0000 7fa3faa00640 1 --2- 172.21.15.122:0/2811439844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3f40ce6e0 0x7fa3f414e950 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:22.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.179+0000 7fa3faa00640 1 --2- 172.21.15.122:0/2811439844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3f406dbc0 0x7fa3f4157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:22.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.179+0000 7fa3faa00640 1 -- 172.21.15.122:0/2811439844 >> 172.21.15.122:0/2811439844 conn(0x7fa3f40b3ff0 msgr2=0x7fa3f406ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:22.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.179+0000 7fa3faa00640 1 -- 172.21.15.122:0/2811439844 shutdown_connections 2024-05-28T06:11:22.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.179+0000 7fa3faa00640 1 -- 172.21.15.122:0/2811439844 wait complete. 2024-05-28T06:11:22.182 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:22.183+0000 7f9ded800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:22.182 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:22.183+0000 7f9ded800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:22.182 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:22.183+0000 7f9ded800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:22.182 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:22.183+0000 7f9ded800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:22.182 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:22.183+0000 7f9ded800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:22.197 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:22.199+0000 7f9dee200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:22.197 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:22.199+0000 7f9dee200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:22.197 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:22.199+0000 7f9dee200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:22.197 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:22.199+0000 7f9dee200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:22.197 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:22.199+0000 7f9dee200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:22.204 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone24472 2024-05-28T06:11:22.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.355+0000 7febc0000640 1 Processor -- start 2024-05-28T06:11:22.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.355+0000 7febc0000640 1 -- start start 2024-05-28T06:11:22.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.355+0000 7febc0000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7febb815f740 0x7febb8167240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:22.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.355+0000 7febc0000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febb815d970 con 0x7febb80ce4f0 2024-05-28T06:11:22.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.355+0000 7febc0000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febb815dc50 con 0x7febb80b58d0 2024-05-28T06:11:22.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.355+0000 7febc0000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7febb815df30 con 0x7febb815f740 2024-05-28T06:11:22.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.355+0000 7febbe000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7febb815f740 0x7febb8167240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:22.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.355+0000 7febbcc00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7febb80ce4f0 0x7febb80ce980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:45686/0 (socket says 172.21.15.122:45686) 2024-05-28T06:11:22.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.359+0000 7febbcc00640 1 -- 172.21.15.122:0/3007061090 learned_addr learned my addr 172.21.15.122:0/3007061090 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:11:22.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.359+0000 7febbe000640 1 -- 172.21.15.122:0/3007061090 >> v1:172.21.15.153:6789/0 conn(0x7febb80b58d0 legacy=0x7febb80b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:22.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.359+0000 7febbe000640 1 -- 172.21.15.122:0/3007061090 >> v1:172.21.15.122:6789/0 conn(0x7febb80ce4f0 legacy=0x7febb80ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:22.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.359+0000 7febbe000640 1 -- 172.21.15.122:0/3007061090 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb815e210 con 0x7febb815f740 2024-05-28T06:11:22.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.359+0000 7febbe000640 1 --2- 172.21.15.122:0/3007061090 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febb815f740 0x7febb8167240 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7febb0009d90 tx=0x7febb001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6afdd8aa53415521 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:22.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.359+0000 7febb7e00640 1 -- 172.21.15.122:0/3007061090 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb00b2070 con 0x7febb815f740 2024-05-28T06:11:22.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.359+0000 7febb7e00640 1 -- 172.21.15.122:0/3007061090 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febb00a5840 con 0x7febb815f740 2024-05-28T06:11:22.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.359+0000 7febb7e00640 1 -- 172.21.15.122:0/3007061090 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb00a5c10 con 0x7febb815f740 2024-05-28T06:11:22.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febc0000640 1 -- 172.21.15.122:0/3007061090 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febb815f740 msgr2=0x7febb8167240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:22.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febc0000640 1 --2- 172.21.15.122:0/3007061090 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febb815f740 0x7febb8167240 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7febb0009d90 tx=0x7febb001c970 comp rx=0 tx=0).stop 2024-05-28T06:11:22.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febc0000640 1 -- 172.21.15.122:0/3007061090 shutdown_connections 2024-05-28T06:11:22.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febc0000640 1 --2- 172.21.15.122:0/3007061090 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febb815f740 0x7febb8167240 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:22.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febc0000640 1 -- 172.21.15.122:0/3007061090 >> 172.21.15.122:0/3007061090 conn(0x7febb806bd90 msgr2=0x7febb806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:22.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febc0000640 1 -- 172.21.15.122:0/3007061090 shutdown_connections 2024-05-28T06:11:22.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febc0000640 1 -- 172.21.15.122:0/3007061090 wait complete. 2024-05-28T06:11:22.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febc0000640 1 Processor -- start 2024-05-28T06:11:22.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febc0000640 1 -- start start 2024-05-28T06:11:22.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febc0000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febb80b58d0 0x7febb80b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:22.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febc0000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febb80ce4f0 0x7febb8138760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:22.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febc0000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febb815f740 0x7febb813a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:22.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febc0000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7febb816a330 con 0x7febb815f740 2024-05-28T06:11:22.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febc0000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7febb816a1b0 con 0x7febb80b58d0 2024-05-28T06:11:22.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febc0000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7febb816a4b0 con 0x7febb80ce4f0 2024-05-28T06:11:22.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febbe000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febb815f740 0x7febb813a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:22.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febbe000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febb815f740 0x7febb813a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:33700/0 (socket says 172.21.15.122:33700) 2024-05-28T06:11:22.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febbe000640 1 -- 172.21.15.122:0/3655734306 learned_addr learned my addr 172.21.15.122:0/3655734306 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:22.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febbcc00640 1 --2- 172.21.15.122:0/3655734306 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febb80ce4f0 0x7febb8138760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:22.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febbd600640 1 --2- 172.21.15.122:0/3655734306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febb80b58d0 0x7febb80b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:22.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febbe000640 1 -- 172.21.15.122:0/3655734306 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febb80ce4f0 msgr2=0x7febb8138760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:22.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febbe000640 1 --2- 172.21.15.122:0/3655734306 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febb80ce4f0 0x7febb8138760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:22.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febbe000640 1 -- 172.21.15.122:0/3655734306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febb80b58d0 msgr2=0x7febb80b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:22.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febbe000640 1 --2- 172.21.15.122:0/3655734306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febb80b58d0 0x7febb80b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:22.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febbe000640 1 -- 172.21.15.122:0/3655734306 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb8145080 con 0x7febb815f740 2024-05-28T06:11:22.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.363+0000 7febbe000640 1 --2- 172.21.15.122:0/3655734306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febb815f740 0x7febb813a7e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7febb00b0040 tx=0x7febb0019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:22.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.367+0000 7febb5600640 1 -- 172.21.15.122:0/3655734306 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb00b2050 con 0x7febb815f740 2024-05-28T06:11:22.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.367+0000 7febb5600640 1 -- 172.21.15.122:0/3655734306 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febb00be070 con 0x7febb815f740 2024-05-28T06:11:22.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.367+0000 7febb5600640 1 -- 172.21.15.122:0/3655734306 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb00ada90 con 0x7febb815f740 2024-05-28T06:11:22.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.367+0000 7febc0000640 1 -- 172.21.15.122:0/3655734306 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb8136320 con 0x7febb815f740 2024-05-28T06:11:22.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.367+0000 7febc0000640 1 -- 172.21.15.122:0/3655734306 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb8137f60 con 0x7febb815f740 2024-05-28T06:11:22.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.367+0000 7febc0000640 1 -- 172.21.15.122:0/3655734306 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb8068c40 con 0x7febb815f740 2024-05-28T06:11:22.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.367+0000 7febb5600640 1 -- 172.21.15.122:0/3655734306 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 13) ==== 88293+0+0 (secure 0 0 0) 0x7febb00adc30 con 0x7febb815f740 2024-05-28T06:11:22.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.367+0000 7febb5600640 1 --2- 172.21.15.122:0/3655734306 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feb980686e0 0x7feb9806aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:22.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.367+0000 7febb5600640 1 -- 172.21.15.122:0/3655734306 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7febb0122010 con 0x7febb815f740 2024-05-28T06:11:22.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.367+0000 7febbd600640 1 --2- 172.21.15.122:0/3655734306 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feb980686e0 0x7feb9806aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:22.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.367+0000 7febbd600640 1 --2- 172.21.15.122:0/3655734306 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feb980686e0 0x7feb9806aba0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7febac001770 tx=0x7febac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:22.371 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.371+0000 7febb5600640 1 -- 172.21.15.122:0/3655734306 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7febb0016560 con 0x7febb815f740 2024-05-28T06:11:22.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:22.559+0000 7febc0000640 1 -- 172.21.15.122:0/3655734306 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone24472", "target": ["mon-mgr", ""]}) -- 0x7febb8136600 con 0x7feb980686e0 2024-05-28T06:11:23.182 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:23.183+0000 7f9dd5200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:23.182 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:23.183+0000 7f9dd5200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:23.182 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:23.183+0000 7f9dd5200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:23.182 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:23.183+0000 7f9dd5200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:23.182 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:23.183+0000 7f9dd5200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:23.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.287+0000 7febb5600640 1 -- 172.21.15.122:0/3655734306 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7febb8136600 con 0x7feb980686e0 2024-05-28T06:11:23.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.295+0000 7febc0000640 1 -- 172.21.15.122:0/3655734306 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feb980686e0 msgr2=0x7feb9806aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:23.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.295+0000 7febc0000640 1 --2- 172.21.15.122:0/3655734306 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feb980686e0 0x7feb9806aba0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7febac001770 tx=0x7febac009040 comp rx=0 tx=0).stop 2024-05-28T06:11:23.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.295+0000 7febc0000640 1 -- 172.21.15.122:0/3655734306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febb815f740 msgr2=0x7febb813a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:23.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.295+0000 7febc0000640 1 --2- 172.21.15.122:0/3655734306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febb815f740 0x7febb813a7e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7febb00b0040 tx=0x7febb0019710 comp rx=0 tx=0).stop 2024-05-28T06:11:23.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.295+0000 7febc0000640 1 -- 172.21.15.122:0/3655734306 shutdown_connections 2024-05-28T06:11:23.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.295+0000 7febc0000640 1 --2- 172.21.15.122:0/3655734306 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feb980686e0 0x7feb9806aba0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:23.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.295+0000 7febc0000640 1 --2- 172.21.15.122:0/3655734306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febb815f740 0x7febb813a7e0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:23.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.295+0000 7febc0000640 1 --2- 172.21.15.122:0/3655734306 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febb80ce4f0 0x7febb8138760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:23.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.295+0000 7febc0000640 1 --2- 172.21.15.122:0/3655734306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febb80b58d0 0x7febb80b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:23.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.295+0000 7febc0000640 1 -- 172.21.15.122:0/3655734306 >> 172.21.15.122:0/3655734306 conn(0x7febb806bd90 msgr2=0x7febb8144970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:23.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.299+0000 7febc0000640 1 -- 172.21.15.122:0/3655734306 shutdown_connections 2024-05-28T06:11:23.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.299+0000 7febc0000640 1 -- 172.21.15.122:0/3655734306 wait complete. 2024-05-28T06:11:23.314 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:23.315+0000 7f9dee200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:23.315 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:23.315+0000 7f9dee200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:23.315 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:23.315+0000 7f9dee200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:23.315 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:23.315+0000 7f9dee200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:23.315 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:23.315+0000 7f9dee200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:23.345 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone24473 2024-05-28T06:11:23.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.623+0000 7f3c35c00640 1 Processor -- start 2024-05-28T06:11:23.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.623+0000 7f3c35c00640 1 -- start start 2024-05-28T06:11:23.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.627+0000 7f3c35c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3c300722a0 0x7f3c30072750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:23.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.627+0000 7f3c35c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3c300ce6e0 0x7f3c300ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:23.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.627+0000 7f3c35c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c3006e070 con 0x7f3c30162be0 2024-05-28T06:11:23.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.627+0000 7f3c35c00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f3c301641b0 con 0x7f3c300722a0 2024-05-28T06:11:23.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.627+0000 7f3c35c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3c30072c90 con 0x7f3c300ce6e0 2024-05-28T06:11:23.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.627+0000 7f3c26000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3c300722a0 0x7f3c30072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:23.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.627+0000 7f3c26000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3c300722a0 0x7f3c30072750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:33760/0 (socket says 172.21.15.122:33760) 2024-05-28T06:11:23.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.627+0000 7f3c26000640 1 -- 172.21.15.122:0/3339629401 learned_addr learned my addr 172.21.15.122:0/3339629401 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:23.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.627+0000 7f3c26000640 1 -- 172.21.15.122:0/3339629401 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3c300ce6e0 msgr2=0x7f3c300ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:11:23.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.627+0000 7f3c26000640 1 --2- 172.21.15.122:0/3339629401 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3c300ce6e0 0x7f3c300ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:23.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.627+0000 7f3c26000640 1 -- 172.21.15.122:0/3339629401 >> v1:172.21.15.153:6789/0 conn(0x7f3c30162be0 legacy=0x7f3c300cc7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-28T06:11:23.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.627+0000 7f3c26000640 1 -- 172.21.15.122:0/3339629401 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c3006e350 con 0x7f3c300722a0 2024-05-28T06:11:23.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.635+0000 7f3c26000640 1 --2- 172.21.15.122:0/3339629401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c300722a0 0x7f3c30072750 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3c3006f450 tx=0x7f3c1801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838ac07f069ef42f server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:23.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.635+0000 7f3c2e000640 1 -- 172.21.15.122:0/3339629401 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c180aa5f0 con 0x7f3c300722a0 2024-05-28T06:11:23.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.635+0000 7f3c2e000640 1 -- 172.21.15.122:0/3339629401 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c180af070 con 0x7f3c300722a0 2024-05-28T06:11:23.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.635+0000 7f3c2e000640 1 -- 172.21.15.122:0/3339629401 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c180aa9b0 con 0x7f3c300722a0 2024-05-28T06:11:23.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.635+0000 7f3c35c00640 1 -- 172.21.15.122:0/3339629401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c300722a0 msgr2=0x7f3c30072750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:23.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.635+0000 7f3c35c00640 1 --2- 172.21.15.122:0/3339629401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c300722a0 0x7f3c30072750 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3c3006f450 tx=0x7f3c1801c4d0 comp rx=0 tx=0).stop 2024-05-28T06:11:23.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.635+0000 7f3c35c00640 1 -- 172.21.15.122:0/3339629401 shutdown_connections 2024-05-28T06:11:23.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.635+0000 7f3c35c00640 1 --2- 172.21.15.122:0/3339629401 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3c300ce6e0 0x7f3c300ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:23.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.635+0000 7f3c35c00640 1 --2- 172.21.15.122:0/3339629401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c300722a0 0x7f3c30072750 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:23.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.635+0000 7f3c35c00640 1 -- 172.21.15.122:0/3339629401 >> 172.21.15.122:0/3339629401 conn(0x7f3c3006bd90 msgr2=0x7f3c3006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:23.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.635+0000 7f3c35c00640 1 -- 172.21.15.122:0/3339629401 shutdown_connections 2024-05-28T06:11:23.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.635+0000 7f3c35c00640 1 -- 172.21.15.122:0/3339629401 wait complete. 2024-05-28T06:11:23.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.639+0000 7f3c35c00640 1 Processor -- start 2024-05-28T06:11:23.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.639+0000 7f3c35c00640 1 -- start start 2024-05-28T06:11:23.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.639+0000 7f3c35c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3c300722a0 0x7f3c30147490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:23.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.639+0000 7f3c35c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c300ce6e0 0x7f3c300b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:23.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.639+0000 7f3c35c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c30162be0 0x7f3c300b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:23.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.639+0000 7f3c35c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3c30162fc0 con 0x7f3c300ce6e0 2024-05-28T06:11:23.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.639+0000 7f3c35c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3006eed0 con 0x7f3c30162be0 2024-05-28T06:11:23.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.639+0000 7f3c35c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3c300ccec0 con 0x7f3c300722a0 2024-05-28T06:11:23.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.639+0000 7f3c26000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c300ce6e0 0x7f3c300b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:23.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.639+0000 7f3c26000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c300ce6e0 0x7f3c300b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:33772/0 (socket says 172.21.15.122:33772) 2024-05-28T06:11:23.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.639+0000 7f3c26000640 1 -- 172.21.15.122:0/757902330 learned_addr learned my addr 172.21.15.122:0/757902330 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:23.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.639+0000 7f3c26000640 1 -- 172.21.15.122:0/757902330 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3c300722a0 msgr2=0x7f3c30147490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:23.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.639+0000 7f3c26000640 1 --2- 172.21.15.122:0/757902330 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3c300722a0 0x7f3c30147490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:23.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.639+0000 7f3c26000640 1 -- 172.21.15.122:0/757902330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c30162be0 msgr2=0x7f3c300b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:23.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.639+0000 7f3c26000640 1 --2- 172.21.15.122:0/757902330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c30162be0 0x7f3c300b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:23.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.639+0000 7f3c26000640 1 -- 172.21.15.122:0/757902330 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c30156090 con 0x7f3c300ce6e0 2024-05-28T06:11:23.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.639+0000 7f3c26000640 1 --2- 172.21.15.122:0/757902330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c300ce6e0 0x7f3c300b0ec0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3c180ac040 tx=0x7f3c1801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:23.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.639+0000 7f3c27400640 1 -- 172.21.15.122:0/757902330 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c180bd5f0 con 0x7f3c300ce6e0 2024-05-28T06:11:23.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.639+0000 7f3c27400640 1 -- 172.21.15.122:0/757902330 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c180bd790 con 0x7f3c300ce6e0 2024-05-28T06:11:23.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.639+0000 7f3c27400640 1 -- 172.21.15.122:0/757902330 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c180bdb80 con 0x7f3c300ce6e0 2024-05-28T06:11:23.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.639+0000 7f3c35c00640 1 -- 172.21.15.122:0/757902330 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c30156370 con 0x7f3c300ce6e0 2024-05-28T06:11:23.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.639+0000 7f3c35c00640 1 -- 172.21.15.122:0/757902330 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c300b44e0 con 0x7f3c300ce6e0 2024-05-28T06:11:23.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.643+0000 7f3c35c00640 1 -- 172.21.15.122:0/757902330 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c30068c40 con 0x7f3c300ce6e0 2024-05-28T06:11:23.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.647+0000 7f3c27400640 1 -- 172.21.15.122:0/757902330 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 14) ==== 88446+0+0 (secure 0 0 0) 0x7f3c180b33f0 con 0x7f3c300ce6e0 2024-05-28T06:11:23.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.647+0000 7f3c27400640 1 --2- 172.21.15.122:0/757902330 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3c0c068960 0x7f3c0c06ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:23.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.647+0000 7f3c27400640 1 -- 172.21.15.122:0/757902330 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7f3c18122450 con 0x7f3c300ce6e0 2024-05-28T06:11:23.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.651+0000 7f3c2ea00640 1 --2- 172.21.15.122:0/757902330 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3c0c068960 0x7f3c0c06ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:23.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.655+0000 7f3c2ea00640 1 --2- 172.21.15.122:0/757902330 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3c0c068960 0x7f3c0c06ae20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000abb0 tx=0x7f3c20009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:23.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:23.655+0000 7f3c27400640 1 -- 172.21.15.122:0/757902330 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3c180c3060 con 0x7f3c300ce6e0 2024-05-28T06:11:24.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:24.071+0000 7f3c35c00640 1 -- 172.21.15.122:0/757902330 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone24473", "target": ["mon-mgr", ""]}) -- 0x7f3c301479d0 con 0x7f3c0c068960 2024-05-28T06:11:24.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:24.683+0000 7f3c27400640 1 -- 172.21.15.122:0/757902330 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3c301479d0 con 0x7f3c0c068960 2024-05-28T06:11:24.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:24.691+0000 7f3c35c00640 1 -- 172.21.15.122:0/757902330 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3c0c068960 msgr2=0x7f3c0c06ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:24.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:24.695+0000 7f3c35c00640 1 --2- 172.21.15.122:0/757902330 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3c0c068960 0x7f3c0c06ae20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000abb0 tx=0x7f3c20009250 comp rx=0 tx=0).stop 2024-05-28T06:11:24.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:24.695+0000 7f3c35c00640 1 -- 172.21.15.122:0/757902330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c300ce6e0 msgr2=0x7f3c300b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:24.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:24.695+0000 7f3c35c00640 1 --2- 172.21.15.122:0/757902330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c300ce6e0 0x7f3c300b0ec0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3c180ac040 tx=0x7f3c1801ad10 comp rx=0 tx=0).stop 2024-05-28T06:11:24.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:24.695+0000 7f3c35c00640 1 -- 172.21.15.122:0/757902330 shutdown_connections 2024-05-28T06:11:24.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:24.695+0000 7f3c35c00640 1 --2- 172.21.15.122:0/757902330 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3c0c068960 0x7f3c0c06ae20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:24.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:24.695+0000 7f3c35c00640 1 --2- 172.21.15.122:0/757902330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c30162be0 0x7f3c300b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:24.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:24.695+0000 7f3c35c00640 1 --2- 172.21.15.122:0/757902330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c300ce6e0 0x7f3c300b0ec0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:24.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:24.695+0000 7f3c35c00640 1 --2- 172.21.15.122:0/757902330 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3c300722a0 0x7f3c30147490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:24.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:24.695+0000 7f3c35c00640 1 -- 172.21.15.122:0/757902330 >> 172.21.15.122:0/757902330 conn(0x7f3c3006bd90 msgr2=0x7f3c30161b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:24.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:24.699+0000 7f3c35c00640 1 -- 172.21.15.122:0/757902330 shutdown_connections 2024-05-28T06:11:24.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:24.699+0000 7f3c35c00640 1 -- 172.21.15.122:0/757902330 wait complete. 2024-05-28T06:11:24.775 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:24.771+0000 7f9dee200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:24.775 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:24.771+0000 7f9dee200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:24.775 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:24.771+0000 7f9dee200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:24.775 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:24.771+0000 7f9dee200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:24.775 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:24.771+0000 7f9dee200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:24.778 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone24474 2024-05-28T06:11:25.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.199+0000 7fe98d600640 1 Processor -- start 2024-05-28T06:11:25.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.199+0000 7fe98d600640 1 -- start start 2024-05-28T06:11:25.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.203+0000 7fe98d600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe98815eb70 0x7fe98815ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:25.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.203+0000 7fe986a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe98815eb70 0x7fe98815ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:25.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.207+0000 7fe986a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe98815eb70 0x7fe98815ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:33790/0 (socket says 172.21.15.122:33790) 2024-05-28T06:11:25.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.207+0000 7fe98d600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe9880d1f30 0x7fe988160a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:25.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.207+0000 7fe98d600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe98815feb0 con 0x7fe9880cf180 2024-05-28T06:11:25.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.207+0000 7fe98d600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fe98815f8f0 con 0x7fe98815eb70 2024-05-28T06:11:25.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.207+0000 7fe98d600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe98815fbd0 con 0x7fe9880d1f30 2024-05-28T06:11:25.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.207+0000 7fe986a00640 1 -- 172.21.15.122:0/3942386603 learned_addr learned my addr 172.21.15.122:0/3942386603 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:25.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.207+0000 7fe986a00640 1 -- 172.21.15.122:0/3942386603 >> v2:172.21.15.153:3300/0 conn(0x7fe9880d1f30 msgr2=0x7fe988160a00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-28T06:11:25.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.207+0000 7fe986a00640 1 --2- 172.21.15.122:0/3942386603 >> v2:172.21.15.153:3300/0 conn(0x7fe9880d1f30 0x7fe988160a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:25.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.207+0000 7fe986a00640 1 -- 172.21.15.122:0/3942386603 >> v1:172.21.15.153:6789/0 conn(0x7fe9880cf180 legacy=0x7fe9880d1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:25.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.207+0000 7fe986a00640 1 -- 172.21.15.122:0/3942386603 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe988160200 con 0x7fe98815eb70 2024-05-28T06:11:25.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.211+0000 7fe986a00640 1 --2- 172.21.15.122:0/3942386603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe98815eb70 0x7fe98815ef50 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe978009870 tx=0x7fe97801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a357ed5938030d server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:25.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.219+0000 7fe985600640 1 -- 172.21.15.122:0/3942386603 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9780b1070 con 0x7fe98815eb70 2024-05-28T06:11:25.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.219+0000 7fe985600640 1 -- 172.21.15.122:0/3942386603 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe98815f6a0 con 0x7fe98815eb70 2024-05-28T06:11:25.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.219+0000 7fe985600640 1 -- 172.21.15.122:0/3942386603 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9780ac840 con 0x7fe98815eb70 2024-05-28T06:11:25.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.219+0000 7fe98d600640 1 -- 172.21.15.122:0/3942386603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe98815eb70 msgr2=0x7fe98815ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:25.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.219+0000 7fe98d600640 1 --2- 172.21.15.122:0/3942386603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe98815eb70 0x7fe98815ef50 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe978009870 tx=0x7fe97801c4b0 comp rx=0 tx=0).stop 2024-05-28T06:11:25.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.219+0000 7fe98d600640 1 -- 172.21.15.122:0/3942386603 shutdown_connections 2024-05-28T06:11:25.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.219+0000 7fe98d600640 1 --2- 172.21.15.122:0/3942386603 >> v2:172.21.15.153:3300/0 conn(0x7fe9880d1f30 0x7fe988160a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:25.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.219+0000 7fe98d600640 1 --2- 172.21.15.122:0/3942386603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe98815eb70 0x7fe98815ef50 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:25.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.219+0000 7fe98d600640 1 -- 172.21.15.122:0/3942386603 >> 172.21.15.122:0/3942386603 conn(0x7fe988062840 msgr2=0x7fe988062c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:25.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.219+0000 7fe98d600640 1 -- 172.21.15.122:0/3942386603 shutdown_connections 2024-05-28T06:11:25.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.219+0000 7fe98d600640 1 -- 172.21.15.122:0/3942386603 wait complete. 2024-05-28T06:11:25.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.227+0000 7fe98d600640 1 Processor -- start 2024-05-28T06:11:25.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.227+0000 7fe98d600640 1 -- start start 2024-05-28T06:11:25.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.231+0000 7fe98d600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9880cf180 0x7fe9880cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:25.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.231+0000 7fe98d600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9880d1f30 0x7fe988168680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:25.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.231+0000 7fe98d600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe98815eb70 0x7fe988168bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:25.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.231+0000 7fe98d600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe988161ae0 con 0x7fe9880d1f30 2024-05-28T06:11:25.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.231+0000 7fe98d600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe988161960 con 0x7fe98815eb70 2024-05-28T06:11:25.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.231+0000 7fe98d600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe988161c60 con 0x7fe9880cf180 2024-05-28T06:11:25.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.231+0000 7fe986a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9880cf180 0x7fe9880cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:25.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.235+0000 7fe986000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9880d1f30 0x7fe988168680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:25.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.235+0000 7fe987400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe98815eb70 0x7fe988168bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:25.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.235+0000 7fe986000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9880d1f30 0x7fe988168680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:33804/0 (socket says 172.21.15.122:33804) 2024-05-28T06:11:25.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.235+0000 7fe986000640 1 -- 172.21.15.122:0/1763394022 learned_addr learned my addr 172.21.15.122:0/1763394022 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:25.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.235+0000 7fe986000640 1 -- 172.21.15.122:0/1763394022 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9880cf180 msgr2=0x7fe9880cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:25.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.235+0000 7fe986000640 1 --2- 172.21.15.122:0/1763394022 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9880cf180 0x7fe9880cbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:25.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.235+0000 7fe986000640 1 -- 172.21.15.122:0/1763394022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe98815eb70 msgr2=0x7fe988168bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:25.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.235+0000 7fe986000640 1 --2- 172.21.15.122:0/1763394022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe98815eb70 0x7fe988168bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:25.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.235+0000 7fe986000640 1 -- 172.21.15.122:0/1763394022 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9881fbe40 con 0x7fe9880d1f30 2024-05-28T06:11:25.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.235+0000 7fe987400640 1 --2- 172.21.15.122:0/1763394022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe98815eb70 0x7fe988168bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:11:25.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.235+0000 7fe986000640 1 --2- 172.21.15.122:0/1763394022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9880d1f30 0x7fe988168680 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe974007fd0 tx=0x7fe97400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:25.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.235+0000 7fe97ea00640 1 -- 172.21.15.122:0/1763394022 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe974017070 con 0x7fe9880d1f30 2024-05-28T06:11:25.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.235+0000 7fe97ea00640 1 -- 172.21.15.122:0/1763394022 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9740052f0 con 0x7fe9880d1f30 2024-05-28T06:11:25.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.235+0000 7fe97ea00640 1 -- 172.21.15.122:0/1763394022 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe974003840 con 0x7fe9880d1f30 2024-05-28T06:11:25.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.235+0000 7fe98d600640 1 -- 172.21.15.122:0/1763394022 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9880d2590 con 0x7fe9880d1f30 2024-05-28T06:11:25.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.235+0000 7fe98d600640 1 -- 172.21.15.122:0/1763394022 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9880d2b50 con 0x7fe9880d1f30 2024-05-28T06:11:25.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.239+0000 7fe98d600640 1 -- 172.21.15.122:0/1763394022 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe988068c40 con 0x7fe9880d1f30 2024-05-28T06:11:25.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.243+0000 7fe97ea00640 1 -- 172.21.15.122:0/1763394022 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 14) ==== 88446+0+0 (secure 0 0 0) 0x7fe97401a070 con 0x7fe9880d1f30 2024-05-28T06:11:25.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.251+0000 7fe97ea00640 1 --2- 172.21.15.122:0/1763394022 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe968068960 0x7fe96806ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:25.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.259+0000 7fe97ea00640 1 -- 172.21.15.122:0/1763394022 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7fe974086660 con 0x7fe9880d1f30 2024-05-28T06:11:25.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.259+0000 7fe986a00640 1 --2- 172.21.15.122:0/1763394022 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe968068960 0x7fe96806ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:25.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.267+0000 7fe97ea00640 1 -- 172.21.15.122:0/1763394022 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe974056520 con 0x7fe9880d1f30 2024-05-28T06:11:25.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.271+0000 7fe986a00640 1 --2- 172.21.15.122:0/1763394022 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe968068960 0x7fe96806ae20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe9780ae000 tx=0x7fe978008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:25.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.531+0000 7fe97ea00640 1 -- 172.21.15.122:0/1763394022 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mgrmap(e 15) ==== 88548+0+0 (secure 0 0 0) 0x7fe974052490 con 0x7fe9880d1f30 2024-05-28T06:11:25.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:25.783+0000 7fe98d600640 1 -- 172.21.15.122:0/1763394022 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone24474", "target": ["mon-mgr", ""]}) -- 0x7fe98815f6a0 con 0x7fe968068960 2024-05-28T06:11:26.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:26.687+0000 7fe97ea00640 1 -- 172.21.15.122:0/1763394022 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe98815f6a0 con 0x7fe968068960 2024-05-28T06:11:26.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:26.691+0000 7fe98d600640 1 -- 172.21.15.122:0/1763394022 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe968068960 msgr2=0x7fe96806ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:26.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:26.691+0000 7fe98d600640 1 --2- 172.21.15.122:0/1763394022 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe968068960 0x7fe96806ae20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe9780ae000 tx=0x7fe978008040 comp rx=0 tx=0).stop 2024-05-28T06:11:26.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:26.691+0000 7fe98d600640 1 -- 172.21.15.122:0/1763394022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9880d1f30 msgr2=0x7fe988168680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:26.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:26.691+0000 7fe98d600640 1 --2- 172.21.15.122:0/1763394022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9880d1f30 0x7fe988168680 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe974007fd0 tx=0x7fe97400c890 comp rx=0 tx=0).stop 2024-05-28T06:11:26.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:26.695+0000 7fe98d600640 1 -- 172.21.15.122:0/1763394022 shutdown_connections 2024-05-28T06:11:26.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:26.695+0000 7fe98d600640 1 --2- 172.21.15.122:0/1763394022 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe968068960 0x7fe96806ae20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:26.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:26.695+0000 7fe98d600640 1 --2- 172.21.15.122:0/1763394022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe98815eb70 0x7fe988168bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:26.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:26.695+0000 7fe98d600640 1 --2- 172.21.15.122:0/1763394022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9880d1f30 0x7fe988168680 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:26.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:26.695+0000 7fe98d600640 1 --2- 172.21.15.122:0/1763394022 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9880cf180 0x7fe9880cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:26.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:26.695+0000 7fe98d600640 1 -- 172.21.15.122:0/1763394022 >> 172.21.15.122:0/1763394022 conn(0x7fe988062840 msgr2=0x7fe9880b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:26.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:26.695+0000 7fe98d600640 1 -- 172.21.15.122:0/1763394022 shutdown_connections 2024-05-28T06:11:26.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:26.695+0000 7fe98d600640 1 -- 172.21.15.122:0/1763394022 wait complete. 2024-05-28T06:11:26.792 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:11:27.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.163+0000 7f81cce00640 1 Processor -- start 2024-05-28T06:11:27.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.163+0000 7f81cce00640 1 -- start start 2024-05-28T06:11:27.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.167+0000 7f81cce00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81c004fa80 0x7f81c004fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:27.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.167+0000 7f81cce00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f81c00df390 0x7f81c0007190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:27.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.171+0000 7f81cce00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f81c004f5c0 0x7f81c0038020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:27.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.171+0000 7f81c7400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81c004fa80 0x7f81c004fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:27.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.171+0000 7f81c7400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81c004fa80 0x7f81c004fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:49884/0 (socket says 172.21.15.122:49884) 2024-05-28T06:11:27.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.171+0000 7f81c6a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f81c00df390 0x7f81c0007190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:27.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.171+0000 7f81c6a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f81c00df390 0x7f81c0007190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:57334/0 (socket says 172.21.15.122:57334) 2024-05-28T06:11:27.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.171+0000 7f81c7400640 1 -- 172.21.15.122:0/3999652690 learned_addr learned my addr 172.21.15.122:0/3999652690 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:27.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.175+0000 7f81cce00640 1 -- 172.21.15.122:0/3999652690 --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f81c0005ea0 con 0x7f81c004f5c0 2024-05-28T06:11:27.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.175+0000 7f81cce00640 1 -- 172.21.15.122:0/3999652690 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f81c0006d00 con 0x7f81c00df390 2024-05-28T06:11:27.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.175+0000 7f81cce00640 1 -- 172.21.15.122:0/3999652690 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f81c0054390 con 0x7f81c004fa80 2024-05-28T06:11:27.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.179+0000 7f81c6a00640 1 -- 172.21.15.122:0/3999652690 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81c004fa80 msgr2=0x7f81c004fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:11:27.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.179+0000 7f81c6a00640 1 --2- 172.21.15.122:0/3999652690 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81c004fa80 0x7f81c004fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:27.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.179+0000 7f81c6a00640 1 -- 172.21.15.122:0/3999652690 >> v2:172.21.15.122:3300/0 conn(0x7f81c004f5c0 msgr2=0x7f81c0038020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:11:27.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.179+0000 7f81c6a00640 1 --2- 172.21.15.122:0/3999652690 >> v2:172.21.15.122:3300/0 conn(0x7f81c004f5c0 0x7f81c0038020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:27.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.179+0000 7f81c6a00640 1 -- 172.21.15.122:0/3999652690 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c00503a0 con 0x7f81c00df390 2024-05-28T06:11:27.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.187+0000 7f81c7400640 1 --2- 172.21.15.122:0/3999652690 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81c004fa80 0x7f81c004fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:11:27.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.191+0000 7f81c6a00640 1 --2- 172.21.15.122:0/3999652690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81c00df390 0x7f81c0007190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f81c00524e0 tx=0x7f81b401d6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3837e5115a60e886 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:27.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.195+0000 7f81c6000640 1 -- 172.21.15.122:0/3999652690 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b40b3070 con 0x7f81c00df390 2024-05-28T06:11:27.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.195+0000 7f81c6000640 1 -- 172.21.15.122:0/3999652690 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b40a6730 con 0x7f81c00df390 2024-05-28T06:11:27.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.195+0000 7f81c6000640 1 -- 172.21.15.122:0/3999652690 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b40a6b40 con 0x7f81c00df390 2024-05-28T06:11:27.204 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.203+0000 7f81cce00640 1 -- 172.21.15.122:0/3999652690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81c00df390 msgr2=0x7f81c0007190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:27.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.203+0000 7f81cce00640 1 --2- 172.21.15.122:0/3999652690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81c00df390 0x7f81c0007190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f81c00524e0 tx=0x7f81b401d6c0 comp rx=0 tx=0).stop 2024-05-28T06:11:27.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.207+0000 7f81cce00640 1 -- 172.21.15.122:0/3999652690 shutdown_connections 2024-05-28T06:11:27.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.207+0000 7f81cce00640 1 --2- 172.21.15.122:0/3999652690 >> v2:172.21.15.122:3300/0 conn(0x7f81c004f5c0 0x7f81c0038020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:27.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.207+0000 7f81cce00640 1 --2- 172.21.15.122:0/3999652690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81c00df390 0x7f81c0007190 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:27.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.207+0000 7f81cce00640 1 --2- 172.21.15.122:0/3999652690 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81c004fa80 0x7f81c004fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:27.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.207+0000 7f81cce00640 1 -- 172.21.15.122:0/3999652690 >> 172.21.15.122:0/3999652690 conn(0x7f81c0009fc0 msgr2=0x7f81c000a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:27.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.207+0000 7f81cce00640 1 -- 172.21.15.122:0/3999652690 shutdown_connections 2024-05-28T06:11:27.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.207+0000 7f81cce00640 1 -- 172.21.15.122:0/3999652690 wait complete. 2024-05-28T06:11:27.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.211+0000 7f81cce00640 1 Processor -- start 2024-05-28T06:11:27.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.215+0000 7f81cce00640 1 -- start start 2024-05-28T06:11:27.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.219+0000 7f81cce00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81c004f5c0 0x7f81c00ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:27.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.219+0000 7f81cce00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81c004fa80 0x7f81c00ce520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:27.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.219+0000 7f81cce00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81c00df390 0x7f81c004c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:27.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.219+0000 7f81cce00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f81c00076d0 con 0x7f81c004fa80 2024-05-28T06:11:27.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.219+0000 7f81cce00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f81c0006990 con 0x7f81c004f5c0 2024-05-28T06:11:27.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.219+0000 7f81cce00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f81c004bba0 con 0x7f81c00df390 2024-05-28T06:11:27.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.219+0000 7f81c7e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81c00df390 0x7f81c004c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:27.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.219+0000 7f81c7e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81c00df390 0x7f81c004c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:49900/0 (socket says 172.21.15.122:49900) 2024-05-28T06:11:27.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.219+0000 7f81c7e00640 1 -- 172.21.15.122:0/2638968323 learned_addr learned my addr 172.21.15.122:0/2638968323 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:27.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.219+0000 7f81c7400640 1 --2- 172.21.15.122:0/2638968323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81c004f5c0 0x7f81c00ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:27.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.219+0000 7f81c6a00640 1 --2- 172.21.15.122:0/2638968323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81c004fa80 0x7f81c00ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:27.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.219+0000 7f81c7e00640 1 -- 172.21.15.122:0/2638968323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81c004f5c0 msgr2=0x7f81c00ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:27.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.219+0000 7f81c7e00640 1 --2- 172.21.15.122:0/2638968323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81c004f5c0 0x7f81c00ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:27.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.219+0000 7f81c7e00640 1 -- 172.21.15.122:0/2638968323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81c004fa80 msgr2=0x7f81c00ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:27.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.219+0000 7f81c7e00640 1 --2- 172.21.15.122:0/2638968323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81c004fa80 0x7f81c00ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:27.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.219+0000 7f81c7e00640 1 -- 172.21.15.122:0/2638968323 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c004be80 con 0x7f81c00df390 2024-05-28T06:11:27.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.219+0000 7f81c6a00640 1 --2- 172.21.15.122:0/2638968323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81c004fa80 0x7f81c00ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:11:27.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.223+0000 7f81c7e00640 1 --2- 172.21.15.122:0/2638968323 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81c00df390 0x7f81c004c850 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f81c8050b40 tx=0x7f81c80695a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:27.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.223+0000 7f81bb400640 1 -- 172.21.15.122:0/2638968323 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c8068eb0 con 0x7f81c00df390 2024-05-28T06:11:27.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.223+0000 7f81cce00640 1 -- 172.21.15.122:0/2638968323 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c00d12b0 con 0x7f81c00df390 2024-05-28T06:11:27.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.223+0000 7f81cce00640 1 -- 172.21.15.122:0/2638968323 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c00d1870 con 0x7f81c00df390 2024-05-28T06:11:27.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.223+0000 7f81bb400640 1 -- 172.21.15.122:0/2638968323 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c8068eb0 con 0x7f81c00df390 2024-05-28T06:11:27.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.223+0000 7f81bb400640 1 -- 172.21.15.122:0/2638968323 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c8075550 con 0x7f81c00df390 2024-05-28T06:11:27.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.223+0000 7f81cce00640 1 -- 172.21.15.122:0/2638968323 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81a40052a0 con 0x7f81c00df390 2024-05-28T06:11:27.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.227+0000 7f81bb400640 1 -- 172.21.15.122:0/2638968323 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 15) ==== 88548+0+0 (secure 0 0 0) 0x7f81c80757b0 con 0x7f81c00df390 2024-05-28T06:11:27.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.227+0000 7f81bb400640 1 --2- 172.21.15.122:0/2638968323 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f81a8068bb0 0x7f81a806b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:27.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.227+0000 7f81bb400640 1 -- 172.21.15.122:0/2638968323 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7f81c8102420 con 0x7f81c00df390 2024-05-28T06:11:27.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.235+0000 7f81c7400640 1 --2- 172.21.15.122:0/2638968323 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f81a8068bb0 0x7f81a806b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:27.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.239+0000 7f81c7400640 1 --2- 172.21.15.122:0/2638968323 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f81a8068bb0 0x7f81a806b070 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f81c00d4aa0 tx=0x7f81bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:27.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.239+0000 7f81bb400640 1 -- 172.21.15.122:0/2638968323 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f81c808f030 con 0x7f81c00df390 2024-05-28T06:11:27.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.747+0000 7f81cce00640 1 -- 172.21.15.122:0/2638968323 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f81a4005860 con 0x7f81c00df390 2024-05-28T06:11:27.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.755+0000 7f81bb400640 1 -- 172.21.15.122:0/2638968323 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2131 (secure 0 0 0) 0x7f81c808f030 con 0x7f81c00df390 2024-05-28T06:11:27.756 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:11:27.760 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:11:27.760 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:11:27.760 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:11:27.760 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:11:27.760 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:11:27.760 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:11:27.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:27.760 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:11:27.760 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:11:27.760 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:11:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:11:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:11:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:11:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:11:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:11:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:11:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 363, 2024-05-28T06:11:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:11:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:11:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:11:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:11:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:11:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 49, 2024-05-28T06:11:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:11:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:11:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:11:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:11:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:11:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:11:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:11:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:11:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:11:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:11:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:11:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:11:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:11:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 2588, 2024-05-28T06:11:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 10738623906, 2024-05-28T06:11:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 21784080384, 2024-05-28T06:11:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 751310032896, 2024-05-28T06:11:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:11:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: "read_bytes_sec": 170, 2024-05-28T06:11:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 89394421, 2024-05-28T06:11:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 0, 2024-05-28T06:11:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 23 2024-05-28T06:11:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:11:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 29, 2024-05-28T06:11:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 3, 2024-05-28T06:11:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:11:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:11:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:11:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:11:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:11:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 3, 2024-05-28T06:11:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:11:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "a", 2024-05-28T06:11:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:11:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 5679 2024-05-28T06:11:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:11:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:11:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:11:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:11:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:11:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:11:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:11:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:11:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:11:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:11:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 8, 2024-05-28T06:11:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:10:43.307303+0000", 2024-05-28T06:11:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:11:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:11:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: "ed0906d2-55cb-4fe9-b815-1869630be1ae": { 2024-05-28T06:11:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "3 ongoing clones; Avg progress is 5.495% (3s)\n [=...........................] (remaining: 52s)", 2024-05-28T06:11:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.05494999885559082, 2024-05-28T06:11:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:11:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:27.766 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:11:27.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.771+0000 7f81cce00640 1 -- 172.21.15.122:0/2638968323 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f81a8068bb0 msgr2=0x7f81a806b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:27.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.771+0000 7f81cce00640 1 --2- 172.21.15.122:0/2638968323 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f81a8068bb0 0x7f81a806b070 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f81c00d4aa0 tx=0x7f81bc008040 comp rx=0 tx=0).stop 2024-05-28T06:11:27.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.771+0000 7f81cce00640 1 -- 172.21.15.122:0/2638968323 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81c00df390 msgr2=0x7f81c004c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:27.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.771+0000 7f81cce00640 1 --2- 172.21.15.122:0/2638968323 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81c00df390 0x7f81c004c850 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f81c8050b40 tx=0x7f81c80695a0 comp rx=0 tx=0).stop 2024-05-28T06:11:27.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.771+0000 7f81cce00640 1 -- 172.21.15.122:0/2638968323 shutdown_connections 2024-05-28T06:11:27.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.771+0000 7f81cce00640 1 --2- 172.21.15.122:0/2638968323 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f81a8068bb0 0x7f81a806b070 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:27.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.771+0000 7f81cce00640 1 --2- 172.21.15.122:0/2638968323 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81c00df390 0x7f81c004c850 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:27.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.771+0000 7f81cce00640 1 --2- 172.21.15.122:0/2638968323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81c004fa80 0x7f81c00ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:27.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.771+0000 7f81cce00640 1 --2- 172.21.15.122:0/2638968323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81c004f5c0 0x7f81c00ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:27.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.771+0000 7f81cce00640 1 -- 172.21.15.122:0/2638968323 >> 172.21.15.122:0/2638968323 conn(0x7f81c0009fc0 msgr2=0x7f81c0048dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:27.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.771+0000 7f81cce00640 1 -- 172.21.15.122:0/2638968323 shutdown_connections 2024-05-28T06:11:27.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:27.771+0000 7f81cce00640 1 -- 172.21.15.122:0/2638968323 wait complete. 2024-05-28T06:11:27.855 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone24471 2024-05-28T06:11:28.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.251+0000 7f8beac00640 1 Processor -- start 2024-05-28T06:11:28.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.251+0000 7f8beac00640 1 -- start start 2024-05-28T06:11:28.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.255+0000 7f8beac00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8be4071ea0 0x7f8be4072280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:28.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.255+0000 7f8beac00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8be4072ef0 0x7f8be40b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:28.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.255+0000 7f8beac00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8be40727c0 con 0x7f8be40b5b40 2024-05-28T06:11:28.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.255+0000 7f8beac00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8be416ba20 con 0x7f8be4071ea0 2024-05-28T06:11:28.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.255+0000 7f8beac00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8be40cf200 con 0x7f8be4072ef0 2024-05-28T06:11:28.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.259+0000 7f8be3e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8be4071ea0 0x7f8be4072280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:28.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.259+0000 7f8be3e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8be4071ea0 0x7f8be4072280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:57358/0 (socket says 172.21.15.122:57358) 2024-05-28T06:11:28.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.259+0000 7f8be8c00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8be40b5b40 0x7f8be40b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:33362/0 (socket says 172.21.15.122:33362) 2024-05-28T06:11:28.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.259+0000 7f8be3e00640 1 -- 172.21.15.122:0/3934571920 learned_addr learned my addr 172.21.15.122:0/3934571920 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:28.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.263+0000 7f8be3e00640 1 -- 172.21.15.122:0/3934571920 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8be4072ef0 msgr2=0x7f8be40b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:11:28.263 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.263+0000 7f8be3e00640 1 --2- 172.21.15.122:0/3934571920 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8be4072ef0 0x7f8be40b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:28.263 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.263+0000 7f8be3e00640 1 -- 172.21.15.122:0/3934571920 >> v1:172.21.15.153:6789/0 conn(0x7f8be40b5b40 legacy=0x7f8be40b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:11:28.263 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.263+0000 7f8be3e00640 1 -- 172.21.15.122:0/3934571920 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be40cf4e0 con 0x7f8be4071ea0 2024-05-28T06:11:28.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.279+0000 7f8be3e00640 1 --2- 172.21.15.122:0/3934571920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be4071ea0 0x7f8be4072280 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40098a0 tx=0x7f8be40b47f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=212b6340ca555777 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:28.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.279+0000 7f8be2a00640 1 -- 172.21.15.122:0/3934571920 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd40b0070 con 0x7f8be4071ea0 2024-05-28T06:11:28.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.279+0000 7f8be2a00640 1 -- 172.21.15.122:0/3934571920 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bd40ab600 con 0x7f8be4071ea0 2024-05-28T06:11:28.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.279+0000 7f8be2a00640 1 -- 172.21.15.122:0/3934571920 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd40ab9d0 con 0x7f8be4071ea0 2024-05-28T06:11:28.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.283+0000 7f8beac00640 1 -- 172.21.15.122:0/3934571920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be4071ea0 msgr2=0x7f8be4072280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:28.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.283+0000 7f8beac00640 1 --2- 172.21.15.122:0/3934571920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be4071ea0 0x7f8be4072280 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40098a0 tx=0x7f8be40b47f0 comp rx=0 tx=0).stop 2024-05-28T06:11:28.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.283+0000 7f8beac00640 1 -- 172.21.15.122:0/3934571920 shutdown_connections 2024-05-28T06:11:28.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.283+0000 7f8beac00640 1 --2- 172.21.15.122:0/3934571920 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8be4072ef0 0x7f8be40b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:28.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.283+0000 7f8beac00640 1 --2- 172.21.15.122:0/3934571920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be4071ea0 0x7f8be4072280 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:28.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.283+0000 7f8beac00640 1 -- 172.21.15.122:0/3934571920 >> 172.21.15.122:0/3934571920 conn(0x7f8be40700f0 msgr2=0x7f8be406b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:28.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.283+0000 7f8beac00640 1 -- 172.21.15.122:0/3934571920 shutdown_connections 2024-05-28T06:11:28.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.283+0000 7f8beac00640 1 -- 172.21.15.122:0/3934571920 wait complete. 2024-05-28T06:11:28.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.287+0000 7f8beac00640 1 Processor -- start 2024-05-28T06:11:28.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.287+0000 7f8beac00640 1 -- start start 2024-05-28T06:11:28.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.291+0000 7f8beac00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8be4071ea0 0x7f8be416bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:28.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.291+0000 7f8beac00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8be4072ef0 0x7f8be416c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:28.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.291+0000 7f8beac00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be40b5b40 0x7f8be416d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:28.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.291+0000 7f8beac00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8be4174310 con 0x7f8be4071ea0 2024-05-28T06:11:28.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.291+0000 7f8beac00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8be4174190 con 0x7f8be40b5b40 2024-05-28T06:11:28.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.291+0000 7f8beac00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8be4174490 con 0x7f8be4072ef0 2024-05-28T06:11:28.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.291+0000 7f8be3e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8be4071ea0 0x7f8be416bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:28.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.291+0000 7f8be3e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8be4071ea0 0x7f8be416bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52688/0 (socket says 172.21.15.122:52688) 2024-05-28T06:11:28.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.291+0000 7f8be3e00640 1 -- 172.21.15.122:0/486160072 learned_addr learned my addr 172.21.15.122:0/486160072 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:28.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.295+0000 7f8be3e00640 1 -- 172.21.15.122:0/486160072 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8be4072ef0 msgr2=0x7f8be416c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:28.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.295+0000 7f8be3e00640 1 --2- 172.21.15.122:0/486160072 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8be4072ef0 0x7f8be416c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:28.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.295+0000 7f8be3e00640 1 -- 172.21.15.122:0/486160072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be40b5b40 msgr2=0x7f8be416d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:28.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.295+0000 7f8be3e00640 1 --2- 172.21.15.122:0/486160072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be40b5b40 0x7f8be416d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:28.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.295+0000 7f8be3e00640 1 -- 172.21.15.122:0/486160072 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be416ca50 con 0x7f8be4071ea0 2024-05-28T06:11:28.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.295+0000 7f8be3e00640 1 --2- 172.21.15.122:0/486160072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8be4071ea0 0x7f8be416bc20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8bd401ab20 tx=0x7f8bd4019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:28.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.299+0000 7f8bdbe00640 1 -- 172.21.15.122:0/486160072 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd40b0050 con 0x7f8be4071ea0 2024-05-28T06:11:28.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.299+0000 7f8beac00640 1 -- 172.21.15.122:0/486160072 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be40b1d40 con 0x7f8be4071ea0 2024-05-28T06:11:28.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.299+0000 7f8beac00640 1 -- 172.21.15.122:0/486160072 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be40b22a0 con 0x7f8be4071ea0 2024-05-28T06:11:28.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.299+0000 7f8bdbe00640 1 -- 172.21.15.122:0/486160072 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bd40bb070 con 0x7f8be4071ea0 2024-05-28T06:11:28.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.299+0000 7f8bdbe00640 1 -- 172.21.15.122:0/486160072 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd40b0050 con 0x7f8be4071ea0 2024-05-28T06:11:28.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.303+0000 7f8beac00640 1 -- 172.21.15.122:0/486160072 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bbc0052a0 con 0x7f8be4071ea0 2024-05-28T06:11:28.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.311+0000 7f8bdbe00640 1 -- 172.21.15.122:0/486160072 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 15) ==== 88548+0+0 (secure 0 0 0) 0x7f8bd40b5810 con 0x7f8be4071ea0 2024-05-28T06:11:28.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.315+0000 7f8bdbe00640 1 --2- 172.21.15.122:0/486160072 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8bc4068bb0 0x7f8bc406b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:28.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.315+0000 7f8bdbe00640 1 -- 172.21.15.122:0/486160072 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7f8bd4121a70 con 0x7f8be4071ea0 2024-05-28T06:11:28.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.319+0000 7f8be3400640 1 --2- 172.21.15.122:0/486160072 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8bc4068bb0 0x7f8bc406b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:28.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.323+0000 7f8be3400640 1 --2- 172.21.15.122:0/486160072 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8bc4068bb0 0x7f8bc406b070 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8be416ae80 tx=0x7f8bd0006ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:28.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.323+0000 7f8bdbe00640 1 -- 172.21.15.122:0/486160072 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8be40b1d40 con 0x7f8be4071ea0 2024-05-28T06:11:28.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:28.891+0000 7f8beac00640 1 -- 172.21.15.122:0/486160072 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone24471", "target": ["mon-mgr", ""]}) -- 0x7f8bbc000bd0 con 0x7f8bc4068bb0 2024-05-28T06:11:29.026 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:29.027+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:29.026 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:29.027+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:29.026 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:29.027+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:29.026 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:29.027+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:29.026 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:11:29.027+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:11:29.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:29.683+0000 7f8bdbe00640 1 -- 172.21.15.122:0/486160072 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mgrmap(e 16) ==== 88599+0+0 (secure 0 0 0) 0x7f8bd40ed6f0 con 0x7f8be4071ea0 2024-05-28T06:11:30.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:30.799+0000 7f8bdbe00640 1 -- 172.21.15.122:0/486160072 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8bbc000bd0 con 0x7f8bc4068bb0 2024-05-28T06:11:30.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:30.803+0000 7f8beac00640 1 -- 172.21.15.122:0/486160072 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8bc4068bb0 msgr2=0x7f8bc406b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:30.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:30.803+0000 7f8beac00640 1 --2- 172.21.15.122:0/486160072 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8bc4068bb0 0x7f8bc406b070 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8be416ae80 tx=0x7f8bd0006ca0 comp rx=0 tx=0).stop 2024-05-28T06:11:30.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:30.803+0000 7f8beac00640 1 -- 172.21.15.122:0/486160072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8be4071ea0 msgr2=0x7f8be416bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:30.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:30.803+0000 7f8beac00640 1 --2- 172.21.15.122:0/486160072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8be4071ea0 0x7f8be416bc20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8bd401ab20 tx=0x7f8bd4019210 comp rx=0 tx=0).stop 2024-05-28T06:11:30.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:30.803+0000 7f8beac00640 1 -- 172.21.15.122:0/486160072 shutdown_connections 2024-05-28T06:11:30.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:30.803+0000 7f8beac00640 1 --2- 172.21.15.122:0/486160072 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8bc4068bb0 0x7f8bc406b070 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:30.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:30.803+0000 7f8beac00640 1 --2- 172.21.15.122:0/486160072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be40b5b40 0x7f8be416d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:30.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:30.803+0000 7f8beac00640 1 --2- 172.21.15.122:0/486160072 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8be4072ef0 0x7f8be416c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:30.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:30.803+0000 7f8beac00640 1 --2- 172.21.15.122:0/486160072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8be4071ea0 0x7f8be416bc20 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:30.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:30.803+0000 7f8beac00640 1 -- 172.21.15.122:0/486160072 >> 172.21.15.122:0/486160072 conn(0x7f8be40700f0 msgr2=0x7f8be4175e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:30.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:30.803+0000 7f8beac00640 1 -- 172.21.15.122:0/486160072 shutdown_connections 2024-05-28T06:11:30.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:30.803+0000 7f8beac00640 1 -- 172.21.15.122:0/486160072 wait complete. 2024-05-28T06:11:30.862 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone24472 2024-05-28T06:11:31.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.275+0000 7fe1d8200640 1 Processor -- start 2024-05-28T06:11:31.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.275+0000 7fe1d8200640 1 -- start start 2024-05-28T06:11:31.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.279+0000 7fe1d8200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1d00d0120 0x7fe1d00ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:31.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.279+0000 7fe1d8200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe1d00b63f0 0x7fe1d00b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:31.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.279+0000 7fe1d8200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d00cfba0 con 0x7fe1d006ff90 2024-05-28T06:11:31.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.279+0000 7fe1d8200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe1d00cf300 con 0x7fe1d00b63f0 2024-05-28T06:11:31.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.279+0000 7fe1d8200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d00cf5e0 con 0x7fe1d00d0120 2024-05-28T06:11:31.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.279+0000 7fe1d5800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1d00d0120 0x7fe1d00ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:31.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.279+0000 7fe1d5800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1d00d0120 0x7fe1d00ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:49950/0 (socket says 172.21.15.122:49950) 2024-05-28T06:11:31.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.279+0000 7fe1d5800640 1 -- 172.21.15.122:0/1492955958 learned_addr learned my addr 172.21.15.122:0/1492955958 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:31.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.283+0000 7fe1d5800640 1 -- 172.21.15.122:0/1492955958 >> v2:172.21.15.153:3300/0 conn(0x7fe1d00b63f0 msgr2=0x7fe1d00b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:11:31.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.283+0000 7fe1d6200640 1 --2- 172.21.15.122:0/1492955958 >> v2:172.21.15.153:3300/0 conn(0x7fe1d00b63f0 0x7fe1d00b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:31.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.283+0000 7fe1d5800640 1 --2- 172.21.15.122:0/1492955958 >> v2:172.21.15.153:3300/0 conn(0x7fe1d00b63f0 0x7fe1d00b3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:31.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.283+0000 7fe1d5800640 1 -- 172.21.15.122:0/1492955958 >> v1:172.21.15.153:6789/0 conn(0x7fe1d006ff90 legacy=0x7fe1d00b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:11:31.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.283+0000 7fe1d5800640 1 -- 172.21.15.122:0/1492955958 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d00cf8c0 con 0x7fe1d00d0120 2024-05-28T06:11:31.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.283+0000 7fe1d6200640 1 --2- 172.21.15.122:0/1492955958 >> v2:172.21.15.153:3300/0 conn(0x7fe1d00b63f0 0x7fe1d00b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:11:31.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.291+0000 7fe1d5800640 1 --2- 172.21.15.122:0/1492955958 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1d00d0120 0x7fe1d00ce820 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe1d006fec0 tx=0x7fe1c001c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19ca91699cf7a2c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:31.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.291+0000 7fe1cfe00640 1 -- 172.21.15.122:0/1492955958 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c00b0070 con 0x7fe1d00d0120 2024-05-28T06:11:31.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.291+0000 7fe1cfe00640 1 -- 172.21.15.122:0/1492955958 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c00ab600 con 0x7fe1d00d0120 2024-05-28T06:11:31.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.291+0000 7fe1cfe00640 1 -- 172.21.15.122:0/1492955958 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c00ab9d0 con 0x7fe1d00d0120 2024-05-28T06:11:31.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.291+0000 7fe1d8200640 1 -- 172.21.15.122:0/1492955958 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1d00d0120 msgr2=0x7fe1d00ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:31.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.291+0000 7fe1d8200640 1 --2- 172.21.15.122:0/1492955958 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1d00d0120 0x7fe1d00ce820 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe1d006fec0 tx=0x7fe1c001c500 comp rx=0 tx=0).stop 2024-05-28T06:11:31.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.295+0000 7fe1d8200640 1 -- 172.21.15.122:0/1492955958 shutdown_connections 2024-05-28T06:11:31.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.295+0000 7fe1d8200640 1 --2- 172.21.15.122:0/1492955958 >> v2:172.21.15.153:3300/0 conn(0x7fe1d00b63f0 0x7fe1d00b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:31.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.299+0000 7fe1d8200640 1 --2- 172.21.15.122:0/1492955958 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1d00d0120 0x7fe1d00ce820 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:31.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.299+0000 7fe1d8200640 1 -- 172.21.15.122:0/1492955958 >> 172.21.15.122:0/1492955958 conn(0x7fe1d006bd90 msgr2=0x7fe1d006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:31.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.299+0000 7fe1d8200640 1 -- 172.21.15.122:0/1492955958 shutdown_connections 2024-05-28T06:11:31.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.299+0000 7fe1d8200640 1 -- 172.21.15.122:0/1492955958 wait complete. 2024-05-28T06:11:31.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.303+0000 7fe1d8200640 1 Processor -- start 2024-05-28T06:11:31.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.303+0000 7fe1d8200640 1 -- start start 2024-05-28T06:11:31.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.303+0000 7fe1d8200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1d006ff90 0x7fe1d0141480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:31.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.307+0000 7fe1d8200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d00b63f0 0x7fe1d0208ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:31.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.307+0000 7fe1d8200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1d015cfe0 0x7fe1d0205460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:31.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.307+0000 7fe1d5800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1d006ff90 0x7fe1d0141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:31.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.307+0000 7fe1d4e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d00b63f0 0x7fe1d0208ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:31.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.307+0000 7fe1d8200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d00b4c60 con 0x7fe1d015cfe0 2024-05-28T06:11:31.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.307+0000 7fe1d8200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d00b4ae0 con 0x7fe1d00b63f0 2024-05-28T06:11:31.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.307+0000 7fe1d8200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d00b4de0 con 0x7fe1d006ff90 2024-05-28T06:11:31.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.307+0000 7fe1d4e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d00b63f0 0x7fe1d0208ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:57406/0 (socket says 172.21.15.122:57406) 2024-05-28T06:11:31.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.307+0000 7fe1d5800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1d006ff90 0x7fe1d0141480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:49954/0 (socket says 172.21.15.122:49954) 2024-05-28T06:11:31.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.307+0000 7fe1d5800640 1 -- 172.21.15.122:0/2386995238 learned_addr learned my addr 172.21.15.122:0/2386995238 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:31.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.307+0000 7fe1d4e00640 1 -- 172.21.15.122:0/2386995238 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1d006ff90 msgr2=0x7fe1d0141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:31.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.307+0000 7fe1d4e00640 1 --2- 172.21.15.122:0/2386995238 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1d006ff90 0x7fe1d0141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:31.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.307+0000 7fe1d4e00640 1 -- 172.21.15.122:0/2386995238 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1d015cfe0 msgr2=0x7fe1d0205460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:31.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.307+0000 7fe1d4e00640 1 --2- 172.21.15.122:0/2386995238 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1d015cfe0 0x7fe1d0205460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:31.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.307+0000 7fe1d4e00640 1 -- 172.21.15.122:0/2386995238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d0141ad0 con 0x7fe1d00b63f0 2024-05-28T06:11:31.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.311+0000 7fe1d4e00640 1 --2- 172.21.15.122:0/2386995238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d00b63f0 0x7fe1d0208ad0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400c3e0 tx=0x7fe1c400c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:31.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.315+0000 7fe1cd600640 1 -- 172.21.15.122:0/2386995238 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4011790 con 0x7fe1d00b63f0 2024-05-28T06:11:31.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.315+0000 7fe1cd600640 1 -- 172.21.15.122:0/2386995238 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c4017070 con 0x7fe1d00b63f0 2024-05-28T06:11:31.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.315+0000 7fe1cd600640 1 -- 172.21.15.122:0/2386995238 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4011b70 con 0x7fe1d00b63f0 2024-05-28T06:11:31.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.315+0000 7fe1d8200640 1 -- 172.21.15.122:0/2386995238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d0141db0 con 0x7fe1d00b63f0 2024-05-28T06:11:31.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.315+0000 7fe1d8200640 1 -- 172.21.15.122:0/2386995238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d02085b0 con 0x7fe1d00b63f0 2024-05-28T06:11:31.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.315+0000 7fe1d8200640 1 -- 172.21.15.122:0/2386995238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1d02087b0 con 0x7fe1d00b63f0 2024-05-28T06:11:31.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.327+0000 7fe1cd600640 1 -- 172.21.15.122:0/2386995238 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 16) ==== 88599+0+0 (secure 0 0 0) 0x7fe1c4011d10 con 0x7fe1d00b63f0 2024-05-28T06:11:31.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.327+0000 7fe1cd600640 1 --2- 172.21.15.122:0/2386995238 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe1b4068a90 0x7fe1b406af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:31.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.327+0000 7fe1cd600640 1 -- 172.21.15.122:0/2386995238 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7fe1c4087d70 con 0x7fe1d00b63f0 2024-05-28T06:11:31.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.331+0000 7fe1d5800640 1 --2- 172.21.15.122:0/2386995238 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe1b4068a90 0x7fe1b406af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:31.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.335+0000 7fe1d5800640 1 --2- 172.21.15.122:0/2386995238 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe1b4068a90 0x7fe1b406af50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0000c10 tx=0x7fe1c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:31.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.351+0000 7fe1cd600640 1 -- 172.21.15.122:0/2386995238 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe1d02087b0 con 0x7fe1d00b63f0 2024-05-28T06:11:31.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:31.967+0000 7fe1d8200640 1 -- 172.21.15.122:0/2386995238 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone24472", "target": ["mon-mgr", ""]}) -- 0x7fe1d0076020 con 0x7fe1b4068a90 2024-05-28T06:11:32.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:32.919+0000 7fe1cd600640 1 -- 172.21.15.122:0/2386995238 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe1c00b1040 con 0x7fe1b4068a90 2024-05-28T06:11:32.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:32.931+0000 7fe1d8200640 1 -- 172.21.15.122:0/2386995238 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe1b4068a90 msgr2=0x7fe1b406af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:32.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:32.931+0000 7fe1d8200640 1 --2- 172.21.15.122:0/2386995238 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe1b4068a90 0x7fe1b406af50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0000c10 tx=0x7fe1c0008040 comp rx=0 tx=0).stop 2024-05-28T06:11:32.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:32.931+0000 7fe1d8200640 1 -- 172.21.15.122:0/2386995238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d00b63f0 msgr2=0x7fe1d0208ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:32.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:32.931+0000 7fe1d8200640 1 --2- 172.21.15.122:0/2386995238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d00b63f0 0x7fe1d0208ad0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400c3e0 tx=0x7fe1c400c8a0 comp rx=0 tx=0).stop 2024-05-28T06:11:32.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:32.935+0000 7fe1d8200640 1 -- 172.21.15.122:0/2386995238 shutdown_connections 2024-05-28T06:11:32.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:32.935+0000 7fe1d8200640 1 --2- 172.21.15.122:0/2386995238 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe1b4068a90 0x7fe1b406af50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:32.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:32.935+0000 7fe1d8200640 1 --2- 172.21.15.122:0/2386995238 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1d015cfe0 0x7fe1d0205460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:32.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:32.935+0000 7fe1d8200640 1 --2- 172.21.15.122:0/2386995238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d00b63f0 0x7fe1d0208ad0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:32.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:32.935+0000 7fe1d8200640 1 --2- 172.21.15.122:0/2386995238 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe1d006ff90 0x7fe1d0141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:32.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:32.935+0000 7fe1d8200640 1 -- 172.21.15.122:0/2386995238 >> 172.21.15.122:0/2386995238 conn(0x7fe1d006bd90 msgr2=0x7fe1d006c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:32.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:32.935+0000 7fe1d8200640 1 -- 172.21.15.122:0/2386995238 shutdown_connections 2024-05-28T06:11:32.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:32.935+0000 7fe1d8200640 1 -- 172.21.15.122:0/2386995238 wait complete. 2024-05-28T06:11:32.999 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone24473 2024-05-28T06:11:33.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.339+0000 7f4c14c00640 1 Processor -- start 2024-05-28T06:11:33.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.339+0000 7f4c14c00640 1 -- start start 2024-05-28T06:11:33.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.339+0000 7f4c14c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4c1009aca0 0x7f4c100b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:33.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.339+0000 7f4c14c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4c1009b080 0x7f4c1009b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:33.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.339+0000 7f4c14c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c100d0bf0 con 0x7f4c1015fb30 2024-05-28T06:11:33.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.339+0000 7f4c14c00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f4c100b5460 con 0x7f4c1009aca0 2024-05-28T06:11:33.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.339+0000 7f4c14c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f4c100d0eb0 con 0x7f4c1009b080 2024-05-28T06:11:33.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.343+0000 7f4c05400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4c1009b080 0x7f4c1009b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:33.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.343+0000 7f4c05400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4c1009b080 0x7f4c1009b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:57412/0 (socket says 172.21.15.122:57412) 2024-05-28T06:11:33.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.343+0000 7f4c05400640 1 -- 172.21.15.122:0/2033460440 learned_addr learned my addr 172.21.15.122:0/2033460440 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:33.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.343+0000 7f4c0de00640 1 --2- 172.21.15.122:0/2033460440 >> v2:172.21.15.122:3300/0 conn(0x7f4c1009aca0 0x7f4c100b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:33.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.343+0000 7f4c05400640 1 -- 172.21.15.122:0/2033460440 >> v2:172.21.15.122:3300/0 conn(0x7f4c1009aca0 msgr2=0x7f4c100b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:11:33.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.343+0000 7f4c05400640 1 --2- 172.21.15.122:0/2033460440 >> v2:172.21.15.122:3300/0 conn(0x7f4c1009aca0 0x7f4c100b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:33.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.343+0000 7f4c05400640 1 -- 172.21.15.122:0/2033460440 >> v1:172.21.15.122:6789/0 conn(0x7f4c1015fb30 legacy=0x7f4c1015ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:33.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.343+0000 7f4c05400640 1 -- 172.21.15.122:0/2033460440 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c100d1190 con 0x7f4c1009b080 2024-05-28T06:11:33.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.347+0000 7f4c05400640 1 --2- 172.21.15.122:0/2033460440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c1009b080 0x7f4c1009b780 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4c10073fa0 tx=0x7f4bf801c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2fae85e81723b2f server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:33.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.351+0000 7f4c0d400640 1 -- 172.21.15.122:0/2033460440 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf80ab430 con 0x7f4c1009b080 2024-05-28T06:11:33.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.351+0000 7f4c0d400640 1 -- 172.21.15.122:0/2033460440 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf80b0070 con 0x7f4c1009b080 2024-05-28T06:11:33.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.351+0000 7f4c0d400640 1 -- 172.21.15.122:0/2033460440 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf80ab7f0 con 0x7f4c1009b080 2024-05-28T06:11:33.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.351+0000 7f4c14c00640 1 -- 172.21.15.122:0/2033460440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c1009b080 msgr2=0x7f4c1009b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:33.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.351+0000 7f4c14c00640 1 --2- 172.21.15.122:0/2033460440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c1009b080 0x7f4c1009b780 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4c10073fa0 tx=0x7f4bf801c520 comp rx=0 tx=0).stop 2024-05-28T06:11:33.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.351+0000 7f4c14c00640 1 -- 172.21.15.122:0/2033460440 shutdown_connections 2024-05-28T06:11:33.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.351+0000 7f4c14c00640 1 --2- 172.21.15.122:0/2033460440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c1009b080 0x7f4c1009b780 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:33.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.351+0000 7f4c14c00640 1 --2- 172.21.15.122:0/2033460440 >> v2:172.21.15.122:3300/0 conn(0x7f4c1009aca0 0x7f4c100b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:33.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.351+0000 7f4c14c00640 1 -- 172.21.15.122:0/2033460440 >> 172.21.15.122:0/2033460440 conn(0x7f4c100b4100 msgr2=0x7f4c100b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:33.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.351+0000 7f4c14c00640 1 -- 172.21.15.122:0/2033460440 shutdown_connections 2024-05-28T06:11:33.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.351+0000 7f4c14c00640 1 -- 172.21.15.122:0/2033460440 wait complete. 2024-05-28T06:11:33.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.355+0000 7f4c14c00640 1 Processor -- start 2024-05-28T06:11:33.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.355+0000 7f4c14c00640 1 -- start start 2024-05-28T06:11:33.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.359+0000 7f4c14c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c1009aca0 0x7f4c100ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:33.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.359+0000 7f4c14c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c1009b080 0x7f4c10151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:33.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.359+0000 7f4c14c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c1015fb30 0x7f4c100c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:33.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.359+0000 7f4c14c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4c100b64b0 con 0x7f4c1015fb30 2024-05-28T06:11:33.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.359+0000 7f4c14c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4c100b6330 con 0x7f4c1009aca0 2024-05-28T06:11:33.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.359+0000 7f4c14c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4c100b6630 con 0x7f4c1009b080 2024-05-28T06:11:33.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.359+0000 7f4c0e800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c1015fb30 0x7f4c100c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:33.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.359+0000 7f4c0e800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c1015fb30 0x7f4c100c88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52722/0 (socket says 172.21.15.122:52722) 2024-05-28T06:11:33.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.359+0000 7f4c0e800640 1 -- 172.21.15.122:0/866342370 learned_addr learned my addr 172.21.15.122:0/866342370 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:33.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.359+0000 7f4c0e800640 1 -- 172.21.15.122:0/866342370 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c1009b080 msgr2=0x7f4c10151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:33.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.359+0000 7f4c0e800640 1 --2- 172.21.15.122:0/866342370 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c1009b080 0x7f4c10151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:33.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.359+0000 7f4c0e800640 1 -- 172.21.15.122:0/866342370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c1009aca0 msgr2=0x7f4c100ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:33.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.359+0000 7f4c0e800640 1 --2- 172.21.15.122:0/866342370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c1009aca0 0x7f4c100ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:33.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.359+0000 7f4c0e800640 1 -- 172.21.15.122:0/866342370 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c100c7ce0 con 0x7f4c1015fb30 2024-05-28T06:11:33.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.359+0000 7f4c0e800640 1 --2- 172.21.15.122:0/866342370 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c1015fb30 0x7f4c100c88b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800c340 tx=0x7f4c0800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:33.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.363+0000 7f4c06a00640 1 -- 172.21.15.122:0/866342370 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c08017070 con 0x7f4c1015fb30 2024-05-28T06:11:33.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.363+0000 7f4c06a00640 1 -- 172.21.15.122:0/866342370 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c080052d0 con 0x7f4c1015fb30 2024-05-28T06:11:33.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.363+0000 7f4c06a00640 1 -- 172.21.15.122:0/866342370 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c08003840 con 0x7f4c1015fb30 2024-05-28T06:11:33.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.363+0000 7f4c14c00640 1 -- 172.21.15.122:0/866342370 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c100c7780 con 0x7f4c1015fb30 2024-05-28T06:11:33.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.363+0000 7f4c14c00640 1 -- 172.21.15.122:0/866342370 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c100c8390 con 0x7f4c1015fb30 2024-05-28T06:11:33.363 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.363+0000 7f4c14c00640 1 -- 172.21.15.122:0/866342370 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c100c7eb0 con 0x7f4c1015fb30 2024-05-28T06:11:33.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.367+0000 7f4c06a00640 1 -- 172.21.15.122:0/866342370 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 88599+0+0 (secure 0 0 0) 0x7f4c0801a070 con 0x7f4c1015fb30 2024-05-28T06:11:33.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.367+0000 7f4c06a00640 1 --2- 172.21.15.122:0/866342370 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4bec068a90 0x7f4bec06af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:33.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.371+0000 7f4c06a00640 1 -- 172.21.15.122:0/866342370 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7f4c080868f0 con 0x7f4c1015fb30 2024-05-28T06:11:33.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.371+0000 7f4c0de00640 1 --2- 172.21.15.122:0/866342370 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4bec068a90 0x7f4bec06af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:33.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.371+0000 7f4c0de00640 1 --2- 172.21.15.122:0/866342370 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4bec068a90 0x7f4bec06af50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4c000070b0 tx=0x7f4c00007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:33.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.379+0000 7f4c06a00640 1 -- 172.21.15.122:0/866342370 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4c100c7780 con 0x7f4c1015fb30 2024-05-28T06:11:33.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:33.931+0000 7f4c14c00640 1 -- 172.21.15.122:0/866342370 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone24473", "target": ["mon-mgr", ""]}) -- 0x7f4c10076020 con 0x7f4bec068a90 2024-05-28T06:11:34.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.295+0000 7f4c06a00640 1 -- 172.21.15.122:0/866342370 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4c00009710 con 0x7f4bec068a90 2024-05-28T06:11:34.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.299+0000 7f4c14c00640 1 -- 172.21.15.122:0/866342370 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4bec068a90 msgr2=0x7f4bec06af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:34.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.299+0000 7f4c14c00640 1 --2- 172.21.15.122:0/866342370 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4bec068a90 0x7f4bec06af50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4c000070b0 tx=0x7f4c00007040 comp rx=0 tx=0).stop 2024-05-28T06:11:34.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.299+0000 7f4c14c00640 1 -- 172.21.15.122:0/866342370 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c1015fb30 msgr2=0x7f4c100c88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:34.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.299+0000 7f4c14c00640 1 --2- 172.21.15.122:0/866342370 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c1015fb30 0x7f4c100c88b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800c340 tx=0x7f4c0800c800 comp rx=0 tx=0).stop 2024-05-28T06:11:34.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.299+0000 7f4c14c00640 1 -- 172.21.15.122:0/866342370 shutdown_connections 2024-05-28T06:11:34.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.299+0000 7f4c14c00640 1 --2- 172.21.15.122:0/866342370 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4bec068a90 0x7f4bec06af50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:34.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.299+0000 7f4c14c00640 1 --2- 172.21.15.122:0/866342370 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c1015fb30 0x7f4c100c88b0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:34.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.299+0000 7f4c14c00640 1 --2- 172.21.15.122:0/866342370 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c1009b080 0x7f4c10151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:34.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.299+0000 7f4c14c00640 1 --2- 172.21.15.122:0/866342370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c1009aca0 0x7f4c100ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:34.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.299+0000 7f4c14c00640 1 -- 172.21.15.122:0/866342370 >> 172.21.15.122:0/866342370 conn(0x7f4c100b4100 msgr2=0x7f4c101565a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:34.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.299+0000 7f4c14c00640 1 -- 172.21.15.122:0/866342370 shutdown_connections 2024-05-28T06:11:34.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.299+0000 7f4c14c00640 1 -- 172.21.15.122:0/866342370 wait complete. 2024-05-28T06:11:34.362 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone24474 2024-05-28T06:11:34.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.683+0000 7f3dfa200640 1 Processor -- start 2024-05-28T06:11:34.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.683+0000 7f3dfa200640 1 -- start start 2024-05-28T06:11:34.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.687+0000 7f3dfa200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3df40cff30 0x7f3df406f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:34.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.687+0000 7f3dfa200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3df406f6c0 0x7f3df40cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:34.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.687+0000 7f3dfa200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3df40cd930 0x7f3df40722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:34.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.687+0000 7f3dfa200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f3df406fb30 con 0x7f3df40cff30 2024-05-28T06:11:34.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.687+0000 7f3dfa200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f3df40d0310 con 0x7f3df406f6c0 2024-05-28T06:11:34.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.687+0000 7f3dfa200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3df415be20 con 0x7f3df40cd930 2024-05-28T06:11:34.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.687+0000 7f3df3400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3df40cff30 0x7f3df406f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:34.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.687+0000 7f3df3400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3df40cff30 0x7f3df406f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52732/0 (socket says 172.21.15.122:52732) 2024-05-28T06:11:34.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.687+0000 7f3df3400640 1 -- 172.21.15.122:0/1291645367 learned_addr learned my addr 172.21.15.122:0/1291645367 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:34.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.691+0000 7f3df2a00640 1 --2- 172.21.15.122:0/1291645367 >> v2:172.21.15.153:3300/0 conn(0x7f3df406f6c0 0x7f3df40cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:34.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.691+0000 7f3df3e00640 1 --2- 172.21.15.122:0/1291645367 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3df40cd930 0x7f3df40722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:34.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.691+0000 7f3df3400640 1 -- 172.21.15.122:0/1291645367 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3df40cd930 msgr2=0x7f3df40722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:11:34.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.691+0000 7f3df3400640 1 --2- 172.21.15.122:0/1291645367 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3df40cd930 0x7f3df40722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:34.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.691+0000 7f3df3400640 1 -- 172.21.15.122:0/1291645367 >> v2:172.21.15.153:3300/0 conn(0x7f3df406f6c0 msgr2=0x7f3df40cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:11:34.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.691+0000 7f3df3400640 1 --2- 172.21.15.122:0/1291645367 >> v2:172.21.15.153:3300/0 conn(0x7f3df406f6c0 0x7f3df40cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:34.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.691+0000 7f3df3400640 1 -- 172.21.15.122:0/1291645367 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df415c100 con 0x7f3df40cff30 2024-05-28T06:11:34.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.695+0000 7f3df3400640 1 --2- 172.21.15.122:0/1291645367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3df40cff30 0x7f3df406f180 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3df4073310 tx=0x7f3de401e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b876958a00cfa24b server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:34.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.695+0000 7f3df2000640 1 -- 172.21.15.122:0/1291645367 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de40b4070 con 0x7f3df40cff30 2024-05-28T06:11:34.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.695+0000 7f3df2000640 1 -- 172.21.15.122:0/1291645367 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3de40a7990 con 0x7f3df40cff30 2024-05-28T06:11:34.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.695+0000 7f3df2000640 1 -- 172.21.15.122:0/1291645367 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de40a7d60 con 0x7f3df40cff30 2024-05-28T06:11:34.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.699+0000 7f3dfa200640 1 -- 172.21.15.122:0/1291645367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3df40cff30 msgr2=0x7f3df406f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:34.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.699+0000 7f3dfa200640 1 --2- 172.21.15.122:0/1291645367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3df40cff30 0x7f3df406f180 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3df4073310 tx=0x7f3de401e900 comp rx=0 tx=0).stop 2024-05-28T06:11:34.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.699+0000 7f3dfa200640 1 -- 172.21.15.122:0/1291645367 shutdown_connections 2024-05-28T06:11:34.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.699+0000 7f3dfa200640 1 --2- 172.21.15.122:0/1291645367 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3df40cd930 0x7f3df40722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:34.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.699+0000 7f3dfa200640 1 --2- 172.21.15.122:0/1291645367 >> v2:172.21.15.153:3300/0 conn(0x7f3df406f6c0 0x7f3df40cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:34.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.699+0000 7f3dfa200640 1 --2- 172.21.15.122:0/1291645367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3df40cff30 0x7f3df406f180 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:34.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.699+0000 7f3dfa200640 1 -- 172.21.15.122:0/1291645367 >> 172.21.15.122:0/1291645367 conn(0x7f3df406bd90 msgr2=0x7f3df406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:34.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.699+0000 7f3dfa200640 1 -- 172.21.15.122:0/1291645367 shutdown_connections 2024-05-28T06:11:34.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.699+0000 7f3dfa200640 1 -- 172.21.15.122:0/1291645367 wait complete. 2024-05-28T06:11:34.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.703+0000 7f3dfa200640 1 Processor -- start 2024-05-28T06:11:34.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.703+0000 7f3dfa200640 1 -- start start 2024-05-28T06:11:34.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.707+0000 7f3dfa200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3df406f6c0 0x7f3df4165630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:34.707 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.707+0000 7f3dfa200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3df40cd930 0x7f3df40aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:34.707 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.707+0000 7f3dfa200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3df40cff30 0x7f3df40aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:34.707 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.707+0000 7f3dfa200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3df40cde90 con 0x7f3df40cd930 2024-05-28T06:11:34.707 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.707+0000 7f3dfa200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3df40cdd10 con 0x7f3df406f6c0 2024-05-28T06:11:34.707 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.707+0000 7f3dfa200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3df406e070 con 0x7f3df40cff30 2024-05-28T06:11:34.708 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.707+0000 7f3df3400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3df406f6c0 0x7f3df4165630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:34.708 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.707+0000 7f3df3400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3df406f6c0 0x7f3df4165630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:57452/0 (socket says 172.21.15.122:57452) 2024-05-28T06:11:34.708 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.707+0000 7f3df3400640 1 -- 172.21.15.122:0/295716481 learned_addr learned my addr 172.21.15.122:0/295716481 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:34.708 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.707+0000 7f3df3e00640 1 --2- 172.21.15.122:0/295716481 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3df40cff30 0x7f3df40aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:34.708 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.707+0000 7f3df2a00640 1 --2- 172.21.15.122:0/295716481 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3df40cd930 0x7f3df40aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:34.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.711+0000 7f3df3400640 1 -- 172.21.15.122:0/295716481 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3df40cff30 msgr2=0x7f3df40aef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:34.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.711+0000 7f3df3400640 1 --2- 172.21.15.122:0/295716481 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3df40cff30 0x7f3df40aef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:34.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.711+0000 7f3df3400640 1 -- 172.21.15.122:0/295716481 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3df40cd930 msgr2=0x7f3df40aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:34.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.711+0000 7f3df3400640 1 --2- 172.21.15.122:0/295716481 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3df40cd930 0x7f3df40aea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:34.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.711+0000 7f3df3400640 1 -- 172.21.15.122:0/295716481 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df4154330 con 0x7f3df406f6c0 2024-05-28T06:11:34.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.711+0000 7f3df3400640 1 --2- 172.21.15.122:0/295716481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3df406f6c0 0x7f3df4165630 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3de401c530 tx=0x7f3de401b6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:34.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.711+0000 7f3deb400640 1 -- 172.21.15.122:0/295716481 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de40bd070 con 0x7f3df406f6c0 2024-05-28T06:11:34.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.711+0000 7f3deb400640 1 -- 172.21.15.122:0/295716481 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3de40af780 con 0x7f3df406f6c0 2024-05-28T06:11:34.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.711+0000 7f3deb400640 1 -- 172.21.15.122:0/295716481 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de40b4040 con 0x7f3df406f6c0 2024-05-28T06:11:34.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.711+0000 7f3dfa200640 1 -- 172.21.15.122:0/295716481 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3df41545d0 con 0x7f3df406f6c0 2024-05-28T06:11:34.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.711+0000 7f3dfa200640 1 -- 172.21.15.122:0/295716481 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3df4154e00 con 0x7f3df406f6c0 2024-05-28T06:11:34.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.715+0000 7f3dfa200640 1 -- 172.21.15.122:0/295716481 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3df4068c40 con 0x7f3df406f6c0 2024-05-28T06:11:34.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.719+0000 7f3deb400640 1 -- 172.21.15.122:0/295716481 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 16) ==== 88599+0+0 (secure 0 0 0) 0x7f3de40afb70 con 0x7f3df406f6c0 2024-05-28T06:11:34.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.723+0000 7f3deb400640 1 --2- 172.21.15.122:0/295716481 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3dd0068a90 0x7f3dd006af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:34.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.723+0000 7f3deb400640 1 -- 172.21.15.122:0/295716481 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7f3de4121400 con 0x7f3df406f6c0 2024-05-28T06:11:34.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.727+0000 7f3deb400640 1 -- 172.21.15.122:0/295716481 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3de40c6020 con 0x7f3df406f6c0 2024-05-28T06:11:34.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.739+0000 7f3df2a00640 1 --2- 172.21.15.122:0/295716481 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3dd0068a90 0x7f3dd006af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:34.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:34.739+0000 7f3df2a00640 1 --2- 172.21.15.122:0/295716481 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3dd0068a90 0x7f3dd006af50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3df41559d0 tx=0x7f3ddc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:35.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.067+0000 7f3dfa200640 1 -- 172.21.15.122:0/295716481 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone24474", "target": ["mon-mgr", ""]}) -- 0x7f3df4154be0 con 0x7f3dd0068a90 2024-05-28T06:11:35.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.215+0000 7f3deb400640 1 -- 172.21.15.122:0/295716481 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3df4154be0 con 0x7f3dd0068a90 2024-05-28T06:11:35.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.219+0000 7f3dfa200640 1 -- 172.21.15.122:0/295716481 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3dd0068a90 msgr2=0x7f3dd006af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:35.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.219+0000 7f3dfa200640 1 --2- 172.21.15.122:0/295716481 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3dd0068a90 0x7f3dd006af50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3df41559d0 tx=0x7f3ddc008040 comp rx=0 tx=0).stop 2024-05-28T06:11:35.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.219+0000 7f3dfa200640 1 -- 172.21.15.122:0/295716481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3df406f6c0 msgr2=0x7f3df4165630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:35.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.219+0000 7f3dfa200640 1 --2- 172.21.15.122:0/295716481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3df406f6c0 0x7f3df4165630 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3de401c530 tx=0x7f3de401b6a0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.219+0000 7f3dfa200640 1 -- 172.21.15.122:0/295716481 shutdown_connections 2024-05-28T06:11:35.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.219+0000 7f3dfa200640 1 --2- 172.21.15.122:0/295716481 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3dd0068a90 0x7f3dd006af50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.219+0000 7f3dfa200640 1 --2- 172.21.15.122:0/295716481 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3df40cff30 0x7f3df40aef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.219+0000 7f3dfa200640 1 --2- 172.21.15.122:0/295716481 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3df40cd930 0x7f3df40aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.219+0000 7f3dfa200640 1 --2- 172.21.15.122:0/295716481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3df406f6c0 0x7f3df4165630 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.219+0000 7f3dfa200640 1 -- 172.21.15.122:0/295716481 >> 172.21.15.122:0/295716481 conn(0x7f3df406bd90 msgr2=0x7f3df41597a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:35.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.219+0000 7f3dfa200640 1 -- 172.21.15.122:0/295716481 shutdown_connections 2024-05-28T06:11:35.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.219+0000 7f3dfa200640 1 -- 172.21.15.122:0/295716481 wait complete. 2024-05-28T06:11:35.238 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-28T06:11:35.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.383+0000 7f70c3200640 1 Processor -- start 2024-05-28T06:11:35.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.387+0000 7f70c3200640 1 -- start start 2024-05-28T06:11:35.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.387+0000 7f70c3200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70bc15ea10 0x7f70bc0cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:35.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.387+0000 7f70c3200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f70bc0cf4f0 0x7f70bc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:35.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.387+0000 7f70c3200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70bc0b2620 con 0x7f70bc06ce60 2024-05-28T06:11:35.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.387+0000 7f70c3200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f70bc0cf950 con 0x7f70bc0cf4f0 2024-05-28T06:11:35.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.387+0000 7f70c3200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f70bc06d2d0 con 0x7f70bc15ea10 2024-05-28T06:11:35.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.387+0000 7f70bb400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f70bc0cf4f0 0x7f70bc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:35.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.387+0000 7f70bb400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f70bc0cf4f0 0x7f70bc06c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52736/0 (socket says 172.21.15.122:52736) 2024-05-28T06:11:35.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.387+0000 7f70bb400640 1 -- 172.21.15.122:0/3140306693 learned_addr learned my addr 172.21.15.122:0/3140306693 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:35.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.387+0000 7f70bbe00640 1 --2- 172.21.15.122:0/3140306693 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70bc15ea10 0x7f70bc0cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:35.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.387+0000 7f70bb400640 1 -- 172.21.15.122:0/3140306693 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70bc15ea10 msgr2=0x7f70bc0cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:11:35.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.387+0000 7f70bb400640 1 --2- 172.21.15.122:0/3140306693 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70bc15ea10 0x7f70bc0cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.387+0000 7f70bb400640 1 -- 172.21.15.122:0/3140306693 >> v1:172.21.15.153:6789/0 conn(0x7f70bc06ce60 legacy=0x7f70bc09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:35.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.387+0000 7f70bb400640 1 -- 172.21.15.122:0/3140306693 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70bc0d07a0 con 0x7f70bc0cf4f0 2024-05-28T06:11:35.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.391+0000 7f70bb400640 1 --2- 172.21.15.122:0/3140306693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70bc0cf4f0 0x7f70bc06c920 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f70a8009870 tx=0x7f70a801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5caec5c7b9bbe97b server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:35.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.391+0000 7f70baa00640 1 -- 172.21.15.122:0/3140306693 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a80ab650 con 0x7f70bc0cf4f0 2024-05-28T06:11:35.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.391+0000 7f70baa00640 1 -- 172.21.15.122:0/3140306693 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70a80b0070 con 0x7f70bc0cf4f0 2024-05-28T06:11:35.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.391+0000 7f70baa00640 1 -- 172.21.15.122:0/3140306693 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a80aba10 con 0x7f70bc0cf4f0 2024-05-28T06:11:35.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.391+0000 7f70c3200640 1 -- 172.21.15.122:0/3140306693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70bc0cf4f0 msgr2=0x7f70bc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:35.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.391+0000 7f70c3200640 1 --2- 172.21.15.122:0/3140306693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70bc0cf4f0 0x7f70bc06c920 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f70a8009870 tx=0x7f70a801c560 comp rx=0 tx=0).stop 2024-05-28T06:11:35.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.391+0000 7f70c3200640 1 -- 172.21.15.122:0/3140306693 shutdown_connections 2024-05-28T06:11:35.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.391+0000 7f70c3200640 1 --2- 172.21.15.122:0/3140306693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70bc0cf4f0 0x7f70bc06c920 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.391+0000 7f70c3200640 1 --2- 172.21.15.122:0/3140306693 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70bc15ea10 0x7f70bc0cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.391+0000 7f70c3200640 1 -- 172.21.15.122:0/3140306693 >> 172.21.15.122:0/3140306693 conn(0x7f70bc0d26a0 msgr2=0x7f70bc0d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:35.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.391+0000 7f70c3200640 1 -- 172.21.15.122:0/3140306693 shutdown_connections 2024-05-28T06:11:35.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.391+0000 7f70c3200640 1 -- 172.21.15.122:0/3140306693 wait complete. 2024-05-28T06:11:35.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.391+0000 7f70c3200640 1 Processor -- start 2024-05-28T06:11:35.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.391+0000 7f70c3200640 1 -- start start 2024-05-28T06:11:35.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70c3200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70bc06ce60 0x7f70bc1f7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:35.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70c3200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70bc0cf4f0 0x7f70bc1fb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:35.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70c3200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70bc15ea10 0x7f70bc152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:35.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70c3200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc06dac0 con 0x7f70bc15ea10 2024-05-28T06:11:35.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70c3200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc06d7e0 con 0x7f70bc0cf4f0 2024-05-28T06:11:35.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70c3200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f70bc16b580 con 0x7f70bc06ce60 2024-05-28T06:11:35.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70bbe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70bc06ce60 0x7f70bc1f7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:35.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70bb400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70bc0cf4f0 0x7f70bc1fb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:35.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70c1200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70bc15ea10 0x7f70bc152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:35.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70bb400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70bc0cf4f0 0x7f70bc1fb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:57464/0 (socket says 172.21.15.122:57464) 2024-05-28T06:11:35.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70bb400640 1 -- 172.21.15.122:0/4245596196 learned_addr learned my addr 172.21.15.122:0/4245596196 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:35.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70bb400640 1 -- 172.21.15.122:0/4245596196 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70bc06ce60 msgr2=0x7f70bc1f7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:35.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70bb400640 1 --2- 172.21.15.122:0/4245596196 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70bc06ce60 0x7f70bc1f7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70bb400640 1 -- 172.21.15.122:0/4245596196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70bc15ea10 msgr2=0x7f70bc152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:35.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70bb400640 1 --2- 172.21.15.122:0/4245596196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70bc15ea10 0x7f70bc152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70bb400640 1 -- 172.21.15.122:0/4245596196 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70bc1f8360 con 0x7f70bc0cf4f0 2024-05-28T06:11:35.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70bb400640 1 --2- 172.21.15.122:0/4245596196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70bc0cf4f0 0x7f70bc1fb8f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f70a801a190 tx=0x7f70a801ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:35.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70b3e00640 1 -- 172.21.15.122:0/4245596196 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a80b4800 con 0x7f70bc0cf4f0 2024-05-28T06:11:35.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70b3e00640 1 -- 172.21.15.122:0/4245596196 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70a80b49a0 con 0x7f70bc0cf4f0 2024-05-28T06:11:35.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70b3e00640 1 -- 172.21.15.122:0/4245596196 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a80b4d90 con 0x7f70bc0cf4f0 2024-05-28T06:11:35.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70c3200640 1 -- 172.21.15.122:0/4245596196 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70bc1f8640 con 0x7f70bc0cf4f0 2024-05-28T06:11:35.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70c3200640 1 -- 172.21.15.122:0/4245596196 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70bc1fb3d0 con 0x7f70bc0cf4f0 2024-05-28T06:11:35.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70c3200640 1 -- 172.21.15.122:0/4245596196 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70bc068bd0 con 0x7f70bc0cf4f0 2024-05-28T06:11:35.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.395+0000 7f70b3e00640 1 -- 172.21.15.122:0/4245596196 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 16) ==== 88599+0+0 (secure 0 0 0) 0x7f70a80c7390 con 0x7f70bc0cf4f0 2024-05-28T06:11:35.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.399+0000 7f70b3e00640 1 --2- 172.21.15.122:0/4245596196 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f709c068a70 0x7f709c06af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:35.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.399+0000 7f70b3e00640 1 -- 172.21.15.122:0/4245596196 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7f70a8121cb0 con 0x7f70bc0cf4f0 2024-05-28T06:11:35.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.399+0000 7f70bbe00640 1 --2- 172.21.15.122:0/4245596196 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f709c068a70 0x7f709c06af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:35.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.399+0000 7f70bbe00640 1 --2- 172.21.15.122:0/4245596196 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f709c068a70 0x7f709c06af30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009b60 tx=0x7f70ac009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:35.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.403+0000 7f70b3e00640 1 -- 172.21.15.122:0/4245596196 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f70a80c4060 con 0x7f70bc0cf4f0 2024-05-28T06:11:35.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.579+0000 7f70c3200640 1 -- 172.21.15.122:0/4245596196 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f70bc1f8b60 con 0x7f709c068a70 2024-05-28T06:11:35.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.583+0000 7f70b3e00640 1 -- 172.21.15.122:0/4245596196 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f70bc1f8b60 con 0x7f709c068a70 2024-05-28T06:11:35.581 INFO:teuthology.orchestra.run.smithi122.stdout:[ 2024-05-28T06:11:35.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:11:35.581 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "cephfs" 2024-05-28T06:11:35.581 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:35.581 INFO:teuthology.orchestra.run.smithi122.stdout:] 2024-05-28T06:11:35.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.583+0000 7f70c3200640 1 -- 172.21.15.122:0/4245596196 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f709c068a70 msgr2=0x7f709c06af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:35.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.583+0000 7f70c3200640 1 --2- 172.21.15.122:0/4245596196 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f709c068a70 0x7f709c06af30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009b60 tx=0x7f70ac009190 comp rx=0 tx=0).stop 2024-05-28T06:11:35.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.583+0000 7f70c3200640 1 -- 172.21.15.122:0/4245596196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70bc0cf4f0 msgr2=0x7f70bc1fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:35.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.583+0000 7f70c3200640 1 --2- 172.21.15.122:0/4245596196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70bc0cf4f0 0x7f70bc1fb8f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f70a801a190 tx=0x7f70a801ada0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.583+0000 7f70c3200640 1 -- 172.21.15.122:0/4245596196 shutdown_connections 2024-05-28T06:11:35.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.583+0000 7f70c3200640 1 --2- 172.21.15.122:0/4245596196 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f709c068a70 0x7f709c06af30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.583+0000 7f70c3200640 1 --2- 172.21.15.122:0/4245596196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70bc15ea10 0x7f70bc152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.583+0000 7f70c3200640 1 --2- 172.21.15.122:0/4245596196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70bc0cf4f0 0x7f70bc1fb8f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.583+0000 7f70c3200640 1 --2- 172.21.15.122:0/4245596196 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70bc06ce60 0x7f70bc1f7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.583+0000 7f70c3200640 1 -- 172.21.15.122:0/4245596196 >> 172.21.15.122:0/4245596196 conn(0x7f70bc0d26a0 msgr2=0x7f70bc155a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:35.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.583+0000 7f70c3200640 1 -- 172.21.15.122:0/4245596196 shutdown_connections 2024-05-28T06:11:35.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.583+0000 7f70c3200640 1 -- 172.21.15.122:0/4245596196 wait complete. 2024-05-28T06:11:35.603 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:11:35.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.739+0000 7f8fbbe00640 1 Processor -- start 2024-05-28T06:11:35.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.739+0000 7f8fbbe00640 1 -- start start 2024-05-28T06:11:35.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.739+0000 7f8fbbe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8fb40cff30 0x7f8fb406f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:35.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.739+0000 7f8fbbe00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8fb40cdb00 0x7f8fb40b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:35.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.739+0000 7f8fbbe00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fb40cdf00 con 0x7f8fb406f6c0 2024-05-28T06:11:35.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.739+0000 7f8fbbe00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f8fb406fb30 con 0x7f8fb40cdb00 2024-05-28T06:11:35.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.739+0000 7f8fbbe00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8fb40d0310 con 0x7f8fb40cff30 2024-05-28T06:11:35.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.739+0000 7f8fb9e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8fb40cdb00 0x7f8fb40b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:35.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.739+0000 7f8fb8a00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f8fb406f6c0 0x7f8fb40cd3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:48082/0 (socket says 172.21.15.122:48082) 2024-05-28T06:11:35.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.739+0000 7f8fb8a00640 1 -- 172.21.15.122:0/2920479313 learned_addr learned my addr 172.21.15.122:0/2920479313 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:11:35.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.739+0000 7f8fb9400640 1 --2- 172.21.15.122:0/2920479313 >> v2:172.21.15.153:3300/0 conn(0x7f8fb40cff30 0x7f8fb406f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:35.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.739+0000 7f8fb9e00640 1 -- 172.21.15.122:0/2920479313 >> v2:172.21.15.153:3300/0 conn(0x7f8fb40cff30 msgr2=0x7f8fb406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:11:35.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.739+0000 7f8fb9e00640 1 --2- 172.21.15.122:0/2920479313 >> v2:172.21.15.153:3300/0 conn(0x7f8fb40cff30 0x7f8fb406f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.739+0000 7f8fb9e00640 1 -- 172.21.15.122:0/2920479313 >> v1:172.21.15.122:6789/0 conn(0x7f8fb406f6c0 legacy=0x7f8fb40cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:35.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.739+0000 7f8fb9e00640 1 -- 172.21.15.122:0/2920479313 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb415be20 con 0x7f8fb40cdb00 2024-05-28T06:11:35.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.739+0000 7f8fb3e00640 1 -- 172.21.15.122:0/2920479313 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4124218016 0 0) 0x7f8fa0001120 con 0x7f8fb406f6c0 2024-05-28T06:11:35.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.743+0000 7f8fb9e00640 1 --2- 172.21.15.122:0/2920479313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb40cdb00 0x7f8fb40b49b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40b3dc0 tx=0x7f8fac01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a18c772793b0415 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:35.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.743+0000 7f8fb3e00640 1 -- 172.21.15.122:0/2920479313 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac0ab650 con 0x7f8fb40cdb00 2024-05-28T06:11:35.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.743+0000 7f8fb3e00640 1 -- 172.21.15.122:0/2920479313 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fac0b0070 con 0x7f8fb40cdb00 2024-05-28T06:11:35.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.743+0000 7f8fb3e00640 1 -- 172.21.15.122:0/2920479313 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac0aba10 con 0x7f8fb40cdb00 2024-05-28T06:11:35.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.743+0000 7f8fbbe00640 1 -- 172.21.15.122:0/2920479313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb40cdb00 msgr2=0x7f8fb40b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:35.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.743+0000 7f8fbbe00640 1 --2- 172.21.15.122:0/2920479313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb40cdb00 0x7f8fb40b49b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40b3dc0 tx=0x7f8fac01c450 comp rx=0 tx=0).stop 2024-05-28T06:11:35.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.743+0000 7f8fbbe00640 1 -- 172.21.15.122:0/2920479313 shutdown_connections 2024-05-28T06:11:35.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.743+0000 7f8fbbe00640 1 --2- 172.21.15.122:0/2920479313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb40cdb00 0x7f8fb40b49b0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.743+0000 7f8fbbe00640 1 --2- 172.21.15.122:0/2920479313 >> v2:172.21.15.153:3300/0 conn(0x7f8fb40cff30 0x7f8fb406f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.743+0000 7f8fbbe00640 1 -- 172.21.15.122:0/2920479313 >> 172.21.15.122:0/2920479313 conn(0x7f8fb406bd90 msgr2=0x7f8fb406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:35.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.743+0000 7f8fbbe00640 1 -- 172.21.15.122:0/2920479313 shutdown_connections 2024-05-28T06:11:35.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.743+0000 7f8fbbe00640 1 -- 172.21.15.122:0/2920479313 wait complete. 2024-05-28T06:11:35.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fbbe00640 1 Processor -- start 2024-05-28T06:11:35.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fbbe00640 1 -- start start 2024-05-28T06:11:35.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fbbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb406f6c0 0x7f8fb40ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:35.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fbbe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8fb40cdb00 0x7f8fb415b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:35.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fbbe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fb40cff30 0x7f8fb4146b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:35.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fbbe00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb40b5700 con 0x7f8fb406f6c0 2024-05-28T06:11:35.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fbbe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb415baf0 con 0x7f8fb40cff30 2024-05-28T06:11:35.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fbbe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8fb40b5880 con 0x7f8fb40cdb00 2024-05-28T06:11:35.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fb9400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb406f6c0 0x7f8fb40ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:35.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fb9400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb406f6c0 0x7f8fb40ad8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57054/0 (socket says 172.21.15.122:57054) 2024-05-28T06:11:35.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fb9400640 1 -- 172.21.15.122:0/2520306430 learned_addr learned my addr 172.21.15.122:0/2520306430 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:35.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fb9e00640 1 --2- 172.21.15.122:0/2520306430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fb40cff30 0x7f8fb4146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:35.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fb8a00640 1 --2- 172.21.15.122:0/2520306430 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8fb40cdb00 0x7f8fb415b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:35.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fb9400640 1 -- 172.21.15.122:0/2520306430 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8fb40cdb00 msgr2=0x7f8fb415b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:35.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fb9400640 1 --2- 172.21.15.122:0/2520306430 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8fb40cdb00 0x7f8fb415b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fb9400640 1 -- 172.21.15.122:0/2520306430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fb40cff30 msgr2=0x7f8fb4146b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:35.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fb9400640 1 --2- 172.21.15.122:0/2520306430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fb40cff30 0x7f8fb4146b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fb9400640 1 -- 172.21.15.122:0/2520306430 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb415b720 con 0x7f8fb406f6c0 2024-05-28T06:11:35.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fb8a00640 1 --2- 172.21.15.122:0/2520306430 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8fb40cdb00 0x7f8fb415b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:11:35.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fb9400640 1 --2- 172.21.15.122:0/2520306430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb406f6c0 0x7f8fb40ad8b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800efc0 tx=0x7f8fa800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:35.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fb1600640 1 -- 172.21.15.122:0/2520306430 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8018020 con 0x7f8fb406f6c0 2024-05-28T06:11:35.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fb1600640 1 -- 172.21.15.122:0/2520306430 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fa8014480 con 0x7f8fb406f6c0 2024-05-28T06:11:35.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fbbe00640 1 -- 172.21.15.122:0/2520306430 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb40adf40 con 0x7f8fb406f6c0 2024-05-28T06:11:35.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fb1600640 1 -- 172.21.15.122:0/2520306430 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8014850 con 0x7f8fb406f6c0 2024-05-28T06:11:35.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.747+0000 7f8fbbe00640 1 -- 172.21.15.122:0/2520306430 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb40ae7e0 con 0x7f8fb406f6c0 2024-05-28T06:11:35.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.751+0000 7f8fbbe00640 1 -- 172.21.15.122:0/2520306430 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb4068c40 con 0x7f8fb406f6c0 2024-05-28T06:11:35.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.751+0000 7f8fb1600640 1 -- 172.21.15.122:0/2520306430 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 88599+0+0 (secure 0 0 0) 0x7f8fa801b020 con 0x7f8fb406f6c0 2024-05-28T06:11:35.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.751+0000 7f8fb1600640 1 --2- 172.21.15.122:0/2520306430 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8f94068a40 0x7f8f9406af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:35.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.751+0000 7f8fb1600640 1 -- 172.21.15.122:0/2520306430 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7f8fa80881b0 con 0x7f8fb406f6c0 2024-05-28T06:11:35.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.751+0000 7f8fb8a00640 1 --2- 172.21.15.122:0/2520306430 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8f94068a40 0x7f8f9406af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:35.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.751+0000 7f8fb8a00640 1 --2- 172.21.15.122:0/2520306430 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8f94068a40 0x7f8f9406af00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0007fd0 tx=0x7f8fa0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:35.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.755+0000 7f8fb1600640 1 -- 172.21.15.122:0/2520306430 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8fa8022070 con 0x7f8fb406f6c0 2024-05-28T06:11:35.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.975+0000 7f8fbbe00640 1 -- 172.21.15.122:0/2520306430 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8fb40ccdf0 con 0x7f8fb406f6c0 2024-05-28T06:11:35.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.975+0000 7f8fb1600640 1 -- 172.21.15.122:0/2520306430 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2143 (secure 0 0 0) 0x7f8fa8010040 con 0x7f8fb406f6c0 2024-05-28T06:11:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:11:35.974 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:11:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:11:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:11:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:11:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:11:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:11:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:11:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:11:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:11:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:11:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:11:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:11:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:11:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:11:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:11:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 371, 2024-05-28T06:11:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:11:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:11:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:11:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:11:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:11:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 49, 2024-05-28T06:11:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:11:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:11:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:11:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:11:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:11:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:11:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:11:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:11:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:11:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:11:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:11:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:11:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:11:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 4003, 2024-05-28T06:11:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 16644657786, 2024-05-28T06:11:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 33092530176, 2024-05-28T06:11:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 740001583104, 2024-05-28T06:11:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:11:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "read_bytes_sec": 502415465, 2024-05-28T06:11:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 491633547, 2024-05-28T06:11:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 122, 2024-05-28T06:11:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 131 2024-05-28T06:11:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:11:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 29, 2024-05-28T06:11:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 3, 2024-05-28T06:11:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:11:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:11:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:11:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:11:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:11:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 3, 2024-05-28T06:11:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:11:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "a", 2024-05-28T06:11:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:11:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 5679 2024-05-28T06:11:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:11:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:11:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:11:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:11:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:11:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:11:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:11:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:11:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:11:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:11:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 8, 2024-05-28T06:11:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:10:43.307303+0000", 2024-05-28T06:11:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:11:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:11:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "ed0906d2-55cb-4fe9-b815-1869630be1ae": { 2024-05-28T06:11:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "1 ongoing clones; Avg progress is 13.125% (11s)\n [===.........................] (remaining: 73s)", 2024-05-28T06:11:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.13124999403953552, 2024-05-28T06:11:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:11:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:35.981 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:11:35.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.975+0000 7f8fbbe00640 1 -- 172.21.15.122:0/2520306430 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8f94068a40 msgr2=0x7f8f9406af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:35.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.975+0000 7f8fbbe00640 1 --2- 172.21.15.122:0/2520306430 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8f94068a40 0x7f8f9406af00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0007fd0 tx=0x7f8fa0009040 comp rx=0 tx=0).stop 2024-05-28T06:11:35.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.975+0000 7f8fbbe00640 1 -- 172.21.15.122:0/2520306430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb406f6c0 msgr2=0x7f8fb40ad8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:35.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.975+0000 7f8fbbe00640 1 --2- 172.21.15.122:0/2520306430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb406f6c0 0x7f8fb40ad8b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800efc0 tx=0x7f8fa800c490 comp rx=0 tx=0).stop 2024-05-28T06:11:35.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.975+0000 7f8fbbe00640 1 -- 172.21.15.122:0/2520306430 shutdown_connections 2024-05-28T06:11:35.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.975+0000 7f8fbbe00640 1 --2- 172.21.15.122:0/2520306430 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8f94068a40 0x7f8f9406af00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.975+0000 7f8fbbe00640 1 --2- 172.21.15.122:0/2520306430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fb40cff30 0x7f8fb4146b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.975+0000 7f8fbbe00640 1 --2- 172.21.15.122:0/2520306430 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8fb40cdb00 0x7f8fb415b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.975+0000 7f8fbbe00640 1 --2- 172.21.15.122:0/2520306430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb406f6c0 0x7f8fb40ad8b0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:35.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.975+0000 7f8fbbe00640 1 -- 172.21.15.122:0/2520306430 >> 172.21.15.122:0/2520306430 conn(0x7f8fb406bd90 msgr2=0x7f8fb4153ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:35.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.975+0000 7f8fbbe00640 1 -- 172.21.15.122:0/2520306430 shutdown_connections 2024-05-28T06:11:35.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:35.975+0000 7f8fbbe00640 1 -- 172.21.15.122:0/2520306430 wait complete. 2024-05-28T06:11:40.996 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:11:41.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.139+0000 7fc4be000640 1 Processor -- start 2024-05-28T06:11:41.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.139+0000 7fc4be000640 1 -- start start 2024-05-28T06:11:41.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.143+0000 7fc4be000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc4b815aae0 0x7fc4b806dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:41.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.143+0000 7fc4be000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4b80cf810 0x7fc4b806b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:41.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.143+0000 7fc4be000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4b80b4600 con 0x7fc4b80cfc10 2024-05-28T06:11:41.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.143+0000 7fc4be000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc4b80b48a0 con 0x7fc4b815aae0 2024-05-28T06:11:41.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.143+0000 7fc4be000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b80cde70 con 0x7fc4b80cf810 2024-05-28T06:11:41.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.143+0000 7fc4bd600640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fc4b80cfc10 0x7fc4b80ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:48086/0 (socket says 172.21.15.122:48086) 2024-05-28T06:11:41.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.143+0000 7fc4bd600640 1 -- 172.21.15.122:0/1451422540 learned_addr learned my addr 172.21.15.122:0/1451422540 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:11:41.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.143+0000 7fc4afe00640 1 --2- 172.21.15.122:0/1451422540 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4b80cf810 0x7fc4b806b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:41.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.143+0000 7fc4bcc00640 1 --2- 172.21.15.122:0/1451422540 >> v2:172.21.15.153:3300/0 conn(0x7fc4b815aae0 0x7fc4b806dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:41.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.143+0000 7fc4b7e00640 1 -- 172.21.15.122:0/1451422540 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1374698506 0 0) 0x7fc4b80b4600 con 0x7fc4b80cfc10 2024-05-28T06:11:41.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.143+0000 7fc4b7e00640 1 -- 172.21.15.122:0/1451422540 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc49c003530 con 0x7fc4b80cfc10 2024-05-28T06:11:41.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.143+0000 7fc4afe00640 1 -- 172.21.15.122:0/1451422540 >> v2:172.21.15.153:3300/0 conn(0x7fc4b815aae0 msgr2=0x7fc4b806dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:11:41.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.143+0000 7fc4afe00640 1 --2- 172.21.15.122:0/1451422540 >> v2:172.21.15.153:3300/0 conn(0x7fc4b815aae0 0x7fc4b806dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:41.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.143+0000 7fc4afe00640 1 -- 172.21.15.122:0/1451422540 >> v1:172.21.15.122:6789/0 conn(0x7fc4b80cfc10 legacy=0x7fc4b80ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:41.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.143+0000 7fc4afe00640 1 -- 172.21.15.122:0/1451422540 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b80ce150 con 0x7fc4b80cf810 2024-05-28T06:11:41.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.143+0000 7fc4bcc00640 1 --2- 172.21.15.122:0/1451422540 >> v2:172.21.15.153:3300/0 conn(0x7fc4b815aae0 0x7fc4b806dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:11:41.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.147+0000 7fc4afe00640 1 --2- 172.21.15.122:0/1451422540 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4b80cf810 0x7fc4b806b990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00097c0 tx=0x7fc4a001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7716e8d5a5c69243 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:41.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.147+0000 7fc4b7e00640 1 -- 172.21.15.122:0/1451422540 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a00b0070 con 0x7fc4b80cf810 2024-05-28T06:11:41.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.147+0000 7fc4b7e00640 1 -- 172.21.15.122:0/1451422540 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a00ab600 con 0x7fc4b80cf810 2024-05-28T06:11:41.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.147+0000 7fc4b7e00640 1 -- 172.21.15.122:0/1451422540 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a00ab9d0 con 0x7fc4b80cf810 2024-05-28T06:11:41.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.147+0000 7fc4be000640 1 -- 172.21.15.122:0/1451422540 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4b80cf810 msgr2=0x7fc4b806b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:41.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.147+0000 7fc4be000640 1 --2- 172.21.15.122:0/1451422540 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4b80cf810 0x7fc4b806b990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00097c0 tx=0x7fc4a001c4a0 comp rx=0 tx=0).stop 2024-05-28T06:11:41.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.147+0000 7fc4be000640 1 -- 172.21.15.122:0/1451422540 shutdown_connections 2024-05-28T06:11:41.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.147+0000 7fc4be000640 1 --2- 172.21.15.122:0/1451422540 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4b80cf810 0x7fc4b806b990 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:41.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.147+0000 7fc4be000640 1 --2- 172.21.15.122:0/1451422540 >> v2:172.21.15.153:3300/0 conn(0x7fc4b815aae0 0x7fc4b806dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:41.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.147+0000 7fc4be000640 1 -- 172.21.15.122:0/1451422540 >> 172.21.15.122:0/1451422540 conn(0x7fc4b80b20a0 msgr2=0x7fc4b80b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:41.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.147+0000 7fc4be000640 1 -- 172.21.15.122:0/1451422540 shutdown_connections 2024-05-28T06:11:41.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.147+0000 7fc4be000640 1 -- 172.21.15.122:0/1451422540 wait complete. 2024-05-28T06:11:41.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.147+0000 7fc4be000640 1 Processor -- start 2024-05-28T06:11:41.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.147+0000 7fc4be000640 1 -- start start 2024-05-28T06:11:41.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4be000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4b80cf810 0x7fc4b815b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:41.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4be000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4b80cfc10 0x7fc4b81692f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:41.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4be000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4b815aae0 0x7fc4b8143540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:41.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4be000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b80b5030 con 0x7fc4b815aae0 2024-05-28T06:11:41.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4be000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b806c2e0 con 0x7fc4b80cf810 2024-05-28T06:11:41.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4be000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b80b51b0 con 0x7fc4b80cfc10 2024-05-28T06:11:41.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4bd600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4b815aae0 0x7fc4b8143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:41.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4bd600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4b815aae0 0x7fc4b8143540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57058/0 (socket says 172.21.15.122:57058) 2024-05-28T06:11:41.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4bd600640 1 -- 172.21.15.122:0/905766261 learned_addr learned my addr 172.21.15.122:0/905766261 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:41.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4afe00640 1 --2- 172.21.15.122:0/905766261 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4b80cfc10 0x7fc4b81692f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:41.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4bcc00640 1 --2- 172.21.15.122:0/905766261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4b80cf810 0x7fc4b815b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:41.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4bd600640 1 -- 172.21.15.122:0/905766261 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4b80cfc10 msgr2=0x7fc4b81692f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:41.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4bd600640 1 --2- 172.21.15.122:0/905766261 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4b80cfc10 0x7fc4b81692f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:41.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4bd600640 1 -- 172.21.15.122:0/905766261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4b80cf810 msgr2=0x7fc4b815b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:41.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4bd600640 1 --2- 172.21.15.122:0/905766261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4b80cf810 0x7fc4b815b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:41.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4bd600640 1 -- 172.21.15.122:0/905766261 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b8168880 con 0x7fc4b815aae0 2024-05-28T06:11:41.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4bcc00640 1 --2- 172.21.15.122:0/905766261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4b80cf810 0x7fc4b815b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:11:41.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4bd600640 1 --2- 172.21.15.122:0/905766261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4b815aae0 0x7fc4b8143540 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000cb70 tx=0x7fc4b000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:41.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4b5600640 1 -- 172.21.15.122:0/905766261 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0017070 con 0x7fc4b815aae0 2024-05-28T06:11:41.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4b5600640 1 -- 172.21.15.122:0/905766261 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b000ad40 con 0x7fc4b815aae0 2024-05-28T06:11:41.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4b5600640 1 -- 172.21.15.122:0/905766261 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0012620 con 0x7fc4b815aae0 2024-05-28T06:11:41.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4be000640 1 -- 172.21.15.122:0/905766261 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b8169830 con 0x7fc4b815aae0 2024-05-28T06:11:41.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4be000640 1 -- 172.21.15.122:0/905766261 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b8168af0 con 0x7fc4b815aae0 2024-05-28T06:11:41.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4be000640 1 -- 172.21.15.122:0/905766261 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4b8075620 con 0x7fc4b815aae0 2024-05-28T06:11:41.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.151+0000 7fc4b5600640 1 -- 172.21.15.122:0/905766261 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 88599+0+0 (secure 0 0 0) 0x7fc4b001a070 con 0x7fc4b815aae0 2024-05-28T06:11:41.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.155+0000 7fc4b5600640 1 --2- 172.21.15.122:0/905766261 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc494068a40 0x7fc49406af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:41.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.155+0000 7fc4b5600640 1 -- 172.21.15.122:0/905766261 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7fc4b0087450 con 0x7fc4b815aae0 2024-05-28T06:11:41.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.155+0000 7fc4bcc00640 1 --2- 172.21.15.122:0/905766261 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc494068a40 0x7fc49406af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:41.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.155+0000 7fc4bcc00640 1 --2- 172.21.15.122:0/905766261 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc494068a40 0x7fc49406af00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009b10 tx=0x7fc4a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:41.157 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.159+0000 7fc4b5600640 1 -- 172.21.15.122:0/905766261 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc4b0056920 con 0x7fc4b815aae0 2024-05-28T06:11:41.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.371+0000 7fc4be000640 1 -- 172.21.15.122:0/905766261 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc4b8158eb0 con 0x7fc4b815aae0 2024-05-28T06:11:41.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.371+0000 7fc4b5600640 1 -- 172.21.15.122:0/905766261 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2125 (secure 0 0 0) 0x7fc4b005ac20 con 0x7fc4b815aae0 2024-05-28T06:11:41.373 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:11:41.373 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:11:41.373 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:11:41.373 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:11:41.373 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:11:41.373 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:11:41.373 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:11:41.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:41.373 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:11:41.373 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:11:41.373 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:11:41.373 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:11:41.373 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:11:41.374 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:41.374 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:11:41.374 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:11:41.374 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:11:41.374 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:11:41.374 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:41.374 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 377, 2024-05-28T06:11:41.374 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:11:41.374 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:11:41.374 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:11:41.374 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:11:41.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:41.374 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:11:41.375 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 49, 2024-05-28T06:11:41.375 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:11:41.375 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:11:41.375 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:11:41.375 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:11:41.375 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:11:41.375 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:11:41.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:41.375 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:11:41.375 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:11:41.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:11:41.375 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:11:41.375 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:11:41.375 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:41.375 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:41.375 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:11:41.376 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:11:41.376 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 4428, 2024-05-28T06:11:41.376 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 18440011260, 2024-05-28T06:11:41.376 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 37263773696, 2024-05-28T06:11:41.376 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 735830339584, 2024-05-28T06:11:41.376 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:11:41.376 INFO:teuthology.orchestra.run.smithi122.stdout: "read_bytes_sec": 647053342, 2024-05-28T06:11:41.376 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 641522651, 2024-05-28T06:11:41.376 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 158, 2024-05-28T06:11:41.376 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 174 2024-05-28T06:11:41.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:41.376 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:11:41.376 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 29, 2024-05-28T06:11:41.376 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 3, 2024-05-28T06:11:41.376 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:11:41.377 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:11:41.377 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:11:41.377 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:11:41.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:11:41.377 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 3, 2024-05-28T06:11:41.377 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:11:41.377 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "a", 2024-05-28T06:11:41.377 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:11:41.377 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 5679 2024-05-28T06:11:41.377 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:41.377 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:41.377 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:11:41.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:41.377 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:11:41.377 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:11:41.378 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:11:41.378 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:11:41.378 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:11:41.378 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:11:41.378 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:11:41.378 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:41.378 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:11:41.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:41.378 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:11:41.378 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 8, 2024-05-28T06:11:41.378 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:10:43.307303+0000", 2024-05-28T06:11:41.378 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:11:41.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:41.379 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:11:41.379 INFO:teuthology.orchestra.run.smithi122.stdout: "ed0906d2-55cb-4fe9-b815-1869630be1ae": { 2024-05-28T06:11:41.379 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "All cloning finished, waiting 27.0 seconds before exiting (15s)\n [============================] ", 2024-05-28T06:11:41.379 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 1, 2024-05-28T06:11:41.379 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:11:41.379 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:41.379 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:41.379 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:11:41.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.375+0000 7fc4be000640 1 -- 172.21.15.122:0/905766261 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc494068a40 msgr2=0x7fc49406af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:41.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.375+0000 7fc4be000640 1 --2- 172.21.15.122:0/905766261 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc494068a40 0x7fc49406af00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009b10 tx=0x7fc4a8008040 comp rx=0 tx=0).stop 2024-05-28T06:11:41.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.375+0000 7fc4be000640 1 -- 172.21.15.122:0/905766261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4b815aae0 msgr2=0x7fc4b8143540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:41.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.375+0000 7fc4be000640 1 --2- 172.21.15.122:0/905766261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4b815aae0 0x7fc4b8143540 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000cb70 tx=0x7fc4b000a430 comp rx=0 tx=0).stop 2024-05-28T06:11:41.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.375+0000 7fc4be000640 1 -- 172.21.15.122:0/905766261 shutdown_connections 2024-05-28T06:11:41.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.375+0000 7fc4be000640 1 --2- 172.21.15.122:0/905766261 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc494068a40 0x7fc49406af00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:41.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.375+0000 7fc4be000640 1 --2- 172.21.15.122:0/905766261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4b815aae0 0x7fc4b8143540 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:41.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.375+0000 7fc4be000640 1 --2- 172.21.15.122:0/905766261 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4b80cfc10 0x7fc4b81692f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:41.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.375+0000 7fc4be000640 1 --2- 172.21.15.122:0/905766261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4b80cf810 0x7fc4b815b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:41.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.375+0000 7fc4be000640 1 -- 172.21.15.122:0/905766261 >> 172.21.15.122:0/905766261 conn(0x7fc4b80b20a0 msgr2=0x7fc4b80b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:41.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.375+0000 7fc4be000640 1 -- 172.21.15.122:0/905766261 shutdown_connections 2024-05-28T06:11:41.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:41.375+0000 7fc4be000640 1 -- 172.21.15.122:0/905766261 wait complete. 2024-05-28T06:11:46.397 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:11:46.541 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.543+0000 7f0006400640 1 Processor -- start 2024-05-28T06:11:46.541 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.543+0000 7f0006400640 1 -- start start 2024-05-28T06:11:46.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.543+0000 7f0006400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f000006dab0 0x7f000015f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:46.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.543+0000 7f0006400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f000015fa80 0x7f00000d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:46.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.543+0000 7f0006400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0000162510 con 0x7f000015ea50 2024-05-28T06:11:46.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.543+0000 7f0006400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f0000163120 con 0x7f000015fa80 2024-05-28T06:11:46.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.543+0000 7f0006400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f00001627f0 con 0x7f000006dab0 2024-05-28T06:11:46.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.543+0000 7effffe00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f000015fa80 0x7f00000d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:46.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.543+0000 7effffe00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f000015fa80 0x7f00000d08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51070/0 (socket says 172.21.15.122:51070) 2024-05-28T06:11:46.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.543+0000 7effffe00640 1 -- 172.21.15.122:0/2015421029 learned_addr learned my addr 172.21.15.122:0/2015421029 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:46.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.543+0000 7efff6a00640 1 --2- 172.21.15.122:0/2015421029 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f000006dab0 0x7f000015f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:46.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.543+0000 7effffe00640 1 -- 172.21.15.122:0/2015421029 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f000006dab0 msgr2=0x7f000015f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:11:46.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.543+0000 7effffe00640 1 --2- 172.21.15.122:0/2015421029 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f000006dab0 0x7f000015f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:46.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.543+0000 7effffe00640 1 -- 172.21.15.122:0/2015421029 >> v1:172.21.15.153:6789/0 conn(0x7f000015ea50 legacy=0x7f000015ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:46.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.543+0000 7effffe00640 1 -- 172.21.15.122:0/2015421029 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0000162ad0 con 0x7f000015fa80 2024-05-28T06:11:46.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.547+0000 7effffe00640 1 --2- 172.21.15.122:0/2015421029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f000015fa80 0x7f00000d08e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7efff8009e50 tx=0x7efff801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25f237efeada7fd server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:46.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.547+0000 7efffea00640 1 -- 172.21.15.122:0/2015421029 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff80a5760 con 0x7f000015fa80 2024-05-28T06:11:46.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.547+0000 7efffea00640 1 -- 172.21.15.122:0/2015421029 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff80a5900 con 0x7f000015fa80 2024-05-28T06:11:46.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.547+0000 7efffea00640 1 -- 172.21.15.122:0/2015421029 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff80a5cd0 con 0x7f000015fa80 2024-05-28T06:11:46.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.547+0000 7f0006400640 1 -- 172.21.15.122:0/2015421029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f000015fa80 msgr2=0x7f00000d08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:46.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.547+0000 7f0006400640 1 --2- 172.21.15.122:0/2015421029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f000015fa80 0x7f00000d08e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7efff8009e50 tx=0x7efff801ca00 comp rx=0 tx=0).stop 2024-05-28T06:11:46.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.547+0000 7f0006400640 1 -- 172.21.15.122:0/2015421029 shutdown_connections 2024-05-28T06:11:46.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.547+0000 7f0006400640 1 --2- 172.21.15.122:0/2015421029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f000015fa80 0x7f00000d08e0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:46.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.547+0000 7f0006400640 1 --2- 172.21.15.122:0/2015421029 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f000006dab0 0x7f000015f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:46.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.547+0000 7f0006400640 1 -- 172.21.15.122:0/2015421029 >> 172.21.15.122:0/2015421029 conn(0x7f00000b4190 msgr2=0x7f00000b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:46.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.547+0000 7f0006400640 1 -- 172.21.15.122:0/2015421029 shutdown_connections 2024-05-28T06:11:46.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.547+0000 7f0006400640 1 -- 172.21.15.122:0/2015421029 wait complete. 2024-05-28T06:11:46.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7f0006400640 1 Processor -- start 2024-05-28T06:11:46.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7f0006400640 1 -- start start 2024-05-28T06:11:46.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7f0006400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f000006dab0 0x7f0000156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:46.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7f0006400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f000015ea50 0x7f00000b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:46.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7f0006400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f000015fa80 0x7f00000b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:46.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7f0006400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f00000d19c0 con 0x7f000015fa80 2024-05-28T06:11:46.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7f0006400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f00000d1840 con 0x7f000015ea50 2024-05-28T06:11:46.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7f0006400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f00000d1b40 con 0x7f000006dab0 2024-05-28T06:11:46.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7effffe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f000015fa80 0x7f00000b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:46.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7effffe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f000015fa80 0x7f00000b3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51086/0 (socket says 172.21.15.122:51086) 2024-05-28T06:11:46.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7effffe00640 1 -- 172.21.15.122:0/950387097 learned_addr learned my addr 172.21.15.122:0/950387097 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:46.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7effff400640 1 --2- 172.21.15.122:0/950387097 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f000006dab0 0x7f0000156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:46.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7efff6a00640 1 --2- 172.21.15.122:0/950387097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f000015ea50 0x7f00000b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:46.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7effffe00640 1 -- 172.21.15.122:0/950387097 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f000006dab0 msgr2=0x7f0000156c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:46.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7effffe00640 1 --2- 172.21.15.122:0/950387097 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f000006dab0 0x7f0000156c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:46.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7effffe00640 1 -- 172.21.15.122:0/950387097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f000015ea50 msgr2=0x7f00000b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:46.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7effffe00640 1 --2- 172.21.15.122:0/950387097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f000015ea50 0x7f00000b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:46.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7effffe00640 1 -- 172.21.15.122:0/950387097 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00000b6530 con 0x7f000015fa80 2024-05-28T06:11:46.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7effff400640 1 --2- 172.21.15.122:0/950387097 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f000006dab0 0x7f0000156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:11:46.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7effffe00640 1 --2- 172.21.15.122:0/950387097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f000015fa80 0x7f00000b3400 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7efff80af040 tx=0x7efff80197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:46.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7efff7e00640 1 -- 172.21.15.122:0/950387097 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff80b8440 con 0x7f000015fa80 2024-05-28T06:11:46.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7efff7e00640 1 -- 172.21.15.122:0/950387097 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff80b85e0 con 0x7f000015fa80 2024-05-28T06:11:46.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7efff7e00640 1 -- 172.21.15.122:0/950387097 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff80b89d0 con 0x7f000015fa80 2024-05-28T06:11:46.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7f0006400640 1 -- 172.21.15.122:0/950387097 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f000015be60 con 0x7f000015fa80 2024-05-28T06:11:46.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7f0006400640 1 -- 172.21.15.122:0/950387097 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f000015c420 con 0x7f000015fa80 2024-05-28T06:11:46.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.551+0000 7f0006400640 1 -- 172.21.15.122:0/950387097 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0000068c40 con 0x7f000015fa80 2024-05-28T06:11:46.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.555+0000 7efff7e00640 1 -- 172.21.15.122:0/950387097 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 88599+0+0 (secure 0 0 0) 0x7efff80c1020 con 0x7f000015fa80 2024-05-28T06:11:46.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.555+0000 7efff7e00640 1 --2- 172.21.15.122:0/950387097 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7effdc068a40 0x7effdc06af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:46.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.555+0000 7efff7e00640 1 -- 172.21.15.122:0/950387097 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7efff8121a70 con 0x7f000015fa80 2024-05-28T06:11:46.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.555+0000 7effff400640 1 --2- 172.21.15.122:0/950387097 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7effdc068a40 0x7effdc06af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:46.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.555+0000 7effff400640 1 --2- 172.21.15.122:0/950387097 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7effdc068a40 0x7effdc06af00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0000158200 tx=0x7efff0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:46.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.559+0000 7efff7e00640 1 -- 172.21.15.122:0/950387097 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efff80c8020 con 0x7f000015fa80 2024-05-28T06:11:46.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.771+0000 7f0006400640 1 -- 172.21.15.122:0/950387097 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f00000b4ea0 con 0x7f000015fa80 2024-05-28T06:11:46.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.775+0000 7efff7e00640 1 -- 172.21.15.122:0/950387097 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2123 (secure 0 0 0) 0x7efff8016620 con 0x7f000015fa80 2024-05-28T06:11:46.772 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:11:46.773 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:11:46.773 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:11:46.773 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:11:46.773 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:11:46.773 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:11:46.773 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:11:46.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:46.773 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:11:46.773 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:11:46.773 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:11:46.773 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:11:46.773 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:11:46.773 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:46.774 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:11:46.774 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:11:46.774 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:11:46.774 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:11:46.774 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:46.774 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 382, 2024-05-28T06:11:46.774 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:11:46.774 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:11:46.774 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:11:46.774 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:11:46.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:46.774 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:11:46.774 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 49, 2024-05-28T06:11:46.775 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:11:46.775 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:11:46.775 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:11:46.775 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:11:46.775 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:11:46.775 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:11:46.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:46.775 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:11:46.775 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:11:46.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:11:46.775 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:11:46.775 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:11:46.775 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:46.776 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:46.776 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:11:46.776 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:11:46.776 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 4428, 2024-05-28T06:11:46.776 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 18440068073, 2024-05-28T06:11:46.776 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 37263867904, 2024-05-28T06:11:46.776 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 735830245376, 2024-05-28T06:11:46.776 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:11:46.776 INFO:teuthology.orchestra.run.smithi122.stdout: "read_bytes_sec": 144314864, 2024-05-28T06:11:46.776 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 149579397, 2024-05-28T06:11:46.776 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 35, 2024-05-28T06:11:46.776 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 44 2024-05-28T06:11:46.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:46.776 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:11:46.777 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 29, 2024-05-28T06:11:46.777 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 3, 2024-05-28T06:11:46.777 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:11:46.777 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:11:46.777 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:11:46.777 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:11:46.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:11:46.777 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 3, 2024-05-28T06:11:46.777 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:11:46.777 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "a", 2024-05-28T06:11:46.777 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:11:46.777 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 5679 2024-05-28T06:11:46.777 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:46.778 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:46.778 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:11:46.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:46.778 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:11:46.778 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:11:46.778 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:11:46.778 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:11:46.778 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:11:46.778 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:11:46.778 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:11:46.778 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:46.778 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:11:46.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:46.778 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:11:46.779 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 8, 2024-05-28T06:11:46.779 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:10:43.307303+0000", 2024-05-28T06:11:46.779 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:11:46.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:46.779 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:11:46.779 INFO:teuthology.orchestra.run.smithi122.stdout: "ed0906d2-55cb-4fe9-b815-1869630be1ae": { 2024-05-28T06:11:46.779 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "All cloning finished, waiting 21.0 seconds before exiting (21s)\n [============================] ", 2024-05-28T06:11:46.779 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 1, 2024-05-28T06:11:46.779 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:11:46.779 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:46.779 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:46.779 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:11:46.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.775+0000 7f0006400640 1 -- 172.21.15.122:0/950387097 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7effdc068a40 msgr2=0x7effdc06af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:46.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.775+0000 7f0006400640 1 --2- 172.21.15.122:0/950387097 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7effdc068a40 0x7effdc06af00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0000158200 tx=0x7efff0009040 comp rx=0 tx=0).stop 2024-05-28T06:11:46.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.775+0000 7f0006400640 1 -- 172.21.15.122:0/950387097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f000015fa80 msgr2=0x7f00000b3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:46.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.775+0000 7f0006400640 1 --2- 172.21.15.122:0/950387097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f000015fa80 0x7f00000b3400 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7efff80af040 tx=0x7efff80197a0 comp rx=0 tx=0).stop 2024-05-28T06:11:46.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.775+0000 7f0006400640 1 -- 172.21.15.122:0/950387097 shutdown_connections 2024-05-28T06:11:46.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.775+0000 7f0006400640 1 --2- 172.21.15.122:0/950387097 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7effdc068a40 0x7effdc06af00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:46.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.775+0000 7f0006400640 1 --2- 172.21.15.122:0/950387097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f000015fa80 0x7f00000b3400 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:46.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.775+0000 7f0006400640 1 --2- 172.21.15.122:0/950387097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f000015ea50 0x7f00000b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:46.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.775+0000 7f0006400640 1 --2- 172.21.15.122:0/950387097 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f000006dab0 0x7f0000156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:46.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.775+0000 7f0006400640 1 -- 172.21.15.122:0/950387097 >> 172.21.15.122:0/950387097 conn(0x7f00000b4190 msgr2=0x7f0000071410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:46.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.775+0000 7f0006400640 1 -- 172.21.15.122:0/950387097 shutdown_connections 2024-05-28T06:11:46.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:46.775+0000 7f0006400640 1 -- 172.21.15.122:0/950387097 wait complete. 2024-05-28T06:11:48.218 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:11:48.222 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:11:51.795 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:11:51.930 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.931+0000 7f7d9e600640 1 Processor -- start 2024-05-28T06:11:51.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.931+0000 7f7d9e600640 1 -- start start 2024-05-28T06:11:51.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.931+0000 7f7d9e600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7d9806f890 0x7f7d980cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:51.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.931+0000 7f7d9e600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7d980cd930 0x7f7d980b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:51.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.931+0000 7f7d9e600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d980d0310 con 0x7f7d980cff30 2024-05-28T06:11:51.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.931+0000 7f7d9e600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f7d9815be20 con 0x7f7d9806f890 2024-05-28T06:11:51.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.931+0000 7f7d9e600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7d9815c100 con 0x7f7d980cd930 2024-05-28T06:11:51.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.931+0000 7f7d97400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f7d980cff30 0x7f7d9806f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:50322/0 (socket says 172.21.15.122:50322) 2024-05-28T06:11:51.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.931+0000 7f7d97400640 1 -- 172.21.15.122:0/4106986894 learned_addr learned my addr 172.21.15.122:0/4106986894 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:11:51.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.931+0000 7f7d8ea00640 1 --2- 172.21.15.122:0/4106986894 >> v2:172.21.15.122:3300/0 conn(0x7f7d9806f890 0x7f7d980cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:51.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.931+0000 7f7d97e00640 1 --2- 172.21.15.122:0/4106986894 >> v2:172.21.15.153:3300/0 conn(0x7f7d980cd930 0x7f7d980b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:51.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.931+0000 7f7d8ea00640 1 -- 172.21.15.122:0/4106986894 >> v2:172.21.15.153:3300/0 conn(0x7f7d980cd930 msgr2=0x7f7d980b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:11:51.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.931+0000 7f7d8ea00640 1 --2- 172.21.15.122:0/4106986894 >> v2:172.21.15.153:3300/0 conn(0x7f7d980cd930 0x7f7d980b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:51.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.931+0000 7f7d8ea00640 1 -- 172.21.15.122:0/4106986894 >> v1:172.21.15.122:6789/0 conn(0x7f7d980cff30 legacy=0x7f7d9806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:51.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.935+0000 7f7d8ea00640 1 -- 172.21.15.122:0/4106986894 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d9815c3e0 con 0x7f7d9806f890 2024-05-28T06:11:51.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.931+0000 7f7d96a00640 1 -- 172.21.15.122:0/4106986894 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 695922969 0 0) 0x7f7d980d0310 con 0x7f7d980cff30 2024-05-28T06:11:51.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.935+0000 7f7d8ea00640 1 --2- 172.21.15.122:0/4106986894 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d9806f890 0x7f7d980cd3f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7d9815f040 tx=0x7f7d8001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27d90cb5967c832 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:51.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.935+0000 7f7d96a00640 1 -- 172.21.15.122:0/4106986894 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d800ab5f0 con 0x7f7d9806f890 2024-05-28T06:11:51.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.935+0000 7f7d96a00640 1 -- 172.21.15.122:0/4106986894 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d800b0070 con 0x7f7d9806f890 2024-05-28T06:11:51.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.935+0000 7f7d96a00640 1 -- 172.21.15.122:0/4106986894 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d800ab9b0 con 0x7f7d9806f890 2024-05-28T06:11:51.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.935+0000 7f7d9e600640 1 -- 172.21.15.122:0/4106986894 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d9806f890 msgr2=0x7f7d980cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:51.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.935+0000 7f7d9e600640 1 --2- 172.21.15.122:0/4106986894 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d9806f890 0x7f7d980cd3f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7d9815f040 tx=0x7f7d8001c450 comp rx=0 tx=0).stop 2024-05-28T06:11:51.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.935+0000 7f7d9e600640 1 -- 172.21.15.122:0/4106986894 shutdown_connections 2024-05-28T06:11:51.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.935+0000 7f7d9e600640 1 --2- 172.21.15.122:0/4106986894 >> v2:172.21.15.153:3300/0 conn(0x7f7d980cd930 0x7f7d980b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:51.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.935+0000 7f7d9e600640 1 --2- 172.21.15.122:0/4106986894 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d9806f890 0x7f7d980cd3f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:51.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.935+0000 7f7d9e600640 1 -- 172.21.15.122:0/4106986894 >> 172.21.15.122:0/4106986894 conn(0x7f7d9806bd90 msgr2=0x7f7d9806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:51.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.935+0000 7f7d9e600640 1 -- 172.21.15.122:0/4106986894 shutdown_connections 2024-05-28T06:11:51.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.935+0000 7f7d9e600640 1 -- 172.21.15.122:0/4106986894 wait complete. 2024-05-28T06:11:51.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d9e600640 1 Processor -- start 2024-05-28T06:11:51.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d9e600640 1 -- start start 2024-05-28T06:11:51.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d9e600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d9806f890 0x7f7d980aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:51.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d9e600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d980cd930 0x7f7d981f7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:51.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d9e600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d980cff30 0x7f7d980b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:51.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d9e600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7d980b5880 con 0x7f7d980cd930 2024-05-28T06:11:51.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d9e600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7d980b5700 con 0x7f7d980cff30 2024-05-28T06:11:51.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d9e600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7d980b5a00 con 0x7f7d9806f890 2024-05-28T06:11:51.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d8ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d980cd930 0x7f7d981f7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:51.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d8ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d980cd930 0x7f7d981f7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51094/0 (socket says 172.21.15.122:51094) 2024-05-28T06:11:51.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d8ea00640 1 -- 172.21.15.122:0/53328057 learned_addr learned my addr 172.21.15.122:0/53328057 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:51.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d97e00640 1 --2- 172.21.15.122:0/53328057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d980cff30 0x7f7d980b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:51.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d97400640 1 --2- 172.21.15.122:0/53328057 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d9806f890 0x7f7d980aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:51.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d8ea00640 1 -- 172.21.15.122:0/53328057 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d9806f890 msgr2=0x7f7d980aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:51.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d8ea00640 1 --2- 172.21.15.122:0/53328057 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d9806f890 0x7f7d980aecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:51.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d8ea00640 1 -- 172.21.15.122:0/53328057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d980cff30 msgr2=0x7f7d980b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:51.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d8ea00640 1 --2- 172.21.15.122:0/53328057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d980cff30 0x7f7d980b2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:51.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d8ea00640 1 -- 172.21.15.122:0/53328057 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d981f81f0 con 0x7f7d980cd930 2024-05-28T06:11:51.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d8ea00640 1 --2- 172.21.15.122:0/53328057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d980cd930 0x7f7d981f7cb0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7d800ad040 tx=0x7f7d8001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:51.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d8fe00640 1 -- 172.21.15.122:0/53328057 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80004020 con 0x7f7d980cd930 2024-05-28T06:11:51.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d8fe00640 1 -- 172.21.15.122:0/53328057 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d800041c0 con 0x7f7d980cd930 2024-05-28T06:11:51.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d8fe00640 1 -- 172.21.15.122:0/53328057 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80003620 con 0x7f7d980cd930 2024-05-28T06:11:51.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d9e600640 1 -- 172.21.15.122:0/53328057 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d980adc50 con 0x7f7d980cd930 2024-05-28T06:11:51.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.939+0000 7f7d9e600640 1 -- 172.21.15.122:0/53328057 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d980ae210 con 0x7f7d980cd930 2024-05-28T06:11:51.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.943+0000 7f7d9e600640 1 -- 172.21.15.122:0/53328057 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d98068c40 con 0x7f7d980cd930 2024-05-28T06:11:51.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.943+0000 7f7d8fe00640 1 -- 172.21.15.122:0/53328057 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 88599+0+0 (secure 0 0 0) 0x7f7d800037c0 con 0x7f7d980cd930 2024-05-28T06:11:51.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.943+0000 7f7d8fe00640 1 --2- 172.21.15.122:0/53328057 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7d74068a40 0x7f7d7406af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:51.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.943+0000 7f7d8fe00640 1 -- 172.21.15.122:0/53328057 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7f7d80121a60 con 0x7f7d980cd930 2024-05-28T06:11:51.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.943+0000 7f7d97400640 1 --2- 172.21.15.122:0/53328057 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7d74068a40 0x7f7d7406af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:51.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.943+0000 7f7d97400640 1 --2- 172.21.15.122:0/53328057 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7d74068a40 0x7f7d7406af00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7d88000f70 tx=0x7f7d88007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:51.947 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:51.947+0000 7f7d8fe00640 1 -- 172.21.15.122:0/53328057 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7d80016070 con 0x7f7d980cd930 2024-05-28T06:11:52.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:52.163+0000 7f7d9e600640 1 -- 172.21.15.122:0/53328057 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f7d980ccdf0 con 0x7f7d980cd930 2024-05-28T06:11:52.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:52.163+0000 7f7d8fe00640 1 -- 172.21.15.122:0/53328057 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2079 (secure 0 0 0) 0x7f7d800f1620 con 0x7f7d980cd930 2024-05-28T06:11:52.162 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:11:52.162 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:11:52.162 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:11:52.162 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:11:52.162 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:11:52.162 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:11:52.162 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:11:52.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:52.162 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:11:52.163 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:11:52.163 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:11:52.163 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:11:52.163 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:11:52.163 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:52.163 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:11:52.163 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:11:52.163 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:11:52.163 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:11:52.163 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:52.163 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 387, 2024-05-28T06:11:52.163 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:11:52.163 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:11:52.163 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:11:52.164 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:11:52.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:52.164 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:11:52.164 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 49, 2024-05-28T06:11:52.164 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:11:52.164 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:11:52.164 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:11:52.164 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:11:52.164 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:11:52.164 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:11:52.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:52.164 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:11:52.164 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:11:52.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:11:52.165 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:11:52.165 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:11:52.165 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:52.165 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:52.165 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:11:52.165 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:11:52.165 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 4428, 2024-05-28T06:11:52.165 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 18440078190, 2024-05-28T06:11:52.165 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 37263884288, 2024-05-28T06:11:52.165 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 735830228992, 2024-05-28T06:11:52.165 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:11:52.165 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 6142, 2024-05-28T06:11:52.165 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 0, 2024-05-28T06:11:52.165 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 2 2024-05-28T06:11:52.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:52.166 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:11:52.166 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 29, 2024-05-28T06:11:52.166 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 3, 2024-05-28T06:11:52.166 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:11:52.166 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:11:52.166 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:11:52.166 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:11:52.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:11:52.166 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 3, 2024-05-28T06:11:52.166 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:11:52.166 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "a", 2024-05-28T06:11:52.166 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:11:52.166 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 5679 2024-05-28T06:11:52.167 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:52.167 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:52.167 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:11:52.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:52.167 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:11:52.167 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:11:52.167 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:11:52.167 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:11:52.167 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:11:52.167 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:11:52.167 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:11:52.167 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:52.167 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:11:52.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:52.167 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:11:52.168 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 8, 2024-05-28T06:11:52.168 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:10:43.307303+0000", 2024-05-28T06:11:52.168 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:11:52.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:52.168 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:11:52.168 INFO:teuthology.orchestra.run.smithi122.stdout: "ed0906d2-55cb-4fe9-b815-1869630be1ae": { 2024-05-28T06:11:52.168 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "All cloning finished, waiting 15.0 seconds before exiting (27s)\n [============================] ", 2024-05-28T06:11:52.168 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 1, 2024-05-28T06:11:52.168 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:11:52.168 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:52.168 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:52.168 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:11:52.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:52.163+0000 7f7d9e600640 1 -- 172.21.15.122:0/53328057 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7d74068a40 msgr2=0x7f7d7406af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:52.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:52.163+0000 7f7d9e600640 1 --2- 172.21.15.122:0/53328057 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7d74068a40 0x7f7d7406af00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7d88000f70 tx=0x7f7d88007c10 comp rx=0 tx=0).stop 2024-05-28T06:11:52.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:52.163+0000 7f7d9e600640 1 -- 172.21.15.122:0/53328057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d980cd930 msgr2=0x7f7d981f7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:52.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:52.163+0000 7f7d9e600640 1 --2- 172.21.15.122:0/53328057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d980cd930 0x7f7d981f7cb0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7d800ad040 tx=0x7f7d8001ac90 comp rx=0 tx=0).stop 2024-05-28T06:11:52.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:52.163+0000 7f7d9e600640 1 -- 172.21.15.122:0/53328057 shutdown_connections 2024-05-28T06:11:52.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:52.163+0000 7f7d9e600640 1 --2- 172.21.15.122:0/53328057 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7d74068a40 0x7f7d7406af00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:52.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:52.163+0000 7f7d9e600640 1 --2- 172.21.15.122:0/53328057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d980cff30 0x7f7d980b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:52.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:52.163+0000 7f7d9e600640 1 --2- 172.21.15.122:0/53328057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d980cd930 0x7f7d981f7cb0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:52.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:52.163+0000 7f7d9e600640 1 --2- 172.21.15.122:0/53328057 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d9806f890 0x7f7d980aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:52.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:52.163+0000 7f7d9e600640 1 -- 172.21.15.122:0/53328057 >> 172.21.15.122:0/53328057 conn(0x7f7d9806bd90 msgr2=0x7f7d98072b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:52.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:52.163+0000 7f7d9e600640 1 -- 172.21.15.122:0/53328057 shutdown_connections 2024-05-28T06:11:52.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:52.163+0000 7f7d9e600640 1 -- 172.21.15.122:0/53328057 wait complete. 2024-05-28T06:11:57.184 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:11:57.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.331+0000 7fcf7ca00640 1 Processor -- start 2024-05-28T06:11:57.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.331+0000 7fcf7ca00640 1 -- start start 2024-05-28T06:11:57.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.335+0000 7fcf7ca00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcf7815e9a0 0x7fcf780d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:57.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.335+0000 7fcf7ca00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcf7809bb40 0x7fcf7806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:57.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.335+0000 7fcf7ca00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcf7806de00 0x7fcf7809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:57.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.335+0000 7fcf7ca00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fcf780d0090 con 0x7fcf7806de00 2024-05-28T06:11:57.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.335+0000 7fcf7ca00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fcf780d02e0 con 0x7fcf7815e9a0 2024-05-28T06:11:57.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.335+0000 7fcf7ca00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcf780d05c0 con 0x7fcf7809bb40 2024-05-28T06:11:57.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.335+0000 7fcf77e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcf7806de00 0x7fcf7809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:57.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.335+0000 7fcf77e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcf7806de00 0x7fcf7809aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40096/0 (socket says 172.21.15.122:40096) 2024-05-28T06:11:57.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.335+0000 7fcf77e00640 1 -- 172.21.15.122:0/1910333002 learned_addr learned my addr 172.21.15.122:0/1910333002 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:57.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.335+0000 7fcf6fe00640 1 --2- 172.21.15.122:0/1910333002 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcf7809bb40 0x7fcf7806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:57.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.335+0000 7fcf77400640 1 --2- 172.21.15.122:0/1910333002 >> v2:172.21.15.153:3300/0 conn(0x7fcf7815e9a0 0x7fcf780d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:57.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.335+0000 7fcf77e00640 1 -- 172.21.15.122:0/1910333002 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcf7809bb40 msgr2=0x7fcf7806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:11:57.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.335+0000 7fcf77e00640 1 --2- 172.21.15.122:0/1910333002 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcf7809bb40 0x7fcf7806d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:57.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.335+0000 7fcf77e00640 1 -- 172.21.15.122:0/1910333002 >> v2:172.21.15.153:3300/0 conn(0x7fcf7815e9a0 msgr2=0x7fcf780d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:11:57.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.335+0000 7fcf77e00640 1 --2- 172.21.15.122:0/1910333002 >> v2:172.21.15.153:3300/0 conn(0x7fcf7815e9a0 0x7fcf780d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:57.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.335+0000 7fcf77e00640 1 -- 172.21.15.122:0/1910333002 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf780d08a0 con 0x7fcf7806de00 2024-05-28T06:11:57.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.339+0000 7fcf77e00640 1 --2- 172.21.15.122:0/1910333002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf7806de00 0x7fcf7809aa40 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcf780734b0 tx=0x7fcf7001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f772b36db8fcf7c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:57.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.339+0000 7fcf76a00640 1 -- 172.21.15.122:0/1910333002 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf700a5670 con 0x7fcf7806de00 2024-05-28T06:11:57.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.339+0000 7fcf76a00640 1 -- 172.21.15.122:0/1910333002 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf700a5810 con 0x7fcf7806de00 2024-05-28T06:11:57.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.339+0000 7fcf76a00640 1 -- 172.21.15.122:0/1910333002 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf700a5be0 con 0x7fcf7806de00 2024-05-28T06:11:57.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.339+0000 7fcf7ca00640 1 -- 172.21.15.122:0/1910333002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf7806de00 msgr2=0x7fcf7809aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:57.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.339+0000 7fcf7ca00640 1 --2- 172.21.15.122:0/1910333002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf7806de00 0x7fcf7809aa40 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcf780734b0 tx=0x7fcf7001c9f0 comp rx=0 tx=0).stop 2024-05-28T06:11:57.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.339+0000 7fcf7ca00640 1 -- 172.21.15.122:0/1910333002 shutdown_connections 2024-05-28T06:11:57.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.339+0000 7fcf7ca00640 1 --2- 172.21.15.122:0/1910333002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf7806de00 0x7fcf7809aa40 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:57.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.339+0000 7fcf7ca00640 1 --2- 172.21.15.122:0/1910333002 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcf7809bb40 0x7fcf7806d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:57.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.339+0000 7fcf7ca00640 1 --2- 172.21.15.122:0/1910333002 >> v2:172.21.15.153:3300/0 conn(0x7fcf7815e9a0 0x7fcf780d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:57.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.339+0000 7fcf7ca00640 1 -- 172.21.15.122:0/1910333002 >> 172.21.15.122:0/1910333002 conn(0x7fcf780d24c0 msgr2=0x7fcf780d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:57.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.339+0000 7fcf7ca00640 1 -- 172.21.15.122:0/1910333002 shutdown_connections 2024-05-28T06:11:57.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.339+0000 7fcf7ca00640 1 -- 172.21.15.122:0/1910333002 wait complete. 2024-05-28T06:11:57.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.339+0000 7fcf7ca00640 1 Processor -- start 2024-05-28T06:11:57.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.339+0000 7fcf7ca00640 1 -- start start 2024-05-28T06:11:57.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf7ca00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf7806de00 0x7fcf781508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:57.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf7ca00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf7815e9a0 0x7fcf780cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:57.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf7ca00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcf78151fd0 0x7fcf780cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:57.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf7ca00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcf780cd6b0 con 0x7fcf7815e9a0 2024-05-28T06:11:57.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf7ca00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcf780cd530 con 0x7fcf7806de00 2024-05-28T06:11:57.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf7ca00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcf780cd830 con 0x7fcf78151fd0 2024-05-28T06:11:57.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf6fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf7815e9a0 0x7fcf780cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:57.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf6fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf7815e9a0 0x7fcf780cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40102/0 (socket says 172.21.15.122:40102) 2024-05-28T06:11:57.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf6fe00640 1 -- 172.21.15.122:0/2500436575 learned_addr learned my addr 172.21.15.122:0/2500436575 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:11:57.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf77400640 1 --2- 172.21.15.122:0/2500436575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf7806de00 0x7fcf781508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:57.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf77e00640 1 --2- 172.21.15.122:0/2500436575 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcf78151fd0 0x7fcf780cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:57.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf6fe00640 1 -- 172.21.15.122:0/2500436575 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcf78151fd0 msgr2=0x7fcf780cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:57.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf6fe00640 1 --2- 172.21.15.122:0/2500436575 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcf78151fd0 0x7fcf780cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:57.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf6fe00640 1 -- 172.21.15.122:0/2500436575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf7806de00 msgr2=0x7fcf781508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:57.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf6fe00640 1 --2- 172.21.15.122:0/2500436575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf7806de00 0x7fcf781508c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:57.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf6fe00640 1 -- 172.21.15.122:0/2500436575 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf78150f30 con 0x7fcf7815e9a0 2024-05-28T06:11:57.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf6fe00640 1 --2- 172.21.15.122:0/2500436575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf7815e9a0 0x7fcf780cb8d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000e870 tx=0x7fcf6000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:57.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf6f400640 1 -- 172.21.15.122:0/2500436575 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60017070 con 0x7fcf7815e9a0 2024-05-28T06:11:57.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf6f400640 1 -- 172.21.15.122:0/2500436575 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf6000c940 con 0x7fcf7815e9a0 2024-05-28T06:11:57.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf6f400640 1 -- 172.21.15.122:0/2500436575 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6000ccf0 con 0x7fcf7815e9a0 2024-05-28T06:11:57.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf7ca00640 1 -- 172.21.15.122:0/2500436575 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf78151210 con 0x7fcf7815e9a0 2024-05-28T06:11:57.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf7ca00640 1 -- 172.21.15.122:0/2500436575 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf781517d0 con 0x7fcf7815e9a0 2024-05-28T06:11:57.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf7ca00640 1 -- 172.21.15.122:0/2500436575 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf78075620 con 0x7fcf7815e9a0 2024-05-28T06:11:57.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.343+0000 7fcf6f400640 1 -- 172.21.15.122:0/2500436575 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 88599+0+0 (secure 0 0 0) 0x7fcf6001a070 con 0x7fcf7815e9a0 2024-05-28T06:11:57.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.347+0000 7fcf6f400640 1 --2- 172.21.15.122:0/2500436575 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcf54068a40 0x7fcf5406af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:11:57.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.347+0000 7fcf6f400640 1 -- 172.21.15.122:0/2500436575 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7fcf600876e0 con 0x7fcf7815e9a0 2024-05-28T06:11:57.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.347+0000 7fcf77400640 1 --2- 172.21.15.122:0/2500436575 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcf54068a40 0x7fcf5406af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:11:57.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.347+0000 7fcf77400640 1 --2- 172.21.15.122:0/2500436575 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcf54068a40 0x7fcf5406af00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcf68009a40 tx=0x7fcf68009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:11:57.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.351+0000 7fcf6f400640 1 -- 172.21.15.122:0/2500436575 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcf60056d40 con 0x7fcf7815e9a0 2024-05-28T06:11:57.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.571+0000 7fcf7ca00640 1 -- 172.21.15.122:0/2500436575 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fcf780d3200 con 0x7fcf7815e9a0 2024-05-28T06:11:57.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.571+0000 7fcf6f400640 1 -- 172.21.15.122:0/2500436575 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2078 (secure 0 0 0) 0x7fcf6005b040 con 0x7fcf7815e9a0 2024-05-28T06:11:57.570 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:11:57.570 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:11:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:11:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:11:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:11:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:11:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:11:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:11:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:11:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:11:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:11:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:11:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:11:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:11:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:11:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:11:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 393, 2024-05-28T06:11:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:11:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:11:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:11:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:11:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:11:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 49, 2024-05-28T06:11:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:11:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:11:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:11:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:11:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:11:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:11:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:11:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:11:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:11:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:11:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:11:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:11:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:11:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 4428, 2024-05-28T06:11:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 18440089982, 2024-05-28T06:11:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 37263908864, 2024-05-28T06:11:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 735830204416, 2024-05-28T06:11:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:11:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 2047, 2024-05-28T06:11:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 0, 2024-05-28T06:11:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 0 2024-05-28T06:11:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:11:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 29, 2024-05-28T06:11:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 3, 2024-05-28T06:11:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:11:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:11:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:11:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:11:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:11:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 3, 2024-05-28T06:11:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:11:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "a", 2024-05-28T06:11:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:11:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 5679 2024-05-28T06:11:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:11:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:11:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:11:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:11:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:11:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:11:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:11:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:11:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:11:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:11:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:11:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 8, 2024-05-28T06:11:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:10:43.307303+0000", 2024-05-28T06:11:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:11:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:11:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:11:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: "ed0906d2-55cb-4fe9-b815-1869630be1ae": { 2024-05-28T06:11:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "All cloning finished, waiting 9.0 seconds before exiting (33s)\n [============================] ", 2024-05-28T06:11:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 1, 2024-05-28T06:11:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:11:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:11:57.578 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:11:57.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.571+0000 7fcf7ca00640 1 -- 172.21.15.122:0/2500436575 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcf54068a40 msgr2=0x7fcf5406af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:57.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.571+0000 7fcf7ca00640 1 --2- 172.21.15.122:0/2500436575 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcf54068a40 0x7fcf5406af00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcf68009a40 tx=0x7fcf68009190 comp rx=0 tx=0).stop 2024-05-28T06:11:57.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.571+0000 7fcf7ca00640 1 -- 172.21.15.122:0/2500436575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf7815e9a0 msgr2=0x7fcf780cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:11:57.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.571+0000 7fcf7ca00640 1 --2- 172.21.15.122:0/2500436575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf7815e9a0 0x7fcf780cb8d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000e870 tx=0x7fcf6000ec70 comp rx=0 tx=0).stop 2024-05-28T06:11:57.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.571+0000 7fcf7ca00640 1 -- 172.21.15.122:0/2500436575 shutdown_connections 2024-05-28T06:11:57.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.571+0000 7fcf7ca00640 1 --2- 172.21.15.122:0/2500436575 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcf54068a40 0x7fcf5406af00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:57.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.571+0000 7fcf7ca00640 1 --2- 172.21.15.122:0/2500436575 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcf78151fd0 0x7fcf780cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:57.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.571+0000 7fcf7ca00640 1 --2- 172.21.15.122:0/2500436575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf7815e9a0 0x7fcf780cb8d0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:57.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.571+0000 7fcf7ca00640 1 --2- 172.21.15.122:0/2500436575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf7806de00 0x7fcf781508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:11:57.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.571+0000 7fcf7ca00640 1 -- 172.21.15.122:0/2500436575 >> 172.21.15.122:0/2500436575 conn(0x7fcf780d24c0 msgr2=0x7fcf78071700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:11:57.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.571+0000 7fcf7ca00640 1 -- 172.21.15.122:0/2500436575 shutdown_connections 2024-05-28T06:11:57.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:11:57.571+0000 7fcf7ca00640 1 -- 172.21.15.122:0/2500436575 wait complete. 2024-05-28T06:12:02.592 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:12:02.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.738+0000 7f09d1200640 1 Processor -- start 2024-05-28T06:12:02.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.738+0000 7f09d1200640 1 -- start start 2024-05-28T06:12:02.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.738+0000 7f09d1200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f09cc0d0c80 0x7f09cc09b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:02.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.738+0000 7f09d1200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09cc15d7e0 0x7f09cc0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:02.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.738+0000 7f09d1200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09cc15dc70 con 0x7f09cc0d0270 2024-05-28T06:12:02.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.738+0000 7f09d1200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f09cc0d0830 con 0x7f09cc0d0c80 2024-05-28T06:12:02.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.738+0000 7f09d1200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f09cc09aa40 con 0x7f09cc15d7e0 2024-05-28T06:12:02.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.738+0000 7f09c9e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f09cc0d0c80 0x7f09cc09b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:02.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.738+0000 7f09c9e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f09cc0d0c80 0x7f09cc09b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40106/0 (socket says 172.21.15.122:40106) 2024-05-28T06:12:02.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.738+0000 7f09c9e00640 1 -- 172.21.15.122:0/2343560885 learned_addr learned my addr 172.21.15.122:0/2343560885 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:02.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.738+0000 7f09c9400640 1 --1- 172.21.15.122:0/2343560885 >> v1:172.21.15.122:6789/0 conn(0x7f09cc0d0270 0x7f09cc0d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:41414/0 (socket says 172.21.15.122:41414) 2024-05-28T06:12:02.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.738+0000 7f09c9e00640 1 -- 172.21.15.122:0/2343560885 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09cc15d7e0 msgr2=0x7f09cc0cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:02.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.738+0000 7f09c9e00640 1 --2- 172.21.15.122:0/2343560885 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09cc15d7e0 0x7f09cc0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:02.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.738+0000 7f09c9e00640 1 -- 172.21.15.122:0/2343560885 >> v1:172.21.15.122:6789/0 conn(0x7f09cc0d0270 legacy=0x7f09cc0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:02.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.738+0000 7f09c9e00640 1 -- 172.21.15.122:0/2343560885 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09cc09ad20 con 0x7f09cc0d0c80 2024-05-28T06:12:02.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.742+0000 7f09c9e00640 1 --2- 172.21.15.122:0/2343560885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09cc0d0c80 0x7f09cc09b800 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f09bc009870 tx=0x7f09bc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efeda4d5760eae75 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:02.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.742+0000 7f09c8a00640 1 -- 172.21.15.122:0/2343560885 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09bc0b1070 con 0x7f09cc0d0c80 2024-05-28T06:12:02.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.742+0000 7f09c8a00640 1 -- 172.21.15.122:0/2343560885 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09bc0ac410 con 0x7f09cc0d0c80 2024-05-28T06:12:02.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.742+0000 7f09c8a00640 1 -- 172.21.15.122:0/2343560885 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09bc0ac7e0 con 0x7f09cc0d0c80 2024-05-28T06:12:02.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.742+0000 7f09d1200640 1 -- 172.21.15.122:0/2343560885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09cc0d0c80 msgr2=0x7f09cc09b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:02.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.742+0000 7f09d1200640 1 --2- 172.21.15.122:0/2343560885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09cc0d0c80 0x7f09cc09b800 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f09bc009870 tx=0x7f09bc01c4a0 comp rx=0 tx=0).stop 2024-05-28T06:12:02.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.742+0000 7f09d1200640 1 -- 172.21.15.122:0/2343560885 shutdown_connections 2024-05-28T06:12:02.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.742+0000 7f09d1200640 1 --2- 172.21.15.122:0/2343560885 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09cc15d7e0 0x7f09cc0cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:02.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.742+0000 7f09d1200640 1 --2- 172.21.15.122:0/2343560885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09cc0d0c80 0x7f09cc09b800 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:02.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.742+0000 7f09d1200640 1 -- 172.21.15.122:0/2343560885 >> 172.21.15.122:0/2343560885 conn(0x7f09cc0b4190 msgr2=0x7f09cc0b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:02.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.742+0000 7f09d1200640 1 -- 172.21.15.122:0/2343560885 shutdown_connections 2024-05-28T06:12:02.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.742+0000 7f09d1200640 1 -- 172.21.15.122:0/2343560885 wait complete. 2024-05-28T06:12:02.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.742+0000 7f09d1200640 1 Processor -- start 2024-05-28T06:12:02.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.742+0000 7f09d1200640 1 -- start start 2024-05-28T06:12:02.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.746+0000 7f09d1200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09cc0d0270 0x7f09cc152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:02.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.746+0000 7f09d1200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09cc0d0c80 0x7f09cc153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:02.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.746+0000 7f09d1200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09cc15d7e0 0x7f09cc0712a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:02.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.746+0000 7f09d1200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f09cc1697c0 con 0x7f09cc0d0c80 2024-05-28T06:12:02.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.746+0000 7f09d1200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f09cc169640 con 0x7f09cc0d0270 2024-05-28T06:12:02.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.746+0000 7f09d1200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f09cc169940 con 0x7f09cc15d7e0 2024-05-28T06:12:02.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.746+0000 7f09c9400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09cc0d0c80 0x7f09cc153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:02.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.746+0000 7f09c9400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09cc0d0c80 0x7f09cc153740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40118/0 (socket says 172.21.15.122:40118) 2024-05-28T06:12:02.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.746+0000 7f09c9400640 1 -- 172.21.15.122:0/178008293 learned_addr learned my addr 172.21.15.122:0/178008293 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:02.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.746+0000 7f09c9e00640 1 --2- 172.21.15.122:0/178008293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09cc0d0270 0x7f09cc152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:02.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.746+0000 7f09ca800640 1 --2- 172.21.15.122:0/178008293 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09cc15d7e0 0x7f09cc0712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:02.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.746+0000 7f09c9400640 1 -- 172.21.15.122:0/178008293 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09cc15d7e0 msgr2=0x7f09cc0712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:02.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.746+0000 7f09c9400640 1 --2- 172.21.15.122:0/178008293 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09cc15d7e0 0x7f09cc0712a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:02.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.746+0000 7f09c9400640 1 -- 172.21.15.122:0/178008293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09cc0d0270 msgr2=0x7f09cc152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:02.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.746+0000 7f09c9400640 1 --2- 172.21.15.122:0/178008293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09cc0d0270 0x7f09cc152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:02.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.746+0000 7f09c9400640 1 -- 172.21.15.122:0/178008293 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09cc154190 con 0x7f09cc0d0c80 2024-05-28T06:12:02.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.746+0000 7f09c9400640 1 --2- 172.21.15.122:0/178008293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09cc0d0c80 0x7f09cc153740 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f09b800c370 tx=0x7f09b800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:02.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.746+0000 7f09c2000640 1 -- 172.21.15.122:0/178008293 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b80074e0 con 0x7f09cc0d0c80 2024-05-28T06:12:02.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.746+0000 7f09c2000640 1 -- 172.21.15.122:0/178008293 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b8007680 con 0x7f09cc0d0c80 2024-05-28T06:12:02.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.746+0000 7f09c2000640 1 -- 172.21.15.122:0/178008293 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b8004a30 con 0x7f09cc0d0c80 2024-05-28T06:12:02.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.746+0000 7f09d1200640 1 -- 172.21.15.122:0/178008293 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09cc154470 con 0x7f09cc0d0c80 2024-05-28T06:12:02.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.746+0000 7f09d1200640 1 -- 172.21.15.122:0/178008293 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09cc154a30 con 0x7f09cc0d0c80 2024-05-28T06:12:02.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.746+0000 7f09d1200640 1 -- 172.21.15.122:0/178008293 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09cc068c40 con 0x7f09cc0d0c80 2024-05-28T06:12:02.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.750+0000 7f09c2000640 1 -- 172.21.15.122:0/178008293 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 88599+0+0 (secure 0 0 0) 0x7f09b801a020 con 0x7f09cc0d0c80 2024-05-28T06:12:02.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.750+0000 7f09c2000640 1 --2- 172.21.15.122:0/178008293 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f09ac068a70 0x7f09ac06af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:02.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.750+0000 7f09c2000640 1 -- 172.21.15.122:0/178008293 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7f09b8086da0 con 0x7f09cc0d0c80 2024-05-28T06:12:02.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.750+0000 7f09c9e00640 1 --2- 172.21.15.122:0/178008293 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f09ac068a70 0x7f09ac06af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:02.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.750+0000 7f09c9e00640 1 --2- 172.21.15.122:0/178008293 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f09ac068a70 0x7f09ac06af30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f09bc0ae000 tx=0x7f09bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:02.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.754+0000 7f09c2000640 1 -- 172.21.15.122:0/178008293 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f09b8056950 con 0x7f09cc0d0c80 2024-05-28T06:12:02.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.966+0000 7f09d1200640 1 -- 172.21.15.122:0/178008293 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f09cc0b8620 con 0x7f09cc0d0c80 2024-05-28T06:12:02.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.970+0000 7f09c2000640 1 -- 172.21.15.122:0/178008293 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2078 (secure 0 0 0) 0x7f09b8056250 con 0x7f09cc0d0c80 2024-05-28T06:12:02.969 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:02.969 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:12:02.969 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:12:02.970 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:12:02.970 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:12:02.970 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:12:02.970 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:12:02.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:02.970 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:12:02.970 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:12:02.970 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:12:02.970 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:12:02.970 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:12:02.971 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:12:02.971 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:12:02.971 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:12:02.971 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:12:02.971 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:12:02.971 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:12:02.971 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 398, 2024-05-28T06:12:02.971 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:12:02.971 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:12:02.971 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:12:02.971 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:12:02.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:02.971 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:12:02.971 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 49, 2024-05-28T06:12:02.971 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:12:02.972 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:12:02.972 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:12:02.972 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:12:02.972 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:12:02.972 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:12:02.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:02.972 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:12:02.972 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:12:02.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:02.972 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:12:02.972 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:12:02.972 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:02.972 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:12:02.972 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:12:02.972 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:12:02.972 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 4428, 2024-05-28T06:12:02.973 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 18440089982, 2024-05-28T06:12:02.973 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 37263908864, 2024-05-28T06:12:02.973 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 735830204416, 2024-05-28T06:12:02.973 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:12:02.973 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 1109, 2024-05-28T06:12:02.973 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 0, 2024-05-28T06:12:02.973 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 0 2024-05-28T06:12:02.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:02.973 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:12:02.973 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 29, 2024-05-28T06:12:02.973 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 3, 2024-05-28T06:12:02.973 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:12:02.973 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:12:02.973 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:12:02.973 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:12:02.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:02.974 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 3, 2024-05-28T06:12:02.974 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:12:02.974 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "a", 2024-05-28T06:12:02.974 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:12:02.974 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 5679 2024-05-28T06:12:02.974 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:02.974 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:12:02.974 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:12:02.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:02.974 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:12:02.974 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:12:02.974 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:12:02.974 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:12:02.974 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:12:02.974 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:12:02.975 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:12:02.975 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:12:02.975 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:12:02.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:02.975 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:12:02.975 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 8, 2024-05-28T06:12:02.975 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:10:43.307303+0000", 2024-05-28T06:12:02.975 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:12:02.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:02.975 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:12:02.975 INFO:teuthology.orchestra.run.smithi122.stdout: "ed0906d2-55cb-4fe9-b815-1869630be1ae": { 2024-05-28T06:12:02.975 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "All cloning finished, waiting 5.0 seconds before exiting (37s)\n [============================] ", 2024-05-28T06:12:02.975 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 1, 2024-05-28T06:12:02.975 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:12:02.975 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:02.975 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:02.976 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:12:02.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.970+0000 7f09d1200640 1 -- 172.21.15.122:0/178008293 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f09ac068a70 msgr2=0x7f09ac06af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:02.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.970+0000 7f09d1200640 1 --2- 172.21.15.122:0/178008293 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f09ac068a70 0x7f09ac06af30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f09bc0ae000 tx=0x7f09bc008040 comp rx=0 tx=0).stop 2024-05-28T06:12:02.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.970+0000 7f09d1200640 1 -- 172.21.15.122:0/178008293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09cc0d0c80 msgr2=0x7f09cc153740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:02.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.970+0000 7f09d1200640 1 --2- 172.21.15.122:0/178008293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09cc0d0c80 0x7f09cc153740 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f09b800c370 tx=0x7f09b800c830 comp rx=0 tx=0).stop 2024-05-28T06:12:02.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.970+0000 7f09d1200640 1 -- 172.21.15.122:0/178008293 shutdown_connections 2024-05-28T06:12:02.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.970+0000 7f09d1200640 1 --2- 172.21.15.122:0/178008293 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f09ac068a70 0x7f09ac06af30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:02.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.970+0000 7f09d1200640 1 --2- 172.21.15.122:0/178008293 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09cc15d7e0 0x7f09cc0712a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:02.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.970+0000 7f09d1200640 1 --2- 172.21.15.122:0/178008293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09cc0d0c80 0x7f09cc153740 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:02.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.970+0000 7f09d1200640 1 --2- 172.21.15.122:0/178008293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09cc0d0270 0x7f09cc152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:02.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.970+0000 7f09d1200640 1 -- 172.21.15.122:0/178008293 >> 172.21.15.122:0/178008293 conn(0x7f09cc0b4190 msgr2=0x7f09cc0c7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:02.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.970+0000 7f09d1200640 1 -- 172.21.15.122:0/178008293 shutdown_connections 2024-05-28T06:12:02.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:02.970+0000 7f09d1200640 1 -- 172.21.15.122:0/178008293 wait complete. 2024-05-28T06:12:07.992 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:12:08.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.142+0000 7f6c2f800640 1 Processor -- start 2024-05-28T06:12:08.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.142+0000 7f6c2f800640 1 -- start start 2024-05-28T06:12:08.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.142+0000 7f6c2f800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6c28162be0 0x7f6c280cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:08.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.142+0000 7f6c2f800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6c280729b0 0x7f6c280ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:08.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.142+0000 7f6c2f800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c2806e070 con 0x7f6c280cccf0 2024-05-28T06:12:08.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.142+0000 7f6c2f800640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f6c281641b0 con 0x7f6c28162be0 2024-05-28T06:12:08.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.142+0000 7f6c2f800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6c2806e350 con 0x7f6c280729b0 2024-05-28T06:12:08.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.142+0000 7f6c2ce00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6c28162be0 0x7f6c280cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:08.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.142+0000 7f6c27e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f6c280cccf0 0x7f6c280722a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:34756/0 (socket says 172.21.15.122:34756) 2024-05-28T06:12:08.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.142+0000 7f6c27e00640 1 -- 172.21.15.122:0/841788830 learned_addr learned my addr 172.21.15.122:0/841788830 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:08.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.142+0000 7f6c2ce00640 1 -- 172.21.15.122:0/841788830 >> v2:172.21.15.153:3300/0 conn(0x7f6c280729b0 msgr2=0x7f6c280ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:08.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.142+0000 7f6c2ce00640 1 --2- 172.21.15.122:0/841788830 >> v2:172.21.15.153:3300/0 conn(0x7f6c280729b0 0x7f6c280ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.142+0000 7f6c2ce00640 1 -- 172.21.15.122:0/841788830 >> v1:172.21.15.122:6789/0 conn(0x7f6c280cccf0 legacy=0x7f6c280722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:08.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.142+0000 7f6c2ce00640 1 -- 172.21.15.122:0/841788830 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2806e630 con 0x7f6c28162be0 2024-05-28T06:12:08.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.142+0000 7f6c27400640 1 -- 172.21.15.122:0/841788830 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 883222460 0 0) 0x7f6c2806e070 con 0x7f6c280cccf0 2024-05-28T06:12:08.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.146+0000 7f6c2ce00640 1 --2- 172.21.15.122:0/841788830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c28162be0 0x7f6c280cc7b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6c2806fb50 tx=0x7f6c1c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e724ae6795dd1fa6 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:08.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.146+0000 7f6c27400640 1 -- 172.21.15.122:0/841788830 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c0ab650 con 0x7f6c28162be0 2024-05-28T06:12:08.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.146+0000 7f6c27400640 1 -- 172.21.15.122:0/841788830 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c1c0b0070 con 0x7f6c28162be0 2024-05-28T06:12:08.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.146+0000 7f6c27400640 1 -- 172.21.15.122:0/841788830 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c0aba10 con 0x7f6c28162be0 2024-05-28T06:12:08.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.146+0000 7f6c2f800640 1 -- 172.21.15.122:0/841788830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c28162be0 msgr2=0x7f6c280cc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:08.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.146+0000 7f6c2f800640 1 --2- 172.21.15.122:0/841788830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c28162be0 0x7f6c280cc7b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6c2806fb50 tx=0x7f6c1c01c450 comp rx=0 tx=0).stop 2024-05-28T06:12:08.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.146+0000 7f6c2f800640 1 -- 172.21.15.122:0/841788830 shutdown_connections 2024-05-28T06:12:08.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.146+0000 7f6c2f800640 1 --2- 172.21.15.122:0/841788830 >> v2:172.21.15.153:3300/0 conn(0x7f6c280729b0 0x7f6c280ce6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.146+0000 7f6c2f800640 1 --2- 172.21.15.122:0/841788830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c28162be0 0x7f6c280cc7b0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.146+0000 7f6c2f800640 1 -- 172.21.15.122:0/841788830 >> 172.21.15.122:0/841788830 conn(0x7f6c2806bd90 msgr2=0x7f6c2806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:08.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.146+0000 7f6c2f800640 1 -- 172.21.15.122:0/841788830 shutdown_connections 2024-05-28T06:12:08.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.146+0000 7f6c2f800640 1 -- 172.21.15.122:0/841788830 wait complete. 2024-05-28T06:12:08.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c2f800640 1 Processor -- start 2024-05-28T06:12:08.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c2f800640 1 -- start start 2024-05-28T06:12:08.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c2f800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c280729b0 0x7f6c2814f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:08.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c2f800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c280cccf0 0x7f6c2815da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:08.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c2f800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c28162be0 0x7f6c28074d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:08.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c2f800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6c280cf430 con 0x7f6c280cccf0 2024-05-28T06:12:08.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c2f800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c28162fc0 con 0x7f6c280729b0 2024-05-28T06:12:08.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c2f800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6c280cf5b0 con 0x7f6c28162be0 2024-05-28T06:12:08.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c27e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c280cccf0 0x7f6c2815da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:08.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c27e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c280cccf0 0x7f6c2815da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43724/0 (socket says 172.21.15.122:43724) 2024-05-28T06:12:08.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c27e00640 1 -- 172.21.15.122:0/669761837 learned_addr learned my addr 172.21.15.122:0/669761837 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:08.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c2ce00640 1 --2- 172.21.15.122:0/669761837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c280729b0 0x7f6c2814f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:08.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c2d800640 1 --2- 172.21.15.122:0/669761837 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c28162be0 0x7f6c28074d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:08.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c27e00640 1 -- 172.21.15.122:0/669761837 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c28162be0 msgr2=0x7f6c28074d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:08.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c27e00640 1 --2- 172.21.15.122:0/669761837 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c28162be0 0x7f6c28074d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c27e00640 1 -- 172.21.15.122:0/669761837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c280729b0 msgr2=0x7f6c2814f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:08.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c27e00640 1 --2- 172.21.15.122:0/669761837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c280729b0 0x7f6c2814f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c27e00640 1 -- 172.21.15.122:0/669761837 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2815e330 con 0x7f6c280cccf0 2024-05-28T06:12:08.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c2d800640 1 --2- 172.21.15.122:0/669761837 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c28162be0 0x7f6c28074d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:12:08.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c27e00640 1 --2- 172.21.15.122:0/669761837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c280cccf0 0x7f6c2815da50 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400c4b0 tx=0x7f6c1400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:08.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c24c00640 1 -- 172.21.15.122:0/669761837 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14018070 con 0x7f6c280cccf0 2024-05-28T06:12:08.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c24c00640 1 -- 172.21.15.122:0/669761837 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c14007500 con 0x7f6c280cccf0 2024-05-28T06:12:08.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c2f800640 1 -- 172.21.15.122:0/669761837 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c2815e610 con 0x7f6c280cccf0 2024-05-28T06:12:08.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c24c00640 1 -- 172.21.15.122:0/669761837 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14004a30 con 0x7f6c280cccf0 2024-05-28T06:12:08.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.150+0000 7f6c2f800640 1 -- 172.21.15.122:0/669761837 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c281657a0 con 0x7f6c280cccf0 2024-05-28T06:12:08.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.154+0000 7f6c2f800640 1 -- 172.21.15.122:0/669761837 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c28068c40 con 0x7f6c280cccf0 2024-05-28T06:12:08.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.154+0000 7f6c24c00640 1 -- 172.21.15.122:0/669761837 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 88599+0+0 (secure 0 0 0) 0x7f6c1401b070 con 0x7f6c280cccf0 2024-05-28T06:12:08.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.154+0000 7f6c24c00640 1 --2- 172.21.15.122:0/669761837 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6c08068a40 0x7f6c0806af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:08.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.154+0000 7f6c24c00640 1 -- 172.21.15.122:0/669761837 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7f6c14086920 con 0x7f6c280cccf0 2024-05-28T06:12:08.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.154+0000 7f6c2ce00640 1 --2- 172.21.15.122:0/669761837 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6c08068a40 0x7f6c0806af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:08.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.154+0000 7f6c2ce00640 1 --2- 172.21.15.122:0/669761837 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6c08068a40 0x7f6c0806af00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0af000 tx=0x7f6c1c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:08.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.158+0000 7f6c24c00640 1 -- 172.21.15.122:0/669761837 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6c14055eb0 con 0x7f6c280cccf0 2024-05-28T06:12:08.373 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.374+0000 7f6c2f800640 1 -- 172.21.15.122:0/669761837 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6c2806fbb0 con 0x7f6c280cccf0 2024-05-28T06:12:08.373 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.374+0000 7f6c24c00640 1 -- 172.21.15.122:0/669761837 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1823 (secure 0 0 0) 0x7f6c1405a1b0 con 0x7f6c280cccf0 2024-05-28T06:12:08.374 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:08.374 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:12:08.374 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:12:08.374 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:12:08.374 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:12:08.374 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:12:08.374 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:12:08.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:08.374 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:12:08.374 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:12:08.374 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:12:08.374 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:12:08.375 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:12:08.375 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:12:08.375 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:12:08.375 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:12:08.375 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:12:08.375 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:12:08.375 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:12:08.375 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 404, 2024-05-28T06:12:08.375 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:12:08.375 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:12:08.375 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:12:08.375 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:12:08.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:08.375 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:12:08.375 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 49, 2024-05-28T06:12:08.376 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:12:08.376 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:12:08.376 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:12:08.376 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:12:08.376 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:12:08.376 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:12:08.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:08.376 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:12:08.376 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:12:08.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:08.376 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:12:08.376 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:12:08.377 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:08.377 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:12:08.377 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:12:08.377 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:12:08.377 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 4428, 2024-05-28T06:12:08.377 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 18440092588, 2024-05-28T06:12:08.377 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 37263917056, 2024-05-28T06:12:08.377 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 735830196224, 2024-05-28T06:12:08.377 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:12:08.377 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 341, 2024-05-28T06:12:08.377 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 0, 2024-05-28T06:12:08.377 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 0 2024-05-28T06:12:08.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:08.377 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:12:08.378 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 29, 2024-05-28T06:12:08.378 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 3, 2024-05-28T06:12:08.378 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:12:08.378 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:12:08.378 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:12:08.378 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:12:08.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:08.378 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 3, 2024-05-28T06:12:08.378 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:12:08.378 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "a", 2024-05-28T06:12:08.378 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:12:08.378 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 5679 2024-05-28T06:12:08.378 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:08.379 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:12:08.379 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:12:08.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:08.379 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:12:08.379 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:12:08.379 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:12:08.379 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:12:08.379 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:12:08.379 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:12:08.379 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:12:08.379 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:12:08.379 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:12:08.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:08.379 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:12:08.380 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 8, 2024-05-28T06:12:08.380 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:10:43.307303+0000", 2024-05-28T06:12:08.380 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:12:08.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:08.380 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": {} 2024-05-28T06:12:08.380 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:12:08.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.374+0000 7f6c2f800640 1 -- 172.21.15.122:0/669761837 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6c08068a40 msgr2=0x7f6c0806af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:08.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.374+0000 7f6c2f800640 1 --2- 172.21.15.122:0/669761837 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6c08068a40 0x7f6c0806af00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0af000 tx=0x7f6c1c0a7000 comp rx=0 tx=0).stop 2024-05-28T06:12:08.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.374+0000 7f6c2f800640 1 -- 172.21.15.122:0/669761837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c280cccf0 msgr2=0x7f6c2815da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:08.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.374+0000 7f6c2f800640 1 --2- 172.21.15.122:0/669761837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c280cccf0 0x7f6c2815da50 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400c4b0 tx=0x7f6c1400c970 comp rx=0 tx=0).stop 2024-05-28T06:12:08.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.374+0000 7f6c2f800640 1 -- 172.21.15.122:0/669761837 shutdown_connections 2024-05-28T06:12:08.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.374+0000 7f6c2f800640 1 --2- 172.21.15.122:0/669761837 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6c08068a40 0x7f6c0806af00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.374+0000 7f6c2f800640 1 --2- 172.21.15.122:0/669761837 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6c28162be0 0x7f6c28074d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.374+0000 7f6c2f800640 1 --2- 172.21.15.122:0/669761837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c280cccf0 0x7f6c2815da50 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.374+0000 7f6c2f800640 1 --2- 172.21.15.122:0/669761837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c280729b0 0x7f6c2814f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.374+0000 7f6c2f800640 1 -- 172.21.15.122:0/669761837 >> 172.21.15.122:0/669761837 conn(0x7f6c2806bd90 msgr2=0x7f6c2815bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:08.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.374+0000 7f6c2f800640 1 -- 172.21.15.122:0/669761837 shutdown_connections 2024-05-28T06:12:08.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.374+0000 7f6c2f800640 1 -- 172.21.15.122:0/669761837 wait complete. 2024-05-28T06:12:08.395 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-05-28T06:12:08.534 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.534+0000 7ffafec00640 1 Processor -- start 2024-05-28T06:12:08.534 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.534+0000 7ffafec00640 1 -- start start 2024-05-28T06:12:08.536 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.534+0000 7ffafec00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ffaf80cf650 0x7ffaf80b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:08.536 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.534+0000 7ffafec00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaf80cfa30 0x7ffaf80b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:08.536 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.534+0000 7ffafec00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaf806df80 con 0x7ffaf806f780 2024-05-28T06:12:08.536 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.534+0000 7ffafec00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7ffaf806e260 con 0x7ffaf80cf650 2024-05-28T06:12:08.536 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.534+0000 7ffafec00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ffaf80cd7d0 con 0x7ffaf80cfa30 2024-05-28T06:12:08.536 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.534+0000 7ffafd800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ffaf80cf650 0x7ffaf80b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:08.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.534+0000 7ffafd800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ffaf80cf650 0x7ffaf80b3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43738/0 (socket says 172.21.15.122:43738) 2024-05-28T06:12:08.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.534+0000 7ffafd800640 1 -- 172.21.15.122:0/1274987667 learned_addr learned my addr 172.21.15.122:0/1274987667 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:08.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.534+0000 7ffafce00640 1 --2- 172.21.15.122:0/1274987667 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaf80cfa30 0x7ffaf80b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:08.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.534+0000 7ffafd800640 1 -- 172.21.15.122:0/1274987667 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaf80cfa30 msgr2=0x7ffaf80b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:08.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.534+0000 7ffafd800640 1 --2- 172.21.15.122:0/1274987667 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaf80cfa30 0x7ffaf80b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.538+0000 7ffafd800640 1 -- 172.21.15.122:0/1274987667 >> v1:172.21.15.153:6789/0 conn(0x7ffaf806f780 legacy=0x7ffaf80b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:08.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.538+0000 7ffafd800640 1 -- 172.21.15.122:0/1274987667 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf80cdab0 con 0x7ffaf80cf650 2024-05-28T06:12:08.539 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.538+0000 7ffafd800640 1 --2- 172.21.15.122:0/1274987667 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaf80cf650 0x7ffaf80b3470 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009870 tx=0x7ffaec01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815e4850a446764 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:08.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.538+0000 7ffaf7e00640 1 -- 172.21.15.122:0/1274987667 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec0b0070 con 0x7ffaf80cf650 2024-05-28T06:12:08.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.538+0000 7ffaf7e00640 1 -- 172.21.15.122:0/1274987667 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaec0ab600 con 0x7ffaf80cf650 2024-05-28T06:12:08.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.538+0000 7ffaf7e00640 1 -- 172.21.15.122:0/1274987667 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec0ab9d0 con 0x7ffaf80cf650 2024-05-28T06:12:08.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.538+0000 7ffafec00640 1 -- 172.21.15.122:0/1274987667 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaf80cf650 msgr2=0x7ffaf80b3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:08.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.538+0000 7ffafec00640 1 --2- 172.21.15.122:0/1274987667 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaf80cf650 0x7ffaf80b3470 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009870 tx=0x7ffaec01c440 comp rx=0 tx=0).stop 2024-05-28T06:12:08.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.538+0000 7ffafec00640 1 -- 172.21.15.122:0/1274987667 shutdown_connections 2024-05-28T06:12:08.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.538+0000 7ffafec00640 1 --2- 172.21.15.122:0/1274987667 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaf80cfa30 0x7ffaf80b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.538+0000 7ffafec00640 1 --2- 172.21.15.122:0/1274987667 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaf80cf650 0x7ffaf80b3470 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.538+0000 7ffafec00640 1 -- 172.21.15.122:0/1274987667 >> 172.21.15.122:0/1274987667 conn(0x7ffaf806b990 msgr2=0x7ffaf806bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:08.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.542+0000 7ffafec00640 1 -- 172.21.15.122:0/1274987667 shutdown_connections 2024-05-28T06:12:08.541 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.542+0000 7ffafec00640 1 -- 172.21.15.122:0/1274987667 wait complete. 2024-05-28T06:12:08.541 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.542+0000 7ffafec00640 1 Processor -- start 2024-05-28T06:12:08.542 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.542+0000 7ffafec00640 1 -- start start 2024-05-28T06:12:08.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.542+0000 7ffafec00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaf806f780 0x7ffaf815f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:08.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.542+0000 7ffafec00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaf80cf650 0x7ffaf8147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:08.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.542+0000 7ffafec00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaf80cfa30 0x7ffaf815d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:08.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.542+0000 7ffafec00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf806e7f0 con 0x7ffaf80cfa30 2024-05-28T06:12:08.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.542+0000 7ffafec00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf806e670 con 0x7ffaf806f780 2024-05-28T06:12:08.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.542+0000 7ffafec00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ffaf806e970 con 0x7ffaf80cf650 2024-05-28T06:12:08.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.542+0000 7ffafe200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaf80cfa30 0x7ffaf815d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:08.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.542+0000 7ffafe200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaf80cfa30 0x7ffaf815d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43752/0 (socket says 172.21.15.122:43752) 2024-05-28T06:12:08.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.542+0000 7ffafe200640 1 -- 172.21.15.122:0/3361756133 learned_addr learned my addr 172.21.15.122:0/3361756133 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:08.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.542+0000 7ffafce00640 1 --2- 172.21.15.122:0/3361756133 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaf80cf650 0x7ffaf8147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:08.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.542+0000 7ffafd800640 1 --2- 172.21.15.122:0/3361756133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaf806f780 0x7ffaf815f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:08.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.542+0000 7ffafe200640 1 -- 172.21.15.122:0/3361756133 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaf80cf650 msgr2=0x7ffaf8147e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:08.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.542+0000 7ffafe200640 1 --2- 172.21.15.122:0/3361756133 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaf80cf650 0x7ffaf8147e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.542+0000 7ffafe200640 1 -- 172.21.15.122:0/3361756133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaf806f780 msgr2=0x7ffaf815f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:08.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.542+0000 7ffafe200640 1 --2- 172.21.15.122:0/3361756133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaf806f780 0x7ffaf815f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.542+0000 7ffafe200640 1 -- 172.21.15.122:0/3361756133 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf815dfb0 con 0x7ffaf80cfa30 2024-05-28T06:12:08.545 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.542+0000 7ffafe200640 1 --2- 172.21.15.122:0/3361756133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaf80cfa30 0x7ffaf815d510 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000c770 tx=0x7ffaf000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:08.545 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.542+0000 7ffaf5600640 1 -- 172.21.15.122:0/3361756133 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0003b80 con 0x7ffaf80cfa30 2024-05-28T06:12:08.545 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.546+0000 7ffaf5600640 1 -- 172.21.15.122:0/3361756133 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf0003d20 con 0x7ffaf80cfa30 2024-05-28T06:12:08.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.546+0000 7ffafec00640 1 -- 172.21.15.122:0/3361756133 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaf815e290 con 0x7ffaf80cfa30 2024-05-28T06:12:08.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.546+0000 7ffaf5600640 1 -- 172.21.15.122:0/3361756133 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf000aa90 con 0x7ffaf80cfa30 2024-05-28T06:12:08.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.546+0000 7ffafec00640 1 -- 172.21.15.122:0/3361756133 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaf815e850 con 0x7ffaf80cfa30 2024-05-28T06:12:08.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.546+0000 7ffafec00640 1 -- 172.21.15.122:0/3361756133 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaf8075620 con 0x7ffaf80cfa30 2024-05-28T06:12:08.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.546+0000 7ffaf5600640 1 -- 172.21.15.122:0/3361756133 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 88599+0+0 (secure 0 0 0) 0x7ffaf000ac30 con 0x7ffaf80cfa30 2024-05-28T06:12:08.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.546+0000 7ffaf5600640 1 --2- 172.21.15.122:0/3361756133 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffad8068a40 0x7ffad806af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:08.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.546+0000 7ffaf5600640 1 -- 172.21.15.122:0/3361756133 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7ffaf0087250 con 0x7ffaf80cfa30 2024-05-28T06:12:08.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.546+0000 7ffafd800640 1 --2- 172.21.15.122:0/3361756133 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffad8068a40 0x7ffad806af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:08.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.546+0000 7ffafd800640 1 --2- 172.21.15.122:0/3361756133 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffad8068a40 0x7ffad806af00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ffaec0ad000 tx=0x7ffaec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:08.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.550+0000 7ffaf5600640 1 -- 172.21.15.122:0/3361756133 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffaf0056940 con 0x7ffaf80cfa30 2024-05-28T06:12:08.735 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.734+0000 7ffafec00640 1 -- 172.21.15.122:0/3361756133 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffaf8072f70 con 0x7ffad8068a40 2024-05-28T06:12:08.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.738+0000 7ffaf5600640 1 -- 172.21.15.122:0/3361756133 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+234 (secure 0 0 0) 0x7ffaf8072f70 con 0x7ffad8068a40 2024-05-28T06:12:08.740 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:08.740 INFO:teuthology.orchestra.run.smithi122.stdout:[ 2024-05-28T06:12:08.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:08.740 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "subvol_clone24473" 2024-05-28T06:12:08.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:08.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:08.740 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "subvol_clone24474" 2024-05-28T06:12:08.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:08.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:08.741 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "sv1" 2024-05-28T06:12:08.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:08.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:08.741 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "subvol_clone24472" 2024-05-28T06:12:08.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:08.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:08.741 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "subvol_clone24471" 2024-05-28T06:12:08.741 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:08.741 INFO:teuthology.orchestra.run.smithi122.stdout:] 2024-05-28T06:12:08.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.742+0000 7ffafec00640 1 -- 172.21.15.122:0/3361756133 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffad8068a40 msgr2=0x7ffad806af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:08.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.742+0000 7ffafec00640 1 --2- 172.21.15.122:0/3361756133 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffad8068a40 0x7ffad806af00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ffaec0ad000 tx=0x7ffaec008040 comp rx=0 tx=0).stop 2024-05-28T06:12:08.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.742+0000 7ffafec00640 1 -- 172.21.15.122:0/3361756133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaf80cfa30 msgr2=0x7ffaf815d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:08.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.742+0000 7ffafec00640 1 --2- 172.21.15.122:0/3361756133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaf80cfa30 0x7ffaf815d510 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000c770 tx=0x7ffaf000cc30 comp rx=0 tx=0).stop 2024-05-28T06:12:08.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.742+0000 7ffafec00640 1 -- 172.21.15.122:0/3361756133 shutdown_connections 2024-05-28T06:12:08.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.742+0000 7ffafec00640 1 --2- 172.21.15.122:0/3361756133 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffad8068a40 0x7ffad806af00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.742+0000 7ffafec00640 1 --2- 172.21.15.122:0/3361756133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaf80cfa30 0x7ffaf815d510 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.742+0000 7ffafec00640 1 --2- 172.21.15.122:0/3361756133 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaf80cf650 0x7ffaf8147e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.742+0000 7ffafec00640 1 --2- 172.21.15.122:0/3361756133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaf806f780 0x7ffaf815f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.742+0000 7ffafec00640 1 -- 172.21.15.122:0/3361756133 >> 172.21.15.122:0/3361756133 conn(0x7ffaf806b990 msgr2=0x7ffaf80ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:08.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.742+0000 7ffafec00640 1 -- 172.21.15.122:0/3361756133 shutdown_connections 2024-05-28T06:12:08.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.742+0000 7ffafec00640 1 -- 172.21.15.122:0/3361756133 wait complete. 2024-05-28T06:12:08.762 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone24473 2024-05-28T06:12:08.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.902+0000 7fdb91e00640 1 Processor -- start 2024-05-28T06:12:08.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.902+0000 7fdb91e00640 1 -- start start 2024-05-28T06:12:08.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.902+0000 7fdb91e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb8c09aca0 0x7fdb8c0b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:08.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.902+0000 7fdb91e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdb8c09b080 0x7fdb8c09b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:08.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.902+0000 7fdb91e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdb8c15fb30 0x7fdb8c15ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:08.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.902+0000 7fdb91e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fdb8c0b5460 con 0x7fdb8c09b080 2024-05-28T06:12:08.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.902+0000 7fdb91e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fdb8c1604c0 con 0x7fdb8c15fb30 2024-05-28T06:12:08.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.902+0000 7fdb91e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdb8c0d0bf0 con 0x7fdb8c09aca0 2024-05-28T06:12:08.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.902+0000 7fdb82000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdb8c09b080 0x7fdb8c09b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:08.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.902+0000 7fdb82000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdb8c09b080 0x7fdb8c09b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43758/0 (socket says 172.21.15.122:43758) 2024-05-28T06:12:08.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.902+0000 7fdb82000640 1 -- 172.21.15.122:0/3089236128 learned_addr learned my addr 172.21.15.122:0/3089236128 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:08.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.902+0000 7fdb8b400640 1 --2- 172.21.15.122:0/3089236128 >> v2:172.21.15.153:3300/0 conn(0x7fdb8c15fb30 0x7fdb8c15ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:08.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.902+0000 7fdb8aa00640 1 --2- 172.21.15.122:0/3089236128 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb8c09aca0 0x7fdb8c0b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:08.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.902+0000 7fdb82000640 1 -- 172.21.15.122:0/3089236128 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb8c09aca0 msgr2=0x7fdb8c0b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:08.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.902+0000 7fdb82000640 1 --2- 172.21.15.122:0/3089236128 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb8c09aca0 0x7fdb8c0b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.902+0000 7fdb82000640 1 -- 172.21.15.122:0/3089236128 >> v2:172.21.15.153:3300/0 conn(0x7fdb8c15fb30 msgr2=0x7fdb8c15ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:08.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.902+0000 7fdb82000640 1 --2- 172.21.15.122:0/3089236128 >> v2:172.21.15.153:3300/0 conn(0x7fdb8c15fb30 0x7fdb8c15ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.902+0000 7fdb82000640 1 -- 172.21.15.122:0/3089236128 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8c0d0eb0 con 0x7fdb8c09b080 2024-05-28T06:12:08.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.902+0000 7fdb8b400640 1 --2- 172.21.15.122:0/3089236128 >> v2:172.21.15.153:3300/0 conn(0x7fdb8c15fb30 0x7fdb8c15ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:12:08.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.906+0000 7fdb82000640 1 --2- 172.21.15.122:0/3089236128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb8c09b080 0x7fdb8c09b780 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c073b80 tx=0x7fdb7401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce36886d83b03f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:08.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.906+0000 7fdb8a000640 1 -- 172.21.15.122:0/3089236128 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb740b0070 con 0x7fdb8c09b080 2024-05-28T06:12:08.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.906+0000 7fdb8a000640 1 -- 172.21.15.122:0/3089236128 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb740ab600 con 0x7fdb8c09b080 2024-05-28T06:12:08.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.906+0000 7fdb8a000640 1 -- 172.21.15.122:0/3089236128 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb740ab9d0 con 0x7fdb8c09b080 2024-05-28T06:12:08.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.906+0000 7fdb91e00640 1 -- 172.21.15.122:0/3089236128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb8c09b080 msgr2=0x7fdb8c09b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:08.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.906+0000 7fdb91e00640 1 --2- 172.21.15.122:0/3089236128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb8c09b080 0x7fdb8c09b780 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c073b80 tx=0x7fdb7401c490 comp rx=0 tx=0).stop 2024-05-28T06:12:08.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.906+0000 7fdb91e00640 1 -- 172.21.15.122:0/3089236128 shutdown_connections 2024-05-28T06:12:08.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.906+0000 7fdb91e00640 1 --2- 172.21.15.122:0/3089236128 >> v2:172.21.15.153:3300/0 conn(0x7fdb8c15fb30 0x7fdb8c15ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.906+0000 7fdb91e00640 1 --2- 172.21.15.122:0/3089236128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb8c09b080 0x7fdb8c09b780 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.906+0000 7fdb91e00640 1 --2- 172.21.15.122:0/3089236128 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb8c09aca0 0x7fdb8c0b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.906+0000 7fdb91e00640 1 -- 172.21.15.122:0/3089236128 >> 172.21.15.122:0/3089236128 conn(0x7fdb8c0b4100 msgr2=0x7fdb8c0b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:08.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.906+0000 7fdb91e00640 1 -- 172.21.15.122:0/3089236128 shutdown_connections 2024-05-28T06:12:08.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.906+0000 7fdb91e00640 1 -- 172.21.15.122:0/3089236128 wait complete. 2024-05-28T06:12:08.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb91e00640 1 Processor -- start 2024-05-28T06:12:08.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb91e00640 1 -- start start 2024-05-28T06:12:08.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb91e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb8c09aca0 0x7fdb8c156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:08.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb91e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb8c09b080 0x7fdb8c0c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:08.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb91e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb8c15fb30 0x7fdb8c0c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:08.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb91e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c0cde00 con 0x7fdb8c09aca0 2024-05-28T06:12:08.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb91e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c0cdc80 con 0x7fdb8c15fb30 2024-05-28T06:12:08.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb91e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdb8c0cdf80 con 0x7fdb8c09b080 2024-05-28T06:12:08.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb8aa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb8c09aca0 0x7fdb8c156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:08.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb8aa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb8c09aca0 0x7fdb8c156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43770/0 (socket says 172.21.15.122:43770) 2024-05-28T06:12:08.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb8aa00640 1 -- 172.21.15.122:0/1169819498 learned_addr learned my addr 172.21.15.122:0/1169819498 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:08.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb8b400640 1 --2- 172.21.15.122:0/1169819498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb8c15fb30 0x7fdb8c0c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:08.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb82000640 1 --2- 172.21.15.122:0/1169819498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb8c09b080 0x7fdb8c0c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:08.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb8aa00640 1 -- 172.21.15.122:0/1169819498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb8c09b080 msgr2=0x7fdb8c0c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:08.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb8aa00640 1 --2- 172.21.15.122:0/1169819498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb8c09b080 0x7fdb8c0c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb8aa00640 1 -- 172.21.15.122:0/1169819498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb8c15fb30 msgr2=0x7fdb8c0c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:08.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb8aa00640 1 --2- 172.21.15.122:0/1169819498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb8c15fb30 0x7fdb8c0c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:08.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb8aa00640 1 -- 172.21.15.122:0/1169819498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8c0c8d20 con 0x7fdb8c09aca0 2024-05-28T06:12:08.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb8b400640 1 --2- 172.21.15.122:0/1169819498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb8c15fb30 0x7fdb8c0c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:12:08.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb8aa00640 1 --2- 172.21.15.122:0/1169819498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb8c09aca0 0x7fdb8c156fd0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c007e70 tx=0x7fdb7c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:08.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb83e00640 1 -- 172.21.15.122:0/1169819498 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c014620 con 0x7fdb8c09aca0 2024-05-28T06:12:08.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb83e00640 1 -- 172.21.15.122:0/1169819498 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7c019070 con 0x7fdb8c09aca0 2024-05-28T06:12:08.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb91e00640 1 -- 172.21.15.122:0/1169819498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb8c0c9000 con 0x7fdb8c09aca0 2024-05-28T06:12:08.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb83e00640 1 -- 172.21.15.122:0/1169819498 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c014a00 con 0x7fdb8c09aca0 2024-05-28T06:12:08.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.910+0000 7fdb91e00640 1 -- 172.21.15.122:0/1169819498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb8c157510 con 0x7fdb8c09aca0 2024-05-28T06:12:08.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.914+0000 7fdb91e00640 1 -- 172.21.15.122:0/1169819498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb8c15cd00 con 0x7fdb8c09aca0 2024-05-28T06:12:08.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.914+0000 7fdb83e00640 1 -- 172.21.15.122:0/1169819498 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 88599+0+0 (secure 0 0 0) 0x7fdb7c014ba0 con 0x7fdb8c09aca0 2024-05-28T06:12:08.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.914+0000 7fdb83e00640 1 --2- 172.21.15.122:0/1169819498 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdb68068a40 0x7fdb6806af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:08.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.914+0000 7fdb83e00640 1 -- 172.21.15.122:0/1169819498 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7fdb7c087da0 con 0x7fdb8c09aca0 2024-05-28T06:12:08.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.914+0000 7fdb82000640 1 --2- 172.21.15.122:0/1169819498 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdb68068a40 0x7fdb6806af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:08.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.914+0000 7fdb82000640 1 --2- 172.21.15.122:0/1169819498 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdb68068a40 0x7fdb6806af00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdb740ad000 tx=0x7fdb74008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:08.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:08.918+0000 7fdb83e00640 1 -- 172.21.15.122:0/1169819498 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdb7c057a50 con 0x7fdb8c09aca0 2024-05-28T06:12:09.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.102+0000 7fdb91e00640 1 -- 172.21.15.122:0/1169819498 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone24473", "target": ["mon-mgr", ""]}) -- 0x7fdb8c0c9520 con 0x7fdb68068a40 2024-05-28T06:12:09.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.122+0000 7fdb83e00640 1 -- 172.21.15.122:0/1169819498 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdb740b1040 con 0x7fdb68068a40 2024-05-28T06:12:09.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.122+0000 7fdb91e00640 1 -- 172.21.15.122:0/1169819498 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdb68068a40 msgr2=0x7fdb6806af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:09.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.122+0000 7fdb91e00640 1 --2- 172.21.15.122:0/1169819498 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdb68068a40 0x7fdb6806af00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdb740ad000 tx=0x7fdb74008040 comp rx=0 tx=0).stop 2024-05-28T06:12:09.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.122+0000 7fdb91e00640 1 -- 172.21.15.122:0/1169819498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb8c09aca0 msgr2=0x7fdb8c156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:09.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.122+0000 7fdb91e00640 1 --2- 172.21.15.122:0/1169819498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb8c09aca0 0x7fdb8c156fd0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c007e70 tx=0x7fdb7c00e4b0 comp rx=0 tx=0).stop 2024-05-28T06:12:09.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.122+0000 7fdb91e00640 1 -- 172.21.15.122:0/1169819498 shutdown_connections 2024-05-28T06:12:09.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.122+0000 7fdb91e00640 1 --2- 172.21.15.122:0/1169819498 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdb68068a40 0x7fdb6806af00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:09.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.122+0000 7fdb91e00640 1 --2- 172.21.15.122:0/1169819498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb8c15fb30 0x7fdb8c0c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:09.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.122+0000 7fdb91e00640 1 --2- 172.21.15.122:0/1169819498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdb8c09b080 0x7fdb8c0c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:09.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.122+0000 7fdb91e00640 1 --2- 172.21.15.122:0/1169819498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb8c09aca0 0x7fdb8c156fd0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:09.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.122+0000 7fdb91e00640 1 -- 172.21.15.122:0/1169819498 >> 172.21.15.122:0/1169819498 conn(0x7fdb8c0b4100 msgr2=0x7fdb8c15bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:09.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.122+0000 7fdb91e00640 1 -- 172.21.15.122:0/1169819498 shutdown_connections 2024-05-28T06:12:09.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.122+0000 7fdb91e00640 1 -- 172.21.15.122:0/1169819498 wait complete. 2024-05-28T06:12:09.124 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:09.126+0000 7f9deb000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:09.125 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:09.126+0000 7f9deb000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:09.125 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:09.126+0000 7f9deb000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:09.125 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:09.126+0000 7f9deb000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:09.125 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:09.126+0000 7f9deb000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:09.141 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:09.142+0000 7f9deba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:09.141 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:09.142+0000 7f9deba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:09.141 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:09.142+0000 7f9deba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:09.141 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:09.142+0000 7f9deba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:09.142 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:09.142+0000 7f9deba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:09.146 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone24474 2024-05-28T06:12:09.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.294+0000 7fc279c00640 1 Processor -- start 2024-05-28T06:12:09.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.294+0000 7fc279c00640 1 -- start start 2024-05-28T06:12:09.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.294+0000 7fc279c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc2741460c0 0x7fc2740ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:09.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.294+0000 7fc279c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc2740b3d00 0x7fc274072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:09.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.294+0000 7fc279c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2741464a0 con 0x7fc2740ce760 2024-05-28T06:12:09.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.294+0000 7fc279c00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fc27415cbf0 con 0x7fc2741460c0 2024-05-28T06:12:09.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.294+0000 7fc279c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc2740cebe0 con 0x7fc2740b3d00 2024-05-28T06:12:09.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.294+0000 7fc272a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc2741460c0 0x7fc2740ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:09.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.294+0000 7fc272000640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fc2740ce760 0x7fc2740b35f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:34766/0 (socket says 172.21.15.122:34766) 2024-05-28T06:12:09.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.294+0000 7fc272000640 1 -- 172.21.15.122:0/2280644082 learned_addr learned my addr 172.21.15.122:0/2280644082 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:09.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.294+0000 7fc272a00640 1 -- 172.21.15.122:0/2280644082 >> v2:172.21.15.153:3300/0 conn(0x7fc2740b3d00 msgr2=0x7fc274072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:09.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.294+0000 7fc273400640 1 --2- 172.21.15.122:0/2280644082 >> v2:172.21.15.153:3300/0 conn(0x7fc2740b3d00 0x7fc274072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:09.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.294+0000 7fc271600640 1 -- 172.21.15.122:0/2280644082 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1273478067 0 0) 0x7fc260001120 con 0x7fc2740ce760 2024-05-28T06:12:09.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.294+0000 7fc272a00640 1 --2- 172.21.15.122:0/2280644082 >> v2:172.21.15.153:3300/0 conn(0x7fc2740b3d00 0x7fc274072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:09.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.294+0000 7fc272a00640 1 -- 172.21.15.122:0/2280644082 >> v1:172.21.15.122:6789/0 conn(0x7fc2740ce760 legacy=0x7fc2740b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:09.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.294+0000 7fc272a00640 1 -- 172.21.15.122:0/2280644082 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2740d05c0 con 0x7fc2741460c0 2024-05-28T06:12:09.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.294+0000 7fc273400640 1 --2- 172.21.15.122:0/2280644082 >> v2:172.21.15.153:3300/0 conn(0x7fc2740b3d00 0x7fc274072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:09.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.298+0000 7fc272a00640 1 --2- 172.21.15.122:0/2280644082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2741460c0 0x7fc2740ce220 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fc2740cf960 tx=0x7fc26401c100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e683a38a017f89 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:09.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.298+0000 7fc271600640 1 -- 172.21.15.122:0/2280644082 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2640b0070 con 0x7fc2741460c0 2024-05-28T06:12:09.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.298+0000 7fc271600640 1 -- 172.21.15.122:0/2280644082 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2640ab600 con 0x7fc2741460c0 2024-05-28T06:12:09.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.298+0000 7fc271600640 1 -- 172.21.15.122:0/2280644082 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2640ab9d0 con 0x7fc2741460c0 2024-05-28T06:12:09.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.298+0000 7fc279c00640 1 -- 172.21.15.122:0/2280644082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2741460c0 msgr2=0x7fc2740ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:09.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.298+0000 7fc279c00640 1 --2- 172.21.15.122:0/2280644082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2741460c0 0x7fc2740ce220 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fc2740cf960 tx=0x7fc26401c100 comp rx=0 tx=0).stop 2024-05-28T06:12:09.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.298+0000 7fc279c00640 1 -- 172.21.15.122:0/2280644082 shutdown_connections 2024-05-28T06:12:09.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.298+0000 7fc279c00640 1 --2- 172.21.15.122:0/2280644082 >> v2:172.21.15.153:3300/0 conn(0x7fc2740b3d00 0x7fc274072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:09.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.298+0000 7fc279c00640 1 --2- 172.21.15.122:0/2280644082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2741460c0 0x7fc2740ce220 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:09.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.298+0000 7fc279c00640 1 -- 172.21.15.122:0/2280644082 >> 172.21.15.122:0/2280644082 conn(0x7fc2740b6c10 msgr2=0x7fc2740b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:09.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.298+0000 7fc279c00640 1 -- 172.21.15.122:0/2280644082 shutdown_connections 2024-05-28T06:12:09.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.298+0000 7fc279c00640 1 -- 172.21.15.122:0/2280644082 wait complete. 2024-05-28T06:12:09.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.298+0000 7fc279c00640 1 Processor -- start 2024-05-28T06:12:09.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc279c00640 1 -- start start 2024-05-28T06:12:09.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc279c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2740b3d00 0x7fc274154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:09.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc279c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2740ce760 0x7fc27413cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:09.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc279c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2741460c0 0x7fc274150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:09.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc279c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc2740d10a0 con 0x7fc2740b3d00 2024-05-28T06:12:09.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc279c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc2740cde50 con 0x7fc2741460c0 2024-05-28T06:12:09.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc279c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc274155c00 con 0x7fc2740ce760 2024-05-28T06:12:09.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc272a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2740b3d00 0x7fc274154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:09.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc272a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2740b3d00 0x7fc274154490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43818/0 (socket says 172.21.15.122:43818) 2024-05-28T06:12:09.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc272a00640 1 -- 172.21.15.122:0/2319598527 learned_addr learned my addr 172.21.15.122:0/2319598527 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:09.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc273400640 1 --2- 172.21.15.122:0/2319598527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2741460c0 0x7fc274150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:09.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc272000640 1 --2- 172.21.15.122:0/2319598527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2740ce760 0x7fc27413cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:09.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc272a00640 1 -- 172.21.15.122:0/2319598527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2740ce760 msgr2=0x7fc27413cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:09.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc272a00640 1 --2- 172.21.15.122:0/2319598527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2740ce760 0x7fc27413cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:09.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc272a00640 1 -- 172.21.15.122:0/2319598527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2741460c0 msgr2=0x7fc274150500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:09.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc272a00640 1 --2- 172.21.15.122:0/2319598527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2741460c0 0x7fc274150500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:09.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc272a00640 1 -- 172.21.15.122:0/2319598527 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc274155710 con 0x7fc2740b3d00 2024-05-28T06:12:09.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc272000640 1 --2- 172.21.15.122:0/2319598527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2740ce760 0x7fc27413cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:12:09.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc272a00640 1 --2- 172.21.15.122:0/2319598527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2740b3d00 0x7fc274154490 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc2640ae040 tx=0x7fc26401a940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:09.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc26aa00640 1 -- 172.21.15.122:0/2319598527 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2640b0050 con 0x7fc2740b3d00 2024-05-28T06:12:09.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc26aa00640 1 -- 172.21.15.122:0/2319598527 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2640bc070 con 0x7fc2740b3d00 2024-05-28T06:12:09.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc279c00640 1 -- 172.21.15.122:0/2319598527 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc274154b90 con 0x7fc2740b3d00 2024-05-28T06:12:09.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc26aa00640 1 -- 172.21.15.122:0/2319598527 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2640b5a70 con 0x7fc2740b3d00 2024-05-28T06:12:09.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc279c00640 1 -- 172.21.15.122:0/2319598527 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc274155150 con 0x7fc2740b3d00 2024-05-28T06:12:09.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.302+0000 7fc279c00640 1 -- 172.21.15.122:0/2319598527 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc274068c40 con 0x7fc2740b3d00 2024-05-28T06:12:09.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.306+0000 7fc26aa00640 1 -- 172.21.15.122:0/2319598527 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 88599+0+0 (secure 0 0 0) 0x7fc2640ab480 con 0x7fc2740b3d00 2024-05-28T06:12:09.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.306+0000 7fc26aa00640 1 --2- 172.21.15.122:0/2319598527 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc254068a40 0x7fc25406af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:09.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.306+0000 7fc26aa00640 1 -- 172.21.15.122:0/2319598527 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7fc264121eb0 con 0x7fc2740b3d00 2024-05-28T06:12:09.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.306+0000 7fc272000640 1 --2- 172.21.15.122:0/2319598527 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc254068a40 0x7fc25406af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:09.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.306+0000 7fc272000640 1 --2- 172.21.15.122:0/2319598527 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc254068a40 0x7fc25406af00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc274156930 tx=0x7fc260007a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:09.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.310+0000 7fc26aa00640 1 -- 172.21.15.122:0/2319598527 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc264016070 con 0x7fc2740b3d00 2024-05-28T06:12:09.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.494+0000 7fc279c00640 1 -- 172.21.15.122:0/2319598527 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone24474", "target": ["mon-mgr", ""]}) -- 0x7fc274076020 con 0x7fc254068a40 2024-05-28T06:12:09.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.510+0000 7fc26aa00640 1 -- 172.21.15.122:0/2319598527 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc260005db0 con 0x7fc254068a40 2024-05-28T06:12:09.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.514+0000 7fc279c00640 1 -- 172.21.15.122:0/2319598527 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc254068a40 msgr2=0x7fc25406af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:09.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.514+0000 7fc279c00640 1 --2- 172.21.15.122:0/2319598527 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc254068a40 0x7fc25406af00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc274156930 tx=0x7fc260007a20 comp rx=0 tx=0).stop 2024-05-28T06:12:09.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.514+0000 7fc279c00640 1 -- 172.21.15.122:0/2319598527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2740b3d00 msgr2=0x7fc274154490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:09.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.514+0000 7fc279c00640 1 --2- 172.21.15.122:0/2319598527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2740b3d00 0x7fc274154490 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc2640ae040 tx=0x7fc26401a940 comp rx=0 tx=0).stop 2024-05-28T06:12:09.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.514+0000 7fc279c00640 1 -- 172.21.15.122:0/2319598527 shutdown_connections 2024-05-28T06:12:09.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.514+0000 7fc279c00640 1 --2- 172.21.15.122:0/2319598527 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc254068a40 0x7fc25406af00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:09.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.514+0000 7fc279c00640 1 --2- 172.21.15.122:0/2319598527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2741460c0 0x7fc274150500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:09.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.514+0000 7fc279c00640 1 --2- 172.21.15.122:0/2319598527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc2740ce760 0x7fc27413cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:09.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.514+0000 7fc279c00640 1 --2- 172.21.15.122:0/2319598527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2740b3d00 0x7fc274154490 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:09.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.514+0000 7fc279c00640 1 -- 172.21.15.122:0/2319598527 >> 172.21.15.122:0/2319598527 conn(0x7fc2740b6c10 msgr2=0x7fc2741434e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:09.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.514+0000 7fc279c00640 1 -- 172.21.15.122:0/2319598527 shutdown_connections 2024-05-28T06:12:09.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.514+0000 7fc279c00640 1 -- 172.21.15.122:0/2319598527 wait complete. 2024-05-28T06:12:09.539 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-05-28T06:12:09.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.682+0000 7fcdbfe00640 1 Processor -- start 2024-05-28T06:12:09.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.682+0000 7fcdbfe00640 1 -- start start 2024-05-28T06:12:09.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.682+0000 7fcdbfe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcdc0145f10 0x7fcdc01601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:09.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.682+0000 7fcdbfe00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdc006f330 con 0x7fcdc0160710 2024-05-28T06:12:09.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.682+0000 7fcdbfe00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdc0160d20 con 0x7fcdc0072520 2024-05-28T06:12:09.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.682+0000 7fcdbfe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcdc01462f0 con 0x7fcdc0145f10 2024-05-28T06:12:09.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.682+0000 7fcdbe000640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fcdc0160710 0x7fcdc0071e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:34780/0 (socket says 172.21.15.122:34780) 2024-05-28T06:12:09.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.682+0000 7fcdbe000640 1 -- 172.21.15.122:0/2875720558 learned_addr learned my addr 172.21.15.122:0/2875720558 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:09.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.682+0000 7fcdbea00640 1 --2- 172.21.15.122:0/2875720558 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcdc0145f10 0x7fcdc01601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:09.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.682+0000 7fcdbd600640 1 -- 172.21.15.122:0/2875720558 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3297608678 0 0) 0x7fcdc006f330 con 0x7fcdc0160710 2024-05-28T06:12:09.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.682+0000 7fcdbd600640 1 -- 172.21.15.122:0/2875720558 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcda4003530 con 0x7fcdc0160710 2024-05-28T06:12:09.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.682+0000 7fcdbd600640 1 -- 172.21.15.122:0/2875720558 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 712306299 0 0) 0x7fcdc0160d20 con 0x7fcdc0072520 2024-05-28T06:12:09.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.682+0000 7fcdbd600640 1 -- 172.21.15.122:0/2875720558 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdc006f330 con 0x7fcdc0072520 2024-05-28T06:12:09.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.682+0000 7fcdbea00640 1 -- 172.21.15.122:0/2875720558 >> v1:172.21.15.153:6789/0 conn(0x7fcdc0072520 legacy=0x7fcdc00cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:09.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.682+0000 7fcdbea00640 1 -- 172.21.15.122:0/2875720558 >> v1:172.21.15.122:6789/0 conn(0x7fcdc0160710 legacy=0x7fcdc0071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:09.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.682+0000 7fcdbd600640 1 -- 172.21.15.122:0/2875720558 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2005479394 0 0) 0x7fcda4003530 con 0x7fcdc0160710 2024-05-28T06:12:09.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.682+0000 7fcdbea00640 1 -- 172.21.15.122:0/2875720558 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc0161000 con 0x7fcdc0145f10 2024-05-28T06:12:09.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.686+0000 7fcdbea00640 1 --2- 172.21.15.122:0/2875720558 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcdc0145f10 0x7fcdc01601d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcdb00097f0 tx=0x7fcdb001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9f18cbefadbcbd8 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:09.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.686+0000 7fcdbd600640 1 -- 172.21.15.122:0/2875720558 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb00b0070 con 0x7fcdc0145f10 2024-05-28T06:12:09.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.686+0000 7fcdbd600640 1 -- 172.21.15.122:0/2875720558 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdb00ab400 con 0x7fcdc0145f10 2024-05-28T06:12:09.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.686+0000 7fcdbd600640 1 -- 172.21.15.122:0/2875720558 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac001680 con 0x7fcdc0145f10 2024-05-28T06:12:09.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.686+0000 7fcdbfe00640 1 -- 172.21.15.122:0/2875720558 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcdc0145f10 msgr2=0x7fcdc01601d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:09.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.686+0000 7fcdbfe00640 1 --2- 172.21.15.122:0/2875720558 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcdc0145f10 0x7fcdc01601d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcdb00097f0 tx=0x7fcdb001c400 comp rx=0 tx=0).stop 2024-05-28T06:12:09.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.686+0000 7fcdbfe00640 1 -- 172.21.15.122:0/2875720558 shutdown_connections 2024-05-28T06:12:09.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.686+0000 7fcdbfe00640 1 --2- 172.21.15.122:0/2875720558 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcdc0145f10 0x7fcdc01601d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:09.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.686+0000 7fcdbfe00640 1 -- 172.21.15.122:0/2875720558 >> 172.21.15.122:0/2875720558 conn(0x7fcdc00b2170 msgr2=0x7fcdc00b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:09.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.686+0000 7fcdbfe00640 1 -- 172.21.15.122:0/2875720558 shutdown_connections 2024-05-28T06:12:09.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.686+0000 7fcdbfe00640 1 -- 172.21.15.122:0/2875720558 wait complete. 2024-05-28T06:12:09.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.686+0000 7fcdbfe00640 1 Processor -- start 2024-05-28T06:12:09.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdbfe00640 1 -- start start 2024-05-28T06:12:09.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdbfe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcdc0072520 0x7fcdc015d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:09.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdbfe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdc0145f10 0x7fcdc013eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:09.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdbfe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcdc0160710 0x7fcdc013f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:09.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdbfe00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc00cea30 con 0x7fcdc0160710 2024-05-28T06:12:09.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdbfe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc00ce8b0 con 0x7fcdc0145f10 2024-05-28T06:12:09.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdbfe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcdc00cebb0 con 0x7fcdc0072520 2024-05-28T06:12:09.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdbf400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcdc0160710 0x7fcdc013f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:09.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdbf400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcdc0160710 0x7fcdc013f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43822/0 (socket says 172.21.15.122:43822) 2024-05-28T06:12:09.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdbf400640 1 -- 172.21.15.122:0/2656091112 learned_addr learned my addr 172.21.15.122:0/2656091112 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:09.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdbe000640 1 --2- 172.21.15.122:0/2656091112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdc0145f10 0x7fcdc013eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:09.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdbea00640 1 --2- 172.21.15.122:0/2656091112 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcdc0072520 0x7fcdc015d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:09.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdbf400640 1 -- 172.21.15.122:0/2656091112 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcdc0072520 msgr2=0x7fcdc015d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:09.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdbf400640 1 --2- 172.21.15.122:0/2656091112 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcdc0072520 0x7fcdc015d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:09.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdbf400640 1 -- 172.21.15.122:0/2656091112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdc0145f10 msgr2=0x7fcdc013eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:09.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdbf400640 1 --2- 172.21.15.122:0/2656091112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdc0145f10 0x7fcdc013eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:09.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdbf400640 1 -- 172.21.15.122:0/2656091112 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc0141480 con 0x7fcdc0160710 2024-05-28T06:12:09.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdbf400640 1 --2- 172.21.15.122:0/2656091112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcdc0160710 0x7fcdc013f040 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fcdb800c7a0 tx=0x7fcdb800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:09.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdb6a00640 1 -- 172.21.15.122:0/2656091112 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8003b80 con 0x7fcdc0160710 2024-05-28T06:12:09.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdb6a00640 1 -- 172.21.15.122:0/2656091112 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdb8003d20 con 0x7fcdc0160710 2024-05-28T06:12:09.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdb6a00640 1 -- 172.21.15.122:0/2656091112 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb800aa90 con 0x7fcdc0160710 2024-05-28T06:12:09.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdbfe00640 1 -- 172.21.15.122:0/2656091112 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdc01f7de0 con 0x7fcdc0160710 2024-05-28T06:12:09.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdbfe00640 1 -- 172.21.15.122:0/2656091112 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdc01f83a0 con 0x7fcdc0160710 2024-05-28T06:12:09.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.690+0000 7fcdbfe00640 1 -- 172.21.15.122:0/2656091112 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdc01f85a0 con 0x7fcdc0160710 2024-05-28T06:12:09.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.694+0000 7fcdb6a00640 1 -- 172.21.15.122:0/2656091112 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 88599+0+0 (secure 0 0 0) 0x7fcdb800ac30 con 0x7fcdc0160710 2024-05-28T06:12:09.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.694+0000 7fcdb6a00640 1 --2- 172.21.15.122:0/2656091112 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcda0068a40 0x7fcda006af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:09.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.694+0000 7fcdb6a00640 1 -- 172.21.15.122:0/2656091112 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7fcdb8087310 con 0x7fcdc0160710 2024-05-28T06:12:09.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.694+0000 7fcdbea00640 1 --2- 172.21.15.122:0/2656091112 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcda0068a40 0x7fcda006af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:09.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.694+0000 7fcdbea00640 1 --2- 172.21.15.122:0/2656091112 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcda0068a40 0x7fcda006af00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcdb00ad000 tx=0x7fcdb00a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:09.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.698+0000 7fcdb6a00640 1 -- 172.21.15.122:0/2656091112 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcdb80569b0 con 0x7fcdc0160710 2024-05-28T06:12:09.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.882+0000 7fcdbfe00640 1 -- 172.21.15.122:0/2656091112 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcdc0075620 con 0x7fcda0068a40 2024-05-28T06:12:09.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.894+0000 7fcdb6a00640 1 -- 172.21.15.122:0/2656091112 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fcdc0075620 con 0x7fcda0068a40 2024-05-28T06:12:09.894 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:09.895 INFO:teuthology.orchestra.run.smithi122.stdout:[ 2024-05-28T06:12:09.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:09.895 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "ss1" 2024-05-28T06:12:09.895 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:09.895 INFO:teuthology.orchestra.run.smithi122.stdout:] 2024-05-28T06:12:09.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.894+0000 7fcdbfe00640 1 -- 172.21.15.122:0/2656091112 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcda0068a40 msgr2=0x7fcda006af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:09.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.898+0000 7fcdbfe00640 1 --2- 172.21.15.122:0/2656091112 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcda0068a40 0x7fcda006af00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcdb00ad000 tx=0x7fcdb00a6000 comp rx=0 tx=0).stop 2024-05-28T06:12:09.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.898+0000 7fcdbfe00640 1 -- 172.21.15.122:0/2656091112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcdc0160710 msgr2=0x7fcdc013f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:09.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.898+0000 7fcdbfe00640 1 --2- 172.21.15.122:0/2656091112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcdc0160710 0x7fcdc013f040 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fcdb800c7a0 tx=0x7fcdb800cc60 comp rx=0 tx=0).stop 2024-05-28T06:12:09.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.898+0000 7fcdbfe00640 1 -- 172.21.15.122:0/2656091112 shutdown_connections 2024-05-28T06:12:09.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.898+0000 7fcdbfe00640 1 --2- 172.21.15.122:0/2656091112 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcda0068a40 0x7fcda006af00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:09.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.898+0000 7fcdbfe00640 1 --2- 172.21.15.122:0/2656091112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcdc0160710 0x7fcdc013f040 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:09.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.898+0000 7fcdbfe00640 1 --2- 172.21.15.122:0/2656091112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdc0145f10 0x7fcdc013eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:09.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.898+0000 7fcdbfe00640 1 --2- 172.21.15.122:0/2656091112 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcdc0072520 0x7fcdc015d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:09.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.898+0000 7fcdbfe00640 1 -- 172.21.15.122:0/2656091112 >> 172.21.15.122:0/2656091112 conn(0x7fcdc00b2170 msgr2=0x7fcdc0144820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:09.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.898+0000 7fcdbfe00640 1 -- 172.21.15.122:0/2656091112 shutdown_connections 2024-05-28T06:12:09.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:09.898+0000 7fcdbfe00640 1 -- 172.21.15.122:0/2656091112 wait complete. 2024-05-28T06:12:09.915 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-28T06:12:10.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.058+0000 7f4c07000640 1 Processor -- start 2024-05-28T06:12:10.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.058+0000 7f4c07000640 1 -- start start 2024-05-28T06:12:10.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.058+0000 7f4c07000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4c000b58d0 0x7f4c000b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:10.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.058+0000 7f4c07000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c000b61f0 con 0x7f4c000ce4f0 2024-05-28T06:12:10.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.058+0000 7f4c07000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c0015d970 con 0x7f4c0015e730 2024-05-28T06:12:10.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.058+0000 7f4c07000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f4c0015dc50 con 0x7f4c000b58d0 2024-05-28T06:12:10.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.058+0000 7f4bffe00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4c000b58d0 0x7f4c000b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:10.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.058+0000 7f4bff400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f4c000ce4f0 0x7f4c000ce980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:34796/0 (socket says 172.21.15.122:34796) 2024-05-28T06:12:10.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.058+0000 7f4bff400640 1 -- 172.21.15.122:0/19859699 learned_addr learned my addr 172.21.15.122:0/19859699 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:10.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.058+0000 7f4bffe00640 1 -- 172.21.15.122:0/19859699 >> v1:172.21.15.153:6789/0 conn(0x7f4c0015e730 legacy=0x7f4c0015eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:10.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.058+0000 7f4bffe00640 1 -- 172.21.15.122:0/19859699 >> v1:172.21.15.122:6789/0 conn(0x7f4c000ce4f0 legacy=0x7f4c000ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:10.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.058+0000 7f4bffe00640 1 -- 172.21.15.122:0/19859699 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0015df30 con 0x7f4c000b58d0 2024-05-28T06:12:10.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.062+0000 7f4bffe00640 1 --2- 172.21.15.122:0/19859699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c000b58d0 0x7f4c000b5cb0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00097c0 tx=0x7f4bf001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b4d8900118704d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:10.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.062+0000 7f4bfea00640 1 -- 172.21.15.122:0/19859699 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf00b0070 con 0x7f4c000b58d0 2024-05-28T06:12:10.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.062+0000 7f4bfea00640 1 -- 172.21.15.122:0/19859699 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf00ab600 con 0x7f4c000b58d0 2024-05-28T06:12:10.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.062+0000 7f4bfea00640 1 -- 172.21.15.122:0/19859699 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf00ab9d0 con 0x7f4c000b58d0 2024-05-28T06:12:10.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.062+0000 7f4c07000640 1 -- 172.21.15.122:0/19859699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c000b58d0 msgr2=0x7f4c000b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:10.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.062+0000 7f4c07000640 1 --2- 172.21.15.122:0/19859699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c000b58d0 0x7f4c000b5cb0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00097c0 tx=0x7f4bf001c460 comp rx=0 tx=0).stop 2024-05-28T06:12:10.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.062+0000 7f4c07000640 1 -- 172.21.15.122:0/19859699 shutdown_connections 2024-05-28T06:12:10.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.062+0000 7f4c07000640 1 --2- 172.21.15.122:0/19859699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c000b58d0 0x7f4c000b5cb0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:10.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.062+0000 7f4c07000640 1 -- 172.21.15.122:0/19859699 >> 172.21.15.122:0/19859699 conn(0x7f4c0006bd90 msgr2=0x7f4c0006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:10.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.062+0000 7f4c07000640 1 -- 172.21.15.122:0/19859699 shutdown_connections 2024-05-28T06:12:10.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.062+0000 7f4c07000640 1 -- 172.21.15.122:0/19859699 wait complete. 2024-05-28T06:12:10.064 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.062+0000 7f4c07000640 1 Processor -- start 2024-05-28T06:12:10.064 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.062+0000 7f4c07000640 1 -- start start 2024-05-28T06:12:10.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4c07000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c000b58d0 0x7f4c001fa730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:10.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4c07000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c000ce4f0 0x7f4c0015b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:10.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4c07000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c0015e730 0x7f4c0015bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:10.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4c07000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0016a3e0 con 0x7f4c000ce4f0 2024-05-28T06:12:10.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4c07000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0016a260 con 0x7f4c0015e730 2024-05-28T06:12:10.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4c07000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4c0016a560 con 0x7f4c000b58d0 2024-05-28T06:12:10.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4bff400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c000ce4f0 0x7f4c0015b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:10.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4bff400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c000ce4f0 0x7f4c0015b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43836/0 (socket says 172.21.15.122:43836) 2024-05-28T06:12:10.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4bff400640 1 -- 172.21.15.122:0/1515131670 learned_addr learned my addr 172.21.15.122:0/1515131670 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:10.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4c05000640 1 --2- 172.21.15.122:0/1515131670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c0015e730 0x7f4c0015bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:10.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4bffe00640 1 --2- 172.21.15.122:0/1515131670 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c000b58d0 0x7f4c001fa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:10.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4bff400640 1 -- 172.21.15.122:0/1515131670 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c000b58d0 msgr2=0x7f4c001fa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:10.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4bff400640 1 --2- 172.21.15.122:0/1515131670 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c000b58d0 0x7f4c001fa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:10.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4bff400640 1 -- 172.21.15.122:0/1515131670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c0015e730 msgr2=0x7f4c0015bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:10.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4bff400640 1 --2- 172.21.15.122:0/1515131670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c0015e730 0x7f4c0015bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:10.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4bff400640 1 -- 172.21.15.122:0/1515131670 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c001fac70 con 0x7f4c000ce4f0 2024-05-28T06:12:10.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4c05000640 1 --2- 172.21.15.122:0/1515131670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c0015e730 0x7f4c0015bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:10.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4bffe00640 1 --2- 172.21.15.122:0/1515131670 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c000b58d0 0x7f4c001fa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:10.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4bff400640 1 --2- 172.21.15.122:0/1515131670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c000ce4f0 0x7f4c0015b960 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4bec00c420 tx=0x7f4bec00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:10.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4bf7e00640 1 -- 172.21.15.122:0/1515131670 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec017070 con 0x7f4c000ce4f0 2024-05-28T06:12:10.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4bf7e00640 1 -- 172.21.15.122:0/1515131670 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bec005cf0 con 0x7f4c000ce4f0 2024-05-28T06:12:10.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4bf7e00640 1 -- 172.21.15.122:0/1515131670 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0072f0 con 0x7f4c000ce4f0 2024-05-28T06:12:10.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4c07000640 1 -- 172.21.15.122:0/1515131670 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c000b1780 con 0x7f4c000ce4f0 2024-05-28T06:12:10.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4c07000640 1 -- 172.21.15.122:0/1515131670 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c000b1d40 con 0x7f4c000ce4f0 2024-05-28T06:12:10.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.066+0000 7f4c07000640 1 -- 172.21.15.122:0/1515131670 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c000b2350 con 0x7f4c000ce4f0 2024-05-28T06:12:10.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.070+0000 7f4bf7e00640 1 -- 172.21.15.122:0/1515131670 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 88599+0+0 (secure 0 0 0) 0x7f4bec01a070 con 0x7f4c000ce4f0 2024-05-28T06:12:10.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.070+0000 7f4bf7e00640 1 --2- 172.21.15.122:0/1515131670 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4be0068a40 0x7f4be006af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:10.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.070+0000 7f4bf7e00640 1 -- 172.21.15.122:0/1515131670 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7f4bec086a50 con 0x7f4c000ce4f0 2024-05-28T06:12:10.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.070+0000 7f4bffe00640 1 --2- 172.21.15.122:0/1515131670 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4be0068a40 0x7f4be006af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:10.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.070+0000 7f4bffe00640 1 --2- 172.21.15.122:0/1515131670 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4be0068a40 0x7f4be006af00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00ad000 tx=0x7f4bf0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:10.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.074+0000 7f4bf7e00640 1 -- 172.21.15.122:0/1515131670 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4bec056570 con 0x7f4c000ce4f0 2024-05-28T06:12:10.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.262+0000 7f4c07000640 1 -- 172.21.15.122:0/1515131670 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4c00076020 con 0x7f4be0068a40 2024-05-28T06:12:10.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.290+0000 7f4bf7e00640 1 -- 172.21.15.122:0/1515131670 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4bf00ab790 con 0x7f4be0068a40 2024-05-28T06:12:10.289 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:10.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.290+0000 7f4c07000640 1 -- 172.21.15.122:0/1515131670 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4be0068a40 msgr2=0x7f4be006af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:10.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.290+0000 7f4c07000640 1 --2- 172.21.15.122:0/1515131670 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4be0068a40 0x7f4be006af00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00ad000 tx=0x7f4bf0008040 comp rx=0 tx=0).stop 2024-05-28T06:12:10.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.290+0000 7f4c07000640 1 -- 172.21.15.122:0/1515131670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c000ce4f0 msgr2=0x7f4c0015b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:10.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.290+0000 7f4c07000640 1 --2- 172.21.15.122:0/1515131670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c000ce4f0 0x7f4c0015b960 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4bec00c420 tx=0x7f4bec00c8e0 comp rx=0 tx=0).stop 2024-05-28T06:12:10.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.290+0000 7f4c07000640 1 -- 172.21.15.122:0/1515131670 shutdown_connections 2024-05-28T06:12:10.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.290+0000 7f4c07000640 1 --2- 172.21.15.122:0/1515131670 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4be0068a40 0x7f4be006af00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:10.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.290+0000 7f4c07000640 1 --2- 172.21.15.122:0/1515131670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c0015e730 0x7f4c0015bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:10.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.290+0000 7f4c07000640 1 --2- 172.21.15.122:0/1515131670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c000ce4f0 0x7f4c0015b960 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:10.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.290+0000 7f4c07000640 1 --2- 172.21.15.122:0/1515131670 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c000b58d0 0x7f4c001fa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:10.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.290+0000 7f4c07000640 1 -- 172.21.15.122:0/1515131670 >> 172.21.15.122:0/1515131670 conn(0x7f4c0006bd90 msgr2=0x7f4c00145440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:10.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.294+0000 7f4c07000640 1 -- 172.21.15.122:0/1515131670 shutdown_connections 2024-05-28T06:12:10.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.294+0000 7f4c07000640 1 -- 172.21.15.122:0/1515131670 wait complete. 2024-05-28T06:12:10.314 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-05-28T06:12:10.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.454+0000 7f54b8e00640 1 Processor -- start 2024-05-28T06:12:10.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.454+0000 7f54b8e00640 1 -- start start 2024-05-28T06:12:10.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.454+0000 7f54b8e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f54b406f890 0x7f54b40cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:10.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.454+0000 7f54b8e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54b40d0310 con 0x7f54b40cff30 2024-05-28T06:12:10.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.454+0000 7f54b8e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54b415be20 con 0x7f54b40cd930 2024-05-28T06:12:10.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.454+0000 7f54b8e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f54b415c100 con 0x7f54b406f890 2024-05-28T06:12:10.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.454+0000 7f54b1e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f54b40cff30 0x7f54b406f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:34808/0 (socket says 172.21.15.122:34808) 2024-05-28T06:12:10.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.454+0000 7f54b1e00640 1 -- 172.21.15.122:0/1672522651 learned_addr learned my addr 172.21.15.122:0/1672522651 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:10.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.454+0000 7f54a9400640 1 --2- 172.21.15.122:0/1672522651 >> v2:172.21.15.122:3300/0 conn(0x7f54b406f890 0x7f54b40cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:10.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.458+0000 7f54a9400640 1 -- 172.21.15.122:0/1672522651 >> v1:172.21.15.153:6789/0 conn(0x7f54b40cd930 legacy=0x7f54b40b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:10.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.458+0000 7f54a9400640 1 -- 172.21.15.122:0/1672522651 >> v1:172.21.15.122:6789/0 conn(0x7f54b40cff30 legacy=0x7f54b406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:10.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.458+0000 7f54a9400640 1 -- 172.21.15.122:0/1672522651 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54b415c3e0 con 0x7f54b406f890 2024-05-28T06:12:10.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.458+0000 7f54a9400640 1 --2- 172.21.15.122:0/1672522651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54b406f890 0x7f54b40cd3f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f549c0097c0 tx=0x7f549c01e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64fe932976e67656 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:10.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.458+0000 7f54b1400640 1 -- 172.21.15.122:0/1672522651 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c0aa610 con 0x7f54b406f890 2024-05-28T06:12:10.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.458+0000 7f54b1400640 1 -- 172.21.15.122:0/1672522651 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f549c0aa7b0 con 0x7f54b406f890 2024-05-28T06:12:10.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.458+0000 7f54b1400640 1 -- 172.21.15.122:0/1672522651 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c0aab80 con 0x7f54b406f890 2024-05-28T06:12:10.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.458+0000 7f54b8e00640 1 -- 172.21.15.122:0/1672522651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54b406f890 msgr2=0x7f54b40cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:10.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.458+0000 7f54b8e00640 1 --2- 172.21.15.122:0/1672522651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54b406f890 0x7f54b40cd3f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f549c0097c0 tx=0x7f549c01e640 comp rx=0 tx=0).stop 2024-05-28T06:12:10.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.458+0000 7f54b8e00640 1 -- 172.21.15.122:0/1672522651 shutdown_connections 2024-05-28T06:12:10.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.458+0000 7f54b8e00640 1 --2- 172.21.15.122:0/1672522651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54b406f890 0x7f54b40cd3f0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:10.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.458+0000 7f54b8e00640 1 -- 172.21.15.122:0/1672522651 >> 172.21.15.122:0/1672522651 conn(0x7f54b406bd90 msgr2=0x7f54b406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:10.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.458+0000 7f54b8e00640 1 -- 172.21.15.122:0/1672522651 shutdown_connections 2024-05-28T06:12:10.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.458+0000 7f54b8e00640 1 -- 172.21.15.122:0/1672522651 wait complete. 2024-05-28T06:12:10.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54b8e00640 1 Processor -- start 2024-05-28T06:12:10.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54b8e00640 1 -- start start 2024-05-28T06:12:10.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54b8e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54b406f890 0x7f54b415aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:10.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54b8e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54b40cd930 0x7f54b40b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:10.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54b8e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f54b40cff30 0x7f54b40b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:10.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54b8e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f54b40b5a50 con 0x7f54b406f890 2024-05-28T06:12:10.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54b8e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f54b40b58d0 con 0x7f54b40cd930 2024-05-28T06:12:10.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54b8e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f54b40b5bd0 con 0x7f54b40cff30 2024-05-28T06:12:10.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54b1e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54b406f890 0x7f54b415aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:10.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54b1e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54b406f890 0x7f54b415aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43846/0 (socket says 172.21.15.122:43846) 2024-05-28T06:12:10.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54b1e00640 1 -- 172.21.15.122:0/2166535276 learned_addr learned my addr 172.21.15.122:0/2166535276 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:10.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54a9400640 1 --2- 172.21.15.122:0/2166535276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54b40cd930 0x7f54b40b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:10.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54b2800640 1 --2- 172.21.15.122:0/2166535276 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f54b40cff30 0x7f54b40b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:10.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54b1e00640 1 -- 172.21.15.122:0/2166535276 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f54b40cff30 msgr2=0x7f54b40b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:10.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54b1e00640 1 --2- 172.21.15.122:0/2166535276 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f54b40cff30 0x7f54b40b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:10.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54b1e00640 1 -- 172.21.15.122:0/2166535276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54b40cd930 msgr2=0x7f54b40b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:10.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54b1e00640 1 --2- 172.21.15.122:0/2166535276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54b40cd930 0x7f54b40b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:10.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54b1e00640 1 -- 172.21.15.122:0/2166535276 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54b414b470 con 0x7f54b406f890 2024-05-28T06:12:10.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54a9400640 1 --2- 172.21.15.122:0/2166535276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54b40cd930 0x7f54b40b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:12:10.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54b1e00640 1 --2- 172.21.15.122:0/2166535276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54b406f890 0x7f54b415aff0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f54a400c370 tx=0x7f54a400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:10.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54aaa00640 1 -- 172.21.15.122:0/2166535276 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a4017070 con 0x7f54b406f890 2024-05-28T06:12:10.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54aaa00640 1 -- 172.21.15.122:0/2166535276 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a4005cf0 con 0x7f54b406f890 2024-05-28T06:12:10.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54b8e00640 1 -- 172.21.15.122:0/2166535276 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54b41fbd30 con 0x7f54b406f890 2024-05-28T06:12:10.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.462+0000 7f54aaa00640 1 -- 172.21.15.122:0/2166535276 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a40072f0 con 0x7f54b406f890 2024-05-28T06:12:10.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.466+0000 7f54b8e00640 1 -- 172.21.15.122:0/2166535276 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54b415b530 con 0x7f54b406f890 2024-05-28T06:12:10.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.466+0000 7f54b8e00640 1 -- 172.21.15.122:0/2166535276 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54b4068c40 con 0x7f54b406f890 2024-05-28T06:12:10.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.466+0000 7f54aaa00640 1 -- 172.21.15.122:0/2166535276 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) ==== 88701+0+0 (secure 0 0 0) 0x7f54a401a070 con 0x7f54b406f890 2024-05-28T06:12:10.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.466+0000 7f54aaa00640 1 --2- 172.21.15.122:0/2166535276 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5490068b60 0x7f549006b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:10.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.466+0000 7f54aaa00640 1 -- 172.21.15.122:0/2166535276 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7f54a4087050 con 0x7f54b406f890 2024-05-28T06:12:10.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.466+0000 7f54a9400640 1 --2- 172.21.15.122:0/2166535276 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5490068b60 0x7f549006b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:10.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.466+0000 7f54a9400640 1 --2- 172.21.15.122:0/2166535276 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5490068b60 0x7f549006b020 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f549c0b1000 tx=0x7f549c0b4040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:10.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.470+0000 7f54aaa00640 1 -- 172.21.15.122:0/2166535276 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f54a40565b0 con 0x7f54b406f890 2024-05-28T06:12:10.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.654+0000 7f54b8e00640 1 -- 172.21.15.122:0/2166535276 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f54b4076020 con 0x7f5490068b60 2024-05-28T06:12:10.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.670+0000 7f54aaa00640 1 -- 172.21.15.122:0/2166535276 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f549c0aa7a0 con 0x7f5490068b60 2024-05-28T06:12:10.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.674+0000 7f54b8e00640 1 -- 172.21.15.122:0/2166535276 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5490068b60 msgr2=0x7f549006b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:10.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.674+0000 7f54b8e00640 1 --2- 172.21.15.122:0/2166535276 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5490068b60 0x7f549006b020 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f549c0b1000 tx=0x7f549c0b4040 comp rx=0 tx=0).stop 2024-05-28T06:12:10.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.674+0000 7f54b8e00640 1 -- 172.21.15.122:0/2166535276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54b406f890 msgr2=0x7f54b415aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:10.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.674+0000 7f54b8e00640 1 --2- 172.21.15.122:0/2166535276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54b406f890 0x7f54b415aff0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f54a400c370 tx=0x7f54a400c830 comp rx=0 tx=0).stop 2024-05-28T06:12:10.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.674+0000 7f54b8e00640 1 -- 172.21.15.122:0/2166535276 shutdown_connections 2024-05-28T06:12:10.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.674+0000 7f54b8e00640 1 --2- 172.21.15.122:0/2166535276 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5490068b60 0x7f549006b020 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:10.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.674+0000 7f54b8e00640 1 --2- 172.21.15.122:0/2166535276 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f54b40cff30 0x7f54b40b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:10.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.674+0000 7f54b8e00640 1 --2- 172.21.15.122:0/2166535276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54b40cd930 0x7f54b40b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:10.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.674+0000 7f54b8e00640 1 --2- 172.21.15.122:0/2166535276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54b406f890 0x7f54b415aff0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:10.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.674+0000 7f54b8e00640 1 -- 172.21.15.122:0/2166535276 >> 172.21.15.122:0/2166535276 conn(0x7f54b406bd90 msgr2=0x7f54b406ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:10.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.674+0000 7f54b8e00640 1 -- 172.21.15.122:0/2166535276 shutdown_connections 2024-05-28T06:12:10.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.674+0000 7f54b8e00640 1 -- 172.21.15.122:0/2166535276 wait complete. 2024-05-28T06:12:10.699 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone24472 2024-05-28T06:12:10.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.842+0000 7f3b4d800640 1 Processor -- start 2024-05-28T06:12:10.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.842+0000 7f3b4d800640 1 -- start start 2024-05-28T06:12:10.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.842+0000 7f3b4d800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b4809aa40 0x7f3b4809bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:10.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.842+0000 7f3b4d800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3b480cda80 0x7f3b480b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:10.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.842+0000 7f3b4d800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b480d0110 con 0x7f3b4809ae20 2024-05-28T06:12:10.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.842+0000 7f3b4d800640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f3b480d03f0 con 0x7f3b480cda80 2024-05-28T06:12:10.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.842+0000 7f3b4d800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3b480d06d0 con 0x7f3b4809aa40 2024-05-28T06:12:10.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.842+0000 7f3b3fe00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f3b4809ae20 0x7f3b480d0ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:34814/0 (socket says 172.21.15.122:34814) 2024-05-28T06:12:10.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.842+0000 7f3b3fe00640 1 -- 172.21.15.122:0/3618126556 learned_addr learned my addr 172.21.15.122:0/3618126556 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:10.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.842+0000 7f3b4ce00640 1 --2- 172.21.15.122:0/3618126556 >> v2:172.21.15.122:3300/0 conn(0x7f3b480cda80 0x7f3b480b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:10.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.842+0000 7f3b47e00640 1 --2- 172.21.15.122:0/3618126556 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b4809aa40 0x7f3b4809bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:10.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.842+0000 7f3b47400640 1 -- 172.21.15.122:0/3618126556 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4031109290 0 0) 0x7f3b480d0110 con 0x7f3b4809ae20 2024-05-28T06:12:10.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.842+0000 7f3b47400640 1 -- 172.21.15.122:0/3618126556 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b2c003530 con 0x7f3b4809ae20 2024-05-28T06:12:10.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.842+0000 7f3b4ce00640 1 -- 172.21.15.122:0/3618126556 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b4809aa40 msgr2=0x7f3b4809bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:10.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.842+0000 7f3b4ce00640 1 --2- 172.21.15.122:0/3618126556 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b4809aa40 0x7f3b4809bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:10.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.842+0000 7f3b4ce00640 1 -- 172.21.15.122:0/3618126556 >> v1:172.21.15.122:6789/0 conn(0x7f3b4809ae20 legacy=0x7f3b480d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:10.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.842+0000 7f3b4ce00640 1 -- 172.21.15.122:0/3618126556 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b480d09b0 con 0x7f3b480cda80 2024-05-28T06:12:10.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.842+0000 7f3b47e00640 1 --2- 172.21.15.122:0/3618126556 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b4809aa40 0x7f3b4809bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:10.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.846+0000 7f3b4ce00640 1 --2- 172.21.15.122:0/3618126556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b480cda80 0x7f3b480b52f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3b40009d90 tx=0x7f3b4001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d839786f69414d03 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:10.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.846+0000 7f3b47400640 1 -- 172.21.15.122:0/3618126556 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b400b2070 con 0x7f3b480cda80 2024-05-28T06:12:10.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.846+0000 7f3b47400640 1 -- 172.21.15.122:0/3618126556 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b400a58e0 con 0x7f3b480cda80 2024-05-28T06:12:10.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.846+0000 7f3b47400640 1 -- 172.21.15.122:0/3618126556 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b400a5cb0 con 0x7f3b480cda80 2024-05-28T06:12:10.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.846+0000 7f3b4d800640 1 -- 172.21.15.122:0/3618126556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b480cda80 msgr2=0x7f3b480b52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:10.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.846+0000 7f3b4d800640 1 --2- 172.21.15.122:0/3618126556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b480cda80 0x7f3b480b52f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3b40009d90 tx=0x7f3b4001c970 comp rx=0 tx=0).stop 2024-05-28T06:12:10.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.846+0000 7f3b4d800640 1 -- 172.21.15.122:0/3618126556 shutdown_connections 2024-05-28T06:12:10.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.846+0000 7f3b4d800640 1 --2- 172.21.15.122:0/3618126556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b480cda80 0x7f3b480b52f0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:10.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.846+0000 7f3b4d800640 1 --2- 172.21.15.122:0/3618126556 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b4809aa40 0x7f3b4809bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:10.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.846+0000 7f3b4d800640 1 -- 172.21.15.122:0/3618126556 >> 172.21.15.122:0/3618126556 conn(0x7f3b480b3f90 msgr2=0x7f3b480b43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:10.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.846+0000 7f3b4d800640 1 -- 172.21.15.122:0/3618126556 shutdown_connections 2024-05-28T06:12:10.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.846+0000 7f3b4d800640 1 -- 172.21.15.122:0/3618126556 wait complete. 2024-05-28T06:12:10.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b4d800640 1 Processor -- start 2024-05-28T06:12:10.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b4d800640 1 -- start start 2024-05-28T06:12:10.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b4d800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b4809aa40 0x7f3b4814b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:10.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b4d800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b4809ae20 0x7f3b4806e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:10.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b4d800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b480cda80 0x7f3b4815aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:10.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b4d800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4809b380 con 0x7f3b480cda80 2024-05-28T06:12:10.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b4d800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4809b200 con 0x7f3b4809aa40 2024-05-28T06:12:10.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b4d800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3b48169570 con 0x7f3b4809ae20 2024-05-28T06:12:10.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b4ce00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b480cda80 0x7f3b4815aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:10.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b4ce00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b480cda80 0x7f3b4815aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43854/0 (socket says 172.21.15.122:43854) 2024-05-28T06:12:10.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b4ce00640 1 -- 172.21.15.122:0/142516993 learned_addr learned my addr 172.21.15.122:0/142516993 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:10.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b3fe00640 1 --2- 172.21.15.122:0/142516993 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b4809ae20 0x7f3b4806e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:10.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b47e00640 1 --2- 172.21.15.122:0/142516993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b4809aa40 0x7f3b4814b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:10.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b4ce00640 1 -- 172.21.15.122:0/142516993 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b4809ae20 msgr2=0x7f3b4806e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:10.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b4ce00640 1 --2- 172.21.15.122:0/142516993 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b4809ae20 0x7f3b4806e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:10.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b4ce00640 1 -- 172.21.15.122:0/142516993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b4809aa40 msgr2=0x7f3b4814b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:10.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b4ce00640 1 --2- 172.21.15.122:0/142516993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b4809aa40 0x7f3b4814b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:10.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b4ce00640 1 -- 172.21.15.122:0/142516993 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b480c7440 con 0x7f3b480cda80 2024-05-28T06:12:10.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b47e00640 1 --2- 172.21.15.122:0/142516993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b4809aa40 0x7f3b4814b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:12:10.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b4ce00640 1 --2- 172.21.15.122:0/142516993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b480cda80 0x7f3b4815aa50 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3b400b0040 tx=0x7f3b40019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:10.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b44c00640 1 -- 172.21.15.122:0/142516993 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b400b2050 con 0x7f3b480cda80 2024-05-28T06:12:10.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b44c00640 1 -- 172.21.15.122:0/142516993 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b400be070 con 0x7f3b480cda80 2024-05-28T06:12:10.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b44c00640 1 -- 172.21.15.122:0/142516993 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b400ada90 con 0x7f3b480cda80 2024-05-28T06:12:10.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b4d800640 1 -- 172.21.15.122:0/142516993 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b480c7720 con 0x7f3b480cda80 2024-05-28T06:12:10.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.850+0000 7f3b4d800640 1 -- 172.21.15.122:0/142516993 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b480c7ce0 con 0x7f3b480cda80 2024-05-28T06:12:10.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.854+0000 7f3b4d800640 1 -- 172.21.15.122:0/142516993 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b48075620 con 0x7f3b480cda80 2024-05-28T06:12:10.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.854+0000 7f3b44c00640 1 -- 172.21.15.122:0/142516993 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) ==== 88701+0+0 (secure 0 0 0) 0x7f3b400adc30 con 0x7f3b480cda80 2024-05-28T06:12:10.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.854+0000 7f3b44c00640 1 --2- 172.21.15.122:0/142516993 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3b24068b60 0x7f3b2406b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:10.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.854+0000 7f3b44c00640 1 -- 172.21.15.122:0/142516993 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7f3b40120720 con 0x7f3b480cda80 2024-05-28T06:12:10.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.854+0000 7f3b47e00640 1 --2- 172.21.15.122:0/142516993 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3b24068b60 0x7f3b2406b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:10.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.854+0000 7f3b47e00640 1 --2- 172.21.15.122:0/142516993 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3b24068b60 0x7f3b2406b020 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3b4806d830 tx=0x7f3b38008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:10.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:10.858+0000 7f3b44c00640 1 -- 172.21.15.122:0/142516993 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3b40016560 con 0x7f3b480cda80 2024-05-28T06:12:11.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.042+0000 7f3b4d800640 1 -- 172.21.15.122:0/142516993 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone24472", "target": ["mon-mgr", ""]}) -- 0x7f3b480b8420 con 0x7f3b24068b60 2024-05-28T06:12:11.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.058+0000 7f3b44c00640 1 -- 172.21.15.122:0/142516993 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3b480b8420 con 0x7f3b24068b60 2024-05-28T06:12:11.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.058+0000 7f3b4d800640 1 -- 172.21.15.122:0/142516993 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3b24068b60 msgr2=0x7f3b2406b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:11.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.058+0000 7f3b4d800640 1 --2- 172.21.15.122:0/142516993 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3b24068b60 0x7f3b2406b020 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3b4806d830 tx=0x7f3b38008040 comp rx=0 tx=0).stop 2024-05-28T06:12:11.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.058+0000 7f3b4d800640 1 -- 172.21.15.122:0/142516993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b480cda80 msgr2=0x7f3b4815aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:11.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.058+0000 7f3b4d800640 1 --2- 172.21.15.122:0/142516993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b480cda80 0x7f3b4815aa50 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3b400b0040 tx=0x7f3b40019710 comp rx=0 tx=0).stop 2024-05-28T06:12:11.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.062+0000 7f3b4d800640 1 -- 172.21.15.122:0/142516993 shutdown_connections 2024-05-28T06:12:11.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.062+0000 7f3b4d800640 1 --2- 172.21.15.122:0/142516993 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3b24068b60 0x7f3b2406b020 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:11.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.062+0000 7f3b4d800640 1 --2- 172.21.15.122:0/142516993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b480cda80 0x7f3b4815aa50 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:11.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.062+0000 7f3b4d800640 1 --2- 172.21.15.122:0/142516993 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3b4809ae20 0x7f3b4806e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:11.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.062+0000 7f3b4d800640 1 --2- 172.21.15.122:0/142516993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b4809aa40 0x7f3b4814b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:11.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.062+0000 7f3b4d800640 1 -- 172.21.15.122:0/142516993 >> 172.21.15.122:0/142516993 conn(0x7f3b480b3f90 msgr2=0x7f3b4815bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:11.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.062+0000 7f3b4d800640 1 -- 172.21.15.122:0/142516993 shutdown_connections 2024-05-28T06:12:11.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.062+0000 7f3b4d800640 1 -- 172.21.15.122:0/142516993 wait complete. 2024-05-28T06:12:11.070 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:11.070+0000 7f9deba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:11.070 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:11.070+0000 7f9deba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:11.070 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:11.070+0000 7f9deba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:11.070 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:11.070+0000 7f9deba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:11.071 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:11.070+0000 7f9deba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:11.087 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone24471 2024-05-28T06:12:11.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.234+0000 7f17f2000640 1 Processor -- start 2024-05-28T06:12:11.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.234+0000 7f17f2000640 1 -- start start 2024-05-28T06:12:11.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.234+0000 7f17f2000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f17ec06f890 0x7f17ec0cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:11.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.234+0000 7f17f2000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17ec0cd930 0x7f17ec0b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:11.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.234+0000 7f17f2000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17ec0d0310 con 0x7f17ec0cff30 2024-05-28T06:12:11.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.234+0000 7f17f2000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f17ec15be20 con 0x7f17ec06f890 2024-05-28T06:12:11.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.234+0000 7f17f2000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f17ec15c100 con 0x7f17ec0cd930 2024-05-28T06:12:11.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.234+0000 7f17ebe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17ec0cd930 0x7f17ec0b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:11.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.234+0000 7f17eaa00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f17ec06f890 0x7f17ec0cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:11.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.234+0000 7f17eaa00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f17ec06f890 0x7f17ec0cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:42658/0 (socket says 172.21.15.122:42658) 2024-05-28T06:12:11.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.234+0000 7f17eaa00640 1 -- 172.21.15.122:0/1448541179 learned_addr learned my addr 172.21.15.122:0/1448541179 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:11.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.238+0000 7f17eaa00640 1 -- 172.21.15.122:0/1448541179 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17ec0cd930 msgr2=0x7f17ec0b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:11.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.238+0000 7f17eaa00640 1 --2- 172.21.15.122:0/1448541179 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17ec0cd930 0x7f17ec0b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:11.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.238+0000 7f17eaa00640 1 -- 172.21.15.122:0/1448541179 >> v1:172.21.15.153:6789/0 conn(0x7f17ec0cff30 legacy=0x7f17ec06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:11.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.238+0000 7f17eaa00640 1 -- 172.21.15.122:0/1448541179 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ec15c3e0 con 0x7f17ec06f890 2024-05-28T06:12:11.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.238+0000 7f17ea000640 1 -- 172.21.15.122:0/1448541179 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 865141895 0 0) 0x7f17ec0d0310 con 0x7f17ec0cff30 2024-05-28T06:12:11.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.238+0000 7f17eaa00640 1 --2- 172.21.15.122:0/1448541179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17ec06f890 0x7f17ec0cd3f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f17d8009870 tx=0x7f17d801c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1698626c026a100c server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:11.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.238+0000 7f17ea000640 1 -- 172.21.15.122:0/1448541179 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d80aa430 con 0x7f17ec06f890 2024-05-28T06:12:11.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.238+0000 7f17ea000640 1 -- 172.21.15.122:0/1448541179 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17d80af070 con 0x7f17ec06f890 2024-05-28T06:12:11.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.238+0000 7f17ea000640 1 -- 172.21.15.122:0/1448541179 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d80aa7f0 con 0x7f17ec06f890 2024-05-28T06:12:11.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17f2000640 1 -- 172.21.15.122:0/1448541179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17ec06f890 msgr2=0x7f17ec0cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:11.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17f2000640 1 --2- 172.21.15.122:0/1448541179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17ec06f890 0x7f17ec0cd3f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f17d8009870 tx=0x7f17d801c530 comp rx=0 tx=0).stop 2024-05-28T06:12:11.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17f2000640 1 -- 172.21.15.122:0/1448541179 shutdown_connections 2024-05-28T06:12:11.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17f2000640 1 --2- 172.21.15.122:0/1448541179 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17ec0cd930 0x7f17ec0b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:11.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17f2000640 1 --2- 172.21.15.122:0/1448541179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17ec06f890 0x7f17ec0cd3f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:11.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17f2000640 1 -- 172.21.15.122:0/1448541179 >> 172.21.15.122:0/1448541179 conn(0x7f17ec06bd90 msgr2=0x7f17ec06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:11.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17f2000640 1 -- 172.21.15.122:0/1448541179 shutdown_connections 2024-05-28T06:12:11.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17f2000640 1 -- 172.21.15.122:0/1448541179 wait complete. 2024-05-28T06:12:11.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17f2000640 1 Processor -- start 2024-05-28T06:12:11.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17f2000640 1 -- start start 2024-05-28T06:12:11.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17f2000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17ec06f890 0x7f17ec142c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:11.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17f2000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17ec0cd930 0x7f17ec0b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:11.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17f2000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17ec0cff30 0x7f17ec0ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:11.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17f2000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec0b5700 con 0x7f17ec06f890 2024-05-28T06:12:11.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17f2000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec0b5880 con 0x7f17ec0cff30 2024-05-28T06:12:11.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17f2000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f17ec0b5a00 con 0x7f17ec0cd930 2024-05-28T06:12:11.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17eb400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17ec06f890 0x7f17ec142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:11.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17eb400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17ec06f890 0x7f17ec142c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43894/0 (socket says 172.21.15.122:43894) 2024-05-28T06:12:11.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17eb400640 1 -- 172.21.15.122:0/3682966843 learned_addr learned my addr 172.21.15.122:0/3682966843 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:11.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17eaa00640 1 --2- 172.21.15.122:0/3682966843 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17ec0cd930 0x7f17ec0b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:11.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17ebe00640 1 --2- 172.21.15.122:0/3682966843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17ec0cff30 0x7f17ec0ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:11.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17eb400640 1 -- 172.21.15.122:0/3682966843 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17ec0cd930 msgr2=0x7f17ec0b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:11.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17eb400640 1 --2- 172.21.15.122:0/3682966843 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17ec0cd930 0x7f17ec0b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:11.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17eb400640 1 -- 172.21.15.122:0/3682966843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17ec0cff30 msgr2=0x7f17ec0ae900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:11.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17eb400640 1 --2- 172.21.15.122:0/3682966843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17ec0cff30 0x7f17ec0ae900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:11.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.242+0000 7f17eb400640 1 -- 172.21.15.122:0/3682966843 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ec0b2260 con 0x7f17ec06f890 2024-05-28T06:12:11.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.246+0000 7f17eb400640 1 --2- 172.21.15.122:0/3682966843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17ec06f890 0x7f17ec142c50 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00c3f0 tx=0x7f17dc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:11.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.246+0000 7f17e3400640 1 -- 172.21.15.122:0/3682966843 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc017070 con 0x7f17ec06f890 2024-05-28T06:12:11.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.246+0000 7f17e3400640 1 -- 172.21.15.122:0/3682966843 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17dc0052f0 con 0x7f17ec06f890 2024-05-28T06:12:11.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.246+0000 7f17e3400640 1 -- 172.21.15.122:0/3682966843 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc003860 con 0x7f17ec06f890 2024-05-28T06:12:11.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.246+0000 7f17f2000640 1 -- 172.21.15.122:0/3682966843 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17ec0b2540 con 0x7f17ec06f890 2024-05-28T06:12:11.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.246+0000 7f17f2000640 1 -- 172.21.15.122:0/3682966843 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17ec0b2b00 con 0x7f17ec06f890 2024-05-28T06:12:11.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.246+0000 7f17f2000640 1 -- 172.21.15.122:0/3682966843 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17ec068c40 con 0x7f17ec06f890 2024-05-28T06:12:11.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.246+0000 7f17e3400640 1 -- 172.21.15.122:0/3682966843 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) ==== 88701+0+0 (secure 0 0 0) 0x7f17dc01a070 con 0x7f17ec06f890 2024-05-28T06:12:11.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.246+0000 7f17e3400640 1 --2- 172.21.15.122:0/3682966843 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f17cc068b60 0x7f17cc06b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:11.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.246+0000 7f17e3400640 1 -- 172.21.15.122:0/3682966843 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7f17dc087000 con 0x7f17ec06f890 2024-05-28T06:12:11.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.246+0000 7f17eaa00640 1 --2- 172.21.15.122:0/3682966843 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f17cc068b60 0x7f17cc06b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:11.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.250+0000 7f17eaa00640 1 --2- 172.21.15.122:0/3682966843 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f17cc068b60 0x7f17cc06b020 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f17d80ae000 tx=0x7f17d80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:11.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.250+0000 7f17e3400640 1 -- 172.21.15.122:0/3682966843 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f17dc055f10 con 0x7f17ec06f890 2024-05-28T06:12:11.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.574+0000 7f17f2000640 1 -- 172.21.15.122:0/3682966843 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone24471", "target": ["mon-mgr", ""]}) -- 0x7f17ec0c5850 con 0x7f17cc068b60 2024-05-28T06:12:11.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.610+0000 7f17e3400640 1 -- 172.21.15.122:0/3682966843 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f17d80af040 con 0x7f17cc068b60 2024-05-28T06:12:11.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.614+0000 7f17f2000640 1 -- 172.21.15.122:0/3682966843 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f17cc068b60 msgr2=0x7f17cc06b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:11.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.614+0000 7f17f2000640 1 --2- 172.21.15.122:0/3682966843 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f17cc068b60 0x7f17cc06b020 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f17d80ae000 tx=0x7f17d80a7000 comp rx=0 tx=0).stop 2024-05-28T06:12:11.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.614+0000 7f17f2000640 1 -- 172.21.15.122:0/3682966843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17ec06f890 msgr2=0x7f17ec142c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:11.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.614+0000 7f17f2000640 1 --2- 172.21.15.122:0/3682966843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17ec06f890 0x7f17ec142c50 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00c3f0 tx=0x7f17dc00c8b0 comp rx=0 tx=0).stop 2024-05-28T06:12:11.613 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.614+0000 7f17f2000640 1 -- 172.21.15.122:0/3682966843 shutdown_connections 2024-05-28T06:12:11.613 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.614+0000 7f17f2000640 1 --2- 172.21.15.122:0/3682966843 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f17cc068b60 0x7f17cc06b020 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:11.613 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.614+0000 7f17f2000640 1 --2- 172.21.15.122:0/3682966843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17ec0cff30 0x7f17ec0ae900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:11.613 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.614+0000 7f17f2000640 1 --2- 172.21.15.122:0/3682966843 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17ec0cd930 0x7f17ec0b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:11.613 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.614+0000 7f17f2000640 1 --2- 172.21.15.122:0/3682966843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17ec06f890 0x7f17ec142c50 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:11.613 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.614+0000 7f17f2000640 1 -- 172.21.15.122:0/3682966843 >> 172.21.15.122:0/3682966843 conn(0x7f17ec06bd90 msgr2=0x7f17ec159880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:11.613 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.614+0000 7f17f2000640 1 -- 172.21.15.122:0/3682966843 shutdown_connections 2024-05-28T06:12:11.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11.614+0000 7f17f2000640 1 -- 172.21.15.122:0/3682966843 wait complete. 2024-05-28T06:12:11.652 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-05-28T06:12:11.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-28T06:12:11.745 INFO:teuthology.orchestra.run.smithi122.stdout:2 2024-05-28T06:12:11.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:12:11.753 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-28T06:12:11.753 DEBUG:teuthology.orchestra.run.smithi122:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-28T06:12:11.863 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-28T06:12:11.928 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-28T06:12:11.929 INFO:tasks.cephfs.mount:Terminating background process 2024-05-28T06:12:11.929 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:12:11.929 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:12:11.938 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:12:11.938 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:12:11.987 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:12:12.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.170+0000 7f179ee00640 1 Processor -- start 2024-05-28T06:12:12.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.170+0000 7f179ee00640 1 -- start start 2024-05-28T06:12:12.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.170+0000 7f179ee00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17980b59c0 0x7f17980cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:12.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.170+0000 7f179ee00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17980d0310 con 0x7f179806f890 2024-05-28T06:12:12.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.170+0000 7f179ee00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f179815be20 con 0x7f17980cff30 2024-05-28T06:12:12.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.170+0000 7f179ee00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f179815c100 con 0x7f17980b59c0 2024-05-28T06:12:12.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.170+0000 7f1797400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f179806f890 0x7f17980cd3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:34818/0 (socket says 172.21.15.122:34818) 2024-05-28T06:12:12.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.170+0000 7f1797400640 1 -- 172.21.15.122:0/1208301957 learned_addr learned my addr 172.21.15.122:0/1208301957 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:12.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.170+0000 7f179ce00640 1 --2- 172.21.15.122:0/1208301957 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17980b59c0 0x7f17980cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:12.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.170+0000 7f1796a00640 1 -- 172.21.15.122:0/1208301957 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1534631518 0 0) 0x7f17980d0310 con 0x7f179806f890 2024-05-28T06:12:12.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.170+0000 7f1796a00640 1 -- 172.21.15.122:0/1208301957 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f177c005740 con 0x7f179806f890 2024-05-28T06:12:12.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.170+0000 7f1796a00640 1 -- 172.21.15.122:0/1208301957 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2212142814 0 0) 0x7f179815be20 con 0x7f17980cff30 2024-05-28T06:12:12.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.170+0000 7f1796a00640 1 -- 172.21.15.122:0/1208301957 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17980d0310 con 0x7f17980cff30 2024-05-28T06:12:12.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.170+0000 7f1796a00640 1 -- 172.21.15.122:0/1208301957 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2237096986 0 0) 0x7f177c005740 con 0x7f179806f890 2024-05-28T06:12:12.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.170+0000 7f179ce00640 1 -- 172.21.15.122:0/1208301957 >> v1:172.21.15.153:6789/0 conn(0x7f17980cff30 legacy=0x7f179806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:12.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.170+0000 7f179ce00640 1 -- 172.21.15.122:0/1208301957 >> v1:172.21.15.122:6789/0 conn(0x7f179806f890 legacy=0x7f17980cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:12.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.170+0000 7f179ce00640 1 -- 172.21.15.122:0/1208301957 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f179815c3e0 con 0x7f17980b59c0 2024-05-28T06:12:12.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.174+0000 7f179ce00640 1 --2- 172.21.15.122:0/1208301957 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17980b59c0 0x7f17980cdb00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1790009dc0 tx=0x7f179001c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c6a8cd6dce0729a server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:12.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.174+0000 7f1796a00640 1 -- 172.21.15.122:0/1208301957 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17900b2070 con 0x7f17980b59c0 2024-05-28T06:12:12.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.174+0000 7f1796a00640 1 -- 172.21.15.122:0/1208301957 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17900a5560 con 0x7f17980b59c0 2024-05-28T06:12:12.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.174+0000 7f1796a00640 1 -- 172.21.15.122:0/1208301957 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1784001680 con 0x7f17980b59c0 2024-05-28T06:12:12.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.174+0000 7f179ee00640 1 -- 172.21.15.122:0/1208301957 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17980b59c0 msgr2=0x7f17980cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:12.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.174+0000 7f179ee00640 1 --2- 172.21.15.122:0/1208301957 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17980b59c0 0x7f17980cdb00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1790009dc0 tx=0x7f179001c880 comp rx=0 tx=0).stop 2024-05-28T06:12:12.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.174+0000 7f179ee00640 1 -- 172.21.15.122:0/1208301957 shutdown_connections 2024-05-28T06:12:12.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.174+0000 7f179ee00640 1 --2- 172.21.15.122:0/1208301957 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17980b59c0 0x7f17980cdb00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:12.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.174+0000 7f179ee00640 1 -- 172.21.15.122:0/1208301957 >> 172.21.15.122:0/1208301957 conn(0x7f179806bd90 msgr2=0x7f179806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:12.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.174+0000 7f179ee00640 1 -- 172.21.15.122:0/1208301957 shutdown_connections 2024-05-28T06:12:12.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.174+0000 7f179ee00640 1 -- 172.21.15.122:0/1208301957 wait complete. 2024-05-28T06:12:12.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f179ee00640 1 Processor -- start 2024-05-28T06:12:12.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f179ee00640 1 -- start start 2024-05-28T06:12:12.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f179ee00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f179806f890 0x7f17981570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:12.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f179ee00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17980b59c0 0x7f1798148a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:12.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f179ee00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17980cff30 0x7f1798157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:12.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f179ee00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f179806ec10 con 0x7f17980cff30 2024-05-28T06:12:12.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f179ee00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f179806ea90 con 0x7f179806f890 2024-05-28T06:12:12.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f179ee00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f179806ed90 con 0x7f17980b59c0 2024-05-28T06:12:12.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f179ce00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17980cff30 0x7f1798157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:12.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f1797400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17980b59c0 0x7f1798148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:12.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f179ce00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17980cff30 0x7f1798157910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43904/0 (socket says 172.21.15.122:43904) 2024-05-28T06:12:12.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f179ce00640 1 -- 172.21.15.122:0/1658434766 learned_addr learned my addr 172.21.15.122:0/1658434766 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:12.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f1797e00640 1 --2- 172.21.15.122:0/1658434766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f179806f890 0x7f17981570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:12.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f179ce00640 1 -- 172.21.15.122:0/1658434766 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17980b59c0 msgr2=0x7f1798148a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:12.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f179ce00640 1 --2- 172.21.15.122:0/1658434766 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17980b59c0 0x7f1798148a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:12.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f179ce00640 1 -- 172.21.15.122:0/1658434766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f179806f890 msgr2=0x7f17981570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:12.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f179ce00640 1 --2- 172.21.15.122:0/1658434766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f179806f890 0x7f17981570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:12.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f179ce00640 1 -- 172.21.15.122:0/1658434766 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1798149880 con 0x7f17980cff30 2024-05-28T06:12:12.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f1797400640 1 --2- 172.21.15.122:0/1658434766 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17980b59c0 0x7f1798148a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:12:12.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f179ce00640 1 --2- 172.21.15.122:0/1658434766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17980cff30 0x7f1798157910 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f179001a4b0 tx=0x7f1790019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:12.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f178fe00640 1 -- 172.21.15.122:0/1658434766 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17900b2070 con 0x7f17980cff30 2024-05-28T06:12:12.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f178fe00640 1 -- 172.21.15.122:0/1658434766 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17900bc070 con 0x7f17980cff30 2024-05-28T06:12:12.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f178fe00640 1 -- 172.21.15.122:0/1658434766 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17900a5d60 con 0x7f17980cff30 2024-05-28T06:12:12.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f179ee00640 1 -- 172.21.15.122:0/1658434766 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1798149b60 con 0x7f17980cff30 2024-05-28T06:12:12.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f179ee00640 1 -- 172.21.15.122:0/1658434766 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f179814a120 con 0x7f17980cff30 2024-05-28T06:12:12.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.178+0000 7f179ee00640 1 -- 172.21.15.122:0/1658434766 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1798068c40 con 0x7f17980cff30 2024-05-28T06:12:12.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.182+0000 7f178fe00640 1 -- 172.21.15.122:0/1658434766 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) ==== 88701+0+0 (secure 0 0 0) 0x7f1790004040 con 0x7f17980cff30 2024-05-28T06:12:12.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.182+0000 7f178fe00640 1 --2- 172.21.15.122:0/1658434766 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1778068b60 0x7f177806b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:12.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.182+0000 7f178fe00640 1 -- 172.21.15.122:0/1658434766 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7f17901222c0 con 0x7f17980cff30 2024-05-28T06:12:12.181 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.182+0000 7f1797e00640 1 --2- 172.21.15.122:0/1658434766 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1778068b60 0x7f177806b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:12.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.182+0000 7f1797e00640 1 --2- 172.21.15.122:0/1658434766 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1778068b60 0x7f177806b020 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f17880011f0 tx=0x7f1788009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:12.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.186+0000 7f178fe00640 1 -- 172.21.15.122:0/1658434766 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f17900164a0 con 0x7f17980cff30 2024-05-28T06:12:12.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.306+0000 7f178fe00640 1 -- 172.21.15.122:0/1658434766 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f17900edd70 con 0x7f17980cff30 2024-05-28T06:12:12.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.390+0000 7f179ee00640 1 -- 172.21.15.122:0/1658434766 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17980ccdf0 con 0x7f17980cff30 2024-05-28T06:12:12.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.394+0000 7f178fe00640 1 -- 172.21.15.122:0/1658434766 <== mon.0 v2:172.21.15.122:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+16705 (secure 0 0 0) 0x7f17900f8160 con 0x7f17980cff30 2024-05-28T06:12:12.395 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:12.395 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":49,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:10:31.395992+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:09:32.856007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-28T06:09:33.467043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":5}]},{"pgid":"7.32","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:12:12.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.398+0000 7f179ee00640 1 -- 172.21.15.122:0/1658434766 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1778068b60 msgr2=0x7f177806b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:12.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.398+0000 7f179ee00640 1 --2- 172.21.15.122:0/1658434766 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1778068b60 0x7f177806b020 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f17880011f0 tx=0x7f1788009040 comp rx=0 tx=0).stop 2024-05-28T06:12:12.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.398+0000 7f179ee00640 1 -- 172.21.15.122:0/1658434766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17980cff30 msgr2=0x7f1798157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:12.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.398+0000 7f179ee00640 1 --2- 172.21.15.122:0/1658434766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17980cff30 0x7f1798157910 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f179001a4b0 tx=0x7f1790019620 comp rx=0 tx=0).stop 2024-05-28T06:12:12.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.398+0000 7f179ee00640 1 -- 172.21.15.122:0/1658434766 shutdown_connections 2024-05-28T06:12:12.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.398+0000 7f179ee00640 1 --2- 172.21.15.122:0/1658434766 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1778068b60 0x7f177806b020 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:12.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.398+0000 7f179ee00640 1 --2- 172.21.15.122:0/1658434766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17980cff30 0x7f1798157910 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:12.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.398+0000 7f179ee00640 1 --2- 172.21.15.122:0/1658434766 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17980b59c0 0x7f1798148a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:12.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.398+0000 7f179ee00640 1 --2- 172.21.15.122:0/1658434766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f179806f890 0x7f17981570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:12.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.398+0000 7f179ee00640 1 -- 172.21.15.122:0/1658434766 >> 172.21.15.122:0/1658434766 conn(0x7f179806bd90 msgr2=0x7f1798151e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:12.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.398+0000 7f179ee00640 1 -- 172.21.15.122:0/1658434766 shutdown_connections 2024-05-28T06:12:12.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.398+0000 7f179ee00640 1 -- 172.21.15.122:0/1658434766 wait complete. 2024-05-28T06:12:12.432 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-28T06:09:32.856007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-05-28T06:09:33.467043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:12:12.432 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:12:12.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.666+0000 7f8da8200640 1 Processor -- start 2024-05-28T06:12:12.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.666+0000 7f8da8200640 1 -- start start 2024-05-28T06:12:12.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.666+0000 7f8da8200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8da00b0a60 0x7f8da0072f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:12.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.666+0000 7f8da8200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8da006fc90 0x7f8da00d1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:12.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.666+0000 7f8da8200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8da0073460 con 0x7f8da00b0e40 2024-05-28T06:12:12.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.666+0000 7f8da8200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f8da0155f20 con 0x7f8da006fc90 2024-05-28T06:12:12.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.666+0000 7f8da8200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8da015f170 con 0x7f8da00b0a60 2024-05-28T06:12:12.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.666+0000 7f8da5800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8da00b0a60 0x7f8da0072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:12.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.666+0000 7f8da5800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8da00b0a60 0x7f8da0072f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:37916/0 (socket says 172.21.15.122:37916) 2024-05-28T06:12:12.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.666+0000 7f8da5800640 1 -- 172.21.15.122:0/3063156979 learned_addr learned my addr 172.21.15.122:0/3063156979 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:12.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.666+0000 7f8da6200640 1 --2- 172.21.15.122:0/3063156979 >> v2:172.21.15.122:3300/0 conn(0x7f8da006fc90 0x7f8da00d1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:12.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.666+0000 7f8da5800640 1 -- 172.21.15.122:0/3063156979 >> v2:172.21.15.122:3300/0 conn(0x7f8da006fc90 msgr2=0x7f8da00d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:12.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.666+0000 7f8da5800640 1 --2- 172.21.15.122:0/3063156979 >> v2:172.21.15.122:3300/0 conn(0x7f8da006fc90 0x7f8da00d1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:12.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.666+0000 7f8da5800640 1 -- 172.21.15.122:0/3063156979 >> v1:172.21.15.153:6789/0 conn(0x7f8da00b0e40 legacy=0x7f8da006f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:12.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.666+0000 7f8da5800640 1 -- 172.21.15.122:0/3063156979 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da015f450 con 0x7f8da00b0a60 2024-05-28T06:12:12.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.666+0000 7f8da6200640 1 --2- 172.21.15.122:0/3063156979 >> v2:172.21.15.122:3300/0 conn(0x7f8da006fc90 0x7f8da00d1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:12.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.674+0000 7f8da5800640 1 --2- 172.21.15.122:0/3063156979 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8da00b0a60 0x7f8da0072f20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8d94009870 tx=0x7f8d9401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1f39eacfaa21eea server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:12.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.674+0000 7f8d9fe00640 1 -- 172.21.15.122:0/3063156979 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d940b2070 con 0x7f8da00b0a60 2024-05-28T06:12:12.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.674+0000 7f8d9fe00640 1 -- 172.21.15.122:0/3063156979 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d940a9070 con 0x7f8da00b0a60 2024-05-28T06:12:12.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.674+0000 7f8d9fe00640 1 -- 172.21.15.122:0/3063156979 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d940ad880 con 0x7f8da00b0a60 2024-05-28T06:12:12.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.674+0000 7f8da8200640 1 -- 172.21.15.122:0/3063156979 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8da00b0a60 msgr2=0x7f8da0072f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:12.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.674+0000 7f8da8200640 1 --2- 172.21.15.122:0/3063156979 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8da00b0a60 0x7f8da0072f20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8d94009870 tx=0x7f8d9401c560 comp rx=0 tx=0).stop 2024-05-28T06:12:12.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.674+0000 7f8da8200640 1 -- 172.21.15.122:0/3063156979 shutdown_connections 2024-05-28T06:12:12.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.674+0000 7f8da8200640 1 --2- 172.21.15.122:0/3063156979 >> v2:172.21.15.122:3300/0 conn(0x7f8da006fc90 0x7f8da00d1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:12.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.674+0000 7f8da8200640 1 --2- 172.21.15.122:0/3063156979 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8da00b0a60 0x7f8da0072f20 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8d94009870 tx=0x7f8d9401c560 comp rx=0 tx=0).stop 2024-05-28T06:12:12.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.674+0000 7f8da8200640 1 -- 172.21.15.122:0/3063156979 >> 172.21.15.122:0/3063156979 conn(0x7f8da00b6d30 msgr2=0x7f8da00b7140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:12.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.674+0000 7f8da8200640 1 -- 172.21.15.122:0/3063156979 shutdown_connections 2024-05-28T06:12:12.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.674+0000 7f8da8200640 1 -- 172.21.15.122:0/3063156979 wait complete. 2024-05-28T06:12:12.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.678+0000 7f8da8200640 1 Processor -- start 2024-05-28T06:12:12.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.678+0000 7f8da8200640 1 -- start start 2024-05-28T06:12:12.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.678+0000 7f8da8200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8da006fc90 0x7f8da015e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:12.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.678+0000 7f8da8200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8da00b0e40 0x7f8da014a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:12.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.678+0000 7f8da8200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8da0144100 0x7f8da0160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:12.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.678+0000 7f8da8200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8da01626f0 con 0x7f8da006fc90 2024-05-28T06:12:12.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.678+0000 7f8da8200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8da0162570 con 0x7f8da00b0e40 2024-05-28T06:12:12.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.678+0000 7f8da8200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8da0162870 con 0x7f8da0144100 2024-05-28T06:12:12.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.678+0000 7f8da5800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8da006fc90 0x7f8da015e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:12.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.678+0000 7f8da4e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8da00b0e40 0x7f8da014a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:12.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.678+0000 7f8da5800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8da006fc90 0x7f8da015e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43928/0 (socket says 172.21.15.122:43928) 2024-05-28T06:12:12.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.678+0000 7f8da5800640 1 -- 172.21.15.122:0/1015298321 learned_addr learned my addr 172.21.15.122:0/1015298321 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:12.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.678+0000 7f8da6200640 1 --2- 172.21.15.122:0/1015298321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8da0144100 0x7f8da0160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:12.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.678+0000 7f8da5800640 1 -- 172.21.15.122:0/1015298321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8da0144100 msgr2=0x7f8da0160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:12.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.678+0000 7f8da5800640 1 --2- 172.21.15.122:0/1015298321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8da0144100 0x7f8da0160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:12.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.678+0000 7f8da5800640 1 -- 172.21.15.122:0/1015298321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8da00b0e40 msgr2=0x7f8da014a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:12.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.678+0000 7f8da5800640 1 --2- 172.21.15.122:0/1015298321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8da00b0e40 0x7f8da014a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:12.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.678+0000 7f8da5800640 1 -- 172.21.15.122:0/1015298321 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da0144580 con 0x7f8da006fc90 2024-05-28T06:12:12.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.682+0000 7f8da5800640 1 --2- 172.21.15.122:0/1015298321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8da006fc90 0x7f8da015e770 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8d94019170 tx=0x7f8d9401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:12.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.682+0000 7f8d9d600640 1 -- 172.21.15.122:0/1015298321 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d940b2040 con 0x7f8da006fc90 2024-05-28T06:12:12.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.682+0000 7f8da8200640 1 -- 172.21.15.122:0/1015298321 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da0144860 con 0x7f8da006fc90 2024-05-28T06:12:12.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.682+0000 7f8d9d600640 1 -- 172.21.15.122:0/1015298321 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d940be070 con 0x7f8da006fc90 2024-05-28T06:12:12.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.682+0000 7f8d9d600640 1 -- 172.21.15.122:0/1015298321 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d940b8660 con 0x7f8da006fc90 2024-05-28T06:12:12.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.682+0000 7f8da8200640 1 -- 172.21.15.122:0/1015298321 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da0144e20 con 0x7f8da006fc90 2024-05-28T06:12:12.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.682+0000 7f8da8200640 1 -- 172.21.15.122:0/1015298321 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d7c0052a0 con 0x7f8da006fc90 2024-05-28T06:12:12.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.686+0000 7f8d9d600640 1 -- 172.21.15.122:0/1015298321 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f8d940ab070 con 0x7f8da006fc90 2024-05-28T06:12:12.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.686+0000 7f8d9d600640 1 --2- 172.21.15.122:0/1015298321 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8d80068df0 0x7f8d8006b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:12.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.686+0000 7f8d9d600640 1 -- 172.21.15.122:0/1015298321 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7f8d940b8420 con 0x7f8da006fc90 2024-05-28T06:12:12.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.686+0000 7f8da4e00640 1 --2- 172.21.15.122:0/1015298321 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8d80068df0 0x7f8d8006b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:12.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.686+0000 7f8da4e00640 1 --2- 172.21.15.122:0/1015298321 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8d80068df0 0x7f8d8006b2b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8da00b09a0 tx=0x7f8d8c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:12.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.694+0000 7f8d9d600640 1 -- 172.21.15.122:0/1015298321 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8d94016150 con 0x7f8da006fc90 2024-05-28T06:12:12.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.986+0000 7f8da8200640 1 -- 172.21.15.122:0/1015298321 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8d7c005860 con 0x7f8da006fc90 2024-05-28T06:12:12.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.990+0000 7f8d9d600640 1 -- 172.21.15.122:0/1015298321 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) ==== 93+0+10 (secure 0 0 0) 0x7f8d940f1440 con 0x7f8da006fc90 2024-05-28T06:12:12.989 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:12:12.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.990+0000 7f8da8200640 1 -- 172.21.15.122:0/1015298321 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8d80068df0 msgr2=0x7f8d8006b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:12.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.990+0000 7f8da8200640 1 --2- 172.21.15.122:0/1015298321 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8d80068df0 0x7f8d8006b2b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8da00b09a0 tx=0x7f8d8c009040 comp rx=0 tx=0).stop 2024-05-28T06:12:12.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.990+0000 7f8da8200640 1 -- 172.21.15.122:0/1015298321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8da006fc90 msgr2=0x7f8da015e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:12.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.990+0000 7f8da8200640 1 --2- 172.21.15.122:0/1015298321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8da006fc90 0x7f8da015e770 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8d94019170 tx=0x7f8d9401ada0 comp rx=0 tx=0).stop 2024-05-28T06:12:12.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.994+0000 7f8da8200640 1 -- 172.21.15.122:0/1015298321 shutdown_connections 2024-05-28T06:12:12.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.994+0000 7f8da8200640 1 --2- 172.21.15.122:0/1015298321 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8d80068df0 0x7f8d8006b2b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:12.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.994+0000 7f8da8200640 1 --2- 172.21.15.122:0/1015298321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8da0144100 0x7f8da0160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:12.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.994+0000 7f8da8200640 1 --2- 172.21.15.122:0/1015298321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8da00b0e40 0x7f8da014a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:12.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.994+0000 7f8da8200640 1 --2- 172.21.15.122:0/1015298321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8da006fc90 0x7f8da015e770 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:12.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.994+0000 7f8da8200640 1 -- 172.21.15.122:0/1015298321 >> 172.21.15.122:0/1015298321 conn(0x7f8da00b6d30 msgr2=0x7f8da0074d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:12.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.994+0000 7f8da8200640 1 -- 172.21.15.122:0/1015298321 shutdown_connections 2024-05-28T06:12:12.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:12.994+0000 7f8da8200640 1 -- 172.21.15.122:0/1015298321 wait complete. 2024-05-28T06:12:13.026 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-28T06:12:13.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.262+0000 7fbafd800640 1 Processor -- start 2024-05-28T06:12:13.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.262+0000 7fbafd800640 1 -- start start 2024-05-28T06:12:13.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.266+0000 7fbafd800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbaf80c55e0 0x7fbaf8163ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:13.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.266+0000 7fbafd800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaf80b27d0 0x7fbaf809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:13.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.266+0000 7fbafd800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaf80b2010 con 0x7fbaf80b3670 2024-05-28T06:12:13.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.266+0000 7fbafd800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fbaf806cc20 con 0x7fbaf80c55e0 2024-05-28T06:12:13.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.266+0000 7fbafd800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf806cf00 con 0x7fbaf80b27d0 2024-05-28T06:12:13.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.266+0000 7fbaf6000640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fbaf80b3670 0x7fbaf80c59c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:34832/0 (socket says 172.21.15.122:34832) 2024-05-28T06:12:13.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.266+0000 7fbaf6000640 1 -- 172.21.15.122:0/2362319251 learned_addr learned my addr 172.21.15.122:0/2362319251 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:13.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.266+0000 7fbaf6a00640 1 --2- 172.21.15.122:0/2362319251 >> v2:172.21.15.153:3300/0 conn(0x7fbaf80c55e0 0x7fbaf8163ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:13.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.266+0000 7fbaf7400640 1 --2- 172.21.15.122:0/2362319251 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaf80b27d0 0x7fbaf809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:13.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.266+0000 7fbaf6a00640 1 -- 172.21.15.122:0/2362319251 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaf80b27d0 msgr2=0x7fbaf809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:13.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.266+0000 7fbaf6a00640 1 --2- 172.21.15.122:0/2362319251 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaf80b27d0 0x7fbaf809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:13.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.266+0000 7fbaf6a00640 1 -- 172.21.15.122:0/2362319251 >> v1:172.21.15.122:6789/0 conn(0x7fbaf80b3670 legacy=0x7fbaf80c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:13.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.266+0000 7fbaf5600640 1 -- 172.21.15.122:0/2362319251 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 907655115 0 0) 0x7fbaf80b2010 con 0x7fbaf80b3670 2024-05-28T06:12:13.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.266+0000 7fbaf6a00640 1 -- 172.21.15.122:0/2362319251 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf806d1e0 con 0x7fbaf80c55e0 2024-05-28T06:12:13.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.270+0000 7fbaf6a00640 1 --2- 172.21.15.122:0/2362319251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaf80c55e0 0x7fbaf8163ec0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbae80097c0 tx=0x7fbae801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca8977f2642123d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:13.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.274+0000 7fbaf5600640 1 -- 172.21.15.122:0/2362319251 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae80b0070 con 0x7fbaf80c55e0 2024-05-28T06:12:13.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.274+0000 7fbaf5600640 1 -- 172.21.15.122:0/2362319251 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae80ab600 con 0x7fbaf80c55e0 2024-05-28T06:12:13.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.274+0000 7fbaf5600640 1 -- 172.21.15.122:0/2362319251 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae80ab9d0 con 0x7fbaf80c55e0 2024-05-28T06:12:13.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.274+0000 7fbafd800640 1 -- 172.21.15.122:0/2362319251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaf80c55e0 msgr2=0x7fbaf8163ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:13.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.274+0000 7fbafd800640 1 --2- 172.21.15.122:0/2362319251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaf80c55e0 0x7fbaf8163ec0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbae80097c0 tx=0x7fbae801c4a0 comp rx=0 tx=0).stop 2024-05-28T06:12:13.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.274+0000 7fbafd800640 1 -- 172.21.15.122:0/2362319251 shutdown_connections 2024-05-28T06:12:13.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.274+0000 7fbafd800640 1 --2- 172.21.15.122:0/2362319251 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaf80b27d0 0x7fbaf809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:13.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.274+0000 7fbafd800640 1 --2- 172.21.15.122:0/2362319251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaf80c55e0 0x7fbaf8163ec0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:13.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.274+0000 7fbafd800640 1 -- 172.21.15.122:0/2362319251 >> 172.21.15.122:0/2362319251 conn(0x7fbaf80b4100 msgr2=0x7fbaf80b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:13.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.274+0000 7fbafd800640 1 -- 172.21.15.122:0/2362319251 shutdown_connections 2024-05-28T06:12:13.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.274+0000 7fbafd800640 1 -- 172.21.15.122:0/2362319251 wait complete. 2024-05-28T06:12:13.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.274+0000 7fbafd800640 1 Processor -- start 2024-05-28T06:12:13.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.278+0000 7fbafd800640 1 -- start start 2024-05-28T06:12:13.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.278+0000 7fbafd800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaf80b27d0 0x7fbaf815ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:13.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.278+0000 7fbafd800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaf80b3670 0x7fbaf80c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:13.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.278+0000 7fbafd800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbaf80c55e0 0x7fbaf80cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:13.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.278+0000 7fbaf6a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaf80b27d0 0x7fbaf815ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:13.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.278+0000 7fbaf6a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaf80b27d0 0x7fbaf815ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:37946/0 (socket says 172.21.15.122:37946) 2024-05-28T06:12:13.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.278+0000 7fbaf6a00640 1 -- 172.21.15.122:0/3245887418 learned_addr learned my addr 172.21.15.122:0/3245887418 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:13.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.278+0000 7fbafd800640 1 -- 172.21.15.122:0/3245887418 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf8170740 con 0x7fbaf80c55e0 2024-05-28T06:12:13.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.278+0000 7fbafd800640 1 -- 172.21.15.122:0/3245887418 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf81705c0 con 0x7fbaf80b3670 2024-05-28T06:12:13.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.278+0000 7fbafd800640 1 -- 172.21.15.122:0/3245887418 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf81708c0 con 0x7fbaf80b27d0 2024-05-28T06:12:13.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.278+0000 7fbaf6000640 1 --2- 172.21.15.122:0/3245887418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaf80b3670 0x7fbaf80c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:13.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.282+0000 7fbaf7400640 1 --2- 172.21.15.122:0/3245887418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbaf80c55e0 0x7fbaf80cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:13.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.282+0000 7fbaf6a00640 1 -- 172.21.15.122:0/3245887418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaf80b3670 msgr2=0x7fbaf80c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:13.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.282+0000 7fbaf6a00640 1 --2- 172.21.15.122:0/3245887418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaf80b3670 0x7fbaf80c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:13.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.282+0000 7fbaf6a00640 1 -- 172.21.15.122:0/3245887418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbaf80c55e0 msgr2=0x7fbaf80cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:13.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.282+0000 7fbaf6a00640 1 --2- 172.21.15.122:0/3245887418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbaf80c55e0 0x7fbaf80cca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:13.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.282+0000 7fbaf6a00640 1 -- 172.21.15.122:0/3245887418 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf81537b0 con 0x7fbaf80b27d0 2024-05-28T06:12:13.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.282+0000 7fbaf6a00640 1 --2- 172.21.15.122:0/3245887418 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaf80b27d0 0x7fbaf815ce20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbae80190b0 tx=0x7fbae8019240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:13.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.282+0000 7fbaeea00640 1 -- 172.21.15.122:0/3245887418 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae80b9020 con 0x7fbaf80b27d0 2024-05-28T06:12:13.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.282+0000 7fbaeea00640 1 -- 172.21.15.122:0/3245887418 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae80b5890 con 0x7fbaf80b27d0 2024-05-28T06:12:13.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.282+0000 7fbaeea00640 1 -- 172.21.15.122:0/3245887418 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae80b0040 con 0x7fbaf80b27d0 2024-05-28T06:12:13.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.282+0000 7fbafd800640 1 -- 172.21.15.122:0/3245887418 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf80cb170 con 0x7fbaf80b27d0 2024-05-28T06:12:13.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.282+0000 7fbafd800640 1 -- 172.21.15.122:0/3245887418 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf80ca3b0 con 0x7fbaf80b27d0 2024-05-28T06:12:13.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.282+0000 7fbafd800640 1 -- 172.21.15.122:0/3245887418 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf8068c40 con 0x7fbaf80b27d0 2024-05-28T06:12:13.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.286+0000 7fbaeea00640 1 -- 172.21.15.122:0/3245887418 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fbae80bc020 con 0x7fbaf80b27d0 2024-05-28T06:12:13.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.286+0000 7fbaeea00640 1 --2- 172.21.15.122:0/3245887418 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fbad8068cf0 0x7fbad806b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:13.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.286+0000 7fbaeea00640 1 -- 172.21.15.122:0/3245887418 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7fbae8121620 con 0x7fbaf80b27d0 2024-05-28T06:12:13.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.286+0000 7fbaf6000640 1 --2- 172.21.15.122:0/3245887418 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fbad8068cf0 0x7fbad806b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:13.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.290+0000 7fbaf6000640 1 --2- 172.21.15.122:0/3245887418 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fbad8068cf0 0x7fbad806b1b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbaf815d360 tx=0x7fbae4007240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:13.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.294+0000 7fbaeea00640 1 -- 172.21.15.122:0/3245887418 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbaf81537b0 con 0x7fbaf80b27d0 2024-05-28T06:12:13.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.642+0000 7fbafd800640 1 -- 172.21.15.122:0/3245887418 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbaf809bd00 con 0x7fbaf80b27d0 2024-05-28T06:12:13.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.642+0000 7fbaeea00640 1 -- 172.21.15.122:0/3245887418 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) ==== 104+0+11 (secure 0 0 0) 0x7fbae80160b0 con 0x7fbaf80b27d0 2024-05-28T06:12:13.642 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 32 2024-05-28T06:12:13.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.646+0000 7fbafd800640 1 -- 172.21.15.122:0/3245887418 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fbad8068cf0 msgr2=0x7fbad806b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:13.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.646+0000 7fbafd800640 1 --2- 172.21.15.122:0/3245887418 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fbad8068cf0 0x7fbad806b1b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbaf815d360 tx=0x7fbae4007240 comp rx=0 tx=0).stop 2024-05-28T06:12:13.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.646+0000 7fbafd800640 1 -- 172.21.15.122:0/3245887418 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaf80b27d0 msgr2=0x7fbaf815ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:13.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.646+0000 7fbafd800640 1 --2- 172.21.15.122:0/3245887418 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaf80b27d0 0x7fbaf815ce20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbae80190b0 tx=0x7fbae8019240 comp rx=0 tx=0).stop 2024-05-28T06:12:13.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.646+0000 7fbafd800640 1 -- 172.21.15.122:0/3245887418 shutdown_connections 2024-05-28T06:12:13.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.646+0000 7fbafd800640 1 --2- 172.21.15.122:0/3245887418 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fbad8068cf0 0x7fbad806b1b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:13.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.646+0000 7fbafd800640 1 --2- 172.21.15.122:0/3245887418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbaf80c55e0 0x7fbaf80cca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:13.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.646+0000 7fbafd800640 1 --2- 172.21.15.122:0/3245887418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaf80b3670 0x7fbaf80c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:13.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.646+0000 7fbafd800640 1 --2- 172.21.15.122:0/3245887418 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbaf80b27d0 0x7fbaf815ce20 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbae80190b0 tx=0x7fbae8019240 comp rx=0 tx=0).stop 2024-05-28T06:12:13.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.646+0000 7fbafd800640 1 -- 172.21.15.122:0/3245887418 >> 172.21.15.122:0/3245887418 conn(0x7fbaf80b4100 msgr2=0x7fbaf80c59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:13.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.646+0000 7fbafd800640 1 -- 172.21.15.122:0/3245887418 shutdown_connections 2024-05-28T06:12:13.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.646+0000 7fbafd800640 1 -- 172.21.15.122:0/3245887418 wait complete. 2024-05-28T06:12:13.676 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-28T06:12:13.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.918+0000 7f06cc200640 1 Processor -- start 2024-05-28T06:12:13.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.918+0000 7f06cc200640 1 -- start start 2024-05-28T06:12:13.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.918+0000 7f06cc200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f06c40c55e0 0x7f06c4163ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:13.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.918+0000 7f06cc200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f06c40b27d0 0x7f06c409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:13.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.918+0000 7f06cc200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06c40b2010 con 0x7f06c40b3670 2024-05-28T06:12:13.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.918+0000 7f06cc200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f06c406cc20 con 0x7f06c40b27d0 2024-05-28T06:12:13.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.918+0000 7f06cc200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f06c406cf00 con 0x7f06c40c55e0 2024-05-28T06:12:13.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.918+0000 7f06c9800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f06c40c55e0 0x7f06c4163ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:13.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.918+0000 7f06c9800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f06c40c55e0 0x7f06c4163ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:42714/0 (socket says 172.21.15.122:42714) 2024-05-28T06:12:13.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.918+0000 7f06c9800640 1 -- 172.21.15.122:0/1009168807 learned_addr learned my addr 172.21.15.122:0/1009168807 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:13.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.918+0000 7f06ca200640 1 --2- 172.21.15.122:0/1009168807 >> v2:172.21.15.122:3300/0 conn(0x7f06c40b27d0 0x7f06c409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:13.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.918+0000 7f06c9800640 1 -- 172.21.15.122:0/1009168807 >> v2:172.21.15.122:3300/0 conn(0x7f06c40b27d0 msgr2=0x7f06c409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:13.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.918+0000 7f06c9800640 1 --2- 172.21.15.122:0/1009168807 >> v2:172.21.15.122:3300/0 conn(0x7f06c40b27d0 0x7f06c409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:13.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.918+0000 7f06c9800640 1 -- 172.21.15.122:0/1009168807 >> v1:172.21.15.153:6789/0 conn(0x7f06c40b3670 legacy=0x7f06c40c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:13.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.918+0000 7f06c9800640 1 -- 172.21.15.122:0/1009168807 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c406d1e0 con 0x7f06c40c55e0 2024-05-28T06:12:13.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.926+0000 7f06c9800640 1 --2- 172.21.15.122:0/1009168807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c40c55e0 0x7f06c4163ec0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f06c4073270 tx=0x7f06b801c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70812b389e76237a server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:13.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.926+0000 7f06c3e00640 1 -- 172.21.15.122:0/1009168807 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b80b0070 con 0x7f06c40c55e0 2024-05-28T06:12:13.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.926+0000 7f06c3e00640 1 -- 172.21.15.122:0/1009168807 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06b80ab600 con 0x7f06c40c55e0 2024-05-28T06:12:13.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.926+0000 7f06c3e00640 1 -- 172.21.15.122:0/1009168807 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b80ab9d0 con 0x7f06c40c55e0 2024-05-28T06:12:13.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.926+0000 7f06cc200640 1 -- 172.21.15.122:0/1009168807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c40c55e0 msgr2=0x7f06c4163ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:13.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.926+0000 7f06cc200640 1 --2- 172.21.15.122:0/1009168807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c40c55e0 0x7f06c4163ec0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f06c4073270 tx=0x7f06b801c4e0 comp rx=0 tx=0).stop 2024-05-28T06:12:13.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.926+0000 7f06cc200640 1 -- 172.21.15.122:0/1009168807 shutdown_connections 2024-05-28T06:12:13.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.926+0000 7f06cc200640 1 --2- 172.21.15.122:0/1009168807 >> v2:172.21.15.122:3300/0 conn(0x7f06c40b27d0 0x7f06c409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:13.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.926+0000 7f06cc200640 1 --2- 172.21.15.122:0/1009168807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c40c55e0 0x7f06c4163ec0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:13.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.926+0000 7f06cc200640 1 -- 172.21.15.122:0/1009168807 >> 172.21.15.122:0/1009168807 conn(0x7f06c40b4100 msgr2=0x7f06c40b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:13.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.926+0000 7f06cc200640 1 -- 172.21.15.122:0/1009168807 shutdown_connections 2024-05-28T06:12:13.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.926+0000 7f06cc200640 1 -- 172.21.15.122:0/1009168807 wait complete. 2024-05-28T06:12:13.929 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.930+0000 7f06cc200640 1 Processor -- start 2024-05-28T06:12:13.930 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.930+0000 7f06cc200640 1 -- start start 2024-05-28T06:12:13.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.930+0000 7f06cc200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06c40b27d0 0x7f06c40cae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:13.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.930+0000 7f06cc200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c40b3670 0x7f06c40c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:13.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.930+0000 7f06cc200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06c40c55e0 0x7f06c4158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:13.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.930+0000 7f06cc200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f06c4170740 con 0x7f06c40c55e0 2024-05-28T06:12:13.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.930+0000 7f06cc200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f06c41705c0 con 0x7f06c40b3670 2024-05-28T06:12:13.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.930+0000 7f06cc200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f06c41708c0 con 0x7f06c40b27d0 2024-05-28T06:12:13.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.934+0000 7f06c9800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06c40b27d0 0x7f06c40cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:13.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.934+0000 7f06c9800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06c40b27d0 0x7f06c40cae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:37958/0 (socket says 172.21.15.122:37958) 2024-05-28T06:12:13.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.934+0000 7f06c9800640 1 -- 172.21.15.122:0/634788301 learned_addr learned my addr 172.21.15.122:0/634788301 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:13.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.934+0000 7f06c8e00640 1 --2- 172.21.15.122:0/634788301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c40b3670 0x7f06c40c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:13.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.934+0000 7f06ca200640 1 --2- 172.21.15.122:0/634788301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06c40c55e0 0x7f06c4158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:13.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.934+0000 7f06c8e00640 1 -- 172.21.15.122:0/634788301 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06c40b27d0 msgr2=0x7f06c40cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:13.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.934+0000 7f06c8e00640 1 --2- 172.21.15.122:0/634788301 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06c40b27d0 0x7f06c40cae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:13.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.934+0000 7f06c8e00640 1 -- 172.21.15.122:0/634788301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06c40c55e0 msgr2=0x7f06c4158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:13.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.934+0000 7f06c8e00640 1 --2- 172.21.15.122:0/634788301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06c40c55e0 0x7f06c4158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:13.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.934+0000 7f06c8e00640 1 -- 172.21.15.122:0/634788301 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c40cb4b0 con 0x7f06c40b3670 2024-05-28T06:12:13.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.934+0000 7f06c8e00640 1 --2- 172.21.15.122:0/634788301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c40b3670 0x7f06c40c8c90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f06b000c410 tx=0x7f06b000c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:13.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.934+0000 7f06c1600640 1 -- 172.21.15.122:0/634788301 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b0017070 con 0x7f06c40b3670 2024-05-28T06:12:13.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.934+0000 7f06c1600640 1 -- 172.21.15.122:0/634788301 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06b00069e0 con 0x7f06c40b3670 2024-05-28T06:12:13.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.934+0000 7f06c1600640 1 -- 172.21.15.122:0/634788301 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b0006db0 con 0x7f06c40b3670 2024-05-28T06:12:13.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.934+0000 7f06cc200640 1 -- 172.21.15.122:0/634788301 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06c40cb790 con 0x7f06c40b3670 2024-05-28T06:12:13.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.938+0000 7f06cc200640 1 -- 172.21.15.122:0/634788301 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06c41593f0 con 0x7f06c40b3670 2024-05-28T06:12:13.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.938+0000 7f06cc200640 1 -- 172.21.15.122:0/634788301 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06c4068c40 con 0x7f06c40b3670 2024-05-28T06:12:13.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.938+0000 7f06c1600640 1 -- 172.21.15.122:0/634788301 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f06b001a070 con 0x7f06c40b3670 2024-05-28T06:12:13.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.942+0000 7f06c1600640 1 --2- 172.21.15.122:0/634788301 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f06a4068cc0 0x7f06a406b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:13.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.942+0000 7f06c1600640 1 -- 172.21.15.122:0/634788301 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7f06b00875c0 con 0x7f06c40b3670 2024-05-28T06:12:13.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.942+0000 7f06c9800640 1 --2- 172.21.15.122:0/634788301 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f06a4068cc0 0x7f06a406b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:13.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.942+0000 7f06c9800640 1 --2- 172.21.15.122:0/634788301 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f06a4068cc0 0x7f06a406b180 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f06b801c520 tx=0x7f06b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:13.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:13.950+0000 7f06c1600640 1 -- 172.21.15.122:0/634788301 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f06b00566e0 con 0x7f06c40b3670 2024-05-28T06:12:14.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.258+0000 7f06cc200640 1 -- 172.21.15.122:0/634788301 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f06c41678d0 con 0x7f06c40b3670 2024-05-28T06:12:14.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.262+0000 7f06c1600640 1 -- 172.21.15.122:0/634788301 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) ==== 100+0+11 (secure 0 0 0) 0x7f06b005a9e0 con 0x7f06c40b3670 2024-05-28T06:12:14.262 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 64 2024-05-28T06:12:14.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.266+0000 7f06cc200640 1 -- 172.21.15.122:0/634788301 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f06a4068cc0 msgr2=0x7f06a406b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:14.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.266+0000 7f06cc200640 1 --2- 172.21.15.122:0/634788301 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f06a4068cc0 0x7f06a406b180 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f06b801c520 tx=0x7f06b8008040 comp rx=0 tx=0).stop 2024-05-28T06:12:14.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.266+0000 7f06cc200640 1 -- 172.21.15.122:0/634788301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c40b3670 msgr2=0x7f06c40c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:14.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.266+0000 7f06cc200640 1 --2- 172.21.15.122:0/634788301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c40b3670 0x7f06c40c8c90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f06b000c410 tx=0x7f06b000c8d0 comp rx=0 tx=0).stop 2024-05-28T06:12:14.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.266+0000 7f06cc200640 1 -- 172.21.15.122:0/634788301 shutdown_connections 2024-05-28T06:12:14.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.266+0000 7f06cc200640 1 --2- 172.21.15.122:0/634788301 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f06a4068cc0 0x7f06a406b180 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:14.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.266+0000 7f06cc200640 1 --2- 172.21.15.122:0/634788301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06c40c55e0 0x7f06c4158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:14.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.266+0000 7f06cc200640 1 --2- 172.21.15.122:0/634788301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06c40b3670 0x7f06c40c8c90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:14.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.266+0000 7f06cc200640 1 --2- 172.21.15.122:0/634788301 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06c40b27d0 0x7f06c40cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:14.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.266+0000 7f06cc200640 1 -- 172.21.15.122:0/634788301 >> 172.21.15.122:0/634788301 conn(0x7f06c40b4100 msgr2=0x7f06c40af2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:14.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.266+0000 7f06cc200640 1 -- 172.21.15.122:0/634788301 shutdown_connections 2024-05-28T06:12:14.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.266+0000 7f06cc200640 1 -- 172.21.15.122:0/634788301 wait complete. 2024-05-28T06:12:14.289 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-28T06:12:14.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.430+0000 7f1034000640 1 Processor -- start 2024-05-28T06:12:14.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.430+0000 7f1034000640 1 -- start start 2024-05-28T06:12:14.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.430+0000 7f1034000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f102c142d30 0x7f102c06f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:14.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.430+0000 7f1034000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f102c06f610 0x7f102c145b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:14.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.430+0000 7f1034000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f102c06e030 con 0x7f102c1460c0 2024-05-28T06:12:14.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.430+0000 7f1034000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f102c06ec40 con 0x7f102c06f610 2024-05-28T06:12:14.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.430+0000 7f1034000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f102c06e310 con 0x7f102c142d30 2024-05-28T06:12:14.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.430+0000 7f1030c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f102c06f610 0x7f102c145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:14.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.430+0000 7f1030c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f102c06f610 0x7f102c145b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43958/0 (socket says 172.21.15.122:43958) 2024-05-28T06:12:14.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.430+0000 7f1030c00640 1 -- 172.21.15.122:0/4081035358 learned_addr learned my addr 172.21.15.122:0/4081035358 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:14.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.430+0000 7f1031600640 1 --2- 172.21.15.122:0/4081035358 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f102c142d30 0x7f102c06f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:14.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.430+0000 7f1030c00640 1 -- 172.21.15.122:0/4081035358 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f102c142d30 msgr2=0x7f102c06f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:14.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.430+0000 7f1030c00640 1 --2- 172.21.15.122:0/4081035358 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f102c142d30 0x7f102c06f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:14.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.430+0000 7f1030c00640 1 -- 172.21.15.122:0/4081035358 >> v1:172.21.15.122:6789/0 conn(0x7f102c1460c0 legacy=0x7f102c0ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:14.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.430+0000 7f1030c00640 1 -- 172.21.15.122:0/4081035358 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f102c06e5f0 con 0x7f102c06f610 2024-05-28T06:12:14.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.434+0000 7f1030c00640 1 --2- 172.21.15.122:0/4081035358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f102c06f610 0x7f102c145b80 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f102c06edc0 tx=0x7f101801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49cf8e2c0bc0ef07 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:14.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.434+0000 7f102be00640 1 -- 172.21.15.122:0/4081035358 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10180aa610 con 0x7f102c06f610 2024-05-28T06:12:14.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.434+0000 7f102be00640 1 -- 172.21.15.122:0/4081035358 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10180af070 con 0x7f102c06f610 2024-05-28T06:12:14.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.434+0000 7f102be00640 1 -- 172.21.15.122:0/4081035358 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10180aa9d0 con 0x7f102c06f610 2024-05-28T06:12:14.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.434+0000 7f1034000640 1 -- 172.21.15.122:0/4081035358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f102c06f610 msgr2=0x7f102c145b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:14.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.434+0000 7f1034000640 1 --2- 172.21.15.122:0/4081035358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f102c06f610 0x7f102c145b80 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f102c06edc0 tx=0x7f101801c4d0 comp rx=0 tx=0).stop 2024-05-28T06:12:14.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.434+0000 7f1034000640 1 -- 172.21.15.122:0/4081035358 shutdown_connections 2024-05-28T06:12:14.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.434+0000 7f1034000640 1 --2- 172.21.15.122:0/4081035358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f102c06f610 0x7f102c145b80 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:14.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.434+0000 7f1034000640 1 --2- 172.21.15.122:0/4081035358 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f102c142d30 0x7f102c06f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:14.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.434+0000 7f1034000640 1 -- 172.21.15.122:0/4081035358 >> 172.21.15.122:0/4081035358 conn(0x7f102c062a40 msgr2=0x7f102c06b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:14.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.434+0000 7f1034000640 1 -- 172.21.15.122:0/4081035358 shutdown_connections 2024-05-28T06:12:14.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.434+0000 7f1034000640 1 -- 172.21.15.122:0/4081035358 wait complete. 2024-05-28T06:12:14.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.434+0000 7f1034000640 1 Processor -- start 2024-05-28T06:12:14.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.434+0000 7f1034000640 1 -- start start 2024-05-28T06:12:14.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.438+0000 7f1034000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f102c142d30 0x7f102c13c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:14.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.438+0000 7f1034000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f102c1460c0 0x7f102c15ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:14.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.438+0000 7f1034000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f102c13cc00 0x7f102c15f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:14.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.438+0000 7f1034000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f102c143290 con 0x7f102c13cc00 2024-05-28T06:12:14.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.438+0000 7f1034000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f102c143110 con 0x7f102c142d30 2024-05-28T06:12:14.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.438+0000 7f1034000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f102c0cec70 con 0x7f102c1460c0 2024-05-28T06:12:14.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.438+0000 7f1030c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f102c1460c0 0x7f102c15ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:14.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.438+0000 7f1031600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f102c142d30 0x7f102c13c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:14.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.438+0000 7f1030c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f102c1460c0 0x7f102c15ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:37974/0 (socket says 172.21.15.122:37974) 2024-05-28T06:12:14.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.438+0000 7f1030c00640 1 -- 172.21.15.122:0/556744228 learned_addr learned my addr 172.21.15.122:0/556744228 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:14.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.438+0000 7f1030c00640 1 -- 172.21.15.122:0/556744228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f102c142d30 msgr2=0x7f102c13c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:14.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.438+0000 7f1030c00640 1 --2- 172.21.15.122:0/556744228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f102c142d30 0x7f102c13c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:14.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.438+0000 7f1030c00640 1 -- 172.21.15.122:0/556744228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f102c13cc00 msgr2=0x7f102c15f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:14.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.438+0000 7f1030c00640 1 --2- 172.21.15.122:0/556744228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f102c13cc00 0x7f102c15f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:14.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.438+0000 7f1030c00640 1 -- 172.21.15.122:0/556744228 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f102c15fbb0 con 0x7f102c1460c0 2024-05-28T06:12:14.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.438+0000 7f1031600640 1 --2- 172.21.15.122:0/556744228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f102c142d30 0x7f102c13c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:12:14.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.438+0000 7f1030c00640 1 --2- 172.21.15.122:0/556744228 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f102c1460c0 0x7f102c15ee10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f101801ab80 tx=0x7f101801ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:14.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.438+0000 7f1029600640 1 -- 172.21.15.122:0/556744228 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10180bd5f0 con 0x7f102c1460c0 2024-05-28T06:12:14.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.438+0000 7f1029600640 1 -- 172.21.15.122:0/556744228 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10180bd790 con 0x7f102c1460c0 2024-05-28T06:12:14.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.438+0000 7f1029600640 1 -- 172.21.15.122:0/556744228 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10180bdb40 con 0x7f102c1460c0 2024-05-28T06:12:14.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.438+0000 7f1034000640 1 -- 172.21.15.122:0/556744228 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f102c15fe90 con 0x7f102c1460c0 2024-05-28T06:12:14.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.438+0000 7f1034000640 1 -- 172.21.15.122:0/556744228 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f102c160450 con 0x7f102c1460c0 2024-05-28T06:12:14.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.438+0000 7f1034000640 1 -- 172.21.15.122:0/556744228 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f102c068bd0 con 0x7f102c1460c0 2024-05-28T06:12:14.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.442+0000 7f1029600640 1 -- 172.21.15.122:0/556744228 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f10180b33f0 con 0x7f102c1460c0 2024-05-28T06:12:14.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.442+0000 7f1029600640 1 --2- 172.21.15.122:0/556744228 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f100c068bf0 0x7f100c06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:14.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.442+0000 7f1029600640 1 -- 172.21.15.122:0/556744228 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7f10181224e0 con 0x7f102c1460c0 2024-05-28T06:12:14.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.442+0000 7f1031600640 1 --2- 172.21.15.122:0/556744228 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f100c068bf0 0x7f100c06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:14.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.442+0000 7f1031600640 1 --2- 172.21.15.122:0/556744228 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f100c068bf0 0x7f100c06b0b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1020009f50 tx=0x7f1020009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:14.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.446+0000 7f1029600640 1 -- 172.21.15.122:0/556744228 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f10180c3060 con 0x7f102c1460c0 2024-05-28T06:12:14.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.618+0000 7f1034000640 1 -- 172.21.15.122:0/556744228 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f102c06bac0 con 0x7f102c1460c0 2024-05-28T06:12:14.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.618+0000 7f1029600640 1 -- 172.21.15.122:0/556744228 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v49) ==== 80+0+0 (secure 0 0 0) 0x7f10180a7070 con 0x7f102c1460c0 2024-05-28T06:12:14.617 INFO:teuthology.orchestra.run.smithi122.stderr:listed 0 entries 2024-05-28T06:12:14.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.618+0000 7f1034000640 1 -- 172.21.15.122:0/556744228 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f100c068bf0 msgr2=0x7f100c06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:14.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.618+0000 7f1034000640 1 --2- 172.21.15.122:0/556744228 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f100c068bf0 0x7f100c06b0b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1020009f50 tx=0x7f1020009190 comp rx=0 tx=0).stop 2024-05-28T06:12:14.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.618+0000 7f1034000640 1 -- 172.21.15.122:0/556744228 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f102c1460c0 msgr2=0x7f102c15ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:14.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.618+0000 7f1034000640 1 --2- 172.21.15.122:0/556744228 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f102c1460c0 0x7f102c15ee10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f101801ab80 tx=0x7f101801ad10 comp rx=0 tx=0).stop 2024-05-28T06:12:14.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.618+0000 7f1034000640 1 -- 172.21.15.122:0/556744228 shutdown_connections 2024-05-28T06:12:14.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.618+0000 7f1034000640 1 --2- 172.21.15.122:0/556744228 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f100c068bf0 0x7f100c06b0b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:14.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.618+0000 7f1034000640 1 --2- 172.21.15.122:0/556744228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f102c13cc00 0x7f102c15f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:14.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.618+0000 7f1034000640 1 --2- 172.21.15.122:0/556744228 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f102c1460c0 0x7f102c15ee10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:14.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.618+0000 7f1034000640 1 --2- 172.21.15.122:0/556744228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f102c142d30 0x7f102c13c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:14.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.618+0000 7f1034000640 1 -- 172.21.15.122:0/556744228 >> 172.21.15.122:0/556744228 conn(0x7f102c062a40 msgr2=0x7f102c0b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:14.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.618+0000 7f1034000640 1 -- 172.21.15.122:0/556744228 shutdown_connections 2024-05-28T06:12:14.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.618+0000 7f1034000640 1 -- 172.21.15.122:0/556744228 wait complete. 2024-05-28T06:12:14.639 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-28T06:12:14.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:12:14.640 DEBUG:teuthology.orchestra.run.smithi122:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-28T06:12:14.691 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2024-05-28T06:12:14.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:12:14.691 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-28T06:12:14.708 INFO:tasks.cephfs.mount:Terminating background process 2024-05-28T06:12:14.708 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:12:14.708 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:12:14.719 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350304k,nr_inodes=4087576,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5271 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-28T06:12:14.719 INFO:tasks.cephfs.mount:Terminating background process 2024-05-28T06:12:14.719 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:12:14.719 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:12:14.764 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350136k,nr_inodes=4087534,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2578 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-28T06:12:14.764 INFO:tasks.cephfs.mount:Terminating background process 2024-05-28T06:12:14.764 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:12:14.764 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:12:14.772 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350304k,nr_inodes=4087576,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5271 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-28T06:12:14.772 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:12:14.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.946+0000 7fe2ec400640 1 Processor -- start 2024-05-28T06:12:14.947 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.946+0000 7fe2ec400640 1 -- start start 2024-05-28T06:12:14.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.946+0000 7fe2ec400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe2e415cdf0 0x7fe2e415bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:14.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.946+0000 7fe2ec400640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2e4073300 con 0x7fe2e40722f0 2024-05-28T06:12:14.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.946+0000 7fe2ec400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2e4072a60 con 0x7fe2e406f460 2024-05-28T06:12:14.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.946+0000 7fe2ec400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fe2e40cea50 con 0x7fe2e415cdf0 2024-05-28T06:12:14.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.950+0000 7fe2e9000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe2e415cdf0 0x7fe2e415bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:14.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.950+0000 7fe2ea400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fe2e40722f0 0x7fe2e40ceee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:34862/0 (socket says 172.21.15.122:34862) 2024-05-28T06:12:14.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.950+0000 7fe2ea400640 1 -- 172.21.15.122:0/4003320513 learned_addr learned my addr 172.21.15.122:0/4003320513 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:14.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.950+0000 7fe2e9000640 1 --2- 172.21.15.122:0/4003320513 >> v2:172.21.15.122:3300/0 conn(0x7fe2e415cdf0 0x7fe2e415bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43982/0 (socket says 172.21.15.122:43982) 2024-05-28T06:12:14.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.950+0000 7fe2e9000640 1 -- 172.21.15.122:0/4003320513 >> v1:172.21.15.153:6789/0 conn(0x7fe2e406f460 legacy=0x7fe2e406f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:14.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.950+0000 7fe2e9000640 1 -- 172.21.15.122:0/4003320513 >> v1:172.21.15.122:6789/0 conn(0x7fe2e40722f0 legacy=0x7fe2e40ceee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:14.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.950+0000 7fe2e9000640 1 -- 172.21.15.122:0/4003320513 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e4072d40 con 0x7fe2e415cdf0 2024-05-28T06:12:14.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.950+0000 7fe2e9000640 1 --2- 172.21.15.122:0/4003320513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2e415cdf0 0x7fe2e415bc40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00097f0 tx=0x7fe2d001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf93fe45bbe87600 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:14.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.950+0000 7fe2e3e00640 1 -- 172.21.15.122:0/4003320513 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d00b0070 con 0x7fe2e415cdf0 2024-05-28T06:12:14.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.950+0000 7fe2e3e00640 1 -- 172.21.15.122:0/4003320513 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d00ab600 con 0x7fe2e415cdf0 2024-05-28T06:12:14.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.950+0000 7fe2e3e00640 1 -- 172.21.15.122:0/4003320513 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d00ab9d0 con 0x7fe2e415cdf0 2024-05-28T06:12:14.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ec400640 1 -- 172.21.15.122:0/4003320513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2e415cdf0 msgr2=0x7fe2e415bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:14.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ec400640 1 --2- 172.21.15.122:0/4003320513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2e415cdf0 0x7fe2e415bc40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00097f0 tx=0x7fe2d001c410 comp rx=0 tx=0).stop 2024-05-28T06:12:14.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ec400640 1 -- 172.21.15.122:0/4003320513 shutdown_connections 2024-05-28T06:12:14.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ec400640 1 --2- 172.21.15.122:0/4003320513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2e415cdf0 0x7fe2e415bc40 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:14.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ec400640 1 -- 172.21.15.122:0/4003320513 >> 172.21.15.122:0/4003320513 conn(0x7fe2e40b26b0 msgr2=0x7fe2e40b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:14.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ec400640 1 -- 172.21.15.122:0/4003320513 shutdown_connections 2024-05-28T06:12:14.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ec400640 1 -- 172.21.15.122:0/4003320513 wait complete. 2024-05-28T06:12:14.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ec400640 1 Processor -- start 2024-05-28T06:12:14.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ec400640 1 -- start start 2024-05-28T06:12:14.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ec400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2e406f460 0x7fe2e41517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:14.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ec400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2e40722f0 0x7fe2e414a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:14.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ec400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2e415cdf0 0x7fe2e415e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:14.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ec400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e406e4d0 con 0x7fe2e415cdf0 2024-05-28T06:12:14.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ec400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e406e350 con 0x7fe2e406f460 2024-05-28T06:12:14.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ec400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e406e650 con 0x7fe2e40722f0 2024-05-28T06:12:14.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ea400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2e415cdf0 0x7fe2e415e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:14.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ea400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2e415cdf0 0x7fe2e415e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43996/0 (socket says 172.21.15.122:43996) 2024-05-28T06:12:14.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ea400640 1 -- 172.21.15.122:0/1640016436 learned_addr learned my addr 172.21.15.122:0/1640016436 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:14.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2e9a00640 1 --2- 172.21.15.122:0/1640016436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2e406f460 0x7fe2e41517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:14.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2e9000640 1 --2- 172.21.15.122:0/1640016436 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2e40722f0 0x7fe2e414a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:14.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ea400640 1 -- 172.21.15.122:0/1640016436 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2e40722f0 msgr2=0x7fe2e414a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:14.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ea400640 1 --2- 172.21.15.122:0/1640016436 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2e40722f0 0x7fe2e414a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:14.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ea400640 1 -- 172.21.15.122:0/1640016436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2e406f460 msgr2=0x7fe2e41517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:14.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ea400640 1 --2- 172.21.15.122:0/1640016436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2e406f460 0x7fe2e41517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:14.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ea400640 1 -- 172.21.15.122:0/1640016436 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e415e900 con 0x7fe2e415cdf0 2024-05-28T06:12:14.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.954+0000 7fe2ea400640 1 --2- 172.21.15.122:0/1640016436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2e415cdf0 0x7fe2e415e0d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00cbc0 tx=0x7fe2dc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:14.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.958+0000 7fe2e1600640 1 -- 172.21.15.122:0/1640016436 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc017070 con 0x7fe2e415cdf0 2024-05-28T06:12:14.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.958+0000 7fe2e1600640 1 -- 172.21.15.122:0/1640016436 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2dc00ad40 con 0x7fe2e415cdf0 2024-05-28T06:12:14.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.958+0000 7fe2e1600640 1 -- 172.21.15.122:0/1640016436 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc012600 con 0x7fe2e415cdf0 2024-05-28T06:12:14.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.958+0000 7fe2ec400640 1 -- 172.21.15.122:0/1640016436 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e4152540 con 0x7fe2e415cdf0 2024-05-28T06:12:14.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.958+0000 7fe2ec400640 1 -- 172.21.15.122:0/1640016436 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e415e610 con 0x7fe2e415cdf0 2024-05-28T06:12:14.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.958+0000 7fe2ec400640 1 -- 172.21.15.122:0/1640016436 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2e4068c40 con 0x7fe2e415cdf0 2024-05-28T06:12:14.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.958+0000 7fe2e1600640 1 -- 172.21.15.122:0/1640016436 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fe2dc01a070 con 0x7fe2e415cdf0 2024-05-28T06:12:14.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.958+0000 7fe2e1600640 1 --2- 172.21.15.122:0/1640016436 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe2c4068c20 0x7fe2c406b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:14.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.958+0000 7fe2e1600640 1 -- 172.21.15.122:0/1640016436 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7fe2dc0876b0 con 0x7fe2e415cdf0 2024-05-28T06:12:14.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.958+0000 7fe2e9a00640 1 --2- 172.21.15.122:0/1640016436 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe2c4068c20 0x7fe2c406b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:14.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.962+0000 7fe2e9a00640 1 --2- 172.21.15.122:0/1640016436 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe2c4068c20 0x7fe2c406b0e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8001810 tx=0x7fe2d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:14.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:14.966+0000 7fe2e1600640 1 -- 172.21.15.122:0/1640016436 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe2dc056850 con 0x7fe2e415cdf0 2024-05-28T06:12:15.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.158+0000 7fe2ec400640 1 -- 172.21.15.122:0/1640016436 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2e40b3450 con 0x7fe2e415cdf0 2024-05-28T06:12:15.157 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.158+0000 7fe2e1600640 1 -- 172.21.15.122:0/1640016436 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5184 (secure 0 0 0) 0x7fe2dc05ab50 con 0x7fe2e415cdf0 2024-05-28T06:12:15.157 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:15.157 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":29,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5482,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/257060312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":257060312},{"type":"v1","addr":"172.21.15.153:6834","nonce":257060312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5485,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/573898687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":573898687},{"type":"v1","addr":"172.21.15.153:6835","nonce":573898687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/246840682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":246840682},{"type":"v1","addr":"172.21.15.122:6836","nonce":246840682}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-28T06:09:34.510484+0000","modified":"2024-05-28T06:09:37.531081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1627568336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1627568336},{"type":"v1","addr":"172.21.15.122:6837","nonce":1627568336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":3}]} 2024-05-28T06:12:15.158 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 29 2024-05-28T06:12:15.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.158+0000 7fe2ec400640 1 -- 172.21.15.122:0/1640016436 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe2c4068c20 msgr2=0x7fe2c406b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:15.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.158+0000 7fe2ec400640 1 --2- 172.21.15.122:0/1640016436 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe2c4068c20 0x7fe2c406b0e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8001810 tx=0x7fe2d8009040 comp rx=0 tx=0).stop 2024-05-28T06:12:15.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.158+0000 7fe2ec400640 1 -- 172.21.15.122:0/1640016436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2e415cdf0 msgr2=0x7fe2e415e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:15.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.158+0000 7fe2ec400640 1 --2- 172.21.15.122:0/1640016436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2e415cdf0 0x7fe2e415e0d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00cbc0 tx=0x7fe2dc00a430 comp rx=0 tx=0).stop 2024-05-28T06:12:15.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.158+0000 7fe2ec400640 1 -- 172.21.15.122:0/1640016436 shutdown_connections 2024-05-28T06:12:15.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.158+0000 7fe2ec400640 1 --2- 172.21.15.122:0/1640016436 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe2c4068c20 0x7fe2c406b0e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:15.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.158+0000 7fe2ec400640 1 --2- 172.21.15.122:0/1640016436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2e415cdf0 0x7fe2e415e0d0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:15.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.158+0000 7fe2ec400640 1 --2- 172.21.15.122:0/1640016436 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2e40722f0 0x7fe2e414a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:15.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.158+0000 7fe2ec400640 1 --2- 172.21.15.122:0/1640016436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2e406f460 0x7fe2e41517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:15.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.158+0000 7fe2ec400640 1 -- 172.21.15.122:0/1640016436 >> 172.21.15.122:0/1640016436 conn(0x7fe2e40b26b0 msgr2=0x7fe2e40b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:15.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.158+0000 7fe2ec400640 1 -- 172.21.15.122:0/1640016436 shutdown_connections 2024-05-28T06:12:15.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.158+0000 7fe2ec400640 1 -- 172.21.15.122:0/1640016436 wait complete. 2024-05-28T06:12:15.178 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:12:15.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.322+0000 7fe4c5c00640 1 Processor -- start 2024-05-28T06:12:15.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.322+0000 7fe4c5c00640 1 -- start start 2024-05-28T06:12:15.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.322+0000 7fe4c5c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe4c00d18f0 0x7fe4c0169800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:15.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.322+0000 7fe4c5c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4c0162510 con 0x7fe4c015ea50 2024-05-28T06:12:15.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.322+0000 7fe4c5c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4c01627f0 con 0x7fe4c006dab0 2024-05-28T06:12:15.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.322+0000 7fe4c5c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe4c0163120 con 0x7fe4c00d18f0 2024-05-28T06:12:15.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.326+0000 7fe4bea00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fe4c015ea50 0x7fe4c015ee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:34866/0 (socket says 172.21.15.122:34866) 2024-05-28T06:12:15.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.326+0000 7fe4bea00640 1 -- 172.21.15.122:0/1571491692 learned_addr learned my addr 172.21.15.122:0/1571491692 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:15.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.326+0000 7fe4bf400640 1 --2- 172.21.15.122:0/1571491692 >> v2:172.21.15.153:3300/0 conn(0x7fe4c00d18f0 0x7fe4c0169800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:15.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.326+0000 7fe4bf400640 1 -- 172.21.15.122:0/1571491692 >> v1:172.21.15.153:6789/0 conn(0x7fe4c006dab0 legacy=0x7fe4c015f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:15.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.326+0000 7fe4bf400640 1 -- 172.21.15.122:0/1571491692 >> v1:172.21.15.122:6789/0 conn(0x7fe4c015ea50 legacy=0x7fe4c015ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:15.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.326+0000 7fe4bf400640 1 -- 172.21.15.122:0/1571491692 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c0162ad0 con 0x7fe4c00d18f0 2024-05-28T06:12:15.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.330+0000 7fe4bf400640 1 --2- 172.21.15.122:0/1571491692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4c00d18f0 0x7fe4c0169800 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8009d90 tx=0x7fe4b8025030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=841764ec276a4341 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:15.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.330+0000 7fe4bd600640 1 -- 172.21.15.122:0/1571491692 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b80b9070 con 0x7fe4c00d18f0 2024-05-28T06:12:15.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.330+0000 7fe4bd600640 1 -- 172.21.15.122:0/1571491692 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b80b4600 con 0x7fe4c00d18f0 2024-05-28T06:12:15.330 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.330+0000 7fe4bd600640 1 -- 172.21.15.122:0/1571491692 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b80b49d0 con 0x7fe4c00d18f0 2024-05-28T06:12:15.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.330+0000 7fe4c5c00640 1 -- 172.21.15.122:0/1571491692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4c00d18f0 msgr2=0x7fe4c0169800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:15.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.330+0000 7fe4c5c00640 1 --2- 172.21.15.122:0/1571491692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4c00d18f0 0x7fe4c0169800 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8009d90 tx=0x7fe4b8025030 comp rx=0 tx=0).stop 2024-05-28T06:12:15.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.330+0000 7fe4c5c00640 1 -- 172.21.15.122:0/1571491692 shutdown_connections 2024-05-28T06:12:15.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.330+0000 7fe4c5c00640 1 --2- 172.21.15.122:0/1571491692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4c00d18f0 0x7fe4c0169800 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:15.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.330+0000 7fe4c5c00640 1 -- 172.21.15.122:0/1571491692 >> 172.21.15.122:0/1571491692 conn(0x7fe4c00b4190 msgr2=0x7fe4c00b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:15.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.330+0000 7fe4c5c00640 1 -- 172.21.15.122:0/1571491692 shutdown_connections 2024-05-28T06:12:15.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.330+0000 7fe4c5c00640 1 -- 172.21.15.122:0/1571491692 wait complete. 2024-05-28T06:12:15.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4c5c00640 1 Processor -- start 2024-05-28T06:12:15.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4c5c00640 1 -- start start 2024-05-28T06:12:15.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4c5c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4c006dab0 0x7fe4c00b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:15.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4c5c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4c00d18f0 0x7fe4c014b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:15.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4c5c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4c015ea50 0x7fe4c00b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:15.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4c5c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c00bb3f0 con 0x7fe4c015ea50 2024-05-28T06:12:15.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4c5c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c00bb270 con 0x7fe4c006dab0 2024-05-28T06:12:15.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4c5c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c00bb570 con 0x7fe4c00d18f0 2024-05-28T06:12:15.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4bf400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4c015ea50 0x7fe4c00b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:15.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4bf400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4c015ea50 0x7fe4c00b0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44008/0 (socket says 172.21.15.122:44008) 2024-05-28T06:12:15.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4bf400640 1 -- 172.21.15.122:0/1782944591 learned_addr learned my addr 172.21.15.122:0/1782944591 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:15.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4be000640 1 --2- 172.21.15.122:0/1782944591 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4c00d18f0 0x7fe4c014b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:15.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4bea00640 1 --2- 172.21.15.122:0/1782944591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4c006dab0 0x7fe4c00b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:15.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4bf400640 1 -- 172.21.15.122:0/1782944591 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4c00d18f0 msgr2=0x7fe4c014b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:15.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4bf400640 1 --2- 172.21.15.122:0/1782944591 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4c00d18f0 0x7fe4c014b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:15.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4bf400640 1 -- 172.21.15.122:0/1782944591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4c006dab0 msgr2=0x7fe4c00b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:15.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4bf400640 1 --2- 172.21.15.122:0/1782944591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4c006dab0 0x7fe4c00b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:15.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4bf400640 1 -- 172.21.15.122:0/1782944591 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c00b2080 con 0x7fe4c015ea50 2024-05-28T06:12:15.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4bf400640 1 --2- 172.21.15.122:0/1782944591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4c015ea50 0x7fe4c00b0ea0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80b7040 tx=0x7fe4b8021dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:15.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4b6a00640 1 -- 172.21.15.122:0/1782944591 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b80b9040 con 0x7fe4c015ea50 2024-05-28T06:12:15.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4b6a00640 1 -- 172.21.15.122:0/1782944591 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b80c7070 con 0x7fe4c015ea50 2024-05-28T06:12:15.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4c5c00640 1 -- 172.21.15.122:0/1782944591 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c00b5a30 con 0x7fe4c015ea50 2024-05-28T06:12:15.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4b6a00640 1 -- 172.21.15.122:0/1782944591 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b80bf680 con 0x7fe4c015ea50 2024-05-28T06:12:15.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4c5c00640 1 -- 172.21.15.122:0/1782944591 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c00b00e0 con 0x7fe4c015ea50 2024-05-28T06:12:15.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.334+0000 7fe4c5c00640 1 -- 172.21.15.122:0/1782944591 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4c0068c40 con 0x7fe4c015ea50 2024-05-28T06:12:15.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.338+0000 7fe4b6a00640 1 -- 172.21.15.122:0/1782944591 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fe4b80bf820 con 0x7fe4c015ea50 2024-05-28T06:12:15.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.338+0000 7fe4b6a00640 1 --2- 172.21.15.122:0/1782944591 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe4a0068c20 0x7fe4a006b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:15.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.338+0000 7fe4b6a00640 1 -- 172.21.15.122:0/1782944591 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5823+0+0 (secure 0 0 0) 0x7fe4b812b020 con 0x7fe4c015ea50 2024-05-28T06:12:15.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.338+0000 7fe4bea00640 1 --2- 172.21.15.122:0/1782944591 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe4a0068c20 0x7fe4a006b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:15.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.338+0000 7fe4bea00640 1 --2- 172.21.15.122:0/1782944591 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe4a0068c20 0x7fe4a006b0e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0000f70 tx=0x7fe4b0007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:15.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.342+0000 7fe4b6a00640 1 -- 172.21.15.122:0/1782944591 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe4b801ecb0 con 0x7fe4c015ea50 2024-05-28T06:12:15.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.510+0000 7fe4c5c00640 1 -- 172.21.15.122:0/1782944591 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe4c00b4ea0 con 0x7fe4c015ea50 2024-05-28T06:12:15.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.510+0000 7fe4b6a00640 1 -- 172.21.15.122:0/1782944591 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+16813 (secure 0 0 0) 0x7fe4b80fa330 con 0x7fe4c015ea50 2024-05-28T06:12:15.509 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:15.509 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":50,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:12:15.307991+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:09:32.856007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-28T06:09:33.467043+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":50,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":5}]},{"pgid":"7.32","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:12:15.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.510+0000 7fe4c5c00640 1 -- 172.21.15.122:0/1782944591 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe4a0068c20 msgr2=0x7fe4a006b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:15.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.510+0000 7fe4c5c00640 1 --2- 172.21.15.122:0/1782944591 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe4a0068c20 0x7fe4a006b0e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0000f70 tx=0x7fe4b0007e90 comp rx=0 tx=0).stop 2024-05-28T06:12:15.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.510+0000 7fe4c5c00640 1 -- 172.21.15.122:0/1782944591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4c015ea50 msgr2=0x7fe4c00b0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:15.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.510+0000 7fe4c5c00640 1 --2- 172.21.15.122:0/1782944591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4c015ea50 0x7fe4c00b0ea0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80b7040 tx=0x7fe4b8021dd0 comp rx=0 tx=0).stop 2024-05-28T06:12:15.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.510+0000 7fe4c5c00640 1 -- 172.21.15.122:0/1782944591 shutdown_connections 2024-05-28T06:12:15.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.510+0000 7fe4c5c00640 1 --2- 172.21.15.122:0/1782944591 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe4a0068c20 0x7fe4a006b0e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:15.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.510+0000 7fe4c5c00640 1 --2- 172.21.15.122:0/1782944591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4c015ea50 0x7fe4c00b0ea0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:15.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.510+0000 7fe4c5c00640 1 --2- 172.21.15.122:0/1782944591 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4c00d18f0 0x7fe4c014b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:15.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.510+0000 7fe4c5c00640 1 --2- 172.21.15.122:0/1782944591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4c006dab0 0x7fe4c00b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:15.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.510+0000 7fe4c5c00640 1 -- 172.21.15.122:0/1782944591 >> 172.21.15.122:0/1782944591 conn(0x7fe4c00b4190 msgr2=0x7fe4c00b3500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:15.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.510+0000 7fe4c5c00640 1 -- 172.21.15.122:0/1782944591 shutdown_connections 2024-05-28T06:12:15.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.510+0000 7fe4c5c00640 1 -- 172.21.15.122:0/1782944591 wait complete. 2024-05-28T06:12:15.532 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-28T06:09:32.856007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-05-28T06:09:33.467043+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 50, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:12:15.533 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:12:15.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.670+0000 7fc9f0e00640 1 Processor -- start 2024-05-28T06:12:15.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.670+0000 7fc9f0e00640 1 -- start start 2024-05-28T06:12:15.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.674+0000 7fc9f0e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc9ec0ce4f0 0x7fc9ec0ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:15.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.674+0000 7fc9f0e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9ec15e730 0x7fc9ec15ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:15.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.674+0000 7fc9f0e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9ec15d970 con 0x7fc9ec0b58d0 2024-05-28T06:12:15.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.674+0000 7fc9f0e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fc9ec15dc50 con 0x7fc9ec0ce4f0 2024-05-28T06:12:15.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.674+0000 7fc9f0e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc9ec15df30 con 0x7fc9ec15e730 2024-05-28T06:12:15.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.674+0000 7fc9e9e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fc9ec0b58d0 0x7fc9ec0b5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:45316/0 (socket says 172.21.15.122:45316) 2024-05-28T06:12:15.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.674+0000 7fc9e9e00640 1 -- 172.21.15.122:0/1373323335 learned_addr learned my addr 172.21.15.122:0/1373323335 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:15.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.674+0000 7fc9e1400640 1 --2- 172.21.15.122:0/1373323335 >> v2:172.21.15.122:3300/0 conn(0x7fc9ec0ce4f0 0x7fc9ec0ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:15.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.674+0000 7fc9ea800640 1 --2- 172.21.15.122:0/1373323335 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9ec15e730 0x7fc9ec15ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:15.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.674+0000 7fc9e9400640 1 -- 172.21.15.122:0/1373323335 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1928220169 0 0) 0x7fc9ec15d970 con 0x7fc9ec0b58d0 2024-05-28T06:12:15.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.674+0000 7fc9e9400640 1 -- 172.21.15.122:0/1373323335 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9d0003530 con 0x7fc9ec0b58d0 2024-05-28T06:12:15.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.674+0000 7fc9e1400640 1 -- 172.21.15.122:0/1373323335 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9ec15e730 msgr2=0x7fc9ec15ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:15.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.674+0000 7fc9e1400640 1 --2- 172.21.15.122:0/1373323335 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9ec15e730 0x7fc9ec15ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:15.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.674+0000 7fc9e1400640 1 -- 172.21.15.122:0/1373323335 >> v1:172.21.15.122:6789/0 conn(0x7fc9ec0b58d0 legacy=0x7fc9ec0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:15.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.674+0000 7fc9e1400640 1 -- 172.21.15.122:0/1373323335 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ec15e210 con 0x7fc9ec0ce4f0 2024-05-28T06:12:15.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.678+0000 7fc9e1400640 1 --2- 172.21.15.122:0/1373323335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9ec0ce4f0 0x7fc9ec0ce980 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40097c0 tx=0x7fc9d401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ac7e6b50910dc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:15.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.678+0000 7fc9e9400640 1 -- 172.21.15.122:0/1373323335 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d40b0070 con 0x7fc9ec0ce4f0 2024-05-28T06:12:15.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.678+0000 7fc9e9400640 1 -- 172.21.15.122:0/1373323335 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9d4004230 con 0x7fc9ec0ce4f0 2024-05-28T06:12:15.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.678+0000 7fc9e9400640 1 -- 172.21.15.122:0/1373323335 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4003620 con 0x7fc9ec0ce4f0 2024-05-28T06:12:15.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.678+0000 7fc9f0e00640 1 -- 172.21.15.122:0/1373323335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9ec0ce4f0 msgr2=0x7fc9ec0ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:15.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.678+0000 7fc9f0e00640 1 --2- 172.21.15.122:0/1373323335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9ec0ce4f0 0x7fc9ec0ce980 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40097c0 tx=0x7fc9d401c4a0 comp rx=0 tx=0).stop 2024-05-28T06:12:15.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.678+0000 7fc9f0e00640 1 -- 172.21.15.122:0/1373323335 shutdown_connections 2024-05-28T06:12:15.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.678+0000 7fc9f0e00640 1 --2- 172.21.15.122:0/1373323335 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9ec15e730 0x7fc9ec15ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:15.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.678+0000 7fc9f0e00640 1 --2- 172.21.15.122:0/1373323335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9ec0ce4f0 0x7fc9ec0ce980 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:15.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.678+0000 7fc9f0e00640 1 -- 172.21.15.122:0/1373323335 >> 172.21.15.122:0/1373323335 conn(0x7fc9ec06bd90 msgr2=0x7fc9ec06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:15.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.678+0000 7fc9f0e00640 1 -- 172.21.15.122:0/1373323335 shutdown_connections 2024-05-28T06:12:15.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.678+0000 7fc9f0e00640 1 -- 172.21.15.122:0/1373323335 wait complete. 2024-05-28T06:12:15.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.678+0000 7fc9f0e00640 1 Processor -- start 2024-05-28T06:12:15.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.678+0000 7fc9f0e00640 1 -- start start 2024-05-28T06:12:15.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.678+0000 7fc9f0e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9ec0b58d0 0x7fc9ec15bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:15.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.678+0000 7fc9f0e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9ec0ce4f0 0x7fc9ec160980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:15.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.678+0000 7fc9f0e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9ec15e730 0x7fc9ec0aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:15.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.678+0000 7fc9f0e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec1693d0 con 0x7fc9ec15e730 2024-05-28T06:12:15.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.678+0000 7fc9f0e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec169250 con 0x7fc9ec0ce4f0 2024-05-28T06:12:15.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.678+0000 7fc9f0e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc9ec169550 con 0x7fc9ec0b58d0 2024-05-28T06:12:15.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.678+0000 7fc9ea800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9ec15e730 0x7fc9ec0aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:15.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.678+0000 7fc9ea800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9ec15e730 0x7fc9ec0aea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58748/0 (socket says 172.21.15.122:58748) 2024-05-28T06:12:15.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.678+0000 7fc9ea800640 1 -- 172.21.15.122:0/3193309523 learned_addr learned my addr 172.21.15.122:0/3193309523 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:15.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.682+0000 7fc9e9e00640 1 --2- 172.21.15.122:0/3193309523 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9ec0b58d0 0x7fc9ec15bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:15.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.682+0000 7fc9e1400640 1 --2- 172.21.15.122:0/3193309523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9ec0ce4f0 0x7fc9ec160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:15.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.682+0000 7fc9ea800640 1 -- 172.21.15.122:0/3193309523 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9ec0b58d0 msgr2=0x7fc9ec15bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:15.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.682+0000 7fc9ea800640 1 --2- 172.21.15.122:0/3193309523 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9ec0b58d0 0x7fc9ec15bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:15.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.682+0000 7fc9ea800640 1 -- 172.21.15.122:0/3193309523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9ec0ce4f0 msgr2=0x7fc9ec160980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:15.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.682+0000 7fc9ea800640 1 --2- 172.21.15.122:0/3193309523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9ec0ce4f0 0x7fc9ec160980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:15.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.682+0000 7fc9ea800640 1 -- 172.21.15.122:0/3193309523 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ec140620 con 0x7fc9ec15e730 2024-05-28T06:12:15.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.682+0000 7fc9e9e00640 1 --2- 172.21.15.122:0/3193309523 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9ec0b58d0 0x7fc9ec15bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:12:15.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.682+0000 7fc9ea800640 1 --2- 172.21.15.122:0/3193309523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9ec15e730 0x7fc9ec0aea40 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc9e400efc0 tx=0x7fc9e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:15.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.682+0000 7fc9e2a00640 1 -- 172.21.15.122:0/3193309523 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4018020 con 0x7fc9ec15e730 2024-05-28T06:12:15.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.682+0000 7fc9e2a00640 1 -- 172.21.15.122:0/3193309523 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e4014480 con 0x7fc9ec15e730 2024-05-28T06:12:15.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.682+0000 7fc9e2a00640 1 -- 172.21.15.122:0/3193309523 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4014870 con 0x7fc9ec15e730 2024-05-28T06:12:15.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.682+0000 7fc9f0e00640 1 -- 172.21.15.122:0/3193309523 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9ec140900 con 0x7fc9ec15e730 2024-05-28T06:12:15.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.682+0000 7fc9f0e00640 1 -- 172.21.15.122:0/3193309523 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9ec140ec0 con 0x7fc9ec15e730 2024-05-28T06:12:15.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.682+0000 7fc9f0e00640 1 -- 172.21.15.122:0/3193309523 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9ec068c40 con 0x7fc9ec15e730 2024-05-28T06:12:15.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.682+0000 7fc9e2a00640 1 -- 172.21.15.122:0/3193309523 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fc9e401b020 con 0x7fc9ec15e730 2024-05-28T06:12:15.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.686+0000 7fc9e2a00640 1 --2- 172.21.15.122:0/3193309523 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc9c8068bf0 0x7fc9c806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:15.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.686+0000 7fc9e2a00640 1 -- 172.21.15.122:0/3193309523 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5823+0+0 (secure 0 0 0) 0x7fc9e4085d20 con 0x7fc9ec15e730 2024-05-28T06:12:15.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.686+0000 7fc9e9e00640 1 --2- 172.21.15.122:0/3193309523 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc9c8068bf0 0x7fc9c806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:15.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.686+0000 7fc9e9e00640 1 --2- 172.21.15.122:0/3193309523 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc9c8068bf0 0x7fc9c806b0b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc005890 tx=0x7fc9dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:15.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.690+0000 7fc9e2a00640 1 -- 172.21.15.122:0/3193309523 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc9e4022070 con 0x7fc9ec15e730 2024-05-28T06:12:15.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.846+0000 7fc9f0e00640 1 -- 172.21.15.122:0/3193309523 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc9ec145250 con 0x7fc9ec15e730 2024-05-28T06:12:15.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.846+0000 7fc9e2a00640 1 -- 172.21.15.122:0/3193309523 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) ==== 93+0+10 (secure 0 0 0) 0x7fc9e4010040 con 0x7fc9ec15e730 2024-05-28T06:12:15.846 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:12:15.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.846+0000 7fc9f0e00640 1 -- 172.21.15.122:0/3193309523 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc9c8068bf0 msgr2=0x7fc9c806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:15.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.846+0000 7fc9f0e00640 1 --2- 172.21.15.122:0/3193309523 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc9c8068bf0 0x7fc9c806b0b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc005890 tx=0x7fc9dc009040 comp rx=0 tx=0).stop 2024-05-28T06:12:15.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.846+0000 7fc9f0e00640 1 -- 172.21.15.122:0/3193309523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9ec15e730 msgr2=0x7fc9ec0aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:15.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.846+0000 7fc9f0e00640 1 --2- 172.21.15.122:0/3193309523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9ec15e730 0x7fc9ec0aea40 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc9e400efc0 tx=0x7fc9e400c490 comp rx=0 tx=0).stop 2024-05-28T06:12:15.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.846+0000 7fc9f0e00640 1 -- 172.21.15.122:0/3193309523 shutdown_connections 2024-05-28T06:12:15.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.846+0000 7fc9f0e00640 1 --2- 172.21.15.122:0/3193309523 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc9c8068bf0 0x7fc9c806b0b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:15.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.846+0000 7fc9f0e00640 1 --2- 172.21.15.122:0/3193309523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9ec15e730 0x7fc9ec0aea40 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:15.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.846+0000 7fc9f0e00640 1 --2- 172.21.15.122:0/3193309523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9ec0ce4f0 0x7fc9ec160980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:15.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.846+0000 7fc9f0e00640 1 --2- 172.21.15.122:0/3193309523 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9ec0b58d0 0x7fc9ec15bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:15.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.846+0000 7fc9f0e00640 1 -- 172.21.15.122:0/3193309523 >> 172.21.15.122:0/3193309523 conn(0x7fc9ec06bd90 msgr2=0x7fc9ec15ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:15.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.846+0000 7fc9f0e00640 1 -- 172.21.15.122:0/3193309523 shutdown_connections 2024-05-28T06:12:15.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:15.846+0000 7fc9f0e00640 1 -- 172.21.15.122:0/3193309523 wait complete. 2024-05-28T06:12:15.867 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-28T06:12:16.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.006+0000 7fcb62400640 1 Processor -- start 2024-05-28T06:12:16.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.006+0000 7fcb62400640 1 -- start start 2024-05-28T06:12:16.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.010+0000 7fcb62400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb5c0ce4f0 0x7fcb5c0ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:16.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.010+0000 7fcb62400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcb5c15e730 0x7fcb5c15ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:16.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.010+0000 7fcb62400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb5c15d970 con 0x7fcb5c0b58d0 2024-05-28T06:12:16.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.010+0000 7fcb62400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fcb5c15dc50 con 0x7fcb5c15e730 2024-05-28T06:12:16.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.010+0000 7fcb62400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcb5c15df30 con 0x7fcb5c0ce4f0 2024-05-28T06:12:16.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.010+0000 7fcb5be00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcb5c15e730 0x7fcb5c15ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:16.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.010+0000 7fcb5be00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcb5c15e730 0x7fcb5c15ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58754/0 (socket says 172.21.15.122:58754) 2024-05-28T06:12:16.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.010+0000 7fcb5be00640 1 -- 172.21.15.122:0/1771443807 learned_addr learned my addr 172.21.15.122:0/1771443807 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:16.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.010+0000 7fcb5aa00640 1 --2- 172.21.15.122:0/1771443807 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb5c0ce4f0 0x7fcb5c0ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:16.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.010+0000 7fcb5be00640 1 -- 172.21.15.122:0/1771443807 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb5c0ce4f0 msgr2=0x7fcb5c0ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:16.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.010+0000 7fcb5be00640 1 --2- 172.21.15.122:0/1771443807 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb5c0ce4f0 0x7fcb5c0ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.010+0000 7fcb5be00640 1 -- 172.21.15.122:0/1771443807 >> v1:172.21.15.153:6789/0 conn(0x7fcb5c0b58d0 legacy=0x7fcb5c0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:16.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.010+0000 7fcb5be00640 1 -- 172.21.15.122:0/1771443807 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb5c15e210 con 0x7fcb5c15e730 2024-05-28T06:12:16.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.010+0000 7fcb5be00640 1 --2- 172.21.15.122:0/1771443807 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb5c15e730 0x7fcb5c15ebc0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009e50 tx=0x7fcb5401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f7e49eb5a78333 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:16.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.010+0000 7fcb5a000640 1 -- 172.21.15.122:0/1771443807 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb540a57a0 con 0x7fcb5c15e730 2024-05-28T06:12:16.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb5a000640 1 -- 172.21.15.122:0/1771443807 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb540a5940 con 0x7fcb5c15e730 2024-05-28T06:12:16.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb5a000640 1 -- 172.21.15.122:0/1771443807 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb540a5d10 con 0x7fcb5c15e730 2024-05-28T06:12:16.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb62400640 1 -- 172.21.15.122:0/1771443807 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb5c15e730 msgr2=0x7fcb5c15ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:16.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb62400640 1 --2- 172.21.15.122:0/1771443807 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb5c15e730 0x7fcb5c15ebc0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009e50 tx=0x7fcb5401ca30 comp rx=0 tx=0).stop 2024-05-28T06:12:16.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb62400640 1 -- 172.21.15.122:0/1771443807 shutdown_connections 2024-05-28T06:12:16.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb62400640 1 --2- 172.21.15.122:0/1771443807 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb5c15e730 0x7fcb5c15ebc0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb62400640 1 --2- 172.21.15.122:0/1771443807 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb5c0ce4f0 0x7fcb5c0ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb62400640 1 -- 172.21.15.122:0/1771443807 >> 172.21.15.122:0/1771443807 conn(0x7fcb5c06bd90 msgr2=0x7fcb5c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:16.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb62400640 1 -- 172.21.15.122:0/1771443807 shutdown_connections 2024-05-28T06:12:16.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb62400640 1 -- 172.21.15.122:0/1771443807 wait complete. 2024-05-28T06:12:16.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb62400640 1 Processor -- start 2024-05-28T06:12:16.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb62400640 1 -- start start 2024-05-28T06:12:16.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb62400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb5c0b58d0 0x7fcb5c13bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:16.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb62400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb5c0ce4f0 0x7fcb5c1438e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:16.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb62400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb5c15e730 0x7fcb5c143e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:16.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb62400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5c1693d0 con 0x7fcb5c15e730 2024-05-28T06:12:16.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb62400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5c169250 con 0x7fcb5c0b58d0 2024-05-28T06:12:16.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb62400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcb5c169550 con 0x7fcb5c0ce4f0 2024-05-28T06:12:16.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb5be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb5c15e730 0x7fcb5c143e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:16.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb5be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb5c15e730 0x7fcb5c143e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58762/0 (socket says 172.21.15.122:58762) 2024-05-28T06:12:16.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb5be00640 1 -- 172.21.15.122:0/583718900 learned_addr learned my addr 172.21.15.122:0/583718900 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:16.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb5b400640 1 --2- 172.21.15.122:0/583718900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb5c0b58d0 0x7fcb5c13bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:16.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb5aa00640 1 --2- 172.21.15.122:0/583718900 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb5c0ce4f0 0x7fcb5c1438e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:16.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb5be00640 1 -- 172.21.15.122:0/583718900 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb5c0ce4f0 msgr2=0x7fcb5c1438e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:16.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb5be00640 1 --2- 172.21.15.122:0/583718900 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb5c0ce4f0 0x7fcb5c1438e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb5be00640 1 -- 172.21.15.122:0/583718900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb5c0b58d0 msgr2=0x7fcb5c13bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:16.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb5be00640 1 --2- 172.21.15.122:0/583718900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb5c0b58d0 0x7fcb5c13bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.014+0000 7fcb5be00640 1 -- 172.21.15.122:0/583718900 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb5c141150 con 0x7fcb5c15e730 2024-05-28T06:12:16.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.018+0000 7fcb5be00640 1 --2- 172.21.15.122:0/583718900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb5c15e730 0x7fcb5c143e20 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fcb540af040 tx=0x7fcb540197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:16.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.018+0000 7fcb53400640 1 -- 172.21.15.122:0/583718900 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb540bc020 con 0x7fcb5c15e730 2024-05-28T06:12:16.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.018+0000 7fcb53400640 1 -- 172.21.15.122:0/583718900 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb540b8670 con 0x7fcb5c15e730 2024-05-28T06:12:16.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.018+0000 7fcb53400640 1 -- 172.21.15.122:0/583718900 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb54009510 con 0x7fcb5c15e730 2024-05-28T06:12:16.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.018+0000 7fcb62400640 1 -- 172.21.15.122:0/583718900 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb5c144470 con 0x7fcb5c15e730 2024-05-28T06:12:16.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.018+0000 7fcb62400640 1 -- 172.21.15.122:0/583718900 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb5c144a30 con 0x7fcb5c15e730 2024-05-28T06:12:16.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.018+0000 7fcb62400640 1 -- 172.21.15.122:0/583718900 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb5c068c40 con 0x7fcb5c15e730 2024-05-28T06:12:16.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.018+0000 7fcb53400640 1 -- 172.21.15.122:0/583718900 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fcb540bf020 con 0x7fcb5c15e730 2024-05-28T06:12:16.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.018+0000 7fcb53400640 1 --2- 172.21.15.122:0/583718900 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcb3c068bf0 0x7fcb3c06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:16.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.018+0000 7fcb53400640 1 -- 172.21.15.122:0/583718900 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5823+0+0 (secure 0 0 0) 0x7fcb54122640 con 0x7fcb5c15e730 2024-05-28T06:12:16.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.018+0000 7fcb5b400640 1 --2- 172.21.15.122:0/583718900 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcb3c068bf0 0x7fcb3c06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:16.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.022+0000 7fcb5b400640 1 --2- 172.21.15.122:0/583718900 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcb3c068bf0 0x7fcb3c06b0b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c1f88b0 tx=0x7fcb4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:16.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.022+0000 7fcb53400640 1 -- 172.21.15.122:0/583718900 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcb540c6030 con 0x7fcb5c15e730 2024-05-28T06:12:16.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.182+0000 7fcb62400640 1 -- 172.21.15.122:0/583718900 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcb5c13d340 con 0x7fcb5c15e730 2024-05-28T06:12:16.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.182+0000 7fcb53400640 1 -- 172.21.15.122:0/583718900 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) ==== 104+0+11 (secure 0 0 0) 0x7fcb540f8070 con 0x7fcb5c15e730 2024-05-28T06:12:16.182 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 32 2024-05-28T06:12:16.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.186+0000 7fcb62400640 1 -- 172.21.15.122:0/583718900 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcb3c068bf0 msgr2=0x7fcb3c06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:16.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.186+0000 7fcb62400640 1 --2- 172.21.15.122:0/583718900 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcb3c068bf0 0x7fcb3c06b0b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c1f88b0 tx=0x7fcb4c009040 comp rx=0 tx=0).stop 2024-05-28T06:12:16.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.186+0000 7fcb62400640 1 -- 172.21.15.122:0/583718900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb5c15e730 msgr2=0x7fcb5c143e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:16.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.186+0000 7fcb62400640 1 --2- 172.21.15.122:0/583718900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb5c15e730 0x7fcb5c143e20 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fcb540af040 tx=0x7fcb540197d0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.186+0000 7fcb62400640 1 -- 172.21.15.122:0/583718900 shutdown_connections 2024-05-28T06:12:16.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.186+0000 7fcb62400640 1 --2- 172.21.15.122:0/583718900 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcb3c068bf0 0x7fcb3c06b0b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.186+0000 7fcb62400640 1 --2- 172.21.15.122:0/583718900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb5c15e730 0x7fcb5c143e20 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.186+0000 7fcb62400640 1 --2- 172.21.15.122:0/583718900 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb5c0ce4f0 0x7fcb5c1438e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.186+0000 7fcb62400640 1 --2- 172.21.15.122:0/583718900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb5c0b58d0 0x7fcb5c13bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.186+0000 7fcb62400640 1 -- 172.21.15.122:0/583718900 >> 172.21.15.122:0/583718900 conn(0x7fcb5c06bd90 msgr2=0x7fcb5c15cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:16.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.186+0000 7fcb62400640 1 -- 172.21.15.122:0/583718900 shutdown_connections 2024-05-28T06:12:16.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.186+0000 7fcb62400640 1 -- 172.21.15.122:0/583718900 wait complete. 2024-05-28T06:12:16.203 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-28T06:12:16.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.342+0000 7fd93be00640 1 Processor -- start 2024-05-28T06:12:16.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.346+0000 7fd93be00640 1 -- start start 2024-05-28T06:12:16.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.346+0000 7fd93be00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd93c161ff0 0x7fd93c0d1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:16.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.346+0000 7fd93be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd93c06cc60 0x7fd93c09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:16.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.346+0000 7fd93be00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd93c0ccb80 con 0x7fd93c09af80 2024-05-28T06:12:16.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.346+0000 7fd93be00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd93c0cce60 con 0x7fd93c161ff0 2024-05-28T06:12:16.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.346+0000 7fd93be00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd93c0cd140 con 0x7fd93c06cc60 2024-05-28T06:12:16.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.346+0000 7fd93b400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fd93c09af80 0x7fd93c06d160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:45326/0 (socket says 172.21.15.122:45326) 2024-05-28T06:12:16.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.346+0000 7fd93b400640 1 -- 172.21.15.122:0/3773972429 learned_addr learned my addr 172.21.15.122:0/3773972429 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:16.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.346+0000 7fd93a000640 1 --2- 172.21.15.122:0/3773972429 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd93c06cc60 0x7fd93c09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:16.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.346+0000 7fd93aa00640 1 --2- 172.21.15.122:0/3773972429 >> v2:172.21.15.153:3300/0 conn(0x7fd93c161ff0 0x7fd93c0d1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:16.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.346+0000 7fd939600640 1 -- 172.21.15.122:0/3773972429 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 850614742 0 0) 0x7fd93c0ccb80 con 0x7fd93c09af80 2024-05-28T06:12:16.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.346+0000 7fd939600640 1 -- 172.21.15.122:0/3773972429 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd920003530 con 0x7fd93c09af80 2024-05-28T06:12:16.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.346+0000 7fd93a000640 1 -- 172.21.15.122:0/3773972429 >> v2:172.21.15.153:3300/0 conn(0x7fd93c161ff0 msgr2=0x7fd93c0d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:16.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.346+0000 7fd93a000640 1 --2- 172.21.15.122:0/3773972429 >> v2:172.21.15.153:3300/0 conn(0x7fd93c161ff0 0x7fd93c0d1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.346+0000 7fd93a000640 1 -- 172.21.15.122:0/3773972429 >> v1:172.21.15.122:6789/0 conn(0x7fd93c09af80 legacy=0x7fd93c06d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:16.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.346+0000 7fd93a000640 1 -- 172.21.15.122:0/3773972429 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd93c0cd420 con 0x7fd93c06cc60 2024-05-28T06:12:16.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.350+0000 7fd93a000640 1 --2- 172.21.15.122:0/3773972429 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd93c06cc60 0x7fd93c09aa40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd9280097c0 tx=0x7fd92801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=351d07e735707933 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:16.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.350+0000 7fd939600640 1 -- 172.21.15.122:0/3773972429 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9280b0070 con 0x7fd93c06cc60 2024-05-28T06:12:16.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.350+0000 7fd939600640 1 -- 172.21.15.122:0/3773972429 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9280ab600 con 0x7fd93c06cc60 2024-05-28T06:12:16.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.350+0000 7fd939600640 1 -- 172.21.15.122:0/3773972429 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c06e080 con 0x7fd93c06cc60 2024-05-28T06:12:16.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.350+0000 7fd93be00640 1 -- 172.21.15.122:0/3773972429 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd93c06cc60 msgr2=0x7fd93c09aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:16.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.350+0000 7fd93be00640 1 --2- 172.21.15.122:0/3773972429 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd93c06cc60 0x7fd93c09aa40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd9280097c0 tx=0x7fd92801c4a0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.350+0000 7fd93be00640 1 -- 172.21.15.122:0/3773972429 shutdown_connections 2024-05-28T06:12:16.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.350+0000 7fd93be00640 1 --2- 172.21.15.122:0/3773972429 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd93c06cc60 0x7fd93c09aa40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.350+0000 7fd93be00640 1 --2- 172.21.15.122:0/3773972429 >> v2:172.21.15.153:3300/0 conn(0x7fd93c161ff0 0x7fd93c0d1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.350+0000 7fd93be00640 1 -- 172.21.15.122:0/3773972429 >> 172.21.15.122:0/3773972429 conn(0x7fd93c0b3f80 msgr2=0x7fd93c0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:16.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.350+0000 7fd93be00640 1 -- 172.21.15.122:0/3773972429 shutdown_connections 2024-05-28T06:12:16.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.350+0000 7fd93be00640 1 -- 172.21.15.122:0/3773972429 wait complete. 2024-05-28T06:12:16.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.350+0000 7fd93be00640 1 Processor -- start 2024-05-28T06:12:16.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.350+0000 7fd93be00640 1 -- start start 2024-05-28T06:12:16.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd93be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd93c06cc60 0x7fd93c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:16.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd93be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd93c09af80 0x7fd93c155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:16.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd93be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd93c161ff0 0x7fd93c0cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:16.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd93be00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd93c16b980 con 0x7fd93c06cc60 2024-05-28T06:12:16.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd93be00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd93c16b800 con 0x7fd93c161ff0 2024-05-28T06:12:16.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd93be00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd93c16bb00 con 0x7fd93c09af80 2024-05-28T06:12:16.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd93aa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd93c06cc60 0x7fd93c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:16.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd93aa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd93c06cc60 0x7fd93c15b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58764/0 (socket says 172.21.15.122:58764) 2024-05-28T06:12:16.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd93aa00640 1 -- 172.21.15.122:0/2463799137 learned_addr learned my addr 172.21.15.122:0/2463799137 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:16.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd93a000640 1 --2- 172.21.15.122:0/2463799137 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd93c09af80 0x7fd93c155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:16.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd93b400640 1 --2- 172.21.15.122:0/2463799137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd93c161ff0 0x7fd93c0cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:16.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd93aa00640 1 -- 172.21.15.122:0/2463799137 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd93c09af80 msgr2=0x7fd93c155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:16.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd93aa00640 1 --2- 172.21.15.122:0/2463799137 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd93c09af80 0x7fd93c155a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd93aa00640 1 -- 172.21.15.122:0/2463799137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd93c161ff0 msgr2=0x7fd93c0cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:16.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd93aa00640 1 --2- 172.21.15.122:0/2463799137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd93c161ff0 0x7fd93c0cabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd93aa00640 1 -- 172.21.15.122:0/2463799137 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd93c15b730 con 0x7fd93c06cc60 2024-05-28T06:12:16.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd93aa00640 1 --2- 172.21.15.122:0/2463799137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd93c06cc60 0x7fd93c15b0a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00e930 tx=0x7fd92c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:16.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd933400640 1 -- 172.21.15.122:0/2463799137 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c017070 con 0x7fd93c06cc60 2024-05-28T06:12:16.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd933400640 1 -- 172.21.15.122:0/2463799137 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd92c00ca00 con 0x7fd93c06cc60 2024-05-28T06:12:16.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd93be00640 1 -- 172.21.15.122:0/2463799137 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd93c156d50 con 0x7fd93c06cc60 2024-05-28T06:12:16.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd933400640 1 -- 172.21.15.122:0/2463799137 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c00cdb0 con 0x7fd93c06cc60 2024-05-28T06:12:16.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd93be00640 1 -- 172.21.15.122:0/2463799137 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd93c155fc0 con 0x7fd93c06cc60 2024-05-28T06:12:16.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd93be00640 1 -- 172.21.15.122:0/2463799137 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd93c075620 con 0x7fd93c06cc60 2024-05-28T06:12:16.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.354+0000 7fd933400640 1 -- 172.21.15.122:0/2463799137 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fd92c01a070 con 0x7fd93c06cc60 2024-05-28T06:12:16.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.358+0000 7fd933400640 1 --2- 172.21.15.122:0/2463799137 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd91c068c20 0x7fd91c06b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:16.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.358+0000 7fd933400640 1 -- 172.21.15.122:0/2463799137 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5823+0+0 (secure 0 0 0) 0x7fd92c085170 con 0x7fd93c06cc60 2024-05-28T06:12:16.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.358+0000 7fd93a000640 1 --2- 172.21.15.122:0/2463799137 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd91c068c20 0x7fd91c06b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:16.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.358+0000 7fd93a000640 1 --2- 172.21.15.122:0/2463799137 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd91c068c20 0x7fd91c06b0e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd9280ad000 tx=0x7fd9280a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:16.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.362+0000 7fd933400640 1 -- 172.21.15.122:0/2463799137 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd92c056c50 con 0x7fd93c06cc60 2024-05-28T06:12:16.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.522+0000 7fd93be00640 1 -- 172.21.15.122:0/2463799137 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd93c0cc590 con 0x7fd93c06cc60 2024-05-28T06:12:16.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.522+0000 7fd933400640 1 -- 172.21.15.122:0/2463799137 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) ==== 100+0+11 (secure 0 0 0) 0x7fd92c05af50 con 0x7fd93c06cc60 2024-05-28T06:12:16.521 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 64 2024-05-28T06:12:16.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.522+0000 7fd93be00640 1 -- 172.21.15.122:0/2463799137 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd91c068c20 msgr2=0x7fd91c06b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:16.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.522+0000 7fd93be00640 1 --2- 172.21.15.122:0/2463799137 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd91c068c20 0x7fd91c06b0e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd9280ad000 tx=0x7fd9280a6000 comp rx=0 tx=0).stop 2024-05-28T06:12:16.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.522+0000 7fd93be00640 1 -- 172.21.15.122:0/2463799137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd93c06cc60 msgr2=0x7fd93c15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:16.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.522+0000 7fd93be00640 1 --2- 172.21.15.122:0/2463799137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd93c06cc60 0x7fd93c15b0a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00e930 tx=0x7fd92c00edf0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.522+0000 7fd93be00640 1 -- 172.21.15.122:0/2463799137 shutdown_connections 2024-05-28T06:12:16.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.522+0000 7fd93be00640 1 --2- 172.21.15.122:0/2463799137 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd91c068c20 0x7fd91c06b0e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.522+0000 7fd93be00640 1 --2- 172.21.15.122:0/2463799137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd93c161ff0 0x7fd93c0cabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.522+0000 7fd93be00640 1 --2- 172.21.15.122:0/2463799137 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd93c09af80 0x7fd93c155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.522+0000 7fd93be00640 1 --2- 172.21.15.122:0/2463799137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd93c06cc60 0x7fd93c15b0a0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.522+0000 7fd93be00640 1 -- 172.21.15.122:0/2463799137 >> 172.21.15.122:0/2463799137 conn(0x7fd93c0b3f80 msgr2=0x7fd93c0710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:16.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.522+0000 7fd93be00640 1 -- 172.21.15.122:0/2463799137 shutdown_connections 2024-05-28T06:12:16.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.522+0000 7fd93be00640 1 -- 172.21.15.122:0/2463799137 wait complete. 2024-05-28T06:12:16.543 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:12:16.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.678+0000 7f055b600640 1 Processor -- start 2024-05-28T06:12:16.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.678+0000 7f055b600640 1 -- start start 2024-05-28T06:12:16.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.678+0000 7f055b600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f055406f890 0x7f05540cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:16.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.678+0000 7f055b600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05540d0310 con 0x7f05540cff30 2024-05-28T06:12:16.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.678+0000 7f055b600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f055415be20 con 0x7f05540cd930 2024-05-28T06:12:16.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.678+0000 7f055b600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f055415c100 con 0x7f055406f890 2024-05-28T06:12:16.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.682+0000 7f054be00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f055406f890 0x7f05540cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:16.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.682+0000 7f0558c00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f05540cff30 0x7f055406f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:45328/0 (socket says 172.21.15.122:45328) 2024-05-28T06:12:16.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.682+0000 7f0558c00640 1 -- 172.21.15.122:0/2979646122 learned_addr learned my addr 172.21.15.122:0/2979646122 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:16.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.682+0000 7f054be00640 1 -- 172.21.15.122:0/2979646122 >> v1:172.21.15.153:6789/0 conn(0x7f05540cd930 legacy=0x7f05540b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:16.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.682+0000 7f0553e00640 1 -- 172.21.15.122:0/2979646122 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1123569336 0 0) 0x7f05540d0310 con 0x7f05540cff30 2024-05-28T06:12:16.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.682+0000 7f054be00640 1 -- 172.21.15.122:0/2979646122 >> v1:172.21.15.122:6789/0 conn(0x7f05540cff30 legacy=0x7f055406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:16.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.682+0000 7f054be00640 1 -- 172.21.15.122:0/2979646122 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055415c3e0 con 0x7f055406f890 2024-05-28T06:12:16.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.682+0000 7f054be00640 1 --2- 172.21.15.122:0/2979646122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f055406f890 0x7f05540cd3f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f053c0097c0 tx=0x7f053c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faaeca9ee839c23c server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:16.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.682+0000 7f0553e00640 1 -- 172.21.15.122:0/2979646122 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c0ab610 con 0x7f055406f890 2024-05-28T06:12:16.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.682+0000 7f0553e00640 1 -- 172.21.15.122:0/2979646122 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f053c0b0070 con 0x7f055406f890 2024-05-28T06:12:16.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.682+0000 7f0553e00640 1 -- 172.21.15.122:0/2979646122 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c0ab9d0 con 0x7f055406f890 2024-05-28T06:12:16.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.686+0000 7f055b600640 1 -- 172.21.15.122:0/2979646122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f055406f890 msgr2=0x7f05540cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:16.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.686+0000 7f055b600640 1 --2- 172.21.15.122:0/2979646122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f055406f890 0x7f05540cd3f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f053c0097c0 tx=0x7f053c01c470 comp rx=0 tx=0).stop 2024-05-28T06:12:16.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.686+0000 7f055b600640 1 -- 172.21.15.122:0/2979646122 shutdown_connections 2024-05-28T06:12:16.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.686+0000 7f055b600640 1 --2- 172.21.15.122:0/2979646122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f055406f890 0x7f05540cd3f0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.686+0000 7f055b600640 1 -- 172.21.15.122:0/2979646122 >> 172.21.15.122:0/2979646122 conn(0x7f055406bd90 msgr2=0x7f055406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:16.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.686+0000 7f055b600640 1 -- 172.21.15.122:0/2979646122 shutdown_connections 2024-05-28T06:12:16.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.686+0000 7f055b600640 1 -- 172.21.15.122:0/2979646122 wait complete. 2024-05-28T06:12:16.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.686+0000 7f055b600640 1 Processor -- start 2024-05-28T06:12:16.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.686+0000 7f055b600640 1 -- start start 2024-05-28T06:12:16.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.686+0000 7f055b600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f055406f890 0x7f05540b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:16.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.686+0000 7f055b600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05540cd930 0x7f0554153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:16.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.686+0000 7f055b600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05540cff30 0x7f055414f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:16.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.686+0000 7f055b600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f05540b5a50 con 0x7f05540cff30 2024-05-28T06:12:16.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.686+0000 7f055b600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f05540b58d0 con 0x7f055406f890 2024-05-28T06:12:16.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.686+0000 7f055b600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f05540b5bd0 con 0x7f05540cd930 2024-05-28T06:12:16.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.686+0000 7f0559600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05540cff30 0x7f055414f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:16.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.686+0000 7f0559600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05540cff30 0x7f055414f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58790/0 (socket says 172.21.15.122:58790) 2024-05-28T06:12:16.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.686+0000 7f0559600640 1 -- 172.21.15.122:0/1041396570 learned_addr learned my addr 172.21.15.122:0/1041396570 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:16.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.686+0000 7f054be00640 1 --2- 172.21.15.122:0/1041396570 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05540cd930 0x7f0554153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:16.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.686+0000 7f0558c00640 1 --2- 172.21.15.122:0/1041396570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f055406f890 0x7f05540b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:16.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.690+0000 7f0559600640 1 -- 172.21.15.122:0/1041396570 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05540cd930 msgr2=0x7f0554153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:16.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.690+0000 7f0559600640 1 --2- 172.21.15.122:0/1041396570 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05540cd930 0x7f0554153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.690+0000 7f0559600640 1 -- 172.21.15.122:0/1041396570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f055406f890 msgr2=0x7f05540b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:16.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.690+0000 7f0559600640 1 --2- 172.21.15.122:0/1041396570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f055406f890 0x7f05540b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.690+0000 7f0559600640 1 -- 172.21.15.122:0/1041396570 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055415ee40 con 0x7f05540cff30 2024-05-28T06:12:16.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.690+0000 7f0559600640 1 --2- 172.21.15.122:0/1041396570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05540cff30 0x7f055414f980 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f054c00c7a0 tx=0x7f054c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:16.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.690+0000 7f0551600640 1 -- 172.21.15.122:0/1041396570 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c003b80 con 0x7f05540cff30 2024-05-28T06:12:16.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.690+0000 7f0551600640 1 -- 172.21.15.122:0/1041396570 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f054c003d20 con 0x7f05540cff30 2024-05-28T06:12:16.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.690+0000 7f055b600640 1 -- 172.21.15.122:0/1041396570 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05540b1330 con 0x7f05540cff30 2024-05-28T06:12:16.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.690+0000 7f0551600640 1 -- 172.21.15.122:0/1041396570 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c00aa90 con 0x7f05540cff30 2024-05-28T06:12:16.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.690+0000 7f055b600640 1 -- 172.21.15.122:0/1041396570 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05541f8190 con 0x7f05540cff30 2024-05-28T06:12:16.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.690+0000 7f055b600640 1 -- 172.21.15.122:0/1041396570 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0554154280 con 0x7f05540cff30 2024-05-28T06:12:16.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.690+0000 7f0551600640 1 -- 172.21.15.122:0/1041396570 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f054c00ac30 con 0x7f05540cff30 2024-05-28T06:12:16.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.690+0000 7f0551600640 1 --2- 172.21.15.122:0/1041396570 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0530068bf0 0x7f053006b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:16.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.690+0000 7f0551600640 1 -- 172.21.15.122:0/1041396570 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5823+0+0 (secure 0 0 0) 0x7f054c084f70 con 0x7f05540cff30 2024-05-28T06:12:16.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.694+0000 7f0558c00640 1 --2- 172.21.15.122:0/1041396570 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0530068bf0 0x7f053006b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:16.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.694+0000 7f0558c00640 1 --2- 172.21.15.122:0/1041396570 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0530068bf0 0x7f053006b0b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0544007bc0 tx=0x7f0544007b10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:16.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.694+0000 7f0551600640 1 -- 172.21.15.122:0/1041396570 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f05540b1330 con 0x7f05540cff30 2024-05-28T06:12:16.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.886+0000 7f055b600640 1 -- 172.21.15.122:0/1041396570 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0554068c40 con 0x7f05540cff30 2024-05-28T06:12:16.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.886+0000 7f0551600640 1 -- 172.21.15.122:0/1041396570 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5184 (secure 0 0 0) 0x7f054c05be20 con 0x7f05540cff30 2024-05-28T06:12:16.886 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:16.886 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":29,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5482,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/257060312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":257060312},{"type":"v1","addr":"172.21.15.153:6834","nonce":257060312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5485,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/573898687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":573898687},{"type":"v1","addr":"172.21.15.153:6835","nonce":573898687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/246840682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":246840682},{"type":"v1","addr":"172.21.15.122:6836","nonce":246840682}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-28T06:09:34.510484+0000","modified":"2024-05-28T06:09:37.531081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1627568336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1627568336},{"type":"v1","addr":"172.21.15.122:6837","nonce":1627568336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":3}]} 2024-05-28T06:12:16.887 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 29 2024-05-28T06:12:16.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.886+0000 7f055b600640 1 -- 172.21.15.122:0/1041396570 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0530068bf0 msgr2=0x7f053006b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:16.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.886+0000 7f055b600640 1 --2- 172.21.15.122:0/1041396570 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0530068bf0 0x7f053006b0b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0544007bc0 tx=0x7f0544007b10 comp rx=0 tx=0).stop 2024-05-28T06:12:16.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.886+0000 7f055b600640 1 -- 172.21.15.122:0/1041396570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05540cff30 msgr2=0x7f055414f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:16.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.886+0000 7f055b600640 1 --2- 172.21.15.122:0/1041396570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05540cff30 0x7f055414f980 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f054c00c7a0 tx=0x7f054c00cc60 comp rx=0 tx=0).stop 2024-05-28T06:12:16.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.886+0000 7f055b600640 1 -- 172.21.15.122:0/1041396570 shutdown_connections 2024-05-28T06:12:16.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.886+0000 7f055b600640 1 --2- 172.21.15.122:0/1041396570 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0530068bf0 0x7f053006b0b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.886+0000 7f055b600640 1 --2- 172.21.15.122:0/1041396570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05540cff30 0x7f055414f980 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.886+0000 7f055b600640 1 --2- 172.21.15.122:0/1041396570 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05540cd930 0x7f0554153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.886+0000 7f055b600640 1 --2- 172.21.15.122:0/1041396570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f055406f890 0x7f05540b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:16.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.886+0000 7f055b600640 1 -- 172.21.15.122:0/1041396570 >> 172.21.15.122:0/1041396570 conn(0x7f055406bd90 msgr2=0x7f0554150d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:16.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.890+0000 7f055b600640 1 -- 172.21.15.122:0/1041396570 shutdown_connections 2024-05-28T06:12:16.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:16.890+0000 7f055b600640 1 -- 172.21.15.122:0/1041396570 wait complete. 2024-05-28T06:12:16.907 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:12:17.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.042+0000 7fb675e00640 1 Processor -- start 2024-05-28T06:12:17.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.042+0000 7fb675e00640 1 -- start start 2024-05-28T06:12:17.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.042+0000 7fb675e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb67015e7a0 0x7fb67006cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:17.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.042+0000 7fb675e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb670162e90 0x7fb6700b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:17.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.042+0000 7fb675e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb67006be00 con 0x7fb6700b4100 2024-05-28T06:12:17.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.042+0000 7fb675e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fb67006c0e0 con 0x7fb670162e90 2024-05-28T06:12:17.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.042+0000 7fb675e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb67006c3c0 con 0x7fb67015e7a0 2024-05-28T06:12:17.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.042+0000 7fb66e000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb670162e90 0x7fb6700b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:17.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.046+0000 7fb66f400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fb6700b4100 0x7fb6700add80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:45340/0 (socket says 172.21.15.122:45340) 2024-05-28T06:12:17.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.046+0000 7fb66f400640 1 -- 172.21.15.122:0/825594506 learned_addr learned my addr 172.21.15.122:0/825594506 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:17.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.046+0000 7fb66ea00640 1 --2- 172.21.15.122:0/825594506 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb67015e7a0 0x7fb67006cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:17.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.046+0000 7fb66e000640 1 -- 172.21.15.122:0/825594506 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb67015e7a0 msgr2=0x7fb67006cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:17.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.046+0000 7fb66e000640 1 --2- 172.21.15.122:0/825594506 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb67015e7a0 0x7fb67006cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.046+0000 7fb66e000640 1 -- 172.21.15.122:0/825594506 >> v1:172.21.15.122:6789/0 conn(0x7fb6700b4100 legacy=0x7fb6700add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:17.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.046+0000 7fb66e000640 1 -- 172.21.15.122:0/825594506 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67006c6a0 con 0x7fb670162e90 2024-05-28T06:12:17.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.046+0000 7fb66d600640 1 -- 172.21.15.122:0/825594506 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2180460716 0 0) 0x7fb67006be00 con 0x7fb6700b4100 2024-05-28T06:12:17.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.046+0000 7fb66e000640 1 --2- 172.21.15.122:0/825594506 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb670162e90 0x7fb6700b3bc0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb65c0097c0 tx=0x7fb65c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cde41b013debaf9 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:17.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.046+0000 7fb66d600640 1 -- 172.21.15.122:0/825594506 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65c0b1070 con 0x7fb670162e90 2024-05-28T06:12:17.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.046+0000 7fb66d600640 1 -- 172.21.15.122:0/825594506 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb65c0ac410 con 0x7fb670162e90 2024-05-28T06:12:17.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.046+0000 7fb66d600640 1 -- 172.21.15.122:0/825594506 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65c0ac7e0 con 0x7fb670162e90 2024-05-28T06:12:17.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb675e00640 1 -- 172.21.15.122:0/825594506 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb670162e90 msgr2=0x7fb6700b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:17.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb675e00640 1 --2- 172.21.15.122:0/825594506 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb670162e90 0x7fb6700b3bc0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb65c0097c0 tx=0x7fb65c01c4a0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb675e00640 1 -- 172.21.15.122:0/825594506 shutdown_connections 2024-05-28T06:12:17.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb675e00640 1 --2- 172.21.15.122:0/825594506 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb670162e90 0x7fb6700b3bc0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb675e00640 1 --2- 172.21.15.122:0/825594506 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb67015e7a0 0x7fb67006cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb675e00640 1 -- 172.21.15.122:0/825594506 >> 172.21.15.122:0/825594506 conn(0x7fb6700b3130 msgr2=0x7fb6700d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:17.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb675e00640 1 -- 172.21.15.122:0/825594506 shutdown_connections 2024-05-28T06:12:17.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb675e00640 1 -- 172.21.15.122:0/825594506 wait complete. 2024-05-28T06:12:17.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb675e00640 1 Processor -- start 2024-05-28T06:12:17.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb675e00640 1 -- start start 2024-05-28T06:12:17.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb675e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6700b4100 0x7fb67015be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:17.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb675e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb67015e7a0 0x7fb670161800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:17.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb675e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb670162e90 0x7fb670159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:17.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb675e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb67015ed00 con 0x7fb67015e7a0 2024-05-28T06:12:17.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb675e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb67015eb80 con 0x7fb670162e90 2024-05-28T06:12:17.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb675e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb6700ae8a0 con 0x7fb6700b4100 2024-05-28T06:12:17.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb66e000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb67015e7a0 0x7fb670161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:17.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb66e000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb67015e7a0 0x7fb670161800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58812/0 (socket says 172.21.15.122:58812) 2024-05-28T06:12:17.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb66e000640 1 -- 172.21.15.122:0/2571329606 learned_addr learned my addr 172.21.15.122:0/2571329606 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:17.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb66e000640 1 -- 172.21.15.122:0/2571329606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6700b4100 msgr2=0x7fb67015be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:17.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb66ea00640 1 --2- 172.21.15.122:0/2571329606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6700b4100 0x7fb67015be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:17.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb66f400640 1 --2- 172.21.15.122:0/2571329606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb670162e90 0x7fb670159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:17.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb66e000640 1 --2- 172.21.15.122:0/2571329606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6700b4100 0x7fb67015be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb66e000640 1 -- 172.21.15.122:0/2571329606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb670162e90 msgr2=0x7fb670159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:17.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb66e000640 1 --2- 172.21.15.122:0/2571329606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb670162e90 0x7fb670159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb66e000640 1 -- 172.21.15.122:0/2571329606 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67015c4b0 con 0x7fb67015e7a0 2024-05-28T06:12:17.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb66ea00640 1 --2- 172.21.15.122:0/2571329606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6700b4100 0x7fb67015be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:17.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb66f400640 1 --2- 172.21.15.122:0/2571329606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb670162e90 0x7fb670159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:17.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.050+0000 7fb66e000640 1 --2- 172.21.15.122:0/2571329606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb67015e7a0 0x7fb670161800 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb65c01a0d0 tx=0x7fb65c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:17.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.054+0000 7fb667400640 1 -- 172.21.15.122:0/2571329606 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65c0b1040 con 0x7fb67015e7a0 2024-05-28T06:12:17.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.054+0000 7fb667400640 1 -- 172.21.15.122:0/2571329606 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb65c0bb070 con 0x7fb67015e7a0 2024-05-28T06:12:17.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.054+0000 7fb667400640 1 -- 172.21.15.122:0/2571329606 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65c0b5410 con 0x7fb67015e7a0 2024-05-28T06:12:17.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.054+0000 7fb675e00640 1 -- 172.21.15.122:0/2571329606 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb67015c790 con 0x7fb67015e7a0 2024-05-28T06:12:17.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.054+0000 7fb675e00640 1 -- 172.21.15.122:0/2571329606 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb67015cd50 con 0x7fb67015e7a0 2024-05-28T06:12:17.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.054+0000 7fb675e00640 1 -- 172.21.15.122:0/2571329606 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb670068c40 con 0x7fb67015e7a0 2024-05-28T06:12:17.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.054+0000 7fb667400640 1 -- 172.21.15.122:0/2571329606 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fb65c0b55b0 con 0x7fb67015e7a0 2024-05-28T06:12:17.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.054+0000 7fb667400640 1 --2- 172.21.15.122:0/2571329606 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb650068bf0 0x7fb65006b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:17.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.054+0000 7fb667400640 1 -- 172.21.15.122:0/2571329606 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5823+0+0 (secure 0 0 0) 0x7fb65c11ed00 con 0x7fb67015e7a0 2024-05-28T06:12:17.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.054+0000 7fb66ea00640 1 --2- 172.21.15.122:0/2571329606 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb650068bf0 0x7fb65006b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:17.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.058+0000 7fb66ea00640 1 --2- 172.21.15.122:0/2571329606 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb650068bf0 0x7fb65006b0b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb660007330 tx=0x7fb66000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:17.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.058+0000 7fb667400640 1 -- 172.21.15.122:0/2571329606 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb65c016090 con 0x7fb67015e7a0 2024-05-28T06:12:17.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.218+0000 7fb675e00640 1 -- 172.21.15.122:0/2571329606 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6700d18e0 con 0x7fb67015e7a0 2024-05-28T06:12:17.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.218+0000 7fb667400640 1 -- 172.21.15.122:0/2571329606 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+16813 (secure 0 0 0) 0x7fb65c0f0ce0 con 0x7fb67015e7a0 2024-05-28T06:12:17.219 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:17.219 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":50,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:12:15.307991+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:09:32.856007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-28T06:09:33.467043+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":50,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":5}]},{"pgid":"7.32","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:12:17.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.222+0000 7fb675e00640 1 -- 172.21.15.122:0/2571329606 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb650068bf0 msgr2=0x7fb65006b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:17.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.222+0000 7fb675e00640 1 --2- 172.21.15.122:0/2571329606 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb650068bf0 0x7fb65006b0b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb660007330 tx=0x7fb66000b040 comp rx=0 tx=0).stop 2024-05-28T06:12:17.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.222+0000 7fb675e00640 1 -- 172.21.15.122:0/2571329606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb67015e7a0 msgr2=0x7fb670161800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:17.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.222+0000 7fb675e00640 1 --2- 172.21.15.122:0/2571329606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb67015e7a0 0x7fb670161800 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb65c01a0d0 tx=0x7fb65c019240 comp rx=0 tx=0).stop 2024-05-28T06:12:17.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.222+0000 7fb675e00640 1 -- 172.21.15.122:0/2571329606 shutdown_connections 2024-05-28T06:12:17.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.222+0000 7fb675e00640 1 --2- 172.21.15.122:0/2571329606 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb650068bf0 0x7fb65006b0b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.222+0000 7fb675e00640 1 --2- 172.21.15.122:0/2571329606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb670162e90 0x7fb670159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.222+0000 7fb675e00640 1 --2- 172.21.15.122:0/2571329606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb67015e7a0 0x7fb670161800 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.222+0000 7fb675e00640 1 --2- 172.21.15.122:0/2571329606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb6700b4100 0x7fb67015be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.222+0000 7fb675e00640 1 -- 172.21.15.122:0/2571329606 >> 172.21.15.122:0/2571329606 conn(0x7fb6700b3130 msgr2=0x7fb6700b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:17.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.222+0000 7fb675e00640 1 -- 172.21.15.122:0/2571329606 shutdown_connections 2024-05-28T06:12:17.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.222+0000 7fb675e00640 1 -- 172.21.15.122:0/2571329606 wait complete. 2024-05-28T06:12:17.241 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-28T06:12:17.241 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:12:17.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.378+0000 7fd374200640 1 Processor -- start 2024-05-28T06:12:17.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.378+0000 7fd374200640 1 -- start start 2024-05-28T06:12:17.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.382+0000 7fd374200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd36c06f890 0x7fd36c0cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:17.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.382+0000 7fd374200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd36c0cd930 0x7fd36c0b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:17.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.382+0000 7fd374200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd36c0d0310 con 0x7fd36c0cff30 2024-05-28T06:12:17.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.382+0000 7fd374200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fd36c15be20 con 0x7fd36c0cd930 2024-05-28T06:12:17.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.382+0000 7fd374200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd36c15c100 con 0x7fd36c06f890 2024-05-28T06:12:17.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.382+0000 7fd372200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd36c0cd930 0x7fd36c0b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:17.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.382+0000 7fd372200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd36c0cd930 0x7fd36c0b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58814/0 (socket says 172.21.15.122:58814) 2024-05-28T06:12:17.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.382+0000 7fd372200640 1 -- 172.21.15.122:0/2672022388 learned_addr learned my addr 172.21.15.122:0/2672022388 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:17.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.382+0000 7fd370e00640 1 --2- 172.21.15.122:0/2672022388 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd36c06f890 0x7fd36c0cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:17.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.382+0000 7fd372200640 1 -- 172.21.15.122:0/2672022388 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd36c06f890 msgr2=0x7fd36c0cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:17.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.382+0000 7fd372200640 1 --2- 172.21.15.122:0/2672022388 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd36c06f890 0x7fd36c0cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.382+0000 7fd372200640 1 -- 172.21.15.122:0/2672022388 >> v1:172.21.15.153:6789/0 conn(0x7fd36c0cff30 legacy=0x7fd36c06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:17.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.382+0000 7fd372200640 1 -- 172.21.15.122:0/2672022388 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36c15c3e0 con 0x7fd36c0cd930 2024-05-28T06:12:17.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.382+0000 7fd370e00640 1 --2- 172.21.15.122:0/2672022388 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd36c06f890 0x7fd36c0cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:17.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.386+0000 7fd372200640 1 --2- 172.21.15.122:0/2672022388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd36c0cd930 0x7fd36c0b49b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fd36400bb10 tx=0x7fd36401ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3064f79da81e0a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:17.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.386+0000 7fd36be00640 1 -- 172.21.15.122:0/2672022388 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3640b4070 con 0x7fd36c0cd930 2024-05-28T06:12:17.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.386+0000 7fd36be00640 1 -- 172.21.15.122:0/2672022388 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3640a7c70 con 0x7fd36c0cd930 2024-05-28T06:12:17.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.386+0000 7fd36be00640 1 -- 172.21.15.122:0/2672022388 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3640af660 con 0x7fd36c0cd930 2024-05-28T06:12:17.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.386+0000 7fd374200640 1 -- 172.21.15.122:0/2672022388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd36c0cd930 msgr2=0x7fd36c0b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:17.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.386+0000 7fd374200640 1 --2- 172.21.15.122:0/2672022388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd36c0cd930 0x7fd36c0b49b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fd36400bb10 tx=0x7fd36401ec00 comp rx=0 tx=0).stop 2024-05-28T06:12:17.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.386+0000 7fd374200640 1 -- 172.21.15.122:0/2672022388 shutdown_connections 2024-05-28T06:12:17.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.386+0000 7fd374200640 1 --2- 172.21.15.122:0/2672022388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd36c0cd930 0x7fd36c0b49b0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.386+0000 7fd374200640 1 --2- 172.21.15.122:0/2672022388 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd36c06f890 0x7fd36c0cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.386+0000 7fd374200640 1 -- 172.21.15.122:0/2672022388 >> 172.21.15.122:0/2672022388 conn(0x7fd36c06bd90 msgr2=0x7fd36c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:17.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.386+0000 7fd374200640 1 -- 172.21.15.122:0/2672022388 shutdown_connections 2024-05-28T06:12:17.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.386+0000 7fd374200640 1 -- 172.21.15.122:0/2672022388 wait complete. 2024-05-28T06:12:17.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.386+0000 7fd374200640 1 Processor -- start 2024-05-28T06:12:17.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.386+0000 7fd374200640 1 -- start start 2024-05-28T06:12:17.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd374200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd36c06f890 0x7fd36c141f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:17.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd374200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd36c0cd930 0x7fd36c144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:17.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd374200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd36c0cff30 0x7fd36c147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:17.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd374200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd36c0b5880 con 0x7fd36c06f890 2024-05-28T06:12:17.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd374200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd36c0b5700 con 0x7fd36c0cff30 2024-05-28T06:12:17.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd374200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd36c0b5a00 con 0x7fd36c0cd930 2024-05-28T06:12:17.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd371800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd36c06f890 0x7fd36c141f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:17.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd371800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd36c06f890 0x7fd36c141f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58820/0 (socket says 172.21.15.122:58820) 2024-05-28T06:12:17.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd371800640 1 -- 172.21.15.122:0/2855762889 learned_addr learned my addr 172.21.15.122:0/2855762889 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:17.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd370e00640 1 --2- 172.21.15.122:0/2855762889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd36c0cd930 0x7fd36c144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:17.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd372200640 1 --2- 172.21.15.122:0/2855762889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd36c0cff30 0x7fd36c147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:17.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd371800640 1 -- 172.21.15.122:0/2855762889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd36c0cd930 msgr2=0x7fd36c144fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:17.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd371800640 1 --2- 172.21.15.122:0/2855762889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd36c0cd930 0x7fd36c144fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd371800640 1 -- 172.21.15.122:0/2855762889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd36c0cff30 msgr2=0x7fd36c147ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:17.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd371800640 1 --2- 172.21.15.122:0/2855762889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd36c0cff30 0x7fd36c147ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd371800640 1 -- 172.21.15.122:0/2855762889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36c1454e0 con 0x7fd36c06f890 2024-05-28T06:12:17.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd372200640 1 --2- 172.21.15.122:0/2855762889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd36c0cff30 0x7fd36c147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:12:17.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd370e00640 1 --2- 172.21.15.122:0/2855762889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd36c0cd930 0x7fd36c144fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:12:17.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd371800640 1 --2- 172.21.15.122:0/2855762889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd36c06f890 0x7fd36c141f90 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd36000c730 tx=0x7fd36000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:17.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd369600640 1 -- 172.21.15.122:0/2855762889 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd360003ba0 con 0x7fd36c06f890 2024-05-28T06:12:17.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd369600640 1 -- 172.21.15.122:0/2855762889 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd360003d60 con 0x7fd36c06f890 2024-05-28T06:12:17.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd374200640 1 -- 172.21.15.122:0/2855762889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd36c14c4f0 con 0x7fd36c06f890 2024-05-28T06:12:17.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd369600640 1 -- 172.21.15.122:0/2855762889 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36000aa30 con 0x7fd36c06f890 2024-05-28T06:12:17.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd374200640 1 -- 172.21.15.122:0/2855762889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd36c14cab0 con 0x7fd36c06f890 2024-05-28T06:12:17.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd374200640 1 -- 172.21.15.122:0/2855762889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd36c068c40 con 0x7fd36c06f890 2024-05-28T06:12:17.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.390+0000 7fd369600640 1 -- 172.21.15.122:0/2855762889 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fd36000abd0 con 0x7fd36c06f890 2024-05-28T06:12:17.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.394+0000 7fd369600640 1 --2- 172.21.15.122:0/2855762889 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd34c068bf0 0x7fd34c06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:17.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.394+0000 7fd369600640 1 -- 172.21.15.122:0/2855762889 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5823+0+0 (secure 0 0 0) 0x7fd360087a50 con 0x7fd36c06f890 2024-05-28T06:12:17.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.394+0000 7fd370e00640 1 --2- 172.21.15.122:0/2855762889 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd34c068bf0 0x7fd34c06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:17.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.394+0000 7fd370e00640 1 --2- 172.21.15.122:0/2855762889 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd34c068bf0 0x7fd34c06b0b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd358006fd0 tx=0x7fd358008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:17.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.398+0000 7fd369600640 1 -- 172.21.15.122:0/2855762889 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd360057080 con 0x7fd36c06f890 2024-05-28T06:12:17.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.586+0000 7fd374200640 1 -- 172.21.15.122:0/2855762889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd36c1590c0 con 0x7fd36c06f890 2024-05-28T06:12:17.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.586+0000 7fd369600640 1 -- 172.21.15.122:0/2855762889 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5184 (secure 0 0 0) 0x7fd360056980 con 0x7fd36c06f890 2024-05-28T06:12:17.587 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:17.587 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":29,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5482,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/257060312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":257060312},{"type":"v1","addr":"172.21.15.153:6834","nonce":257060312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5485,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/573898687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":573898687},{"type":"v1","addr":"172.21.15.153:6835","nonce":573898687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/246840682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":246840682},{"type":"v1","addr":"172.21.15.122:6836","nonce":246840682}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-28T06:09:34.510484+0000","modified":"2024-05-28T06:09:37.531081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1627568336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1627568336},{"type":"v1","addr":"172.21.15.122:6837","nonce":1627568336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":3}]} 2024-05-28T06:12:17.587 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 29 2024-05-28T06:12:17.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.590+0000 7fd374200640 1 -- 172.21.15.122:0/2855762889 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd34c068bf0 msgr2=0x7fd34c06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:17.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.590+0000 7fd374200640 1 --2- 172.21.15.122:0/2855762889 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd34c068bf0 0x7fd34c06b0b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd358006fd0 tx=0x7fd358008040 comp rx=0 tx=0).stop 2024-05-28T06:12:17.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.590+0000 7fd374200640 1 -- 172.21.15.122:0/2855762889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd36c06f890 msgr2=0x7fd36c141f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:17.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.590+0000 7fd374200640 1 --2- 172.21.15.122:0/2855762889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd36c06f890 0x7fd36c141f90 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd36000c730 tx=0x7fd36000cbf0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.590+0000 7fd374200640 1 -- 172.21.15.122:0/2855762889 shutdown_connections 2024-05-28T06:12:17.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.590+0000 7fd374200640 1 --2- 172.21.15.122:0/2855762889 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd34c068bf0 0x7fd34c06b0b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.590+0000 7fd374200640 1 --2- 172.21.15.122:0/2855762889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd36c0cff30 0x7fd36c147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.590+0000 7fd374200640 1 --2- 172.21.15.122:0/2855762889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd36c0cd930 0x7fd36c144fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.590+0000 7fd374200640 1 --2- 172.21.15.122:0/2855762889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd36c06f890 0x7fd36c141f90 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.590+0000 7fd374200640 1 -- 172.21.15.122:0/2855762889 >> 172.21.15.122:0/2855762889 conn(0x7fd36c06bd90 msgr2=0x7fd36c0729c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:17.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.590+0000 7fd374200640 1 -- 172.21.15.122:0/2855762889 shutdown_connections 2024-05-28T06:12:17.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.590+0000 7fd374200640 1 -- 172.21.15.122:0/2855762889 wait complete. 2024-05-28T06:12:17.608 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:12:17.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.746+0000 7f3ec6e00640 1 Processor -- start 2024-05-28T06:12:17.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.746+0000 7f3ec6e00640 1 -- start start 2024-05-28T06:12:17.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.746+0000 7f3ec6e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3ec00b3dc0 0x7f3ec00d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:17.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.746+0000 7f3ec6e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ec00b46c0 con 0x7f3ec015ea20 2024-05-28T06:12:17.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.746+0000 7f3ec6e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ec00b49a0 con 0x7f3ec0073c80 2024-05-28T06:12:17.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.746+0000 7f3ec6e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f3ec015ee00 con 0x7f3ec00b3dc0 2024-05-28T06:12:17.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.746+0000 7f3ebfe00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f3ec015ea20 0x7f3ec00b4fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:45356/0 (socket says 172.21.15.122:45356) 2024-05-28T06:12:17.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.746+0000 7f3ebfe00640 1 -- 172.21.15.122:0/553139301 learned_addr learned my addr 172.21.15.122:0/553139301 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:17.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.746+0000 7f3ec4e00640 1 --2- 172.21.15.122:0/553139301 >> v2:172.21.15.122:3300/0 conn(0x7f3ec00b3dc0 0x7f3ec00d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:17.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.746+0000 7f3ebea00640 1 -- 172.21.15.122:0/553139301 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2324503430 0 0) 0x7f3ec00b46c0 con 0x7f3ec015ea20 2024-05-28T06:12:17.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.746+0000 7f3ebea00640 1 -- 172.21.15.122:0/553139301 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ea4003530 con 0x7f3ec015ea20 2024-05-28T06:12:17.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.746+0000 7f3ec4e00640 1 -- 172.21.15.122:0/553139301 >> v1:172.21.15.153:6789/0 conn(0x7f3ec0073c80 legacy=0x7f3ec00b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:17.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.746+0000 7f3ec4e00640 1 -- 172.21.15.122:0/553139301 >> v1:172.21.15.122:6789/0 conn(0x7f3ec015ea20 legacy=0x7f3ec00b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:17.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.746+0000 7f3ec4e00640 1 -- 172.21.15.122:0/553139301 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec00d1e50 con 0x7f3ec00b3dc0 2024-05-28T06:12:17.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.750+0000 7f3ec4e00640 1 --2- 172.21.15.122:0/553139301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec00b3dc0 0x7f3ec00d0e10 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8009d90 tx=0x7f3eb801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56db598c5a3c27ce server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:17.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.750+0000 7f3ebea00640 1 -- 172.21.15.122:0/553139301 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb80b2070 con 0x7f3ec00b3dc0 2024-05-28T06:12:17.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.750+0000 7f3ebea00640 1 -- 172.21.15.122:0/553139301 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb80a5940 con 0x7f3ec00b3dc0 2024-05-28T06:12:17.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.750+0000 7f3ebea00640 1 -- 172.21.15.122:0/553139301 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb80a5d10 con 0x7f3ec00b3dc0 2024-05-28T06:12:17.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.750+0000 7f3ec6e00640 1 -- 172.21.15.122:0/553139301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec00b3dc0 msgr2=0x7f3ec00d0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:17.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.750+0000 7f3ec6e00640 1 --2- 172.21.15.122:0/553139301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec00b3dc0 0x7f3ec00d0e10 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8009d90 tx=0x7f3eb801c970 comp rx=0 tx=0).stop 2024-05-28T06:12:17.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.750+0000 7f3ec6e00640 1 -- 172.21.15.122:0/553139301 shutdown_connections 2024-05-28T06:12:17.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.750+0000 7f3ec6e00640 1 --2- 172.21.15.122:0/553139301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec00b3dc0 0x7f3ec00d0e10 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.750+0000 7f3ec6e00640 1 -- 172.21.15.122:0/553139301 >> 172.21.15.122:0/553139301 conn(0x7f3ec00b6c10 msgr2=0x7f3ec00b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:17.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.750+0000 7f3ec6e00640 1 -- 172.21.15.122:0/553139301 shutdown_connections 2024-05-28T06:12:17.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.750+0000 7f3ec6e00640 1 -- 172.21.15.122:0/553139301 wait complete. 2024-05-28T06:12:17.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3ec6e00640 1 Processor -- start 2024-05-28T06:12:17.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3ec6e00640 1 -- start start 2024-05-28T06:12:17.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3ec6e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec0073c80 0x7f3ec014f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:17.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3ec6e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ec00b3dc0 0x7f3ec01456b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:17.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3ec6e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ec015ea20 0x7f3ec0152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:17.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3ec6e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec00ceae0 con 0x7f3ec0073c80 2024-05-28T06:12:17.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3ec6e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec00ce960 con 0x7f3ec015ea20 2024-05-28T06:12:17.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3ec6e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3ec016c520 con 0x7f3ec00b3dc0 2024-05-28T06:12:17.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3ebfe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec0073c80 0x7f3ec014f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:17.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3ebfe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec0073c80 0x7f3ec014f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58834/0 (socket says 172.21.15.122:58834) 2024-05-28T06:12:17.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3ebfe00640 1 -- 172.21.15.122:0/2083479964 learned_addr learned my addr 172.21.15.122:0/2083479964 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:17.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3ec4e00640 1 --2- 172.21.15.122:0/2083479964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ec015ea20 0x7f3ec0152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:17.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3ebf400640 1 --2- 172.21.15.122:0/2083479964 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ec00b3dc0 0x7f3ec01456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:17.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3ebfe00640 1 -- 172.21.15.122:0/2083479964 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ec00b3dc0 msgr2=0x7f3ec01456b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:17.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3ebfe00640 1 --2- 172.21.15.122:0/2083479964 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ec00b3dc0 0x7f3ec01456b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3ebfe00640 1 -- 172.21.15.122:0/2083479964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ec015ea20 msgr2=0x7f3ec0152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:17.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3ebfe00640 1 --2- 172.21.15.122:0/2083479964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ec015ea20 0x7f3ec0152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3ebfe00640 1 -- 172.21.15.122:0/2083479964 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec014e350 con 0x7f3ec0073c80 2024-05-28T06:12:17.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3ebfe00640 1 --2- 172.21.15.122:0/2083479964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec0073c80 0x7f3ec014f110 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f3eb000c500 tx=0x7f3eb000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:17.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3eb7e00640 1 -- 172.21.15.122:0/2083479964 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0017070 con 0x7f3ec0073c80 2024-05-28T06:12:17.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3eb7e00640 1 -- 172.21.15.122:0/2083479964 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb0005cf0 con 0x7f3ec0073c80 2024-05-28T06:12:17.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3eb7e00640 1 -- 172.21.15.122:0/2083479964 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb00072f0 con 0x7f3ec0073c80 2024-05-28T06:12:17.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3ec6e00640 1 -- 172.21.15.122:0/2083479964 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec014e630 con 0x7f3ec0073c80 2024-05-28T06:12:17.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3ec6e00640 1 -- 172.21.15.122:0/2083479964 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec0152a40 con 0x7f3ec0073c80 2024-05-28T06:12:17.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.754+0000 7f3ec6e00640 1 -- 172.21.15.122:0/2083479964 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec0068c40 con 0x7f3ec0073c80 2024-05-28T06:12:17.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.758+0000 7f3eb7e00640 1 -- 172.21.15.122:0/2083479964 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f3eb001a070 con 0x7f3ec0073c80 2024-05-28T06:12:17.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.758+0000 7f3eb7e00640 1 --2- 172.21.15.122:0/2083479964 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3e9c068bf0 0x7f3e9c06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:17.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.758+0000 7f3eb7e00640 1 -- 172.21.15.122:0/2083479964 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5823+0+0 (secure 0 0 0) 0x7f3eb0086f30 con 0x7f3ec0073c80 2024-05-28T06:12:17.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.758+0000 7f3ebf400640 1 --2- 172.21.15.122:0/2083479964 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3e9c068bf0 0x7f3e9c06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:17.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.758+0000 7f3ebf400640 1 --2- 172.21.15.122:0/2083479964 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3e9c068bf0 0x7f3e9c06b0b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3ec006c5b0 tx=0x7f3ea8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:17.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.762+0000 7f3eb7e00640 1 -- 172.21.15.122:0/2083479964 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3eb008b070 con 0x7f3ec0073c80 2024-05-28T06:12:17.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.954+0000 7f3ec6e00640 1 -- 172.21.15.122:0/2083479964 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ec015bb60 con 0x7f3ec0073c80 2024-05-28T06:12:17.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.954+0000 7f3eb7e00640 1 -- 172.21.15.122:0/2083479964 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5184 (secure 0 0 0) 0x7f3eb0055fa0 con 0x7f3ec0073c80 2024-05-28T06:12:17.954 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:17.954 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":29,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5482,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/257060312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":257060312},{"type":"v1","addr":"172.21.15.153:6834","nonce":257060312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5485,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/573898687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":573898687},{"type":"v1","addr":"172.21.15.153:6835","nonce":573898687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/246840682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":246840682},{"type":"v1","addr":"172.21.15.122:6836","nonce":246840682}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-28T06:09:34.510484+0000","modified":"2024-05-28T06:09:37.531081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1627568336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1627568336},{"type":"v1","addr":"172.21.15.122:6837","nonce":1627568336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":3}]} 2024-05-28T06:12:17.955 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 29 2024-05-28T06:12:17.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.954+0000 7f3ec6e00640 1 -- 172.21.15.122:0/2083479964 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3e9c068bf0 msgr2=0x7f3e9c06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:17.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.954+0000 7f3ec6e00640 1 --2- 172.21.15.122:0/2083479964 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3e9c068bf0 0x7f3e9c06b0b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3ec006c5b0 tx=0x7f3ea8009040 comp rx=0 tx=0).stop 2024-05-28T06:12:17.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.954+0000 7f3ec6e00640 1 -- 172.21.15.122:0/2083479964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec0073c80 msgr2=0x7f3ec014f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:17.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.954+0000 7f3ec6e00640 1 --2- 172.21.15.122:0/2083479964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec0073c80 0x7f3ec014f110 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f3eb000c500 tx=0x7f3eb000c9c0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.954+0000 7f3ec6e00640 1 -- 172.21.15.122:0/2083479964 shutdown_connections 2024-05-28T06:12:17.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.954+0000 7f3ec6e00640 1 --2- 172.21.15.122:0/2083479964 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3e9c068bf0 0x7f3e9c06b0b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.954+0000 7f3ec6e00640 1 --2- 172.21.15.122:0/2083479964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ec015ea20 0x7f3ec0152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.954+0000 7f3ec6e00640 1 --2- 172.21.15.122:0/2083479964 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ec00b3dc0 0x7f3ec01456b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.954+0000 7f3ec6e00640 1 --2- 172.21.15.122:0/2083479964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec0073c80 0x7f3ec014f110 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:17.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.954+0000 7f3ec6e00640 1 -- 172.21.15.122:0/2083479964 >> 172.21.15.122:0/2083479964 conn(0x7f3ec00b6c10 msgr2=0x7f3ec00b4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:17.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.954+0000 7f3ec6e00640 1 -- 172.21.15.122:0/2083479964 shutdown_connections 2024-05-28T06:12:17.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:17.954+0000 7f3ec6e00640 1 -- 172.21.15.122:0/2083479964 wait complete. 2024-05-28T06:12:17.974 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:12:18.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.110+0000 7f2764600640 1 Processor -- start 2024-05-28T06:12:18.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.110+0000 7f2764600640 1 -- start start 2024-05-28T06:12:18.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.110+0000 7f2764600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f275c06f890 0x7f275c0cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:18.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.110+0000 7f2764600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f275c0cd930 0x7f275c0b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:18.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.110+0000 7f2764600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f275c0d0310 con 0x7f275c0cff30 2024-05-28T06:12:18.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.110+0000 7f2764600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f275c15be20 con 0x7f275c06f890 2024-05-28T06:12:18.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.110+0000 7f2764600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f275c15c100 con 0x7f275c0cd930 2024-05-28T06:12:18.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.110+0000 7f2761200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f275c06f890 0x7f275c0cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:18.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.110+0000 7f2761c00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f275c0cff30 0x7f275c06f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:45372/0 (socket says 172.21.15.122:45372) 2024-05-28T06:12:18.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.110+0000 7f2761c00640 1 -- 172.21.15.122:0/2326263280 learned_addr learned my addr 172.21.15.122:0/2326263280 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:18.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.110+0000 7f2762600640 1 --2- 172.21.15.122:0/2326263280 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f275c0cd930 0x7f275c0b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:18.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.114+0000 7f2761200640 1 -- 172.21.15.122:0/2326263280 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f275c0cd930 msgr2=0x7f275c0b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:18.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.114+0000 7f2761200640 1 --2- 172.21.15.122:0/2326263280 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f275c0cd930 0x7f275c0b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:18.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.114+0000 7f2761200640 1 -- 172.21.15.122:0/2326263280 >> v1:172.21.15.122:6789/0 conn(0x7f275c0cff30 legacy=0x7f275c06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:18.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.114+0000 7f2761200640 1 -- 172.21.15.122:0/2326263280 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275c15c3e0 con 0x7f275c06f890 2024-05-28T06:12:18.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.114+0000 7f2762600640 1 --2- 172.21.15.122:0/2326263280 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f275c0cd930 0x7f275c0b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:18.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.114+0000 7f2761200640 1 --2- 172.21.15.122:0/2326263280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f275c06f890 0x7f275c0cd3f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f27480097c0 tx=0x7f274801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405c9729fc21860 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:18.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.114+0000 7f275be00640 1 -- 172.21.15.122:0/2326263280 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27480ab610 con 0x7f275c06f890 2024-05-28T06:12:18.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.114+0000 7f275be00640 1 -- 172.21.15.122:0/2326263280 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27480b0070 con 0x7f275c06f890 2024-05-28T06:12:18.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.114+0000 7f275be00640 1 -- 172.21.15.122:0/2326263280 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27480ab9d0 con 0x7f275c06f890 2024-05-28T06:12:18.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.114+0000 7f2764600640 1 -- 172.21.15.122:0/2326263280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f275c06f890 msgr2=0x7f275c0cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:18.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.114+0000 7f2764600640 1 --2- 172.21.15.122:0/2326263280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f275c06f890 0x7f275c0cd3f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f27480097c0 tx=0x7f274801c470 comp rx=0 tx=0).stop 2024-05-28T06:12:18.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.114+0000 7f2764600640 1 -- 172.21.15.122:0/2326263280 shutdown_connections 2024-05-28T06:12:18.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.114+0000 7f2764600640 1 --2- 172.21.15.122:0/2326263280 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f275c0cd930 0x7f275c0b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:18.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2764600640 1 --2- 172.21.15.122:0/2326263280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f275c06f890 0x7f275c0cd3f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:18.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2764600640 1 -- 172.21.15.122:0/2326263280 >> 172.21.15.122:0/2326263280 conn(0x7f275c06bd90 msgr2=0x7f275c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:18.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2764600640 1 -- 172.21.15.122:0/2326263280 shutdown_connections 2024-05-28T06:12:18.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2764600640 1 -- 172.21.15.122:0/2326263280 wait complete. 2024-05-28T06:12:18.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2764600640 1 Processor -- start 2024-05-28T06:12:18.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2764600640 1 -- start start 2024-05-28T06:12:18.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2764600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f275c06f890 0x7f275c157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:18.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2764600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f275c0cd930 0x7f275c145b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:18.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2764600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f275c0cff30 0x7f275c14e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:18.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2764600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f275c0b5700 con 0x7f275c0cff30 2024-05-28T06:12:18.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2764600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f275c0b5880 con 0x7f275c0cd930 2024-05-28T06:12:18.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2764600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f275c0b5a00 con 0x7f275c06f890 2024-05-28T06:12:18.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2762600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f275c0cff30 0x7f275c14e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:18.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2762600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f275c0cff30 0x7f275c14e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58848/0 (socket says 172.21.15.122:58848) 2024-05-28T06:12:18.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2762600640 1 -- 172.21.15.122:0/1896692457 learned_addr learned my addr 172.21.15.122:0/1896692457 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:18.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2761c00640 1 --2- 172.21.15.122:0/1896692457 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f275c06f890 0x7f275c157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:18.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2761200640 1 --2- 172.21.15.122:0/1896692457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f275c0cd930 0x7f275c145b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:18.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2762600640 1 -- 172.21.15.122:0/1896692457 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f275c06f890 msgr2=0x7f275c157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:18.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2762600640 1 --2- 172.21.15.122:0/1896692457 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f275c06f890 0x7f275c157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:18.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2762600640 1 -- 172.21.15.122:0/1896692457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f275c0cd930 msgr2=0x7f275c145b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:18.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2762600640 1 --2- 172.21.15.122:0/1896692457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f275c0cd930 0x7f275c145b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:18.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2762600640 1 -- 172.21.15.122:0/1896692457 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275c150c80 con 0x7f275c0cff30 2024-05-28T06:12:18.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2762600640 1 --2- 172.21.15.122:0/1896692457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f275c0cff30 0x7f275c14e4a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f275400cef0 tx=0x7f275400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:18.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2759600640 1 -- 172.21.15.122:0/1896692457 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275401a070 con 0x7f275c0cff30 2024-05-28T06:12:18.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2759600640 1 -- 172.21.15.122:0/1896692457 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f275400d860 con 0x7f275c0cff30 2024-05-28T06:12:18.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.118+0000 7f2759600640 1 -- 172.21.15.122:0/1896692457 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275400dc50 con 0x7f275c0cff30 2024-05-28T06:12:18.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.122+0000 7f2764600640 1 -- 172.21.15.122:0/1896692457 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f275c0ad9e0 con 0x7f275c0cff30 2024-05-28T06:12:18.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.122+0000 7f2764600640 1 -- 172.21.15.122:0/1896692457 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f275c0adfa0 con 0x7f275c0cff30 2024-05-28T06:12:18.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.122+0000 7f2764600640 1 -- 172.21.15.122:0/1896692457 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f275c068c40 con 0x7f275c0cff30 2024-05-28T06:12:18.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.122+0000 7f2759600640 1 -- 172.21.15.122:0/1896692457 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f275401d070 con 0x7f275c0cff30 2024-05-28T06:12:18.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.122+0000 7f2759600640 1 --2- 172.21.15.122:0/1896692457 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f273c068bf0 0x7f273c06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:18.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.122+0000 7f2759600640 1 -- 172.21.15.122:0/1896692457 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5823+0+0 (secure 0 0 0) 0x7f2754085ac0 con 0x7f275c0cff30 2024-05-28T06:12:18.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.122+0000 7f2761c00640 1 --2- 172.21.15.122:0/1896692457 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f273c068bf0 0x7f273c06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:18.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.122+0000 7f2761c00640 1 --2- 172.21.15.122:0/1896692457 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f273c068bf0 0x7f273c06b0b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2750000f70 tx=0x7f2750009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:18.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.126+0000 7f2759600640 1 -- 172.21.15.122:0/1896692457 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2754057bf0 con 0x7f275c0cff30 2024-05-28T06:12:18.274 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:12:18.277 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:12:18.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.286+0000 7f2764600640 1 -- 172.21.15.122:0/1896692457 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f275c155f70 con 0x7f275c0cff30 2024-05-28T06:12:18.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.286+0000 7f2759600640 1 -- 172.21.15.122:0/1896692457 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+16813 (secure 0 0 0) 0x7f27540574f0 con 0x7f275c0cff30 2024-05-28T06:12:18.286 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:18.286 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":50,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:12:15.307991+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:09:32.856007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-28T06:09:33.467043+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":50,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":5}]},{"pgid":"7.32","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:12:18.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.286+0000 7f2764600640 1 -- 172.21.15.122:0/1896692457 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f273c068bf0 msgr2=0x7f273c06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:18.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.286+0000 7f2764600640 1 --2- 172.21.15.122:0/1896692457 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f273c068bf0 0x7f273c06b0b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2750000f70 tx=0x7f2750009040 comp rx=0 tx=0).stop 2024-05-28T06:12:18.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.286+0000 7f2764600640 1 -- 172.21.15.122:0/1896692457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f275c0cff30 msgr2=0x7f275c14e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:18.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.286+0000 7f2764600640 1 --2- 172.21.15.122:0/1896692457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f275c0cff30 0x7f275c14e4a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f275400cef0 tx=0x7f275400a710 comp rx=0 tx=0).stop 2024-05-28T06:12:18.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.286+0000 7f2764600640 1 -- 172.21.15.122:0/1896692457 shutdown_connections 2024-05-28T06:12:18.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.286+0000 7f2764600640 1 --2- 172.21.15.122:0/1896692457 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f273c068bf0 0x7f273c06b0b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:18.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.286+0000 7f2764600640 1 --2- 172.21.15.122:0/1896692457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f275c0cff30 0x7f275c14e4a0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:18.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.286+0000 7f2764600640 1 --2- 172.21.15.122:0/1896692457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f275c0cd930 0x7f275c145b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:18.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.286+0000 7f2764600640 1 --2- 172.21.15.122:0/1896692457 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f275c06f890 0x7f275c157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:18.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.286+0000 7f2764600640 1 -- 172.21.15.122:0/1896692457 >> 172.21.15.122:0/1896692457 conn(0x7f275c06bd90 msgr2=0x7f275c06c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:18.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.286+0000 7f2764600640 1 -- 172.21.15.122:0/1896692457 shutdown_connections 2024-05-28T06:12:18.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.290+0000 7f2764600640 1 -- 172.21.15.122:0/1896692457 wait complete. 2024-05-28T06:12:18.308 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-28T06:12:18.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.506+0000 7f03d0000640 1 Processor -- start 2024-05-28T06:12:18.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.506+0000 7f03d0000640 1 -- start start 2024-05-28T06:12:18.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.510+0000 7f03d0000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f03c815e980 0x7f03c80b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:18.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.510+0000 7f03d0000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03c80b4200 con 0x7f03c80cea60 2024-05-28T06:12:18.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.510+0000 7f03d0000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03c8162b30 con 0x7f03c8162600 2024-05-28T06:12:18.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.510+0000 7f03d0000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f03c806e270 con 0x7f03c815e980 2024-05-28T06:12:18.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.510+0000 7f03cd600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f03c815e980 0x7f03c80b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:18.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.510+0000 7f03ce000640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f03c80cea60 0x7f03c806e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:45388/0 (socket says 172.21.15.122:45388) 2024-05-28T06:12:18.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.510+0000 7f03ce000640 1 -- 172.21.15.122:0/3426594074 learned_addr learned my addr 172.21.15.122:0/3426594074 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:18.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.510+0000 7f03cd600640 1 -- 172.21.15.122:0/3426594074 >> v1:172.21.15.153:6789/0 conn(0x7f03c8162600 legacy=0x7f03c806f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:18.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.510+0000 7f03cd600640 1 -- 172.21.15.122:0/3426594074 >> v1:172.21.15.122:6789/0 conn(0x7f03c80cea60 legacy=0x7f03c806e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:18.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.510+0000 7f03c7e00640 1 -- 172.21.15.122:0/3426594074 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4061603196 0 0) 0x7f03c80b4200 con 0x7f03c80cea60 2024-05-28T06:12:18.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.510+0000 7f03cd600640 1 -- 172.21.15.122:0/3426594074 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c8162e10 con 0x7f03c815e980 2024-05-28T06:12:18.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.514+0000 7f03cd600640 1 --2- 172.21.15.122:0/3426594074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03c815e980 0x7f03c80b3cc0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f03c806e3f0 tx=0x7f03bc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc9cb6a8f6c8baa2 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:18.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.514+0000 7f03c7e00640 1 -- 172.21.15.122:0/3426594074 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc0ab430 con 0x7f03c815e980 2024-05-28T06:12:18.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.514+0000 7f03c7e00640 1 -- 172.21.15.122:0/3426594074 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03bc0b0070 con 0x7f03c815e980 2024-05-28T06:12:18.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.514+0000 7f03c7e00640 1 -- 172.21.15.122:0/3426594074 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc0ab7f0 con 0x7f03c815e980 2024-05-28T06:12:18.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.514+0000 7f03d0000640 1 -- 172.21.15.122:0/3426594074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03c815e980 msgr2=0x7f03c80b3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:18.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.514+0000 7f03d0000640 1 --2- 172.21.15.122:0/3426594074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03c815e980 0x7f03c80b3cc0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f03c806e3f0 tx=0x7f03bc01c430 comp rx=0 tx=0).stop 2024-05-28T06:12:18.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.514+0000 7f03d0000640 1 -- 172.21.15.122:0/3426594074 shutdown_connections 2024-05-28T06:12:18.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.514+0000 7f03d0000640 1 --2- 172.21.15.122:0/3426594074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03c815e980 0x7f03c80b3cc0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:18.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.514+0000 7f03d0000640 1 -- 172.21.15.122:0/3426594074 >> 172.21.15.122:0/3426594074 conn(0x7f03c8062a40 msgr2=0x7f03c806b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:18.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.514+0000 7f03d0000640 1 -- 172.21.15.122:0/3426594074 shutdown_connections 2024-05-28T06:12:18.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.514+0000 7f03d0000640 1 -- 172.21.15.122:0/3426594074 wait complete. 2024-05-28T06:12:18.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.514+0000 7f03d0000640 1 Processor -- start 2024-05-28T06:12:18.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.514+0000 7f03d0000640 1 -- start start 2024-05-28T06:12:18.516 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03d0000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03c80cea60 0x7f03c8161c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:18.517 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03d0000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03c815e980 0x7f03c814e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:18.517 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03d0000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03c8162600 0x7f03c8152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:18.517 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03d0000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f03c815eee0 con 0x7f03c80cea60 2024-05-28T06:12:18.517 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03d0000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f03c815ed60 con 0x7f03c815e980 2024-05-28T06:12:18.517 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03d0000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f03c806f220 con 0x7f03c8162600 2024-05-28T06:12:18.517 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03cd600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03c80cea60 0x7f03c8161c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:18.517 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03cd600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03c80cea60 0x7f03c8161c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58868/0 (socket says 172.21.15.122:58868) 2024-05-28T06:12:18.517 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03cd600640 1 -- 172.21.15.122:0/1584600317 learned_addr learned my addr 172.21.15.122:0/1584600317 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:18.517 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03ccc00640 1 --2- 172.21.15.122:0/1584600317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03c815e980 0x7f03c814e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:18.517 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03ce000640 1 --2- 172.21.15.122:0/1584600317 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03c8162600 0x7f03c8152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:18.517 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03cd600640 1 -- 172.21.15.122:0/1584600317 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03c8162600 msgr2=0x7f03c8152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:18.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03cd600640 1 --2- 172.21.15.122:0/1584600317 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03c8162600 0x7f03c8152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:18.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03cd600640 1 -- 172.21.15.122:0/1584600317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03c815e980 msgr2=0x7f03c814e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:18.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03cd600640 1 --2- 172.21.15.122:0/1584600317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03c815e980 0x7f03c814e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:18.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03cd600640 1 -- 172.21.15.122:0/1584600317 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c815fb30 con 0x7f03c80cea60 2024-05-28T06:12:18.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03cd600640 1 --2- 172.21.15.122:0/1584600317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03c80cea60 0x7f03c8161c40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f03bc0ad040 tx=0x7f03bc01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:18.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03c5600640 1 -- 172.21.15.122:0/1584600317 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc0bf610 con 0x7f03c80cea60 2024-05-28T06:12:18.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03c5600640 1 -- 172.21.15.122:0/1584600317 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03bc0bf7d0 con 0x7f03c80cea60 2024-05-28T06:12:18.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03c5600640 1 -- 172.21.15.122:0/1584600317 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc0bfbc0 con 0x7f03c80cea60 2024-05-28T06:12:18.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03d0000640 1 -- 172.21.15.122:0/1584600317 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03c815fe10 con 0x7f03c80cea60 2024-05-28T06:12:18.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03d0000640 1 -- 172.21.15.122:0/1584600317 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03c81603d0 con 0x7f03c80cea60 2024-05-28T06:12:18.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03d0000640 1 -- 172.21.15.122:0/1584600317 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03c8068bd0 con 0x7f03c80cea60 2024-05-28T06:12:18.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.518+0000 7f03c5600640 1 -- 172.21.15.122:0/1584600317 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f03bc0bd020 con 0x7f03c80cea60 2024-05-28T06:12:18.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.522+0000 7f03c5600640 1 --2- 172.21.15.122:0/1584600317 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f03a8068bf0 0x7f03a806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:18.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.522+0000 7f03c5600640 1 -- 172.21.15.122:0/1584600317 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5823+0+0 (secure 0 0 0) 0x7f03bc0a8020 con 0x7f03c80cea60 2024-05-28T06:12:18.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.522+0000 7f03ccc00640 1 --2- 172.21.15.122:0/1584600317 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f03a8068bf0 0x7f03a806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:18.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.522+0000 7f03ccc00640 1 --2- 172.21.15.122:0/1584600317 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f03a8068bf0 0x7f03a806b0b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f03c8160c60 tx=0x7f03b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:18.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.526+0000 7f03c5600640 1 -- 172.21.15.122:0/1584600317 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f03bc016050 con 0x7f03c80cea60 2024-05-28T06:12:18.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.714+0000 7f03d0000640 1 -- 172.21.15.122:0/1584600317 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f03c80ccd10 con 0x7f03c80cea60 2024-05-28T06:12:18.716 INFO:tasks.ceph.mon.a.smithi122.stderr:2024-05-28T06:12:18.718+0000 7f3c04000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-28T06:12:18.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.718+0000 7f03c5600640 1 -- 172.21.15.122:0/1584600317 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) ==== 161+0+0 (secure 0 0 0) 0x7f03bc0f1520 con 0x7f03c80cea60 2024-05-28T06:12:18.718 INFO:teuthology.orchestra.run.smithi122.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-28T06:12:18.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.722+0000 7f03d0000640 1 -- 172.21.15.122:0/1584600317 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f03a8068bf0 msgr2=0x7f03a806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:18.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.722+0000 7f03d0000640 1 --2- 172.21.15.122:0/1584600317 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f03a8068bf0 0x7f03a806b0b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f03c8160c60 tx=0x7f03b4008040 comp rx=0 tx=0).stop 2024-05-28T06:12:18.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.722+0000 7f03d0000640 1 -- 172.21.15.122:0/1584600317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03c80cea60 msgr2=0x7f03c8161c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:18.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.722+0000 7f03d0000640 1 --2- 172.21.15.122:0/1584600317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03c80cea60 0x7f03c8161c40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f03bc0ad040 tx=0x7f03bc01ac70 comp rx=0 tx=0).stop 2024-05-28T06:12:18.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.722+0000 7f03d0000640 1 -- 172.21.15.122:0/1584600317 shutdown_connections 2024-05-28T06:12:18.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.722+0000 7f03d0000640 1 --2- 172.21.15.122:0/1584600317 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f03a8068bf0 0x7f03a806b0b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:18.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.722+0000 7f03d0000640 1 --2- 172.21.15.122:0/1584600317 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03c8162600 0x7f03c8152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:18.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.722+0000 7f03d0000640 1 --2- 172.21.15.122:0/1584600317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03c815e980 0x7f03c814e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:18.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.722+0000 7f03d0000640 1 --2- 172.21.15.122:0/1584600317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03c80cea60 0x7f03c8161c40 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:18.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.722+0000 7f03d0000640 1 -- 172.21.15.122:0/1584600317 >> 172.21.15.122:0/1584600317 conn(0x7f03c8062a40 msgr2=0x7f03c806b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:18.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.722+0000 7f03d0000640 1 -- 172.21.15.122:0/1584600317 shutdown_connections 2024-05-28T06:12:18.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.722+0000 7f03d0000640 1 -- 172.21.15.122:0/1584600317 wait complete. 2024-05-28T06:12:18.743 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-28T06:12:18.788 INFO:tasks.ceph.mds.a.smithi122.stdout:starting mds.a at 2024-05-28T06:12:18.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.882+0000 7f0504000640 1 Processor -- start 2024-05-28T06:12:18.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.882+0000 7f0504000640 1 -- start start 2024-05-28T06:12:18.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.886+0000 7f0504000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04fc0cff30 0x7f04fc06f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:18.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.886+0000 7f0504000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f04fc0cdb00 0x7f04fc0b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:18.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.886+0000 7f0504000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04fc0d0310 con 0x7f04fc06f6c0 2024-05-28T06:12:18.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.886+0000 7f0504000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f04fc06fb00 con 0x7f04fc0cdb00 2024-05-28T06:12:18.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.886+0000 7f0504000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f04fc0cdf30 con 0x7f04fc0cff30 2024-05-28T06:12:18.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.886+0000 7f0502000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f04fc0cdb00 0x7f04fc0b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:18.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.886+0000 7f0500c00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f04fc06f6c0 0x7f04fc0cd3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:45396/0 (socket says 172.21.15.122:45396) 2024-05-28T06:12:18.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.886+0000 7f0500c00640 1 -- 172.21.15.122:0/1882381058 learned_addr learned my addr 172.21.15.122:0/1882381058 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:18.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.886+0000 7f0502000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f04fc0cdb00 0x7f04fc0b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58896/0 (socket says 172.21.15.122:58896) 2024-05-28T06:12:18.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.886+0000 7f0501600640 1 --2- 172.21.15.122:0/1882381058 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04fc0cff30 0x7f04fc06f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:18.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.886+0000 7f0502000640 1 -- 172.21.15.122:0/1882381058 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04fc0cff30 msgr2=0x7f04fc06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:18.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.886+0000 7f0502000640 1 --2- 172.21.15.122:0/1882381058 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04fc0cff30 0x7f04fc06f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:18.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.886+0000 7f0502000640 1 -- 172.21.15.122:0/1882381058 >> v1:172.21.15.122:6789/0 conn(0x7f04fc06f6c0 legacy=0x7f04fc0cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:18.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.886+0000 7f0502000640 1 -- 172.21.15.122:0/1882381058 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04fc15be20 con 0x7f04fc0cdb00 2024-05-28T06:12:18.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.886+0000 7f0501600640 1 --2- 172.21.15.122:0/1882381058 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04fc0cff30 0x7f04fc06f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:12:18.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.890+0000 7f0502000640 1 --2- 172.21.15.122:0/1882381058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04fc0cdb00 0x7f04fc0b49b0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f04f40097c0 tx=0x7f04f401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df062f7aa26402 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:18.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.890+0000 7f04fbe00640 1 -- 172.21.15.122:0/1882381058 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f40a7070 con 0x7f04fc0cdb00 2024-05-28T06:12:18.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.890+0000 7f04fbe00640 1 -- 172.21.15.122:0/1882381058 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f40b0070 con 0x7f04fc0cdb00 2024-05-28T06:12:18.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.890+0000 7f04fbe00640 1 -- 172.21.15.122:0/1882381058 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f40ab890 con 0x7f04fc0cdb00 2024-05-28T06:12:18.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.890+0000 7f0504000640 1 -- 172.21.15.122:0/1882381058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04fc0cdb00 msgr2=0x7f04fc0b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:18.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.890+0000 7f0504000640 1 --2- 172.21.15.122:0/1882381058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04fc0cdb00 0x7f04fc0b49b0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f04f40097c0 tx=0x7f04f401c470 comp rx=0 tx=0).stop 2024-05-28T06:12:18.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.890+0000 7f0504000640 1 -- 172.21.15.122:0/1882381058 shutdown_connections 2024-05-28T06:12:18.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.890+0000 7f0504000640 1 --2- 172.21.15.122:0/1882381058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04fc0cdb00 0x7f04fc0b49b0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:18.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.890+0000 7f0504000640 1 --2- 172.21.15.122:0/1882381058 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04fc0cff30 0x7f04fc06f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:18.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.890+0000 7f0504000640 1 -- 172.21.15.122:0/1882381058 >> 172.21.15.122:0/1882381058 conn(0x7f04fc06bd90 msgr2=0x7f04fc06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:18.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.890+0000 7f0504000640 1 -- 172.21.15.122:0/1882381058 shutdown_connections 2024-05-28T06:12:18.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.890+0000 7f0504000640 1 -- 172.21.15.122:0/1882381058 wait complete. 2024-05-28T06:12:18.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.890+0000 7f0504000640 1 Processor -- start 2024-05-28T06:12:18.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.890+0000 7f0504000640 1 -- start start 2024-05-28T06:12:18.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f0504000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04fc06f6c0 0x7f04fc155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:18.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f0504000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04fc0cdb00 0x7f04fc1447b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:18.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f0504000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04fc0cff30 0x7f04fc14da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:18.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f0504000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc0b5700 con 0x7f04fc0cdb00 2024-05-28T06:12:18.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f0504000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc15baf0 con 0x7f04fc0cff30 2024-05-28T06:12:18.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f0504000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f04fc0b5880 con 0x7f04fc06f6c0 2024-05-28T06:12:18.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f0500c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04fc0cdb00 0x7f04fc1447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:18.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f0500c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04fc0cdb00 0x7f04fc1447b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58908/0 (socket says 172.21.15.122:58908) 2024-05-28T06:12:18.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f0500c00640 1 -- 172.21.15.122:0/3295700800 learned_addr learned my addr 172.21.15.122:0/3295700800 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:18.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f0501600640 1 --2- 172.21.15.122:0/3295700800 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04fc06f6c0 0x7f04fc155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:18.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f0502000640 1 --2- 172.21.15.122:0/3295700800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04fc0cff30 0x7f04fc14da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:18.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f0500c00640 1 -- 172.21.15.122:0/3295700800 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04fc06f6c0 msgr2=0x7f04fc155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:18.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f0500c00640 1 --2- 172.21.15.122:0/3295700800 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04fc06f6c0 0x7f04fc155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:18.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f0500c00640 1 -- 172.21.15.122:0/3295700800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04fc0cff30 msgr2=0x7f04fc14da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:18.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f0500c00640 1 --2- 172.21.15.122:0/3295700800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04fc0cff30 0x7f04fc14da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:18.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f0500c00640 1 -- 172.21.15.122:0/3295700800 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04fc1fb030 con 0x7f04fc0cdb00 2024-05-28T06:12:18.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f0501600640 1 --2- 172.21.15.122:0/3295700800 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04fc06f6c0 0x7f04fc155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:18.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f0502000640 1 --2- 172.21.15.122:0/3295700800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04fc0cff30 0x7f04fc14da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:18.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f0500c00640 1 --2- 172.21.15.122:0/3295700800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04fc0cdb00 0x7f04fc1447b0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f04e800c420 tx=0x7f04e800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:18.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f04f9600640 1 -- 172.21.15.122:0/3295700800 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e8017070 con 0x7f04fc0cdb00 2024-05-28T06:12:18.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f04f9600640 1 -- 172.21.15.122:0/3295700800 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e8005cf0 con 0x7f04fc0cdb00 2024-05-28T06:12:18.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f0504000640 1 -- 172.21.15.122:0/3295700800 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04fc1fb310 con 0x7f04fc0cdb00 2024-05-28T06:12:18.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f04f9600640 1 -- 172.21.15.122:0/3295700800 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e80072f0 con 0x7f04fc0cdb00 2024-05-28T06:12:18.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f0504000640 1 -- 172.21.15.122:0/3295700800 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04fc1fb8d0 con 0x7f04fc0cdb00 2024-05-28T06:12:18.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f0504000640 1 -- 172.21.15.122:0/3295700800 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04fc068c40 con 0x7f04fc0cdb00 2024-05-28T06:12:18.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.894+0000 7f04f9600640 1 -- 172.21.15.122:0/3295700800 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f04e801a070 con 0x7f04fc0cdb00 2024-05-28T06:12:18.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.898+0000 7f04f9600640 1 --2- 172.21.15.122:0/3295700800 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f04dc068bf0 0x7f04dc06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:18.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.898+0000 7f04f9600640 1 -- 172.21.15.122:0/3295700800 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5881+0+0 (secure 0 0 0) 0x7f04e8086fd0 con 0x7f04fc0cdb00 2024-05-28T06:12:18.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.898+0000 7f0501600640 1 --2- 172.21.15.122:0/3295700800 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f04dc068bf0 0x7f04dc06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:18.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.898+0000 7f0501600640 1 --2- 172.21.15.122:0/3295700800 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f04dc068bf0 0x7f04dc06b0b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f04f00094c0 tx=0x7f04f000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:18.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:18.902+0000 7f04f9600640 1 -- 172.21.15.122:0/3295700800 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f04e80565c0 con 0x7f04fc0cdb00 2024-05-28T06:12:19.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.094+0000 7f0504000640 1 -- 172.21.15.122:0/3295700800 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f04fc155f70 con 0x7f04fc0cdb00 2024-05-28T06:12:19.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.722+0000 7f04f9600640 1 -- 172.21.15.122:0/3295700800 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7f04e8055ec0 con 0x7f04fc0cdb00 2024-05-28T06:12:19.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.722+0000 7f0504000640 1 -- 172.21.15.122:0/3295700800 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f04dc068bf0 msgr2=0x7f04dc06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:19.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.722+0000 7f0504000640 1 --2- 172.21.15.122:0/3295700800 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f04dc068bf0 0x7f04dc06b0b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f04f00094c0 tx=0x7f04f000b040 comp rx=0 tx=0).stop 2024-05-28T06:12:19.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.722+0000 7f0504000640 1 -- 172.21.15.122:0/3295700800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04fc0cdb00 msgr2=0x7f04fc1447b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:19.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.722+0000 7f0504000640 1 --2- 172.21.15.122:0/3295700800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04fc0cdb00 0x7f04fc1447b0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f04e800c420 tx=0x7f04e800c8e0 comp rx=0 tx=0).stop 2024-05-28T06:12:19.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.722+0000 7f0504000640 1 -- 172.21.15.122:0/3295700800 shutdown_connections 2024-05-28T06:12:19.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.722+0000 7f0504000640 1 --2- 172.21.15.122:0/3295700800 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f04dc068bf0 0x7f04dc06b0b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:19.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.722+0000 7f0504000640 1 --2- 172.21.15.122:0/3295700800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04fc0cff30 0x7f04fc14da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:19.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.722+0000 7f0504000640 1 --2- 172.21.15.122:0/3295700800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04fc0cdb00 0x7f04fc1447b0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:19.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.722+0000 7f0504000640 1 --2- 172.21.15.122:0/3295700800 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04fc06f6c0 0x7f04fc155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:19.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.722+0000 7f0504000640 1 -- 172.21.15.122:0/3295700800 >> 172.21.15.122:0/3295700800 conn(0x7f04fc06bd90 msgr2=0x7f04fc15cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:19.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.722+0000 7f0504000640 1 -- 172.21.15.122:0/3295700800 shutdown_connections 2024-05-28T06:12:19.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.722+0000 7f0504000640 1 -- 172.21.15.122:0/3295700800 wait complete. 2024-05-28T06:12:19.747 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-28T06:12:19.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.890+0000 7fe901200640 1 Processor -- start 2024-05-28T06:12:19.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.890+0000 7fe901200640 1 -- start start 2024-05-28T06:12:19.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.890+0000 7fe901200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe8fc0add80 0x7fe8fc0aff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:19.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.890+0000 7fe901200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8fc0ae160 0x7fe8fc15d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:19.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.890+0000 7fe901200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8fc15db50 con 0x7fe8fc06cbd0 2024-05-28T06:12:19.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.890+0000 7fe901200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe8fc06bb30 con 0x7fe8fc0add80 2024-05-28T06:12:19.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.890+0000 7fe901200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe8fc06be10 con 0x7fe8fc0ae160 2024-05-28T06:12:19.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.890+0000 7fe8f9400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8fc0ae160 0x7fe8fc15d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:19.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.890+0000 7fe8f9e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe8fc0add80 0x7fe8fc0aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:19.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.890+0000 7fe8fa800640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe8fc06cbd0 0x7fe8fc06e6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:55006/0 (socket says 172.21.15.122:55006) 2024-05-28T06:12:19.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.890+0000 7fe8f9400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8fc0ae160 0x7fe8fc15d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:52570/0 (socket says 172.21.15.122:52570) 2024-05-28T06:12:19.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.890+0000 7fe8fa800640 1 -- 172.21.15.122:0/1625205211 learned_addr learned my addr 172.21.15.122:0/1625205211 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:19.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.890+0000 7fe8f9e00640 1 -- 172.21.15.122:0/1625205211 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8fc0ae160 msgr2=0x7fe8fc15d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:19.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.890+0000 7fe8f9e00640 1 --2- 172.21.15.122:0/1625205211 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8fc0ae160 0x7fe8fc15d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:19.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.890+0000 7fe8f9e00640 1 -- 172.21.15.122:0/1625205211 >> v1:172.21.15.153:6789/0 conn(0x7fe8fc06cbd0 legacy=0x7fe8fc06e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:19.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.890+0000 7fe8f9e00640 1 -- 172.21.15.122:0/1625205211 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8fc06c0f0 con 0x7fe8fc0add80 2024-05-28T06:12:19.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.890+0000 7fe8f9400640 1 --2- 172.21.15.122:0/1625205211 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8fc0ae160 0x7fe8fc15d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:12:19.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.890+0000 7fe8f8a00640 1 -- 172.21.15.122:0/1625205211 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1387569826 0 0) 0x7fe8fc15db50 con 0x7fe8fc06cbd0 2024-05-28T06:12:19.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.894+0000 7fe8f9e00640 1 --2- 172.21.15.122:0/1625205211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8fc0add80 0x7fe8fc0aff60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec0097c0 tx=0x7fe8ec01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2f9b1b6e2217d35 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:19.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.894+0000 7fe8f8a00640 1 -- 172.21.15.122:0/1625205211 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec0b1070 con 0x7fe8fc0add80 2024-05-28T06:12:19.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.894+0000 7fe8f8a00640 1 -- 172.21.15.122:0/1625205211 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8ec0a8050 con 0x7fe8fc0add80 2024-05-28T06:12:19.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.894+0000 7fe8f8a00640 1 -- 172.21.15.122:0/1625205211 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec0ac860 con 0x7fe8fc0add80 2024-05-28T06:12:19.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.894+0000 7fe901200640 1 -- 172.21.15.122:0/1625205211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8fc0add80 msgr2=0x7fe8fc0aff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:19.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.894+0000 7fe901200640 1 --2- 172.21.15.122:0/1625205211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8fc0add80 0x7fe8fc0aff60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec0097c0 tx=0x7fe8ec01c3e0 comp rx=0 tx=0).stop 2024-05-28T06:12:19.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.894+0000 7fe901200640 1 -- 172.21.15.122:0/1625205211 shutdown_connections 2024-05-28T06:12:19.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.894+0000 7fe901200640 1 --2- 172.21.15.122:0/1625205211 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8fc0ae160 0x7fe8fc15d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:19.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.894+0000 7fe901200640 1 --2- 172.21.15.122:0/1625205211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8fc0add80 0x7fe8fc0aff60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:19.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.894+0000 7fe901200640 1 -- 172.21.15.122:0/1625205211 >> 172.21.15.122:0/1625205211 conn(0x7fe8fc0b3130 msgr2=0x7fe8fc0d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:19.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.894+0000 7fe901200640 1 -- 172.21.15.122:0/1625205211 shutdown_connections 2024-05-28T06:12:19.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.894+0000 7fe901200640 1 -- 172.21.15.122:0/1625205211 wait complete. 2024-05-28T06:12:19.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.898+0000 7fe901200640 1 Processor -- start 2024-05-28T06:12:19.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.898+0000 7fe901200640 1 -- start start 2024-05-28T06:12:19.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.898+0000 7fe901200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8fc06cbd0 0x7fe8fc1536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:19.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.898+0000 7fe901200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8fc0add80 0x7fe8fc159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:19.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.898+0000 7fe901200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8fc0ae160 0x7fe8fc0b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:19.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.898+0000 7fe901200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc0ae6c0 con 0x7fe8fc0ae160 2024-05-28T06:12:19.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.898+0000 7fe901200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc0ae540 con 0x7fe8fc0add80 2024-05-28T06:12:19.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.898+0000 7fe901200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe8fc169d80 con 0x7fe8fc06cbd0 2024-05-28T06:12:19.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.898+0000 7fe8fa800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8fc0ae160 0x7fe8fc0b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:19.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.898+0000 7fe8f9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8fc06cbd0 0x7fe8fc1536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:19.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.898+0000 7fe8fa800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8fc0ae160 0x7fe8fc0b10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58918/0 (socket says 172.21.15.122:58918) 2024-05-28T06:12:19.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.898+0000 7fe8f9400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8fc0add80 0x7fe8fc159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:19.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.898+0000 7fe8fa800640 1 -- 172.21.15.122:0/3247483731 learned_addr learned my addr 172.21.15.122:0/3247483731 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:19.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.898+0000 7fe8f9e00640 1 -- 172.21.15.122:0/3247483731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8fc0add80 msgr2=0x7fe8fc159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:19.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.898+0000 7fe8f9e00640 1 --2- 172.21.15.122:0/3247483731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8fc0add80 0x7fe8fc159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:19.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.898+0000 7fe8f9e00640 1 -- 172.21.15.122:0/3247483731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8fc0ae160 msgr2=0x7fe8fc0b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:19.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.898+0000 7fe8f9e00640 1 --2- 172.21.15.122:0/3247483731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8fc0ae160 0x7fe8fc0b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:19.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.898+0000 7fe8f9e00640 1 -- 172.21.15.122:0/3247483731 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8fc0b3d60 con 0x7fe8fc06cbd0 2024-05-28T06:12:19.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.898+0000 7fe8fa800640 1 --2- 172.21.15.122:0/3247483731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8fc0ae160 0x7fe8fc0b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:12:19.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.898+0000 7fe8f9e00640 1 --2- 172.21.15.122:0/3247483731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8fc06cbd0 0x7fe8fc1536c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec0ac000 tx=0x7fe8ec01ac20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:19.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.898+0000 7fe8f2000640 1 -- 172.21.15.122:0/3247483731 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec0b1040 con 0x7fe8fc06cbd0 2024-05-28T06:12:19.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.902+0000 7fe8f2000640 1 -- 172.21.15.122:0/3247483731 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8ec0acdd0 con 0x7fe8fc06cbd0 2024-05-28T06:12:19.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.902+0000 7fe901200640 1 -- 172.21.15.122:0/3247483731 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8fc157ed0 con 0x7fe8fc06cbd0 2024-05-28T06:12:19.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.902+0000 7fe8f2000640 1 -- 172.21.15.122:0/3247483731 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec004260 con 0x7fe8fc06cbd0 2024-05-28T06:12:19.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.902+0000 7fe901200640 1 -- 172.21.15.122:0/3247483731 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8fc0b4000 con 0x7fe8fc06cbd0 2024-05-28T06:12:19.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.902+0000 7fe901200640 1 -- 172.21.15.122:0/3247483731 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8fc068c40 con 0x7fe8fc06cbd0 2024-05-28T06:12:19.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.902+0000 7fe8f2000640 1 -- 172.21.15.122:0/3247483731 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fe8ec0b4070 con 0x7fe8fc06cbd0 2024-05-28T06:12:19.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.902+0000 7fe8f2000640 1 --2- 172.21.15.122:0/3247483731 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe8dc068bf0 0x7fe8dc06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:19.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.902+0000 7fe8f2000640 1 -- 172.21.15.122:0/3247483731 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(51..51 src has 1..51) ==== 5881+0+0 (secure 0 0 0) 0x7fe8ec121d40 con 0x7fe8fc06cbd0 2024-05-28T06:12:19.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.902+0000 7fe8f9400640 1 --2- 172.21.15.122:0/3247483731 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe8dc068bf0 0x7fe8dc06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:19.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.906+0000 7fe8f9400640 1 --2- 172.21.15.122:0/3247483731 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe8dc068bf0 0x7fe8dc06b0b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8009580 tx=0x7fe8e8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:19.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:19.906+0000 7fe8f2000640 1 -- 172.21.15.122:0/3247483731 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe8ec0c4030 con 0x7fe8fc06cbd0 2024-05-28T06:12:20.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.066+0000 7fe901200640 1 -- 172.21.15.122:0/3247483731 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe8fc0d17e0 con 0x7fe8fc06cbd0 2024-05-28T06:12:20.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.726+0000 7fe8f2000640 1 -- 172.21.15.122:0/3247483731 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v52) ==== 181+0+0 (secure 0 0 0) 0x7fe8ec0bb030 con 0x7fe8fc06cbd0 2024-05-28T06:12:20.727 INFO:teuthology.orchestra.run.smithi122.stderr:pool 'cephfs_metadata' removed 2024-05-28T06:12:20.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.730+0000 7fe901200640 1 -- 172.21.15.122:0/3247483731 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe8dc068bf0 msgr2=0x7fe8dc06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:20.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.730+0000 7fe901200640 1 --2- 172.21.15.122:0/3247483731 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe8dc068bf0 0x7fe8dc06b0b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8009580 tx=0x7fe8e8009190 comp rx=0 tx=0).stop 2024-05-28T06:12:20.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.730+0000 7fe901200640 1 -- 172.21.15.122:0/3247483731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8fc06cbd0 msgr2=0x7fe8fc1536c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:20.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.730+0000 7fe901200640 1 --2- 172.21.15.122:0/3247483731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8fc06cbd0 0x7fe8fc1536c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec0ac000 tx=0x7fe8ec01ac20 comp rx=0 tx=0).stop 2024-05-28T06:12:20.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.730+0000 7fe901200640 1 -- 172.21.15.122:0/3247483731 shutdown_connections 2024-05-28T06:12:20.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.730+0000 7fe901200640 1 --2- 172.21.15.122:0/3247483731 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe8dc068bf0 0x7fe8dc06b0b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:20.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.730+0000 7fe901200640 1 --2- 172.21.15.122:0/3247483731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8fc0ae160 0x7fe8fc0b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:20.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.730+0000 7fe901200640 1 --2- 172.21.15.122:0/3247483731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8fc0add80 0x7fe8fc159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:20.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.730+0000 7fe901200640 1 --2- 172.21.15.122:0/3247483731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8fc06cbd0 0x7fe8fc1536c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:20.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.730+0000 7fe901200640 1 -- 172.21.15.122:0/3247483731 >> 172.21.15.122:0/3247483731 conn(0x7fe8fc0b3130 msgr2=0x7fe8fc06fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:20.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.730+0000 7fe901200640 1 -- 172.21.15.122:0/3247483731 shutdown_connections 2024-05-28T06:12:20.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.730+0000 7fe901200640 1 -- 172.21.15.122:0/3247483731 wait complete. 2024-05-28T06:12:20.753 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-28T06:12:20.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f671c600640 1 Processor -- start 2024-05-28T06:12:20.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f671c600640 1 -- start start 2024-05-28T06:12:20.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f671c600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f671415ea50 0x7f671415ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:20.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f671c600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f671406dab0 0x7f67140d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:20.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f671c600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6714162510 con 0x7f671415f370 2024-05-28T06:12:20.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f671c600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6714163120 con 0x7f671406dab0 2024-05-28T06:12:20.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f671c600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f67141627f0 con 0x7f671415ea50 2024-05-28T06:12:20.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f6719200640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f671415f370 0x7f671415f790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:45410/0 (socket says 172.21.15.122:45410) 2024-05-28T06:12:20.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f6719200640 1 -- 172.21.15.122:0/4020828553 learned_addr learned my addr 172.21.15.122:0/4020828553 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:20.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f6719c00640 1 --2- 172.21.15.122:0/4020828553 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f671415ea50 0x7f671415ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:20.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f671a600640 1 --2- 172.21.15.122:0/4020828553 >> v2:172.21.15.153:3300/0 conn(0x7f671406dab0 0x7f67140d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:20.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f6713e00640 1 -- 172.21.15.122:0/4020828553 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 173304083 0 0) 0x7f6714162510 con 0x7f671415f370 2024-05-28T06:12:20.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f6713e00640 1 -- 172.21.15.122:0/4020828553 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66fc003530 con 0x7f671415f370 2024-05-28T06:12:20.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f6713e00640 1 -- 172.21.15.122:0/4020828553 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1951879258 0 0) 0x7f66fc003530 con 0x7f671415f370 2024-05-28T06:12:20.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f6713e00640 1 -- 172.21.15.122:0/4020828553 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f671415ea50 msgr2=0x7f671415ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:20.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f6713e00640 1 --2- 172.21.15.122:0/4020828553 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f671415ea50 0x7f671415ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:20.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f6713e00640 1 -- 172.21.15.122:0/4020828553 >> v2:172.21.15.153:3300/0 conn(0x7f671406dab0 msgr2=0x7f67140d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:20.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f6713e00640 1 --2- 172.21.15.122:0/4020828553 >> v2:172.21.15.153:3300/0 conn(0x7f671406dab0 0x7f67140d08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:20.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f6713e00640 1 -- 172.21.15.122:0/4020828553 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6714162ad0 con 0x7f671415f370 2024-05-28T06:12:20.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f6713e00640 1 -- 172.21.15.122:0/4020828553 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f6700001680 con 0x7f671415f370 2024-05-28T06:12:20.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f671a600640 1 --2- 172.21.15.122:0/4020828553 >> v2:172.21.15.153:3300/0 conn(0x7f671406dab0 0x7f67140d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:12:20.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f6719c00640 1 --2- 172.21.15.122:0/4020828553 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f671415ea50 0x7f671415ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:12:20.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f6713e00640 1 -- 172.21.15.122:0/4020828553 >> v1:172.21.15.122:6789/0 conn(0x7f671415f370 legacy=0x7f671415f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:20.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f6713e00640 1 --2- 172.21.15.122:0/4020828553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66fc0039c0 0x7f66fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:20.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f6713e00640 1 --2- 172.21.15.122:0/4020828553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66fc004810 0x7f66fc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:20.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f6713e00640 1 --2- 172.21.15.122:0/4020828553 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f671415ea50 0x7f66fc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:20.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f6713e00640 1 -- 172.21.15.122:0/4020828553 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f67141627f0 con 0x7f66fc0039c0 2024-05-28T06:12:20.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f6713e00640 1 -- 172.21.15.122:0/4020828553 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc00b9d0 con 0x7f66fc004810 2024-05-28T06:12:20.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.898+0000 7f6713e00640 1 -- 172.21.15.122:0/4020828553 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f66fc00bb50 con 0x7f671415ea50 2024-05-28T06:12:20.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.902+0000 7f6719c00640 1 --2- 172.21.15.122:0/4020828553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66fc0039c0 0x7f66fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:20.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.902+0000 7f6719200640 1 --2- 172.21.15.122:0/4020828553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66fc004810 0x7f66fc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:20.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.902+0000 7f671a600640 1 --2- 172.21.15.122:0/4020828553 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f671415ea50 0x7f66fc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:20.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.902+0000 7f6719c00640 1 -- 172.21.15.122:0/4020828553 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f671415ea50 msgr2=0x7f66fc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:20.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.902+0000 7f6719c00640 1 --2- 172.21.15.122:0/4020828553 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f671415ea50 0x7f66fc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:20.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.902+0000 7f6719c00640 1 -- 172.21.15.122:0/4020828553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66fc004810 msgr2=0x7f66fc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:20.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.902+0000 7f6719c00640 1 --2- 172.21.15.122:0/4020828553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66fc004810 0x7f66fc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:20.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.902+0000 7f6719c00640 1 -- 172.21.15.122:0/4020828553 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66fc003530 con 0x7f66fc0039c0 2024-05-28T06:12:20.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.902+0000 7f6719200640 1 --2- 172.21.15.122:0/4020828553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66fc004810 0x7f66fc004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:12:20.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.902+0000 7f6719c00640 1 --2- 172.21.15.122:0/4020828553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66fc0039c0 0x7f66fc003de0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f670800e350 tx=0x7f670801cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6ecf94ea41f406 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:20.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.902+0000 7f6713e00640 1 -- 172.21.15.122:0/4020828553 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67080b2070 con 0x7f66fc0039c0 2024-05-28T06:12:20.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.902+0000 7f6713e00640 1 -- 172.21.15.122:0/4020828553 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67080a5b70 con 0x7f66fc0039c0 2024-05-28T06:12:20.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.902+0000 7f6713e00640 1 -- 172.21.15.122:0/4020828553 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6708009de0 con 0x7f66fc0039c0 2024-05-28T06:12:20.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.902+0000 7f671c600640 1 -- 172.21.15.122:0/4020828553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66fc0039c0 msgr2=0x7f66fc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:20.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.902+0000 7f671c600640 1 --2- 172.21.15.122:0/4020828553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66fc0039c0 0x7f66fc003de0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f670800e350 tx=0x7f670801cdd0 comp rx=0 tx=0).stop 2024-05-28T06:12:20.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f671a600640 1 -- 172.21.15.122:0/4020828553 reap_dead start 2024-05-28T06:12:20.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f671c600640 1 -- 172.21.15.122:0/4020828553 shutdown_connections 2024-05-28T06:12:20.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f671c600640 1 -- 172.21.15.122:0/4020828553 >> 172.21.15.122:0/4020828553 conn(0x7f67140b4190 msgr2=0x7f67140b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:20.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f671c600640 1 -- 172.21.15.122:0/4020828553 shutdown_connections 2024-05-28T06:12:20.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f671c600640 1 -- 172.21.15.122:0/4020828553 wait complete. 2024-05-28T06:12:20.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f671c600640 1 Processor -- start 2024-05-28T06:12:20.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f671c600640 1 -- start start 2024-05-28T06:12:20.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f671c600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66fc0039c0 0x7f67141619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:20.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f671c600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67140b31e0 0x7f6714153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:20.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f671c600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67140b3660 0x7f67141539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:20.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f671c600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f67140d19c0 con 0x7f67140b31e0 2024-05-28T06:12:20.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f671c600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f67140d1840 con 0x7f66fc0039c0 2024-05-28T06:12:20.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f671c600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f67140d1b40 con 0x7f67140b3660 2024-05-28T06:12:20.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f6719200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67140b31e0 0x7f6714153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:20.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f6719200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67140b31e0 0x7f6714153490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58948/0 (socket says 172.21.15.122:58948) 2024-05-28T06:12:20.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f6719200640 1 -- 172.21.15.122:0/4228171302 learned_addr learned my addr 172.21.15.122:0/4228171302 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:20.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f6719c00640 1 --2- 172.21.15.122:0/4228171302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66fc0039c0 0x7f67141619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:20.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f671a600640 1 --2- 172.21.15.122:0/4228171302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67140b3660 0x7f67141539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:20.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f6719200640 1 -- 172.21.15.122:0/4228171302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67140b3660 msgr2=0x7f67141539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:20.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f6719200640 1 --2- 172.21.15.122:0/4228171302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67140b3660 0x7f67141539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:20.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f6719200640 1 -- 172.21.15.122:0/4228171302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66fc0039c0 msgr2=0x7f67141619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:20.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f6719200640 1 --2- 172.21.15.122:0/4228171302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66fc0039c0 0x7f67141619a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:20.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f6719200640 1 -- 172.21.15.122:0/4228171302 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6714157770 con 0x7f67140b31e0 2024-05-28T06:12:20.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f671a600640 1 --2- 172.21.15.122:0/4228171302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67140b3660 0x7f67141539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:12:20.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f6719200640 1 --2- 172.21.15.122:0/4228171302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67140b31e0 0x7f6714153490 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6700001870 tx=0x7f670000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:20.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.906+0000 7f6711600640 1 -- 172.21.15.122:0/4228171302 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670000c8d0 con 0x7f67140b31e0 2024-05-28T06:12:20.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.910+0000 7f6711600640 1 -- 172.21.15.122:0/4228171302 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6700018070 con 0x7f67140b31e0 2024-05-28T06:12:20.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.910+0000 7f671c600640 1 -- 172.21.15.122:0/4228171302 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6714161ee0 con 0x7f67140b31e0 2024-05-28T06:12:20.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.910+0000 7f6711600640 1 -- 172.21.15.122:0/4228171302 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670000cc70 con 0x7f67140b31e0 2024-05-28T06:12:20.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.910+0000 7f671c600640 1 -- 172.21.15.122:0/4228171302 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67141569b0 con 0x7f67140b31e0 2024-05-28T06:12:20.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.910+0000 7f671c600640 1 -- 172.21.15.122:0/4228171302 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6714068c40 con 0x7f67140b31e0 2024-05-28T06:12:20.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.910+0000 7f6711600640 1 -- 172.21.15.122:0/4228171302 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f670001d460 con 0x7f67140b31e0 2024-05-28T06:12:20.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.910+0000 7f6711600640 1 --2- 172.21.15.122:0/4228171302 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f66f4068c20 0x7f66f406b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:20.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.910+0000 7f6711600640 1 -- 172.21.15.122:0/4228171302 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5443+0+0 (secure 0 0 0) 0x7f6700087840 con 0x7f67140b31e0 2024-05-28T06:12:20.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.910+0000 7f6719c00640 1 --2- 172.21.15.122:0/4228171302 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f66f4068c20 0x7f66f406b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:20.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.910+0000 7f6719c00640 1 --2- 172.21.15.122:0/4228171302 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f66f4068c20 0x7f66f406b0e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f67080af000 tx=0x7f6708004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:20.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:20.914+0000 7f6711600640 1 -- 172.21.15.122:0/4228171302 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6700057070 con 0x7f67140b31e0 2024-05-28T06:12:21.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.074+0000 7f671c600640 1 -- 172.21.15.122:0/4228171302 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f67140b4ea0 con 0x7f67140b31e0 2024-05-28T06:12:21.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.730+0000 7f6711600640 1 -- 172.21.15.122:0/4228171302 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v53) ==== 169+0+0 (secure 0 0 0) 0x7f6700056970 con 0x7f67140b31e0 2024-05-28T06:12:21.729 INFO:teuthology.orchestra.run.smithi122.stderr:pool 'cephfs_data' removed 2024-05-28T06:12:21.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.734+0000 7f671c600640 1 -- 172.21.15.122:0/4228171302 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f66f4068c20 msgr2=0x7f66f406b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:21.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.734+0000 7f671c600640 1 --2- 172.21.15.122:0/4228171302 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f66f4068c20 0x7f66f406b0e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f67080af000 tx=0x7f6708004ac0 comp rx=0 tx=0).stop 2024-05-28T06:12:21.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.734+0000 7f671c600640 1 -- 172.21.15.122:0/4228171302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67140b31e0 msgr2=0x7f6714153490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:21.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.734+0000 7f671c600640 1 --2- 172.21.15.122:0/4228171302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67140b31e0 0x7f6714153490 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6700001870 tx=0x7f670000ec80 comp rx=0 tx=0).stop 2024-05-28T06:12:21.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.734+0000 7f671c600640 1 -- 172.21.15.122:0/4228171302 shutdown_connections 2024-05-28T06:12:21.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.734+0000 7f671c600640 1 --2- 172.21.15.122:0/4228171302 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f66f4068c20 0x7f66f406b0e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:21.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.734+0000 7f671c600640 1 --2- 172.21.15.122:0/4228171302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67140b3660 0x7f67141539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:21.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.734+0000 7f671c600640 1 --2- 172.21.15.122:0/4228171302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67140b31e0 0x7f6714153490 secure :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6700001870 tx=0x7f670000ec80 comp rx=0 tx=0).stop 2024-05-28T06:12:21.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.734+0000 7f671c600640 1 --2- 172.21.15.122:0/4228171302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66fc0039c0 0x7f67141619a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:21.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.734+0000 7f671c600640 1 -- 172.21.15.122:0/4228171302 >> 172.21.15.122:0/4228171302 conn(0x7f67140b4190 msgr2=0x7f67140cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:21.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.734+0000 7f671c600640 1 -- 172.21.15.122:0/4228171302 shutdown_connections 2024-05-28T06:12:21.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.734+0000 7f671c600640 1 -- 172.21.15.122:0/4228171302 wait complete. 2024-05-28T06:12:21.761 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-28T06:12:21.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.898+0000 7f646fa00640 1 Processor -- start 2024-05-28T06:12:21.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.898+0000 7f646fa00640 1 -- start start 2024-05-28T06:12:21.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.898+0000 7f646fa00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f64680cff30 0x7f646806f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:21.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.898+0000 7f646fa00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f646806f6c0 0x7f64680cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:21.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.898+0000 7f646fa00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f64680cd930 0x7f64680722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:21.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.898+0000 7f646fa00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f646806fb00 con 0x7f64680cd930 2024-05-28T06:12:21.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.898+0000 7f646fa00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f64680d0310 con 0x7f64680cff30 2024-05-28T06:12:21.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.898+0000 7f646fa00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f646815be20 con 0x7f646806f6c0 2024-05-28T06:12:21.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.902+0000 7f646da00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f64680cd930 0x7f64680722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:21.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.902+0000 7f646da00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f64680cd930 0x7f64680722a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58954/0 (socket says 172.21.15.122:58954) 2024-05-28T06:12:21.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.902+0000 7f646da00640 1 -- 172.21.15.122:0/2446233068 learned_addr learned my addr 172.21.15.122:0/2446233068 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:21.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.902+0000 7f646d000640 1 --2- 172.21.15.122:0/2446233068 >> v2:172.21.15.153:3300/0 conn(0x7f64680cff30 0x7f646806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:21.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.902+0000 7f6467e00640 1 --2- 172.21.15.122:0/2446233068 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f646806f6c0 0x7f64680cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:21.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.902+0000 7f646da00640 1 -- 172.21.15.122:0/2446233068 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f646806f6c0 msgr2=0x7f64680cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:21.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.902+0000 7f646da00640 1 --2- 172.21.15.122:0/2446233068 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f646806f6c0 0x7f64680cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:21.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.902+0000 7f646da00640 1 -- 172.21.15.122:0/2446233068 >> v2:172.21.15.153:3300/0 conn(0x7f64680cff30 msgr2=0x7f646806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:21.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.902+0000 7f646da00640 1 --2- 172.21.15.122:0/2446233068 >> v2:172.21.15.153:3300/0 conn(0x7f64680cff30 0x7f646806f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:21.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.902+0000 7f646da00640 1 -- 172.21.15.122:0/2446233068 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646815c100 con 0x7f64680cd930 2024-05-28T06:12:21.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.902+0000 7f6467e00640 1 --2- 172.21.15.122:0/2446233068 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f646806f6c0 0x7f64680cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:12:21.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.902+0000 7f646da00640 1 --2- 172.21.15.122:0/2446233068 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64680cd930 0x7f64680722a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f64680b3dc0 tx=0x7f646001c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3f9ed316aa8558 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:21.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.902+0000 7f6467400640 1 -- 172.21.15.122:0/2446233068 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64600a5580 con 0x7f64680cd930 2024-05-28T06:12:21.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.902+0000 7f6467400640 1 -- 172.21.15.122:0/2446233068 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64600a5720 con 0x7f64680cd930 2024-05-28T06:12:21.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.902+0000 7f6467400640 1 -- 172.21.15.122:0/2446233068 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64600a5af0 con 0x7f64680cd930 2024-05-28T06:12:21.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.906+0000 7f646fa00640 1 -- 172.21.15.122:0/2446233068 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64680cd930 msgr2=0x7f64680722a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:21.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.906+0000 7f646fa00640 1 --2- 172.21.15.122:0/2446233068 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64680cd930 0x7f64680722a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f64680b3dc0 tx=0x7f646001c700 comp rx=0 tx=0).stop 2024-05-28T06:12:21.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.906+0000 7f646fa00640 1 -- 172.21.15.122:0/2446233068 shutdown_connections 2024-05-28T06:12:21.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.906+0000 7f646fa00640 1 --2- 172.21.15.122:0/2446233068 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64680cd930 0x7f64680722a0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:21.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.906+0000 7f646fa00640 1 --2- 172.21.15.122:0/2446233068 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f646806f6c0 0x7f64680cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:21.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.906+0000 7f646fa00640 1 --2- 172.21.15.122:0/2446233068 >> v2:172.21.15.153:3300/0 conn(0x7f64680cff30 0x7f646806f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:21.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.906+0000 7f646fa00640 1 -- 172.21.15.122:0/2446233068 >> 172.21.15.122:0/2446233068 conn(0x7f646806bd90 msgr2=0x7f646806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:21.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.906+0000 7f646fa00640 1 -- 172.21.15.122:0/2446233068 shutdown_connections 2024-05-28T06:12:21.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.906+0000 7f646fa00640 1 -- 172.21.15.122:0/2446233068 wait complete. 2024-05-28T06:12:21.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.906+0000 7f646fa00640 1 Processor -- start 2024-05-28T06:12:21.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.906+0000 7f646fa00640 1 -- start start 2024-05-28T06:12:21.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.906+0000 7f646fa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f646806f6c0 0x7f646815d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:21.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.906+0000 7f646fa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64680cd930 0x7f64681fb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:21.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.906+0000 7f646fa00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64680cff30 0x7f6468151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:21.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.906+0000 7f646fa00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f64680cdee0 con 0x7f64680cd930 2024-05-28T06:12:21.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.906+0000 7f646fa00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f64680cdd60 con 0x7f646806f6c0 2024-05-28T06:12:21.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.906+0000 7f646fa00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f64680b49b0 con 0x7f64680cff30 2024-05-28T06:12:21.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.906+0000 7f6467e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64680cd930 0x7f64681fb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:21.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.906+0000 7f6467e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64680cd930 0x7f64681fb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58960/0 (socket says 172.21.15.122:58960) 2024-05-28T06:12:21.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.906+0000 7f6467e00640 1 -- 172.21.15.122:0/474695614 learned_addr learned my addr 172.21.15.122:0/474695614 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:21.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.906+0000 7f646d000640 1 --2- 172.21.15.122:0/474695614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f646806f6c0 0x7f646815d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:21.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.906+0000 7f646da00640 1 --2- 172.21.15.122:0/474695614 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64680cff30 0x7f6468151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:21.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.910+0000 7f6467e00640 1 -- 172.21.15.122:0/474695614 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64680cff30 msgr2=0x7f6468151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:21.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.910+0000 7f6467e00640 1 --2- 172.21.15.122:0/474695614 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64680cff30 0x7f6468151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:21.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.910+0000 7f6467e00640 1 -- 172.21.15.122:0/474695614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f646806f6c0 msgr2=0x7f646815d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:21.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.910+0000 7f6467e00640 1 --2- 172.21.15.122:0/474695614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f646806f6c0 0x7f646815d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:21.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.910+0000 7f6467e00640 1 -- 172.21.15.122:0/474695614 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64680af520 con 0x7f64680cd930 2024-05-28T06:12:21.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.910+0000 7f6467e00640 1 --2- 172.21.15.122:0/474695614 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64680cd930 0x7f64681fb6a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f645400e840 tx=0x7f645400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:21.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.910+0000 7f6464c00640 1 -- 172.21.15.122:0/474695614 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454017070 con 0x7f64680cd930 2024-05-28T06:12:21.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.910+0000 7f6464c00640 1 -- 172.21.15.122:0/474695614 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f645400c8d0 con 0x7f64680cd930 2024-05-28T06:12:21.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.910+0000 7f6464c00640 1 -- 172.21.15.122:0/474695614 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645400f040 con 0x7f64680cd930 2024-05-28T06:12:21.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.910+0000 7f646fa00640 1 -- 172.21.15.122:0/474695614 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64680b2fb0 con 0x7f64680cd930 2024-05-28T06:12:21.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.910+0000 7f646fa00640 1 -- 172.21.15.122:0/474695614 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f646815d1c0 con 0x7f64680cd930 2024-05-28T06:12:21.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.910+0000 7f646fa00640 1 -- 172.21.15.122:0/474695614 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6468068c40 con 0x7f64680cd930 2024-05-28T06:12:21.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.910+0000 7f6464c00640 1 -- 172.21.15.122:0/474695614 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f645401a070 con 0x7f64680cd930 2024-05-28T06:12:21.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.910+0000 7f6464c00640 1 --2- 172.21.15.122:0/474695614 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6448068c20 0x7f644806b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:21.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.910+0000 7f6464c00640 1 -- 172.21.15.122:0/474695614 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4971+0+0 (secure 0 0 0) 0x7f6454087390 con 0x7f64680cd930 2024-05-28T06:12:21.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.910+0000 7f646d000640 1 --2- 172.21.15.122:0/474695614 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6448068c20 0x7f644806b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:21.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.914+0000 7f646d000640 1 --2- 172.21.15.122:0/474695614 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6448068c20 0x7f644806b0e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6458009a40 tx=0x7f6458009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:21.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:21.914+0000 7f6464c00640 1 -- 172.21.15.122:0/474695614 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f64540566f0 con 0x7f64680cd930 2024-05-28T06:12:22.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.078+0000 7f646fa00640 1 -- 172.21.15.122:0/474695614 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f6468155f70 con 0x7f64680cd930 2024-05-28T06:12:22.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.082+0000 7f6464c00640 1 -- 172.21.15.122:0/474695614 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7f645405a9f0 con 0x7f64680cd930 2024-05-28T06:12:22.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.086+0000 7f646fa00640 1 -- 172.21.15.122:0/474695614 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6448068c20 msgr2=0x7f644806b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:22.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.086+0000 7f646fa00640 1 --2- 172.21.15.122:0/474695614 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6448068c20 0x7f644806b0e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6458009a40 tx=0x7f6458009190 comp rx=0 tx=0).stop 2024-05-28T06:12:22.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.086+0000 7f646fa00640 1 -- 172.21.15.122:0/474695614 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64680cd930 msgr2=0x7f64681fb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:22.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.086+0000 7f646fa00640 1 --2- 172.21.15.122:0/474695614 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64680cd930 0x7f64681fb6a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f645400e840 tx=0x7f645400ed00 comp rx=0 tx=0).stop 2024-05-28T06:12:22.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.086+0000 7f646fa00640 1 -- 172.21.15.122:0/474695614 shutdown_connections 2024-05-28T06:12:22.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.086+0000 7f646fa00640 1 --2- 172.21.15.122:0/474695614 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6448068c20 0x7f644806b0e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:22.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.086+0000 7f646fa00640 1 --2- 172.21.15.122:0/474695614 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64680cff30 0x7f6468151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:22.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.086+0000 7f646fa00640 1 --2- 172.21.15.122:0/474695614 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64680cd930 0x7f64681fb6a0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:22.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.086+0000 7f646fa00640 1 --2- 172.21.15.122:0/474695614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f646806f6c0 0x7f646815d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:22.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.086+0000 7f646fa00640 1 -- 172.21.15.122:0/474695614 >> 172.21.15.122:0/474695614 conn(0x7f646806bd90 msgr2=0x7f64680aee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:22.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.086+0000 7f646fa00640 1 -- 172.21.15.122:0/474695614 shutdown_connections 2024-05-28T06:12:22.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.086+0000 7f646fa00640 1 -- 172.21.15.122:0/474695614 wait complete. 2024-05-28T06:12:22.104 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones' 2024-05-28T06:12:22.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.246+0000 7f69f7600640 1 Processor -- start 2024-05-28T06:12:22.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.246+0000 7f69f7600640 1 -- start start 2024-05-28T06:12:22.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.250+0000 7f69f7600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f69f00b0d90 0x7f69f00cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:22.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.250+0000 7f69f7600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f015bd70 con 0x7f69f006f0c0 2024-05-28T06:12:22.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.250+0000 7f69f7600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f015c050 con 0x7f69f0159280 2024-05-28T06:12:22.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.250+0000 7f69f7600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f69f0159660 con 0x7f69f00b0d90 2024-05-28T06:12:22.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.250+0000 7f69f5600640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f69f006f0c0 0x7f69f00d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:45426/0 (socket says 172.21.15.122:45426) 2024-05-28T06:12:22.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.250+0000 7f69f5600640 1 -- 172.21.15.122:0/4135407163 learned_addr learned my addr 172.21.15.122:0/4135407163 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:22.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.250+0000 7f69efe00640 1 --2- 172.21.15.122:0/4135407163 >> v2:172.21.15.153:3300/0 conn(0x7f69f00b0d90 0x7f69f00cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:22.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.250+0000 7f69ef400640 1 -- 172.21.15.122:0/4135407163 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1694335387 0 0) 0x7f69f015bd70 con 0x7f69f006f0c0 2024-05-28T06:12:22.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.250+0000 7f69ef400640 1 -- 172.21.15.122:0/4135407163 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69d8005740 con 0x7f69f006f0c0 2024-05-28T06:12:22.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.250+0000 7f69ef400640 1 -- 172.21.15.122:0/4135407163 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3333499383 0 0) 0x7f69f015c050 con 0x7f69f0159280 2024-05-28T06:12:22.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.250+0000 7f69ef400640 1 -- 172.21.15.122:0/4135407163 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69f015bd70 con 0x7f69f0159280 2024-05-28T06:12:22.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.250+0000 7f69efe00640 1 -- 172.21.15.122:0/4135407163 >> v1:172.21.15.153:6789/0 conn(0x7f69f0159280 legacy=0x7f69f0073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:22.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.250+0000 7f69efe00640 1 -- 172.21.15.122:0/4135407163 >> v1:172.21.15.122:6789/0 conn(0x7f69f006f0c0 legacy=0x7f69f00d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:22.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.250+0000 7f69efe00640 1 -- 172.21.15.122:0/4135407163 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f015c330 con 0x7f69f00b0d90 2024-05-28T06:12:22.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.254+0000 7f69efe00640 1 --2- 172.21.15.122:0/4135407163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69f00b0d90 0x7f69f00cf290 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0097c0 tx=0x7f69dc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e588ce905b432334 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:22.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.254+0000 7f69ef400640 1 -- 172.21.15.122:0/4135407163 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc0b0070 con 0x7f69f00b0d90 2024-05-28T06:12:22.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.254+0000 7f69ef400640 1 -- 172.21.15.122:0/4135407163 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69dc0ab600 con 0x7f69f00b0d90 2024-05-28T06:12:22.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.254+0000 7f69ef400640 1 -- 172.21.15.122:0/4135407163 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc0ab9d0 con 0x7f69f00b0d90 2024-05-28T06:12:22.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.254+0000 7f69f7600640 1 -- 172.21.15.122:0/4135407163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69f00b0d90 msgr2=0x7f69f00cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:22.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.254+0000 7f69f7600640 1 --2- 172.21.15.122:0/4135407163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69f00b0d90 0x7f69f00cf290 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0097c0 tx=0x7f69dc01c4a0 comp rx=0 tx=0).stop 2024-05-28T06:12:22.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.254+0000 7f69f7600640 1 -- 172.21.15.122:0/4135407163 shutdown_connections 2024-05-28T06:12:22.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.254+0000 7f69f7600640 1 --2- 172.21.15.122:0/4135407163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69f00b0d90 0x7f69f00cf290 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:22.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.254+0000 7f69f7600640 1 -- 172.21.15.122:0/4135407163 >> 172.21.15.122:0/4135407163 conn(0x7f69f00b6c10 msgr2=0x7f69f00b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:22.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.254+0000 7f69f7600640 1 -- 172.21.15.122:0/4135407163 shutdown_connections 2024-05-28T06:12:22.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.254+0000 7f69f7600640 1 -- 172.21.15.122:0/4135407163 wait complete. 2024-05-28T06:12:22.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.254+0000 7f69f7600640 1 Processor -- start 2024-05-28T06:12:22.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.254+0000 7f69f7600640 1 -- start start 2024-05-28T06:12:22.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69f7600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69f006f0c0 0x7f69f014b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:22.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69f7600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69f00b0d90 0x7f69f0137d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:22.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69f7600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69f0159280 0x7f69f014c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:22.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69f7600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f69f006bda0 con 0x7f69f00b0d90 2024-05-28T06:12:22.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69f7600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f69f006bc20 con 0x7f69f0159280 2024-05-28T06:12:22.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69f7600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f69f006bf20 con 0x7f69f006f0c0 2024-05-28T06:12:22.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69efe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69f00b0d90 0x7f69f0137d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:22.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69efe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69f00b0d90 0x7f69f0137d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58962/0 (socket says 172.21.15.122:58962) 2024-05-28T06:12:22.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69efe00640 1 -- 172.21.15.122:0/1158454321 learned_addr learned my addr 172.21.15.122:0/1158454321 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:22.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69f5600640 1 --2- 172.21.15.122:0/1158454321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69f0159280 0x7f69f014c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:22.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69f4c00640 1 --2- 172.21.15.122:0/1158454321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69f006f0c0 0x7f69f014b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:22.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69efe00640 1 -- 172.21.15.122:0/1158454321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69f006f0c0 msgr2=0x7f69f014b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:22.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69efe00640 1 --2- 172.21.15.122:0/1158454321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69f006f0c0 0x7f69f014b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:22.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69efe00640 1 -- 172.21.15.122:0/1158454321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69f0159280 msgr2=0x7f69f014c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:22.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69efe00640 1 --2- 172.21.15.122:0/1158454321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69f0159280 0x7f69f014c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:22.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69efe00640 1 -- 172.21.15.122:0/1158454321 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f014bb60 con 0x7f69f00b0d90 2024-05-28T06:12:22.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69efe00640 1 --2- 172.21.15.122:0/1158454321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69f00b0d90 0x7f69f0137d70 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0190b0 tx=0x7f69dc019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:22.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69ecc00640 1 -- 172.21.15.122:0/1158454321 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc0b8020 con 0x7f69f00b0d90 2024-05-28T06:12:22.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69ecc00640 1 -- 172.21.15.122:0/1158454321 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69dc0b4410 con 0x7f69f00b0d90 2024-05-28T06:12:22.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69ecc00640 1 -- 172.21.15.122:0/1158454321 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc0b0040 con 0x7f69f00b0d90 2024-05-28T06:12:22.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69f7600640 1 -- 172.21.15.122:0/1158454321 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f00d0e30 con 0x7f69f00b0d90 2024-05-28T06:12:22.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69f7600640 1 -- 172.21.15.122:0/1158454321 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f0156740 con 0x7f69f00b0d90 2024-05-28T06:12:22.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69f7600640 1 -- 172.21.15.122:0/1158454321 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f0156530 con 0x7f69f00b0d90 2024-05-28T06:12:22.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.258+0000 7f69ecc00640 1 -- 172.21.15.122:0/1158454321 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f69dc0bb020 con 0x7f69f00b0d90 2024-05-28T06:12:22.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.262+0000 7f69ecc00640 1 --2- 172.21.15.122:0/1158454321 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f69d0068c20 0x7f69d006b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:22.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.262+0000 7f69ecc00640 1 -- 172.21.15.122:0/1158454321 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4971+0+0 (secure 0 0 0) 0x7f69dc11e560 con 0x7f69f00b0d90 2024-05-28T06:12:22.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.262+0000 7f69f4c00640 1 --2- 172.21.15.122:0/1158454321 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f69d0068c20 0x7f69d006b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:22.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.262+0000 7f69f4c00640 1 --2- 172.21.15.122:0/1158454321 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f69d0068c20 0x7f69d006b0e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f69e40011f0 tx=0x7f69e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:22.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.266+0000 7f69ecc00640 1 -- 172.21.15.122:0/1158454321 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f69dc0c3020 con 0x7f69f00b0d90 2024-05-28T06:12:22.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.478+0000 7f69f7600640 1 -- 172.21.15.122:0/1158454321 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones"]} v 0) -- 0x7f69f0068c40 con 0x7f69f00b0d90 2024-05-28T06:12:22.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.730+0000 7f69ecc00640 1 -- 172.21.15.122:0/1158454321 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones"]}]=0 v307) ==== 162+0+0 (secure 0 0 0) 0x7f69dc016090 con 0x7f69f00b0d90 2024-05-28T06:12:22.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.734+0000 7f69f7600640 1 -- 172.21.15.122:0/1158454321 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f69d0068c20 msgr2=0x7f69d006b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:22.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.734+0000 7f69f7600640 1 --2- 172.21.15.122:0/1158454321 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f69d0068c20 0x7f69d006b0e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f69e40011f0 tx=0x7f69e4009040 comp rx=0 tx=0).stop 2024-05-28T06:12:22.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.734+0000 7f69f7600640 1 -- 172.21.15.122:0/1158454321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69f00b0d90 msgr2=0x7f69f0137d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:22.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.734+0000 7f69f7600640 1 --2- 172.21.15.122:0/1158454321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69f00b0d90 0x7f69f0137d70 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0190b0 tx=0x7f69dc019240 comp rx=0 tx=0).stop 2024-05-28T06:12:22.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.734+0000 7f69f7600640 1 -- 172.21.15.122:0/1158454321 shutdown_connections 2024-05-28T06:12:22.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.734+0000 7f69f7600640 1 --2- 172.21.15.122:0/1158454321 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f69d0068c20 0x7f69d006b0e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:22.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.734+0000 7f69f7600640 1 --2- 172.21.15.122:0/1158454321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69f0159280 0x7f69f014c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:22.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.734+0000 7f69f7600640 1 --2- 172.21.15.122:0/1158454321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69f00b0d90 0x7f69f0137d70 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:22.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.734+0000 7f69f7600640 1 --2- 172.21.15.122:0/1158454321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f69f006f0c0 0x7f69f014b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:22.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.734+0000 7f69f7600640 1 -- 172.21.15.122:0/1158454321 >> 172.21.15.122:0/1158454321 conn(0x7f69f00b6c10 msgr2=0x7f69f00b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:22.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.734+0000 7f69f7600640 1 -- 172.21.15.122:0/1158454321 shutdown_connections 2024-05-28T06:12:22.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.734+0000 7f69f7600640 1 -- 172.21.15.122:0/1158454321 wait complete. 2024-05-28T06:12:22.753 INFO:tasks.cephfs_test_runner:Test that one progress bar is printed when number of clone jobs is ... ok 2024-05-28T06:12:22.753 INFO:tasks.cephfs_test_runner:Starting test: test_progress_bars_for_7_clones (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that 2 progress bars are printed when number of clone jobs is 2024-05-28T06:12:22.754 INFO:tasks.cephfs_test_runner:test_progress_bars_for_7_clones (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-28T06:12:22.754 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:12:22.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.898+0000 7febcba00640 1 Processor -- start 2024-05-28T06:12:22.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.898+0000 7febcba00640 1 -- start start 2024-05-28T06:12:22.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.898+0000 7febcba00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febc40b58d0 0x7febc40b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:22.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.898+0000 7febcba00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7febc40ce4f0 0x7febc40ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:22.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.898+0000 7febcba00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febc40b61f0 con 0x7febc40722a0 2024-05-28T06:12:22.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.898+0000 7febcba00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7febc415d970 con 0x7febc40ce4f0 2024-05-28T06:12:22.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.898+0000 7febcba00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7febc415dc50 con 0x7febc40b58d0 2024-05-28T06:12:22.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.898+0000 7febc9000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febc40b58d0 0x7febc40b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:22.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.898+0000 7febc3e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7febc40ce4f0 0x7febc40ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:22.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.898+0000 7febc9a00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7febc40722a0 0x7febc4072730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:55026/0 (socket says 172.21.15.122:55026) 2024-05-28T06:12:22.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.898+0000 7febc9000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febc40b58d0 0x7febc40b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:52634/0 (socket says 172.21.15.122:52634) 2024-05-28T06:12:22.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.898+0000 7febc9a00640 1 -- 172.21.15.122:0/2901968806 learned_addr learned my addr 172.21.15.122:0/2901968806 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:22.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.898+0000 7febc9000640 1 -- 172.21.15.122:0/2901968806 >> v2:172.21.15.153:3300/0 conn(0x7febc40ce4f0 msgr2=0x7febc40ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:22.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.898+0000 7febc9000640 1 --2- 172.21.15.122:0/2901968806 >> v2:172.21.15.153:3300/0 conn(0x7febc40ce4f0 0x7febc40ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:22.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.898+0000 7febc9000640 1 -- 172.21.15.122:0/2901968806 >> v1:172.21.15.153:6789/0 conn(0x7febc40722a0 legacy=0x7febc4072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:22.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.898+0000 7febc9000640 1 -- 172.21.15.122:0/2901968806 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc415df30 con 0x7febc40b58d0 2024-05-28T06:12:22.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.898+0000 7febc3e00640 1 --2- 172.21.15.122:0/2901968806 >> v2:172.21.15.153:3300/0 conn(0x7febc40ce4f0 0x7febc40ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:12:22.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.902+0000 7febc9000640 1 --2- 172.21.15.122:0/2901968806 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febc40b58d0 0x7febc40b5cb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7febb80097c0 tx=0x7febb801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80220078f0141b4e server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:22.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.902+0000 7febc3400640 1 -- 172.21.15.122:0/2901968806 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb80ab610 con 0x7febc40b58d0 2024-05-28T06:12:22.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.902+0000 7febc3400640 1 -- 172.21.15.122:0/2901968806 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febb80b0070 con 0x7febc40b58d0 2024-05-28T06:12:22.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.902+0000 7febc3400640 1 -- 172.21.15.122:0/2901968806 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb80ab9d0 con 0x7febc40b58d0 2024-05-28T06:12:22.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.902+0000 7febcba00640 1 -- 172.21.15.122:0/2901968806 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febc40b58d0 msgr2=0x7febc40b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:22.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.902+0000 7febcba00640 1 --2- 172.21.15.122:0/2901968806 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febc40b58d0 0x7febc40b5cb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7febb80097c0 tx=0x7febb801c470 comp rx=0 tx=0).stop 2024-05-28T06:12:22.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.902+0000 7febcba00640 1 -- 172.21.15.122:0/2901968806 shutdown_connections 2024-05-28T06:12:22.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.902+0000 7febcba00640 1 --2- 172.21.15.122:0/2901968806 >> v2:172.21.15.153:3300/0 conn(0x7febc40ce4f0 0x7febc40ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:22.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.902+0000 7febcba00640 1 --2- 172.21.15.122:0/2901968806 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febc40b58d0 0x7febc40b5cb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:22.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.902+0000 7febcba00640 1 -- 172.21.15.122:0/2901968806 >> 172.21.15.122:0/2901968806 conn(0x7febc406bd90 msgr2=0x7febc406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:22.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.902+0000 7febcba00640 1 -- 172.21.15.122:0/2901968806 shutdown_connections 2024-05-28T06:12:22.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.902+0000 7febcba00640 1 -- 172.21.15.122:0/2901968806 wait complete. 2024-05-28T06:12:22.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febcba00640 1 Processor -- start 2024-05-28T06:12:22.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febcba00640 1 -- start start 2024-05-28T06:12:22.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febcba00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febc40722a0 0x7febc413b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:22.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febcba00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febc40b58d0 0x7febc40aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:22.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febcba00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febc40ce4f0 0x7febc4159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:22.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febcba00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7febc40cf010 con 0x7febc40ce4f0 2024-05-28T06:12:22.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febcba00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7febc40cee90 con 0x7febc40b58d0 2024-05-28T06:12:22.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febcba00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7febc4169a60 con 0x7febc40722a0 2024-05-28T06:12:22.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febc9a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febc40ce4f0 0x7febc4159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:22.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febc9a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febc40ce4f0 0x7febc4159240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58970/0 (socket says 172.21.15.122:58970) 2024-05-28T06:12:22.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febc9a00640 1 -- 172.21.15.122:0/2842164636 learned_addr learned my addr 172.21.15.122:0/2842164636 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:22.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febc9000640 1 --2- 172.21.15.122:0/2842164636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febc40722a0 0x7febc413b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:22.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febc3e00640 1 --2- 172.21.15.122:0/2842164636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febc40b58d0 0x7febc40aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:22.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febc9a00640 1 -- 172.21.15.122:0/2842164636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febc40722a0 msgr2=0x7febc413b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:22.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febc9a00640 1 --2- 172.21.15.122:0/2842164636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febc40722a0 0x7febc413b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:22.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febc9a00640 1 -- 172.21.15.122:0/2842164636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febc40b58d0 msgr2=0x7febc40aa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:22.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febc9a00640 1 --2- 172.21.15.122:0/2842164636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febc40b58d0 0x7febc40aa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:22.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febc9a00640 1 -- 172.21.15.122:0/2842164636 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc4159db0 con 0x7febc40ce4f0 2024-05-28T06:12:22.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febc9a00640 1 --2- 172.21.15.122:0/2842164636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febc40ce4f0 0x7febc4159240 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7febbc00cbc0 tx=0x7febbc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:22.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febc0c00640 1 -- 172.21.15.122:0/2842164636 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc017070 con 0x7febc40ce4f0 2024-05-28T06:12:22.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febc0c00640 1 -- 172.21.15.122:0/2842164636 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febbc00ad40 con 0x7febc40ce4f0 2024-05-28T06:12:22.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febcba00640 1 -- 172.21.15.122:0/2842164636 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc415a090 con 0x7febc40ce4f0 2024-05-28T06:12:22.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febc0c00640 1 -- 172.21.15.122:0/2842164636 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc012600 con 0x7febc40ce4f0 2024-05-28T06:12:22.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.906+0000 7febcba00640 1 -- 172.21.15.122:0/2842164636 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc415a650 con 0x7febc40ce4f0 2024-05-28T06:12:22.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.910+0000 7febcba00640 1 -- 172.21.15.122:0/2842164636 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febc4068c40 con 0x7febc40ce4f0 2024-05-28T06:12:22.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.910+0000 7febc0c00640 1 -- 172.21.15.122:0/2842164636 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7febbc01a070 con 0x7febc40ce4f0 2024-05-28T06:12:22.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.910+0000 7febc0c00640 1 --2- 172.21.15.122:0/2842164636 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feba4068bf0 0x7feba406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:22.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.910+0000 7febc0c00640 1 -- 172.21.15.122:0/2842164636 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4971+0+0 (secure 0 0 0) 0x7febbc087520 con 0x7febc40ce4f0 2024-05-28T06:12:22.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.910+0000 7febc9000640 1 --2- 172.21.15.122:0/2842164636 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feba4068bf0 0x7feba406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:22.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.910+0000 7febc9000640 1 --2- 172.21.15.122:0/2842164636 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feba4068bf0 0x7feba406b0b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7febb80af000 tx=0x7febb80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:22.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:22.914+0000 7febc0c00640 1 -- 172.21.15.122:0/2842164636 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7febbc056850 con 0x7febc40ce4f0 2024-05-28T06:12:23.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.074+0000 7febcba00640 1 -- 172.21.15.122:0/2842164636 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7febc415aae0 con 0x7febc40ce4f0 2024-05-28T06:12:23.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.074+0000 7febc0c00640 1 -- 172.21.15.122:0/2842164636 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+13065 (secure 0 0 0) 0x7febbc05ab50 con 0x7febc40ce4f0 2024-05-28T06:12:23.074 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:23.074 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":53,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:12:21.726908+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.122:6837/1627568336":"2024-05-29T06:12:18.719897+0000","172.21.15.122:6835/1627568336":"2024-05-29T06:12:18.719897+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:12:23.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.074+0000 7febcba00640 1 -- 172.21.15.122:0/2842164636 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feba4068bf0 msgr2=0x7feba406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:23.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.074+0000 7febcba00640 1 --2- 172.21.15.122:0/2842164636 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feba4068bf0 0x7feba406b0b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7febb80af000 tx=0x7febb80a7000 comp rx=0 tx=0).stop 2024-05-28T06:12:23.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.074+0000 7febcba00640 1 -- 172.21.15.122:0/2842164636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febc40ce4f0 msgr2=0x7febc4159240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:23.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.074+0000 7febcba00640 1 --2- 172.21.15.122:0/2842164636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febc40ce4f0 0x7febc4159240 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7febbc00cbc0 tx=0x7febbc00a430 comp rx=0 tx=0).stop 2024-05-28T06:12:23.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.074+0000 7febcba00640 1 -- 172.21.15.122:0/2842164636 shutdown_connections 2024-05-28T06:12:23.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.074+0000 7febcba00640 1 --2- 172.21.15.122:0/2842164636 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7feba4068bf0 0x7feba406b0b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:23.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.074+0000 7febcba00640 1 --2- 172.21.15.122:0/2842164636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febc40ce4f0 0x7febc4159240 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:23.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.074+0000 7febcba00640 1 --2- 172.21.15.122:0/2842164636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febc40b58d0 0x7febc40aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:23.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.074+0000 7febcba00640 1 --2- 172.21.15.122:0/2842164636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febc40722a0 0x7febc413b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:23.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.074+0000 7febcba00640 1 -- 172.21.15.122:0/2842164636 >> 172.21.15.122:0/2842164636 conn(0x7febc406bd90 msgr2=0x7febc4145090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:23.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.078+0000 7febcba00640 1 -- 172.21.15.122:0/2842164636 shutdown_connections 2024-05-28T06:12:23.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.078+0000 7febcba00640 1 -- 172.21.15.122:0/2842164636 wait complete. 2024-05-28T06:12:23.095 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:12:23.096 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:12:23.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.234+0000 7f8abe000640 1 Processor -- start 2024-05-28T06:12:23.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.238+0000 7f8abe000640 1 -- start start 2024-05-28T06:12:23.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.238+0000 7f8abe000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8ab80b58d0 0x7f8ab80b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:23.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.238+0000 7f8abe000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8ab80ce4f0 0x7f8ab80ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:23.238 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.238+0000 7f8abe000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab80722a0 0x7f8ab8072730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:23.238 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.238+0000 7f8abe000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f8ab80b61f0 con 0x7f8ab80b58d0 2024-05-28T06:12:23.238 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.238+0000 7f8abe000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8ab815d970 con 0x7f8ab80ce4f0 2024-05-28T06:12:23.238 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.238+0000 7f8abe000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab815dc50 con 0x7f8ab80722a0 2024-05-28T06:12:23.238 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.238+0000 7f8ab7400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8ab80b58d0 0x7f8ab80b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:23.238 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.238+0000 7f8ab7400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8ab80b58d0 0x7f8ab80b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58976/0 (socket says 172.21.15.122:58976) 2024-05-28T06:12:23.238 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.238+0000 7f8ab7400640 1 -- 172.21.15.122:0/2647055677 learned_addr learned my addr 172.21.15.122:0/2647055677 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:23.238 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.238+0000 7f8aaea00640 1 --2- 172.21.15.122:0/2647055677 >> v2:172.21.15.153:3300/0 conn(0x7f8ab80ce4f0 0x7f8ab80ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:23.238 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.238+0000 7f8ab7e00640 1 --2- 172.21.15.122:0/2647055677 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab80722a0 0x7f8ab8072730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:23.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.238+0000 7f8ab7400640 1 -- 172.21.15.122:0/2647055677 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab80722a0 msgr2=0x7f8ab8072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:23.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.238+0000 7f8ab7400640 1 --2- 172.21.15.122:0/2647055677 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab80722a0 0x7f8ab8072730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:23.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.238+0000 7f8ab7400640 1 -- 172.21.15.122:0/2647055677 >> v2:172.21.15.153:3300/0 conn(0x7f8ab80ce4f0 msgr2=0x7f8ab80ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:23.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.238+0000 7f8ab7400640 1 --2- 172.21.15.122:0/2647055677 >> v2:172.21.15.153:3300/0 conn(0x7f8ab80ce4f0 0x7f8ab80ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:23.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.238+0000 7f8ab7400640 1 -- 172.21.15.122:0/2647055677 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab815df30 con 0x7f8ab80b58d0 2024-05-28T06:12:23.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.238+0000 7f8aaea00640 1 --2- 172.21.15.122:0/2647055677 >> v2:172.21.15.153:3300/0 conn(0x7f8ab80ce4f0 0x7f8ab80ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:12:23.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.242+0000 7f8ab7400640 1 --2- 172.21.15.122:0/2647055677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ab80b58d0 0x7f8ab80b5cb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80d0470 tx=0x7f8aa801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b85f46d80ce14a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:23.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.242+0000 7f8ab6a00640 1 -- 172.21.15.122:0/2647055677 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80a5840 con 0x7f8ab80b58d0 2024-05-28T06:12:23.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.242+0000 7f8ab6a00640 1 -- 172.21.15.122:0/2647055677 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa80a59e0 con 0x7f8ab80b58d0 2024-05-28T06:12:23.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.242+0000 7f8ab6a00640 1 -- 172.21.15.122:0/2647055677 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80a5db0 con 0x7f8ab80b58d0 2024-05-28T06:12:23.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.242+0000 7f8abe000640 1 -- 172.21.15.122:0/2647055677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ab80b58d0 msgr2=0x7f8ab80b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:23.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.242+0000 7f8abe000640 1 --2- 172.21.15.122:0/2647055677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ab80b58d0 0x7f8ab80b5cb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80d0470 tx=0x7f8aa801c9c0 comp rx=0 tx=0).stop 2024-05-28T06:12:23.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.242+0000 7f8abe000640 1 -- 172.21.15.122:0/2647055677 shutdown_connections 2024-05-28T06:12:23.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.242+0000 7f8abe000640 1 --2- 172.21.15.122:0/2647055677 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab80722a0 0x7f8ab8072730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:23.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.242+0000 7f8abe000640 1 --2- 172.21.15.122:0/2647055677 >> v2:172.21.15.153:3300/0 conn(0x7f8ab80ce4f0 0x7f8ab80ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:23.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.242+0000 7f8abe000640 1 --2- 172.21.15.122:0/2647055677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ab80b58d0 0x7f8ab80b5cb0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:23.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.242+0000 7f8abe000640 1 -- 172.21.15.122:0/2647055677 >> 172.21.15.122:0/2647055677 conn(0x7f8ab806bd90 msgr2=0x7f8ab806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:23.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.242+0000 7f8abe000640 1 -- 172.21.15.122:0/2647055677 shutdown_connections 2024-05-28T06:12:23.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.242+0000 7f8abe000640 1 -- 172.21.15.122:0/2647055677 wait complete. 2024-05-28T06:12:23.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.242+0000 7f8abe000640 1 Processor -- start 2024-05-28T06:12:23.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.242+0000 7f8abe000640 1 -- start start 2024-05-28T06:12:23.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.246+0000 7f8abe000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ab80722a0 0x7f8ab8140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:23.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.246+0000 7f8abe000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ab80b58d0 0x7f8ab8143ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:23.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.246+0000 7f8abe000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab80ce4f0 0x7f8ab81f9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:23.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.246+0000 7f8abe000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab80cf040 con 0x7f8ab80b58d0 2024-05-28T06:12:23.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.246+0000 7f8abe000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab80ceec0 con 0x7f8ab80722a0 2024-05-28T06:12:23.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.246+0000 7f8abe000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab8146260 con 0x7f8ab80ce4f0 2024-05-28T06:12:23.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.246+0000 7f8aaea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ab80b58d0 0x7f8ab8143ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:23.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.246+0000 7f8aaea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ab80b58d0 0x7f8ab8143ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58984/0 (socket says 172.21.15.122:58984) 2024-05-28T06:12:23.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.246+0000 7f8aaea00640 1 -- 172.21.15.122:0/2478507250 learned_addr learned my addr 172.21.15.122:0/2478507250 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:23.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.246+0000 7f8ab7400640 1 --2- 172.21.15.122:0/2478507250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ab80722a0 0x7f8ab8140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:23.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.246+0000 7f8ab7e00640 1 --2- 172.21.15.122:0/2478507250 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab80ce4f0 0x7f8ab81f9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:23.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.246+0000 7f8aaea00640 1 -- 172.21.15.122:0/2478507250 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab80ce4f0 msgr2=0x7f8ab81f9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:23.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.246+0000 7f8aaea00640 1 --2- 172.21.15.122:0/2478507250 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab80ce4f0 0x7f8ab81f9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:23.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.246+0000 7f8aaea00640 1 -- 172.21.15.122:0/2478507250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ab80722a0 msgr2=0x7f8ab8140730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:23.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.246+0000 7f8aaea00640 1 --2- 172.21.15.122:0/2478507250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ab80722a0 0x7f8ab8140730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:23.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.246+0000 7f8aaea00640 1 -- 172.21.15.122:0/2478507250 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab813ebc0 con 0x7f8ab80b58d0 2024-05-28T06:12:23.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.246+0000 7f8aaea00640 1 --2- 172.21.15.122:0/2478507250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ab80b58d0 0x7f8ab8143ec0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8aa000d800 tx=0x7f8aa000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:23.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.246+0000 7f8aafe00640 1 -- 172.21.15.122:0/2478507250 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa000b6c0 con 0x7f8ab80b58d0 2024-05-28T06:12:23.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.246+0000 7f8aafe00640 1 -- 172.21.15.122:0/2478507250 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa0019070 con 0x7f8ab80b58d0 2024-05-28T06:12:23.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.246+0000 7f8abe000640 1 -- 172.21.15.122:0/2478507250 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab813eea0 con 0x7f8ab80b58d0 2024-05-28T06:12:23.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.246+0000 7f8aafe00640 1 -- 172.21.15.122:0/2478507250 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa000baa0 con 0x7f8ab80b58d0 2024-05-28T06:12:23.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.246+0000 7f8abe000640 1 -- 172.21.15.122:0/2478507250 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab813f460 con 0x7f8ab80b58d0 2024-05-28T06:12:23.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.246+0000 7f8abe000640 1 -- 172.21.15.122:0/2478507250 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab8068c40 con 0x7f8ab80b58d0 2024-05-28T06:12:23.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.250+0000 7f8aafe00640 1 -- 172.21.15.122:0/2478507250 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f8aa000bc40 con 0x7f8ab80b58d0 2024-05-28T06:12:23.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.250+0000 7f8aafe00640 1 --2- 172.21.15.122:0/2478507250 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8a94068bf0 0x7f8a9406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:23.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.250+0000 7f8aafe00640 1 -- 172.21.15.122:0/2478507250 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4971+0+0 (secure 0 0 0) 0x7f8aa0087bf0 con 0x7f8ab80b58d0 2024-05-28T06:12:23.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.250+0000 7f8ab7400640 1 --2- 172.21.15.122:0/2478507250 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8a94068bf0 0x7f8a9406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:23.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.250+0000 7f8ab7400640 1 --2- 172.21.15.122:0/2478507250 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8a94068bf0 0x7f8a9406b0b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8aa80ae000 tx=0x7f8aa80a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:23.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.254+0000 7f8aafe00640 1 -- 172.21.15.122:0/2478507250 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8aa0057570 con 0x7f8ab80b58d0 2024-05-28T06:12:23.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.414+0000 7f8abe000640 1 -- 172.21.15.122:0/2478507250 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8ab813f860 con 0x7f8ab80b58d0 2024-05-28T06:12:23.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.414+0000 7f8aafe00640 1 -- 172.21.15.122:0/2478507250 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) ==== 93+0+10 (secure 0 0 0) 0x7f8aa0056e70 con 0x7f8ab80b58d0 2024-05-28T06:12:23.413 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:12:23.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.414+0000 7f8abe000640 1 -- 172.21.15.122:0/2478507250 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8a94068bf0 msgr2=0x7f8a9406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:23.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.414+0000 7f8abe000640 1 --2- 172.21.15.122:0/2478507250 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8a94068bf0 0x7f8a9406b0b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8aa80ae000 tx=0x7f8aa80a7070 comp rx=0 tx=0).stop 2024-05-28T06:12:23.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.414+0000 7f8abe000640 1 -- 172.21.15.122:0/2478507250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ab80b58d0 msgr2=0x7f8ab8143ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:23.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.414+0000 7f8abe000640 1 --2- 172.21.15.122:0/2478507250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ab80b58d0 0x7f8ab8143ec0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8aa000d800 tx=0x7f8aa000dcc0 comp rx=0 tx=0).stop 2024-05-28T06:12:23.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.414+0000 7f8abe000640 1 -- 172.21.15.122:0/2478507250 shutdown_connections 2024-05-28T06:12:23.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.414+0000 7f8abe000640 1 --2- 172.21.15.122:0/2478507250 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8a94068bf0 0x7f8a9406b0b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:23.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.414+0000 7f8abe000640 1 --2- 172.21.15.122:0/2478507250 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ab80ce4f0 0x7f8ab81f9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:23.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.414+0000 7f8abe000640 1 --2- 172.21.15.122:0/2478507250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ab80b58d0 0x7f8ab8143ec0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:23.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.414+0000 7f8abe000640 1 --2- 172.21.15.122:0/2478507250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ab80722a0 0x7f8ab8140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:23.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.414+0000 7f8abe000640 1 -- 172.21.15.122:0/2478507250 >> 172.21.15.122:0/2478507250 conn(0x7f8ab806bd90 msgr2=0x7f8ab80cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:23.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.414+0000 7f8abe000640 1 -- 172.21.15.122:0/2478507250 shutdown_connections 2024-05-28T06:12:23.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.414+0000 7f8abe000640 1 -- 172.21.15.122:0/2478507250 wait complete. 2024-05-28T06:12:23.434 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_7_clones' 2024-05-28T06:12:23.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.570+0000 7f1525c00640 1 Processor -- start 2024-05-28T06:12:23.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.570+0000 7f1525c00640 1 -- start start 2024-05-28T06:12:23.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.570+0000 7f1525c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f15201588b0 0x7f152006e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:23.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.570+0000 7f1525c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f152015f4c0 0x7f1520140580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:23.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.570+0000 7f1525c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1520141420 con 0x7f152015e8b0 2024-05-28T06:12:23.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.570+0000 7f1525c00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f1520158c90 con 0x7f15201588b0 2024-05-28T06:12:23.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.570+0000 7f1525c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1520140e60 con 0x7f152015f4c0 2024-05-28T06:12:23.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.570+0000 7f151ea00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f15201588b0 0x7f152006e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:23.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.570+0000 7f151f400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f152015e8b0 0x7f15200cf670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:45428/0 (socket says 172.21.15.122:45428) 2024-05-28T06:12:23.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.570+0000 7f151f400640 1 -- 172.21.15.122:0/2724422215 learned_addr learned my addr 172.21.15.122:0/2724422215 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:23.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.570+0000 7f151e000640 1 --2- 172.21.15.122:0/2724422215 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f152015f4c0 0x7f1520140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:23.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.570+0000 7f151ea00640 1 -- 172.21.15.122:0/2724422215 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f152015f4c0 msgr2=0x7f1520140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:23.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.570+0000 7f151ea00640 1 --2- 172.21.15.122:0/2724422215 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f152015f4c0 0x7f1520140580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:23.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.570+0000 7f151ea00640 1 -- 172.21.15.122:0/2724422215 >> v1:172.21.15.122:6789/0 conn(0x7f152015e8b0 legacy=0x7f15200cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:23.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.570+0000 7f151ea00640 1 -- 172.21.15.122:0/2724422215 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1520141140 con 0x7f15201588b0 2024-05-28T06:12:23.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.570+0000 7f151d600640 1 -- 172.21.15.122:0/2724422215 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3284014553 0 0) 0x7f1520141420 con 0x7f152015e8b0 2024-05-28T06:12:23.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.574+0000 7f151ea00640 1 --2- 172.21.15.122:0/2724422215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15201588b0 0x7f152006e070 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f151000a960 tx=0x7f151001d870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d18bf23530440d server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:23.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.574+0000 7f151d600640 1 -- 172.21.15.122:0/2724422215 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15100b3070 con 0x7f15201588b0 2024-05-28T06:12:23.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.574+0000 7f151d600640 1 -- 172.21.15.122:0/2724422215 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15100a6920 con 0x7f15201588b0 2024-05-28T06:12:23.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.574+0000 7f151d600640 1 -- 172.21.15.122:0/2724422215 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151000b040 con 0x7f15201588b0 2024-05-28T06:12:23.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.574+0000 7f1525c00640 1 -- 172.21.15.122:0/2724422215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15201588b0 msgr2=0x7f152006e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:23.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.574+0000 7f1525c00640 1 --2- 172.21.15.122:0/2724422215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15201588b0 0x7f152006e070 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f151000a960 tx=0x7f151001d870 comp rx=0 tx=0).stop 2024-05-28T06:12:23.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.574+0000 7f1525c00640 1 -- 172.21.15.122:0/2724422215 shutdown_connections 2024-05-28T06:12:23.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.574+0000 7f1525c00640 1 --2- 172.21.15.122:0/2724422215 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f152015f4c0 0x7f1520140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:23.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.574+0000 7f1525c00640 1 --2- 172.21.15.122:0/2724422215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15201588b0 0x7f152006e070 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:23.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.574+0000 7f1525c00640 1 -- 172.21.15.122:0/2724422215 >> 172.21.15.122:0/2724422215 conn(0x7f152006bd90 msgr2=0x7f152006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:23.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.574+0000 7f1525c00640 1 -- 172.21.15.122:0/2724422215 shutdown_connections 2024-05-28T06:12:23.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.574+0000 7f1525c00640 1 -- 172.21.15.122:0/2724422215 wait complete. 2024-05-28T06:12:23.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f1525c00640 1 Processor -- start 2024-05-28T06:12:23.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f1525c00640 1 -- start start 2024-05-28T06:12:23.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f1525c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15201588b0 0x7f1520141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:23.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f1525c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f152015e8b0 0x7f152014c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:23.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f1525c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f152015f4c0 0x7f152015d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:23.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f1525c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1520140c40 con 0x7f15201588b0 2024-05-28T06:12:23.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f1525c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1520140ac0 con 0x7f152015e8b0 2024-05-28T06:12:23.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f1525c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f15200d0190 con 0x7f152015f4c0 2024-05-28T06:12:23.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f151ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15201588b0 0x7f1520141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:23.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f151ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15201588b0 0x7f1520141640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58998/0 (socket says 172.21.15.122:58998) 2024-05-28T06:12:23.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f151ea00640 1 -- 172.21.15.122:0/2229913467 learned_addr learned my addr 172.21.15.122:0/2229913467 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:23.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f151f400640 1 --2- 172.21.15.122:0/2229913467 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f152015f4c0 0x7f152015d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:23.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f151e000640 1 --2- 172.21.15.122:0/2229913467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f152015e8b0 0x7f152014c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:23.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f151ea00640 1 -- 172.21.15.122:0/2229913467 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f152015f4c0 msgr2=0x7f152015d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:23.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f151ea00640 1 --2- 172.21.15.122:0/2229913467 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f152015f4c0 0x7f152015d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:23.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f151ea00640 1 -- 172.21.15.122:0/2229913467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f152015e8b0 msgr2=0x7f152014c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:23.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f151ea00640 1 --2- 172.21.15.122:0/2229913467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f152015e8b0 0x7f152014c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:23.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f151ea00640 1 -- 172.21.15.122:0/2229913467 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1520141f20 con 0x7f15201588b0 2024-05-28T06:12:23.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f151e000640 1 --2- 172.21.15.122:0/2229913467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f152015e8b0 0x7f152014c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:23.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f151ea00640 1 --2- 172.21.15.122:0/2229913467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15201588b0 0x7f1520141640 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f151000a960 tx=0x7f151001c0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:23.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f1516a00640 1 -- 172.21.15.122:0/2229913467 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15100b3040 con 0x7f15201588b0 2024-05-28T06:12:23.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f1516a00640 1 -- 172.21.15.122:0/2229913467 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1510004230 con 0x7f15201588b0 2024-05-28T06:12:23.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f1516a00640 1 -- 172.21.15.122:0/2229913467 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1510003620 con 0x7f15201588b0 2024-05-28T06:12:23.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f1525c00640 1 -- 172.21.15.122:0/2229913467 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1520142200 con 0x7f15201588b0 2024-05-28T06:12:23.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.578+0000 7f1525c00640 1 -- 172.21.15.122:0/2229913467 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15201427c0 con 0x7f15201588b0 2024-05-28T06:12:23.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.582+0000 7f1525c00640 1 -- 172.21.15.122:0/2229913467 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1520068c40 con 0x7f15201588b0 2024-05-28T06:12:23.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.582+0000 7f1516a00640 1 -- 172.21.15.122:0/2229913467 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f15100c0060 con 0x7f15201588b0 2024-05-28T06:12:23.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.582+0000 7f1516a00640 1 --2- 172.21.15.122:0/2229913467 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1500068bf0 0x7f150006b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:23.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.582+0000 7f1516a00640 1 -- 172.21.15.122:0/2229913467 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4971+0+0 (secure 0 0 0) 0x7f15101210c0 con 0x7f15201588b0 2024-05-28T06:12:23.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.582+0000 7f151e000640 1 --2- 172.21.15.122:0/2229913467 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1500068bf0 0x7f150006b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:23.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.582+0000 7f151e000640 1 --2- 172.21.15.122:0/2229913467 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1500068bf0 0x7f150006b0b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f152013d850 tx=0x7f150c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:23.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.586+0000 7f1516a00640 1 -- 172.21.15.122:0/2229913467 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1510017460 con 0x7f15201588b0 2024-05-28T06:12:23.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:23.798+0000 7f1525c00640 1 -- 172.21.15.122:0/2229913467 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_7_clones"]} v 0) -- 0x7f1520165a20 con 0x7f15201588b0 2024-05-28T06:12:24.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.742+0000 7f1516a00640 1 -- 172.21.15.122:0/2229913467 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_7_clones"]}]=0 v309) ==== 165+0+0 (secure 0 0 0) 0x7f15100f0e50 con 0x7f15201588b0 2024-05-28T06:12:24.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.742+0000 7f1525c00640 1 -- 172.21.15.122:0/2229913467 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1500068bf0 msgr2=0x7f150006b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:24.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.742+0000 7f1525c00640 1 --2- 172.21.15.122:0/2229913467 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1500068bf0 0x7f150006b0b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f152013d850 tx=0x7f150c008040 comp rx=0 tx=0).stop 2024-05-28T06:12:24.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.742+0000 7f1525c00640 1 -- 172.21.15.122:0/2229913467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15201588b0 msgr2=0x7f1520141640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:24.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.742+0000 7f1525c00640 1 --2- 172.21.15.122:0/2229913467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15201588b0 0x7f1520141640 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f151000a960 tx=0x7f151001c0b0 comp rx=0 tx=0).stop 2024-05-28T06:12:24.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.746+0000 7f1525c00640 1 -- 172.21.15.122:0/2229913467 shutdown_connections 2024-05-28T06:12:24.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.746+0000 7f1525c00640 1 --2- 172.21.15.122:0/2229913467 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1500068bf0 0x7f150006b0b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:24.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.746+0000 7f1525c00640 1 --2- 172.21.15.122:0/2229913467 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f152015f4c0 0x7f152015d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:24.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.746+0000 7f1525c00640 1 --2- 172.21.15.122:0/2229913467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f152015e8b0 0x7f152014c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:24.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.746+0000 7f1525c00640 1 --2- 172.21.15.122:0/2229913467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15201588b0 0x7f1520141640 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:24.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.746+0000 7f1525c00640 1 -- 172.21.15.122:0/2229913467 >> 172.21.15.122:0/2229913467 conn(0x7f152006bd90 msgr2=0x7f1520159050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:24.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.746+0000 7f1525c00640 1 -- 172.21.15.122:0/2229913467 shutdown_connections 2024-05-28T06:12:24.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.746+0000 7f1525c00640 1 -- 172.21.15.122:0/2229913467 wait complete. 2024-05-28T06:12:24.769 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-28T06:12:24.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.910+0000 7fd9b3200640 1 Processor -- start 2024-05-28T06:12:24.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.910+0000 7fd9b3200640 1 -- start start 2024-05-28T06:12:24.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.914+0000 7fd9b3200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd9ac0cf650 0x7fd9ac0b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:24.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.914+0000 7fd9b3200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9ac06f780 0x7fd9ac0b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:24.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.914+0000 7fd9b3200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9ac06df80 con 0x7fd9ac0cfa30 2024-05-28T06:12:24.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.914+0000 7fd9b3200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd9ac06e260 con 0x7fd9ac0cf650 2024-05-28T06:12:24.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.914+0000 7fd9b3200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd9ac0cd7d0 con 0x7fd9ac06f780 2024-05-28T06:12:24.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.914+0000 7fd9b2800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9ac06f780 0x7fd9ac0b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:24.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.914+0000 7fd9b1e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd9ac0cf650 0x7fd9ac0b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:24.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.914+0000 7fd9b1400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd9ac0cfa30 0x7fd9ac0b39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:55030/0 (socket says 172.21.15.122:55030) 2024-05-28T06:12:24.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.914+0000 7fd9b1400640 1 -- 172.21.15.122:0/116049359 learned_addr learned my addr 172.21.15.122:0/116049359 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:24.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.914+0000 7fd9b1e00640 1 -- 172.21.15.122:0/116049359 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9ac06f780 msgr2=0x7fd9ac0b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:24.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.914+0000 7fd9b1e00640 1 --2- 172.21.15.122:0/116049359 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9ac06f780 0x7fd9ac0b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:24.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.914+0000 7fd9b1e00640 1 -- 172.21.15.122:0/116049359 >> v1:172.21.15.153:6789/0 conn(0x7fd9ac0cfa30 legacy=0x7fd9ac0b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:24.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.914+0000 7fd9b1e00640 1 -- 172.21.15.122:0/116049359 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9ac0cdab0 con 0x7fd9ac0cf650 2024-05-28T06:12:24.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.918+0000 7fd9b1e00640 1 --2- 172.21.15.122:0/116049359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9ac0cf650 0x7fd9ac0b3470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00097c0 tx=0x7fd9a001c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6166c202bcfd0860 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:24.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.918+0000 7fd9b0a00640 1 -- 172.21.15.122:0/116049359 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a00b0070 con 0x7fd9ac0cf650 2024-05-28T06:12:24.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.918+0000 7fd9b0a00640 1 -- 172.21.15.122:0/116049359 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a00ab600 con 0x7fd9ac0cf650 2024-05-28T06:12:24.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.918+0000 7fd9b0a00640 1 -- 172.21.15.122:0/116049359 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a00ab9d0 con 0x7fd9ac0cf650 2024-05-28T06:12:24.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.918+0000 7fd9b3200640 1 -- 172.21.15.122:0/116049359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9ac0cf650 msgr2=0x7fd9ac0b3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:24.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.918+0000 7fd9b3200640 1 --2- 172.21.15.122:0/116049359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9ac0cf650 0x7fd9ac0b3470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00097c0 tx=0x7fd9a001c380 comp rx=0 tx=0).stop 2024-05-28T06:12:24.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.918+0000 7fd9b3200640 1 -- 172.21.15.122:0/116049359 shutdown_connections 2024-05-28T06:12:24.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.918+0000 7fd9b3200640 1 --2- 172.21.15.122:0/116049359 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9ac06f780 0x7fd9ac0b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:24.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.918+0000 7fd9b3200640 1 --2- 172.21.15.122:0/116049359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9ac0cf650 0x7fd9ac0b3470 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:24.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.918+0000 7fd9b3200640 1 -- 172.21.15.122:0/116049359 >> 172.21.15.122:0/116049359 conn(0x7fd9ac06b990 msgr2=0x7fd9ac06bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:24.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.918+0000 7fd9b3200640 1 -- 172.21.15.122:0/116049359 shutdown_connections 2024-05-28T06:12:24.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.918+0000 7fd9b3200640 1 -- 172.21.15.122:0/116049359 wait complete. 2024-05-28T06:12:24.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.918+0000 7fd9b3200640 1 Processor -- start 2024-05-28T06:12:24.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.918+0000 7fd9b3200640 1 -- start start 2024-05-28T06:12:24.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9b3200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9ac06f780 0x7fd9ac150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:24.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9b3200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9ac0cf650 0x7fd9ac158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:24.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9b3200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9ac0cfa30 0x7fd9ac13acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:24.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9b3200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ac06ea00 con 0x7fd9ac0cfa30 2024-05-28T06:12:24.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9b3200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ac06e880 con 0x7fd9ac0cf650 2024-05-28T06:12:24.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9b3200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd9ac06eb80 con 0x7fd9ac06f780 2024-05-28T06:12:24.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9b2800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9ac0cfa30 0x7fd9ac13acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:24.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9b2800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9ac0cfa30 0x7fd9ac13acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59000/0 (socket says 172.21.15.122:59000) 2024-05-28T06:12:24.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9b2800640 1 -- 172.21.15.122:0/1019738819 learned_addr learned my addr 172.21.15.122:0/1019738819 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:24.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9b1400640 1 --2- 172.21.15.122:0/1019738819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9ac0cf650 0x7fd9ac158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:24.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9b1e00640 1 --2- 172.21.15.122:0/1019738819 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9ac06f780 0x7fd9ac150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:24.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9b2800640 1 -- 172.21.15.122:0/1019738819 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9ac06f780 msgr2=0x7fd9ac150550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:24.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9b2800640 1 --2- 172.21.15.122:0/1019738819 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9ac06f780 0x7fd9ac150550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:24.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9b2800640 1 -- 172.21.15.122:0/1019738819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9ac0cf650 msgr2=0x7fd9ac158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:24.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9b2800640 1 --2- 172.21.15.122:0/1019738819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9ac0cf650 0x7fd9ac158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:24.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9b2800640 1 -- 172.21.15.122:0/1019738819 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9ac0afa00 con 0x7fd9ac0cfa30 2024-05-28T06:12:24.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9b2800640 1 --2- 172.21.15.122:0/1019738819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9ac0cfa30 0x7fd9ac13acb0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd9a800efc0 tx=0x7fd9a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:24.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9a6000640 1 -- 172.21.15.122:0/1019738819 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8018020 con 0x7fd9ac0cfa30 2024-05-28T06:12:24.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9a6000640 1 -- 172.21.15.122:0/1019738819 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a8014480 con 0x7fd9ac0cfa30 2024-05-28T06:12:24.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9a6000640 1 -- 172.21.15.122:0/1019738819 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8014870 con 0x7fd9ac0cfa30 2024-05-28T06:12:24.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9b3200640 1 -- 172.21.15.122:0/1019738819 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9ac159720 con 0x7fd9ac0cfa30 2024-05-28T06:12:24.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9b3200640 1 -- 172.21.15.122:0/1019738819 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9ac159ce0 con 0x7fd9ac0cfa30 2024-05-28T06:12:24.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9b3200640 1 -- 172.21.15.122:0/1019738819 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9ac075620 con 0x7fd9ac0cfa30 2024-05-28T06:12:24.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.922+0000 7fd9a6000640 1 -- 172.21.15.122:0/1019738819 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fd9a801b020 con 0x7fd9ac0cfa30 2024-05-28T06:12:24.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.926+0000 7fd9a6000640 1 --2- 172.21.15.122:0/1019738819 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd990068bf0 0x7fd99006b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:24.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.926+0000 7fd9a6000640 1 -- 172.21.15.122:0/1019738819 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4971+0+0 (secure 0 0 0) 0x7fd9a8085ba0 con 0x7fd9ac0cfa30 2024-05-28T06:12:24.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.926+0000 7fd9b1e00640 1 --2- 172.21.15.122:0/1019738819 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd990068bf0 0x7fd99006b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:24.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.926+0000 7fd9b1e00640 1 --2- 172.21.15.122:0/1019738819 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd990068bf0 0x7fd99006b0b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00ad000 tx=0x7fd9a00a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:24.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:24.930+0000 7fd9a6000640 1 -- 172.21.15.122:0/1019738819 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd9a8022070 con 0x7fd9ac0cfa30 2024-05-28T06:12:25.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.086+0000 7fd9b3200640 1 -- 172.21.15.122:0/1019738819 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd9ac072f70 con 0x7fd9ac0cfa30 2024-05-28T06:12:25.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.090+0000 7fd9a6000640 1 -- 172.21.15.122:0/1019738819 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7fd9a8010040 con 0x7fd9ac0cfa30 2024-05-28T06:12:25.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.090+0000 7fd9b3200640 1 -- 172.21.15.122:0/1019738819 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd990068bf0 msgr2=0x7fd99006b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:25.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.090+0000 7fd9b3200640 1 --2- 172.21.15.122:0/1019738819 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd990068bf0 0x7fd99006b0b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00ad000 tx=0x7fd9a00a6000 comp rx=0 tx=0).stop 2024-05-28T06:12:25.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.090+0000 7fd9b3200640 1 -- 172.21.15.122:0/1019738819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9ac0cfa30 msgr2=0x7fd9ac13acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:25.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.090+0000 7fd9b3200640 1 --2- 172.21.15.122:0/1019738819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9ac0cfa30 0x7fd9ac13acb0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd9a800efc0 tx=0x7fd9a800c490 comp rx=0 tx=0).stop 2024-05-28T06:12:25.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.090+0000 7fd9b3200640 1 -- 172.21.15.122:0/1019738819 shutdown_connections 2024-05-28T06:12:25.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.090+0000 7fd9b3200640 1 --2- 172.21.15.122:0/1019738819 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd990068bf0 0x7fd99006b0b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:25.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.090+0000 7fd9b3200640 1 --2- 172.21.15.122:0/1019738819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9ac0cfa30 0x7fd9ac13acb0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:25.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.090+0000 7fd9b3200640 1 --2- 172.21.15.122:0/1019738819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9ac0cf650 0x7fd9ac158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:25.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.090+0000 7fd9b3200640 1 --2- 172.21.15.122:0/1019738819 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9ac06f780 0x7fd9ac150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:25.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.090+0000 7fd9b3200640 1 -- 172.21.15.122:0/1019738819 >> 172.21.15.122:0/1019738819 conn(0x7fd9ac06b990 msgr2=0x7fd9ac06efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:25.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.090+0000 7fd9b3200640 1 -- 172.21.15.122:0/1019738819 shutdown_connections 2024-05-28T06:12:25.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.090+0000 7fd9b3200640 1 -- 172.21.15.122:0/1019738819 wait complete. 2024-05-28T06:12:25.113 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-28T06:12:25.114 DEBUG:teuthology.orchestra.run.smithi122:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-28T06:12:25.179 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-28T06:12:25.265 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-28T06:12:25.265 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:12:25.265 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:12:25.273 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350136k,nr_inodes=4087534,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2578 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-28T06:12:25.274 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:12:25.274 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:12:25.283 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350304k,nr_inodes=4087576,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5271 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-28T06:12:25.283 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:12:25.283 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:12:25.326 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350136k,nr_inodes=4087534,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2578 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-28T06:12:25.326 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:12:25.326 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:12:25.335 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350304k,nr_inodes=4087576,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5271 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-28T06:12:25.335 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-28T06:12:25.335 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:12:25.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.502+0000 7f500c000640 1 Processor -- start 2024-05-28T06:12:25.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.502+0000 7f500c000640 1 -- start start 2024-05-28T06:12:25.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.506+0000 7f500c000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5004159280 0x7f50040cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:25.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.506+0000 7f500c000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f500406f0c0 0x7f500406f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:25.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.506+0000 7f500c000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f500415bd70 con 0x7f50040b0d90 2024-05-28T06:12:25.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.506+0000 7f500c000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f500406fa70 con 0x7f5004159280 2024-05-28T06:12:25.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.506+0000 7f500c000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5004159660 con 0x7f500406f0c0 2024-05-28T06:12:25.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.506+0000 7f5009600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5004159280 0x7f50040cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:25.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.506+0000 7f5009600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5004159280 0x7f50040cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37746/0 (socket says 172.21.15.122:37746) 2024-05-28T06:12:25.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.506+0000 7f5009600640 1 -- 172.21.15.122:0/2305279576 learned_addr learned my addr 172.21.15.122:0/2305279576 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:25.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.506+0000 7f5009600640 1 -- 172.21.15.122:0/2305279576 >> v2:172.21.15.153:3300/0 conn(0x7f500406f0c0 msgr2=0x7f500406f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:25.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.506+0000 7f500a000640 1 --2- 172.21.15.122:0/2305279576 >> v2:172.21.15.153:3300/0 conn(0x7f500406f0c0 0x7f500406f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:25.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.506+0000 7f5009600640 1 --2- 172.21.15.122:0/2305279576 >> v2:172.21.15.153:3300/0 conn(0x7f500406f0c0 0x7f500406f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:25.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.506+0000 7f5009600640 1 -- 172.21.15.122:0/2305279576 >> v1:172.21.15.153:6789/0 conn(0x7f50040b0d90 legacy=0x7f5004073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:25.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.506+0000 7f5009600640 1 -- 172.21.15.122:0/2305279576 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500415c050 con 0x7f5004159280 2024-05-28T06:12:25.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.506+0000 7f500a000640 1 --2- 172.21.15.122:0/2305279576 >> v2:172.21.15.153:3300/0 conn(0x7f500406f0c0 0x7f500406f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:25.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.510+0000 7f5009600640 1 --2- 172.21.15.122:0/2305279576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5004159280 0x7f50040cf290 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f50040ce280 tx=0x7f4ff801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f419583f8791c0d server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:25.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.510+0000 7f5003e00640 1 -- 172.21.15.122:0/2305279576 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff80a5670 con 0x7f5004159280 2024-05-28T06:12:25.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.510+0000 7f5003e00640 1 -- 172.21.15.122:0/2305279576 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff80a5810 con 0x7f5004159280 2024-05-28T06:12:25.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.510+0000 7f5003e00640 1 -- 172.21.15.122:0/2305279576 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff80a5be0 con 0x7f5004159280 2024-05-28T06:12:25.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.510+0000 7f500c000640 1 -- 172.21.15.122:0/2305279576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5004159280 msgr2=0x7f50040cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:25.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.510+0000 7f500c000640 1 --2- 172.21.15.122:0/2305279576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5004159280 0x7f50040cf290 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f50040ce280 tx=0x7f4ff801c9b0 comp rx=0 tx=0).stop 2024-05-28T06:12:25.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.510+0000 7f500c000640 1 -- 172.21.15.122:0/2305279576 shutdown_connections 2024-05-28T06:12:25.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.510+0000 7f500c000640 1 --2- 172.21.15.122:0/2305279576 >> v2:172.21.15.153:3300/0 conn(0x7f500406f0c0 0x7f500406f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:25.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.510+0000 7f500c000640 1 --2- 172.21.15.122:0/2305279576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5004159280 0x7f50040cf290 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:25.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.510+0000 7f500c000640 1 -- 172.21.15.122:0/2305279576 >> 172.21.15.122:0/2305279576 conn(0x7f50040b6c10 msgr2=0x7f50040b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:25.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.510+0000 7f500c000640 1 -- 172.21.15.122:0/2305279576 shutdown_connections 2024-05-28T06:12:25.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.510+0000 7f500c000640 1 -- 172.21.15.122:0/2305279576 wait complete. 2024-05-28T06:12:25.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.510+0000 7f500c000640 1 Processor -- start 2024-05-28T06:12:25.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.510+0000 7f500c000640 1 -- start start 2024-05-28T06:12:25.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f500c000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f500406f0c0 0x7f5004142f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:25.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f500c000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f50040b0d90 0x7f50040cb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:25.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f500c000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5004159280 0x7f50040cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:25.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f500c000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f50040d2000 con 0x7f5004159280 2024-05-28T06:12:25.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f500c000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f50040d1e80 con 0x7f500406f0c0 2024-05-28T06:12:25.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f500c000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f50040d2180 con 0x7f50040b0d90 2024-05-28T06:12:25.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f500a000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5004159280 0x7f50040cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:25.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f500a000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5004159280 0x7f50040cbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37750/0 (socket says 172.21.15.122:37750) 2024-05-28T06:12:25.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f500a000640 1 -- 172.21.15.122:0/1087257285 learned_addr learned my addr 172.21.15.122:0/1087257285 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:25.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f5009600640 1 --2- 172.21.15.122:0/1087257285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f500406f0c0 0x7f5004142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:25.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f5008c00640 1 --2- 172.21.15.122:0/1087257285 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f50040b0d90 0x7f50040cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:25.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f500a000640 1 -- 172.21.15.122:0/1087257285 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f50040b0d90 msgr2=0x7f50040cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:25.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f500a000640 1 --2- 172.21.15.122:0/1087257285 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f50040b0d90 0x7f50040cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:25.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f500a000640 1 -- 172.21.15.122:0/1087257285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f500406f0c0 msgr2=0x7f5004142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:25.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f500a000640 1 --2- 172.21.15.122:0/1087257285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f500406f0c0 0x7f5004142f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:25.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f500a000640 1 -- 172.21.15.122:0/1087257285 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5004143460 con 0x7f5004159280 2024-05-28T06:12:25.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f500a000640 1 --2- 172.21.15.122:0/1087257285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5004159280 0x7f50040cbcc0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00c7f0 tx=0x7f4ffc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:25.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f5001600640 1 -- 172.21.15.122:0/1087257285 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc015070 con 0x7f5004159280 2024-05-28T06:12:25.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f5001600640 1 -- 172.21.15.122:0/1087257285 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ffc007860 con 0x7f5004159280 2024-05-28T06:12:25.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f500c000640 1 -- 172.21.15.122:0/1087257285 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5004152ae0 con 0x7f5004159280 2024-05-28T06:12:25.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f5001600640 1 -- 172.21.15.122:0/1087257285 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc007c50 con 0x7f5004159280 2024-05-28T06:12:25.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f500c000640 1 -- 172.21.15.122:0/1087257285 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5004153060 con 0x7f5004159280 2024-05-28T06:12:25.516 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f500c000640 1 -- 172.21.15.122:0/1087257285 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5004068c40 con 0x7f5004159280 2024-05-28T06:12:25.516 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.514+0000 7f5001600640 1 -- 172.21.15.122:0/1087257285 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f4ffc018070 con 0x7f5004159280 2024-05-28T06:12:25.517 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.518+0000 7f5001600640 1 --2- 172.21.15.122:0/1087257285 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4fe4068bf0 0x7f4fe406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:25.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.518+0000 7f5001600640 1 -- 172.21.15.122:0/1087257285 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4971+0+0 (secure 0 0 0) 0x7f4ffc087a30 con 0x7f5004159280 2024-05-28T06:12:25.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.518+0000 7f5009600640 1 --2- 172.21.15.122:0/1087257285 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4fe4068bf0 0x7f4fe406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:25.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.518+0000 7f5009600640 1 --2- 172.21.15.122:0/1087257285 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4fe4068bf0 0x7f4fe406b0b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80ae000 tx=0x7f4ff80a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:25.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.522+0000 7f5001600640 1 -- 172.21.15.122:0/1087257285 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4ffc056ce0 con 0x7f5004159280 2024-05-28T06:12:25.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.710+0000 7f500c000640 1 -- 172.21.15.122:0/1087257285 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f500406bcc0 con 0x7f5004159280 2024-05-28T06:12:25.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.710+0000 7f5001600640 1 -- 172.21.15.122:0/1087257285 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+3872 (secure 0 0 0) 0x7f4ffc05afe0 con 0x7f5004159280 2024-05-28T06:12:25.710 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:25.710 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":31,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5482,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/257060312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":257060312},{"type":"v1","addr":"172.21.15.153:6834","nonce":257060312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5485,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/573898687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":573898687},{"type":"v1","addr":"172.21.15.153:6835","nonce":573898687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/246840682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":246840682},{"type":"v1","addr":"172.21.15.122:6836","nonce":246840682}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":6228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/3791758370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":3791758370},{"type":"v1","addr":"172.21.15.122:6837","nonce":3791758370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[]} 2024-05-28T06:12:25.710 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 31 2024-05-28T06:12:25.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.710+0000 7f500c000640 1 -- 172.21.15.122:0/1087257285 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4fe4068bf0 msgr2=0x7f4fe406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:25.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.710+0000 7f500c000640 1 --2- 172.21.15.122:0/1087257285 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4fe4068bf0 0x7f4fe406b0b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80ae000 tx=0x7f4ff80a7070 comp rx=0 tx=0).stop 2024-05-28T06:12:25.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.710+0000 7f500c000640 1 -- 172.21.15.122:0/1087257285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5004159280 msgr2=0x7f50040cbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:25.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.710+0000 7f500c000640 1 --2- 172.21.15.122:0/1087257285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5004159280 0x7f50040cbcc0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00c7f0 tx=0x7f4ffc00ccb0 comp rx=0 tx=0).stop 2024-05-28T06:12:25.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.710+0000 7f500c000640 1 -- 172.21.15.122:0/1087257285 shutdown_connections 2024-05-28T06:12:25.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.710+0000 7f500c000640 1 --2- 172.21.15.122:0/1087257285 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4fe4068bf0 0x7f4fe406b0b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:25.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.710+0000 7f500c000640 1 --2- 172.21.15.122:0/1087257285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5004159280 0x7f50040cbcc0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:25.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.710+0000 7f500c000640 1 --2- 172.21.15.122:0/1087257285 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f50040b0d90 0x7f50040cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:25.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.710+0000 7f500c000640 1 --2- 172.21.15.122:0/1087257285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f500406f0c0 0x7f5004142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:25.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.710+0000 7f500c000640 1 -- 172.21.15.122:0/1087257285 >> 172.21.15.122:0/1087257285 conn(0x7f50040b6c10 msgr2=0x7f5004072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:25.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.710+0000 7f500c000640 1 -- 172.21.15.122:0/1087257285 shutdown_connections 2024-05-28T06:12:25.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.710+0000 7f500c000640 1 -- 172.21.15.122:0/1087257285 wait complete. 2024-05-28T06:12:25.731 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-28T06:12:25.731 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-28T06:12:25.731 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-28T06:12:25.732 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:12:25.732 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-28T06:12:25.732 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-28T06:12:25.732 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-28T06:12:25.732 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:12:25.732 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-28T06:12:25.732 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-28T06:12:25.733 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-28T06:12:25.733 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:12:25.733 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-28T06:12:25.733 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-28T06:12:25.733 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-28T06:12:25.733 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:12:25.745 INFO:tasks.ceph.mds.a:Stopped 2024-05-28T06:12:25.745 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-28T06:12:25.746 INFO:tasks.ceph.mds.c:Stopped 2024-05-28T06:12:25.747 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-28T06:12:25.748 INFO:tasks.ceph.mds.b:Stopped 2024-05-28T06:12:25.748 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-28T06:12:25.749 INFO:tasks.ceph.mds.d:Stopped 2024-05-28T06:12:25.749 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-28T06:12:25.790 INFO:tasks.ceph.mds.a:Started 2024-05-28T06:12:25.791 DEBUG:teuthology.parallel:result is None 2024-05-28T06:12:25.793 INFO:tasks.ceph.mds.c:Started 2024-05-28T06:12:25.793 DEBUG:teuthology.parallel:result is None 2024-05-28T06:12:25.796 INFO:tasks.ceph.mds.b:Started 2024-05-28T06:12:25.796 DEBUG:teuthology.parallel:result is None 2024-05-28T06:12:25.798 INFO:tasks.ceph.mds.d:Started 2024-05-28T06:12:25.798 DEBUG:teuthology.parallel:result is None 2024-05-28T06:12:25.798 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-28T06:12:25.876 INFO:tasks.ceph.mds.a.smithi122.stdout:starting mds.a at 2024-05-28T06:12:25.877 INFO:tasks.ceph.mds.c.smithi122.stdout:starting mds.c at 2024-05-28T06:12:25.887 INFO:tasks.ceph.mds.b.smithi153.stdout:starting mds.b at 2024-05-28T06:12:25.888 INFO:tasks.ceph.mds.d.smithi153.stdout:starting mds.d at 2024-05-28T06:12:25.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.942+0000 7f1f6b000640 1 Processor -- start 2024-05-28T06:12:25.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.942+0000 7f1f6b000640 1 -- start start 2024-05-28T06:12:25.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.942+0000 7f1f6b000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f64145b80 0x7f1f64145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:25.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.942+0000 7f1f6b000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1f640ce560 0x7f1f640ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:25.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.942+0000 7f1f6b000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f6406f7e0 con 0x7f1f64142d30 2024-05-28T06:12:25.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.942+0000 7f1f6b000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f1f6406ec40 con 0x7f1f640ce560 2024-05-28T06:12:25.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.942+0000 7f1f6b000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1f6406e030 con 0x7f1f64145b80 2024-05-28T06:12:25.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.942+0000 7f1f69000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1f640ce560 0x7f1f640ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:25.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.942+0000 7f1f63e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f1f64142d30 0x7f1f6406f0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:44838/0 (socket says 172.21.15.122:44838) 2024-05-28T06:12:25.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.942+0000 7f1f63e00640 1 -- 172.21.15.122:0/3130746678 learned_addr learned my addr 172.21.15.122:0/3130746678 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:25.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.942+0000 7f1f63400640 1 --2- 172.21.15.122:0/3130746678 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f64145b80 0x7f1f64145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:25.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.942+0000 7f1f69000640 1 -- 172.21.15.122:0/3130746678 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f64145b80 msgr2=0x7f1f64145fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:25.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.942+0000 7f1f69000640 1 --2- 172.21.15.122:0/3130746678 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f64145b80 0x7f1f64145fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:25.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.942+0000 7f1f69000640 1 -- 172.21.15.122:0/3130746678 >> v1:172.21.15.122:6789/0 conn(0x7f1f64142d30 legacy=0x7f1f6406f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:25.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.942+0000 7f1f69000640 1 -- 172.21.15.122:0/3130746678 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f6406e310 con 0x7f1f640ce560 2024-05-28T06:12:25.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.942+0000 7f1f63400640 1 --2- 172.21.15.122:0/3130746678 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f64145b80 0x7f1f64145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:25.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.946+0000 7f1f69000640 1 --2- 172.21.15.122:0/3130746678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f640ce560 0x7f1f640ce9f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c0097f0 tx=0x7f1f5c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97da705f2ca7c16a server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:25.947 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.946+0000 7f1f62a00640 1 -- 172.21.15.122:0/3130746678 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0b2070 con 0x7f1f640ce560 2024-05-28T06:12:25.947 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.946+0000 7f1f62a00640 1 -- 172.21.15.122:0/3130746678 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f5c0ad640 con 0x7f1f640ce560 2024-05-28T06:12:25.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.946+0000 7f1f62a00640 1 -- 172.21.15.122:0/3130746678 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0ada10 con 0x7f1f640ce560 2024-05-28T06:12:25.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.946+0000 7f1f6b000640 1 -- 172.21.15.122:0/3130746678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f640ce560 msgr2=0x7f1f640ce9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:25.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.946+0000 7f1f6b000640 1 --2- 172.21.15.122:0/3130746678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f640ce560 0x7f1f640ce9f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c0097f0 tx=0x7f1f5c01c4a0 comp rx=0 tx=0).stop 2024-05-28T06:12:25.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.946+0000 7f1f6b000640 1 -- 172.21.15.122:0/3130746678 shutdown_connections 2024-05-28T06:12:25.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.946+0000 7f1f6b000640 1 --2- 172.21.15.122:0/3130746678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f640ce560 0x7f1f640ce9f0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:25.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.946+0000 7f1f6b000640 1 --2- 172.21.15.122:0/3130746678 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f64145b80 0x7f1f64145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:25.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.946+0000 7f1f6b000640 1 -- 172.21.15.122:0/3130746678 >> 172.21.15.122:0/3130746678 conn(0x7f1f64062a40 msgr2=0x7f1f6406b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:25.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.946+0000 7f1f6b000640 1 -- 172.21.15.122:0/3130746678 shutdown_connections 2024-05-28T06:12:25.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.946+0000 7f1f6b000640 1 -- 172.21.15.122:0/3130746678 wait complete. 2024-05-28T06:12:25.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f6b000640 1 Processor -- start 2024-05-28T06:12:25.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f6b000640 1 -- start start 2024-05-28T06:12:25.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f6b000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f640ce560 0x7f1f6413d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:25.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f6b000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f64142d30 0x7f1f64159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:25.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f6b000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f64145b80 0x7f1f6415bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:25.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f6b000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1f64143290 con 0x7f1f640ce560 2024-05-28T06:12:25.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f6b000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1f64143110 con 0x7f1f64142d30 2024-05-28T06:12:25.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f6b000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1f64169830 con 0x7f1f64145b80 2024-05-28T06:12:25.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f63e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f640ce560 0x7f1f6413d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:25.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f63e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f640ce560 0x7f1f6413d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37782/0 (socket says 172.21.15.122:37782) 2024-05-28T06:12:25.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f63e00640 1 -- 172.21.15.122:0/2162816934 learned_addr learned my addr 172.21.15.122:0/2162816934 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:25.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f63400640 1 --2- 172.21.15.122:0/2162816934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f64142d30 0x7f1f64159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:25.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f69000640 1 --2- 172.21.15.122:0/2162816934 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f64145b80 0x7f1f6415bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:25.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f63e00640 1 -- 172.21.15.122:0/2162816934 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f64145b80 msgr2=0x7f1f6415bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:25.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f63e00640 1 --2- 172.21.15.122:0/2162816934 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f64145b80 0x7f1f6415bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:25.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f63e00640 1 -- 172.21.15.122:0/2162816934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f64142d30 msgr2=0x7f1f64159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:25.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f63e00640 1 --2- 172.21.15.122:0/2162816934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f64142d30 0x7f1f64159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:25.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f63e00640 1 -- 172.21.15.122:0/2162816934 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f641fc060 con 0x7f1f640ce560 2024-05-28T06:12:25.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f69000640 1 --2- 172.21.15.122:0/2162816934 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f64145b80 0x7f1f6415bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:25.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f63400640 1 --2- 172.21.15.122:0/2162816934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f64142d30 0x7f1f64159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:25.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f63e00640 1 --2- 172.21.15.122:0/2162816934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f640ce560 0x7f1f6413d1a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400cb10 tx=0x7f1f5400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:25.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f5be00640 1 -- 172.21.15.122:0/2162816934 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f54017070 con 0x7f1f640ce560 2024-05-28T06:12:25.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f5be00640 1 -- 172.21.15.122:0/2162816934 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f5400ac10 con 0x7f1f640ce560 2024-05-28T06:12:25.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f5be00640 1 -- 172.21.15.122:0/2162816934 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f54012620 con 0x7f1f640ce560 2024-05-28T06:12:25.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f6b000640 1 -- 172.21.15.122:0/2162816934 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f640b3d10 con 0x7f1f640ce560 2024-05-28T06:12:25.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.950+0000 7f1f6b000640 1 -- 172.21.15.122:0/2162816934 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f6415c450 con 0x7f1f640ce560 2024-05-28T06:12:25.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.954+0000 7f1f6b000640 1 -- 172.21.15.122:0/2162816934 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f6415a6c0 con 0x7f1f640ce560 2024-05-28T06:12:25.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.954+0000 7f1f5be00640 1 -- 172.21.15.122:0/2162816934 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f1f5401a070 con 0x7f1f640ce560 2024-05-28T06:12:25.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.954+0000 7f1f5be00640 1 --2- 172.21.15.122:0/2162816934 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1f44068bf0 0x7f1f4406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:25.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.954+0000 7f1f5be00640 1 -- 172.21.15.122:0/2162816934 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4971+0+0 (secure 0 0 0) 0x7f1f54087570 con 0x7f1f640ce560 2024-05-28T06:12:25.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.954+0000 7f1f63400640 1 --2- 172.21.15.122:0/2162816934 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1f44068bf0 0x7f1f4406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:25.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.954+0000 7f1f63400640 1 --2- 172.21.15.122:0/2162816934 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1f44068bf0 0x7f1f4406b0b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1f64167360 tx=0x7f1f50008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:25.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:25.958+0000 7f1f5be00640 1 -- 172.21.15.122:0/2162816934 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1f6415a6c0 con 0x7f1f640ce560 2024-05-28T06:12:26.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:26.134+0000 7f1f6b000640 1 -- 172.21.15.122:0/2162816934 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f1f6406be50 con 0x7f1f640ce560 2024-05-28T06:12:27.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.110+0000 7f1f5be00640 1 -- 172.21.15.122:0/2162816934 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v58) ==== 97+0+0 (secure 0 0 0) 0x7f1f54056f80 con 0x7f1f640ce560 2024-05-28T06:12:27.111 INFO:teuthology.orchestra.run.smithi122.stderr: removed all blocklist entries 2024-05-28T06:12:27.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.114+0000 7f1f6b000640 1 -- 172.21.15.122:0/2162816934 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1f44068bf0 msgr2=0x7f1f4406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:27.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.114+0000 7f1f6b000640 1 --2- 172.21.15.122:0/2162816934 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1f44068bf0 0x7f1f4406b0b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1f64167360 tx=0x7f1f50008040 comp rx=0 tx=0).stop 2024-05-28T06:12:27.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.114+0000 7f1f6b000640 1 -- 172.21.15.122:0/2162816934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f640ce560 msgr2=0x7f1f6413d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:27.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.114+0000 7f1f6b000640 1 --2- 172.21.15.122:0/2162816934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f640ce560 0x7f1f6413d1a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400cb10 tx=0x7f1f5400a060 comp rx=0 tx=0).stop 2024-05-28T06:12:27.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.114+0000 7f1f6b000640 1 -- 172.21.15.122:0/2162816934 shutdown_connections 2024-05-28T06:12:27.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.114+0000 7f1f6b000640 1 --2- 172.21.15.122:0/2162816934 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1f44068bf0 0x7f1f4406b0b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.114+0000 7f1f6b000640 1 --2- 172.21.15.122:0/2162816934 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f64145b80 0x7f1f6415bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.114+0000 7f1f6b000640 1 --2- 172.21.15.122:0/2162816934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f64142d30 0x7f1f64159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.114+0000 7f1f6b000640 1 --2- 172.21.15.122:0/2162816934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f640ce560 0x7f1f6413d1a0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.114+0000 7f1f6b000640 1 -- 172.21.15.122:0/2162816934 >> 172.21.15.122:0/2162816934 conn(0x7f1f64062a40 msgr2=0x7f1f6406f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:27.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.114+0000 7f1f6b000640 1 -- 172.21.15.122:0/2162816934 shutdown_connections 2024-05-28T06:12:27.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.114+0000 7f1f6b000640 1 -- 172.21.15.122:0/2162816934 wait complete. 2024-05-28T06:12:27.138 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-28T06:12:27.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.278+0000 7f66d0600640 1 Processor -- start 2024-05-28T06:12:27.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.278+0000 7f66d0600640 1 -- start start 2024-05-28T06:12:27.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.278+0000 7f66d0600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f66c815ea20 0x7f66c80d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:27.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.278+0000 7f66d0600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f66c8073c80 0x7f66c80b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:27.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.278+0000 7f66d0600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66c80b46c0 con 0x7f66c80b5500 2024-05-28T06:12:27.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.278+0000 7f66d0600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f66c815ee00 con 0x7f66c8073c80 2024-05-28T06:12:27.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.278+0000 7f66d0600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f66c80b49a0 con 0x7f66c815ea20 2024-05-28T06:12:27.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.282+0000 7f66cd200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f66c8073c80 0x7f66c80b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:27.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.282+0000 7f66cd200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f66c8073c80 0x7f66c80b4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37796/0 (socket says 172.21.15.122:37796) 2024-05-28T06:12:27.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.282+0000 7f66cd200640 1 -- 172.21.15.122:0/3509499350 learned_addr learned my addr 172.21.15.122:0/3509499350 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:27.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.282+0000 7f66cdc00640 1 --2- 172.21.15.122:0/3509499350 >> v2:172.21.15.153:3300/0 conn(0x7f66c815ea20 0x7f66c80d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:27.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.282+0000 7f66cd200640 1 -- 172.21.15.122:0/3509499350 >> v2:172.21.15.153:3300/0 conn(0x7f66c815ea20 msgr2=0x7f66c80d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:27.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.282+0000 7f66cd200640 1 --2- 172.21.15.122:0/3509499350 >> v2:172.21.15.153:3300/0 conn(0x7f66c815ea20 0x7f66c80d0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.282+0000 7f66cd200640 1 -- 172.21.15.122:0/3509499350 >> v1:172.21.15.153:6789/0 conn(0x7f66c80b5500 legacy=0x7f66c80b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:27.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.282+0000 7f66cd200640 1 -- 172.21.15.122:0/3509499350 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c80d1e50 con 0x7f66c8073c80 2024-05-28T06:12:27.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.282+0000 7f66cd200640 1 --2- 172.21.15.122:0/3509499350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66c8073c80 0x7f66c80b4fc0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f66c806f360 tx=0x7f66b401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1c24a6a6e582c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:27.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.282+0000 7f66c7e00640 1 -- 172.21.15.122:0/3509499350 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b40ab5f0 con 0x7f66c8073c80 2024-05-28T06:12:27.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.282+0000 7f66c7e00640 1 -- 172.21.15.122:0/3509499350 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66b40b0070 con 0x7f66c8073c80 2024-05-28T06:12:27.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.282+0000 7f66c7e00640 1 -- 172.21.15.122:0/3509499350 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b40ab9b0 con 0x7f66c8073c80 2024-05-28T06:12:27.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66d0600640 1 -- 172.21.15.122:0/3509499350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66c8073c80 msgr2=0x7f66c80b4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:27.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66d0600640 1 --2- 172.21.15.122:0/3509499350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66c8073c80 0x7f66c80b4fc0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f66c806f360 tx=0x7f66b401c4e0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66d0600640 1 -- 172.21.15.122:0/3509499350 shutdown_connections 2024-05-28T06:12:27.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66d0600640 1 --2- 172.21.15.122:0/3509499350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66c8073c80 0x7f66c80b4fc0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66d0600640 1 --2- 172.21.15.122:0/3509499350 >> v2:172.21.15.153:3300/0 conn(0x7f66c815ea20 0x7f66c80d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66d0600640 1 -- 172.21.15.122:0/3509499350 >> 172.21.15.122:0/3509499350 conn(0x7f66c80b6c10 msgr2=0x7f66c80b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:27.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66d0600640 1 -- 172.21.15.122:0/3509499350 shutdown_connections 2024-05-28T06:12:27.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66d0600640 1 -- 172.21.15.122:0/3509499350 wait complete. 2024-05-28T06:12:27.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66d0600640 1 Processor -- start 2024-05-28T06:12:27.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66d0600640 1 -- start start 2024-05-28T06:12:27.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66d0600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66c8073c80 0x7f66c814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:27.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66d0600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c80b5500 0x7f66c814e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:27.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66d0600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66c815ea20 0x7f66c814ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:27.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66d0600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f66c80ce960 con 0x7f66c8073c80 2024-05-28T06:12:27.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66d0600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f66c80b3fd0 con 0x7f66c815ea20 2024-05-28T06:12:27.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66d0600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f66c80ceae0 con 0x7f66c80b5500 2024-05-28T06:12:27.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66cdc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66c8073c80 0x7f66c814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:27.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66cdc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66c8073c80 0x7f66c814e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37800/0 (socket says 172.21.15.122:37800) 2024-05-28T06:12:27.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66cdc00640 1 -- 172.21.15.122:0/3643047547 learned_addr learned my addr 172.21.15.122:0/3643047547 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:27.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66cd200640 1 --2- 172.21.15.122:0/3643047547 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c80b5500 0x7f66c814e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:27.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66ce600640 1 --2- 172.21.15.122:0/3643047547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66c815ea20 0x7f66c814ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:27.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66cdc00640 1 -- 172.21.15.122:0/3643047547 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c80b5500 msgr2=0x7f66c814e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:27.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66cdc00640 1 --2- 172.21.15.122:0/3643047547 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c80b5500 0x7f66c814e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66cdc00640 1 -- 172.21.15.122:0/3643047547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66c815ea20 msgr2=0x7f66c814ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:27.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66cdc00640 1 --2- 172.21.15.122:0/3643047547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66c815ea20 0x7f66c814ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66cdc00640 1 -- 172.21.15.122:0/3643047547 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c80ca940 con 0x7f66c8073c80 2024-05-28T06:12:27.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66cd200640 1 --2- 172.21.15.122:0/3643047547 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c80b5500 0x7f66c814e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:27.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.286+0000 7f66ce600640 1 --2- 172.21.15.122:0/3643047547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66c815ea20 0x7f66c814ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:27.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.290+0000 7f66cdc00640 1 --2- 172.21.15.122:0/3643047547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66c8073c80 0x7f66c814e4b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f66bc00d800 tx=0x7f66bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:27.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.290+0000 7f66c5600640 1 -- 172.21.15.122:0/3643047547 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66bc00b6c0 con 0x7f66c8073c80 2024-05-28T06:12:27.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.290+0000 7f66c5600640 1 -- 172.21.15.122:0/3643047547 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66bc019070 con 0x7f66c8073c80 2024-05-28T06:12:27.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.290+0000 7f66c5600640 1 -- 172.21.15.122:0/3643047547 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66bc00ba60 con 0x7f66c8073c80 2024-05-28T06:12:27.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.290+0000 7f66d0600640 1 -- 172.21.15.122:0/3643047547 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c80cac40 con 0x7f66c8073c80 2024-05-28T06:12:27.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.290+0000 7f66d0600640 1 -- 172.21.15.122:0/3643047547 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c81504f0 con 0x7f66c8073c80 2024-05-28T06:12:27.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.290+0000 7f66d0600640 1 -- 172.21.15.122:0/3643047547 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66c8068c40 con 0x7f66c8073c80 2024-05-28T06:12:27.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.290+0000 7f66c5600640 1 -- 172.21.15.122:0/3643047547 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f66bc00bc00 con 0x7f66c8073c80 2024-05-28T06:12:27.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.290+0000 7f66c5600640 1 --2- 172.21.15.122:0/3643047547 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f66a8068bf0 0x7f66a806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:27.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.290+0000 7f66c5600640 1 -- 172.21.15.122:0/3643047547 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4885+0+0 (secure 0 0 0) 0x7f66bc087d20 con 0x7f66c8073c80 2024-05-28T06:12:27.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.290+0000 7f66cd200640 1 --2- 172.21.15.122:0/3643047547 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f66a8068bf0 0x7f66a806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:27.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.294+0000 7f66cd200640 1 --2- 172.21.15.122:0/3643047547 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f66a8068bf0 0x7f66a806b0b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f66b40af000 tx=0x7f66b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:27.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.294+0000 7f66c5600640 1 -- 172.21.15.122:0/3643047547 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f66c80cac40 con 0x7f66c8073c80 2024-05-28T06:12:27.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.506+0000 7f66d0600640 1 -- 172.21.15.122:0/3643047547 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f66c815b600 con 0x7f66c8073c80 2024-05-28T06:12:27.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.510+0000 7f66c5600640 1 -- 172.21.15.122:0/3643047547 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7f66bc0576f0 con 0x7f66c8073c80 2024-05-28T06:12:27.508 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:27.508 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:12:27.508 INFO:teuthology.orchestra.run.smithi122.stdout: "auth_dump": [ 2024-05-28T06:12:27.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:27.509 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "mds.a", 2024-05-28T06:12:27.509 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQABdFVm1w+ENBAApIn8Y6gj7tEWLXulaHDeUQ==", 2024-05-28T06:12:27.509 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:12:27.509 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:12:27.509 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow *", 2024-05-28T06:12:27.509 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow *", 2024-05-28T06:12:27.509 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:12:27.509 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:27.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:27.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:27.509 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "mds.b", 2024-05-28T06:12:27.509 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQACdFVmGk7xBBAAMqLBLe5planzHBjA6ArHRw==", 2024-05-28T06:12:27.509 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:12:27.510 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:12:27.510 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow *", 2024-05-28T06:12:27.510 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow *", 2024-05-28T06:12:27.510 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:12:27.510 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:27.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:27.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:27.510 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "mds.c", 2024-05-28T06:12:27.510 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQACdFVmFGgJABAA77ul3s2asGb5MaqgumfSug==", 2024-05-28T06:12:27.510 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:12:27.510 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:12:27.510 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow *", 2024-05-28T06:12:27.510 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow *", 2024-05-28T06:12:27.511 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:12:27.511 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:27.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:27.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:27.511 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "mds.d", 2024-05-28T06:12:27.511 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQACdFVmJ6bgDhAAyvzv5Q6Q10llEPpP2ZrVMw==", 2024-05-28T06:12:27.511 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:12:27.511 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:12:27.511 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow *", 2024-05-28T06:12:27.511 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow *", 2024-05-28T06:12:27.511 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:12:27.511 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:27.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:27.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:27.512 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.0", 2024-05-28T06:12:27.512 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAFdFVmyeJQGBAAvF5HlH71HfNSzHJgrGQSeQ==", 2024-05-28T06:12:27.512 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:12:27.512 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:12:27.512 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:12:27.512 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:12:27.512 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:27.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:27.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:27.512 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.1", 2024-05-28T06:12:27.512 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAIdFVm1gb0IhAAfdRRFfamBuhL6VC4fKnd6A==", 2024-05-28T06:12:27.512 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:12:27.512 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:12:27.512 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:12:27.513 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:12:27.513 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:27.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:27.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:27.513 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.2", 2024-05-28T06:12:27.513 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQALdFVm7g3HLBAA9HywQrCOoZa52bOHJc8Nkw==", 2024-05-28T06:12:27.513 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:12:27.513 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:12:27.513 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:12:27.513 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:12:27.513 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:27.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:27.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:27.513 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.3", 2024-05-28T06:12:27.514 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAOdFVmo7kHOBAATvO+5IkILjPjVVGK09HAQw==", 2024-05-28T06:12:27.514 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:12:27.514 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:12:27.514 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:12:27.514 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:12:27.514 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:27.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:27.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:27.514 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.4", 2024-05-28T06:12:27.514 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAUdFVmlS0xMBAAnznRAYw5OO6Cgn/cfRrcfA==", 2024-05-28T06:12:27.514 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:12:27.514 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:12:27.515 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:12:27.515 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:12:27.515 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:27.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:27.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:27.515 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.5", 2024-05-28T06:12:27.515 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAXdFVmCcjTORAALJZO51S0QxuOlJVBtTl25A==", 2024-05-28T06:12:27.515 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:12:27.515 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:12:27.515 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:12:27.515 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:12:27.515 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:27.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:27.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:27.516 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.6", 2024-05-28T06:12:27.516 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAbdFVmMl0ABxAAPNjpXSKXvza1dAIaFCdesw==", 2024-05-28T06:12:27.516 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:12:27.516 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:12:27.516 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:12:27.516 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:12:27.516 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:27.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:27.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:27.516 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "osd.7", 2024-05-28T06:12:27.516 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQAedFVmA7ufDxAAPQwbA2Cb+c5sHN6cA1cwbQ==", 2024-05-28T06:12:27.516 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:12:27.516 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow profile osd", 2024-05-28T06:12:27.516 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile osd", 2024-05-28T06:12:27.517 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:12:27.517 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:27.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:27.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:27.517 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "client.0", 2024-05-28T06:12:27.517 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQACdFVm0fSmExAAkwJTGq732gbcMsBbs84lWw==", 2024-05-28T06:12:27.517 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:12:27.517 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:12:27.517 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow r", 2024-05-28T06:12:27.517 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-28T06:12:27.517 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:27.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:27.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:27.517 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "client.1", 2024-05-28T06:12:27.517 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQACdFVmrapoHRAAgM01mt0lQsXP/W8G1QETmQ==", 2024-05-28T06:12:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:12:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:12:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow r", 2024-05-28T06:12:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow rw", 2024-05-28T06:12:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow rwx" 2024-05-28T06:12:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "client.2", 2024-05-28T06:12:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQACdFVmekj8GRAA2pS9myP+ygZmUImxnfgjiw==", 2024-05-28T06:12:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:12:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:12:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow r", 2024-05-28T06:12:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow rw", 2024-05-28T06:12:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow rwx" 2024-05-28T06:12:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "client.3", 2024-05-28T06:12:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQACdFVmwRh0IxAACbmN8+zTza+A3aB9xeRRRg==", 2024-05-28T06:12:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:12:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow", 2024-05-28T06:12:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow r", 2024-05-28T06:12:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow rw", 2024-05-28T06:12:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow rwx" 2024-05-28T06:12:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "client.admin", 2024-05-28T06:12:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQABdFVmkLXlFxAAP8CCUVIxQMti8qk4wrU4Hw==", 2024-05-28T06:12:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:12:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow *", 2024-05-28T06:12:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": "allow *", 2024-05-28T06:12:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow *", 2024-05-28T06:12:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:12:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "mgr.x", 2024-05-28T06:12:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQABdFVmyM6lLxAACnc16i7218VDdALiqlbb0A==", 2024-05-28T06:12:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:12:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow *", 2024-05-28T06:12:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile mgr", 2024-05-28T06:12:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:12:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:12:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: "entity": "mgr.y", 2024-05-28T06:12:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "AQABdFVmnI6oKxAARwnXRnNv2SZ59/x+YyuO6g==", 2024-05-28T06:12:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": { 2024-05-28T06:12:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": "allow *", 2024-05-28T06:12:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: "mon": "allow profile mgr", 2024-05-28T06:12:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": "allow *" 2024-05-28T06:12:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-05-28T06:12:27.522 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:12:27.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.510+0000 7f66d0600640 1 -- 172.21.15.122:0/3643047547 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f66a8068bf0 msgr2=0x7f66a806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:27.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.510+0000 7f66d0600640 1 --2- 172.21.15.122:0/3643047547 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f66a8068bf0 0x7f66a806b0b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f66b40af000 tx=0x7f66b4008040 comp rx=0 tx=0).stop 2024-05-28T06:12:27.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.510+0000 7f66d0600640 1 -- 172.21.15.122:0/3643047547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66c8073c80 msgr2=0x7f66c814e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:27.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.510+0000 7f66d0600640 1 --2- 172.21.15.122:0/3643047547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66c8073c80 0x7f66c814e4b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f66bc00d800 tx=0x7f66bc00dcc0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.510+0000 7f66d0600640 1 -- 172.21.15.122:0/3643047547 shutdown_connections 2024-05-28T06:12:27.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.510+0000 7f66d0600640 1 --2- 172.21.15.122:0/3643047547 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f66a8068bf0 0x7f66a806b0b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.510+0000 7f66d0600640 1 --2- 172.21.15.122:0/3643047547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66c815ea20 0x7f66c814ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.510+0000 7f66d0600640 1 --2- 172.21.15.122:0/3643047547 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c80b5500 0x7f66c814e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.510+0000 7f66d0600640 1 --2- 172.21.15.122:0/3643047547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66c8073c80 0x7f66c814e4b0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.510+0000 7f66d0600640 1 -- 172.21.15.122:0/3643047547 >> 172.21.15.122:0/3643047547 conn(0x7f66c80b6c10 msgr2=0x7f66c80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:27.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.510+0000 7f66d0600640 1 -- 172.21.15.122:0/3643047547 shutdown_connections 2024-05-28T06:12:27.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.510+0000 7f66d0600640 1 -- 172.21.15.122:0/3643047547 wait complete. 2024-05-28T06:12:27.530 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:12:27.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.666+0000 7f97ec800640 1 Processor -- start 2024-05-28T06:12:27.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.666+0000 7f97ec800640 1 -- start start 2024-05-28T06:12:27.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.666+0000 7f97ec800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f97e40cff30 0x7f97e406f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:27.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.666+0000 7f97ec800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f97e406f6c0 0x7f97e40cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:27.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.666+0000 7f97ec800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97e40d0310 con 0x7f97e40cd930 2024-05-28T06:12:27.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.666+0000 7f97ec800640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f97e406fb30 con 0x7f97e40cff30 2024-05-28T06:12:27.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.666+0000 7f97ec800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f97e415be20 con 0x7f97e406f6c0 2024-05-28T06:12:27.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.670+0000 7f97e9e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f97e40cff30 0x7f97e406f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:27.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.670+0000 7f97e9e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f97e40cff30 0x7f97e406f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37814/0 (socket says 172.21.15.122:37814) 2024-05-28T06:12:27.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.670+0000 7f97e9e00640 1 -- 172.21.15.122:0/1444379008 learned_addr learned my addr 172.21.15.122:0/1444379008 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:27.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.670+0000 7f97e9400640 1 --2- 172.21.15.122:0/1444379008 >> v2:172.21.15.153:3300/0 conn(0x7f97e406f6c0 0x7f97e40cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:27.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.670+0000 7f97e9e00640 1 -- 172.21.15.122:0/1444379008 >> v2:172.21.15.153:3300/0 conn(0x7f97e406f6c0 msgr2=0x7f97e40cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:27.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.670+0000 7f97e9e00640 1 --2- 172.21.15.122:0/1444379008 >> v2:172.21.15.153:3300/0 conn(0x7f97e406f6c0 0x7f97e40cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.670+0000 7f97e9e00640 1 -- 172.21.15.122:0/1444379008 >> v1:172.21.15.122:6789/0 conn(0x7f97e40cd930 legacy=0x7f97e40722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:27.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.670+0000 7f97e9e00640 1 -- 172.21.15.122:0/1444379008 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e415c100 con 0x7f97e40cff30 2024-05-28T06:12:27.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.670+0000 7f97e9e00640 1 --2- 172.21.15.122:0/1444379008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97e40cff30 0x7f97e406f180 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f97e4073310 tx=0x7f97d801ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d19c9d93bd292a server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:27.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.670+0000 7f97e8a00640 1 -- 172.21.15.122:0/1444379008 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d80b4070 con 0x7f97e40cff30 2024-05-28T06:12:27.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.670+0000 7f97e8a00640 1 -- 172.21.15.122:0/1444379008 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97d80a7c90 con 0x7f97e40cff30 2024-05-28T06:12:27.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.670+0000 7f97e8a00640 1 -- 172.21.15.122:0/1444379008 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d80af660 con 0x7f97e40cff30 2024-05-28T06:12:27.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97ec800640 1 -- 172.21.15.122:0/1444379008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97e40cff30 msgr2=0x7f97e406f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:27.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97ec800640 1 --2- 172.21.15.122:0/1444379008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97e40cff30 0x7f97e406f180 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f97e4073310 tx=0x7f97d801ebc0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97ec800640 1 -- 172.21.15.122:0/1444379008 shutdown_connections 2024-05-28T06:12:27.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97ec800640 1 --2- 172.21.15.122:0/1444379008 >> v2:172.21.15.153:3300/0 conn(0x7f97e406f6c0 0x7f97e40cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97ec800640 1 --2- 172.21.15.122:0/1444379008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97e40cff30 0x7f97e406f180 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97ec800640 1 -- 172.21.15.122:0/1444379008 >> 172.21.15.122:0/1444379008 conn(0x7f97e406bd90 msgr2=0x7f97e406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:27.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97ec800640 1 -- 172.21.15.122:0/1444379008 shutdown_connections 2024-05-28T06:12:27.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97ec800640 1 -- 172.21.15.122:0/1444379008 wait complete. 2024-05-28T06:12:27.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97ec800640 1 Processor -- start 2024-05-28T06:12:27.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97ec800640 1 -- start start 2024-05-28T06:12:27.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97ec800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97e406f6c0 0x7f97e4147560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:27.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97ec800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97e40cd930 0x7f97e4142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:27.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97ec800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97e40cff30 0x7f97e4150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:27.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97ec800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f97e40cde90 con 0x7f97e406f6c0 2024-05-28T06:12:27.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97ec800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f97e40cdd10 con 0x7f97e40cff30 2024-05-28T06:12:27.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97ec800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f97e40b59c0 con 0x7f97e40cd930 2024-05-28T06:12:27.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97e9e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97e406f6c0 0x7f97e4147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:27.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97e9e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97e406f6c0 0x7f97e4147560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37820/0 (socket says 172.21.15.122:37820) 2024-05-28T06:12:27.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97e9e00640 1 -- 172.21.15.122:0/810680762 learned_addr learned my addr 172.21.15.122:0/810680762 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:27.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97ea800640 1 --2- 172.21.15.122:0/810680762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97e40cff30 0x7f97e4150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:27.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97e9400640 1 --2- 172.21.15.122:0/810680762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97e40cd930 0x7f97e4142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:27.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97e9e00640 1 -- 172.21.15.122:0/810680762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97e40cd930 msgr2=0x7f97e4142f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:27.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97e9e00640 1 --2- 172.21.15.122:0/810680762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97e40cd930 0x7f97e4142f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97e9e00640 1 -- 172.21.15.122:0/810680762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97e40cff30 msgr2=0x7f97e4150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:27.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97e9e00640 1 --2- 172.21.15.122:0/810680762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97e40cff30 0x7f97e4150970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97e9e00640 1 -- 172.21.15.122:0/810680762 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e4147b40 con 0x7f97e406f6c0 2024-05-28T06:12:27.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97ea800640 1 --2- 172.21.15.122:0/810680762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97e40cff30 0x7f97e4150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:27.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97e9400640 1 --2- 172.21.15.122:0/810680762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97e40cd930 0x7f97e4142f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:27.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.674+0000 7f97e9e00640 1 --2- 172.21.15.122:0/810680762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97e406f6c0 0x7f97e4147560 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f97d800b2c0 tx=0x7f97d801b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:27.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.678+0000 7f97de000640 1 -- 172.21.15.122:0/810680762 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d80b4030 con 0x7f97e406f6c0 2024-05-28T06:12:27.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.678+0000 7f97de000640 1 -- 172.21.15.122:0/810680762 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97d80b6070 con 0x7f97e406f6c0 2024-05-28T06:12:27.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.678+0000 7f97de000640 1 -- 172.21.15.122:0/810680762 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d80ad550 con 0x7f97e406f6c0 2024-05-28T06:12:27.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.678+0000 7f97ec800640 1 -- 172.21.15.122:0/810680762 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97e4147e20 con 0x7f97e406f6c0 2024-05-28T06:12:27.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.678+0000 7f97ec800640 1 -- 172.21.15.122:0/810680762 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97e4150eb0 con 0x7f97e406f6c0 2024-05-28T06:12:27.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.678+0000 7f97ec800640 1 -- 172.21.15.122:0/810680762 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97e4068c40 con 0x7f97e406f6c0 2024-05-28T06:12:27.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.678+0000 7f97de000640 1 -- 172.21.15.122:0/810680762 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f97d80c1060 con 0x7f97e406f6c0 2024-05-28T06:12:27.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.678+0000 7f97de000640 1 --2- 172.21.15.122:0/810680762 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f97c8068c20 0x7f97c806b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:27.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.678+0000 7f97de000640 1 -- 172.21.15.122:0/810680762 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4885+0+0 (secure 0 0 0) 0x7f97d81218c0 con 0x7f97e406f6c0 2024-05-28T06:12:27.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.678+0000 7f97e9400640 1 --2- 172.21.15.122:0/810680762 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f97c8068c20 0x7f97c806b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:27.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.682+0000 7f97e9400640 1 --2- 172.21.15.122:0/810680762 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f97c8068c20 0x7f97c806b0e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f97e4151590 tx=0x7f97d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:27.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.682+0000 7f97de000640 1 -- 172.21.15.122:0/810680762 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f97d80187e0 con 0x7f97e406f6c0 2024-05-28T06:12:27.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.846+0000 7f97ec800640 1 -- 172.21.15.122:0/810680762 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f97e4155f70 con 0x7f97e406f6c0 2024-05-28T06:12:27.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.846+0000 7f97de000640 1 -- 172.21.15.122:0/810680762 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+12934 (secure 0 0 0) 0x7f97d80c02c0 con 0x7f97e406f6c0 2024-05-28T06:12:27.847 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:27.847 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":58,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:12:27.112071+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:12:27.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.850+0000 7f97ec800640 1 -- 172.21.15.122:0/810680762 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f97c8068c20 msgr2=0x7f97c806b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:27.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.850+0000 7f97ec800640 1 --2- 172.21.15.122:0/810680762 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f97c8068c20 0x7f97c806b0e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f97e4151590 tx=0x7f97d4008040 comp rx=0 tx=0).stop 2024-05-28T06:12:27.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.850+0000 7f97ec800640 1 -- 172.21.15.122:0/810680762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97e406f6c0 msgr2=0x7f97e4147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:27.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.850+0000 7f97ec800640 1 --2- 172.21.15.122:0/810680762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97e406f6c0 0x7f97e4147560 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f97d800b2c0 tx=0x7f97d801b960 comp rx=0 tx=0).stop 2024-05-28T06:12:27.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.850+0000 7f97ec800640 1 -- 172.21.15.122:0/810680762 shutdown_connections 2024-05-28T06:12:27.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.850+0000 7f97ec800640 1 --2- 172.21.15.122:0/810680762 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f97c8068c20 0x7f97c806b0e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.850+0000 7f97ec800640 1 --2- 172.21.15.122:0/810680762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97e40cff30 0x7f97e4150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.850+0000 7f97ec800640 1 --2- 172.21.15.122:0/810680762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97e40cd930 0x7f97e4142f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.850+0000 7f97ec800640 1 --2- 172.21.15.122:0/810680762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97e406f6c0 0x7f97e4147560 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:27.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.850+0000 7f97ec800640 1 -- 172.21.15.122:0/810680762 >> 172.21.15.122:0/810680762 conn(0x7f97e406bd90 msgr2=0x7f97e414e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:27.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.850+0000 7f97ec800640 1 -- 172.21.15.122:0/810680762 shutdown_connections 2024-05-28T06:12:27.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:27.850+0000 7f97ec800640 1 -- 172.21.15.122:0/810680762 wait complete. 2024-05-28T06:12:27.867 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:12:27.867 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:12:28.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.010+0000 7f7b3b400640 1 Processor -- start 2024-05-28T06:12:28.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.010+0000 7f7b3b400640 1 -- start start 2024-05-28T06:12:28.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.014+0000 7f7b3b400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7b340cff30 0x7f7b3406f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:28.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.014+0000 7f7b3b400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b3406f6c0 0x7f7b340cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:28.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.014+0000 7f7b3b400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b340d0310 con 0x7f7b340cd930 2024-05-28T06:12:28.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.014+0000 7f7b3b400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7b3406fb00 con 0x7f7b340cff30 2024-05-28T06:12:28.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.014+0000 7f7b3b400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7b3415be20 con 0x7f7b3406f6c0 2024-05-28T06:12:28.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.014+0000 7f7b33e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b3406f6c0 0x7f7b340cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:28.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.014+0000 7f7b38a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7b340cff30 0x7f7b3406f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:28.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.014+0000 7f7b33e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b3406f6c0 0x7f7b340cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:42976/0 (socket says 172.21.15.122:42976) 2024-05-28T06:12:28.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.014+0000 7f7b33e00640 1 -- 172.21.15.122:0/1404897554 learned_addr learned my addr 172.21.15.122:0/1404897554 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:28.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.014+0000 7f7b38a00640 1 -- 172.21.15.122:0/1404897554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b3406f6c0 msgr2=0x7f7b340cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:28.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.014+0000 7f7b38a00640 1 --2- 172.21.15.122:0/1404897554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b3406f6c0 0x7f7b340cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.014+0000 7f7b38a00640 1 -- 172.21.15.122:0/1404897554 >> v1:172.21.15.153:6789/0 conn(0x7f7b340cd930 legacy=0x7f7b340722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:28.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.014+0000 7f7b38a00640 1 -- 172.21.15.122:0/1404897554 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b3415c100 con 0x7f7b340cff30 2024-05-28T06:12:28.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.018+0000 7f7b38a00640 1 --2- 172.21.15.122:0/1404897554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b340cff30 0x7f7b3406f180 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7b240097c0 tx=0x7f7b2401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3227153c7f637c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:28.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.018+0000 7f7b33400640 1 -- 172.21.15.122:0/1404897554 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b240a7070 con 0x7f7b340cff30 2024-05-28T06:12:28.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.018+0000 7f7b33400640 1 -- 172.21.15.122:0/1404897554 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b240b0070 con 0x7f7b340cff30 2024-05-28T06:12:28.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.018+0000 7f7b33400640 1 -- 172.21.15.122:0/1404897554 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b240ab890 con 0x7f7b340cff30 2024-05-28T06:12:28.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.018+0000 7f7b3b400640 1 -- 172.21.15.122:0/1404897554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b340cff30 msgr2=0x7f7b3406f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:28.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.018+0000 7f7b3b400640 1 --2- 172.21.15.122:0/1404897554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b340cff30 0x7f7b3406f180 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7b240097c0 tx=0x7f7b2401c470 comp rx=0 tx=0).stop 2024-05-28T06:12:28.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.018+0000 7f7b3b400640 1 -- 172.21.15.122:0/1404897554 shutdown_connections 2024-05-28T06:12:28.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.018+0000 7f7b3b400640 1 --2- 172.21.15.122:0/1404897554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b3406f6c0 0x7f7b340cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.018+0000 7f7b3b400640 1 --2- 172.21.15.122:0/1404897554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b340cff30 0x7f7b3406f180 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.018+0000 7f7b3b400640 1 -- 172.21.15.122:0/1404897554 >> 172.21.15.122:0/1404897554 conn(0x7f7b3406bd90 msgr2=0x7f7b3406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:28.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.018+0000 7f7b3b400640 1 -- 172.21.15.122:0/1404897554 shutdown_connections 2024-05-28T06:12:28.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.018+0000 7f7b3b400640 1 -- 172.21.15.122:0/1404897554 wait complete. 2024-05-28T06:12:28.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.018+0000 7f7b3b400640 1 Processor -- start 2024-05-28T06:12:28.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.018+0000 7f7b3b400640 1 -- start start 2024-05-28T06:12:28.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b3b400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b3406f6c0 0x7f7b340af240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:28.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b3b400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b340cd930 0x7f7b3414e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:28.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b3b400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b340cff30 0x7f7b3414e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:28.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b3b400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7b340cdec0 con 0x7f7b340cff30 2024-05-28T06:12:28.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b3b400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7b340cdd40 con 0x7f7b340cd930 2024-05-28T06:12:28.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b3b400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7b340b59c0 con 0x7f7b3406f6c0 2024-05-28T06:12:28.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b39400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b340cff30 0x7f7b3414e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:28.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b39400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b340cff30 0x7f7b3414e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37832/0 (socket says 172.21.15.122:37832) 2024-05-28T06:12:28.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b39400640 1 -- 172.21.15.122:0/875211602 learned_addr learned my addr 172.21.15.122:0/875211602 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:28.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b38a00640 1 --2- 172.21.15.122:0/875211602 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b3406f6c0 0x7f7b340af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:28.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b33e00640 1 --2- 172.21.15.122:0/875211602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b340cd930 0x7f7b3414e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:28.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b39400640 1 -- 172.21.15.122:0/875211602 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b3406f6c0 msgr2=0x7f7b340af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:28.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b39400640 1 --2- 172.21.15.122:0/875211602 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b3406f6c0 0x7f7b340af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b39400640 1 -- 172.21.15.122:0/875211602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b340cd930 msgr2=0x7f7b3414e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:28.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b39400640 1 --2- 172.21.15.122:0/875211602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b340cd930 0x7f7b3414e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b39400640 1 -- 172.21.15.122:0/875211602 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b3414f590 con 0x7f7b340cff30 2024-05-28T06:12:28.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b39400640 1 --2- 172.21.15.122:0/875211602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b340cff30 0x7f7b3414e770 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c00c7d0 tx=0x7f7b2c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:28.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b30c00640 1 -- 172.21.15.122:0/875211602 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c003ba0 con 0x7f7b340cff30 2024-05-28T06:12:28.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b30c00640 1 -- 172.21.15.122:0/875211602 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b2c003d40 con 0x7f7b340cff30 2024-05-28T06:12:28.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b30c00640 1 -- 172.21.15.122:0/875211602 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c00aa30 con 0x7f7b340cff30 2024-05-28T06:12:28.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b3b400640 1 -- 172.21.15.122:0/875211602 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b340ae3e0 con 0x7f7b340cff30 2024-05-28T06:12:28.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b3b400640 1 -- 172.21.15.122:0/875211602 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b340b2130 con 0x7f7b340cff30 2024-05-28T06:12:28.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b3b400640 1 -- 172.21.15.122:0/875211602 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b34068c40 con 0x7f7b340cff30 2024-05-28T06:12:28.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.022+0000 7f7b30c00640 1 -- 172.21.15.122:0/875211602 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f7b2c00abd0 con 0x7f7b340cff30 2024-05-28T06:12:28.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.026+0000 7f7b30c00640 1 --2- 172.21.15.122:0/875211602 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7b14068c20 0x7f7b1406b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:28.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.026+0000 7f7b30c00640 1 -- 172.21.15.122:0/875211602 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4885+0+0 (secure 0 0 0) 0x7f7b2c087600 con 0x7f7b340cff30 2024-05-28T06:12:28.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.026+0000 7f7b38a00640 1 --2- 172.21.15.122:0/875211602 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7b14068c20 0x7f7b1406b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:28.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.026+0000 7f7b38a00640 1 --2- 172.21.15.122:0/875211602 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7b14068c20 0x7f7b1406b0e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7b240af000 tx=0x7f7b240a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:28.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.030+0000 7f7b30c00640 1 -- 172.21.15.122:0/875211602 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7b3414f590 con 0x7f7b340cff30 2024-05-28T06:12:28.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.186+0000 7f7b3b400640 1 -- 172.21.15.122:0/875211602 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7b341590c0 con 0x7f7b340cff30 2024-05-28T06:12:28.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.186+0000 7f7b30c00640 1 -- 172.21.15.122:0/875211602 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) ==== 93+0+10 (secure 0 0 0) 0x7f7b2c056980 con 0x7f7b340cff30 2024-05-28T06:12:28.186 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:12:28.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.190+0000 7f7b3b400640 1 -- 172.21.15.122:0/875211602 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7b14068c20 msgr2=0x7f7b1406b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:28.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.190+0000 7f7b3b400640 1 --2- 172.21.15.122:0/875211602 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7b14068c20 0x7f7b1406b0e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7b240af000 tx=0x7f7b240a7000 comp rx=0 tx=0).stop 2024-05-28T06:12:28.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.190+0000 7f7b3b400640 1 -- 172.21.15.122:0/875211602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b340cff30 msgr2=0x7f7b3414e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:28.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.190+0000 7f7b3b400640 1 --2- 172.21.15.122:0/875211602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b340cff30 0x7f7b3414e770 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c00c7d0 tx=0x7f7b2c00cc90 comp rx=0 tx=0).stop 2024-05-28T06:12:28.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.190+0000 7f7b3b400640 1 -- 172.21.15.122:0/875211602 shutdown_connections 2024-05-28T06:12:28.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.190+0000 7f7b3b400640 1 --2- 172.21.15.122:0/875211602 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7b14068c20 0x7f7b1406b0e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.190+0000 7f7b3b400640 1 --2- 172.21.15.122:0/875211602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b340cff30 0x7f7b3414e770 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.190+0000 7f7b3b400640 1 --2- 172.21.15.122:0/875211602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b340cd930 0x7f7b3414e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.190+0000 7f7b3b400640 1 --2- 172.21.15.122:0/875211602 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b3406f6c0 0x7f7b340af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.190+0000 7f7b3b400640 1 -- 172.21.15.122:0/875211602 >> 172.21.15.122:0/875211602 conn(0x7f7b3406bd90 msgr2=0x7f7b341557c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:28.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.190+0000 7f7b3b400640 1 -- 172.21.15.122:0/875211602 shutdown_connections 2024-05-28T06:12:28.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.190+0000 7f7b3b400640 1 -- 172.21.15.122:0/875211602 wait complete. 2024-05-28T06:12:28.208 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-28T06:12:28.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.346+0000 7f0808e00640 1 Processor -- start 2024-05-28T06:12:28.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.346+0000 7f0808e00640 1 -- start start 2024-05-28T06:12:28.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.350+0000 7f0808e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f08040b58d0 0x7f08040b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:28.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.350+0000 7f0808e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08040ce4f0 0x7f08040ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:28.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.350+0000 7f0808e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08040b61f0 con 0x7f08040722a0 2024-05-28T06:12:28.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.350+0000 7f0808e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f080415d970 con 0x7f08040b58d0 2024-05-28T06:12:28.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.350+0000 7f0808e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f080415dc50 con 0x7f08040ce4f0 2024-05-28T06:12:28.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.350+0000 7f0801e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f08040b58d0 0x7f08040b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:28.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.350+0000 7f0802800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f08040722a0 0x7f0804072730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:44860/0 (socket says 172.21.15.122:44860) 2024-05-28T06:12:28.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.350+0000 7f0802800640 1 -- 172.21.15.122:0/2096115103 learned_addr learned my addr 172.21.15.122:0/2096115103 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:28.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.350+0000 7f07f9400640 1 --2- 172.21.15.122:0/2096115103 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08040ce4f0 0x7f08040ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:28.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.350+0000 7f0801e00640 1 -- 172.21.15.122:0/2096115103 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08040ce4f0 msgr2=0x7f08040ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:28.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.350+0000 7f0801e00640 1 --2- 172.21.15.122:0/2096115103 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08040ce4f0 0x7f08040ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.350+0000 7f0801400640 1 -- 172.21.15.122:0/2096115103 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 674345330 0 0) 0x7f08040b61f0 con 0x7f08040722a0 2024-05-28T06:12:28.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.350+0000 7f0801e00640 1 -- 172.21.15.122:0/2096115103 >> v1:172.21.15.122:6789/0 conn(0x7f08040722a0 legacy=0x7f0804072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:28.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.350+0000 7f0801e00640 1 -- 172.21.15.122:0/2096115103 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f080415df30 con 0x7f08040b58d0 2024-05-28T06:12:28.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.350+0000 7f07f9400640 1 --2- 172.21.15.122:0/2096115103 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08040ce4f0 0x7f08040ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:28.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.354+0000 7f0801e00640 1 --2- 172.21.15.122:0/2096115103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08040b58d0 0x7f08040b5cb0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f07f40097c0 tx=0x7f07f401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe9c41f50f18d23 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:28.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.354+0000 7f0801400640 1 -- 172.21.15.122:0/2096115103 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f40ab610 con 0x7f08040b58d0 2024-05-28T06:12:28.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.354+0000 7f0801400640 1 -- 172.21.15.122:0/2096115103 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f40b0070 con 0x7f08040b58d0 2024-05-28T06:12:28.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.354+0000 7f0801400640 1 -- 172.21.15.122:0/2096115103 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f40ab9d0 con 0x7f08040b58d0 2024-05-28T06:12:28.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.354+0000 7f0808e00640 1 -- 172.21.15.122:0/2096115103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08040b58d0 msgr2=0x7f08040b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:28.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.354+0000 7f0808e00640 1 --2- 172.21.15.122:0/2096115103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08040b58d0 0x7f08040b5cb0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f07f40097c0 tx=0x7f07f401c470 comp rx=0 tx=0).stop 2024-05-28T06:12:28.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.354+0000 7f0808e00640 1 -- 172.21.15.122:0/2096115103 shutdown_connections 2024-05-28T06:12:28.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.354+0000 7f0808e00640 1 --2- 172.21.15.122:0/2096115103 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08040ce4f0 0x7f08040ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.354+0000 7f0808e00640 1 --2- 172.21.15.122:0/2096115103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08040b58d0 0x7f08040b5cb0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.354+0000 7f0808e00640 1 -- 172.21.15.122:0/2096115103 >> 172.21.15.122:0/2096115103 conn(0x7f080406bd90 msgr2=0x7f080406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:28.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.354+0000 7f0808e00640 1 -- 172.21.15.122:0/2096115103 shutdown_connections 2024-05-28T06:12:28.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.354+0000 7f0808e00640 1 -- 172.21.15.122:0/2096115103 wait complete. 2024-05-28T06:12:28.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.354+0000 7f0808e00640 1 Processor -- start 2024-05-28T06:12:28.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.354+0000 7f0808e00640 1 -- start start 2024-05-28T06:12:28.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f0808e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08040722a0 0x7f080415b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:28.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f0808e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08040b58d0 0x7f08041396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:28.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f0808e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08040ce4f0 0x7f080415b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:28.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f0808e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f08040cf010 con 0x7f08040b58d0 2024-05-28T06:12:28.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f0808e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f08040cee90 con 0x7f08040722a0 2024-05-28T06:12:28.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f0808e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0804169a60 con 0x7f08040ce4f0 2024-05-28T06:12:28.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f07f9400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08040b58d0 0x7f08041396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:28.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f07f9400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08040b58d0 0x7f08041396d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37838/0 (socket says 172.21.15.122:37838) 2024-05-28T06:12:28.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f07f9400640 1 -- 172.21.15.122:0/2537715248 learned_addr learned my addr 172.21.15.122:0/2537715248 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:28.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f0801e00640 1 --2- 172.21.15.122:0/2537715248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08040722a0 0x7f080415b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:28.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f0802800640 1 --2- 172.21.15.122:0/2537715248 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08040ce4f0 0x7f080415b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:28.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f07f9400640 1 -- 172.21.15.122:0/2537715248 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08040ce4f0 msgr2=0x7f080415b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:28.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f07f9400640 1 --2- 172.21.15.122:0/2537715248 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08040ce4f0 0x7f080415b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f07f9400640 1 -- 172.21.15.122:0/2537715248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08040722a0 msgr2=0x7f080415b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:28.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f07f9400640 1 --2- 172.21.15.122:0/2537715248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08040722a0 0x7f080415b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f07f9400640 1 -- 172.21.15.122:0/2537715248 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0804072790 con 0x7f08040b58d0 2024-05-28T06:12:28.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f07f9400640 1 --2- 172.21.15.122:0/2537715248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08040b58d0 0x7f08041396d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00c7f0 tx=0x7f07ec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:28.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f07faa00640 1 -- 172.21.15.122:0/2537715248 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec015070 con 0x7f08040b58d0 2024-05-28T06:12:28.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f07faa00640 1 -- 172.21.15.122:0/2537715248 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07ec007820 con 0x7f08040b58d0 2024-05-28T06:12:28.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f07faa00640 1 -- 172.21.15.122:0/2537715248 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec007c10 con 0x7f08040b58d0 2024-05-28T06:12:28.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f0808e00640 1 -- 172.21.15.122:0/2537715248 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f080415b760 con 0x7f08040b58d0 2024-05-28T06:12:28.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f0808e00640 1 -- 172.21.15.122:0/2537715248 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f080413a090 con 0x7f08040b58d0 2024-05-28T06:12:28.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f0808e00640 1 -- 172.21.15.122:0/2537715248 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0804068c40 con 0x7f08040b58d0 2024-05-28T06:12:28.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.358+0000 7f07faa00640 1 -- 172.21.15.122:0/2537715248 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f07ec018070 con 0x7f08040b58d0 2024-05-28T06:12:28.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.362+0000 7f07faa00640 1 --2- 172.21.15.122:0/2537715248 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f07e0068c20 0x7f07e006b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:28.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.362+0000 7f07faa00640 1 -- 172.21.15.122:0/2537715248 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4885+0+0 (secure 0 0 0) 0x7f07ec0879d0 con 0x7f08040b58d0 2024-05-28T06:12:28.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.362+0000 7f0801e00640 1 --2- 172.21.15.122:0/2537715248 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f07e0068c20 0x7f07e006b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:28.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.362+0000 7f0801e00640 1 --2- 172.21.15.122:0/2537715248 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f07e0068c20 0x7f07e006b0e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f07f40af000 tx=0x7f07f40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:28.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.366+0000 7f07faa00640 1 -- 172.21.15.122:0/2537715248 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f07ec056c40 con 0x7f08040b58d0 2024-05-28T06:12:28.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.522+0000 7f0808e00640 1 -- 172.21.15.122:0/2537715248 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f0804072a00 con 0x7f08040b58d0 2024-05-28T06:12:28.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.526+0000 7f07faa00640 1 -- 172.21.15.122:0/2537715248 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v58) ==== 84+0+65 (secure 0 0 0) 0x7f07ec05af40 con 0x7f08040b58d0 2024-05-28T06:12:28.524 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:28.524 INFO:teuthology.orchestra.run.smithi122.stdout:[ 2024-05-28T06:12:28.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:28.524 INFO:teuthology.orchestra.run.smithi122.stdout: "poolnum": 1, 2024-05-28T06:12:28.524 INFO:teuthology.orchestra.run.smithi122.stdout: "poolname": ".mgr" 2024-05-28T06:12:28.524 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:28.524 INFO:teuthology.orchestra.run.smithi122.stdout:] 2024-05-28T06:12:28.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.526+0000 7f0808e00640 1 -- 172.21.15.122:0/2537715248 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f07e0068c20 msgr2=0x7f07e006b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:28.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.526+0000 7f0808e00640 1 --2- 172.21.15.122:0/2537715248 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f07e0068c20 0x7f07e006b0e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f07f40af000 tx=0x7f07f40a7000 comp rx=0 tx=0).stop 2024-05-28T06:12:28.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.526+0000 7f0808e00640 1 -- 172.21.15.122:0/2537715248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08040b58d0 msgr2=0x7f08041396d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:28.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.526+0000 7f0808e00640 1 --2- 172.21.15.122:0/2537715248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08040b58d0 0x7f08041396d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00c7f0 tx=0x7f07ec00ccb0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.526+0000 7f0808e00640 1 -- 172.21.15.122:0/2537715248 shutdown_connections 2024-05-28T06:12:28.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.526+0000 7f0808e00640 1 --2- 172.21.15.122:0/2537715248 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f07e0068c20 0x7f07e006b0e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.526+0000 7f0808e00640 1 --2- 172.21.15.122:0/2537715248 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08040ce4f0 0x7f080415b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.526+0000 7f0808e00640 1 --2- 172.21.15.122:0/2537715248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08040b58d0 0x7f08041396d0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.526+0000 7f0808e00640 1 --2- 172.21.15.122:0/2537715248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08040722a0 0x7f080415b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.526+0000 7f0808e00640 1 -- 172.21.15.122:0/2537715248 >> 172.21.15.122:0/2537715248 conn(0x7f080406bd90 msgr2=0x7f0804143060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:28.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.526+0000 7f0808e00640 1 -- 172.21.15.122:0/2537715248 shutdown_connections 2024-05-28T06:12:28.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.526+0000 7f0808e00640 1 -- 172.21.15.122:0/2537715248 wait complete. 2024-05-28T06:12:28.545 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-28T06:12:28.545 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-28T06:12:28.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.686+0000 7fe57e600640 1 Processor -- start 2024-05-28T06:12:28.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.686+0000 7fe57e600640 1 -- start start 2024-05-28T06:12:28.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.686+0000 7fe57e600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe5780ce4f0 0x7fe5780ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:28.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.686+0000 7fe57e600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe57815e730 0x7fe57815eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:28.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.686+0000 7fe57e600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe57815d970 con 0x7fe5780b58d0 2024-05-28T06:12:28.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.686+0000 7fe57e600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fe57815dc50 con 0x7fe5780ce4f0 2024-05-28T06:12:28.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.686+0000 7fe57e600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe57815df30 con 0x7fe57815e730 2024-05-28T06:12:28.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.686+0000 7fe56ea00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe5780ce4f0 0x7fe5780ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:28.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.686+0000 7fe577400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fe5780b58d0 0x7fe5780b5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:44874/0 (socket says 172.21.15.122:44874) 2024-05-28T06:12:28.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.686+0000 7fe577400640 1 -- 172.21.15.122:0/1480451925 learned_addr learned my addr 172.21.15.122:0/1480451925 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:28.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.686+0000 7fe577e00640 1 --2- 172.21.15.122:0/1480451925 >> v2:172.21.15.153:3300/0 conn(0x7fe57815e730 0x7fe57815eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:28.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.690+0000 7fe56ea00640 1 -- 172.21.15.122:0/1480451925 >> v2:172.21.15.153:3300/0 conn(0x7fe57815e730 msgr2=0x7fe57815eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:28.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.690+0000 7fe56ea00640 1 --2- 172.21.15.122:0/1480451925 >> v2:172.21.15.153:3300/0 conn(0x7fe57815e730 0x7fe57815eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.690+0000 7fe56ea00640 1 -- 172.21.15.122:0/1480451925 >> v1:172.21.15.122:6789/0 conn(0x7fe5780b58d0 legacy=0x7fe5780b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:28.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.690+0000 7fe56ea00640 1 -- 172.21.15.122:0/1480451925 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe57815e210 con 0x7fe5780ce4f0 2024-05-28T06:12:28.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.690+0000 7fe56ea00640 1 --2- 172.21.15.122:0/1480451925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5780ce4f0 0x7fe5780ce980 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe578071cf0 tx=0x7fe56001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3522d7d8b0872988 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:28.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.690+0000 7fe576a00640 1 -- 172.21.15.122:0/1480451925 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5600b0070 con 0x7fe5780ce4f0 2024-05-28T06:12:28.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.690+0000 7fe576a00640 1 -- 172.21.15.122:0/1480451925 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5600ab600 con 0x7fe5780ce4f0 2024-05-28T06:12:28.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.690+0000 7fe576a00640 1 -- 172.21.15.122:0/1480451925 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5600ab9d0 con 0x7fe5780ce4f0 2024-05-28T06:12:28.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.690+0000 7fe57e600640 1 -- 172.21.15.122:0/1480451925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5780ce4f0 msgr2=0x7fe5780ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:28.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.690+0000 7fe57e600640 1 --2- 172.21.15.122:0/1480451925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5780ce4f0 0x7fe5780ce980 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe578071cf0 tx=0x7fe56001c480 comp rx=0 tx=0).stop 2024-05-28T06:12:28.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.690+0000 7fe57e600640 1 -- 172.21.15.122:0/1480451925 shutdown_connections 2024-05-28T06:12:28.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.690+0000 7fe57e600640 1 --2- 172.21.15.122:0/1480451925 >> v2:172.21.15.153:3300/0 conn(0x7fe57815e730 0x7fe57815eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.690+0000 7fe57e600640 1 --2- 172.21.15.122:0/1480451925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5780ce4f0 0x7fe5780ce980 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.690+0000 7fe57e600640 1 -- 172.21.15.122:0/1480451925 >> 172.21.15.122:0/1480451925 conn(0x7fe57806bd90 msgr2=0x7fe57806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:28.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.690+0000 7fe57e600640 1 -- 172.21.15.122:0/1480451925 shutdown_connections 2024-05-28T06:12:28.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.690+0000 7fe57e600640 1 -- 172.21.15.122:0/1480451925 wait complete. 2024-05-28T06:12:28.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.694+0000 7fe57e600640 1 Processor -- start 2024-05-28T06:12:28.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.694+0000 7fe57e600640 1 -- start start 2024-05-28T06:12:28.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.694+0000 7fe57e600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5780b58d0 0x7fe578144870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:28.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.694+0000 7fe57e600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5780ce4f0 0x7fe578144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:28.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.694+0000 7fe57e600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe57815e730 0x7fe578155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:28.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.694+0000 7fe57e600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe5781693d0 con 0x7fe5780b58d0 2024-05-28T06:12:28.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.694+0000 7fe57e600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe578169250 con 0x7fe5780ce4f0 2024-05-28T06:12:28.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.694+0000 7fe57e600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe578169550 con 0x7fe57815e730 2024-05-28T06:12:28.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.694+0000 7fe577400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5780b58d0 0x7fe578144870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:28.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.694+0000 7fe577400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5780b58d0 0x7fe578144870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37858/0 (socket says 172.21.15.122:37858) 2024-05-28T06:12:28.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.694+0000 7fe577400640 1 -- 172.21.15.122:0/2160058364 learned_addr learned my addr 172.21.15.122:0/2160058364 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:28.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.694+0000 7fe56ea00640 1 --2- 172.21.15.122:0/2160058364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5780ce4f0 0x7fe578144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:28.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.694+0000 7fe577e00640 1 --2- 172.21.15.122:0/2160058364 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe57815e730 0x7fe578155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:28.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.694+0000 7fe577400640 1 -- 172.21.15.122:0/2160058364 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe57815e730 msgr2=0x7fe578155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:28.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.694+0000 7fe577400640 1 --2- 172.21.15.122:0/2160058364 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe57815e730 0x7fe578155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.694+0000 7fe577400640 1 -- 172.21.15.122:0/2160058364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5780ce4f0 msgr2=0x7fe578144db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:28.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.694+0000 7fe577400640 1 --2- 172.21.15.122:0/2160058364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5780ce4f0 0x7fe578144db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:28.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.694+0000 7fe577400640 1 -- 172.21.15.122:0/2160058364 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5781569e0 con 0x7fe5780b58d0 2024-05-28T06:12:28.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.694+0000 7fe577400640 1 --2- 172.21.15.122:0/2160058364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5780b58d0 0x7fe578144870 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe56800c450 tx=0x7fe56800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:28.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.694+0000 7fe56fe00640 1 -- 172.21.15.122:0/2160058364 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe568017070 con 0x7fe5780b58d0 2024-05-28T06:12:28.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.694+0000 7fe56fe00640 1 -- 172.21.15.122:0/2160058364 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe568005cf0 con 0x7fe5780b58d0 2024-05-28T06:12:28.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.694+0000 7fe56fe00640 1 -- 172.21.15.122:0/2160058364 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe568007290 con 0x7fe5780b58d0 2024-05-28T06:12:28.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.694+0000 7fe57e600640 1 -- 172.21.15.122:0/2160058364 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5781549d0 con 0x7fe5780b58d0 2024-05-28T06:12:28.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.698+0000 7fe57e600640 1 -- 172.21.15.122:0/2160058364 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe578154f90 con 0x7fe5780b58d0 2024-05-28T06:12:28.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.698+0000 7fe57e600640 1 -- 172.21.15.122:0/2160058364 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe578068c40 con 0x7fe5780b58d0 2024-05-28T06:12:28.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.698+0000 7fe56fe00640 1 -- 172.21.15.122:0/2160058364 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fe56801a070 con 0x7fe5780b58d0 2024-05-28T06:12:28.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.698+0000 7fe56fe00640 1 --2- 172.21.15.122:0/2160058364 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe554068bf0 0x7fe55406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:28.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.698+0000 7fe56fe00640 1 -- 172.21.15.122:0/2160058364 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4885+0+0 (secure 0 0 0) 0x7fe568086ab0 con 0x7fe5780b58d0 2024-05-28T06:12:28.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.698+0000 7fe56ea00640 1 --2- 172.21.15.122:0/2160058364 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe554068bf0 0x7fe55406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:28.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.698+0000 7fe56ea00640 1 --2- 172.21.15.122:0/2160058364 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe554068bf0 0x7fe55406b0b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe5600ad000 tx=0x7fe560008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:28.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.702+0000 7fe56fe00640 1 -- 172.21.15.122:0/2160058364 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe568055e30 con 0x7fe5780b58d0 2024-05-28T06:12:28.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:28.862+0000 7fe57e600640 1 -- 172.21.15.122:0/2160058364 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe57806c3c0 con 0x7fe5780b58d0 2024-05-28T06:12:29.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.762+0000 7fe56fe00640 1 -- 172.21.15.122:0/2160058364 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v59) ==== 138+0+0 (secure 0 0 0) 0x7fe56805a130 con 0x7fe5780b58d0 2024-05-28T06:12:29.760 INFO:teuthology.orchestra.run.smithi122.stderr:pool 'cephfs_metadata' created 2024-05-28T06:12:29.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.762+0000 7fe57e600640 1 -- 172.21.15.122:0/2160058364 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe554068bf0 msgr2=0x7fe55406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:29.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.762+0000 7fe57e600640 1 --2- 172.21.15.122:0/2160058364 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe554068bf0 0x7fe55406b0b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe5600ad000 tx=0x7fe560008040 comp rx=0 tx=0).stop 2024-05-28T06:12:29.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.762+0000 7fe57e600640 1 -- 172.21.15.122:0/2160058364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5780b58d0 msgr2=0x7fe578144870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:29.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.762+0000 7fe57e600640 1 --2- 172.21.15.122:0/2160058364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5780b58d0 0x7fe578144870 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe56800c450 tx=0x7fe56800c910 comp rx=0 tx=0).stop 2024-05-28T06:12:29.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.766+0000 7fe57e600640 1 -- 172.21.15.122:0/2160058364 shutdown_connections 2024-05-28T06:12:29.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.766+0000 7fe57e600640 1 --2- 172.21.15.122:0/2160058364 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe554068bf0 0x7fe55406b0b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:29.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.766+0000 7fe57e600640 1 --2- 172.21.15.122:0/2160058364 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe57815e730 0x7fe578155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:29.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.766+0000 7fe57e600640 1 --2- 172.21.15.122:0/2160058364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5780ce4f0 0x7fe578144db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:29.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.766+0000 7fe57e600640 1 --2- 172.21.15.122:0/2160058364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5780b58d0 0x7fe578144870 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:29.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.766+0000 7fe57e600640 1 -- 172.21.15.122:0/2160058364 >> 172.21.15.122:0/2160058364 conn(0x7fe57806bd90 msgr2=0x7fe578143f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:29.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.766+0000 7fe57e600640 1 -- 172.21.15.122:0/2160058364 shutdown_connections 2024-05-28T06:12:29.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.766+0000 7fe57e600640 1 -- 172.21.15.122:0/2160058364 wait complete. 2024-05-28T06:12:29.791 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-28T06:12:29.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.938+0000 7f6e89000640 1 Processor -- start 2024-05-28T06:12:29.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.938+0000 7f6e89000640 1 -- start start 2024-05-28T06:12:29.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.942+0000 7f6e89000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6e8406f890 0x7f6e840cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:29.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.942+0000 7f6e89000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6e840cd930 0x7f6e840b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:29.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.942+0000 7f6e89000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e840d0310 con 0x7f6e840cff30 2024-05-28T06:12:29.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.942+0000 7f6e89000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f6e8415be20 con 0x7f6e840cd930 2024-05-28T06:12:29.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.942+0000 7f6e89000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6e8415c100 con 0x7f6e8406f890 2024-05-28T06:12:29.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.942+0000 7f6e82800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6e840cd930 0x7f6e840b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:29.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.942+0000 7f6e82800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6e840cd930 0x7f6e840b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37874/0 (socket says 172.21.15.122:37874) 2024-05-28T06:12:29.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.942+0000 7f6e82800640 1 -- 172.21.15.122:0/3174682 learned_addr learned my addr 172.21.15.122:0/3174682 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:29.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.942+0000 7f6e79400640 1 --2- 172.21.15.122:0/3174682 >> v2:172.21.15.153:3300/0 conn(0x7f6e8406f890 0x7f6e840cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:29.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.942+0000 7f6e82800640 1 -- 172.21.15.122:0/3174682 >> v2:172.21.15.153:3300/0 conn(0x7f6e8406f890 msgr2=0x7f6e840cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:29.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.942+0000 7f6e82800640 1 --2- 172.21.15.122:0/3174682 >> v2:172.21.15.153:3300/0 conn(0x7f6e8406f890 0x7f6e840cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:29.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.942+0000 7f6e82800640 1 -- 172.21.15.122:0/3174682 >> v1:172.21.15.153:6789/0 conn(0x7f6e840cff30 legacy=0x7f6e8406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:29.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.942+0000 7f6e82800640 1 -- 172.21.15.122:0/3174682 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e8415c3e0 con 0x7f6e840cd930 2024-05-28T06:12:29.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.946+0000 7f6e82800640 1 --2- 172.21.15.122:0/3174682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e840cd930 0x7f6e840b49b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f6e84073340 tx=0x7f6e7c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbd8bb02d4a5d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:29.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.946+0000 7f6e81400640 1 -- 172.21.15.122:0/3174682 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0a57e0 con 0x7f6e840cd930 2024-05-28T06:12:29.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.946+0000 7f6e81400640 1 -- 172.21.15.122:0/3174682 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e7c0a5980 con 0x7f6e840cd930 2024-05-28T06:12:29.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.946+0000 7f6e81400640 1 -- 172.21.15.122:0/3174682 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0a5d50 con 0x7f6e840cd930 2024-05-28T06:12:29.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.946+0000 7f6e89000640 1 -- 172.21.15.122:0/3174682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e840cd930 msgr2=0x7f6e840b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:29.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.946+0000 7f6e89000640 1 --2- 172.21.15.122:0/3174682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e840cd930 0x7f6e840b49b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f6e84073340 tx=0x7f6e7c01c980 comp rx=0 tx=0).stop 2024-05-28T06:12:29.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.946+0000 7f6e89000640 1 -- 172.21.15.122:0/3174682 shutdown_connections 2024-05-28T06:12:29.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.946+0000 7f6e89000640 1 --2- 172.21.15.122:0/3174682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e840cd930 0x7f6e840b49b0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:29.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.946+0000 7f6e89000640 1 --2- 172.21.15.122:0/3174682 >> v2:172.21.15.153:3300/0 conn(0x7f6e8406f890 0x7f6e840cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:29.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.946+0000 7f6e89000640 1 -- 172.21.15.122:0/3174682 >> 172.21.15.122:0/3174682 conn(0x7f6e8406bd90 msgr2=0x7f6e8406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:29.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.946+0000 7f6e89000640 1 -- 172.21.15.122:0/3174682 shutdown_connections 2024-05-28T06:12:29.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.946+0000 7f6e89000640 1 -- 172.21.15.122:0/3174682 wait complete. 2024-05-28T06:12:29.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.946+0000 7f6e89000640 1 Processor -- start 2024-05-28T06:12:29.947 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.946+0000 7f6e89000640 1 -- start start 2024-05-28T06:12:29.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.946+0000 7f6e89000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e8406f890 0x7f6e841519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:29.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.950+0000 7f6e89000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e840cd930 0x7f6e840ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:29.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.950+0000 7f6e89000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e840cff30 0x7f6e840addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:29.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.950+0000 7f6e89000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6e840b5880 con 0x7f6e8406f890 2024-05-28T06:12:29.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.950+0000 7f6e89000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6e840b5700 con 0x7f6e840cd930 2024-05-28T06:12:29.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.950+0000 7f6e89000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6e840b5a00 con 0x7f6e840cff30 2024-05-28T06:12:29.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.950+0000 7f6e81e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e8406f890 0x7f6e841519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:29.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.950+0000 7f6e81e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e8406f890 0x7f6e841519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37888/0 (socket says 172.21.15.122:37888) 2024-05-28T06:12:29.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.950+0000 7f6e81e00640 1 -- 172.21.15.122:0/3787939978 learned_addr learned my addr 172.21.15.122:0/3787939978 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:29.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.950+0000 7f6e82800640 1 --2- 172.21.15.122:0/3787939978 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e840cff30 0x7f6e840addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:29.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.950+0000 7f6e79400640 1 --2- 172.21.15.122:0/3787939978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e840cd930 0x7f6e840ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:29.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.950+0000 7f6e81e00640 1 -- 172.21.15.122:0/3787939978 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e840cff30 msgr2=0x7f6e840addf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:29.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.950+0000 7f6e81e00640 1 --2- 172.21.15.122:0/3787939978 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e840cff30 0x7f6e840addf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:29.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.950+0000 7f6e81e00640 1 -- 172.21.15.122:0/3787939978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e840cd930 msgr2=0x7f6e840ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:29.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.950+0000 7f6e81e00640 1 --2- 172.21.15.122:0/3787939978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e840cd930 0x7f6e840ad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:29.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.950+0000 7f6e81e00640 1 -- 172.21.15.122:0/3787939978 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e84169170 con 0x7f6e8406f890 2024-05-28T06:12:29.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.950+0000 7f6e81e00640 1 --2- 172.21.15.122:0/3787939978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e8406f890 0x7f6e841519c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f6e7400b410 tx=0x7f6e7400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:29.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.950+0000 7f6e7aa00640 1 -- 172.21.15.122:0/3787939978 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e74015030 con 0x7f6e8406f890 2024-05-28T06:12:29.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.950+0000 7f6e7aa00640 1 -- 172.21.15.122:0/3787939978 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e74004020 con 0x7f6e8406f890 2024-05-28T06:12:29.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.950+0000 7f6e89000640 1 -- 172.21.15.122:0/3787939978 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e84144f90 con 0x7f6e8406f890 2024-05-28T06:12:29.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.950+0000 7f6e7aa00640 1 -- 172.21.15.122:0/3787939978 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e74004450 con 0x7f6e8406f890 2024-05-28T06:12:29.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.950+0000 7f6e89000640 1 -- 172.21.15.122:0/3787939978 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e84145510 con 0x7f6e8406f890 2024-05-28T06:12:29.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.950+0000 7f6e89000640 1 -- 172.21.15.122:0/3787939978 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e84068c40 con 0x7f6e8406f890 2024-05-28T06:12:29.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.950+0000 7f6e7aa00640 1 -- 172.21.15.122:0/3787939978 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f6e74018070 con 0x7f6e8406f890 2024-05-28T06:12:29.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.954+0000 7f6e7aa00640 1 --2- 172.21.15.122:0/3787939978 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6e60068c20 0x7f6e6006b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:29.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.954+0000 7f6e7aa00640 1 -- 172.21.15.122:0/3787939978 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5255+0+0 (secure 0 0 0) 0x7f6e740853b0 con 0x7f6e8406f890 2024-05-28T06:12:29.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.954+0000 7f6e79400640 1 --2- 172.21.15.122:0/3787939978 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6e60068c20 0x7f6e6006b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:29.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.954+0000 7f6e79400640 1 --2- 172.21.15.122:0/3787939978 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6e60068c20 0x7f6e6006b0e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6e8406c670 tx=0x7f6e6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:29.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:29.958+0000 7f6e7aa00640 1 -- 172.21.15.122:0/3787939978 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6e74056db0 con 0x7f6e8406f890 2024-05-28T06:12:30.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.126+0000 7f6e89000640 1 -- 172.21.15.122:0/3787939978 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f6e84155f70 con 0x7f6e8406f890 2024-05-28T06:12:30.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.770+0000 7f6e7aa00640 1 -- 172.21.15.122:0/3787939978 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v60) ==== 170+0+0 (secure 0 0 0) 0x7f6e7405b0b0 con 0x7f6e8406f890 2024-05-28T06:12:30.770 INFO:teuthology.orchestra.run.smithi122.stderr:pool 'cephfs_data' created 2024-05-28T06:12:30.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.774+0000 7f6e89000640 1 -- 172.21.15.122:0/3787939978 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6e60068c20 msgr2=0x7f6e6006b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:30.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.774+0000 7f6e89000640 1 --2- 172.21.15.122:0/3787939978 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6e60068c20 0x7f6e6006b0e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6e8406c670 tx=0x7f6e6c008040 comp rx=0 tx=0).stop 2024-05-28T06:12:30.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.774+0000 7f6e89000640 1 -- 172.21.15.122:0/3787939978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e8406f890 msgr2=0x7f6e841519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:30.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.774+0000 7f6e89000640 1 --2- 172.21.15.122:0/3787939978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e8406f890 0x7f6e841519c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f6e7400b410 tx=0x7f6e7400b8d0 comp rx=0 tx=0).stop 2024-05-28T06:12:30.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.774+0000 7f6e89000640 1 -- 172.21.15.122:0/3787939978 shutdown_connections 2024-05-28T06:12:30.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.774+0000 7f6e89000640 1 --2- 172.21.15.122:0/3787939978 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6e60068c20 0x7f6e6006b0e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:30.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.774+0000 7f6e89000640 1 --2- 172.21.15.122:0/3787939978 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e840cff30 0x7f6e840addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:30.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.774+0000 7f6e89000640 1 --2- 172.21.15.122:0/3787939978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e840cd930 0x7f6e840ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:30.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.774+0000 7f6e89000640 1 --2- 172.21.15.122:0/3787939978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e8406f890 0x7f6e841519c0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:30.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.774+0000 7f6e89000640 1 -- 172.21.15.122:0/3787939978 >> 172.21.15.122:0/3787939978 conn(0x7f6e8406bd90 msgr2=0x7f6e8406ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:30.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.774+0000 7f6e89000640 1 -- 172.21.15.122:0/3787939978 shutdown_connections 2024-05-28T06:12:30.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.774+0000 7f6e89000640 1 -- 172.21.15.122:0/3787939978 wait complete. 2024-05-28T06:12:30.811 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-28T06:12:30.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.950+0000 7f3a8be00640 1 Processor -- start 2024-05-28T06:12:30.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.950+0000 7f3a8be00640 1 -- start start 2024-05-28T06:12:30.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.950+0000 7f3a8be00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3a841588b0 0x7f3a8406e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:30.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.950+0000 7f3a8be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a8415e8b0 0x7f3a8415ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:30.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.950+0000 7f3a8be00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a84141420 con 0x7f3a8415f4c0 2024-05-28T06:12:30.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.950+0000 7f3a8be00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f3a84158c90 con 0x7f3a841588b0 2024-05-28T06:12:30.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.950+0000 7f3a8be00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3a84140e60 con 0x7f3a8415e8b0 2024-05-28T06:12:30.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a88a00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f3a8415f4c0 0x7f3a84140580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:44888/0 (socket says 172.21.15.122:44888) 2024-05-28T06:12:30.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a88a00640 1 -- 172.21.15.122:0/43158356 learned_addr learned my addr 172.21.15.122:0/43158356 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:30.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a89e00640 1 --2- 172.21.15.122:0/43158356 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a8415e8b0 0x7f3a8415ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:30.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a89400640 1 --2- 172.21.15.122:0/43158356 >> v2:172.21.15.153:3300/0 conn(0x7f3a841588b0 0x7f3a8406e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:30.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a83e00640 1 -- 172.21.15.122:0/43158356 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3421968367 0 0) 0x7f3a84141420 con 0x7f3a8415f4c0 2024-05-28T06:12:30.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a83e00640 1 -- 172.21.15.122:0/43158356 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a6c004640 con 0x7f3a8415f4c0 2024-05-28T06:12:30.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a83e00640 1 -- 172.21.15.122:0/43158356 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1096006523 0 0) 0x7f3a6c004640 con 0x7f3a8415f4c0 2024-05-28T06:12:30.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a83e00640 1 -- 172.21.15.122:0/43158356 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a8415e8b0 msgr2=0x7f3a8415ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:30.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a83e00640 1 --2- 172.21.15.122:0/43158356 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a8415e8b0 0x7f3a8415ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:30.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a83e00640 1 -- 172.21.15.122:0/43158356 >> v2:172.21.15.153:3300/0 conn(0x7f3a841588b0 msgr2=0x7f3a8406e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:30.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a83e00640 1 --2- 172.21.15.122:0/43158356 >> v2:172.21.15.153:3300/0 conn(0x7f3a841588b0 0x7f3a8406e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:30.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a83e00640 1 -- 172.21.15.122:0/43158356 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a84141140 con 0x7f3a8415f4c0 2024-05-28T06:12:30.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a83e00640 1 -- 172.21.15.122:0/43158356 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f3a70001680 con 0x7f3a8415f4c0 2024-05-28T06:12:30.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a83e00640 1 -- 172.21.15.122:0/43158356 >> v1:172.21.15.122:6789/0 conn(0x7f3a8415f4c0 legacy=0x7f3a84140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:30.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a83e00640 1 --2- 172.21.15.122:0/43158356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a6c004ad0 0x7f3a6c004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:30.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a83e00640 1 --2- 172.21.15.122:0/43158356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a6c005920 0x7f3a6c005da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:30.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a83e00640 1 --2- 172.21.15.122:0/43158356 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a6c0062e0 0x7f3a6c003450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:30.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a83e00640 1 -- 172.21.15.122:0/43158356 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3a84158c90 con 0x7f3a6c004ad0 2024-05-28T06:12:30.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a83e00640 1 -- 172.21.15.122:0/43158356 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3a84140e60 con 0x7f3a6c005920 2024-05-28T06:12:30.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a83e00640 1 -- 172.21.15.122:0/43158356 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3a6c003990 con 0x7f3a6c0062e0 2024-05-28T06:12:30.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a89e00640 1 --2- 172.21.15.122:0/43158356 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a8415e8b0 0x7f3a8415ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:12:30.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a89400640 1 --2- 172.21.15.122:0/43158356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a6c004ad0 0x7f3a6c004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:30.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a89e00640 1 --2- 172.21.15.122:0/43158356 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a6c0062e0 0x7f3a6c003450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:30.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a88a00640 1 --2- 172.21.15.122:0/43158356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a6c005920 0x7f3a6c005da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:30.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a89400640 1 -- 172.21.15.122:0/43158356 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a6c0062e0 msgr2=0x7f3a6c003450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:30.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a89400640 1 --2- 172.21.15.122:0/43158356 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a6c0062e0 0x7f3a6c003450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:30.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a89400640 1 -- 172.21.15.122:0/43158356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a6c005920 msgr2=0x7f3a6c005da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:30.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a89400640 1 --2- 172.21.15.122:0/43158356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a6c005920 0x7f3a6c005da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:30.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.954+0000 7f3a89400640 1 -- 172.21.15.122:0/43158356 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6c004640 con 0x7f3a6c004ad0 2024-05-28T06:12:30.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.958+0000 7f3a89400640 1 --2- 172.21.15.122:0/43158356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a6c004ad0 0x7f3a6c004ef0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009ae0 tx=0x7f3a7801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce8295cc846fb99 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:30.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.958+0000 7f3a83e00640 1 -- 172.21.15.122:0/43158356 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a780b2070 con 0x7f3a6c004ad0 2024-05-28T06:12:30.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.958+0000 7f3a83e00640 1 -- 172.21.15.122:0/43158356 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a780a5510 con 0x7f3a6c004ad0 2024-05-28T06:12:30.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.958+0000 7f3a83e00640 1 -- 172.21.15.122:0/43158356 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a780096b0 con 0x7f3a6c004ad0 2024-05-28T06:12:30.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.958+0000 7f3a8be00640 1 -- 172.21.15.122:0/43158356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a6c004ad0 msgr2=0x7f3a6c004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:30.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.958+0000 7f3a8be00640 1 --2- 172.21.15.122:0/43158356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a6c004ad0 0x7f3a6c004ef0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009ae0 tx=0x7f3a7801cab0 comp rx=0 tx=0).stop 2024-05-28T06:12:30.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.958+0000 7f3a89e00640 1 -- 172.21.15.122:0/43158356 reap_dead start 2024-05-28T06:12:30.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.958+0000 7f3a8be00640 1 -- 172.21.15.122:0/43158356 shutdown_connections 2024-05-28T06:12:30.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.958+0000 7f3a8be00640 1 -- 172.21.15.122:0/43158356 >> 172.21.15.122:0/43158356 conn(0x7f3a8406bd90 msgr2=0x7f3a8406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:30.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.958+0000 7f3a8be00640 1 -- 172.21.15.122:0/43158356 shutdown_connections 2024-05-28T06:12:30.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.958+0000 7f3a8be00640 1 -- 172.21.15.122:0/43158356 wait complete. 2024-05-28T06:12:30.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.958+0000 7f3a8be00640 1 Processor -- start 2024-05-28T06:12:30.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.958+0000 7f3a8be00640 1 -- start start 2024-05-28T06:12:30.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a8be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a6c004ad0 0x7f3a8413dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:30.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a8be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a84141640 0x7f3a84143cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:30.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a8be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a84141ac0 0x7f3a84144200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:30.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a8be00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3a840cf7f0 con 0x7f3a84141ac0 2024-05-28T06:12:30.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a8be00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3a840cf670 con 0x7f3a6c004ad0 2024-05-28T06:12:30.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a8be00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3a840cf970 con 0x7f3a84141640 2024-05-28T06:12:30.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a89e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a84141ac0 0x7f3a84144200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:30.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a89e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a84141ac0 0x7f3a84144200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37908/0 (socket says 172.21.15.122:37908) 2024-05-28T06:12:30.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a89e00640 1 -- 172.21.15.122:0/2055476890 learned_addr learned my addr 172.21.15.122:0/2055476890 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:30.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a89400640 1 --2- 172.21.15.122:0/2055476890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a6c004ad0 0x7f3a8413dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:30.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a88a00640 1 --2- 172.21.15.122:0/2055476890 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a84141640 0x7f3a84143cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:30.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a89e00640 1 -- 172.21.15.122:0/2055476890 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a84141640 msgr2=0x7f3a84143cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:30.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a89e00640 1 --2- 172.21.15.122:0/2055476890 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a84141640 0x7f3a84143cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:30.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a89e00640 1 -- 172.21.15.122:0/2055476890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a6c004ad0 msgr2=0x7f3a8413dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:30.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a89e00640 1 --2- 172.21.15.122:0/2055476890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a6c004ad0 0x7f3a8413dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:30.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a89e00640 1 -- 172.21.15.122:0/2055476890 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a84141fb0 con 0x7f3a84141ac0 2024-05-28T06:12:30.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a89e00640 1 --2- 172.21.15.122:0/2055476890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a84141ac0 0x7f3a84144200 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f3a8415ec90 tx=0x7f3a7c00f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:30.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a81600640 1 -- 172.21.15.122:0/2055476890 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c015630 con 0x7f3a84141ac0 2024-05-28T06:12:30.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a81600640 1 -- 172.21.15.122:0/2055476890 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a7c01d070 con 0x7f3a84141ac0 2024-05-28T06:12:30.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a81600640 1 -- 172.21.15.122:0/2055476890 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c015a10 con 0x7f3a84141ac0 2024-05-28T06:12:30.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a8be00640 1 -- 172.21.15.122:0/2055476890 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a84142230 con 0x7f3a84141ac0 2024-05-28T06:12:30.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a8be00640 1 -- 172.21.15.122:0/2055476890 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a840b4060 con 0x7f3a84141ac0 2024-05-28T06:12:30.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a8be00640 1 -- 172.21.15.122:0/2055476890 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a84068c40 con 0x7f3a84141ac0 2024-05-28T06:12:30.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.962+0000 7f3a81600640 1 -- 172.21.15.122:0/2055476890 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f3a7c015bb0 con 0x7f3a84141ac0 2024-05-28T06:12:30.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.966+0000 7f3a81600640 1 --2- 172.21.15.122:0/2055476890 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3a64068c20 0x7f3a6406b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:30.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.966+0000 7f3a81600640 1 -- 172.21.15.122:0/2055476890 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5637+0+0 (secure 0 0 0) 0x7f3a7c089400 con 0x7f3a84141ac0 2024-05-28T06:12:30.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.966+0000 7f3a89400640 1 --2- 172.21.15.122:0/2055476890 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3a64068c20 0x7f3a6406b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:30.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.966+0000 7f3a89400640 1 --2- 172.21.15.122:0/2055476890 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3a64068c20 0x7f3a6406b0e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3a780af000 tx=0x7f3a780046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:30.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:30.970+0000 7f3a81600640 1 -- 172.21.15.122:0/2055476890 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3a84141fb0 con 0x7f3a84141ac0 2024-05-28T06:12:31.157 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.158+0000 7f3a8be00640 1 -- 172.21.15.122:0/2055476890 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3a840b3d10 con 0x7f3a84141ac0 2024-05-28T06:12:31.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.786+0000 7f3a81600640 1 -- 172.21.15.122:0/2055476890 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v33) ==== 172+0+0 (secure 0 0 0) 0x7f3a7c010040 con 0x7f3a84141ac0 2024-05-28T06:12:31.792 INFO:teuthology.orchestra.run.smithi122.stderr:new fs with metadata pool 8 and data pool 9 2024-05-28T06:12:31.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.798+0000 7f3a8be00640 1 -- 172.21.15.122:0/2055476890 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3a64068c20 msgr2=0x7f3a6406b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:31.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.798+0000 7f3a8be00640 1 --2- 172.21.15.122:0/2055476890 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3a64068c20 0x7f3a6406b0e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3a780af000 tx=0x7f3a780046d0 comp rx=0 tx=0).stop 2024-05-28T06:12:31.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.798+0000 7f3a8be00640 1 -- 172.21.15.122:0/2055476890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a84141ac0 msgr2=0x7f3a84144200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:31.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.798+0000 7f3a8be00640 1 --2- 172.21.15.122:0/2055476890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a84141ac0 0x7f3a84144200 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f3a8415ec90 tx=0x7f3a7c00f870 comp rx=0 tx=0).stop 2024-05-28T06:12:31.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.798+0000 7f3a8be00640 1 -- 172.21.15.122:0/2055476890 shutdown_connections 2024-05-28T06:12:31.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.798+0000 7f3a8be00640 1 --2- 172.21.15.122:0/2055476890 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3a64068c20 0x7f3a6406b0e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:31.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.798+0000 7f3a8be00640 1 --2- 172.21.15.122:0/2055476890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a84141ac0 0x7f3a84144200 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:31.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.798+0000 7f3a8be00640 1 --2- 172.21.15.122:0/2055476890 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a84141640 0x7f3a84143cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:31.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.798+0000 7f3a8be00640 1 --2- 172.21.15.122:0/2055476890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a6c004ad0 0x7f3a8413dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:31.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.798+0000 7f3a8be00640 1 -- 172.21.15.122:0/2055476890 >> 172.21.15.122:0/2055476890 conn(0x7f3a8406bd90 msgr2=0x7f3a8406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:31.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.802+0000 7f3a8be00640 1 -- 172.21.15.122:0/2055476890 shutdown_connections 2024-05-28T06:12:31.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.802+0000 7f3a8be00640 1 -- 172.21.15.122:0/2055476890 wait complete. 2024-05-28T06:12:31.830 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:12:31.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.966+0000 7f55fde00640 1 Processor -- start 2024-05-28T06:12:31.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.966+0000 7f55fde00640 1 -- start start 2024-05-28T06:12:31.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.966+0000 7f55fde00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f55f806f890 0x7f55f80cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:31.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.966+0000 7f55fde00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55f80d0310 con 0x7f55f80cd930 2024-05-28T06:12:31.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.966+0000 7f55fde00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55f815be20 con 0x7f55f80cff30 2024-05-28T06:12:31.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.966+0000 7f55fde00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f55f815c100 con 0x7f55f806f890 2024-05-28T06:12:31.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.966+0000 7f55f7400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f55f80cd930 0x7f55f80b49b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:44902/0 (socket says 172.21.15.122:44902) 2024-05-28T06:12:31.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.966+0000 7f55f7400640 1 -- 172.21.15.122:0/1867554307 learned_addr learned my addr 172.21.15.122:0/1867554307 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:31.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.966+0000 7f55ee000640 1 --2- 172.21.15.122:0/1867554307 >> v2:172.21.15.153:3300/0 conn(0x7f55f806f890 0x7f55f80cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:31.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.966+0000 7f55f6000640 1 -- 172.21.15.122:0/1867554307 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2016453574 0 0) 0x7f55f80d0310 con 0x7f55f80cd930 2024-05-28T06:12:31.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.970+0000 7f55f6000640 1 -- 172.21.15.122:0/1867554307 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55dc005740 con 0x7f55f80cd930 2024-05-28T06:12:31.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.970+0000 7f55f6000640 1 -- 172.21.15.122:0/1867554307 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1948380130 0 0) 0x7f55dc005740 con 0x7f55f80cd930 2024-05-28T06:12:31.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.970+0000 7f55f6000640 1 -- 172.21.15.122:0/1867554307 >> v2:172.21.15.153:3300/0 conn(0x7f55f806f890 msgr2=0x7f55f80cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:31.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.970+0000 7f55f6000640 1 --2- 172.21.15.122:0/1867554307 >> v2:172.21.15.153:3300/0 conn(0x7f55f806f890 0x7f55f80cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:31.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.970+0000 7f55f6000640 1 -- 172.21.15.122:0/1867554307 >> v1:172.21.15.153:6789/0 conn(0x7f55f80cff30 legacy=0x7f55f806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:31.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.970+0000 7f55f6000640 1 -- 172.21.15.122:0/1867554307 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f815c3e0 con 0x7f55f80cd930 2024-05-28T06:12:31.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.970+0000 7f55f6000640 1 -- 172.21.15.122:0/1867554307 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f55f0001a00 con 0x7f55f80cd930 2024-05-28T06:12:31.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.970+0000 7f55f6000640 1 -- 172.21.15.122:0/1867554307 >> v1:172.21.15.122:6789/0 conn(0x7f55f80cd930 legacy=0x7f55f80b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:31.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.970+0000 7f55f6000640 1 --2- 172.21.15.122:0/1867554307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55dc005bd0 0x7f55dc005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:31.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.970+0000 7f55f6000640 1 --2- 172.21.15.122:0/1867554307 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55dc006a20 0x7f55dc006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:31.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.970+0000 7f55f6000640 1 --2- 172.21.15.122:0/1867554307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55dc0073e0 0x7f55dc00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:31.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.970+0000 7f55f6000640 1 -- 172.21.15.122:0/1867554307 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f55f815c100 con 0x7f55dc0073e0 2024-05-28T06:12:31.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.970+0000 7f55f6000640 1 -- 172.21.15.122:0/1867554307 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f55dc00e280 con 0x7f55dc005bd0 2024-05-28T06:12:31.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.970+0000 7f55f6000640 1 -- 172.21.15.122:0/1867554307 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f55dc00e480 con 0x7f55dc006a20 2024-05-28T06:12:31.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.970+0000 7f55f7400640 1 --2- 172.21.15.122:0/1867554307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55dc0073e0 0x7f55dc00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:31.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.970+0000 7f55ee000640 1 --2- 172.21.15.122:0/1867554307 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55dc006a20 0x7f55dc006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:31.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.970+0000 7f55f6a00640 1 --2- 172.21.15.122:0/1867554307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55dc005bd0 0x7f55dc005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:31.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.970+0000 7f55f7400640 1 -- 172.21.15.122:0/1867554307 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55dc006a20 msgr2=0x7f55dc006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:31.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.970+0000 7f55f7400640 1 --2- 172.21.15.122:0/1867554307 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55dc006a20 0x7f55dc006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:31.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.970+0000 7f55f7400640 1 -- 172.21.15.122:0/1867554307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55dc005bd0 msgr2=0x7f55dc005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:31.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.970+0000 7f55f7400640 1 --2- 172.21.15.122:0/1867554307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55dc005bd0 0x7f55dc005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:31.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.970+0000 7f55f7400640 1 -- 172.21.15.122:0/1867554307 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55dc005740 con 0x7f55dc0073e0 2024-05-28T06:12:31.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.970+0000 7f55f7400640 1 -- 172.21.15.122:0/1867554307 reap_dead start 2024-05-28T06:12:31.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.974+0000 7f55f7400640 1 --2- 172.21.15.122:0/1867554307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55dc0073e0 0x7f55dc00dbe0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f55f000a840 tx=0x7f55f001d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a3a48e968646b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:31.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.974+0000 7f55f6000640 1 -- 172.21.15.122:0/1867554307 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f000a460 con 0x7f55dc0073e0 2024-05-28T06:12:31.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.974+0000 7f55f6000640 1 -- 172.21.15.122:0/1867554307 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f00ac640 con 0x7f55dc0073e0 2024-05-28T06:12:31.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.974+0000 7f55f6000640 1 -- 172.21.15.122:0/1867554307 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f00aca30 con 0x7f55dc0073e0 2024-05-28T06:12:31.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.974+0000 7f55fde00640 1 -- 172.21.15.122:0/1867554307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55dc0073e0 msgr2=0x7f55dc00dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:31.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.974+0000 7f55fde00640 1 --2- 172.21.15.122:0/1867554307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55dc0073e0 0x7f55dc00dbe0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f55f000a840 tx=0x7f55f001d360 comp rx=0 tx=0).stop 2024-05-28T06:12:31.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.974+0000 7f55fde00640 1 -- 172.21.15.122:0/1867554307 shutdown_connections 2024-05-28T06:12:31.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.974+0000 7f55fde00640 1 --2- 172.21.15.122:0/1867554307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55dc0073e0 0x7f55dc00dbe0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:31.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.974+0000 7f55fde00640 1 -- 172.21.15.122:0/1867554307 >> 172.21.15.122:0/1867554307 conn(0x7f55f806bd90 msgr2=0x7f55f806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:31.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.974+0000 7f55fde00640 1 -- 172.21.15.122:0/1867554307 shutdown_connections 2024-05-28T06:12:31.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.974+0000 7f55fde00640 1 -- 172.21.15.122:0/1867554307 wait complete. 2024-05-28T06:12:31.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.974+0000 7f55fde00640 1 Processor -- start 2024-05-28T06:12:31.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.974+0000 7f55fde00640 1 -- start start 2024-05-28T06:12:31.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.974+0000 7f55fde00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55dc0073e0 0x7f55f81f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:31.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.974+0000 7f55fde00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55f80b27e0 0x7f55f814db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:31.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.974+0000 7f55fde00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55f8157510 0x7f55f8157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:31.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.974+0000 7f55fde00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f55f80cdda0 con 0x7f55f80b27e0 2024-05-28T06:12:31.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.974+0000 7f55fde00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f55f815baf0 con 0x7f55f8157510 2024-05-28T06:12:31.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.974+0000 7f55fde00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f55f80cdf20 con 0x7f55dc0073e0 2024-05-28T06:12:31.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.974+0000 7f55ee000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55f80b27e0 0x7f55f814db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:31.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.974+0000 7f55ee000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55f80b27e0 0x7f55f814db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37930/0 (socket says 172.21.15.122:37930) 2024-05-28T06:12:31.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.974+0000 7f55ee000640 1 -- 172.21.15.122:0/3271427560 learned_addr learned my addr 172.21.15.122:0/3271427560 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:31.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.978+0000 7f55f7400640 1 --2- 172.21.15.122:0/3271427560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55f8157510 0x7f55f8157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:31.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.978+0000 7f55f6a00640 1 --2- 172.21.15.122:0/3271427560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55dc0073e0 0x7f55f81f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:31.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.978+0000 7f55ee000640 1 -- 172.21.15.122:0/3271427560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55dc0073e0 msgr2=0x7f55f81f89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:31.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.978+0000 7f55ee000640 1 --2- 172.21.15.122:0/3271427560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55dc0073e0 0x7f55f81f89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:31.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.978+0000 7f55ee000640 1 -- 172.21.15.122:0/3271427560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55f8157510 msgr2=0x7f55f8157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:31.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.978+0000 7f55ee000640 1 --2- 172.21.15.122:0/3271427560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55f8157510 0x7f55f8157990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:31.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.978+0000 7f55ee000640 1 -- 172.21.15.122:0/3271427560 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f80b2f70 con 0x7f55f80b27e0 2024-05-28T06:12:31.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.978+0000 7f55f7400640 1 --2- 172.21.15.122:0/3271427560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55f8157510 0x7f55f8157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:12:31.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.978+0000 7f55ee000640 1 --2- 172.21.15.122:0/3271427560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55f80b27e0 0x7f55f814db90 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f55e0011930 tx=0x7f55e0011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:31.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.978+0000 7f55efe00640 1 -- 172.21.15.122:0/3271427560 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e000fa30 con 0x7f55f80b27e0 2024-05-28T06:12:31.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.978+0000 7f55efe00640 1 -- 172.21.15.122:0/3271427560 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55e000fbd0 con 0x7f55f80b27e0 2024-05-28T06:12:31.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.978+0000 7f55fde00640 1 -- 172.21.15.122:0/3271427560 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f814e0d0 con 0x7f55f80b27e0 2024-05-28T06:12:31.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.978+0000 7f55efe00640 1 -- 172.21.15.122:0/3271427560 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e0014440 con 0x7f55f80b27e0 2024-05-28T06:12:31.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.978+0000 7f55fde00640 1 -- 172.21.15.122:0/3271427560 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f80b2500 con 0x7f55f80b27e0 2024-05-28T06:12:31.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.978+0000 7f55fde00640 1 -- 172.21.15.122:0/3271427560 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55f81e52a0 con 0x7f55f80b27e0 2024-05-28T06:12:31.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.978+0000 7f55efe00640 1 -- 172.21.15.122:0/3271427560 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f55e0012040 con 0x7f55f80b27e0 2024-05-28T06:12:31.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.978+0000 7f55efe00640 1 --2- 172.21.15.122:0/3271427560 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f55d4068bf0 0x7f55d406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:31.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.978+0000 7f55efe00640 1 -- 172.21.15.122:0/3271427560 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5737+0+0 (secure 0 0 0) 0x7f55e0085760 con 0x7f55f80b27e0 2024-05-28T06:12:31.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.982+0000 7f55f6a00640 1 --2- 172.21.15.122:0/3271427560 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f55d4068bf0 0x7f55d406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:31.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.982+0000 7f55f6a00640 1 --2- 172.21.15.122:0/3271427560 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f55d4068bf0 0x7f55d406b0b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f55e8000c10 tx=0x7f55e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:31.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:31.982+0000 7f55efe00640 1 -- 172.21.15.122:0/3271427560 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f55e0019030 con 0x7f55f80b27e0 2024-05-28T06:12:32.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.142+0000 7f55fde00640 1 -- 172.21.15.122:0/3271427560 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55f8068c40 con 0x7f55f80b27e0 2024-05-28T06:12:32.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.142+0000 7f55efe00640 1 -- 172.21.15.122:0/3271427560 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16721 (secure 0 0 0) 0x7f55e0057870 con 0x7f55f80b27e0 2024-05-28T06:12:32.143 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:32.143 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":61,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:12:31.161619+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:12:28.875891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-28T06:12:30.137302+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:12:32.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.146+0000 7f55fde00640 1 -- 172.21.15.122:0/3271427560 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f55d4068bf0 msgr2=0x7f55d406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:32.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.146+0000 7f55fde00640 1 --2- 172.21.15.122:0/3271427560 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f55d4068bf0 0x7f55d406b0b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f55e8000c10 tx=0x7f55e8009040 comp rx=0 tx=0).stop 2024-05-28T06:12:32.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.146+0000 7f55fde00640 1 -- 172.21.15.122:0/3271427560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55f80b27e0 msgr2=0x7f55f814db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:32.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.146+0000 7f55fde00640 1 --2- 172.21.15.122:0/3271427560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55f80b27e0 0x7f55f814db90 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f55e0011930 tx=0x7f55e0011df0 comp rx=0 tx=0).stop 2024-05-28T06:12:32.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.146+0000 7f55fde00640 1 -- 172.21.15.122:0/3271427560 shutdown_connections 2024-05-28T06:12:32.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.146+0000 7f55fde00640 1 --2- 172.21.15.122:0/3271427560 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f55d4068bf0 0x7f55d406b0b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:32.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.146+0000 7f55fde00640 1 --2- 172.21.15.122:0/3271427560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55f8157510 0x7f55f8157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:32.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.146+0000 7f55fde00640 1 --2- 172.21.15.122:0/3271427560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55f80b27e0 0x7f55f814db90 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:32.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.146+0000 7f55fde00640 1 --2- 172.21.15.122:0/3271427560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55dc0073e0 0x7f55f81f89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:32.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.146+0000 7f55fde00640 1 -- 172.21.15.122:0/3271427560 >> 172.21.15.122:0/3271427560 conn(0x7f55f806bd90 msgr2=0x7f55f806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:32.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.146+0000 7f55fde00640 1 -- 172.21.15.122:0/3271427560 shutdown_connections 2024-05-28T06:12:32.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.146+0000 7f55fde00640 1 -- 172.21.15.122:0/3271427560 wait complete. 2024-05-28T06:12:32.164 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:12:32.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.302+0000 7f7feee00640 1 Processor -- start 2024-05-28T06:12:32.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.302+0000 7f7feee00640 1 -- start start 2024-05-28T06:12:32.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.302+0000 7f7feee00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fe806dab0 0x7f7fe815f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:32.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.302+0000 7f7feee00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7fe815fa80 0x7f7fe80d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:32.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.302+0000 7f7feee00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fe8162510 con 0x7f7fe815ea50 2024-05-28T06:12:32.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.302+0000 7f7feee00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f7fe8163120 con 0x7f7fe815fa80 2024-05-28T06:12:32.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.302+0000 7f7feee00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7fe81627f0 con 0x7f7fe806dab0 2024-05-28T06:12:32.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.302+0000 7f7fe7e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f7fe815ea50 0x7f7fe815ee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:44916/0 (socket says 172.21.15.122:44916) 2024-05-28T06:12:32.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.302+0000 7f7fe7e00640 1 -- 172.21.15.122:0/3608321219 learned_addr learned my addr 172.21.15.122:0/3608321219 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:32.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.302+0000 7f7fece00640 1 --2- 172.21.15.122:0/3608321219 >> v2:172.21.15.122:3300/0 conn(0x7f7fe815fa80 0x7f7fe80d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:32.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.302+0000 7f7fdf400640 1 --2- 172.21.15.122:0/3608321219 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fe806dab0 0x7f7fe815f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:32.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.302+0000 7f7fe7400640 1 -- 172.21.15.122:0/3608321219 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4112150599 0 0) 0x7f7fe8162510 con 0x7f7fe815ea50 2024-05-28T06:12:32.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.302+0000 7f7fe7400640 1 -- 172.21.15.122:0/3608321219 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fcc003530 con 0x7f7fe815ea50 2024-05-28T06:12:32.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.302+0000 7f7fece00640 1 -- 172.21.15.122:0/3608321219 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fe806dab0 msgr2=0x7f7fe815f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:32.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.302+0000 7f7fece00640 1 --2- 172.21.15.122:0/3608321219 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fe806dab0 0x7f7fe815f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:32.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.302+0000 7f7fece00640 1 -- 172.21.15.122:0/3608321219 >> v1:172.21.15.122:6789/0 conn(0x7f7fe815ea50 legacy=0x7f7fe815ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:32.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.302+0000 7f7fece00640 1 -- 172.21.15.122:0/3608321219 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe8162ad0 con 0x7f7fe815fa80 2024-05-28T06:12:32.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.306+0000 7f7fece00640 1 --2- 172.21.15.122:0/3608321219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fe815fa80 0x7f7fe80d08e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f7fe00097c0 tx=0x7f7fe001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51a5c6676ea83cc server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:32.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.306+0000 7f7fe7400640 1 -- 172.21.15.122:0/3608321219 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe00b0070 con 0x7f7fe815fa80 2024-05-28T06:12:32.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.306+0000 7f7fe7400640 1 -- 172.21.15.122:0/3608321219 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fe00ab600 con 0x7f7fe815fa80 2024-05-28T06:12:32.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.306+0000 7f7fe7400640 1 -- 172.21.15.122:0/3608321219 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe00ab9d0 con 0x7f7fe815fa80 2024-05-28T06:12:32.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.306+0000 7f7feee00640 1 -- 172.21.15.122:0/3608321219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fe815fa80 msgr2=0x7f7fe80d08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:32.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.306+0000 7f7feee00640 1 --2- 172.21.15.122:0/3608321219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fe815fa80 0x7f7fe80d08e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f7fe00097c0 tx=0x7f7fe001c470 comp rx=0 tx=0).stop 2024-05-28T06:12:32.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.306+0000 7f7feee00640 1 -- 172.21.15.122:0/3608321219 shutdown_connections 2024-05-28T06:12:32.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.306+0000 7f7feee00640 1 --2- 172.21.15.122:0/3608321219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fe815fa80 0x7f7fe80d08e0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:32.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.306+0000 7f7feee00640 1 --2- 172.21.15.122:0/3608321219 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fe806dab0 0x7f7fe815f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:32.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.306+0000 7f7feee00640 1 -- 172.21.15.122:0/3608321219 >> 172.21.15.122:0/3608321219 conn(0x7f7fe80b4190 msgr2=0x7f7fe80b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:32.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.306+0000 7f7feee00640 1 -- 172.21.15.122:0/3608321219 shutdown_connections 2024-05-28T06:12:32.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.306+0000 7f7feee00640 1 -- 172.21.15.122:0/3608321219 wait complete. 2024-05-28T06:12:32.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7feee00640 1 Processor -- start 2024-05-28T06:12:32.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7feee00640 1 -- start start 2024-05-28T06:12:32.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7feee00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fe806dab0 0x7f7fe814bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:32.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7feee00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fe815ea50 0x7f7fe815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:32.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7feee00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fe815fa80 0x7f7fe80711f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:32.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7feee00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe80d19c0 con 0x7f7fe815ea50 2024-05-28T06:12:32.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7feee00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe80d1840 con 0x7f7fe806dab0 2024-05-28T06:12:32.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7feee00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7fe80d1b40 con 0x7f7fe815fa80 2024-05-28T06:12:32.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7fdf400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fe815ea50 0x7f7fe815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:32.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7fdf400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fe815ea50 0x7f7fe815d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37938/0 (socket says 172.21.15.122:37938) 2024-05-28T06:12:32.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7fdf400640 1 -- 172.21.15.122:0/3623224833 learned_addr learned my addr 172.21.15.122:0/3623224833 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:32.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7fe7e00640 1 --2- 172.21.15.122:0/3623224833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fe806dab0 0x7f7fe814bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:32.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7fece00640 1 --2- 172.21.15.122:0/3623224833 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fe815fa80 0x7f7fe80711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:32.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7fdf400640 1 -- 172.21.15.122:0/3623224833 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fe815fa80 msgr2=0x7f7fe80711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:32.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7fdf400640 1 --2- 172.21.15.122:0/3623224833 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fe815fa80 0x7f7fe80711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:32.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7fdf400640 1 -- 172.21.15.122:0/3623224833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fe806dab0 msgr2=0x7f7fe814bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:32.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7fdf400640 1 --2- 172.21.15.122:0/3623224833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fe806dab0 0x7f7fe814bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:32.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7fdf400640 1 -- 172.21.15.122:0/3623224833 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe814c900 con 0x7f7fe815ea50 2024-05-28T06:12:32.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7fdf400640 1 --2- 172.21.15.122:0/3623224833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fe815ea50 0x7f7fe815d2c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000e8a0 tx=0x7f7fd000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:32.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7fe4c00640 1 -- 172.21.15.122:0/3623224833 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0017070 con 0x7f7fe815ea50 2024-05-28T06:12:32.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7fe4c00640 1 -- 172.21.15.122:0/3623224833 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fd000c940 con 0x7f7fe815ea50 2024-05-28T06:12:32.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7fe4c00640 1 -- 172.21.15.122:0/3623224833 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd000ccf0 con 0x7f7fe815ea50 2024-05-28T06:12:32.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7feee00640 1 -- 172.21.15.122:0/3623224833 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe814cbe0 con 0x7f7fe815ea50 2024-05-28T06:12:32.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.310+0000 7f7feee00640 1 -- 172.21.15.122:0/3623224833 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe814c420 con 0x7f7fe815ea50 2024-05-28T06:12:32.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.314+0000 7f7feee00640 1 -- 172.21.15.122:0/3623224833 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe8068c40 con 0x7f7fe815ea50 2024-05-28T06:12:32.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.314+0000 7f7fe4c00640 1 -- 172.21.15.122:0/3623224833 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f7fd001a070 con 0x7f7fe815ea50 2024-05-28T06:12:32.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.314+0000 7f7fe4c00640 1 --2- 172.21.15.122:0/3623224833 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7fc4068bf0 0x7f7fc406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:32.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.314+0000 7f7fe4c00640 1 -- 172.21.15.122:0/3623224833 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5737+0+0 (secure 0 0 0) 0x7f7fd0087d80 con 0x7f7fe815ea50 2024-05-28T06:12:32.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.314+0000 7f7fe7e00640 1 --2- 172.21.15.122:0/3623224833 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7fc4068bf0 0x7f7fc406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:32.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.314+0000 7f7fe7e00640 1 --2- 172.21.15.122:0/3623224833 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7fc4068bf0 0x7f7fc406b0b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8005c10 tx=0x7f7fd8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:32.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.318+0000 7f7fe4c00640 1 -- 172.21.15.122:0/3623224833 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7fd0056db0 con 0x7f7fe815ea50 2024-05-28T06:12:32.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.482+0000 7f7feee00640 1 -- 172.21.15.122:0/3623224833 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7fe80b4ea0 con 0x7f7fe815ea50 2024-05-28T06:12:32.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.482+0000 7f7fe4c00640 1 -- 172.21.15.122:0/3623224833 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16721 (secure 0 0 0) 0x7f7fd005b0b0 con 0x7f7fe815ea50 2024-05-28T06:12:32.483 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:32.483 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":61,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:12:31.161619+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:12:28.875891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-28T06:12:30.137302+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:12:32.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.486+0000 7f7feee00640 1 -- 172.21.15.122:0/3623224833 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7fc4068bf0 msgr2=0x7f7fc406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:32.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.486+0000 7f7feee00640 1 --2- 172.21.15.122:0/3623224833 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7fc4068bf0 0x7f7fc406b0b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8005c10 tx=0x7f7fd8009040 comp rx=0 tx=0).stop 2024-05-28T06:12:32.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.486+0000 7f7feee00640 1 -- 172.21.15.122:0/3623224833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fe815ea50 msgr2=0x7f7fe815d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:32.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.486+0000 7f7feee00640 1 --2- 172.21.15.122:0/3623224833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fe815ea50 0x7f7fe815d2c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000e8a0 tx=0x7f7fd000eca0 comp rx=0 tx=0).stop 2024-05-28T06:12:32.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.486+0000 7f7feee00640 1 -- 172.21.15.122:0/3623224833 shutdown_connections 2024-05-28T06:12:32.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.486+0000 7f7feee00640 1 --2- 172.21.15.122:0/3623224833 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7fc4068bf0 0x7f7fc406b0b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:32.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.486+0000 7f7feee00640 1 --2- 172.21.15.122:0/3623224833 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fe815fa80 0x7f7fe80711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:32.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.486+0000 7f7feee00640 1 --2- 172.21.15.122:0/3623224833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fe815ea50 0x7f7fe815d2c0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:32.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.486+0000 7f7feee00640 1 --2- 172.21.15.122:0/3623224833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fe806dab0 0x7f7fe814bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:32.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.486+0000 7f7feee00640 1 -- 172.21.15.122:0/3623224833 >> 172.21.15.122:0/3623224833 conn(0x7f7fe80b4190 msgr2=0x7f7fe8157b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:32.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.486+0000 7f7feee00640 1 -- 172.21.15.122:0/3623224833 shutdown_connections 2024-05-28T06:12:32.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.486+0000 7f7feee00640 1 -- 172.21.15.122:0/3623224833 wait complete. 2024-05-28T06:12:32.505 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-28T06:12:32.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.642+0000 7f2279e00640 1 Processor -- start 2024-05-28T06:12:32.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.642+0000 7f2279e00640 1 -- start start 2024-05-28T06:12:32.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.646+0000 7f2279e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f227415eb90 0x7f227406fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:32.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.646+0000 7f2279e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f227406f460 0x7f22740b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:32.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.646+0000 7f2279e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f227415fb00 con 0x7f22740722f0 2024-05-28T06:12:32.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.646+0000 7f2279e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f2274070200 con 0x7f227406f460 2024-05-28T06:12:32.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.646+0000 7f2279e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f227415fde0 con 0x7f227415eb90 2024-05-28T06:12:32.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.646+0000 7f2273400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f227406f460 0x7f22740b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:32.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.646+0000 7f2272a00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f22740722f0 0x7f22740726d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:44928/0 (socket says 172.21.15.122:44928) 2024-05-28T06:12:32.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.646+0000 7f2272a00640 1 -- 172.21.15.122:0/4200997066 learned_addr learned my addr 172.21.15.122:0/4200997066 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:32.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.646+0000 7f226a000640 1 --2- 172.21.15.122:0/4200997066 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f227415eb90 0x7f227406fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:32.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.646+0000 7f2273400640 1 -- 172.21.15.122:0/4200997066 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f227415eb90 msgr2=0x7f227406fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:32.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.646+0000 7f2273400640 1 --2- 172.21.15.122:0/4200997066 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f227415eb90 0x7f227406fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:32.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.646+0000 7f2273400640 1 -- 172.21.15.122:0/4200997066 >> v1:172.21.15.122:6789/0 conn(0x7f22740722f0 legacy=0x7f22740726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:32.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.646+0000 7f2273400640 1 -- 172.21.15.122:0/4200997066 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22740b44a0 con 0x7f227406f460 2024-05-28T06:12:32.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.646+0000 7f2272000640 1 -- 172.21.15.122:0/4200997066 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3074674812 0 0) 0x7f227415fb00 con 0x7f22740722f0 2024-05-28T06:12:32.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.646+0000 7f226a000640 1 --2- 172.21.15.122:0/4200997066 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f227415eb90 0x7f227406fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:12:32.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.650+0000 7f2273400640 1 --2- 172.21.15.122:0/4200997066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f227406f460 0x7f22740b31a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f226c009d90 tx=0x7f226c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c233b20a170fec95 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:32.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.650+0000 7f2272000640 1 -- 172.21.15.122:0/4200997066 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c0b2070 con 0x7f227406f460 2024-05-28T06:12:32.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.650+0000 7f2272000640 1 -- 172.21.15.122:0/4200997066 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f226c0a5970 con 0x7f227406f460 2024-05-28T06:12:32.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.650+0000 7f2272000640 1 -- 172.21.15.122:0/4200997066 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c0a5d40 con 0x7f227406f460 2024-05-28T06:12:32.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.650+0000 7f2279e00640 1 -- 172.21.15.122:0/4200997066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f227406f460 msgr2=0x7f22740b31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:32.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.650+0000 7f2279e00640 1 --2- 172.21.15.122:0/4200997066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f227406f460 0x7f22740b31a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f226c009d90 tx=0x7f226c01c8b0 comp rx=0 tx=0).stop 2024-05-28T06:12:32.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.650+0000 7f2279e00640 1 -- 172.21.15.122:0/4200997066 shutdown_connections 2024-05-28T06:12:32.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.650+0000 7f2279e00640 1 --2- 172.21.15.122:0/4200997066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f227406f460 0x7f22740b31a0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:32.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.650+0000 7f2279e00640 1 --2- 172.21.15.122:0/4200997066 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f227415eb90 0x7f227406fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:32.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.650+0000 7f2279e00640 1 -- 172.21.15.122:0/4200997066 >> 172.21.15.122:0/4200997066 conn(0x7f22740b26b0 msgr2=0x7f22740b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:32.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.650+0000 7f2279e00640 1 -- 172.21.15.122:0/4200997066 shutdown_connections 2024-05-28T06:12:32.650 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.650+0000 7f2279e00640 1 -- 172.21.15.122:0/4200997066 wait complete. 2024-05-28T06:12:32.650 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.650+0000 7f2279e00640 1 Processor -- start 2024-05-28T06:12:32.650 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.650+0000 7f2279e00640 1 -- start start 2024-05-28T06:12:32.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.650+0000 7f2279e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f227406f460 0x7f227414ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:32.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.650+0000 7f2279e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f22740722f0 0x7f227415c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:32.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.650+0000 7f2279e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f227415eb90 0x7f227415c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:32.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.650+0000 7f2279e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f227416b120 con 0x7f227415eb90 2024-05-28T06:12:32.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.650+0000 7f2279e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f227416afa0 con 0x7f227406f460 2024-05-28T06:12:32.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.650+0000 7f2279e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f227416b2a0 con 0x7f22740722f0 2024-05-28T06:12:32.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.654+0000 7f2273400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f227415eb90 0x7f227415c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:32.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.654+0000 7f2273400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f227415eb90 0x7f227415c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37962/0 (socket says 172.21.15.122:37962) 2024-05-28T06:12:32.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.654+0000 7f2273400640 1 -- 172.21.15.122:0/657306121 learned_addr learned my addr 172.21.15.122:0/657306121 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:32.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.654+0000 7f2273400640 1 -- 172.21.15.122:0/657306121 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f22740722f0 msgr2=0x7f227415c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:32.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.654+0000 7f2273400640 1 --2- 172.21.15.122:0/657306121 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f22740722f0 0x7f227415c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:32.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.654+0000 7f2273400640 1 -- 172.21.15.122:0/657306121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f227406f460 msgr2=0x7f227414ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:32.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.654+0000 7f2273400640 1 --2- 172.21.15.122:0/657306121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f227406f460 0x7f227414ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:32.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.654+0000 7f2273400640 1 -- 172.21.15.122:0/657306121 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227415cd30 con 0x7f227415eb90 2024-05-28T06:12:32.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.654+0000 7f2273400640 1 --2- 172.21.15.122:0/657306121 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f227415eb90 0x7f227415c6d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f226c01af60 tx=0x7f226c019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:32.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.654+0000 7f226be00640 1 -- 172.21.15.122:0/657306121 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c0bd020 con 0x7f227415eb90 2024-05-28T06:12:32.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.654+0000 7f226be00640 1 -- 172.21.15.122:0/657306121 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f226c0ad6c0 con 0x7f227415eb90 2024-05-28T06:12:32.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.654+0000 7f226be00640 1 -- 172.21.15.122:0/657306121 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c0b2040 con 0x7f227415eb90 2024-05-28T06:12:32.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.654+0000 7f2279e00640 1 -- 172.21.15.122:0/657306121 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f227415d010 con 0x7f227415eb90 2024-05-28T06:12:32.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.654+0000 7f2279e00640 1 -- 172.21.15.122:0/657306121 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2274151aa0 con 0x7f227415eb90 2024-05-28T06:12:32.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.654+0000 7f2279e00640 1 -- 172.21.15.122:0/657306121 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22740ade80 con 0x7f227415eb90 2024-05-28T06:12:32.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.654+0000 7f226be00640 1 -- 172.21.15.122:0/657306121 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f226c0c0020 con 0x7f227415eb90 2024-05-28T06:12:32.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.658+0000 7f226be00640 1 --2- 172.21.15.122:0/657306121 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2250068bf0 0x7f225006b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:32.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.658+0000 7f226be00640 1 -- 172.21.15.122:0/657306121 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5737+0+0 (secure 0 0 0) 0x7f226c122990 con 0x7f227415eb90 2024-05-28T06:12:32.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.658+0000 7f2272a00640 1 --2- 172.21.15.122:0/657306121 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2250068bf0 0x7f225006b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:32.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.658+0000 7f2272a00640 1 --2- 172.21.15.122:0/657306121 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2250068bf0 0x7f225006b0b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f22640011f0 tx=0x7f2264007930 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:32.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.662+0000 7f226be00640 1 -- 172.21.15.122:0/657306121 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f226c0c7030 con 0x7f227415eb90 2024-05-28T06:12:32.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:32.854+0000 7f2279e00640 1 -- 172.21.15.122:0/657306121 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2274068c40 con 0x7f227415eb90 2024-05-28T06:12:33.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.806+0000 7f226be00640 1 -- 172.21.15.122:0/657306121 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v36) ==== 118+0+0 (secure 0 0 0) 0x7f226c016560 con 0x7f227415eb90 2024-05-28T06:12:33.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.810+0000 7f2279e00640 1 -- 172.21.15.122:0/657306121 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2250068bf0 msgr2=0x7f225006b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:33.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.810+0000 7f2279e00640 1 --2- 172.21.15.122:0/657306121 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2250068bf0 0x7f225006b0b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f22640011f0 tx=0x7f2264007930 comp rx=0 tx=0).stop 2024-05-28T06:12:33.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.810+0000 7f2279e00640 1 -- 172.21.15.122:0/657306121 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f227415eb90 msgr2=0x7f227415c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:33.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.810+0000 7f2279e00640 1 --2- 172.21.15.122:0/657306121 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f227415eb90 0x7f227415c6d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f226c01af60 tx=0x7f226c019650 comp rx=0 tx=0).stop 2024-05-28T06:12:33.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.810+0000 7f2279e00640 1 -- 172.21.15.122:0/657306121 shutdown_connections 2024-05-28T06:12:33.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.810+0000 7f2279e00640 1 --2- 172.21.15.122:0/657306121 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2250068bf0 0x7f225006b0b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:33.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.810+0000 7f2279e00640 1 --2- 172.21.15.122:0/657306121 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f227415eb90 0x7f227415c6d0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:33.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.810+0000 7f2279e00640 1 --2- 172.21.15.122:0/657306121 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f22740722f0 0x7f227415c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:33.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.810+0000 7f2279e00640 1 --2- 172.21.15.122:0/657306121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f227406f460 0x7f227414ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:33.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.810+0000 7f2279e00640 1 -- 172.21.15.122:0/657306121 >> 172.21.15.122:0/657306121 conn(0x7f22740b26b0 msgr2=0x7f227406c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:33.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.810+0000 7f2279e00640 1 -- 172.21.15.122:0/657306121 shutdown_connections 2024-05-28T06:12:33.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.810+0000 7f2279e00640 1 -- 172.21.15.122:0/657306121 wait complete. 2024-05-28T06:12:33.834 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-28T06:12:33.834 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-28T06:12:33.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.978+0000 7efdeb400640 1 Processor -- start 2024-05-28T06:12:33.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.978+0000 7efdeb400640 1 -- start start 2024-05-28T06:12:33.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.978+0000 7efdeb400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efde40cff30 0x7efde406f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:33.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.978+0000 7efdeb400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efde406f6c0 0x7efde40cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:33.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.978+0000 7efdeb400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efde40d0310 con 0x7efde40cd930 2024-05-28T06:12:33.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.978+0000 7efdeb400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7efde406fb30 con 0x7efde40cff30 2024-05-28T06:12:33.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.978+0000 7efdeb400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7efde415be20 con 0x7efde406f6c0 2024-05-28T06:12:33.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.978+0000 7efde8a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efde40cff30 0x7efde406f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:33.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.978+0000 7efde8a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efde40cff30 0x7efde406f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37970/0 (socket says 172.21.15.122:37970) 2024-05-28T06:12:33.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.978+0000 7efde8a00640 1 -- 172.21.15.122:0/361859820 learned_addr learned my addr 172.21.15.122:0/361859820 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:33.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.978+0000 7efddbe00640 1 --2- 172.21.15.122:0/361859820 >> v2:172.21.15.153:3300/0 conn(0x7efde406f6c0 0x7efde40cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:33.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.978+0000 7efde8a00640 1 -- 172.21.15.122:0/361859820 >> v2:172.21.15.153:3300/0 conn(0x7efde406f6c0 msgr2=0x7efde40cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:33.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.978+0000 7efde8a00640 1 --2- 172.21.15.122:0/361859820 >> v2:172.21.15.153:3300/0 conn(0x7efde406f6c0 0x7efde40cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:33.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.978+0000 7efde8a00640 1 -- 172.21.15.122:0/361859820 >> v1:172.21.15.153:6789/0 conn(0x7efde40cd930 legacy=0x7efde40722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:33.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.978+0000 7efde8a00640 1 -- 172.21.15.122:0/361859820 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde415c100 con 0x7efde40cff30 2024-05-28T06:12:33.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.982+0000 7efde8a00640 1 --2- 172.21.15.122:0/361859820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efde40cff30 0x7efde406f180 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7efde4073310 tx=0x7efdd401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75499ba211eca361 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:33.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.982+0000 7efde3e00640 1 -- 172.21.15.122:0/361859820 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd40aa610 con 0x7efde40cff30 2024-05-28T06:12:33.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.982+0000 7efde3e00640 1 -- 172.21.15.122:0/361859820 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd40af070 con 0x7efde40cff30 2024-05-28T06:12:33.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.982+0000 7efde3e00640 1 -- 172.21.15.122:0/361859820 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd40aa9d0 con 0x7efde40cff30 2024-05-28T06:12:33.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.982+0000 7efdeb400640 1 -- 172.21.15.122:0/361859820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efde40cff30 msgr2=0x7efde406f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:33.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.982+0000 7efdeb400640 1 --2- 172.21.15.122:0/361859820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efde40cff30 0x7efde406f180 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7efde4073310 tx=0x7efdd401c4b0 comp rx=0 tx=0).stop 2024-05-28T06:12:33.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.982+0000 7efdeb400640 1 -- 172.21.15.122:0/361859820 shutdown_connections 2024-05-28T06:12:33.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.982+0000 7efdeb400640 1 --2- 172.21.15.122:0/361859820 >> v2:172.21.15.153:3300/0 conn(0x7efde406f6c0 0x7efde40cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:33.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.982+0000 7efdeb400640 1 --2- 172.21.15.122:0/361859820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efde40cff30 0x7efde406f180 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:33.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.982+0000 7efdeb400640 1 -- 172.21.15.122:0/361859820 >> 172.21.15.122:0/361859820 conn(0x7efde406bd90 msgr2=0x7efde406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:33.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.982+0000 7efdeb400640 1 -- 172.21.15.122:0/361859820 shutdown_connections 2024-05-28T06:12:33.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.982+0000 7efdeb400640 1 -- 172.21.15.122:0/361859820 wait complete. 2024-05-28T06:12:33.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efdeb400640 1 Processor -- start 2024-05-28T06:12:33.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efdeb400640 1 -- start start 2024-05-28T06:12:33.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efdeb400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efde406f6c0 0x7efde40b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:33.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efdeb400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efde40cd930 0x7efde40b1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:33.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efdeb400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efde40cff30 0x7efde4141cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:33.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efdeb400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efde40cdeb0 con 0x7efde40cff30 2024-05-28T06:12:33.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efdeb400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efde40cdd30 con 0x7efde406f6c0 2024-05-28T06:12:33.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efdeb400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7efde40b59c0 con 0x7efde40cd930 2024-05-28T06:12:33.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efde9400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efde40cff30 0x7efde4141cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:33.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efde9400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efde40cff30 0x7efde4141cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37976/0 (socket says 172.21.15.122:37976) 2024-05-28T06:12:33.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efde9400640 1 -- 172.21.15.122:0/268288166 learned_addr learned my addr 172.21.15.122:0/268288166 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:33.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efddbe00640 1 --2- 172.21.15.122:0/268288166 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efde40cd930 0x7efde40b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:33.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efde8a00640 1 --2- 172.21.15.122:0/268288166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efde406f6c0 0x7efde40b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:33.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efde9400640 1 -- 172.21.15.122:0/268288166 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efde40cd930 msgr2=0x7efde40b1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:33.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efde9400640 1 --2- 172.21.15.122:0/268288166 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efde40cd930 0x7efde40b1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:33.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efde9400640 1 -- 172.21.15.122:0/268288166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efde406f6c0 msgr2=0x7efde40b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:33.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efde9400640 1 --2- 172.21.15.122:0/268288166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efde406f6c0 0x7efde40b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:33.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efde9400640 1 -- 172.21.15.122:0/268288166 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde40b3120 con 0x7efde40cff30 2024-05-28T06:12:33.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efde9400640 1 --2- 172.21.15.122:0/268288166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efde40cff30 0x7efde4141cd0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7efddc00c7b0 tx=0x7efddc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:33.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efde1600640 1 -- 172.21.15.122:0/268288166 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc004b70 con 0x7efde40cff30 2024-05-28T06:12:33.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efde1600640 1 -- 172.21.15.122:0/268288166 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efddc004d10 con 0x7efde40cff30 2024-05-28T06:12:33.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efdeb400640 1 -- 172.21.15.122:0/268288166 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde40b18a0 con 0x7efde40cff30 2024-05-28T06:12:33.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efde1600640 1 -- 172.21.15.122:0/268288166 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc00aa90 con 0x7efde40cff30 2024-05-28T06:12:33.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.986+0000 7efdeb400640 1 -- 172.21.15.122:0/268288166 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde40b1e20 con 0x7efde40cff30 2024-05-28T06:12:33.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.990+0000 7efdeb400640 1 -- 172.21.15.122:0/268288166 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efde4068c40 con 0x7efde40cff30 2024-05-28T06:12:33.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.990+0000 7efde1600640 1 -- 172.21.15.122:0/268288166 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7efddc00ac30 con 0x7efde40cff30 2024-05-28T06:12:33.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.990+0000 7efde1600640 1 --2- 172.21.15.122:0/268288166 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdc0068bf0 0x7efdc006b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:33.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.990+0000 7efde1600640 1 -- 172.21.15.122:0/268288166 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7efddc087d30 con 0x7efde40cff30 2024-05-28T06:12:33.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.990+0000 7efde8a00640 1 --2- 172.21.15.122:0/268288166 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdc0068bf0 0x7efdc006b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:33.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.990+0000 7efde8a00640 1 --2- 172.21.15.122:0/268288166 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdc0068bf0 0x7efdc006b0b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efdd40ae000 tx=0x7efdd40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:33.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:33.994+0000 7efde1600640 1 -- 172.21.15.122:0/268288166 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efddc020070 con 0x7efde40cff30 2024-05-28T06:12:34.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.182+0000 7efdeb400640 1 -- 172.21.15.122:0/268288166 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7efde4155f70 con 0x7efde40cff30 2024-05-28T06:12:34.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.810+0000 7efde1600640 1 -- 172.21.15.122:0/268288166 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v37) ==== 122+0+0 (secure 0 0 0) 0x7efde40b3120 con 0x7efde40cff30 2024-05-28T06:12:34.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.810+0000 7efdeb400640 1 -- 172.21.15.122:0/268288166 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdc0068bf0 msgr2=0x7efdc006b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:34.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.810+0000 7efdeb400640 1 --2- 172.21.15.122:0/268288166 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdc0068bf0 0x7efdc006b0b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efdd40ae000 tx=0x7efdd40a7000 comp rx=0 tx=0).stop 2024-05-28T06:12:34.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.810+0000 7efdeb400640 1 -- 172.21.15.122:0/268288166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efde40cff30 msgr2=0x7efde4141cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:34.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.810+0000 7efdeb400640 1 --2- 172.21.15.122:0/268288166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efde40cff30 0x7efde4141cd0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7efddc00c7b0 tx=0x7efddc00cc70 comp rx=0 tx=0).stop 2024-05-28T06:12:34.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.810+0000 7efdeb400640 1 -- 172.21.15.122:0/268288166 shutdown_connections 2024-05-28T06:12:34.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.810+0000 7efdeb400640 1 --2- 172.21.15.122:0/268288166 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7efdc0068bf0 0x7efdc006b0b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:34.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.810+0000 7efdeb400640 1 --2- 172.21.15.122:0/268288166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efde40cff30 0x7efde4141cd0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:34.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.810+0000 7efdeb400640 1 --2- 172.21.15.122:0/268288166 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efde40cd930 0x7efde40b1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:34.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.810+0000 7efdeb400640 1 --2- 172.21.15.122:0/268288166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efde406f6c0 0x7efde40b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:34.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.814+0000 7efdeb400640 1 -- 172.21.15.122:0/268288166 >> 172.21.15.122:0/268288166 conn(0x7efde406bd90 msgr2=0x7efde4154390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:34.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.814+0000 7efdeb400640 1 -- 172.21.15.122:0/268288166 shutdown_connections 2024-05-28T06:12:34.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.814+0000 7efdeb400640 1 -- 172.21.15.122:0/268288166 wait complete. 2024-05-28T06:12:34.832 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-28T06:12:34.832 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:12:34.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.970+0000 7f321ee00640 1 Processor -- start 2024-05-28T06:12:34.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.970+0000 7f321ee00640 1 -- start start 2024-05-28T06:12:34.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.970+0000 7f321ee00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f32180b58d0 0x7f32180b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:34.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.970+0000 7f321ee00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32180b61f0 con 0x7f321815e730 2024-05-28T06:12:34.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.970+0000 7f321ee00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f321815d970 con 0x7f32180ce4f0 2024-05-28T06:12:34.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.970+0000 7f321ee00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f321815dc50 con 0x7f32180b58d0 2024-05-28T06:12:34.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.970+0000 7f321ce00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f321815e730 0x7f321815eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:44936/0 (socket says 172.21.15.122:44936) 2024-05-28T06:12:34.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.970+0000 7f321ce00640 1 -- 172.21.15.122:0/3232042426 learned_addr learned my addr 172.21.15.122:0/3232042426 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:34.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.970+0000 7f3217e00640 1 --2- 172.21.15.122:0/3232042426 >> v2:172.21.15.122:3300/0 conn(0x7f32180b58d0 0x7f32180b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:34.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.970+0000 7f3217e00640 1 -- 172.21.15.122:0/3232042426 >> v1:172.21.15.153:6789/0 conn(0x7f32180ce4f0 legacy=0x7f32180ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:34.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.970+0000 7f3217e00640 1 -- 172.21.15.122:0/3232042426 >> v1:172.21.15.122:6789/0 conn(0x7f321815e730 legacy=0x7f321815eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:34.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.970+0000 7f3217400640 1 -- 172.21.15.122:0/3232042426 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1715856979 0 0) 0x7f32180b61f0 con 0x7f321815e730 2024-05-28T06:12:34.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.970+0000 7f3217e00640 1 -- 172.21.15.122:0/3232042426 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f321815df30 con 0x7f32180b58d0 2024-05-28T06:12:34.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.974+0000 7f3217e00640 1 --2- 172.21.15.122:0/3232042426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32180b58d0 0x7f32180b5cb0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f32080097c0 tx=0x7f320801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e220a2fe122873 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:34.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.974+0000 7f3217400640 1 -- 172.21.15.122:0/3232042426 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32080b0070 con 0x7f32180b58d0 2024-05-28T06:12:34.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.974+0000 7f3217400640 1 -- 172.21.15.122:0/3232042426 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32080ab600 con 0x7f32180b58d0 2024-05-28T06:12:34.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.974+0000 7f3217400640 1 -- 172.21.15.122:0/3232042426 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32080ab9d0 con 0x7f32180b58d0 2024-05-28T06:12:34.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.974+0000 7f321ee00640 1 -- 172.21.15.122:0/3232042426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32180b58d0 msgr2=0x7f32180b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:34.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.974+0000 7f321ee00640 1 --2- 172.21.15.122:0/3232042426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32180b58d0 0x7f32180b5cb0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f32080097c0 tx=0x7f320801c460 comp rx=0 tx=0).stop 2024-05-28T06:12:34.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.974+0000 7f321ee00640 1 -- 172.21.15.122:0/3232042426 shutdown_connections 2024-05-28T06:12:34.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.974+0000 7f321ee00640 1 --2- 172.21.15.122:0/3232042426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32180b58d0 0x7f32180b5cb0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:34.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.974+0000 7f321ee00640 1 -- 172.21.15.122:0/3232042426 >> 172.21.15.122:0/3232042426 conn(0x7f321806bd90 msgr2=0x7f321806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:34.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.974+0000 7f321ee00640 1 -- 172.21.15.122:0/3232042426 shutdown_connections 2024-05-28T06:12:34.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.974+0000 7f321ee00640 1 -- 172.21.15.122:0/3232042426 wait complete. 2024-05-28T06:12:34.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f321ee00640 1 Processor -- start 2024-05-28T06:12:34.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f321ee00640 1 -- start start 2024-05-28T06:12:34.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f321ee00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32180b58d0 0x7f321814a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:34.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f321ee00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32180ce4f0 0x7f32180b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:34.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f321ee00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f321815e730 0x7f3218147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:34.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f321ee00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f321816a3e0 con 0x7f32180ce4f0 2024-05-28T06:12:34.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f321ee00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f321816a260 con 0x7f32180b58d0 2024-05-28T06:12:34.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f321ee00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f321816a560 con 0x7f321815e730 2024-05-28T06:12:34.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f320f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32180ce4f0 0x7f32180b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:34.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f320f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32180ce4f0 0x7f32180b5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38000/0 (socket says 172.21.15.122:38000) 2024-05-28T06:12:34.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f320f400640 1 -- 172.21.15.122:0/409727777 learned_addr learned my addr 172.21.15.122:0/409727777 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:34.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f3217e00640 1 --2- 172.21.15.122:0/409727777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32180b58d0 0x7f321814a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:34.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f321ce00640 1 --2- 172.21.15.122:0/409727777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f321815e730 0x7f3218147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:34.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f320f400640 1 -- 172.21.15.122:0/409727777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f321815e730 msgr2=0x7f3218147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:34.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f320f400640 1 --2- 172.21.15.122:0/409727777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f321815e730 0x7f3218147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:34.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f320f400640 1 -- 172.21.15.122:0/409727777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32180b58d0 msgr2=0x7f321814a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:34.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f320f400640 1 --2- 172.21.15.122:0/409727777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32180b58d0 0x7f321814a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:34.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f320f400640 1 -- 172.21.15.122:0/409727777 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3218147660 con 0x7f32180ce4f0 2024-05-28T06:12:34.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f3217e00640 1 --2- 172.21.15.122:0/409727777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32180b58d0 0x7f321814a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:12:34.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f320f400640 1 --2- 172.21.15.122:0/409727777 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32180ce4f0 0x7f32180b5260 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f320000c450 tx=0x7f320000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:34.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f3214c00640 1 -- 172.21.15.122:0/409727777 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3200012830 con 0x7f32180ce4f0 2024-05-28T06:12:34.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f3214c00640 1 -- 172.21.15.122:0/409727777 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3200017070 con 0x7f32180ce4f0 2024-05-28T06:12:34.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f3214c00640 1 -- 172.21.15.122:0/409727777 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3200012c30 con 0x7f32180ce4f0 2024-05-28T06:12:34.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f321ee00640 1 -- 172.21.15.122:0/409727777 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32180b0540 con 0x7f32180ce4f0 2024-05-28T06:12:34.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.978+0000 7f321ee00640 1 -- 172.21.15.122:0/409727777 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32180b0b00 con 0x7f32180ce4f0 2024-05-28T06:12:34.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.982+0000 7f321ee00640 1 -- 172.21.15.122:0/409727777 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3218068c40 con 0x7f32180ce4f0 2024-05-28T06:12:34.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.982+0000 7f3214c00640 1 -- 172.21.15.122:0/409727777 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f320001c460 con 0x7f32180ce4f0 2024-05-28T06:12:34.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.982+0000 7f3214c00640 1 --2- 172.21.15.122:0/409727777 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f31f4068bf0 0x7f31f406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:34.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.982+0000 7f3214c00640 1 -- 172.21.15.122:0/409727777 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f32000878f0 con 0x7f32180ce4f0 2024-05-28T06:12:34.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.982+0000 7f3217e00640 1 --2- 172.21.15.122:0/409727777 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f31f4068bf0 0x7f31f406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:34.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.982+0000 7f3217e00640 1 --2- 172.21.15.122:0/409727777 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f31f4068bf0 0x7f31f406b0b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f32080ad000 tx=0x7f32080a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:34.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:34.986+0000 7f3214c00640 1 -- 172.21.15.122:0/409727777 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3200057000 con 0x7f32180ce4f0 2024-05-28T06:12:35.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.178+0000 7f321ee00640 1 -- 172.21.15.122:0/409727777 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32180b1fd0 con 0x7f32180ce4f0 2024-05-28T06:12:35.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.178+0000 7f3214c00640 1 -- 172.21.15.122:0/409727777 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5190 (secure 0 0 0) 0x7f3200056900 con 0x7f32180ce4f0 2024-05-28T06:12:35.177 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:35.177 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/726421131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":726421131},{"type":"v1","addr":"172.21.15.153:6834","nonce":726421131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5498,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4109795391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4109795391},{"type":"v1","addr":"172.21.15.153:6835","nonce":4109795391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/3019937124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":3019937124},{"type":"v1","addr":"172.21.15.122:6835","nonce":3019937124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-28T06:12:31.161573+0000","modified":"2024-05-28T06:12:34.187846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6300":{"gid":6300,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/3289678231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3289678231},{"type":"v1","addr":"172.21.15.122:6837","nonce":3289678231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6300,"qdb_cluster":[6300]},"id":4}]} 2024-05-28T06:12:35.177 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 37 2024-05-28T06:12:35.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.178+0000 7f321ee00640 1 -- 172.21.15.122:0/409727777 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f31f4068bf0 msgr2=0x7f31f406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:35.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.178+0000 7f321ee00640 1 --2- 172.21.15.122:0/409727777 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f31f4068bf0 0x7f31f406b0b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f32080ad000 tx=0x7f32080a6000 comp rx=0 tx=0).stop 2024-05-28T06:12:35.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.178+0000 7f321ee00640 1 -- 172.21.15.122:0/409727777 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32180ce4f0 msgr2=0x7f32180b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:35.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.178+0000 7f321ee00640 1 --2- 172.21.15.122:0/409727777 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32180ce4f0 0x7f32180b5260 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f320000c450 tx=0x7f320000c910 comp rx=0 tx=0).stop 2024-05-28T06:12:35.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.178+0000 7f321ee00640 1 -- 172.21.15.122:0/409727777 shutdown_connections 2024-05-28T06:12:35.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.178+0000 7f321ee00640 1 --2- 172.21.15.122:0/409727777 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f31f4068bf0 0x7f31f406b0b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:35.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.178+0000 7f321ee00640 1 --2- 172.21.15.122:0/409727777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f321815e730 0x7f3218147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:35.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.178+0000 7f321ee00640 1 --2- 172.21.15.122:0/409727777 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32180ce4f0 0x7f32180b5260 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:35.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.178+0000 7f321ee00640 1 --2- 172.21.15.122:0/409727777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32180b58d0 0x7f321814a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:35.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.178+0000 7f321ee00640 1 -- 172.21.15.122:0/409727777 >> 172.21.15.122:0/409727777 conn(0x7f321806bd90 msgr2=0x7f32181413c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:35.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.178+0000 7f321ee00640 1 -- 172.21.15.122:0/409727777 shutdown_connections 2024-05-28T06:12:35.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.178+0000 7f321ee00640 1 -- 172.21.15.122:0/409727777 wait complete. 2024-05-28T06:12:35.199 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:12:35.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.334+0000 7fa24b600640 1 Processor -- start 2024-05-28T06:12:35.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.334+0000 7fa24b600640 1 -- start start 2024-05-28T06:12:35.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.338+0000 7fa24b600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2440b35f0 0x7fa2440b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:35.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.338+0000 7fa24b600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa244072fb0 0x7fa244073440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:35.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.338+0000 7fa24b600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2441464a0 con 0x7fa2441460c0 2024-05-28T06:12:35.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.338+0000 7fa24b600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fa2440b3f90 con 0x7fa244072fb0 2024-05-28T06:12:35.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.338+0000 7fa24b600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa24415cbf0 con 0x7fa2440b35f0 2024-05-28T06:12:35.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.338+0000 7fa249600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa244072fb0 0x7fa244073440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:35.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.338+0000 7fa249600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa244072fb0 0x7fa244073440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38016/0 (socket says 172.21.15.122:38016) 2024-05-28T06:12:35.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.338+0000 7fa249600640 1 -- 172.21.15.122:0/3487802503 learned_addr learned my addr 172.21.15.122:0/3487802503 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:35.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.338+0000 7fa243e00640 1 --2- 172.21.15.122:0/3487802503 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2440b35f0 0x7fa2440b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:35.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.338+0000 7fa249600640 1 -- 172.21.15.122:0/3487802503 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2440b35f0 msgr2=0x7fa2440b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:35.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.338+0000 7fa249600640 1 --2- 172.21.15.122:0/3487802503 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2440b35f0 0x7fa2440b3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:35.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.338+0000 7fa249600640 1 -- 172.21.15.122:0/3487802503 >> v1:172.21.15.153:6789/0 conn(0x7fa2441460c0 legacy=0x7fa2440ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:35.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.338+0000 7fa249600640 1 -- 172.21.15.122:0/3487802503 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2440ce930 con 0x7fa244072fb0 2024-05-28T06:12:35.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.342+0000 7fa249600640 1 --2- 172.21.15.122:0/3487802503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa244072fb0 0x7fa244073440 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009e50 tx=0x7fa23c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a66f1f34f91e79f server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:35.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.342+0000 7fa243400640 1 -- 172.21.15.122:0/3487802503 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c0a57f0 con 0x7fa244072fb0 2024-05-28T06:12:35.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.342+0000 7fa243400640 1 -- 172.21.15.122:0/3487802503 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa23c0a5990 con 0x7fa244072fb0 2024-05-28T06:12:35.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.342+0000 7fa243400640 1 -- 172.21.15.122:0/3487802503 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c0a5d60 con 0x7fa244072fb0 2024-05-28T06:12:35.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.342+0000 7fa24b600640 1 -- 172.21.15.122:0/3487802503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa244072fb0 msgr2=0x7fa244073440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:35.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.342+0000 7fa24b600640 1 --2- 172.21.15.122:0/3487802503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa244072fb0 0x7fa244073440 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009e50 tx=0x7fa23c01ca30 comp rx=0 tx=0).stop 2024-05-28T06:12:35.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.342+0000 7fa24b600640 1 -- 172.21.15.122:0/3487802503 shutdown_connections 2024-05-28T06:12:35.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.342+0000 7fa24b600640 1 --2- 172.21.15.122:0/3487802503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa244072fb0 0x7fa244073440 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:35.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.342+0000 7fa24b600640 1 --2- 172.21.15.122:0/3487802503 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2440b35f0 0x7fa2440b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:35.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.342+0000 7fa24b600640 1 -- 172.21.15.122:0/3487802503 >> 172.21.15.122:0/3487802503 conn(0x7fa2440b6c10 msgr2=0x7fa2440b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:35.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.342+0000 7fa24b600640 1 -- 172.21.15.122:0/3487802503 shutdown_connections 2024-05-28T06:12:35.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.342+0000 7fa24b600640 1 -- 172.21.15.122:0/3487802503 wait complete. 2024-05-28T06:12:35.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.342+0000 7fa24b600640 1 Processor -- start 2024-05-28T06:12:35.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.342+0000 7fa24b600640 1 -- start start 2024-05-28T06:12:35.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.346+0000 7fa24b600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa244072fb0 0x7fa244156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:35.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.346+0000 7fa24b600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2440b35f0 0x7fa244157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:35.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.346+0000 7fa24b600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2441460c0 0x7fa24415b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:35.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.346+0000 7fa24b600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa2440d0b80 con 0x7fa244072fb0 2024-05-28T06:12:35.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.346+0000 7fa24b600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa2440d08a0 con 0x7fa2440b35f0 2024-05-28T06:12:35.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.346+0000 7fa24b600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa2440ceec0 con 0x7fa2441460c0 2024-05-28T06:12:35.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.346+0000 7fa248c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa244072fb0 0x7fa244156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:35.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.346+0000 7fa248c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa244072fb0 0x7fa244156bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38022/0 (socket says 172.21.15.122:38022) 2024-05-28T06:12:35.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.346+0000 7fa248c00640 1 -- 172.21.15.122:0/930264981 learned_addr learned my addr 172.21.15.122:0/930264981 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:35.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.346+0000 7fa243e00640 1 --2- 172.21.15.122:0/930264981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2440b35f0 0x7fa244157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:35.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.346+0000 7fa249600640 1 --2- 172.21.15.122:0/930264981 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2441460c0 0x7fa24415b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:35.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.346+0000 7fa248c00640 1 -- 172.21.15.122:0/930264981 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2441460c0 msgr2=0x7fa24415b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:35.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.346+0000 7fa248c00640 1 --2- 172.21.15.122:0/930264981 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2441460c0 0x7fa24415b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:35.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.346+0000 7fa248c00640 1 -- 172.21.15.122:0/930264981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2440b35f0 msgr2=0x7fa244157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:35.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.346+0000 7fa248c00640 1 --2- 172.21.15.122:0/930264981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2440b35f0 0x7fa244157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:35.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.346+0000 7fa248c00640 1 -- 172.21.15.122:0/930264981 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2441427c0 con 0x7fa244072fb0 2024-05-28T06:12:35.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.346+0000 7fa248c00640 1 --2- 172.21.15.122:0/930264981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa244072fb0 0x7fa244156bd0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00c3a0 tx=0x7fa22c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:35.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.346+0000 7fa240c00640 1 -- 172.21.15.122:0/930264981 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22c0052d0 con 0x7fa244072fb0 2024-05-28T06:12:35.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.346+0000 7fa240c00640 1 -- 172.21.15.122:0/930264981 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa22c005470 con 0x7fa244072fb0 2024-05-28T06:12:35.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.346+0000 7fa240c00640 1 -- 172.21.15.122:0/930264981 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22c007260 con 0x7fa244072fb0 2024-05-28T06:12:35.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.346+0000 7fa24b600640 1 -- 172.21.15.122:0/930264981 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa244142aa0 con 0x7fa244072fb0 2024-05-28T06:12:35.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.346+0000 7fa24b600640 1 -- 172.21.15.122:0/930264981 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa244143060 con 0x7fa244072fb0 2024-05-28T06:12:35.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.346+0000 7fa24b600640 1 -- 172.21.15.122:0/930264981 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa244068c40 con 0x7fa244072fb0 2024-05-28T06:12:35.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.350+0000 7fa240c00640 1 -- 172.21.15.122:0/930264981 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fa22c007400 con 0x7fa244072fb0 2024-05-28T06:12:35.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.350+0000 7fa240c00640 1 --2- 172.21.15.122:0/930264981 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa220068bf0 0x7fa22006b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:35.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.350+0000 7fa240c00640 1 -- 172.21.15.122:0/930264981 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7fa22c086f60 con 0x7fa244072fb0 2024-05-28T06:12:35.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.350+0000 7fa243e00640 1 --2- 172.21.15.122:0/930264981 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa220068bf0 0x7fa22006b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:35.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.350+0000 7fa243e00640 1 --2- 172.21.15.122:0/930264981 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa220068bf0 0x7fa22006b0b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa244075350 tx=0x7fa234009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:35.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.354+0000 7fa240c00640 1 -- 172.21.15.122:0/930264981 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa2441464a0 con 0x7fa244072fb0 2024-05-28T06:12:35.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.510+0000 7fa24b600640 1 -- 172.21.15.122:0/930264981 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa244075380 con 0x7fa244072fb0 2024-05-28T06:12:35.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.510+0000 7fa240c00640 1 -- 172.21.15.122:0/930264981 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+16708 (secure 0 0 0) 0x7fa22c056020 con 0x7fa244072fb0 2024-05-28T06:12:35.511 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:35.512 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":62,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:12:32.775809+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:12:28.875891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-28T06:12:30.137302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:12:35.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.514+0000 7fa24b600640 1 -- 172.21.15.122:0/930264981 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa220068bf0 msgr2=0x7fa22006b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:35.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.514+0000 7fa24b600640 1 --2- 172.21.15.122:0/930264981 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa220068bf0 0x7fa22006b0b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa244075350 tx=0x7fa234009190 comp rx=0 tx=0).stop 2024-05-28T06:12:35.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.514+0000 7fa24b600640 1 -- 172.21.15.122:0/930264981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa244072fb0 msgr2=0x7fa244156bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:35.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.514+0000 7fa24b600640 1 --2- 172.21.15.122:0/930264981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa244072fb0 0x7fa244156bd0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00c3a0 tx=0x7fa22c00c860 comp rx=0 tx=0).stop 2024-05-28T06:12:35.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.514+0000 7fa24b600640 1 -- 172.21.15.122:0/930264981 shutdown_connections 2024-05-28T06:12:35.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.514+0000 7fa24b600640 1 --2- 172.21.15.122:0/930264981 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa220068bf0 0x7fa22006b0b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:35.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.514+0000 7fa24b600640 1 --2- 172.21.15.122:0/930264981 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa2441460c0 0x7fa24415b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:35.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.514+0000 7fa24b600640 1 --2- 172.21.15.122:0/930264981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2440b35f0 0x7fa244157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:35.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.514+0000 7fa24b600640 1 --2- 172.21.15.122:0/930264981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa244072fb0 0x7fa244156bd0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:35.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.514+0000 7fa24b600640 1 -- 172.21.15.122:0/930264981 >> 172.21.15.122:0/930264981 conn(0x7fa2440b6c10 msgr2=0x7fa2441450a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:35.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.514+0000 7fa24b600640 1 -- 172.21.15.122:0/930264981 shutdown_connections 2024-05-28T06:12:35.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.514+0000 7fa24b600640 1 -- 172.21.15.122:0/930264981 wait complete. 2024-05-28T06:12:35.535 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-28T06:12:35.535 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-28T06:12:35.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.674+0000 7fad81200640 1 Processor -- start 2024-05-28T06:12:35.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.674+0000 7fad81200640 1 -- start start 2024-05-28T06:12:35.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.674+0000 7fad81200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fad7c0b58d0 0x7fad7c0b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:35.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.674+0000 7fad81200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad7c0b61f0 con 0x7fad7c15e730 2024-05-28T06:12:35.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.674+0000 7fad81200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad7c15d970 con 0x7fad7c0ce4f0 2024-05-28T06:12:35.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.674+0000 7fad81200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fad7c15dc50 con 0x7fad7c0b58d0 2024-05-28T06:12:35.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.674+0000 7fad7a800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fad7c15e730 0x7fad7c15eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:59732/0 (socket says 172.21.15.122:59732) 2024-05-28T06:12:35.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.674+0000 7fad7a800640 1 -- 172.21.15.122:0/3940048951 learned_addr learned my addr 172.21.15.122:0/3940048951 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:35.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.674+0000 7fad79e00640 1 --2- 172.21.15.122:0/3940048951 >> v2:172.21.15.153:3300/0 conn(0x7fad7c0b58d0 0x7fad7c0b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:35.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.674+0000 7fad79400640 1 -- 172.21.15.122:0/3940048951 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2423090863 0 0) 0x7fad7c0b61f0 con 0x7fad7c15e730 2024-05-28T06:12:35.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.674+0000 7fad79400640 1 -- 172.21.15.122:0/3940048951 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad60003530 con 0x7fad7c15e730 2024-05-28T06:12:35.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.674+0000 7fad79400640 1 -- 172.21.15.122:0/3940048951 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2894637046 0 0) 0x7fad60003530 con 0x7fad7c15e730 2024-05-28T06:12:35.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.674+0000 7fad79e00640 1 -- 172.21.15.122:0/3940048951 >> v1:172.21.15.153:6789/0 conn(0x7fad7c0ce4f0 legacy=0x7fad7c0ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:35.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.674+0000 7fad79e00640 1 -- 172.21.15.122:0/3940048951 >> v1:172.21.15.122:6789/0 conn(0x7fad7c15e730 legacy=0x7fad7c15eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:35.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.674+0000 7fad79e00640 1 -- 172.21.15.122:0/3940048951 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7c15df30 con 0x7fad7c0b58d0 2024-05-28T06:12:35.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.678+0000 7fad79e00640 1 --2- 172.21.15.122:0/3940048951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad7c0b58d0 0x7fad7c0b5cb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0097c0 tx=0x7fad6c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b95eae340885c25d server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:35.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.678+0000 7fad79400640 1 -- 172.21.15.122:0/3940048951 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c0b0070 con 0x7fad7c0b58d0 2024-05-28T06:12:35.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.678+0000 7fad79400640 1 -- 172.21.15.122:0/3940048951 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad6c0ab400 con 0x7fad7c0b58d0 2024-05-28T06:12:35.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.678+0000 7fad79400640 1 -- 172.21.15.122:0/3940048951 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c0a4e60 con 0x7fad7c0b58d0 2024-05-28T06:12:35.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.678+0000 7fad81200640 1 -- 172.21.15.122:0/3940048951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad7c0b58d0 msgr2=0x7fad7c0b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:35.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.678+0000 7fad81200640 1 --2- 172.21.15.122:0/3940048951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad7c0b58d0 0x7fad7c0b5cb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0097c0 tx=0x7fad6c01c3c0 comp rx=0 tx=0).stop 2024-05-28T06:12:35.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.678+0000 7fad81200640 1 -- 172.21.15.122:0/3940048951 shutdown_connections 2024-05-28T06:12:35.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.678+0000 7fad81200640 1 --2- 172.21.15.122:0/3940048951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad7c0b58d0 0x7fad7c0b5cb0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:35.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.678+0000 7fad81200640 1 -- 172.21.15.122:0/3940048951 >> 172.21.15.122:0/3940048951 conn(0x7fad7c06bd90 msgr2=0x7fad7c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:35.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.678+0000 7fad81200640 1 -- 172.21.15.122:0/3940048951 shutdown_connections 2024-05-28T06:12:35.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.678+0000 7fad81200640 1 -- 172.21.15.122:0/3940048951 wait complete. 2024-05-28T06:12:35.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad81200640 1 Processor -- start 2024-05-28T06:12:35.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad81200640 1 -- start start 2024-05-28T06:12:35.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad81200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad7c0b58d0 0x7fad7c13ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:35.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad81200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fad7c0ce4f0 0x7fad7c0ae730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:35.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad81200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad7c15e730 0x7fad7c158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:35.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad81200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fad7c16a3e0 con 0x7fad7c15e730 2024-05-28T06:12:35.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad81200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fad7c16a260 con 0x7fad7c0b58d0 2024-05-28T06:12:35.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad81200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fad7c16a560 con 0x7fad7c0ce4f0 2024-05-28T06:12:35.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad7a800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad7c15e730 0x7fad7c158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:35.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad7a800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad7c15e730 0x7fad7c158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37928/0 (socket says 172.21.15.122:37928) 2024-05-28T06:12:35.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad7a800640 1 -- 172.21.15.122:0/3903570625 learned_addr learned my addr 172.21.15.122:0/3903570625 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:35.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad79e00640 1 --2- 172.21.15.122:0/3903570625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad7c0b58d0 0x7fad7c13ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:35.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad71400640 1 --2- 172.21.15.122:0/3903570625 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fad7c0ce4f0 0x7fad7c0ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:35.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad7a800640 1 -- 172.21.15.122:0/3903570625 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fad7c0ce4f0 msgr2=0x7fad7c0ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:35.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad7a800640 1 --2- 172.21.15.122:0/3903570625 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fad7c0ce4f0 0x7fad7c0ae730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:35.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad7a800640 1 -- 172.21.15.122:0/3903570625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad7c0b58d0 msgr2=0x7fad7c13ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:35.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad7a800640 1 --2- 172.21.15.122:0/3903570625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad7c0b58d0 0x7fad7c13ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:35.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad7a800640 1 -- 172.21.15.122:0/3903570625 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7c0b04b0 con 0x7fad7c15e730 2024-05-28T06:12:35.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad79e00640 1 --2- 172.21.15.122:0/3903570625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad7c0b58d0 0x7fad7c13ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:12:35.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad7a800640 1 --2- 172.21.15.122:0/3903570625 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad7c15e730 0x7fad7c158ff0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fad74001fc0 tx=0x7fad7400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:35.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad72a00640 1 -- 172.21.15.122:0/3903570625 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad74017070 con 0x7fad7c15e730 2024-05-28T06:12:35.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad72a00640 1 -- 172.21.15.122:0/3903570625 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad74012400 con 0x7fad7c15e730 2024-05-28T06:12:35.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad72a00640 1 -- 172.21.15.122:0/3903570625 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad74012870 con 0x7fad7c15e730 2024-05-28T06:12:35.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad81200640 1 -- 172.21.15.122:0/3903570625 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad7c0b0790 con 0x7fad7c15e730 2024-05-28T06:12:35.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad81200640 1 -- 172.21.15.122:0/3903570625 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad7c0b0d50 con 0x7fad7c15e730 2024-05-28T06:12:35.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.682+0000 7fad81200640 1 -- 172.21.15.122:0/3903570625 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad7c068c40 con 0x7fad7c15e730 2024-05-28T06:12:35.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.686+0000 7fad72a00640 1 -- 172.21.15.122:0/3903570625 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fad7401a070 con 0x7fad7c15e730 2024-05-28T06:12:35.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.686+0000 7fad72a00640 1 --2- 172.21.15.122:0/3903570625 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fad58068c20 0x7fad5806b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:35.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.686+0000 7fad72a00640 1 -- 172.21.15.122:0/3903570625 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7fad74087b80 con 0x7fad7c15e730 2024-05-28T06:12:35.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.686+0000 7fad79e00640 1 --2- 172.21.15.122:0/3903570625 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fad58068c20 0x7fad5806b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:35.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.686+0000 7fad79e00640 1 --2- 172.21.15.122:0/3903570625 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fad58068c20 0x7fad5806b0e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0ad000 tx=0x7fad6c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:35.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.690+0000 7fad72a00640 1 -- 172.21.15.122:0/3903570625 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fad74057290 con 0x7fad7c15e730 2024-05-28T06:12:35.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.850+0000 7fad81200640 1 -- 172.21.15.122:0/3903570625 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fad7c13e370 con 0x7fad58068c20 2024-05-28T06:12:35.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.854+0000 7fad72a00640 1 -- 172.21.15.122:0/3903570625 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251885 (secure 0 0 0) 0x7fad7c13e370 con 0x7fad58068c20 2024-05-28T06:12:35.857 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:35.860 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-05-28T06:12:35.861 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.858+0000 7fad81200640 1 -- 172.21.15.122:0/3903570625 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fad58068c20 msgr2=0x7fad5806b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:35.861 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.858+0000 7fad81200640 1 --2- 172.21.15.122:0/3903570625 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fad58068c20 0x7fad5806b0e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0ad000 tx=0x7fad6c0a6000 comp rx=0 tx=0).stop 2024-05-28T06:12:35.861 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.858+0000 7fad81200640 1 -- 172.21.15.122:0/3903570625 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad7c15e730 msgr2=0x7fad7c158ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:35.861 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.858+0000 7fad81200640 1 --2- 172.21.15.122:0/3903570625 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad7c15e730 0x7fad7c158ff0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fad74001fc0 tx=0x7fad7400a430 comp rx=0 tx=0).stop 2024-05-28T06:12:35.861 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.858+0000 7fad81200640 1 -- 172.21.15.122:0/3903570625 shutdown_connections 2024-05-28T06:12:35.861 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.858+0000 7fad81200640 1 --2- 172.21.15.122:0/3903570625 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fad58068c20 0x7fad5806b0e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:35.861 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.858+0000 7fad81200640 1 --2- 172.21.15.122:0/3903570625 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad7c15e730 0x7fad7c158ff0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:35.861 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.858+0000 7fad81200640 1 --2- 172.21.15.122:0/3903570625 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fad7c0ce4f0 0x7fad7c0ae730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:35.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.858+0000 7fad81200640 1 --2- 172.21.15.122:0/3903570625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad7c0b58d0 0x7fad7c13ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:35.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.858+0000 7fad81200640 1 -- 172.21.15.122:0/3903570625 >> 172.21.15.122:0/3903570625 conn(0x7fad7c06bd90 msgr2=0x7fad7c06c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:35.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.858+0000 7fad81200640 1 -- 172.21.15.122:0/3903570625 shutdown_connections 2024-05-28T06:12:35.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:35.858+0000 7fad81200640 1 -- 172.21.15.122:0/3903570625 wait complete. 2024-05-28T06:12:35.878 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":264,"stamp":"2024-05-28T06:12:35.345478+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":370236,"kb_used_data":6896,"kb_used_omap":12,"kb_used_meta":363187,"kb_avail":754604484,"statfs":{"total":773094113280,"available":772714991616,"internally_reserved":0,"allocated":7061504,"data_stored":3632491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":371904049},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.580824"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.801795+0000","last_change":"2024-05-28T06:12:31.797507+0000","last_active":"2024-05-28T06:12:31.801795+0000","last_peered":"2024-05-28T06:12:31.801795+0000","last_clean":"2024-05-28T06:12:31.801795+0000","last_became_active":"2024-05-28T06:12:31.793751+0000","last_became_peered":"2024-05-28T06:12:31.793751+0000","last_unstale":"2024-05-28T06:12:31.801795+0000","last_undegraded":"2024-05-28T06:12:31.801795+0000","last_fullsized":"2024-05-28T06:12:31.801795+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:05:08.558778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.805183+0000","last_change":"2024-05-28T06:12:31.799024+0000","last_active":"2024-05-28T06:12:31.805183+0000","last_peered":"2024-05-28T06:12:31.805183+0000","last_clean":"2024-05-28T06:12:31.805183+0000","last_became_active":"2024-05-28T06:12:31.798788+0000","last_became_peered":"2024-05-28T06:12:31.798788+0000","last_unstale":"2024-05-28T06:12:31.805183+0000","last_undegraded":"2024-05-28T06:12:31.805183+0000","last_fullsized":"2024-05-28T06:12:31.805183+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T18:05:44.809790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.810381+0000","last_change":"2024-05-28T06:12:31.802734+0000","last_active":"2024-05-28T06:12:31.810381+0000","last_peered":"2024-05-28T06:12:31.810381+0000","last_clean":"2024-05-28T06:12:31.810381+0000","last_became_active":"2024-05-28T06:12:31.802019+0000","last_became_peered":"2024-05-28T06:12:31.802019+0000","last_unstale":"2024-05-28T06:12:31.810381+0000","last_undegraded":"2024-05-28T06:12:31.810381+0000","last_fullsized":"2024-05-28T06:12:31.810381+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:02:32.900541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.809027+0000","last_change":"2024-05-28T06:12:31.802404+0000","last_active":"2024-05-28T06:12:31.809027+0000","last_peered":"2024-05-28T06:12:31.809027+0000","last_clean":"2024-05-28T06:12:31.809027+0000","last_became_active":"2024-05-28T06:12:31.801804+0000","last_became_peered":"2024-05-28T06:12:31.801804+0000","last_unstale":"2024-05-28T06:12:31.809027+0000","last_undegraded":"2024-05-28T06:12:31.809027+0000","last_fullsized":"2024-05-28T06:12:31.809027+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:27:01.826955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.801911+0000","last_change":"2024-05-28T06:12:31.798616+0000","last_active":"2024-05-28T06:12:31.801911+0000","last_peered":"2024-05-28T06:12:31.801911+0000","last_clean":"2024-05-28T06:12:31.801911+0000","last_became_active":"2024-05-28T06:12:31.798238+0000","last_became_peered":"2024-05-28T06:12:31.798238+0000","last_unstale":"2024-05-28T06:12:31.801911+0000","last_undegraded":"2024-05-28T06:12:31.801911+0000","last_fullsized":"2024-05-28T06:12:31.801911+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:10:31.403540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.799458+0000","last_change":"2024-05-28T06:12:31.791032+0000","last_active":"2024-05-28T06:12:31.799458+0000","last_peered":"2024-05-28T06:12:31.799458+0000","last_clean":"2024-05-28T06:12:31.799458+0000","last_became_active":"2024-05-28T06:12:31.790779+0000","last_became_peered":"2024-05-28T06:12:31.790779+0000","last_unstale":"2024-05-28T06:12:31.799458+0000","last_undegraded":"2024-05-28T06:12:31.799458+0000","last_fullsized":"2024-05-28T06:12:31.799458+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:54:31.487426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.793053+0000","last_change":"2024-05-28T06:12:31.786902+0000","last_active":"2024-05-28T06:12:31.793053+0000","last_peered":"2024-05-28T06:12:31.793053+0000","last_clean":"2024-05-28T06:12:31.793053+0000","last_became_active":"2024-05-28T06:12:31.786592+0000","last_became_peered":"2024-05-28T06:12:31.786592+0000","last_unstale":"2024-05-28T06:12:31.793053+0000","last_undegraded":"2024-05-28T06:12:31.793053+0000","last_fullsized":"2024-05-28T06:12:31.793053+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:37:56.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.791374+0000","last_change":"2024-05-28T06:12:31.788445+0000","last_active":"2024-05-28T06:12:31.791374+0000","last_peered":"2024-05-28T06:12:31.791374+0000","last_clean":"2024-05-28T06:12:31.791374+0000","last_became_active":"2024-05-28T06:12:31.788168+0000","last_became_peered":"2024-05-28T06:12:31.788168+0000","last_unstale":"2024-05-28T06:12:31.791374+0000","last_undegraded":"2024-05-28T06:12:31.791374+0000","last_fullsized":"2024-05-28T06:12:31.791374+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:54:23.878943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.786108+0000","last_change":"2024-05-28T06:12:31.783886+0000","last_active":"2024-05-28T06:12:31.786108+0000","last_peered":"2024-05-28T06:12:31.786108+0000","last_clean":"2024-05-28T06:12:31.786108+0000","last_became_active":"2024-05-28T06:12:31.783599+0000","last_became_peered":"2024-05-28T06:12:31.783599+0000","last_unstale":"2024-05-28T06:12:31.786108+0000","last_undegraded":"2024-05-28T06:12:31.786108+0000","last_fullsized":"2024-05-28T06:12:31.786108+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:21:01.169215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.800048+0000","last_change":"2024-05-28T06:12:31.797210+0000","last_active":"2024-05-28T06:12:31.800048+0000","last_peered":"2024-05-28T06:12:31.800048+0000","last_clean":"2024-05-28T06:12:31.800048+0000","last_became_active":"2024-05-28T06:12:31.793687+0000","last_became_peered":"2024-05-28T06:12:31.793687+0000","last_unstale":"2024-05-28T06:12:31.800048+0000","last_undegraded":"2024-05-28T06:12:31.800048+0000","last_fullsized":"2024-05-28T06:12:31.800048+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:11:30.709739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.796061+0000","last_change":"2024-05-28T06:12:31.789629+0000","last_active":"2024-05-28T06:12:31.796061+0000","last_peered":"2024-05-28T06:12:31.796061+0000","last_clean":"2024-05-28T06:12:31.796061+0000","last_became_active":"2024-05-28T06:12:31.789337+0000","last_became_peered":"2024-05-28T06:12:31.789337+0000","last_unstale":"2024-05-28T06:12:31.796061+0000","last_undegraded":"2024-05-28T06:12:31.796061+0000","last_fullsized":"2024-05-28T06:12:31.796061+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:17:06.598590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.797704+0000","last_change":"2024-05-28T06:12:31.796464+0000","last_active":"2024-05-28T06:12:31.797704+0000","last_peered":"2024-05-28T06:12:31.797704+0000","last_clean":"2024-05-28T06:12:31.797704+0000","last_became_active":"2024-05-28T06:12:31.796167+0000","last_became_peered":"2024-05-28T06:12:31.796167+0000","last_unstale":"2024-05-28T06:12:31.797704+0000","last_undegraded":"2024-05-28T06:12:31.797704+0000","last_fullsized":"2024-05-28T06:12:31.797704+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:44:33.675058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.805546+0000","last_change":"2024-05-28T06:12:31.799523+0000","last_active":"2024-05-28T06:12:31.805546+0000","last_peered":"2024-05-28T06:12:31.805546+0000","last_clean":"2024-05-28T06:12:31.805546+0000","last_became_active":"2024-05-28T06:12:31.799169+0000","last_became_peered":"2024-05-28T06:12:31.799169+0000","last_unstale":"2024-05-28T06:12:31.805546+0000","last_undegraded":"2024-05-28T06:12:31.805546+0000","last_fullsized":"2024-05-28T06:12:31.805546+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:06:24.203533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.793394+0000","last_change":"2024-05-28T06:12:31.790257+0000","last_active":"2024-05-28T06:12:31.793394+0000","last_peered":"2024-05-28T06:12:31.793394+0000","last_clean":"2024-05-28T06:12:31.793394+0000","last_became_active":"2024-05-28T06:12:31.789907+0000","last_became_peered":"2024-05-28T06:12:31.789907+0000","last_unstale":"2024-05-28T06:12:31.793394+0000","last_undegraded":"2024-05-28T06:12:31.793394+0000","last_fullsized":"2024-05-28T06:12:31.793394+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:31:15.983892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.793072+0000","last_change":"2024-05-28T06:12:31.788326+0000","last_active":"2024-05-28T06:12:31.793072+0000","last_peered":"2024-05-28T06:12:31.793072+0000","last_clean":"2024-05-28T06:12:31.793072+0000","last_became_active":"2024-05-28T06:12:31.788073+0000","last_became_peered":"2024-05-28T06:12:31.788073+0000","last_unstale":"2024-05-28T06:12:31.793072+0000","last_undegraded":"2024-05-28T06:12:31.793072+0000","last_fullsized":"2024-05-28T06:12:31.793072+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:02:32.900541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.805110+0000","last_change":"2024-05-28T06:12:31.802252+0000","last_active":"2024-05-28T06:12:31.805110+0000","last_peered":"2024-05-28T06:12:31.805110+0000","last_clean":"2024-05-28T06:12:31.805110+0000","last_became_active":"2024-05-28T06:12:31.800507+0000","last_became_peered":"2024-05-28T06:12:31.800507+0000","last_unstale":"2024-05-28T06:12:31.805110+0000","last_undegraded":"2024-05-28T06:12:31.805110+0000","last_fullsized":"2024-05-28T06:12:31.805110+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:33:08.387840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.804830+0000","last_change":"2024-05-28T06:12:31.798684+0000","last_active":"2024-05-28T06:12:31.804830+0000","last_peered":"2024-05-28T06:12:31.804830+0000","last_clean":"2024-05-28T06:12:31.804830+0000","last_became_active":"2024-05-28T06:12:31.798292+0000","last_became_peered":"2024-05-28T06:12:31.798292+0000","last_unstale":"2024-05-28T06:12:31.804830+0000","last_undegraded":"2024-05-28T06:12:31.804830+0000","last_fullsized":"2024-05-28T06:12:31.804830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:54:40.698120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.810020+0000","last_change":"2024-05-28T06:12:31.805307+0000","last_active":"2024-05-28T06:12:31.810020+0000","last_peered":"2024-05-28T06:12:31.810020+0000","last_clean":"2024-05-28T06:12:31.810020+0000","last_became_active":"2024-05-28T06:12:31.805031+0000","last_became_peered":"2024-05-28T06:12:31.805031+0000","last_unstale":"2024-05-28T06:12:31.810020+0000","last_undegraded":"2024-05-28T06:12:31.810020+0000","last_fullsized":"2024-05-28T06:12:31.810020+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:42:44.413357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.800657+0000","last_change":"2024-05-28T06:12:31.792875+0000","last_active":"2024-05-28T06:12:31.800657+0000","last_peered":"2024-05-28T06:12:31.800657+0000","last_clean":"2024-05-28T06:12:31.800657+0000","last_became_active":"2024-05-28T06:12:31.792620+0000","last_became_peered":"2024-05-28T06:12:31.792620+0000","last_unstale":"2024-05-28T06:12:31.800657+0000","last_undegraded":"2024-05-28T06:12:31.800657+0000","last_fullsized":"2024-05-28T06:12:31.800657+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:37:27.523059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.794523+0000","last_change":"2024-05-28T06:12:31.790299+0000","last_active":"2024-05-28T06:12:31.794523+0000","last_peered":"2024-05-28T06:12:31.794523+0000","last_clean":"2024-05-28T06:12:31.794523+0000","last_became_active":"2024-05-28T06:12:31.790044+0000","last_became_peered":"2024-05-28T06:12:31.790044+0000","last_unstale":"2024-05-28T06:12:31.794523+0000","last_undegraded":"2024-05-28T06:12:31.794523+0000","last_fullsized":"2024-05-28T06:12:31.794523+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:05:18.369078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.804777+0000","last_change":"2024-05-28T06:12:31.799285+0000","last_active":"2024-05-28T06:12:31.804777+0000","last_peered":"2024-05-28T06:12:31.804777+0000","last_clean":"2024-05-28T06:12:31.804777+0000","last_became_active":"2024-05-28T06:12:31.798652+0000","last_became_peered":"2024-05-28T06:12:31.798652+0000","last_unstale":"2024-05-28T06:12:31.804777+0000","last_undegraded":"2024-05-28T06:12:31.804777+0000","last_fullsized":"2024-05-28T06:12:31.804777+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:37:56.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.805298+0000","last_change":"2024-05-28T06:12:31.802895+0000","last_active":"2024-05-28T06:12:31.805298+0000","last_peered":"2024-05-28T06:12:31.805298+0000","last_clean":"2024-05-28T06:12:31.805298+0000","last_became_active":"2024-05-28T06:12:31.795520+0000","last_became_peered":"2024-05-28T06:12:31.795520+0000","last_unstale":"2024-05-28T06:12:31.805298+0000","last_undegraded":"2024-05-28T06:12:31.805298+0000","last_fullsized":"2024-05-28T06:12:31.805298+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:56:04.195855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.810250+0000","last_change":"2024-05-28T06:12:31.806502+0000","last_active":"2024-05-28T06:12:31.810250+0000","last_peered":"2024-05-28T06:12:31.810250+0000","last_clean":"2024-05-28T06:12:31.810250+0000","last_became_active":"2024-05-28T06:12:31.805993+0000","last_became_peered":"2024-05-28T06:12:31.805993+0000","last_unstale":"2024-05-28T06:12:31.810250+0000","last_undegraded":"2024-05-28T06:12:31.810250+0000","last_fullsized":"2024-05-28T06:12:31.810250+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:39:57.840865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.806293+0000","last_change":"2024-05-28T06:12:31.801483+0000","last_active":"2024-05-28T06:12:31.806293+0000","last_peered":"2024-05-28T06:12:31.806293+0000","last_clean":"2024-05-28T06:12:31.806293+0000","last_became_active":"2024-05-28T06:12:31.801026+0000","last_became_peered":"2024-05-28T06:12:31.801026+0000","last_unstale":"2024-05-28T06:12:31.806293+0000","last_undegraded":"2024-05-28T06:12:31.806293+0000","last_fullsized":"2024-05-28T06:12:31.806293+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:11:30.709739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.801817+0000","last_change":"2024-05-28T06:12:31.798043+0000","last_active":"2024-05-28T06:12:31.801817+0000","last_peered":"2024-05-28T06:12:31.801817+0000","last_clean":"2024-05-28T06:12:31.801817+0000","last_became_active":"2024-05-28T06:12:31.794016+0000","last_became_peered":"2024-05-28T06:12:31.794016+0000","last_unstale":"2024-05-28T06:12:31.801817+0000","last_undegraded":"2024-05-28T06:12:31.801817+0000","last_fullsized":"2024-05-28T06:12:31.801817+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:50:58.603324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.795018+0000","last_change":"2024-05-28T06:12:31.788822+0000","last_active":"2024-05-28T06:12:31.795018+0000","last_peered":"2024-05-28T06:12:31.795018+0000","last_clean":"2024-05-28T06:12:31.795018+0000","last_became_active":"2024-05-28T06:12:31.788550+0000","last_became_peered":"2024-05-28T06:12:31.788550+0000","last_unstale":"2024-05-28T06:12:31.795018+0000","last_undegraded":"2024-05-28T06:12:31.795018+0000","last_fullsized":"2024-05-28T06:12:31.795018+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:13:29.656977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.799830+0000","last_change":"2024-05-28T06:12:31.793103+0000","last_active":"2024-05-28T06:12:31.799830+0000","last_peered":"2024-05-28T06:12:31.799830+0000","last_clean":"2024-05-28T06:12:31.799830+0000","last_became_active":"2024-05-28T06:12:31.792595+0000","last_became_peered":"2024-05-28T06:12:31.792595+0000","last_unstale":"2024-05-28T06:12:31.799830+0000","last_undegraded":"2024-05-28T06:12:31.799830+0000","last_fullsized":"2024-05-28T06:12:31.799830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:42:44.413357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.804187+0000","last_change":"2024-05-28T06:12:31.800295+0000","last_active":"2024-05-28T06:12:31.804187+0000","last_peered":"2024-05-28T06:12:31.804187+0000","last_clean":"2024-05-28T06:12:31.804187+0000","last_became_active":"2024-05-28T06:12:31.800042+0000","last_became_peered":"2024-05-28T06:12:31.800042+0000","last_unstale":"2024-05-28T06:12:31.804187+0000","last_undegraded":"2024-05-28T06:12:31.804187+0000","last_fullsized":"2024-05-28T06:12:31.804187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:41:22.114684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.805403+0000","last_change":"2024-05-28T06:12:31.798980+0000","last_active":"2024-05-28T06:12:31.805403+0000","last_peered":"2024-05-28T06:12:31.805403+0000","last_clean":"2024-05-28T06:12:31.805403+0000","last_became_active":"2024-05-28T06:12:31.798695+0000","last_became_peered":"2024-05-28T06:12:31.798695+0000","last_unstale":"2024-05-28T06:12:31.805403+0000","last_undegraded":"2024-05-28T06:12:31.805403+0000","last_fullsized":"2024-05-28T06:12:31.805403+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:06:02.059732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.809949+0000","last_change":"2024-05-28T06:12:31.803916+0000","last_active":"2024-05-28T06:12:31.809949+0000","last_peered":"2024-05-28T06:12:31.809949+0000","last_clean":"2024-05-28T06:12:31.809949+0000","last_became_active":"2024-05-28T06:12:31.803396+0000","last_became_peered":"2024-05-28T06:12:31.803396+0000","last_unstale":"2024-05-28T06:12:31.809949+0000","last_undegraded":"2024-05-28T06:12:31.809949+0000","last_fullsized":"2024-05-28T06:12:31.809949+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:14:40.573174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.801956+0000","last_change":"2024-05-28T06:12:31.797444+0000","last_active":"2024-05-28T06:12:31.801956+0000","last_peered":"2024-05-28T06:12:31.801956+0000","last_clean":"2024-05-28T06:12:31.801956+0000","last_became_active":"2024-05-28T06:12:31.797170+0000","last_became_peered":"2024-05-28T06:12:31.797170+0000","last_unstale":"2024-05-28T06:12:31.801956+0000","last_undegraded":"2024-05-28T06:12:31.801956+0000","last_fullsized":"2024-05-28T06:12:31.801956+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:36:21.502162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.796636+0000","last_change":"2024-05-28T06:12:31.787961+0000","last_active":"2024-05-28T06:12:31.796636+0000","last_peered":"2024-05-28T06:12:31.796636+0000","last_clean":"2024-05-28T06:12:31.796636+0000","last_became_active":"2024-05-28T06:12:31.787700+0000","last_became_peered":"2024-05-28T06:12:31.787700+0000","last_unstale":"2024-05-28T06:12:31.796636+0000","last_undegraded":"2024-05-28T06:12:31.796636+0000","last_fullsized":"2024-05-28T06:12:31.796636+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:20:41.476613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.805234+0000","last_change":"2024-05-28T06:12:31.802935+0000","last_active":"2024-05-28T06:12:31.805234+0000","last_peered":"2024-05-28T06:12:31.805234+0000","last_clean":"2024-05-28T06:12:31.805234+0000","last_became_active":"2024-05-28T06:12:31.802678+0000","last_became_peered":"2024-05-28T06:12:31.802678+0000","last_unstale":"2024-05-28T06:12:31.805234+0000","last_undegraded":"2024-05-28T06:12:31.805234+0000","last_fullsized":"2024-05-28T06:12:31.805234+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:59:14.477995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.815132+0000","last_change":"2024-05-28T06:12:30.791032+0000","last_active":"2024-05-28T06:12:31.815132+0000","last_peered":"2024-05-28T06:12:31.815132+0000","last_clean":"2024-05-28T06:12:31.815132+0000","last_became_active":"2024-05-28T06:12:30.790720+0000","last_became_peered":"2024-05-28T06:12:30.790720+0000","last_unstale":"2024-05-28T06:12:31.815132+0000","last_undegraded":"2024-05-28T06:12:31.815132+0000","last_fullsized":"2024-05-28T06:12:31.815132+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:02:31.893460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.811935+0000","last_change":"2024-05-28T06:12:31.801501+0000","last_active":"2024-05-28T06:12:31.811935+0000","last_peered":"2024-05-28T06:12:31.811935+0000","last_clean":"2024-05-28T06:12:31.811935+0000","last_became_active":"2024-05-28T06:12:31.801239+0000","last_became_peered":"2024-05-28T06:12:31.801239+0000","last_unstale":"2024-05-28T06:12:31.811935+0000","last_undegraded":"2024-05-28T06:12:31.811935+0000","last_fullsized":"2024-05-28T06:12:31.811935+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:35:12.821821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.813419+0000","last_change":"2024-05-28T06:12:30.799690+0000","last_active":"2024-05-28T06:12:31.813419+0000","last_peered":"2024-05-28T06:12:31.813419+0000","last_clean":"2024-05-28T06:12:31.813419+0000","last_became_active":"2024-05-28T06:12:30.799345+0000","last_became_peered":"2024-05-28T06:12:30.799345+0000","last_unstale":"2024-05-28T06:12:31.813419+0000","last_undegraded":"2024-05-28T06:12:31.813419+0000","last_fullsized":"2024-05-28T06:12:31.813419+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:53:56.132162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.796323+0000","last_change":"2024-05-28T06:12:31.787304+0000","last_active":"2024-05-28T06:12:31.796323+0000","last_peered":"2024-05-28T06:12:31.796323+0000","last_clean":"2024-05-28T06:12:31.796323+0000","last_became_active":"2024-05-28T06:12:31.786982+0000","last_became_peered":"2024-05-28T06:12:31.786982+0000","last_unstale":"2024-05-28T06:12:31.796323+0000","last_undegraded":"2024-05-28T06:12:31.796323+0000","last_fullsized":"2024-05-28T06:12:31.796323+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:14:40.573174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.814510+0000","last_change":"2024-05-28T06:12:30.784064+0000","last_active":"2024-05-28T06:12:31.814510+0000","last_peered":"2024-05-28T06:12:31.814510+0000","last_clean":"2024-05-28T06:12:31.814510+0000","last_became_active":"2024-05-28T06:12:30.783801+0000","last_became_peered":"2024-05-28T06:12:30.783801+0000","last_unstale":"2024-05-28T06:12:31.814510+0000","last_undegraded":"2024-05-28T06:12:31.814510+0000","last_fullsized":"2024-05-28T06:12:31.814510+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:21:00.162134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.803992+0000","last_change":"2024-05-28T06:12:31.799781+0000","last_active":"2024-05-28T06:12:31.803992+0000","last_peered":"2024-05-28T06:12:31.803992+0000","last_clean":"2024-05-28T06:12:31.803992+0000","last_became_active":"2024-05-28T06:12:31.799517+0000","last_became_peered":"2024-05-28T06:12:31.799517+0000","last_unstale":"2024-05-28T06:12:31.803992+0000","last_undegraded":"2024-05-28T06:12:31.803992+0000","last_fullsized":"2024-05-28T06:12:31.803992+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:22:57.588310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.811408+0000","last_change":"2024-05-28T06:12:30.795765+0000","last_active":"2024-05-28T06:12:31.811408+0000","last_peered":"2024-05-28T06:12:31.811408+0000","last_clean":"2024-05-28T06:12:31.811408+0000","last_became_active":"2024-05-28T06:12:30.795164+0000","last_became_peered":"2024-05-28T06:12:30.795164+0000","last_unstale":"2024-05-28T06:12:31.811408+0000","last_undegraded":"2024-05-28T06:12:31.811408+0000","last_fullsized":"2024-05-28T06:12:31.811408+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:20:40.469531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.805276+0000","last_change":"2024-05-28T06:12:31.801832+0000","last_active":"2024-05-28T06:12:31.805276+0000","last_peered":"2024-05-28T06:12:31.805276+0000","last_clean":"2024-05-28T06:12:31.805276+0000","last_became_active":"2024-05-28T06:12:31.795154+0000","last_became_peered":"2024-05-28T06:12:31.795154+0000","last_unstale":"2024-05-28T06:12:31.805276+0000","last_undegraded":"2024-05-28T06:12:31.805276+0000","last_fullsized":"2024-05-28T06:12:31.805276+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:20:06.541682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.813901+0000","last_change":"2024-05-28T06:12:30.793046+0000","last_active":"2024-05-28T06:12:31.813901+0000","last_peered":"2024-05-28T06:12:31.813901+0000","last_clean":"2024-05-28T06:12:31.813901+0000","last_became_active":"2024-05-28T06:12:30.792752+0000","last_became_peered":"2024-05-28T06:12:30.792752+0000","last_unstale":"2024-05-28T06:12:31.813901+0000","last_undegraded":"2024-05-28T06:12:31.813901+0000","last_fullsized":"2024-05-28T06:12:31.813901+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:03:08.736169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.794152+0000","last_change":"2024-05-28T06:12:31.789865+0000","last_active":"2024-05-28T06:12:31.794152+0000","last_peered":"2024-05-28T06:12:31.794152+0000","last_clean":"2024-05-28T06:12:31.794152+0000","last_became_active":"2024-05-28T06:12:31.789614+0000","last_became_peered":"2024-05-28T06:12:31.789614+0000","last_unstale":"2024-05-28T06:12:31.794152+0000","last_undegraded":"2024-05-28T06:12:31.794152+0000","last_fullsized":"2024-05-28T06:12:31.794152+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:17:35.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.813511+0000","last_change":"2024-05-28T06:12:30.790331+0000","last_active":"2024-05-28T06:12:31.813511+0000","last_peered":"2024-05-28T06:12:31.813511+0000","last_clean":"2024-05-28T06:12:31.813511+0000","last_became_active":"2024-05-28T06:12:30.790028+0000","last_became_peered":"2024-05-28T06:12:30.790028+0000","last_unstale":"2024-05-28T06:12:31.813511+0000","last_undegraded":"2024-05-28T06:12:31.813511+0000","last_fullsized":"2024-05-28T06:12:31.813511+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:01:52.086398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.802974+0000","last_change":"2024-05-28T06:12:31.798571+0000","last_active":"2024-05-28T06:12:31.802974+0000","last_peered":"2024-05-28T06:12:31.802974+0000","last_clean":"2024-05-28T06:12:31.802974+0000","last_became_active":"2024-05-28T06:12:31.797004+0000","last_became_peered":"2024-05-28T06:12:31.797004+0000","last_unstale":"2024-05-28T06:12:31.802974+0000","last_undegraded":"2024-05-28T06:12:31.802974+0000","last_fullsized":"2024-05-28T06:12:31.802974+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:48:47.654123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.785967+0000","last_change":"2024-05-28T06:12:30.792493+0000","last_active":"2024-05-28T06:12:31.785967+0000","last_peered":"2024-05-28T06:12:31.785967+0000","last_clean":"2024-05-28T06:12:31.785967+0000","last_became_active":"2024-05-28T06:12:30.791832+0000","last_became_peered":"2024-05-28T06:12:30.791832+0000","last_unstale":"2024-05-28T06:12:31.785967+0000","last_undegraded":"2024-05-28T06:12:31.785967+0000","last_fullsized":"2024-05-28T06:12:31.785967+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:02:31.893460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.805775+0000","last_change":"2024-05-28T06:12:31.804063+0000","last_active":"2024-05-28T06:12:31.805775+0000","last_peered":"2024-05-28T06:12:31.805775+0000","last_clean":"2024-05-28T06:12:31.805775+0000","last_became_active":"2024-05-28T06:12:31.803791+0000","last_became_peered":"2024-05-28T06:12:31.803791+0000","last_unstale":"2024-05-28T06:12:31.805775+0000","last_undegraded":"2024-05-28T06:12:31.805775+0000","last_fullsized":"2024-05-28T06:12:31.805775+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:22:16.350437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.782356+0000","last_change":"2024-05-28T06:12:30.792385+0000","last_active":"2024-05-28T06:12:31.782356+0000","last_peered":"2024-05-28T06:12:31.782356+0000","last_clean":"2024-05-28T06:12:31.782356+0000","last_became_active":"2024-05-28T06:12:30.789854+0000","last_became_peered":"2024-05-28T06:12:30.789854+0000","last_unstale":"2024-05-28T06:12:31.782356+0000","last_undegraded":"2024-05-28T06:12:31.782356+0000","last_fullsized":"2024-05-28T06:12:31.782356+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:52:08.811888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.793733+0000","last_change":"2024-05-28T06:12:31.791507+0000","last_active":"2024-05-28T06:12:31.793733+0000","last_peered":"2024-05-28T06:12:31.793733+0000","last_clean":"2024-05-28T06:12:31.793733+0000","last_became_active":"2024-05-28T06:12:31.788910+0000","last_became_peered":"2024-05-28T06:12:31.788910+0000","last_unstale":"2024-05-28T06:12:31.793733+0000","last_undegraded":"2024-05-28T06:12:31.793733+0000","last_fullsized":"2024-05-28T06:12:31.793733+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:14:40.573174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.794231+0000","last_change":"2024-05-28T06:12:30.796608+0000","last_active":"2024-05-28T06:12:31.794231+0000","last_peered":"2024-05-28T06:12:31.794231+0000","last_clean":"2024-05-28T06:12:31.794231+0000","last_became_active":"2024-05-28T06:12:30.796011+0000","last_became_peered":"2024-05-28T06:12:30.796011+0000","last_unstale":"2024-05-28T06:12:31.794231+0000","last_undegraded":"2024-05-28T06:12:31.794231+0000","last_fullsized":"2024-05-28T06:12:31.794231+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:03:08.736169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.810185+0000","last_change":"2024-05-28T06:12:31.807786+0000","last_active":"2024-05-28T06:12:31.810185+0000","last_peered":"2024-05-28T06:12:31.810185+0000","last_clean":"2024-05-28T06:12:31.810185+0000","last_became_active":"2024-05-28T06:12:31.807524+0000","last_became_peered":"2024-05-28T06:12:31.807524+0000","last_unstale":"2024-05-28T06:12:31.810185+0000","last_undegraded":"2024-05-28T06:12:31.810185+0000","last_fullsized":"2024-05-28T06:12:31.810185+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:33:08.387840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.785445+0000","last_change":"2024-05-28T06:12:30.798374+0000","last_active":"2024-05-28T06:12:31.785445+0000","last_peered":"2024-05-28T06:12:31.785445+0000","last_clean":"2024-05-28T06:12:31.785445+0000","last_became_active":"2024-05-28T06:12:30.798033+0000","last_became_peered":"2024-05-28T06:12:30.798033+0000","last_unstale":"2024-05-28T06:12:31.785445+0000","last_undegraded":"2024-05-28T06:12:31.785445+0000","last_fullsized":"2024-05-28T06:12:31.785445+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:30:33.083208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.794215+0000","last_change":"2024-05-28T06:12:31.791600+0000","last_active":"2024-05-28T06:12:31.794215+0000","last_peered":"2024-05-28T06:12:31.794215+0000","last_clean":"2024-05-28T06:12:31.794215+0000","last_became_active":"2024-05-28T06:12:31.789590+0000","last_became_peered":"2024-05-28T06:12:31.789590+0000","last_unstale":"2024-05-28T06:12:31.794215+0000","last_undegraded":"2024-05-28T06:12:31.794215+0000","last_fullsized":"2024-05-28T06:12:31.794215+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:06:24.203533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.811491+0000","last_change":"2024-05-28T06:12:30.794636+0000","last_active":"2024-05-28T06:12:31.811491+0000","last_peered":"2024-05-28T06:12:31.811491+0000","last_clean":"2024-05-28T06:12:31.811491+0000","last_became_active":"2024-05-28T06:12:30.794322+0000","last_became_peered":"2024-05-28T06:12:30.794322+0000","last_unstale":"2024-05-28T06:12:31.811491+0000","last_undegraded":"2024-05-28T06:12:31.811491+0000","last_fullsized":"2024-05-28T06:12:31.811491+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:21:00.162134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.810401+0000","last_change":"2024-05-28T06:12:31.806694+0000","last_active":"2024-05-28T06:12:31.810401+0000","last_peered":"2024-05-28T06:12:31.810401+0000","last_clean":"2024-05-28T06:12:31.810401+0000","last_became_active":"2024-05-28T06:12:31.806339+0000","last_became_peered":"2024-05-28T06:12:31.806339+0000","last_unstale":"2024-05-28T06:12:31.810401+0000","last_undegraded":"2024-05-28T06:12:31.810401+0000","last_fullsized":"2024-05-28T06:12:31.810401+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:22:57.588310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.815755+0000","last_change":"2024-05-28T06:12:30.791461+0000","last_active":"2024-05-28T06:12:31.815755+0000","last_peered":"2024-05-28T06:12:31.815755+0000","last_clean":"2024-05-28T06:12:31.815755+0000","last_became_active":"2024-05-28T06:12:30.791190+0000","last_became_peered":"2024-05-28T06:12:30.791190+0000","last_unstale":"2024-05-28T06:12:31.815755+0000","last_undegraded":"2024-05-28T06:12:31.815755+0000","last_fullsized":"2024-05-28T06:12:31.815755+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:01:52.086398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.797670+0000","last_change":"2024-05-28T06:12:31.796224+0000","last_active":"2024-05-28T06:12:31.797670+0000","last_peered":"2024-05-28T06:12:31.797670+0000","last_clean":"2024-05-28T06:12:31.797670+0000","last_became_active":"2024-05-28T06:12:31.794242+0000","last_became_peered":"2024-05-28T06:12:31.794242+0000","last_unstale":"2024-05-28T06:12:31.797670+0000","last_undegraded":"2024-05-28T06:12:31.797670+0000","last_fullsized":"2024-05-28T06:12:31.797670+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:33:08.387840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.815512+0000","last_change":"2024-05-28T06:12:30.794765+0000","last_active":"2024-05-28T06:12:31.815512+0000","last_peered":"2024-05-28T06:12:31.815512+0000","last_clean":"2024-05-28T06:12:31.815512+0000","last_became_active":"2024-05-28T06:12:30.794488+0000","last_became_peered":"2024-05-28T06:12:30.794488+0000","last_unstale":"2024-05-28T06:12:31.815512+0000","last_undegraded":"2024-05-28T06:12:31.815512+0000","last_fullsized":"2024-05-28T06:12:31.815512+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:30:31.483489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.809586+0000","last_change":"2024-05-28T06:12:31.803083+0000","last_active":"2024-05-28T06:12:31.809586+0000","last_peered":"2024-05-28T06:12:31.809586+0000","last_clean":"2024-05-28T06:12:31.809586+0000","last_became_active":"2024-05-28T06:12:31.802789+0000","last_became_peered":"2024-05-28T06:12:31.802789+0000","last_unstale":"2024-05-28T06:12:31.809586+0000","last_undegraded":"2024-05-28T06:12:31.809586+0000","last_fullsized":"2024-05-28T06:12:31.809586+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:31:15.983892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.796348+0000","last_change":"2024-05-28T06:12:30.795959+0000","last_active":"2024-05-28T06:12:31.796348+0000","last_peered":"2024-05-28T06:12:31.796348+0000","last_clean":"2024-05-28T06:12:31.796348+0000","last_became_active":"2024-05-28T06:12:30.795666+0000","last_became_peered":"2024-05-28T06:12:30.795666+0000","last_unstale":"2024-05-28T06:12:31.796348+0000","last_undegraded":"2024-05-28T06:12:31.796348+0000","last_fullsized":"2024-05-28T06:12:31.796348+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:52:42.932309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.799951+0000","last_change":"2024-05-28T06:12:31.795558+0000","last_active":"2024-05-28T06:12:31.799951+0000","last_peered":"2024-05-28T06:12:31.799951+0000","last_clean":"2024-05-28T06:12:31.799951+0000","last_became_active":"2024-05-28T06:12:31.795281+0000","last_became_peered":"2024-05-28T06:12:31.795281+0000","last_unstale":"2024-05-28T06:12:31.799951+0000","last_undegraded":"2024-05-28T06:12:31.799951+0000","last_fullsized":"2024-05-28T06:12:31.799951+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:20:41.476613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.786052+0000","last_change":"2024-05-28T06:12:30.792703+0000","last_active":"2024-05-28T06:12:31.786052+0000","last_peered":"2024-05-28T06:12:31.786052+0000","last_clean":"2024-05-28T06:12:31.786052+0000","last_became_active":"2024-05-28T06:12:30.792218+0000","last_became_peered":"2024-05-28T06:12:30.792218+0000","last_unstale":"2024-05-28T06:12:31.786052+0000","last_undegraded":"2024-05-28T06:12:31.786052+0000","last_fullsized":"2024-05-28T06:12:31.786052+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:14:39.566092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.810228+0000","last_change":"2024-05-28T06:12:31.806242+0000","last_active":"2024-05-28T06:12:31.810228+0000","last_peered":"2024-05-28T06:12:31.810228+0000","last_clean":"2024-05-28T06:12:31.810228+0000","last_became_active":"2024-05-28T06:12:31.805628+0000","last_became_peered":"2024-05-28T06:12:31.805628+0000","last_unstale":"2024-05-28T06:12:31.810228+0000","last_undegraded":"2024-05-28T06:12:31.810228+0000","last_fullsized":"2024-05-28T06:12:31.810228+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:13:29.656977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.814580+0000","last_change":"2024-05-28T06:12:30.797372+0000","last_active":"2024-05-28T06:12:31.814580+0000","last_peered":"2024-05-28T06:12:31.814580+0000","last_clean":"2024-05-28T06:12:31.814580+0000","last_became_active":"2024-05-28T06:12:30.797105+0000","last_became_peered":"2024-05-28T06:12:30.797105+0000","last_unstale":"2024-05-28T06:12:31.814580+0000","last_undegraded":"2024-05-28T06:12:31.814580+0000","last_fullsized":"2024-05-28T06:12:31.814580+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:01:52.086398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.809998+0000","last_change":"2024-05-28T06:12:31.802256+0000","last_active":"2024-05-28T06:12:31.809998+0000","last_peered":"2024-05-28T06:12:31.809998+0000","last_clean":"2024-05-28T06:12:31.809998+0000","last_became_active":"2024-05-28T06:12:31.800610+0000","last_became_peered":"2024-05-28T06:12:31.800610+0000","last_unstale":"2024-05-28T06:12:31.809998+0000","last_undegraded":"2024-05-28T06:12:31.809998+0000","last_fullsized":"2024-05-28T06:12:31.809998+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:54:31.487426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.815298+0000","last_change":"2024-05-28T06:12:30.797106+0000","last_active":"2024-05-28T06:12:31.815298+0000","last_peered":"2024-05-28T06:12:31.815298+0000","last_clean":"2024-05-28T06:12:31.815298+0000","last_became_active":"2024-05-28T06:12:30.795350+0000","last_became_peered":"2024-05-28T06:12:30.795350+0000","last_unstale":"2024-05-28T06:12:31.815298+0000","last_undegraded":"2024-05-28T06:12:31.815298+0000","last_fullsized":"2024-05-28T06:12:31.815298+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:24:27.852847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.797857+0000","last_change":"2024-05-28T06:12:31.794618+0000","last_active":"2024-05-28T06:12:31.797857+0000","last_peered":"2024-05-28T06:12:31.797857+0000","last_clean":"2024-05-28T06:12:31.797857+0000","last_became_active":"2024-05-28T06:12:31.794358+0000","last_became_peered":"2024-05-28T06:12:31.794358+0000","last_unstale":"2024-05-28T06:12:31.797857+0000","last_undegraded":"2024-05-28T06:12:31.797857+0000","last_fullsized":"2024-05-28T06:12:31.797857+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:39:57.840865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.815308+0000","last_change":"2024-05-28T06:12:30.793010+0000","last_active":"2024-05-28T06:12:31.815308+0000","last_peered":"2024-05-28T06:12:31.815308+0000","last_clean":"2024-05-28T06:12:31.815308+0000","last_became_active":"2024-05-28T06:12:30.792705+0000","last_became_peered":"2024-05-28T06:12:30.792705+0000","last_unstale":"2024-05-28T06:12:31.815308+0000","last_undegraded":"2024-05-28T06:12:31.815308+0000","last_fullsized":"2024-05-28T06:12:31.815308+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:37:55.600898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.802490+0000","last_change":"2024-05-28T06:12:31.790772+0000","last_active":"2024-05-28T06:12:31.802490+0000","last_peered":"2024-05-28T06:12:31.802490+0000","last_clean":"2024-05-28T06:12:31.802490+0000","last_became_active":"2024-05-28T06:12:31.790509+0000","last_became_peered":"2024-05-28T06:12:31.790509+0000","last_unstale":"2024-05-28T06:12:31.802490+0000","last_undegraded":"2024-05-28T06:12:31.802490+0000","last_fullsized":"2024-05-28T06:12:31.802490+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:15:23.080919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.811312+0000","last_change":"2024-05-28T06:12:30.797084+0000","last_active":"2024-05-28T06:12:31.811312+0000","last_peered":"2024-05-28T06:12:31.811312+0000","last_clean":"2024-05-28T06:12:31.811312+0000","last_became_active":"2024-05-28T06:12:30.795903+0000","last_became_peered":"2024-05-28T06:12:30.795903+0000","last_unstale":"2024-05-28T06:12:31.811312+0000","last_undegraded":"2024-05-28T06:12:31.811312+0000","last_fullsized":"2024-05-28T06:12:31.811312+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:54:30.480345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.810656+0000","last_change":"2024-05-28T06:12:31.809139+0000","last_active":"2024-05-28T06:12:31.810656+0000","last_peered":"2024-05-28T06:12:31.810656+0000","last_clean":"2024-05-28T06:12:31.810656+0000","last_became_active":"2024-05-28T06:12:31.807373+0000","last_became_peered":"2024-05-28T06:12:31.807373+0000","last_unstale":"2024-05-28T06:12:31.810656+0000","last_undegraded":"2024-05-28T06:12:31.810656+0000","last_fullsized":"2024-05-28T06:12:31.810656+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:44:33.675058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.778378+0000","last_change":"2024-05-28T06:12:30.793875+0000","last_active":"2024-05-28T06:12:31.778378+0000","last_peered":"2024-05-28T06:12:31.778378+0000","last_clean":"2024-05-28T06:12:31.778378+0000","last_became_active":"2024-05-28T06:12:30.793587+0000","last_became_peered":"2024-05-28T06:12:30.793587+0000","last_unstale":"2024-05-28T06:12:31.778378+0000","last_undegraded":"2024-05-28T06:12:31.778378+0000","last_fullsized":"2024-05-28T06:12:31.778378+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:03:08.736169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.797644+0000","last_change":"2024-05-28T06:12:31.794925+0000","last_active":"2024-05-28T06:12:31.797644+0000","last_peered":"2024-05-28T06:12:31.797644+0000","last_clean":"2024-05-28T06:12:31.797644+0000","last_became_active":"2024-05-28T06:12:31.793880+0000","last_became_peered":"2024-05-28T06:12:31.793880+0000","last_unstale":"2024-05-28T06:12:31.797644+0000","last_undegraded":"2024-05-28T06:12:31.797644+0000","last_fullsized":"2024-05-28T06:12:31.797644+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:22:57.588310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.814170+0000","last_change":"2024-05-28T06:12:30.794189+0000","last_active":"2024-05-28T06:12:31.814170+0000","last_peered":"2024-05-28T06:12:31.814170+0000","last_clean":"2024-05-28T06:12:31.814170+0000","last_became_active":"2024-05-28T06:12:30.793922+0000","last_became_peered":"2024-05-28T06:12:30.793922+0000","last_unstale":"2024-05-28T06:12:31.814170+0000","last_undegraded":"2024-05-28T06:12:31.814170+0000","last_fullsized":"2024-05-28T06:12:31.814170+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:08:25.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.802455+0000","last_change":"2024-05-28T06:12:31.797123+0000","last_active":"2024-05-28T06:12:31.802455+0000","last_peered":"2024-05-28T06:12:31.802455+0000","last_clean":"2024-05-28T06:12:31.802455+0000","last_became_active":"2024-05-28T06:12:31.796849+0000","last_became_peered":"2024-05-28T06:12:31.796849+0000","last_unstale":"2024-05-28T06:12:31.802455+0000","last_undegraded":"2024-05-28T06:12:31.802455+0000","last_fullsized":"2024-05-28T06:12:31.802455+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:13:29.656977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.783112+0000","last_change":"2024-05-28T06:12:30.796022+0000","last_active":"2024-05-28T06:12:31.783112+0000","last_peered":"2024-05-28T06:12:31.783112+0000","last_clean":"2024-05-28T06:12:31.783112+0000","last_became_active":"2024-05-28T06:12:30.794505+0000","last_became_peered":"2024-05-28T06:12:30.794505+0000","last_unstale":"2024-05-28T06:12:31.783112+0000","last_undegraded":"2024-05-28T06:12:31.783112+0000","last_fullsized":"2024-05-28T06:12:31.783112+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:32:08.488200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.805194+0000","last_change":"2024-05-28T06:12:31.802246+0000","last_active":"2024-05-28T06:12:31.805194+0000","last_peered":"2024-05-28T06:12:31.805194+0000","last_clean":"2024-05-28T06:12:31.805194+0000","last_became_active":"2024-05-28T06:12:31.801961+0000","last_became_peered":"2024-05-28T06:12:31.801961+0000","last_unstale":"2024-05-28T06:12:31.805194+0000","last_undegraded":"2024-05-28T06:12:31.805194+0000","last_fullsized":"2024-05-28T06:12:31.805194+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:44:33.675058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.785981+0000","last_change":"2024-05-28T06:12:30.790810+0000","last_active":"2024-05-28T06:12:31.785981+0000","last_peered":"2024-05-28T06:12:31.785981+0000","last_clean":"2024-05-28T06:12:31.785981+0000","last_became_active":"2024-05-28T06:12:30.790513+0000","last_became_peered":"2024-05-28T06:12:30.790513+0000","last_unstale":"2024-05-28T06:12:31.785981+0000","last_undegraded":"2024-05-28T06:12:31.785981+0000","last_fullsized":"2024-05-28T06:12:31.785981+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:31:14.976810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.808559+0000","last_change":"2024-05-28T06:12:31.804263+0000","last_active":"2024-05-28T06:12:31.808559+0000","last_peered":"2024-05-28T06:12:31.808559+0000","last_clean":"2024-05-28T06:12:31.808559+0000","last_became_active":"2024-05-28T06:12:31.803936+0000","last_became_peered":"2024-05-28T06:12:31.803936+0000","last_unstale":"2024-05-28T06:12:31.808559+0000","last_undegraded":"2024-05-28T06:12:31.808559+0000","last_fullsized":"2024-05-28T06:12:31.808559+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:43:33.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.814533+0000","last_change":"2024-05-28T06:12:30.798073+0000","last_active":"2024-05-28T06:12:31.814533+0000","last_peered":"2024-05-28T06:12:31.814533+0000","last_clean":"2024-05-28T06:12:31.814533+0000","last_became_active":"2024-05-28T06:12:30.797794+0000","last_became_peered":"2024-05-28T06:12:30.797794+0000","last_unstale":"2024-05-28T06:12:31.814533+0000","last_undegraded":"2024-05-28T06:12:31.814533+0000","last_fullsized":"2024-05-28T06:12:31.814533+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:05:17.937721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.805302+0000","last_change":"2024-05-28T06:12:31.800014+0000","last_active":"2024-05-28T06:12:31.805302+0000","last_peered":"2024-05-28T06:12:31.805302+0000","last_clean":"2024-05-28T06:12:31.805302+0000","last_became_active":"2024-05-28T06:12:31.799714+0000","last_became_peered":"2024-05-28T06:12:31.799714+0000","last_unstale":"2024-05-28T06:12:31.805302+0000","last_undegraded":"2024-05-28T06:12:31.805302+0000","last_fullsized":"2024-05-28T06:12:31.805302+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:59:14.477995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.778857+0000","last_change":"2024-05-28T06:12:30.790726+0000","last_active":"2024-05-28T06:12:31.778857+0000","last_peered":"2024-05-28T06:12:31.778857+0000","last_clean":"2024-05-28T06:12:31.778857+0000","last_became_active":"2024-05-28T06:12:30.790486+0000","last_became_peered":"2024-05-28T06:12:30.790486+0000","last_unstale":"2024-05-28T06:12:31.778857+0000","last_undegraded":"2024-05-28T06:12:31.778857+0000","last_fullsized":"2024-05-28T06:12:31.778857+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:31:14.976810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.794192+0000","last_change":"2024-05-28T06:12:31.791575+0000","last_active":"2024-05-28T06:12:31.794192+0000","last_peered":"2024-05-28T06:12:31.794192+0000","last_clean":"2024-05-28T06:12:31.794192+0000","last_became_active":"2024-05-28T06:12:31.789316+0000","last_became_peered":"2024-05-28T06:12:31.789316+0000","last_unstale":"2024-05-28T06:12:31.794192+0000","last_undegraded":"2024-05-28T06:12:31.794192+0000","last_fullsized":"2024-05-28T06:12:31.794192+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:48:47.654123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.796467+0000","last_change":"2024-05-28T06:12:30.791618+0000","last_active":"2024-05-28T06:12:31.796467+0000","last_peered":"2024-05-28T06:12:31.796467+0000","last_clean":"2024-05-28T06:12:31.796467+0000","last_became_active":"2024-05-28T06:12:30.791296+0000","last_became_peered":"2024-05-28T06:12:30.791296+0000","last_unstale":"2024-05-28T06:12:31.796467+0000","last_undegraded":"2024-05-28T06:12:31.796467+0000","last_fullsized":"2024-05-28T06:12:31.796467+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:32:08.488200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.803971+0000","last_change":"2024-05-28T06:12:31.799676+0000","last_active":"2024-05-28T06:12:31.803971+0000","last_peered":"2024-05-28T06:12:31.803971+0000","last_clean":"2024-05-28T06:12:31.803971+0000","last_became_active":"2024-05-28T06:12:31.799396+0000","last_became_peered":"2024-05-28T06:12:31.799396+0000","last_unstale":"2024-05-28T06:12:31.803971+0000","last_undegraded":"2024-05-28T06:12:31.803971+0000","last_fullsized":"2024-05-28T06:12:31.803971+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:39:57.840865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.787712+0000","last_change":"2024-05-28T06:12:30.790898+0000","last_active":"2024-05-28T06:12:31.787712+0000","last_peered":"2024-05-28T06:12:31.787712+0000","last_clean":"2024-05-28T06:12:31.787712+0000","last_became_active":"2024-05-28T06:12:30.790609+0000","last_became_peered":"2024-05-28T06:12:30.790609+0000","last_unstale":"2024-05-28T06:12:31.787712+0000","last_undegraded":"2024-05-28T06:12:31.787712+0000","last_fullsized":"2024-05-28T06:12:31.787712+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:42:43.406276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.804378+0000","last_change":"2024-05-28T06:12:31.793575+0000","last_active":"2024-05-28T06:12:31.804378+0000","last_peered":"2024-05-28T06:12:31.804378+0000","last_clean":"2024-05-28T06:12:31.804378+0000","last_became_active":"2024-05-28T06:12:31.792189+0000","last_became_peered":"2024-05-28T06:12:31.792189+0000","last_unstale":"2024-05-28T06:12:31.804378+0000","last_undegraded":"2024-05-28T06:12:31.804378+0000","last_fullsized":"2024-05-28T06:12:31.804378+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:57:14.404993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.781977+0000","last_change":"2024-05-28T06:12:30.787551+0000","last_active":"2024-05-28T06:12:31.781977+0000","last_peered":"2024-05-28T06:12:31.781977+0000","last_clean":"2024-05-28T06:12:31.781977+0000","last_became_active":"2024-05-28T06:12:30.786731+0000","last_became_peered":"2024-05-28T06:12:30.786731+0000","last_unstale":"2024-05-28T06:12:31.781977+0000","last_undegraded":"2024-05-28T06:12:31.781977+0000","last_fullsized":"2024-05-28T06:12:31.781977+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:57:56.110796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.810009+0000","last_change":"2024-05-28T06:12:31.804270+0000","last_active":"2024-05-28T06:12:31.810009+0000","last_peered":"2024-05-28T06:12:31.810009+0000","last_clean":"2024-05-28T06:12:31.810009+0000","last_became_active":"2024-05-28T06:12:31.803980+0000","last_became_peered":"2024-05-28T06:12:31.803980+0000","last_unstale":"2024-05-28T06:12:31.810009+0000","last_undegraded":"2024-05-28T06:12:31.810009+0000","last_fullsized":"2024-05-28T06:12:31.810009+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:20:41.476613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.780630+0000","last_change":"2024-05-28T06:12:30.790132+0000","last_active":"2024-05-28T06:12:31.780630+0000","last_peered":"2024-05-28T06:12:31.780630+0000","last_clean":"2024-05-28T06:12:31.780630+0000","last_became_active":"2024-05-28T06:12:30.789856+0000","last_became_peered":"2024-05-28T06:12:30.789856+0000","last_unstale":"2024-05-28T06:12:31.780630+0000","last_undegraded":"2024-05-28T06:12:31.780630+0000","last_fullsized":"2024-05-28T06:12:31.780630+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:05:08.097047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.808057+0000","last_change":"2024-05-28T06:12:31.801507+0000","last_active":"2024-05-28T06:12:31.808057+0000","last_peered":"2024-05-28T06:12:31.808057+0000","last_clean":"2024-05-28T06:12:31.808057+0000","last_became_active":"2024-05-28T06:12:31.801228+0000","last_became_peered":"2024-05-28T06:12:31.801228+0000","last_unstale":"2024-05-28T06:12:31.808057+0000","last_undegraded":"2024-05-28T06:12:31.808057+0000","last_fullsized":"2024-05-28T06:12:31.808057+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:09:57.797411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.782846+0000","last_change":"2024-05-28T06:12:30.790873+0000","last_active":"2024-05-28T06:12:31.782846+0000","last_peered":"2024-05-28T06:12:31.782846+0000","last_clean":"2024-05-28T06:12:31.782846+0000","last_became_active":"2024-05-28T06:12:30.790623+0000","last_became_peered":"2024-05-28T06:12:30.790623+0000","last_unstale":"2024-05-28T06:12:31.782846+0000","last_undegraded":"2024-05-28T06:12:31.782846+0000","last_fullsized":"2024-05-28T06:12:31.782846+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:52:42.932309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.805754+0000","last_change":"2024-05-28T06:12:31.803993+0000","last_active":"2024-05-28T06:12:31.805754+0000","last_peered":"2024-05-28T06:12:31.805754+0000","last_clean":"2024-05-28T06:12:31.805754+0000","last_became_active":"2024-05-28T06:12:31.803709+0000","last_became_peered":"2024-05-28T06:12:31.803709+0000","last_unstale":"2024-05-28T06:12:31.805754+0000","last_undegraded":"2024-05-28T06:12:31.805754+0000","last_fullsized":"2024-05-28T06:12:31.805754+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:24:30.029244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.783406+0000","last_change":"2024-05-28T06:12:30.793567+0000","last_active":"2024-05-28T06:12:31.783406+0000","last_peered":"2024-05-28T06:12:31.783406+0000","last_clean":"2024-05-28T06:12:31.783406+0000","last_became_active":"2024-05-28T06:12:30.793086+0000","last_became_peered":"2024-05-28T06:12:30.793086+0000","last_unstale":"2024-05-28T06:12:31.783406+0000","last_undegraded":"2024-05-28T06:12:31.783406+0000","last_fullsized":"2024-05-28T06:12:31.783406+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:55:15.450791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.794329+0000","last_change":"2024-05-28T06:12:31.789343+0000","last_active":"2024-05-28T06:12:31.794329+0000","last_peered":"2024-05-28T06:12:31.794329+0000","last_clean":"2024-05-28T06:12:31.794329+0000","last_became_active":"2024-05-28T06:12:31.789082+0000","last_became_peered":"2024-05-28T06:12:31.789082+0000","last_unstale":"2024-05-28T06:12:31.794329+0000","last_undegraded":"2024-05-28T06:12:31.794329+0000","last_fullsized":"2024-05-28T06:12:31.794329+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:22:44.741189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.796549+0000","last_change":"2024-05-28T06:12:30.796037+0000","last_active":"2024-05-28T06:12:31.796549+0000","last_peered":"2024-05-28T06:12:31.796549+0000","last_clean":"2024-05-28T06:12:31.796549+0000","last_became_active":"2024-05-28T06:12:30.795716+0000","last_became_peered":"2024-05-28T06:12:30.795716+0000","last_unstale":"2024-05-28T06:12:31.796549+0000","last_undegraded":"2024-05-28T06:12:31.796549+0000","last_fullsized":"2024-05-28T06:12:31.796549+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:17:05.591509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":245,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.791659+0000","last_change":"2024-05-28T06:05:38.517922+0000","last_active":"2024-05-28T06:12:31.791659+0000","last_peered":"2024-05-28T06:12:31.791659+0000","last_clean":"2024-05-28T06:12:31.791659+0000","last_became_active":"2024-05-28T06:05:38.514745+0000","last_became_peered":"2024-05-28T06:05:38.514745+0000","last_unstale":"2024-05-28T06:12:31.791659+0000","last_undegraded":"2024-05-28T06:12:31.791659+0000","last_fullsized":"2024-05-28T06:12:31.791659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_clean_scrub_stamp":"2024-05-28T06:05:37.485018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:23:27.978203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574935,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46380,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325460,"statfs":{"total":96636764160,"available":96589271040,"internally_reserved":0,"allocated":1335296,"data_stored":899229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574935,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45772,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326068,"statfs":{"total":96636764160,"available":96589893632,"internally_reserved":0,"allocated":720896,"data_stored":301898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574934,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44364,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327476,"statfs":{"total":96636764160,"available":96591335424,"internally_reserved":0,"allocated":720896,"data_stored":301898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45776,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326064,"statfs":{"total":96636764160,"available":96589889536,"internally_reserved":0,"allocated":720896,"data_stored":301898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49960,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321880,"statfs":{"total":96636764160,"available":96585605120,"internally_reserved":0,"allocated":741376,"data_stored":308757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574935,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45800,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326040,"statfs":{"total":96636764160,"available":96589864960,"internally_reserved":0,"allocated":741376,"data_stored":308757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45796,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326044,"statfs":{"total":96636764160,"available":96589869056,"internally_reserved":0,"allocated":737280,"data_stored":308791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46388,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325452,"statfs":{"total":96636764160,"available":96589262848,"internally_reserved":0,"allocated":1343488,"data_stored":901263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-28T06:12:35.883 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-28T06:12:36.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.058+0000 7f2209a00640 1 Processor -- start 2024-05-28T06:12:36.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.058+0000 7f2209a00640 1 -- start start 2024-05-28T06:12:36.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.058+0000 7f2209a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f220415c760 0x7f22040b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:36.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.058+0000 7f2209a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f22040c83a0 0x7f220409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:36.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.058+0000 7f2209a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f220409af80 0x7f22040d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:36.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.058+0000 7f2209a00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f220409b3d0 con 0x7f22040c83a0 2024-05-28T06:12:36.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.058+0000 7f2209a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f22040c8af0 con 0x7f220415c760 2024-05-28T06:12:36.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.058+0000 7f2209a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f22040c8dd0 con 0x7f220409af80 2024-05-28T06:12:36.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.058+0000 7f2203400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f22040c83a0 0x7f220409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:36.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.058+0000 7f2203400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f22040c83a0 0x7f220409aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37940/0 (socket says 172.21.15.122:37940) 2024-05-28T06:12:36.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.058+0000 7f2203400640 1 -- 172.21.15.122:0/2154002831 learned_addr learned my addr 172.21.15.122:0/2154002831 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:36.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.058+0000 7f2203400640 1 -- 172.21.15.122:0/2154002831 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f220409af80 msgr2=0x7f22040d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:36.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.058+0000 7f2203400640 1 --2- 172.21.15.122:0/2154002831 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f220409af80 0x7f22040d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.058+0000 7f2203400640 1 -- 172.21.15.122:0/2154002831 >> v2:172.21.15.153:3300/0 conn(0x7f220415c760 msgr2=0x7f22040b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:36.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.058+0000 7f2203400640 1 --2- 172.21.15.122:0/2154002831 >> v2:172.21.15.153:3300/0 conn(0x7f220415c760 0x7f22040b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.058+0000 7f2203400640 1 -- 172.21.15.122:0/2154002831 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22040c90b0 con 0x7f22040c83a0 2024-05-28T06:12:36.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.062+0000 7f2203400640 1 --2- 172.21.15.122:0/2154002831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22040c83a0 0x7f220409aa40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f22040732b0 tx=0x7f21f001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2990f967354ee4 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:36.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.062+0000 7f2202a00640 1 -- 172.21.15.122:0/2154002831 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f00b0070 con 0x7f22040c83a0 2024-05-28T06:12:36.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.062+0000 7f2202a00640 1 -- 172.21.15.122:0/2154002831 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f00ab600 con 0x7f22040c83a0 2024-05-28T06:12:36.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.062+0000 7f2202a00640 1 -- 172.21.15.122:0/2154002831 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f00ab9d0 con 0x7f22040c83a0 2024-05-28T06:12:36.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.062+0000 7f2209a00640 1 -- 172.21.15.122:0/2154002831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22040c83a0 msgr2=0x7f220409aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:36.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.062+0000 7f2209a00640 1 --2- 172.21.15.122:0/2154002831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22040c83a0 0x7f220409aa40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f22040732b0 tx=0x7f21f001c260 comp rx=0 tx=0).stop 2024-05-28T06:12:36.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.062+0000 7f2209a00640 1 -- 172.21.15.122:0/2154002831 shutdown_connections 2024-05-28T06:12:36.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.062+0000 7f2209a00640 1 --2- 172.21.15.122:0/2154002831 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f220409af80 0x7f22040d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.062+0000 7f2209a00640 1 --2- 172.21.15.122:0/2154002831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22040c83a0 0x7f220409aa40 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.062+0000 7f2209a00640 1 --2- 172.21.15.122:0/2154002831 >> v2:172.21.15.153:3300/0 conn(0x7f220415c760 0x7f22040b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.062+0000 7f2209a00640 1 -- 172.21.15.122:0/2154002831 >> 172.21.15.122:0/2154002831 conn(0x7f22040d2470 msgr2=0x7f22040d2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:36.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.062+0000 7f2209a00640 1 -- 172.21.15.122:0/2154002831 shutdown_connections 2024-05-28T06:12:36.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.062+0000 7f2209a00640 1 -- 172.21.15.122:0/2154002831 wait complete. 2024-05-28T06:12:36.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.062+0000 7f2209a00640 1 Processor -- start 2024-05-28T06:12:36.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.066+0000 7f2209a00640 1 -- start start 2024-05-28T06:12:36.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.066+0000 7f2209a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f220409af80 0x7f2204152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:36.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.066+0000 7f2209a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f22040c83a0 0x7f220414efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:36.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.066+0000 7f2209a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f220415c760 0x7f2204158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:36.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.066+0000 7f2209a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f22040cd160 con 0x7f220409af80 2024-05-28T06:12:36.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.066+0000 7f2209a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f220415cd50 con 0x7f220415c760 2024-05-28T06:12:36.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.066+0000 7f2209a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f22040cd2e0 con 0x7f22040c83a0 2024-05-28T06:12:36.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.066+0000 7f2203e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f220409af80 0x7f2204152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:36.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.066+0000 7f2203e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f220409af80 0x7f2204152940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37954/0 (socket says 172.21.15.122:37954) 2024-05-28T06:12:36.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.066+0000 7f2203e00640 1 -- 172.21.15.122:0/3469384531 learned_addr learned my addr 172.21.15.122:0/3469384531 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:36.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.066+0000 7f2203e00640 1 -- 172.21.15.122:0/3469384531 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f22040c83a0 msgr2=0x7f220414efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:36.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.066+0000 7f2203e00640 1 --2- 172.21.15.122:0/3469384531 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f22040c83a0 0x7f220414efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.066+0000 7f2203e00640 1 -- 172.21.15.122:0/3469384531 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f220415c760 msgr2=0x7f2204158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:36.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.066+0000 7f2203e00640 1 --2- 172.21.15.122:0/3469384531 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f220415c760 0x7f2204158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.067 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.066+0000 7f2203e00640 1 -- 172.21.15.122:0/3469384531 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2204151090 con 0x7f220409af80 2024-05-28T06:12:36.067 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.066+0000 7f2203e00640 1 --2- 172.21.15.122:0/3469384531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f220409af80 0x7f2204152940 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f21f400b410 tx=0x7f21f400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:36.067 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.066+0000 7f21fbe00640 1 -- 172.21.15.122:0/3469384531 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f4015020 con 0x7f220409af80 2024-05-28T06:12:36.067 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.066+0000 7f21fbe00640 1 -- 172.21.15.122:0/3469384531 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f4011830 con 0x7f220409af80 2024-05-28T06:12:36.067 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.066+0000 7f2209a00640 1 -- 172.21.15.122:0/3469384531 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2204157d00 con 0x7f220409af80 2024-05-28T06:12:36.067 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.066+0000 7f21fbe00640 1 -- 172.21.15.122:0/3469384531 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f4011c20 con 0x7f220409af80 2024-05-28T06:12:36.067 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.066+0000 7f2209a00640 1 -- 172.21.15.122:0/3469384531 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f220414ea90 con 0x7f220409af80 2024-05-28T06:12:36.067 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.066+0000 7f2209a00640 1 -- 172.21.15.122:0/3469384531 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f220414ec90 con 0x7f220409af80 2024-05-28T06:12:36.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.070+0000 7f21fbe00640 1 -- 172.21.15.122:0/3469384531 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f21f4018020 con 0x7f220409af80 2024-05-28T06:12:36.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.070+0000 7f21fbe00640 1 --2- 172.21.15.122:0/3469384531 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f21e4068bf0 0x7f21e406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:36.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.070+0000 7f21fbe00640 1 -- 172.21.15.122:0/3469384531 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f21f4087ac0 con 0x7f220409af80 2024-05-28T06:12:36.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.070+0000 7f2203400640 1 --2- 172.21.15.122:0/3469384531 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f21e4068bf0 0x7f21e406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:36.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.070+0000 7f2203400640 1 --2- 172.21.15.122:0/3469384531 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f21e4068bf0 0x7f21e406b0b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f21f00ad000 tx=0x7f21f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:36.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.074+0000 7f21fbe00640 1 -- 172.21.15.122:0/3469384531 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f220414ec90 con 0x7f220409af80 2024-05-28T06:12:36.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.230+0000 7f2209a00640 1 -- 172.21.15.122:0/3469384531 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2204075620 con 0x7f21e4068bf0 2024-05-28T06:12:36.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.234+0000 7f21fbe00640 1 -- 172.21.15.122:0/3469384531 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251885 (secure 0 0 0) 0x7f2204075620 con 0x7f21e4068bf0 2024-05-28T06:12:36.238 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:36.239 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-05-28T06:12:36.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.238+0000 7f2209a00640 1 -- 172.21.15.122:0/3469384531 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f21e4068bf0 msgr2=0x7f21e406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:36.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.238+0000 7f2209a00640 1 --2- 172.21.15.122:0/3469384531 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f21e4068bf0 0x7f21e406b0b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f21f00ad000 tx=0x7f21f0008040 comp rx=0 tx=0).stop 2024-05-28T06:12:36.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.238+0000 7f2209a00640 1 -- 172.21.15.122:0/3469384531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f220409af80 msgr2=0x7f2204152940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:36.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.238+0000 7f2209a00640 1 --2- 172.21.15.122:0/3469384531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f220409af80 0x7f2204152940 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f21f400b410 tx=0x7f21f400b8d0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.238+0000 7f2209a00640 1 -- 172.21.15.122:0/3469384531 shutdown_connections 2024-05-28T06:12:36.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.238+0000 7f2209a00640 1 --2- 172.21.15.122:0/3469384531 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f21e4068bf0 0x7f21e406b0b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.238+0000 7f2209a00640 1 --2- 172.21.15.122:0/3469384531 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f220415c760 0x7f2204158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.238+0000 7f2209a00640 1 --2- 172.21.15.122:0/3469384531 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f22040c83a0 0x7f220414efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.238+0000 7f2209a00640 1 --2- 172.21.15.122:0/3469384531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f220409af80 0x7f2204152940 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.238+0000 7f2209a00640 1 -- 172.21.15.122:0/3469384531 >> 172.21.15.122:0/3469384531 conn(0x7f22040d2470 msgr2=0x7f22041503a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:36.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.238+0000 7f2209a00640 1 -- 172.21.15.122:0/3469384531 shutdown_connections 2024-05-28T06:12:36.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.238+0000 7f2209a00640 1 -- 172.21.15.122:0/3469384531 wait complete. 2024-05-28T06:12:36.258 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":264,"stamp":"2024-05-28T06:12:35.345478+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":370236,"kb_used_data":6896,"kb_used_omap":12,"kb_used_meta":363187,"kb_avail":754604484,"statfs":{"total":773094113280,"available":772714991616,"internally_reserved":0,"allocated":7061504,"data_stored":3632491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":371904049},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.580824"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.801795+0000","last_change":"2024-05-28T06:12:31.797507+0000","last_active":"2024-05-28T06:12:31.801795+0000","last_peered":"2024-05-28T06:12:31.801795+0000","last_clean":"2024-05-28T06:12:31.801795+0000","last_became_active":"2024-05-28T06:12:31.793751+0000","last_became_peered":"2024-05-28T06:12:31.793751+0000","last_unstale":"2024-05-28T06:12:31.801795+0000","last_undegraded":"2024-05-28T06:12:31.801795+0000","last_fullsized":"2024-05-28T06:12:31.801795+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:05:08.558778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.805183+0000","last_change":"2024-05-28T06:12:31.799024+0000","last_active":"2024-05-28T06:12:31.805183+0000","last_peered":"2024-05-28T06:12:31.805183+0000","last_clean":"2024-05-28T06:12:31.805183+0000","last_became_active":"2024-05-28T06:12:31.798788+0000","last_became_peered":"2024-05-28T06:12:31.798788+0000","last_unstale":"2024-05-28T06:12:31.805183+0000","last_undegraded":"2024-05-28T06:12:31.805183+0000","last_fullsized":"2024-05-28T06:12:31.805183+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T18:05:44.809790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.810381+0000","last_change":"2024-05-28T06:12:31.802734+0000","last_active":"2024-05-28T06:12:31.810381+0000","last_peered":"2024-05-28T06:12:31.810381+0000","last_clean":"2024-05-28T06:12:31.810381+0000","last_became_active":"2024-05-28T06:12:31.802019+0000","last_became_peered":"2024-05-28T06:12:31.802019+0000","last_unstale":"2024-05-28T06:12:31.810381+0000","last_undegraded":"2024-05-28T06:12:31.810381+0000","last_fullsized":"2024-05-28T06:12:31.810381+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:02:32.900541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.809027+0000","last_change":"2024-05-28T06:12:31.802404+0000","last_active":"2024-05-28T06:12:31.809027+0000","last_peered":"2024-05-28T06:12:31.809027+0000","last_clean":"2024-05-28T06:12:31.809027+0000","last_became_active":"2024-05-28T06:12:31.801804+0000","last_became_peered":"2024-05-28T06:12:31.801804+0000","last_unstale":"2024-05-28T06:12:31.809027+0000","last_undegraded":"2024-05-28T06:12:31.809027+0000","last_fullsized":"2024-05-28T06:12:31.809027+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:27:01.826955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.801911+0000","last_change":"2024-05-28T06:12:31.798616+0000","last_active":"2024-05-28T06:12:31.801911+0000","last_peered":"2024-05-28T06:12:31.801911+0000","last_clean":"2024-05-28T06:12:31.801911+0000","last_became_active":"2024-05-28T06:12:31.798238+0000","last_became_peered":"2024-05-28T06:12:31.798238+0000","last_unstale":"2024-05-28T06:12:31.801911+0000","last_undegraded":"2024-05-28T06:12:31.801911+0000","last_fullsized":"2024-05-28T06:12:31.801911+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:10:31.403540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.799458+0000","last_change":"2024-05-28T06:12:31.791032+0000","last_active":"2024-05-28T06:12:31.799458+0000","last_peered":"2024-05-28T06:12:31.799458+0000","last_clean":"2024-05-28T06:12:31.799458+0000","last_became_active":"2024-05-28T06:12:31.790779+0000","last_became_peered":"2024-05-28T06:12:31.790779+0000","last_unstale":"2024-05-28T06:12:31.799458+0000","last_undegraded":"2024-05-28T06:12:31.799458+0000","last_fullsized":"2024-05-28T06:12:31.799458+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:54:31.487426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.793053+0000","last_change":"2024-05-28T06:12:31.786902+0000","last_active":"2024-05-28T06:12:31.793053+0000","last_peered":"2024-05-28T06:12:31.793053+0000","last_clean":"2024-05-28T06:12:31.793053+0000","last_became_active":"2024-05-28T06:12:31.786592+0000","last_became_peered":"2024-05-28T06:12:31.786592+0000","last_unstale":"2024-05-28T06:12:31.793053+0000","last_undegraded":"2024-05-28T06:12:31.793053+0000","last_fullsized":"2024-05-28T06:12:31.793053+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:37:56.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.791374+0000","last_change":"2024-05-28T06:12:31.788445+0000","last_active":"2024-05-28T06:12:31.791374+0000","last_peered":"2024-05-28T06:12:31.791374+0000","last_clean":"2024-05-28T06:12:31.791374+0000","last_became_active":"2024-05-28T06:12:31.788168+0000","last_became_peered":"2024-05-28T06:12:31.788168+0000","last_unstale":"2024-05-28T06:12:31.791374+0000","last_undegraded":"2024-05-28T06:12:31.791374+0000","last_fullsized":"2024-05-28T06:12:31.791374+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:54:23.878943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.786108+0000","last_change":"2024-05-28T06:12:31.783886+0000","last_active":"2024-05-28T06:12:31.786108+0000","last_peered":"2024-05-28T06:12:31.786108+0000","last_clean":"2024-05-28T06:12:31.786108+0000","last_became_active":"2024-05-28T06:12:31.783599+0000","last_became_peered":"2024-05-28T06:12:31.783599+0000","last_unstale":"2024-05-28T06:12:31.786108+0000","last_undegraded":"2024-05-28T06:12:31.786108+0000","last_fullsized":"2024-05-28T06:12:31.786108+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:21:01.169215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.800048+0000","last_change":"2024-05-28T06:12:31.797210+0000","last_active":"2024-05-28T06:12:31.800048+0000","last_peered":"2024-05-28T06:12:31.800048+0000","last_clean":"2024-05-28T06:12:31.800048+0000","last_became_active":"2024-05-28T06:12:31.793687+0000","last_became_peered":"2024-05-28T06:12:31.793687+0000","last_unstale":"2024-05-28T06:12:31.800048+0000","last_undegraded":"2024-05-28T06:12:31.800048+0000","last_fullsized":"2024-05-28T06:12:31.800048+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:11:30.709739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.796061+0000","last_change":"2024-05-28T06:12:31.789629+0000","last_active":"2024-05-28T06:12:31.796061+0000","last_peered":"2024-05-28T06:12:31.796061+0000","last_clean":"2024-05-28T06:12:31.796061+0000","last_became_active":"2024-05-28T06:12:31.789337+0000","last_became_peered":"2024-05-28T06:12:31.789337+0000","last_unstale":"2024-05-28T06:12:31.796061+0000","last_undegraded":"2024-05-28T06:12:31.796061+0000","last_fullsized":"2024-05-28T06:12:31.796061+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:17:06.598590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.797704+0000","last_change":"2024-05-28T06:12:31.796464+0000","last_active":"2024-05-28T06:12:31.797704+0000","last_peered":"2024-05-28T06:12:31.797704+0000","last_clean":"2024-05-28T06:12:31.797704+0000","last_became_active":"2024-05-28T06:12:31.796167+0000","last_became_peered":"2024-05-28T06:12:31.796167+0000","last_unstale":"2024-05-28T06:12:31.797704+0000","last_undegraded":"2024-05-28T06:12:31.797704+0000","last_fullsized":"2024-05-28T06:12:31.797704+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:44:33.675058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.805546+0000","last_change":"2024-05-28T06:12:31.799523+0000","last_active":"2024-05-28T06:12:31.805546+0000","last_peered":"2024-05-28T06:12:31.805546+0000","last_clean":"2024-05-28T06:12:31.805546+0000","last_became_active":"2024-05-28T06:12:31.799169+0000","last_became_peered":"2024-05-28T06:12:31.799169+0000","last_unstale":"2024-05-28T06:12:31.805546+0000","last_undegraded":"2024-05-28T06:12:31.805546+0000","last_fullsized":"2024-05-28T06:12:31.805546+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:06:24.203533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.793394+0000","last_change":"2024-05-28T06:12:31.790257+0000","last_active":"2024-05-28T06:12:31.793394+0000","last_peered":"2024-05-28T06:12:31.793394+0000","last_clean":"2024-05-28T06:12:31.793394+0000","last_became_active":"2024-05-28T06:12:31.789907+0000","last_became_peered":"2024-05-28T06:12:31.789907+0000","last_unstale":"2024-05-28T06:12:31.793394+0000","last_undegraded":"2024-05-28T06:12:31.793394+0000","last_fullsized":"2024-05-28T06:12:31.793394+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:31:15.983892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.793072+0000","last_change":"2024-05-28T06:12:31.788326+0000","last_active":"2024-05-28T06:12:31.793072+0000","last_peered":"2024-05-28T06:12:31.793072+0000","last_clean":"2024-05-28T06:12:31.793072+0000","last_became_active":"2024-05-28T06:12:31.788073+0000","last_became_peered":"2024-05-28T06:12:31.788073+0000","last_unstale":"2024-05-28T06:12:31.793072+0000","last_undegraded":"2024-05-28T06:12:31.793072+0000","last_fullsized":"2024-05-28T06:12:31.793072+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:02:32.900541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.805110+0000","last_change":"2024-05-28T06:12:31.802252+0000","last_active":"2024-05-28T06:12:31.805110+0000","last_peered":"2024-05-28T06:12:31.805110+0000","last_clean":"2024-05-28T06:12:31.805110+0000","last_became_active":"2024-05-28T06:12:31.800507+0000","last_became_peered":"2024-05-28T06:12:31.800507+0000","last_unstale":"2024-05-28T06:12:31.805110+0000","last_undegraded":"2024-05-28T06:12:31.805110+0000","last_fullsized":"2024-05-28T06:12:31.805110+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:33:08.387840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.804830+0000","last_change":"2024-05-28T06:12:31.798684+0000","last_active":"2024-05-28T06:12:31.804830+0000","last_peered":"2024-05-28T06:12:31.804830+0000","last_clean":"2024-05-28T06:12:31.804830+0000","last_became_active":"2024-05-28T06:12:31.798292+0000","last_became_peered":"2024-05-28T06:12:31.798292+0000","last_unstale":"2024-05-28T06:12:31.804830+0000","last_undegraded":"2024-05-28T06:12:31.804830+0000","last_fullsized":"2024-05-28T06:12:31.804830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:54:40.698120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.810020+0000","last_change":"2024-05-28T06:12:31.805307+0000","last_active":"2024-05-28T06:12:31.810020+0000","last_peered":"2024-05-28T06:12:31.810020+0000","last_clean":"2024-05-28T06:12:31.810020+0000","last_became_active":"2024-05-28T06:12:31.805031+0000","last_became_peered":"2024-05-28T06:12:31.805031+0000","last_unstale":"2024-05-28T06:12:31.810020+0000","last_undegraded":"2024-05-28T06:12:31.810020+0000","last_fullsized":"2024-05-28T06:12:31.810020+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:42:44.413357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.800657+0000","last_change":"2024-05-28T06:12:31.792875+0000","last_active":"2024-05-28T06:12:31.800657+0000","last_peered":"2024-05-28T06:12:31.800657+0000","last_clean":"2024-05-28T06:12:31.800657+0000","last_became_active":"2024-05-28T06:12:31.792620+0000","last_became_peered":"2024-05-28T06:12:31.792620+0000","last_unstale":"2024-05-28T06:12:31.800657+0000","last_undegraded":"2024-05-28T06:12:31.800657+0000","last_fullsized":"2024-05-28T06:12:31.800657+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:37:27.523059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.794523+0000","last_change":"2024-05-28T06:12:31.790299+0000","last_active":"2024-05-28T06:12:31.794523+0000","last_peered":"2024-05-28T06:12:31.794523+0000","last_clean":"2024-05-28T06:12:31.794523+0000","last_became_active":"2024-05-28T06:12:31.790044+0000","last_became_peered":"2024-05-28T06:12:31.790044+0000","last_unstale":"2024-05-28T06:12:31.794523+0000","last_undegraded":"2024-05-28T06:12:31.794523+0000","last_fullsized":"2024-05-28T06:12:31.794523+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:05:18.369078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.804777+0000","last_change":"2024-05-28T06:12:31.799285+0000","last_active":"2024-05-28T06:12:31.804777+0000","last_peered":"2024-05-28T06:12:31.804777+0000","last_clean":"2024-05-28T06:12:31.804777+0000","last_became_active":"2024-05-28T06:12:31.798652+0000","last_became_peered":"2024-05-28T06:12:31.798652+0000","last_unstale":"2024-05-28T06:12:31.804777+0000","last_undegraded":"2024-05-28T06:12:31.804777+0000","last_fullsized":"2024-05-28T06:12:31.804777+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:37:56.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.805298+0000","last_change":"2024-05-28T06:12:31.802895+0000","last_active":"2024-05-28T06:12:31.805298+0000","last_peered":"2024-05-28T06:12:31.805298+0000","last_clean":"2024-05-28T06:12:31.805298+0000","last_became_active":"2024-05-28T06:12:31.795520+0000","last_became_peered":"2024-05-28T06:12:31.795520+0000","last_unstale":"2024-05-28T06:12:31.805298+0000","last_undegraded":"2024-05-28T06:12:31.805298+0000","last_fullsized":"2024-05-28T06:12:31.805298+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:56:04.195855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.810250+0000","last_change":"2024-05-28T06:12:31.806502+0000","last_active":"2024-05-28T06:12:31.810250+0000","last_peered":"2024-05-28T06:12:31.810250+0000","last_clean":"2024-05-28T06:12:31.810250+0000","last_became_active":"2024-05-28T06:12:31.805993+0000","last_became_peered":"2024-05-28T06:12:31.805993+0000","last_unstale":"2024-05-28T06:12:31.810250+0000","last_undegraded":"2024-05-28T06:12:31.810250+0000","last_fullsized":"2024-05-28T06:12:31.810250+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:39:57.840865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.806293+0000","last_change":"2024-05-28T06:12:31.801483+0000","last_active":"2024-05-28T06:12:31.806293+0000","last_peered":"2024-05-28T06:12:31.806293+0000","last_clean":"2024-05-28T06:12:31.806293+0000","last_became_active":"2024-05-28T06:12:31.801026+0000","last_became_peered":"2024-05-28T06:12:31.801026+0000","last_unstale":"2024-05-28T06:12:31.806293+0000","last_undegraded":"2024-05-28T06:12:31.806293+0000","last_fullsized":"2024-05-28T06:12:31.806293+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:11:30.709739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.801817+0000","last_change":"2024-05-28T06:12:31.798043+0000","last_active":"2024-05-28T06:12:31.801817+0000","last_peered":"2024-05-28T06:12:31.801817+0000","last_clean":"2024-05-28T06:12:31.801817+0000","last_became_active":"2024-05-28T06:12:31.794016+0000","last_became_peered":"2024-05-28T06:12:31.794016+0000","last_unstale":"2024-05-28T06:12:31.801817+0000","last_undegraded":"2024-05-28T06:12:31.801817+0000","last_fullsized":"2024-05-28T06:12:31.801817+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:50:58.603324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.795018+0000","last_change":"2024-05-28T06:12:31.788822+0000","last_active":"2024-05-28T06:12:31.795018+0000","last_peered":"2024-05-28T06:12:31.795018+0000","last_clean":"2024-05-28T06:12:31.795018+0000","last_became_active":"2024-05-28T06:12:31.788550+0000","last_became_peered":"2024-05-28T06:12:31.788550+0000","last_unstale":"2024-05-28T06:12:31.795018+0000","last_undegraded":"2024-05-28T06:12:31.795018+0000","last_fullsized":"2024-05-28T06:12:31.795018+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:13:29.656977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.799830+0000","last_change":"2024-05-28T06:12:31.793103+0000","last_active":"2024-05-28T06:12:31.799830+0000","last_peered":"2024-05-28T06:12:31.799830+0000","last_clean":"2024-05-28T06:12:31.799830+0000","last_became_active":"2024-05-28T06:12:31.792595+0000","last_became_peered":"2024-05-28T06:12:31.792595+0000","last_unstale":"2024-05-28T06:12:31.799830+0000","last_undegraded":"2024-05-28T06:12:31.799830+0000","last_fullsized":"2024-05-28T06:12:31.799830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:42:44.413357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.804187+0000","last_change":"2024-05-28T06:12:31.800295+0000","last_active":"2024-05-28T06:12:31.804187+0000","last_peered":"2024-05-28T06:12:31.804187+0000","last_clean":"2024-05-28T06:12:31.804187+0000","last_became_active":"2024-05-28T06:12:31.800042+0000","last_became_peered":"2024-05-28T06:12:31.800042+0000","last_unstale":"2024-05-28T06:12:31.804187+0000","last_undegraded":"2024-05-28T06:12:31.804187+0000","last_fullsized":"2024-05-28T06:12:31.804187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:41:22.114684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.805403+0000","last_change":"2024-05-28T06:12:31.798980+0000","last_active":"2024-05-28T06:12:31.805403+0000","last_peered":"2024-05-28T06:12:31.805403+0000","last_clean":"2024-05-28T06:12:31.805403+0000","last_became_active":"2024-05-28T06:12:31.798695+0000","last_became_peered":"2024-05-28T06:12:31.798695+0000","last_unstale":"2024-05-28T06:12:31.805403+0000","last_undegraded":"2024-05-28T06:12:31.805403+0000","last_fullsized":"2024-05-28T06:12:31.805403+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:06:02.059732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.809949+0000","last_change":"2024-05-28T06:12:31.803916+0000","last_active":"2024-05-28T06:12:31.809949+0000","last_peered":"2024-05-28T06:12:31.809949+0000","last_clean":"2024-05-28T06:12:31.809949+0000","last_became_active":"2024-05-28T06:12:31.803396+0000","last_became_peered":"2024-05-28T06:12:31.803396+0000","last_unstale":"2024-05-28T06:12:31.809949+0000","last_undegraded":"2024-05-28T06:12:31.809949+0000","last_fullsized":"2024-05-28T06:12:31.809949+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:14:40.573174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.801956+0000","last_change":"2024-05-28T06:12:31.797444+0000","last_active":"2024-05-28T06:12:31.801956+0000","last_peered":"2024-05-28T06:12:31.801956+0000","last_clean":"2024-05-28T06:12:31.801956+0000","last_became_active":"2024-05-28T06:12:31.797170+0000","last_became_peered":"2024-05-28T06:12:31.797170+0000","last_unstale":"2024-05-28T06:12:31.801956+0000","last_undegraded":"2024-05-28T06:12:31.801956+0000","last_fullsized":"2024-05-28T06:12:31.801956+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:36:21.502162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.796636+0000","last_change":"2024-05-28T06:12:31.787961+0000","last_active":"2024-05-28T06:12:31.796636+0000","last_peered":"2024-05-28T06:12:31.796636+0000","last_clean":"2024-05-28T06:12:31.796636+0000","last_became_active":"2024-05-28T06:12:31.787700+0000","last_became_peered":"2024-05-28T06:12:31.787700+0000","last_unstale":"2024-05-28T06:12:31.796636+0000","last_undegraded":"2024-05-28T06:12:31.796636+0000","last_fullsized":"2024-05-28T06:12:31.796636+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:20:41.476613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.805234+0000","last_change":"2024-05-28T06:12:31.802935+0000","last_active":"2024-05-28T06:12:31.805234+0000","last_peered":"2024-05-28T06:12:31.805234+0000","last_clean":"2024-05-28T06:12:31.805234+0000","last_became_active":"2024-05-28T06:12:31.802678+0000","last_became_peered":"2024-05-28T06:12:31.802678+0000","last_unstale":"2024-05-28T06:12:31.805234+0000","last_undegraded":"2024-05-28T06:12:31.805234+0000","last_fullsized":"2024-05-28T06:12:31.805234+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:59:14.477995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.815132+0000","last_change":"2024-05-28T06:12:30.791032+0000","last_active":"2024-05-28T06:12:31.815132+0000","last_peered":"2024-05-28T06:12:31.815132+0000","last_clean":"2024-05-28T06:12:31.815132+0000","last_became_active":"2024-05-28T06:12:30.790720+0000","last_became_peered":"2024-05-28T06:12:30.790720+0000","last_unstale":"2024-05-28T06:12:31.815132+0000","last_undegraded":"2024-05-28T06:12:31.815132+0000","last_fullsized":"2024-05-28T06:12:31.815132+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:02:31.893460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.811935+0000","last_change":"2024-05-28T06:12:31.801501+0000","last_active":"2024-05-28T06:12:31.811935+0000","last_peered":"2024-05-28T06:12:31.811935+0000","last_clean":"2024-05-28T06:12:31.811935+0000","last_became_active":"2024-05-28T06:12:31.801239+0000","last_became_peered":"2024-05-28T06:12:31.801239+0000","last_unstale":"2024-05-28T06:12:31.811935+0000","last_undegraded":"2024-05-28T06:12:31.811935+0000","last_fullsized":"2024-05-28T06:12:31.811935+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:35:12.821821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.813419+0000","last_change":"2024-05-28T06:12:30.799690+0000","last_active":"2024-05-28T06:12:31.813419+0000","last_peered":"2024-05-28T06:12:31.813419+0000","last_clean":"2024-05-28T06:12:31.813419+0000","last_became_active":"2024-05-28T06:12:30.799345+0000","last_became_peered":"2024-05-28T06:12:30.799345+0000","last_unstale":"2024-05-28T06:12:31.813419+0000","last_undegraded":"2024-05-28T06:12:31.813419+0000","last_fullsized":"2024-05-28T06:12:31.813419+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:53:56.132162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.796323+0000","last_change":"2024-05-28T06:12:31.787304+0000","last_active":"2024-05-28T06:12:31.796323+0000","last_peered":"2024-05-28T06:12:31.796323+0000","last_clean":"2024-05-28T06:12:31.796323+0000","last_became_active":"2024-05-28T06:12:31.786982+0000","last_became_peered":"2024-05-28T06:12:31.786982+0000","last_unstale":"2024-05-28T06:12:31.796323+0000","last_undegraded":"2024-05-28T06:12:31.796323+0000","last_fullsized":"2024-05-28T06:12:31.796323+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:14:40.573174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.814510+0000","last_change":"2024-05-28T06:12:30.784064+0000","last_active":"2024-05-28T06:12:31.814510+0000","last_peered":"2024-05-28T06:12:31.814510+0000","last_clean":"2024-05-28T06:12:31.814510+0000","last_became_active":"2024-05-28T06:12:30.783801+0000","last_became_peered":"2024-05-28T06:12:30.783801+0000","last_unstale":"2024-05-28T06:12:31.814510+0000","last_undegraded":"2024-05-28T06:12:31.814510+0000","last_fullsized":"2024-05-28T06:12:31.814510+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:21:00.162134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.803992+0000","last_change":"2024-05-28T06:12:31.799781+0000","last_active":"2024-05-28T06:12:31.803992+0000","last_peered":"2024-05-28T06:12:31.803992+0000","last_clean":"2024-05-28T06:12:31.803992+0000","last_became_active":"2024-05-28T06:12:31.799517+0000","last_became_peered":"2024-05-28T06:12:31.799517+0000","last_unstale":"2024-05-28T06:12:31.803992+0000","last_undegraded":"2024-05-28T06:12:31.803992+0000","last_fullsized":"2024-05-28T06:12:31.803992+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:22:57.588310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.811408+0000","last_change":"2024-05-28T06:12:30.795765+0000","last_active":"2024-05-28T06:12:31.811408+0000","last_peered":"2024-05-28T06:12:31.811408+0000","last_clean":"2024-05-28T06:12:31.811408+0000","last_became_active":"2024-05-28T06:12:30.795164+0000","last_became_peered":"2024-05-28T06:12:30.795164+0000","last_unstale":"2024-05-28T06:12:31.811408+0000","last_undegraded":"2024-05-28T06:12:31.811408+0000","last_fullsized":"2024-05-28T06:12:31.811408+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:20:40.469531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.805276+0000","last_change":"2024-05-28T06:12:31.801832+0000","last_active":"2024-05-28T06:12:31.805276+0000","last_peered":"2024-05-28T06:12:31.805276+0000","last_clean":"2024-05-28T06:12:31.805276+0000","last_became_active":"2024-05-28T06:12:31.795154+0000","last_became_peered":"2024-05-28T06:12:31.795154+0000","last_unstale":"2024-05-28T06:12:31.805276+0000","last_undegraded":"2024-05-28T06:12:31.805276+0000","last_fullsized":"2024-05-28T06:12:31.805276+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:20:06.541682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.813901+0000","last_change":"2024-05-28T06:12:30.793046+0000","last_active":"2024-05-28T06:12:31.813901+0000","last_peered":"2024-05-28T06:12:31.813901+0000","last_clean":"2024-05-28T06:12:31.813901+0000","last_became_active":"2024-05-28T06:12:30.792752+0000","last_became_peered":"2024-05-28T06:12:30.792752+0000","last_unstale":"2024-05-28T06:12:31.813901+0000","last_undegraded":"2024-05-28T06:12:31.813901+0000","last_fullsized":"2024-05-28T06:12:31.813901+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:03:08.736169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.794152+0000","last_change":"2024-05-28T06:12:31.789865+0000","last_active":"2024-05-28T06:12:31.794152+0000","last_peered":"2024-05-28T06:12:31.794152+0000","last_clean":"2024-05-28T06:12:31.794152+0000","last_became_active":"2024-05-28T06:12:31.789614+0000","last_became_peered":"2024-05-28T06:12:31.789614+0000","last_unstale":"2024-05-28T06:12:31.794152+0000","last_undegraded":"2024-05-28T06:12:31.794152+0000","last_fullsized":"2024-05-28T06:12:31.794152+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:17:35.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.813511+0000","last_change":"2024-05-28T06:12:30.790331+0000","last_active":"2024-05-28T06:12:31.813511+0000","last_peered":"2024-05-28T06:12:31.813511+0000","last_clean":"2024-05-28T06:12:31.813511+0000","last_became_active":"2024-05-28T06:12:30.790028+0000","last_became_peered":"2024-05-28T06:12:30.790028+0000","last_unstale":"2024-05-28T06:12:31.813511+0000","last_undegraded":"2024-05-28T06:12:31.813511+0000","last_fullsized":"2024-05-28T06:12:31.813511+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:01:52.086398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.802974+0000","last_change":"2024-05-28T06:12:31.798571+0000","last_active":"2024-05-28T06:12:31.802974+0000","last_peered":"2024-05-28T06:12:31.802974+0000","last_clean":"2024-05-28T06:12:31.802974+0000","last_became_active":"2024-05-28T06:12:31.797004+0000","last_became_peered":"2024-05-28T06:12:31.797004+0000","last_unstale":"2024-05-28T06:12:31.802974+0000","last_undegraded":"2024-05-28T06:12:31.802974+0000","last_fullsized":"2024-05-28T06:12:31.802974+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:48:47.654123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.785967+0000","last_change":"2024-05-28T06:12:30.792493+0000","last_active":"2024-05-28T06:12:31.785967+0000","last_peered":"2024-05-28T06:12:31.785967+0000","last_clean":"2024-05-28T06:12:31.785967+0000","last_became_active":"2024-05-28T06:12:30.791832+0000","last_became_peered":"2024-05-28T06:12:30.791832+0000","last_unstale":"2024-05-28T06:12:31.785967+0000","last_undegraded":"2024-05-28T06:12:31.785967+0000","last_fullsized":"2024-05-28T06:12:31.785967+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:02:31.893460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.805775+0000","last_change":"2024-05-28T06:12:31.804063+0000","last_active":"2024-05-28T06:12:31.805775+0000","last_peered":"2024-05-28T06:12:31.805775+0000","last_clean":"2024-05-28T06:12:31.805775+0000","last_became_active":"2024-05-28T06:12:31.803791+0000","last_became_peered":"2024-05-28T06:12:31.803791+0000","last_unstale":"2024-05-28T06:12:31.805775+0000","last_undegraded":"2024-05-28T06:12:31.805775+0000","last_fullsized":"2024-05-28T06:12:31.805775+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:22:16.350437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.782356+0000","last_change":"2024-05-28T06:12:30.792385+0000","last_active":"2024-05-28T06:12:31.782356+0000","last_peered":"2024-05-28T06:12:31.782356+0000","last_clean":"2024-05-28T06:12:31.782356+0000","last_became_active":"2024-05-28T06:12:30.789854+0000","last_became_peered":"2024-05-28T06:12:30.789854+0000","last_unstale":"2024-05-28T06:12:31.782356+0000","last_undegraded":"2024-05-28T06:12:31.782356+0000","last_fullsized":"2024-05-28T06:12:31.782356+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:52:08.811888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.793733+0000","last_change":"2024-05-28T06:12:31.791507+0000","last_active":"2024-05-28T06:12:31.793733+0000","last_peered":"2024-05-28T06:12:31.793733+0000","last_clean":"2024-05-28T06:12:31.793733+0000","last_became_active":"2024-05-28T06:12:31.788910+0000","last_became_peered":"2024-05-28T06:12:31.788910+0000","last_unstale":"2024-05-28T06:12:31.793733+0000","last_undegraded":"2024-05-28T06:12:31.793733+0000","last_fullsized":"2024-05-28T06:12:31.793733+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:14:40.573174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.794231+0000","last_change":"2024-05-28T06:12:30.796608+0000","last_active":"2024-05-28T06:12:31.794231+0000","last_peered":"2024-05-28T06:12:31.794231+0000","last_clean":"2024-05-28T06:12:31.794231+0000","last_became_active":"2024-05-28T06:12:30.796011+0000","last_became_peered":"2024-05-28T06:12:30.796011+0000","last_unstale":"2024-05-28T06:12:31.794231+0000","last_undegraded":"2024-05-28T06:12:31.794231+0000","last_fullsized":"2024-05-28T06:12:31.794231+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:03:08.736169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.810185+0000","last_change":"2024-05-28T06:12:31.807786+0000","last_active":"2024-05-28T06:12:31.810185+0000","last_peered":"2024-05-28T06:12:31.810185+0000","last_clean":"2024-05-28T06:12:31.810185+0000","last_became_active":"2024-05-28T06:12:31.807524+0000","last_became_peered":"2024-05-28T06:12:31.807524+0000","last_unstale":"2024-05-28T06:12:31.810185+0000","last_undegraded":"2024-05-28T06:12:31.810185+0000","last_fullsized":"2024-05-28T06:12:31.810185+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:33:08.387840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.785445+0000","last_change":"2024-05-28T06:12:30.798374+0000","last_active":"2024-05-28T06:12:31.785445+0000","last_peered":"2024-05-28T06:12:31.785445+0000","last_clean":"2024-05-28T06:12:31.785445+0000","last_became_active":"2024-05-28T06:12:30.798033+0000","last_became_peered":"2024-05-28T06:12:30.798033+0000","last_unstale":"2024-05-28T06:12:31.785445+0000","last_undegraded":"2024-05-28T06:12:31.785445+0000","last_fullsized":"2024-05-28T06:12:31.785445+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:30:33.083208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.794215+0000","last_change":"2024-05-28T06:12:31.791600+0000","last_active":"2024-05-28T06:12:31.794215+0000","last_peered":"2024-05-28T06:12:31.794215+0000","last_clean":"2024-05-28T06:12:31.794215+0000","last_became_active":"2024-05-28T06:12:31.789590+0000","last_became_peered":"2024-05-28T06:12:31.789590+0000","last_unstale":"2024-05-28T06:12:31.794215+0000","last_undegraded":"2024-05-28T06:12:31.794215+0000","last_fullsized":"2024-05-28T06:12:31.794215+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:06:24.203533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.811491+0000","last_change":"2024-05-28T06:12:30.794636+0000","last_active":"2024-05-28T06:12:31.811491+0000","last_peered":"2024-05-28T06:12:31.811491+0000","last_clean":"2024-05-28T06:12:31.811491+0000","last_became_active":"2024-05-28T06:12:30.794322+0000","last_became_peered":"2024-05-28T06:12:30.794322+0000","last_unstale":"2024-05-28T06:12:31.811491+0000","last_undegraded":"2024-05-28T06:12:31.811491+0000","last_fullsized":"2024-05-28T06:12:31.811491+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:21:00.162134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.810401+0000","last_change":"2024-05-28T06:12:31.806694+0000","last_active":"2024-05-28T06:12:31.810401+0000","last_peered":"2024-05-28T06:12:31.810401+0000","last_clean":"2024-05-28T06:12:31.810401+0000","last_became_active":"2024-05-28T06:12:31.806339+0000","last_became_peered":"2024-05-28T06:12:31.806339+0000","last_unstale":"2024-05-28T06:12:31.810401+0000","last_undegraded":"2024-05-28T06:12:31.810401+0000","last_fullsized":"2024-05-28T06:12:31.810401+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:22:57.588310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.815755+0000","last_change":"2024-05-28T06:12:30.791461+0000","last_active":"2024-05-28T06:12:31.815755+0000","last_peered":"2024-05-28T06:12:31.815755+0000","last_clean":"2024-05-28T06:12:31.815755+0000","last_became_active":"2024-05-28T06:12:30.791190+0000","last_became_peered":"2024-05-28T06:12:30.791190+0000","last_unstale":"2024-05-28T06:12:31.815755+0000","last_undegraded":"2024-05-28T06:12:31.815755+0000","last_fullsized":"2024-05-28T06:12:31.815755+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:01:52.086398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.797670+0000","last_change":"2024-05-28T06:12:31.796224+0000","last_active":"2024-05-28T06:12:31.797670+0000","last_peered":"2024-05-28T06:12:31.797670+0000","last_clean":"2024-05-28T06:12:31.797670+0000","last_became_active":"2024-05-28T06:12:31.794242+0000","last_became_peered":"2024-05-28T06:12:31.794242+0000","last_unstale":"2024-05-28T06:12:31.797670+0000","last_undegraded":"2024-05-28T06:12:31.797670+0000","last_fullsized":"2024-05-28T06:12:31.797670+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:33:08.387840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.815512+0000","last_change":"2024-05-28T06:12:30.794765+0000","last_active":"2024-05-28T06:12:31.815512+0000","last_peered":"2024-05-28T06:12:31.815512+0000","last_clean":"2024-05-28T06:12:31.815512+0000","last_became_active":"2024-05-28T06:12:30.794488+0000","last_became_peered":"2024-05-28T06:12:30.794488+0000","last_unstale":"2024-05-28T06:12:31.815512+0000","last_undegraded":"2024-05-28T06:12:31.815512+0000","last_fullsized":"2024-05-28T06:12:31.815512+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:30:31.483489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.809586+0000","last_change":"2024-05-28T06:12:31.803083+0000","last_active":"2024-05-28T06:12:31.809586+0000","last_peered":"2024-05-28T06:12:31.809586+0000","last_clean":"2024-05-28T06:12:31.809586+0000","last_became_active":"2024-05-28T06:12:31.802789+0000","last_became_peered":"2024-05-28T06:12:31.802789+0000","last_unstale":"2024-05-28T06:12:31.809586+0000","last_undegraded":"2024-05-28T06:12:31.809586+0000","last_fullsized":"2024-05-28T06:12:31.809586+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:31:15.983892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.796348+0000","last_change":"2024-05-28T06:12:30.795959+0000","last_active":"2024-05-28T06:12:31.796348+0000","last_peered":"2024-05-28T06:12:31.796348+0000","last_clean":"2024-05-28T06:12:31.796348+0000","last_became_active":"2024-05-28T06:12:30.795666+0000","last_became_peered":"2024-05-28T06:12:30.795666+0000","last_unstale":"2024-05-28T06:12:31.796348+0000","last_undegraded":"2024-05-28T06:12:31.796348+0000","last_fullsized":"2024-05-28T06:12:31.796348+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:52:42.932309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.799951+0000","last_change":"2024-05-28T06:12:31.795558+0000","last_active":"2024-05-28T06:12:31.799951+0000","last_peered":"2024-05-28T06:12:31.799951+0000","last_clean":"2024-05-28T06:12:31.799951+0000","last_became_active":"2024-05-28T06:12:31.795281+0000","last_became_peered":"2024-05-28T06:12:31.795281+0000","last_unstale":"2024-05-28T06:12:31.799951+0000","last_undegraded":"2024-05-28T06:12:31.799951+0000","last_fullsized":"2024-05-28T06:12:31.799951+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:20:41.476613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.786052+0000","last_change":"2024-05-28T06:12:30.792703+0000","last_active":"2024-05-28T06:12:31.786052+0000","last_peered":"2024-05-28T06:12:31.786052+0000","last_clean":"2024-05-28T06:12:31.786052+0000","last_became_active":"2024-05-28T06:12:30.792218+0000","last_became_peered":"2024-05-28T06:12:30.792218+0000","last_unstale":"2024-05-28T06:12:31.786052+0000","last_undegraded":"2024-05-28T06:12:31.786052+0000","last_fullsized":"2024-05-28T06:12:31.786052+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:14:39.566092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.810228+0000","last_change":"2024-05-28T06:12:31.806242+0000","last_active":"2024-05-28T06:12:31.810228+0000","last_peered":"2024-05-28T06:12:31.810228+0000","last_clean":"2024-05-28T06:12:31.810228+0000","last_became_active":"2024-05-28T06:12:31.805628+0000","last_became_peered":"2024-05-28T06:12:31.805628+0000","last_unstale":"2024-05-28T06:12:31.810228+0000","last_undegraded":"2024-05-28T06:12:31.810228+0000","last_fullsized":"2024-05-28T06:12:31.810228+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:13:29.656977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.814580+0000","last_change":"2024-05-28T06:12:30.797372+0000","last_active":"2024-05-28T06:12:31.814580+0000","last_peered":"2024-05-28T06:12:31.814580+0000","last_clean":"2024-05-28T06:12:31.814580+0000","last_became_active":"2024-05-28T06:12:30.797105+0000","last_became_peered":"2024-05-28T06:12:30.797105+0000","last_unstale":"2024-05-28T06:12:31.814580+0000","last_undegraded":"2024-05-28T06:12:31.814580+0000","last_fullsized":"2024-05-28T06:12:31.814580+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:01:52.086398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.809998+0000","last_change":"2024-05-28T06:12:31.802256+0000","last_active":"2024-05-28T06:12:31.809998+0000","last_peered":"2024-05-28T06:12:31.809998+0000","last_clean":"2024-05-28T06:12:31.809998+0000","last_became_active":"2024-05-28T06:12:31.800610+0000","last_became_peered":"2024-05-28T06:12:31.800610+0000","last_unstale":"2024-05-28T06:12:31.809998+0000","last_undegraded":"2024-05-28T06:12:31.809998+0000","last_fullsized":"2024-05-28T06:12:31.809998+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:54:31.487426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.815298+0000","last_change":"2024-05-28T06:12:30.797106+0000","last_active":"2024-05-28T06:12:31.815298+0000","last_peered":"2024-05-28T06:12:31.815298+0000","last_clean":"2024-05-28T06:12:31.815298+0000","last_became_active":"2024-05-28T06:12:30.795350+0000","last_became_peered":"2024-05-28T06:12:30.795350+0000","last_unstale":"2024-05-28T06:12:31.815298+0000","last_undegraded":"2024-05-28T06:12:31.815298+0000","last_fullsized":"2024-05-28T06:12:31.815298+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:24:27.852847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.797857+0000","last_change":"2024-05-28T06:12:31.794618+0000","last_active":"2024-05-28T06:12:31.797857+0000","last_peered":"2024-05-28T06:12:31.797857+0000","last_clean":"2024-05-28T06:12:31.797857+0000","last_became_active":"2024-05-28T06:12:31.794358+0000","last_became_peered":"2024-05-28T06:12:31.794358+0000","last_unstale":"2024-05-28T06:12:31.797857+0000","last_undegraded":"2024-05-28T06:12:31.797857+0000","last_fullsized":"2024-05-28T06:12:31.797857+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:39:57.840865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.815308+0000","last_change":"2024-05-28T06:12:30.793010+0000","last_active":"2024-05-28T06:12:31.815308+0000","last_peered":"2024-05-28T06:12:31.815308+0000","last_clean":"2024-05-28T06:12:31.815308+0000","last_became_active":"2024-05-28T06:12:30.792705+0000","last_became_peered":"2024-05-28T06:12:30.792705+0000","last_unstale":"2024-05-28T06:12:31.815308+0000","last_undegraded":"2024-05-28T06:12:31.815308+0000","last_fullsized":"2024-05-28T06:12:31.815308+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:37:55.600898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.802490+0000","last_change":"2024-05-28T06:12:31.790772+0000","last_active":"2024-05-28T06:12:31.802490+0000","last_peered":"2024-05-28T06:12:31.802490+0000","last_clean":"2024-05-28T06:12:31.802490+0000","last_became_active":"2024-05-28T06:12:31.790509+0000","last_became_peered":"2024-05-28T06:12:31.790509+0000","last_unstale":"2024-05-28T06:12:31.802490+0000","last_undegraded":"2024-05-28T06:12:31.802490+0000","last_fullsized":"2024-05-28T06:12:31.802490+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:15:23.080919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.811312+0000","last_change":"2024-05-28T06:12:30.797084+0000","last_active":"2024-05-28T06:12:31.811312+0000","last_peered":"2024-05-28T06:12:31.811312+0000","last_clean":"2024-05-28T06:12:31.811312+0000","last_became_active":"2024-05-28T06:12:30.795903+0000","last_became_peered":"2024-05-28T06:12:30.795903+0000","last_unstale":"2024-05-28T06:12:31.811312+0000","last_undegraded":"2024-05-28T06:12:31.811312+0000","last_fullsized":"2024-05-28T06:12:31.811312+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:54:30.480345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.810656+0000","last_change":"2024-05-28T06:12:31.809139+0000","last_active":"2024-05-28T06:12:31.810656+0000","last_peered":"2024-05-28T06:12:31.810656+0000","last_clean":"2024-05-28T06:12:31.810656+0000","last_became_active":"2024-05-28T06:12:31.807373+0000","last_became_peered":"2024-05-28T06:12:31.807373+0000","last_unstale":"2024-05-28T06:12:31.810656+0000","last_undegraded":"2024-05-28T06:12:31.810656+0000","last_fullsized":"2024-05-28T06:12:31.810656+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:44:33.675058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.778378+0000","last_change":"2024-05-28T06:12:30.793875+0000","last_active":"2024-05-28T06:12:31.778378+0000","last_peered":"2024-05-28T06:12:31.778378+0000","last_clean":"2024-05-28T06:12:31.778378+0000","last_became_active":"2024-05-28T06:12:30.793587+0000","last_became_peered":"2024-05-28T06:12:30.793587+0000","last_unstale":"2024-05-28T06:12:31.778378+0000","last_undegraded":"2024-05-28T06:12:31.778378+0000","last_fullsized":"2024-05-28T06:12:31.778378+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:03:08.736169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.797644+0000","last_change":"2024-05-28T06:12:31.794925+0000","last_active":"2024-05-28T06:12:31.797644+0000","last_peered":"2024-05-28T06:12:31.797644+0000","last_clean":"2024-05-28T06:12:31.797644+0000","last_became_active":"2024-05-28T06:12:31.793880+0000","last_became_peered":"2024-05-28T06:12:31.793880+0000","last_unstale":"2024-05-28T06:12:31.797644+0000","last_undegraded":"2024-05-28T06:12:31.797644+0000","last_fullsized":"2024-05-28T06:12:31.797644+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:22:57.588310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.814170+0000","last_change":"2024-05-28T06:12:30.794189+0000","last_active":"2024-05-28T06:12:31.814170+0000","last_peered":"2024-05-28T06:12:31.814170+0000","last_clean":"2024-05-28T06:12:31.814170+0000","last_became_active":"2024-05-28T06:12:30.793922+0000","last_became_peered":"2024-05-28T06:12:30.793922+0000","last_unstale":"2024-05-28T06:12:31.814170+0000","last_undegraded":"2024-05-28T06:12:31.814170+0000","last_fullsized":"2024-05-28T06:12:31.814170+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:08:25.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.802455+0000","last_change":"2024-05-28T06:12:31.797123+0000","last_active":"2024-05-28T06:12:31.802455+0000","last_peered":"2024-05-28T06:12:31.802455+0000","last_clean":"2024-05-28T06:12:31.802455+0000","last_became_active":"2024-05-28T06:12:31.796849+0000","last_became_peered":"2024-05-28T06:12:31.796849+0000","last_unstale":"2024-05-28T06:12:31.802455+0000","last_undegraded":"2024-05-28T06:12:31.802455+0000","last_fullsized":"2024-05-28T06:12:31.802455+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:13:29.656977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.783112+0000","last_change":"2024-05-28T06:12:30.796022+0000","last_active":"2024-05-28T06:12:31.783112+0000","last_peered":"2024-05-28T06:12:31.783112+0000","last_clean":"2024-05-28T06:12:31.783112+0000","last_became_active":"2024-05-28T06:12:30.794505+0000","last_became_peered":"2024-05-28T06:12:30.794505+0000","last_unstale":"2024-05-28T06:12:31.783112+0000","last_undegraded":"2024-05-28T06:12:31.783112+0000","last_fullsized":"2024-05-28T06:12:31.783112+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:32:08.488200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.805194+0000","last_change":"2024-05-28T06:12:31.802246+0000","last_active":"2024-05-28T06:12:31.805194+0000","last_peered":"2024-05-28T06:12:31.805194+0000","last_clean":"2024-05-28T06:12:31.805194+0000","last_became_active":"2024-05-28T06:12:31.801961+0000","last_became_peered":"2024-05-28T06:12:31.801961+0000","last_unstale":"2024-05-28T06:12:31.805194+0000","last_undegraded":"2024-05-28T06:12:31.805194+0000","last_fullsized":"2024-05-28T06:12:31.805194+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:44:33.675058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.785981+0000","last_change":"2024-05-28T06:12:30.790810+0000","last_active":"2024-05-28T06:12:31.785981+0000","last_peered":"2024-05-28T06:12:31.785981+0000","last_clean":"2024-05-28T06:12:31.785981+0000","last_became_active":"2024-05-28T06:12:30.790513+0000","last_became_peered":"2024-05-28T06:12:30.790513+0000","last_unstale":"2024-05-28T06:12:31.785981+0000","last_undegraded":"2024-05-28T06:12:31.785981+0000","last_fullsized":"2024-05-28T06:12:31.785981+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:31:14.976810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.808559+0000","last_change":"2024-05-28T06:12:31.804263+0000","last_active":"2024-05-28T06:12:31.808559+0000","last_peered":"2024-05-28T06:12:31.808559+0000","last_clean":"2024-05-28T06:12:31.808559+0000","last_became_active":"2024-05-28T06:12:31.803936+0000","last_became_peered":"2024-05-28T06:12:31.803936+0000","last_unstale":"2024-05-28T06:12:31.808559+0000","last_undegraded":"2024-05-28T06:12:31.808559+0000","last_fullsized":"2024-05-28T06:12:31.808559+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:43:33.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.814533+0000","last_change":"2024-05-28T06:12:30.798073+0000","last_active":"2024-05-28T06:12:31.814533+0000","last_peered":"2024-05-28T06:12:31.814533+0000","last_clean":"2024-05-28T06:12:31.814533+0000","last_became_active":"2024-05-28T06:12:30.797794+0000","last_became_peered":"2024-05-28T06:12:30.797794+0000","last_unstale":"2024-05-28T06:12:31.814533+0000","last_undegraded":"2024-05-28T06:12:31.814533+0000","last_fullsized":"2024-05-28T06:12:31.814533+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:05:17.937721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.805302+0000","last_change":"2024-05-28T06:12:31.800014+0000","last_active":"2024-05-28T06:12:31.805302+0000","last_peered":"2024-05-28T06:12:31.805302+0000","last_clean":"2024-05-28T06:12:31.805302+0000","last_became_active":"2024-05-28T06:12:31.799714+0000","last_became_peered":"2024-05-28T06:12:31.799714+0000","last_unstale":"2024-05-28T06:12:31.805302+0000","last_undegraded":"2024-05-28T06:12:31.805302+0000","last_fullsized":"2024-05-28T06:12:31.805302+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:59:14.477995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.778857+0000","last_change":"2024-05-28T06:12:30.790726+0000","last_active":"2024-05-28T06:12:31.778857+0000","last_peered":"2024-05-28T06:12:31.778857+0000","last_clean":"2024-05-28T06:12:31.778857+0000","last_became_active":"2024-05-28T06:12:30.790486+0000","last_became_peered":"2024-05-28T06:12:30.790486+0000","last_unstale":"2024-05-28T06:12:31.778857+0000","last_undegraded":"2024-05-28T06:12:31.778857+0000","last_fullsized":"2024-05-28T06:12:31.778857+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:31:14.976810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.794192+0000","last_change":"2024-05-28T06:12:31.791575+0000","last_active":"2024-05-28T06:12:31.794192+0000","last_peered":"2024-05-28T06:12:31.794192+0000","last_clean":"2024-05-28T06:12:31.794192+0000","last_became_active":"2024-05-28T06:12:31.789316+0000","last_became_peered":"2024-05-28T06:12:31.789316+0000","last_unstale":"2024-05-28T06:12:31.794192+0000","last_undegraded":"2024-05-28T06:12:31.794192+0000","last_fullsized":"2024-05-28T06:12:31.794192+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:48:47.654123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.796467+0000","last_change":"2024-05-28T06:12:30.791618+0000","last_active":"2024-05-28T06:12:31.796467+0000","last_peered":"2024-05-28T06:12:31.796467+0000","last_clean":"2024-05-28T06:12:31.796467+0000","last_became_active":"2024-05-28T06:12:30.791296+0000","last_became_peered":"2024-05-28T06:12:30.791296+0000","last_unstale":"2024-05-28T06:12:31.796467+0000","last_undegraded":"2024-05-28T06:12:31.796467+0000","last_fullsized":"2024-05-28T06:12:31.796467+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:32:08.488200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.803971+0000","last_change":"2024-05-28T06:12:31.799676+0000","last_active":"2024-05-28T06:12:31.803971+0000","last_peered":"2024-05-28T06:12:31.803971+0000","last_clean":"2024-05-28T06:12:31.803971+0000","last_became_active":"2024-05-28T06:12:31.799396+0000","last_became_peered":"2024-05-28T06:12:31.799396+0000","last_unstale":"2024-05-28T06:12:31.803971+0000","last_undegraded":"2024-05-28T06:12:31.803971+0000","last_fullsized":"2024-05-28T06:12:31.803971+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:39:57.840865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.787712+0000","last_change":"2024-05-28T06:12:30.790898+0000","last_active":"2024-05-28T06:12:31.787712+0000","last_peered":"2024-05-28T06:12:31.787712+0000","last_clean":"2024-05-28T06:12:31.787712+0000","last_became_active":"2024-05-28T06:12:30.790609+0000","last_became_peered":"2024-05-28T06:12:30.790609+0000","last_unstale":"2024-05-28T06:12:31.787712+0000","last_undegraded":"2024-05-28T06:12:31.787712+0000","last_fullsized":"2024-05-28T06:12:31.787712+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:42:43.406276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.804378+0000","last_change":"2024-05-28T06:12:31.793575+0000","last_active":"2024-05-28T06:12:31.804378+0000","last_peered":"2024-05-28T06:12:31.804378+0000","last_clean":"2024-05-28T06:12:31.804378+0000","last_became_active":"2024-05-28T06:12:31.792189+0000","last_became_peered":"2024-05-28T06:12:31.792189+0000","last_unstale":"2024-05-28T06:12:31.804378+0000","last_undegraded":"2024-05-28T06:12:31.804378+0000","last_fullsized":"2024-05-28T06:12:31.804378+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:57:14.404993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.781977+0000","last_change":"2024-05-28T06:12:30.787551+0000","last_active":"2024-05-28T06:12:31.781977+0000","last_peered":"2024-05-28T06:12:31.781977+0000","last_clean":"2024-05-28T06:12:31.781977+0000","last_became_active":"2024-05-28T06:12:30.786731+0000","last_became_peered":"2024-05-28T06:12:30.786731+0000","last_unstale":"2024-05-28T06:12:31.781977+0000","last_undegraded":"2024-05-28T06:12:31.781977+0000","last_fullsized":"2024-05-28T06:12:31.781977+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:57:56.110796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.810009+0000","last_change":"2024-05-28T06:12:31.804270+0000","last_active":"2024-05-28T06:12:31.810009+0000","last_peered":"2024-05-28T06:12:31.810009+0000","last_clean":"2024-05-28T06:12:31.810009+0000","last_became_active":"2024-05-28T06:12:31.803980+0000","last_became_peered":"2024-05-28T06:12:31.803980+0000","last_unstale":"2024-05-28T06:12:31.810009+0000","last_undegraded":"2024-05-28T06:12:31.810009+0000","last_fullsized":"2024-05-28T06:12:31.810009+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:20:41.476613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.780630+0000","last_change":"2024-05-28T06:12:30.790132+0000","last_active":"2024-05-28T06:12:31.780630+0000","last_peered":"2024-05-28T06:12:31.780630+0000","last_clean":"2024-05-28T06:12:31.780630+0000","last_became_active":"2024-05-28T06:12:30.789856+0000","last_became_peered":"2024-05-28T06:12:30.789856+0000","last_unstale":"2024-05-28T06:12:31.780630+0000","last_undegraded":"2024-05-28T06:12:31.780630+0000","last_fullsized":"2024-05-28T06:12:31.780630+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:05:08.097047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.808057+0000","last_change":"2024-05-28T06:12:31.801507+0000","last_active":"2024-05-28T06:12:31.808057+0000","last_peered":"2024-05-28T06:12:31.808057+0000","last_clean":"2024-05-28T06:12:31.808057+0000","last_became_active":"2024-05-28T06:12:31.801228+0000","last_became_peered":"2024-05-28T06:12:31.801228+0000","last_unstale":"2024-05-28T06:12:31.808057+0000","last_undegraded":"2024-05-28T06:12:31.808057+0000","last_fullsized":"2024-05-28T06:12:31.808057+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:09:57.797411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.782846+0000","last_change":"2024-05-28T06:12:30.790873+0000","last_active":"2024-05-28T06:12:31.782846+0000","last_peered":"2024-05-28T06:12:31.782846+0000","last_clean":"2024-05-28T06:12:31.782846+0000","last_became_active":"2024-05-28T06:12:30.790623+0000","last_became_peered":"2024-05-28T06:12:30.790623+0000","last_unstale":"2024-05-28T06:12:31.782846+0000","last_undegraded":"2024-05-28T06:12:31.782846+0000","last_fullsized":"2024-05-28T06:12:31.782846+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:52:42.932309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.805754+0000","last_change":"2024-05-28T06:12:31.803993+0000","last_active":"2024-05-28T06:12:31.805754+0000","last_peered":"2024-05-28T06:12:31.805754+0000","last_clean":"2024-05-28T06:12:31.805754+0000","last_became_active":"2024-05-28T06:12:31.803709+0000","last_became_peered":"2024-05-28T06:12:31.803709+0000","last_unstale":"2024-05-28T06:12:31.805754+0000","last_undegraded":"2024-05-28T06:12:31.805754+0000","last_fullsized":"2024-05-28T06:12:31.805754+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:24:30.029244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.783406+0000","last_change":"2024-05-28T06:12:30.793567+0000","last_active":"2024-05-28T06:12:31.783406+0000","last_peered":"2024-05-28T06:12:31.783406+0000","last_clean":"2024-05-28T06:12:31.783406+0000","last_became_active":"2024-05-28T06:12:30.793086+0000","last_became_peered":"2024-05-28T06:12:30.793086+0000","last_unstale":"2024-05-28T06:12:31.783406+0000","last_undegraded":"2024-05-28T06:12:31.783406+0000","last_fullsized":"2024-05-28T06:12:31.783406+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:55:15.450791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.794329+0000","last_change":"2024-05-28T06:12:31.789343+0000","last_active":"2024-05-28T06:12:31.794329+0000","last_peered":"2024-05-28T06:12:31.794329+0000","last_clean":"2024-05-28T06:12:31.794329+0000","last_became_active":"2024-05-28T06:12:31.789082+0000","last_became_peered":"2024-05-28T06:12:31.789082+0000","last_unstale":"2024-05-28T06:12:31.794329+0000","last_undegraded":"2024-05-28T06:12:31.794329+0000","last_fullsized":"2024-05-28T06:12:31.794329+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:22:44.741189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.796549+0000","last_change":"2024-05-28T06:12:30.796037+0000","last_active":"2024-05-28T06:12:31.796549+0000","last_peered":"2024-05-28T06:12:31.796549+0000","last_clean":"2024-05-28T06:12:31.796549+0000","last_became_active":"2024-05-28T06:12:30.795716+0000","last_became_peered":"2024-05-28T06:12:30.795716+0000","last_unstale":"2024-05-28T06:12:31.796549+0000","last_undegraded":"2024-05-28T06:12:31.796549+0000","last_fullsized":"2024-05-28T06:12:31.796549+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:17:05.591509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":245,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-28T06:12:31.791659+0000","last_change":"2024-05-28T06:05:38.517922+0000","last_active":"2024-05-28T06:12:31.791659+0000","last_peered":"2024-05-28T06:12:31.791659+0000","last_clean":"2024-05-28T06:12:31.791659+0000","last_became_active":"2024-05-28T06:05:38.514745+0000","last_became_peered":"2024-05-28T06:05:38.514745+0000","last_unstale":"2024-05-28T06:12:31.791659+0000","last_undegraded":"2024-05-28T06:12:31.791659+0000","last_fullsized":"2024-05-28T06:12:31.791659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_clean_scrub_stamp":"2024-05-28T06:05:37.485018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:23:27.978203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574935,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46380,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325460,"statfs":{"total":96636764160,"available":96589271040,"internally_reserved":0,"allocated":1335296,"data_stored":899229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574935,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45772,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326068,"statfs":{"total":96636764160,"available":96589893632,"internally_reserved":0,"allocated":720896,"data_stored":301898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574934,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44364,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327476,"statfs":{"total":96636764160,"available":96591335424,"internally_reserved":0,"allocated":720896,"data_stored":301898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45776,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326064,"statfs":{"total":96636764160,"available":96589889536,"internally_reserved":0,"allocated":720896,"data_stored":301898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49960,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321880,"statfs":{"total":96636764160,"available":96585605120,"internally_reserved":0,"allocated":741376,"data_stored":308757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574935,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45800,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326040,"statfs":{"total":96636764160,"available":96589864960,"internally_reserved":0,"allocated":741376,"data_stored":308757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45796,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326044,"statfs":{"total":96636764160,"available":96589869056,"internally_reserved":0,"allocated":737280,"data_stored":308791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46388,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325452,"statfs":{"total":96636764160,"available":96589262848,"internally_reserved":0,"allocated":1343488,"data_stored":901263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-28T06:12:36.262 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-28T06:12:36.262 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-28T06:12:36.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.446+0000 7f0a3ca00640 1 Processor -- start 2024-05-28T06:12:36.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.446+0000 7f0a3ca00640 1 -- start start 2024-05-28T06:12:36.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.450+0000 7f0a3ca00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a3815ebe0 0x7f0a380d1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:36.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.450+0000 7f0a3ca00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0a3806dbc0 0x7f0a380c8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:36.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.450+0000 7f0a3ca00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a380d18c0 con 0x7f0a3806ccb0 2024-05-28T06:12:36.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.450+0000 7f0a3ca00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f0a380cd240 con 0x7f0a3806dbc0 2024-05-28T06:12:36.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.450+0000 7f0a3ca00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0a380ccbf0 con 0x7f0a3815ebe0 2024-05-28T06:12:36.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.450+0000 7f0a37400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a3815ebe0 0x7f0a380d1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:36.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.450+0000 7f0a37e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0a3806dbc0 0x7f0a380c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:36.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.450+0000 7f0a36a00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0a3806ccb0 0x7f0a3806d4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:37406/0 (socket says 172.21.15.122:37406) 2024-05-28T06:12:36.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.450+0000 7f0a37400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a3815ebe0 0x7f0a380d1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:52300/0 (socket says 172.21.15.122:52300) 2024-05-28T06:12:36.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.450+0000 7f0a37e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0a3806dbc0 0x7f0a380c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:48852/0 (socket says 172.21.15.122:48852) 2024-05-28T06:12:36.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.450+0000 7f0a36a00640 1 -- 172.21.15.122:0/3062398081 learned_addr learned my addr 172.21.15.122:0/3062398081 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:36.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.450+0000 7f0a37400640 1 -- 172.21.15.122:0/3062398081 >> v2:172.21.15.153:3300/0 conn(0x7f0a3806dbc0 msgr2=0x7f0a380c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:36.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.450+0000 7f0a37400640 1 --2- 172.21.15.122:0/3062398081 >> v2:172.21.15.153:3300/0 conn(0x7f0a3806dbc0 0x7f0a380c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.450+0000 7f0a37400640 1 -- 172.21.15.122:0/3062398081 >> v1:172.21.15.153:6789/0 conn(0x7f0a3806ccb0 legacy=0x7f0a3806d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:36.450 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.450+0000 7f0a37400640 1 -- 172.21.15.122:0/3062398081 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a380cced0 con 0x7f0a3815ebe0 2024-05-28T06:12:36.450 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.450+0000 7f0a37e00640 1 --2- 172.21.15.122:0/3062398081 >> v2:172.21.15.153:3300/0 conn(0x7f0a3806dbc0 0x7f0a380c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:12:36.450 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.450+0000 7f0a36000640 1 -- 172.21.15.122:0/3062398081 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1949535333 0 0) 0x7f0a380d18c0 con 0x7f0a3806ccb0 2024-05-28T06:12:36.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.454+0000 7f0a37400640 1 --2- 172.21.15.122:0/3062398081 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a3815ebe0 0x7f0a380d1220 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0a28009d90 tx=0x7f0a2801c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1ed0a9b1af51517 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:36.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.454+0000 7f0a36000640 1 -- 172.21.15.122:0/3062398081 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a280b2070 con 0x7f0a3815ebe0 2024-05-28T06:12:36.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.454+0000 7f0a36000640 1 -- 172.21.15.122:0/3062398081 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a280a59d0 con 0x7f0a3815ebe0 2024-05-28T06:12:36.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.454+0000 7f0a36000640 1 -- 172.21.15.122:0/3062398081 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a280a5da0 con 0x7f0a3815ebe0 2024-05-28T06:12:36.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.454+0000 7f0a3ca00640 1 -- 172.21.15.122:0/3062398081 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a3815ebe0 msgr2=0x7f0a380d1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:36.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.454+0000 7f0a3ca00640 1 --2- 172.21.15.122:0/3062398081 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a3815ebe0 0x7f0a380d1220 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0a28009d90 tx=0x7f0a2801c930 comp rx=0 tx=0).stop 2024-05-28T06:12:36.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.454+0000 7f0a3ca00640 1 -- 172.21.15.122:0/3062398081 shutdown_connections 2024-05-28T06:12:36.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.454+0000 7f0a3ca00640 1 --2- 172.21.15.122:0/3062398081 >> v2:172.21.15.153:3300/0 conn(0x7f0a3806dbc0 0x7f0a380c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.454+0000 7f0a3ca00640 1 --2- 172.21.15.122:0/3062398081 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a3815ebe0 0x7f0a380d1220 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.454+0000 7f0a3ca00640 1 -- 172.21.15.122:0/3062398081 >> 172.21.15.122:0/3062398081 conn(0x7f0a380b3ff0 msgr2=0x7f0a380b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:36.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.454+0000 7f0a3ca00640 1 -- 172.21.15.122:0/3062398081 shutdown_connections 2024-05-28T06:12:36.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.454+0000 7f0a3ca00640 1 -- 172.21.15.122:0/3062398081 wait complete. 2024-05-28T06:12:36.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.454+0000 7f0a3ca00640 1 Processor -- start 2024-05-28T06:12:36.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.454+0000 7f0a3ca00640 1 -- start start 2024-05-28T06:12:36.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a3ca00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a3806ccb0 0x7f0a38157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:36.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a3ca00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a3806dbc0 0x7f0a38070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:36.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a3ca00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a3815ebe0 0x7f0a38071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:36.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a3ca00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0a380cda60 con 0x7f0a3815ebe0 2024-05-28T06:12:36.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a3ca00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0a380cd8e0 con 0x7f0a3806ccb0 2024-05-28T06:12:36.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a3ca00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0a380cdbe0 con 0x7f0a3806dbc0 2024-05-28T06:12:36.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a37e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a3815ebe0 0x7f0a38071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:36.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a37e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a3815ebe0 0x7f0a38071520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37958/0 (socket says 172.21.15.122:37958) 2024-05-28T06:12:36.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a37e00640 1 -- 172.21.15.122:0/2945913608 learned_addr learned my addr 172.21.15.122:0/2945913608 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:36.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a36a00640 1 --2- 172.21.15.122:0/2945913608 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a3806dbc0 0x7f0a38070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:36.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a37400640 1 --2- 172.21.15.122:0/2945913608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a3806ccb0 0x7f0a38157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:36.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a37e00640 1 -- 172.21.15.122:0/2945913608 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a3806dbc0 msgr2=0x7f0a38070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:36.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a37e00640 1 --2- 172.21.15.122:0/2945913608 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a3806dbc0 0x7f0a38070fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a37e00640 1 -- 172.21.15.122:0/2945913608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a3806ccb0 msgr2=0x7f0a38157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:36.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a37e00640 1 --2- 172.21.15.122:0/2945913608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a3806ccb0 0x7f0a38157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a37e00640 1 -- 172.21.15.122:0/2945913608 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a3815c9b0 con 0x7f0a3815ebe0 2024-05-28T06:12:36.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a37e00640 1 --2- 172.21.15.122:0/2945913608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a3815ebe0 0x7f0a38071520 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000e950 tx=0x7f0a3000ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:36.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a2f400640 1 -- 172.21.15.122:0/2945913608 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a30017070 con 0x7f0a3815ebe0 2024-05-28T06:12:36.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a2f400640 1 -- 172.21.15.122:0/2945913608 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a3000ca00 con 0x7f0a3815ebe0 2024-05-28T06:12:36.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a3ca00640 1 -- 172.21.15.122:0/2945913608 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a3815cc90 con 0x7f0a3815ebe0 2024-05-28T06:12:36.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a2f400640 1 -- 172.21.15.122:0/2945913608 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3000cdd0 con 0x7f0a3815ebe0 2024-05-28T06:12:36.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a3ca00640 1 -- 172.21.15.122:0/2945913608 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a380b72d0 con 0x7f0a3815ebe0 2024-05-28T06:12:36.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a3ca00640 1 -- 172.21.15.122:0/2945913608 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a38075620 con 0x7f0a3815ebe0 2024-05-28T06:12:36.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.458+0000 7f0a2f400640 1 -- 172.21.15.122:0/2945913608 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f0a30013470 con 0x7f0a3815ebe0 2024-05-28T06:12:36.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.462+0000 7f0a2f400640 1 --2- 172.21.15.122:0/2945913608 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0a18068bf0 0x7f0a1806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:36.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.462+0000 7f0a2f400640 1 -- 172.21.15.122:0/2945913608 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f0a30087a40 con 0x7f0a3815ebe0 2024-05-28T06:12:36.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.462+0000 7f0a37400640 1 --2- 172.21.15.122:0/2945913608 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0a18068bf0 0x7f0a1806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:36.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.462+0000 7f0a37400640 1 --2- 172.21.15.122:0/2945913608 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0a18068bf0 0x7f0a1806b0b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0a280af000 tx=0x7f0a280a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:36.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.466+0000 7f0a2f400640 1 -- 172.21.15.122:0/2945913608 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0a30057150 con 0x7f0a3815ebe0 2024-05-28T06:12:36.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.678+0000 7f0a3ca00640 1 -- 172.21.15.122:0/2945913608 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f0a3806d290 con 0x7f0a3815ebe0 2024-05-28T06:12:36.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.682+0000 7f0a2f400640 1 -- 172.21.15.122:0/2945913608 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f0a30056a50 con 0x7f0a3815ebe0 2024-05-28T06:12:36.681 INFO:teuthology.orchestra.run.smithi122.stdout:[client.0] 2024-05-28T06:12:36.681 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQACdFVm0fSmExAAkwJTGq732gbcMsBbs84lWw== 2024-05-28T06:12:36.681 INFO:teuthology.orchestra.run.smithi122.stdout: caps mds = "allow" 2024-05-28T06:12:36.681 INFO:teuthology.orchestra.run.smithi122.stdout: caps mon = "allow r" 2024-05-28T06:12:36.681 INFO:teuthology.orchestra.run.smithi122.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-28T06:12:36.681 INFO:teuthology.orchestra.run.smithi122.stderr:updated caps for client.0 2024-05-28T06:12:36.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.682+0000 7f0a3ca00640 1 -- 172.21.15.122:0/2945913608 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0a18068bf0 msgr2=0x7f0a1806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:36.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.682+0000 7f0a3ca00640 1 --2- 172.21.15.122:0/2945913608 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0a18068bf0 0x7f0a1806b0b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0a280af000 tx=0x7f0a280a7070 comp rx=0 tx=0).stop 2024-05-28T06:12:36.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.682+0000 7f0a3ca00640 1 -- 172.21.15.122:0/2945913608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a3815ebe0 msgr2=0x7f0a38071520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:36.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.682+0000 7f0a3ca00640 1 --2- 172.21.15.122:0/2945913608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a3815ebe0 0x7f0a38071520 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000e950 tx=0x7f0a3000ee10 comp rx=0 tx=0).stop 2024-05-28T06:12:36.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.682+0000 7f0a3ca00640 1 -- 172.21.15.122:0/2945913608 shutdown_connections 2024-05-28T06:12:36.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.682+0000 7f0a3ca00640 1 --2- 172.21.15.122:0/2945913608 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0a18068bf0 0x7f0a1806b0b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.682+0000 7f0a3ca00640 1 --2- 172.21.15.122:0/2945913608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a3815ebe0 0x7f0a38071520 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.682+0000 7f0a3ca00640 1 --2- 172.21.15.122:0/2945913608 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0a3806dbc0 0x7f0a38070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.682+0000 7f0a3ca00640 1 --2- 172.21.15.122:0/2945913608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a3806ccb0 0x7f0a38157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.682+0000 7f0a3ca00640 1 -- 172.21.15.122:0/2945913608 >> 172.21.15.122:0/2945913608 conn(0x7f0a380b3ff0 msgr2=0x7f0a380cf680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:36.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.682+0000 7f0a3ca00640 1 -- 172.21.15.122:0/2945913608 shutdown_connections 2024-05-28T06:12:36.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.682+0000 7f0a3ca00640 1 -- 172.21.15.122:0/2945913608 wait complete. 2024-05-28T06:12:36.703 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:12:36.757 INFO:tasks.ceph.mds.c.smithi122.stderr:2024-05-28T06:12:36.758+0000 7f56eb800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-28T06:12:36.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.842+0000 7f45fa000640 1 Processor -- start 2024-05-28T06:12:36.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.842+0000 7f45fa000640 1 -- start start 2024-05-28T06:12:36.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.842+0000 7f45fa000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f45f40b58d0 0x7f45f40b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:36.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.842+0000 7f45fa000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45f415e730 0x7f45f415ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:36.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.842+0000 7f45fa000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45f40b61f0 con 0x7f45f40ce4f0 2024-05-28T06:12:36.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.842+0000 7f45fa000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f45f415d970 con 0x7f45f40b58d0 2024-05-28T06:12:36.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.842+0000 7f45fa000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f45f415dc50 con 0x7f45f415e730 2024-05-28T06:12:36.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.842+0000 7f45f3e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45f415e730 0x7f45f415ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:36.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.842+0000 7f45f3400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f45f40b58d0 0x7f45f40b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:36.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.842+0000 7f45f3e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45f415e730 0x7f45f415ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:52326/0 (socket says 172.21.15.122:52326) 2024-05-28T06:12:36.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.842+0000 7f45f3e00640 1 -- 172.21.15.122:0/1734370790 learned_addr learned my addr 172.21.15.122:0/1734370790 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:36.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.842+0000 7f45f3400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f45f40b58d0 0x7f45f40b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:48866/0 (socket says 172.21.15.122:48866) 2024-05-28T06:12:36.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.842+0000 7f45f2a00640 1 --1- 172.21.15.122:0/1734370790 >> v1:172.21.15.153:6789/0 conn(0x7f45f40ce4f0 0x7f45f40ce980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:37422/0 (socket says 172.21.15.122:37422) 2024-05-28T06:12:36.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.842+0000 7f45f3e00640 1 -- 172.21.15.122:0/1734370790 >> v2:172.21.15.153:3300/0 conn(0x7f45f40b58d0 msgr2=0x7f45f40b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:36.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.842+0000 7f45f3e00640 1 --2- 172.21.15.122:0/1734370790 >> v2:172.21.15.153:3300/0 conn(0x7f45f40b58d0 0x7f45f40b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.842+0000 7f45f2000640 1 -- 172.21.15.122:0/1734370790 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1320244204 0 0) 0x7f45f40b61f0 con 0x7f45f40ce4f0 2024-05-28T06:12:36.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.842+0000 7f45f3e00640 1 -- 172.21.15.122:0/1734370790 >> v1:172.21.15.153:6789/0 conn(0x7f45f40ce4f0 legacy=0x7f45f40ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:36.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.842+0000 7f45f3e00640 1 -- 172.21.15.122:0/1734370790 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f415df30 con 0x7f45f415e730 2024-05-28T06:12:36.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.846+0000 7f45f3e00640 1 --2- 172.21.15.122:0/1734370790 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45f415e730 0x7f45f415ebc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009e50 tx=0x7f45ec01ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=408ed2ffbf43052c server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:36.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.846+0000 7f45f2000640 1 -- 172.21.15.122:0/1734370790 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec0a5790 con 0x7f45f415e730 2024-05-28T06:12:36.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.846+0000 7f45f2000640 1 -- 172.21.15.122:0/1734370790 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45ec0a5930 con 0x7f45f415e730 2024-05-28T06:12:36.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.846+0000 7f45f2000640 1 -- 172.21.15.122:0/1734370790 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec0a5d00 con 0x7f45f415e730 2024-05-28T06:12:36.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.846+0000 7f45fa000640 1 -- 172.21.15.122:0/1734370790 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45f415e730 msgr2=0x7f45f415ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:36.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.846+0000 7f45fa000640 1 --2- 172.21.15.122:0/1734370790 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45f415e730 0x7f45f415ebc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009e50 tx=0x7f45ec01ca30 comp rx=0 tx=0).stop 2024-05-28T06:12:36.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.846+0000 7f45fa000640 1 -- 172.21.15.122:0/1734370790 shutdown_connections 2024-05-28T06:12:36.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.846+0000 7f45fa000640 1 --2- 172.21.15.122:0/1734370790 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45f415e730 0x7f45f415ebc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.846+0000 7f45fa000640 1 --2- 172.21.15.122:0/1734370790 >> v2:172.21.15.153:3300/0 conn(0x7f45f40b58d0 0x7f45f40b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.846+0000 7f45fa000640 1 -- 172.21.15.122:0/1734370790 >> 172.21.15.122:0/1734370790 conn(0x7f45f406bd90 msgr2=0x7f45f406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:36.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.846+0000 7f45fa000640 1 -- 172.21.15.122:0/1734370790 shutdown_connections 2024-05-28T06:12:36.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.846+0000 7f45fa000640 1 -- 172.21.15.122:0/1734370790 wait complete. 2024-05-28T06:12:36.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45fa000640 1 Processor -- start 2024-05-28T06:12:36.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45fa000640 1 -- start start 2024-05-28T06:12:36.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45fa000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45f40b58d0 0x7f45f4157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:36.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45fa000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45f40ce4f0 0x7f45f413bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:36.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45fa000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45f415e730 0x7f45f415ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:36.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45fa000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f45f40b3840 con 0x7f45f415e730 2024-05-28T06:12:36.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45fa000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f45f40b36c0 con 0x7f45f40ce4f0 2024-05-28T06:12:36.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45fa000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f45f40b39c0 con 0x7f45f40b58d0 2024-05-28T06:12:36.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45f3e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45f415e730 0x7f45f415ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:36.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45f3e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45f415e730 0x7f45f415ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37968/0 (socket says 172.21.15.122:37968) 2024-05-28T06:12:36.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45f3e00640 1 -- 172.21.15.122:0/107314869 learned_addr learned my addr 172.21.15.122:0/107314869 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:36.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45f3400640 1 --2- 172.21.15.122:0/107314869 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45f40b58d0 0x7f45f4157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:36.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45f2a00640 1 --2- 172.21.15.122:0/107314869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45f40ce4f0 0x7f45f413bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:36.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45f3e00640 1 -- 172.21.15.122:0/107314869 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45f40b58d0 msgr2=0x7f45f4157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:36.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45f3e00640 1 --2- 172.21.15.122:0/107314869 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45f40b58d0 0x7f45f4157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45f3e00640 1 -- 172.21.15.122:0/107314869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45f40ce4f0 msgr2=0x7f45f413bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:36.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45f3e00640 1 --2- 172.21.15.122:0/107314869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45f40ce4f0 0x7f45f413bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:36.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45f3e00640 1 -- 172.21.15.122:0/107314869 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f413c730 con 0x7f45f415e730 2024-05-28T06:12:36.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45f2a00640 1 --2- 172.21.15.122:0/107314869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45f40ce4f0 0x7f45f413bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:12:36.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45f3e00640 1 --2- 172.21.15.122:0/107314869 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45f415e730 0x7f45f415ba90 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f45ec0af040 tx=0x7f45ec0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:36.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45eb400640 1 -- 172.21.15.122:0/107314869 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec0b8440 con 0x7f45f415e730 2024-05-28T06:12:36.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45eb400640 1 -- 172.21.15.122:0/107314869 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45ec0b85e0 con 0x7f45f415e730 2024-05-28T06:12:36.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45eb400640 1 -- 172.21.15.122:0/107314869 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec0b8990 con 0x7f45f415e730 2024-05-28T06:12:36.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45fa000640 1 -- 172.21.15.122:0/107314869 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f413ca10 con 0x7f45f415e730 2024-05-28T06:12:36.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.850+0000 7f45fa000640 1 -- 172.21.15.122:0/107314869 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f413cfd0 con 0x7f45f415e730 2024-05-28T06:12:36.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.854+0000 7f45fa000640 1 -- 172.21.15.122:0/107314869 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f4068c40 con 0x7f45f415e730 2024-05-28T06:12:36.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.854+0000 7f45eb400640 1 -- 172.21.15.122:0/107314869 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f45ec0c1020 con 0x7f45f415e730 2024-05-28T06:12:36.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.854+0000 7f45eb400640 1 --2- 172.21.15.122:0/107314869 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f45d4068bf0 0x7f45d406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:36.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.854+0000 7f45eb400640 1 -- 172.21.15.122:0/107314869 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f45ec121e00 con 0x7f45f415e730 2024-05-28T06:12:36.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.854+0000 7f45f3400640 1 --2- 172.21.15.122:0/107314869 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f45d4068bf0 0x7f45d406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:36.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.854+0000 7f45f3400640 1 --2- 172.21.15.122:0/107314869 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f45d4068bf0 0x7f45d406b0b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f45e4009b60 tx=0x7f45e4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:36.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:36.858+0000 7f45eb400640 1 -- 172.21.15.122:0/107314869 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f45ec016620 con 0x7f45f415e730 2024-05-28T06:12:37.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.050+0000 7f45fa000640 1 -- 172.21.15.122:0/107314869 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45f40758c0 con 0x7f45f415e730 2024-05-28T06:12:37.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.050+0000 7f45eb400640 1 -- 172.21.15.122:0/107314869 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5190 (secure 0 0 0) 0x7f45ec0f1930 con 0x7f45f415e730 2024-05-28T06:12:37.051 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:12:37.051 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/726421131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":726421131},{"type":"v1","addr":"172.21.15.153:6834","nonce":726421131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5498,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4109795391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4109795391},{"type":"v1","addr":"172.21.15.153:6835","nonce":4109795391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/3019937124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":3019937124},{"type":"v1","addr":"172.21.15.122:6835","nonce":3019937124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-28T06:12:31.161573+0000","modified":"2024-05-28T06:12:34.187846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6300":{"gid":6300,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/3289678231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3289678231},{"type":"v1","addr":"172.21.15.122:6837","nonce":3289678231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6300,"qdb_cluster":[6300]},"id":4}]} 2024-05-28T06:12:37.051 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 37 2024-05-28T06:12:37.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.054+0000 7f45fa000640 1 -- 172.21.15.122:0/107314869 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f45d4068bf0 msgr2=0x7f45d406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:37.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.054+0000 7f45fa000640 1 --2- 172.21.15.122:0/107314869 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f45d4068bf0 0x7f45d406b0b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f45e4009b60 tx=0x7f45e4009190 comp rx=0 tx=0).stop 2024-05-28T06:12:37.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.054+0000 7f45fa000640 1 -- 172.21.15.122:0/107314869 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45f415e730 msgr2=0x7f45f415ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:37.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.054+0000 7f45fa000640 1 --2- 172.21.15.122:0/107314869 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45f415e730 0x7f45f415ba90 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f45ec0af040 tx=0x7f45ec0197d0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.054+0000 7f45fa000640 1 -- 172.21.15.122:0/107314869 shutdown_connections 2024-05-28T06:12:37.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.054+0000 7f45fa000640 1 --2- 172.21.15.122:0/107314869 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f45d4068bf0 0x7f45d406b0b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.054+0000 7f45fa000640 1 --2- 172.21.15.122:0/107314869 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45f415e730 0x7f45f415ba90 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.054+0000 7f45fa000640 1 --2- 172.21.15.122:0/107314869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45f40ce4f0 0x7f45f413bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.054+0000 7f45fa000640 1 --2- 172.21.15.122:0/107314869 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45f40b58d0 0x7f45f4157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.054+0000 7f45fa000640 1 -- 172.21.15.122:0/107314869 >> 172.21.15.122:0/107314869 conn(0x7f45f406bd90 msgr2=0x7f45f40b4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:37.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.054+0000 7f45fa000640 1 -- 172.21.15.122:0/107314869 shutdown_connections 2024-05-28T06:12:37.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.054+0000 7f45fa000640 1 -- 172.21.15.122:0/107314869 wait complete. 2024-05-28T06:12:37.475 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-28T06:12:31.161573+0000', 'modified': '2024-05-28T06:12:34.187846+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6300}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6300': {'gid': 6300, 'name': 'c', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.122:6837/3289678231', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6836', 'nonce': 3289678231}, {'type': 'v1', 'addr': '172.21.15.122:6837', 'nonce': 3289678231}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6300, 'qdb_cluster': [6300]} 2024-05-28T06:12:37.476 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-28T06:12:37.476 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-28T06:12:37.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.614+0000 7f5aea200640 1 Processor -- start 2024-05-28T06:12:37.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.614+0000 7f5aea200640 1 -- start start 2024-05-28T06:12:37.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.614+0000 7f5aea200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ae4159280 0x7f5ae40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.614+0000 7f5aea200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5ae415c7a0 0x7f5ae406f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.614+0000 7f5aea200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ae40b54d0 con 0x7f5ae40cced0 2024-05-28T06:12:37.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.614+0000 7f5aea200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f5ae415c310 con 0x7f5ae415c7a0 2024-05-28T06:12:37.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.614+0000 7f5aea200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5ae40b57b0 con 0x7f5ae4159280 2024-05-28T06:12:37.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.618+0000 7f5ae3e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f5ae40cced0 0x7f5ae415f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:59748/0 (socket says 172.21.15.122:59748) 2024-05-28T06:12:37.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.618+0000 7f5adaa00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5ae415c7a0 0x7f5ae406f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:37.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.618+0000 7f5ae3e00640 1 -- 172.21.15.122:0/3527229505 learned_addr learned my addr 172.21.15.122:0/3527229505 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:37.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.618+0000 7f5ae3400640 1 --2- 172.21.15.122:0/3527229505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ae4159280 0x7f5ae40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:37.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.618+0000 7f5ae2a00640 1 -- 172.21.15.122:0/3527229505 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1346687234 0 0) 0x7f5ae40b54d0 con 0x7f5ae40cced0 2024-05-28T06:12:37.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.618+0000 7f5adaa00640 1 -- 172.21.15.122:0/3527229505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ae4159280 msgr2=0x7f5ae40b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:37.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.618+0000 7f5adaa00640 1 --2- 172.21.15.122:0/3527229505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ae4159280 0x7f5ae40b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.618+0000 7f5adaa00640 1 -- 172.21.15.122:0/3527229505 >> v1:172.21.15.122:6789/0 conn(0x7f5ae40cced0 legacy=0x7f5ae415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:37.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.618+0000 7f5adaa00640 1 -- 172.21.15.122:0/3527229505 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ae415bfa0 con 0x7f5ae415c7a0 2024-05-28T06:12:37.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.618+0000 7f5adaa00640 1 --2- 172.21.15.122:0/3527229505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ae415c7a0 0x7f5ae406f1e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0097c0 tx=0x7f5acc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d186438446072e server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:37.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.618+0000 7f5ae2a00640 1 -- 172.21.15.122:0/3527229505 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0b0070 con 0x7f5ae415c7a0 2024-05-28T06:12:37.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.618+0000 7f5ae2a00640 1 -- 172.21.15.122:0/3527229505 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5acc0ab600 con 0x7f5ae415c7a0 2024-05-28T06:12:37.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.618+0000 7f5ae2a00640 1 -- 172.21.15.122:0/3527229505 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0ab9d0 con 0x7f5ae415c7a0 2024-05-28T06:12:37.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5aea200640 1 -- 172.21.15.122:0/3527229505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ae415c7a0 msgr2=0x7f5ae406f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:37.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5aea200640 1 --2- 172.21.15.122:0/3527229505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ae415c7a0 0x7f5ae406f1e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0097c0 tx=0x7f5acc01c4a0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5aea200640 1 -- 172.21.15.122:0/3527229505 shutdown_connections 2024-05-28T06:12:37.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5aea200640 1 --2- 172.21.15.122:0/3527229505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ae415c7a0 0x7f5ae406f1e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5aea200640 1 --2- 172.21.15.122:0/3527229505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ae4159280 0x7f5ae40b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5aea200640 1 -- 172.21.15.122:0/3527229505 >> 172.21.15.122:0/3527229505 conn(0x7f5ae4062a40 msgr2=0x7f5ae406b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:37.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5aea200640 1 -- 172.21.15.122:0/3527229505 shutdown_connections 2024-05-28T06:12:37.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5aea200640 1 -- 172.21.15.122:0/3527229505 wait complete. 2024-05-28T06:12:37.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5aea200640 1 Processor -- start 2024-05-28T06:12:37.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5aea200640 1 -- start start 2024-05-28T06:12:37.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5aea200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ae40cced0 0x7f5ae4157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5aea200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ae4159280 0x7f5ae41648a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5aea200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ae415c7a0 0x7f5ae4164de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5aea200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae40cd710 con 0x7f5ae40cced0 2024-05-28T06:12:37.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5aea200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae4159660 con 0x7f5ae415c7a0 2024-05-28T06:12:37.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5aea200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5ae4142de0 con 0x7f5ae4159280 2024-05-28T06:12:37.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5ae3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ae40cced0 0x7f5ae4157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:37.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5ae3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ae40cced0 0x7f5ae4157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37988/0 (socket says 172.21.15.122:37988) 2024-05-28T06:12:37.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5ae3400640 1 -- 172.21.15.122:0/2678497802 learned_addr learned my addr 172.21.15.122:0/2678497802 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:37.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5adaa00640 1 --2- 172.21.15.122:0/2678497802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ae4159280 0x7f5ae41648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:37.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5ae3400640 1 -- 172.21.15.122:0/2678497802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ae4159280 msgr2=0x7f5ae41648a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:37.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5ae3400640 1 --2- 172.21.15.122:0/2678497802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ae4159280 0x7f5ae41648a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5ae3400640 1 -- 172.21.15.122:0/2678497802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ae415c7a0 msgr2=0x7f5ae4164de0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-28T06:12:37.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5ae3400640 1 --2- 172.21.15.122:0/2678497802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ae415c7a0 0x7f5ae4164de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5ae3400640 1 -- 172.21.15.122:0/2678497802 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ae406efe0 con 0x7f5ae40cced0 2024-05-28T06:12:37.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5adaa00640 1 --2- 172.21.15.122:0/2678497802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ae4159280 0x7f5ae41648a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:37.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.622+0000 7f5ae3400640 1 --2- 172.21.15.122:0/2678497802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ae40cced0 0x7f5ae4157e70 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4007ef0 tx=0x7f5ad400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:37.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.626+0000 7f5adbe00640 1 -- 172.21.15.122:0/2678497802 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4014620 con 0x7f5ae40cced0 2024-05-28T06:12:37.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.626+0000 7f5adbe00640 1 -- 172.21.15.122:0/2678497802 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad4019070 con 0x7f5ae40cced0 2024-05-28T06:12:37.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.626+0000 7f5adbe00640 1 -- 172.21.15.122:0/2678497802 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4014a00 con 0x7f5ae40cced0 2024-05-28T06:12:37.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.626+0000 7f5aea200640 1 -- 172.21.15.122:0/2678497802 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ae41583b0 con 0x7f5ae40cced0 2024-05-28T06:12:37.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.626+0000 7f5aea200640 1 -- 172.21.15.122:0/2678497802 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ae4142540 con 0x7f5ae40cced0 2024-05-28T06:12:37.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.626+0000 7f5adbe00640 1 -- 172.21.15.122:0/2678497802 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f5ad4014ba0 con 0x7f5ae40cced0 2024-05-28T06:12:37.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.626+0000 7f5adbe00640 1 --2- 172.21.15.122:0/2678497802 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5ac0068bf0 0x7f5ac006b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.626+0000 7f5adbe00640 1 -- 172.21.15.122:0/2678497802 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f5ad4088510 con 0x7f5ae40cced0 2024-05-28T06:12:37.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.626+0000 7f5adaa00640 1 --2- 172.21.15.122:0/2678497802 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5ac0068bf0 0x7f5ac006b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:37.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.626+0000 7f5aed601000 1 Processor -- start 2024-05-28T06:12:37.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.626+0000 7f5aed601000 1 -- start start 2024-05-28T06:12:37.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5adaa00640 1 --2- 172.21.15.122:0/2678497802 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5ac0068bf0 0x7f5ac006b0b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0ad000 tx=0x7f5acc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:37.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5aed601000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2fbc120 0x563eb2fbc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5aed601000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563eb2fbca40 0x563eb2f6f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5aed601000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eb2f6f650 0x563eb2f6fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5aed601000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563eb2dc0420 con 0x563eb2fbc120 2024-05-28T06:12:37.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5aed601000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563eb2d5abf0 con 0x563eb2f6f650 2024-05-28T06:12:37.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5aed601000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x563eb2dbc3e0 con 0x563eb2fbca40 2024-05-28T06:12:37.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5ae3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2fbc120 0x563eb2fbc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:37.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5ae3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2fbc120 0x563eb2fbc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37990/0 (socket says 172.21.15.122:37990) 2024-05-28T06:12:37.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5ae3400640 1 -- 172.21.15.122:0/4084244380 learned_addr learned my addr 172.21.15.122:0/4084244380 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:37.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5adaa00640 1 --2- 172.21.15.122:0/4084244380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563eb2fbca40 0x563eb2f6f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:37.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5ae3400640 1 -- 172.21.15.122:0/4084244380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563eb2fbca40 msgr2=0x563eb2f6f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:37.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5ae3400640 1 --2- 172.21.15.122:0/4084244380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563eb2fbca40 0x563eb2f6f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5ae3400640 1 -- 172.21.15.122:0/4084244380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eb2f6f650 msgr2=0x563eb2f6fa30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-28T06:12:37.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5ae3400640 1 --2- 172.21.15.122:0/4084244380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eb2f6f650 0x563eb2f6fa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5ae3400640 1 -- 172.21.15.122:0/4084244380 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563eb2e68450 con 0x563eb2fbc120 2024-05-28T06:12:37.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5ae3400640 1 --2- 172.21.15.122:0/4084244380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2fbc120 0x563eb2fbc500 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400e9b0 tx=0x7f5ad4057b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408f259ee9a24422 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:37.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5ad3e00640 1 -- 172.21.15.122:0/4084244380 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad405b840 con 0x563eb2fbc120 2024-05-28T06:12:37.631 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5ad3e00640 1 -- 172.21.15.122:0/4084244380 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad4060070 con 0x563eb2fbc120 2024-05-28T06:12:37.631 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5ad3e00640 1 -- 172.21.15.122:0/4084244380 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad40576f0 con 0x563eb2fbc120 2024-05-28T06:12:37.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5aed601000 1 -- 172.21.15.122:0/4084244380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2fbc120 msgr2=0x563eb2fbc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:37.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5aed601000 1 --2- 172.21.15.122:0/4084244380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2fbc120 0x563eb2fbc500 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400e9b0 tx=0x7f5ad4057b90 comp rx=0 tx=0).stop 2024-05-28T06:12:37.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5aed601000 1 -- 172.21.15.122:0/4084244380 shutdown_connections 2024-05-28T06:12:37.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5aed601000 1 --2- 172.21.15.122:0/4084244380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eb2f6f650 0x563eb2f6fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5aed601000 1 --2- 172.21.15.122:0/4084244380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563eb2fbca40 0x563eb2f6f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5aed601000 1 --2- 172.21.15.122:0/4084244380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2fbc120 0x563eb2fbc500 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5aed601000 1 -- 172.21.15.122:0/4084244380 >> 172.21.15.122:0/4084244380 conn(0x563eb2f9cec0 msgr2=0x563eb2f9f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:37.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5aed601000 1 -- 172.21.15.122:0/4084244380 shutdown_connections 2024-05-28T06:12:37.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5aed601000 1 -- 172.21.15.122:0/4084244380 wait complete. 2024-05-28T06:12:37.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5aed601000 1 -- start start 2024-05-28T06:12:37.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.630+0000 7f5aed601000 1 Processor -- start 2024-05-28T06:12:37.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2f6f650 0x563eb2f74b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eb2fbc120 0x563eb2f75080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563eb2fbca40 0x563eb2f755c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563eb2d60ec0 con 0x563eb2f6f650 2024-05-28T06:12:37.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563eb2e41120 con 0x563eb2fbc120 2024-05-28T06:12:37.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x563eb2dcb350 con 0x563eb2fbca40 2024-05-28T06:12:37.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 10 client.0 _ll_register_callbacks cb 0x563eb2d9d4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-28T06:12:37.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5ae3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2f6f650 0x563eb2f74b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:37.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5ae3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2f6f650 0x563eb2f74b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37994/0 (socket says 172.21.15.122:37994) 2024-05-28T06:12:37.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5ae3400640 1 -- 172.21.15.122:0/1301138572 learned_addr learned my addr 172.21.15.122:0/1301138572 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:37.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5adaa00640 1 --2- 172.21.15.122:0/1301138572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eb2fbc120 0x563eb2f75080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:37.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5ae3400640 1 -- 172.21.15.122:0/1301138572 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563eb2fbca40 msgr2=0x563eb2f755c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-28T06:12:37.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5ae3400640 1 --2- 172.21.15.122:0/1301138572 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563eb2fbca40 0x563eb2f755c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5ae3400640 1 -- 172.21.15.122:0/1301138572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eb2fbc120 msgr2=0x563eb2f75080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:37.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5ae3400640 1 --2- 172.21.15.122:0/1301138572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eb2fbc120 0x563eb2f75080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5ae3400640 1 -- 172.21.15.122:0/1301138572 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563eb2e05f80 con 0x563eb2f6f650 2024-05-28T06:12:37.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5ae3400640 1 --2- 172.21.15.122:0/1301138572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2f6f650 0x563eb2f74b40 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4057650 tx=0x7f5ad4088040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c02c2620269a22 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:37.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5ad0c00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-28T06:12:37.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5ad0c00640 1 -- 172.21.15.122:0/1301138572 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad40578f0 con 0x563eb2f6f650 2024-05-28T06:12:37.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5ad0c00640 1 -- 172.21.15.122:0/1301138572 <== mon.0 v2:172.21.15.122:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f5ad405fbe0 con 0x563eb2f6f650 2024-05-28T06:12:37.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 1 -- 172.21.15.122:0/1301138572 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ad4060070 con 0x563eb2f6f650 2024-05-28T06:12:37.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5ad0c00640 1 -- 172.21.15.122:0/1301138572 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f5ad4075050 con 0x563eb2f6f650 2024-05-28T06:12:37.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 10 client.6444 fetch_fsmap learned FSMap version 37 2024-05-28T06:12:37.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 1 -- 172.21.15.122:0/1301138572 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) -- 0x563eb2d99f00 con 0x563eb2f6f650 2024-05-28T06:12:37.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5ad0c00640 1 -- 172.21.15.122:0/1301138572 <== mon.0 v2:172.21.15.122:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad4060070 con 0x563eb2f6f650 2024-05-28T06:12:37.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5ad0c00640 1 -- 172.21.15.122:0/1301138572 <== mon.0 v2:172.21.15.122:3300/0 5 ==== fsmap(e 37) ==== 3494+0+0 (secure 0 0 0) 0x7f5ad40880b0 con 0x563eb2f6f650 2024-05-28T06:12:37.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 10 client.6444 fetch_fsmap finished waiting for FSMap version 37 2024-05-28T06:12:37.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 10 client.6444 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-28T06:12:37.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 20 client.6444 populate_metadata read hostname 'smithi122' 2024-05-28T06:12:37.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 1 --2- 172.21.15.122:0/1301138572 >> [v2:172.21.15.122:6836/3289678231,v1:172.21.15.122:6837/3289678231] conn(0x563eb2fcb3c0 0x563eb2fcd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 4 client.6444 mds_command: new command op to 6300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-28T06:12:37.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 1 -- 172.21.15.122:0/1301138572 --> [v2:172.21.15.122:6836/3289678231,v1:172.21.15.122:6837/3289678231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563eb2d59bc0 con 0x563eb2fcb3c0 2024-05-28T06:12:37.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5adaa00640 1 --2- 172.21.15.122:0/1301138572 >> [v2:172.21.15.122:6836/3289678231,v1:172.21.15.122:6837/3289678231] conn(0x563eb2fcb3c0 0x563eb2fcd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:37.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5ad0c00640 10 client.6444 ms_handle_connect on v2:172.21.15.122:6836/3289678231 2024-05-28T06:12:37.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5adaa00640 1 --2- 172.21.15.122:0/1301138572 >> [v2:172.21.15.122:6836/3289678231,v1:172.21.15.122:6837/3289678231] conn(0x563eb2fcb3c0 0x563eb2fcd7b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9797f0b292195223 server_cookie=733bbaba5fd327db in_seq=0 out_seq=0 2024-05-28T06:12:37.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5ad0c00640 1 -- 172.21.15.122:0/1301138572 <== mds.0 v2:172.21.15.122:6836/3289678231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563eb2d59bc0 con 0x563eb2fcb3c0 2024-05-28T06:12:37.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5ad0c00640 10 client.6444 handle_command_reply: tid=0 2024-05-28T06:12:37.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 1 client.6444 shutdown 2024-05-28T06:12:37.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 1 -- 172.21.15.122:0/1301138572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2f6f650 msgr2=0x563eb2f74b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:37.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 1 --2- 172.21.15.122:0/1301138572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2f6f650 0x563eb2f74b40 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4057650 tx=0x7f5ad4088040 comp rx=0 tx=0).stop 2024-05-28T06:12:37.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 1 -- 172.21.15.122:0/1301138572 shutdown_connections 2024-05-28T06:12:37.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 1 --2- 172.21.15.122:0/1301138572 >> [v2:172.21.15.122:6836/3289678231,v1:172.21.15.122:6837/3289678231] conn(0x563eb2fcb3c0 0x563eb2fcd7b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 1 --2- 172.21.15.122:0/1301138572 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563eb2fbca40 0x563eb2f755c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 1 --2- 172.21.15.122:0/1301138572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eb2fbc120 0x563eb2f75080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 1 --2- 172.21.15.122:0/1301138572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2f6f650 0x563eb2f74b40 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5ad0c00640 0 client.6444 ms_handle_reset on v2:172.21.15.122:6836/3289678231 2024-05-28T06:12:37.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.634+0000 7f5aed601000 1 -- 172.21.15.122:0/1301138572 >> 172.21.15.122:0/1301138572 conn(0x563eb2f9cec0 msgr2=0x563eb2f9f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:37.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.638+0000 7f5aed601000 1 -- 172.21.15.122:0/1301138572 shutdown_connections 2024-05-28T06:12:37.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.638+0000 7f5aed601000 1 -- 172.21.15.122:0/1301138572 wait complete. 2024-05-28T06:12:37.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.638+0000 7f5aed601000 20 client.6444 trim_cache size 0 max 16384 2024-05-28T06:12:37.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.654+0000 7f5aed601000 1 Processor -- start 2024-05-28T06:12:37.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.654+0000 7f5aed601000 1 -- start start 2024-05-28T06:12:37.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.654+0000 7f5aed601000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563eb2f6f650 0x563eb2f6e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.654+0000 7f5aed601000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2fbc120 0x563eb2f6ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.654+0000 7f5aed601000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eb2fbca40 0x563eb2fcd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.654+0000 7f5aed601000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae4203480 con 0x563eb2fbc120 2024-05-28T06:12:37.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.654+0000 7f5aed601000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae41fbef0 con 0x563eb2fbca40 2024-05-28T06:12:37.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.654+0000 7f5aed601000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5ae4168da0 con 0x563eb2f6f650 2024-05-28T06:12:37.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.654+0000 7f5adaa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2fbc120 0x563eb2f6ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:37.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.654+0000 7f5adaa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2fbc120 0x563eb2f6ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38006/0 (socket says 172.21.15.122:38006) 2024-05-28T06:12:37.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.654+0000 7f5adaa00640 1 -- 172.21.15.122:0/1250620616 learned_addr learned my addr 172.21.15.122:0/1250620616 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:37.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.654+0000 7f5adaa00640 1 -- 172.21.15.122:0/1250620616 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563eb2f6f650 msgr2=0x563eb2f6e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:37.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.654+0000 7f5adaa00640 1 --2- 172.21.15.122:0/1250620616 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563eb2f6f650 0x563eb2f6e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.654+0000 7f5adaa00640 1 -- 172.21.15.122:0/1250620616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eb2fbca40 msgr2=0x563eb2fcd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:37.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.654+0000 7f5adaa00640 1 --2- 172.21.15.122:0/1250620616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eb2fbca40 0x563eb2fcd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.654+0000 7f5adaa00640 1 -- 172.21.15.122:0/1250620616 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563eb2fbc870 con 0x563eb2fbc120 2024-05-28T06:12:37.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.654+0000 7f5adaa00640 1 --2- 172.21.15.122:0/1250620616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2fbc120 0x563eb2f6ed50 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f5acc01ab50 tx=0x7f5acc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f24650f603defa4 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:37.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.654+0000 7f5ad3400640 1 -- 172.21.15.122:0/1250620616 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0abd10 con 0x563eb2fbc120 2024-05-28T06:12:37.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.654+0000 7f5ad3400640 1 -- 172.21.15.122:0/1250620616 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5acc0ce070 con 0x563eb2fbc120 2024-05-28T06:12:37.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.654+0000 7f5ad3400640 1 -- 172.21.15.122:0/1250620616 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0c83d0 con 0x563eb2fbc120 2024-05-28T06:12:37.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 1 -- 172.21.15.122:0/1250620616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2fbc120 msgr2=0x563eb2f6ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:37.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 1 --2- 172.21.15.122:0/1250620616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2fbc120 0x563eb2f6ed50 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f5acc01ab50 tx=0x7f5acc004740 comp rx=0 tx=0).stop 2024-05-28T06:12:37.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 1 -- 172.21.15.122:0/1250620616 shutdown_connections 2024-05-28T06:12:37.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 1 --2- 172.21.15.122:0/1250620616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eb2fbca40 0x563eb2fcd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 1 --2- 172.21.15.122:0/1250620616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2fbc120 0x563eb2f6ed50 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 1 --2- 172.21.15.122:0/1250620616 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563eb2f6f650 0x563eb2f6e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 1 -- 172.21.15.122:0/1250620616 >> 172.21.15.122:0/1250620616 conn(0x563eb2f9cec0 msgr2=0x563eb2f6e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:37.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 1 -- 172.21.15.122:0/1250620616 shutdown_connections 2024-05-28T06:12:37.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 1 -- 172.21.15.122:0/1250620616 wait complete. 2024-05-28T06:12:37.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 1 -- start start 2024-05-28T06:12:37.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 1 Processor -- start 2024-05-28T06:12:37.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eb2f6f650 0x563eb2fd0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2fbc120 0x563eb2fe7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563eb2fbca40 0x563eb2fe7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563eb2dbf730 con 0x563eb2fbc120 2024-05-28T06:12:37.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563eb2d8c9e0 con 0x563eb2f6f650 2024-05-28T06:12:37.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x563eb2dc4a50 con 0x563eb2fbca40 2024-05-28T06:12:37.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 10 client.0 _ll_register_callbacks cb 0x7f5acc0ae070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-28T06:12:37.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5adaa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2fbc120 0x563eb2fe7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:37.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5adaa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2fbc120 0x563eb2fe7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38020/0 (socket says 172.21.15.122:38020) 2024-05-28T06:12:37.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5adaa00640 1 -- 172.21.15.122:0/1590910886 learned_addr learned my addr 172.21.15.122:0/1590910886 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:37.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5ae3400640 1 --2- 172.21.15.122:0/1590910886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eb2f6f650 0x563eb2fd0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:37.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5ae3e00640 1 --2- 172.21.15.122:0/1590910886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563eb2fbca40 0x563eb2fe7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:37.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5adaa00640 1 -- 172.21.15.122:0/1590910886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563eb2fbca40 msgr2=0x563eb2fe7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:37.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5adaa00640 1 --2- 172.21.15.122:0/1590910886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563eb2fbca40 0x563eb2fe7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5adaa00640 1 -- 172.21.15.122:0/1590910886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eb2f6f650 msgr2=0x563eb2fd0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:37.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5adaa00640 1 --2- 172.21.15.122:0/1590910886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eb2f6f650 0x563eb2fd0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5adaa00640 1 -- 172.21.15.122:0/1590910886 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563eb2d46e80 con 0x563eb2fbc120 2024-05-28T06:12:37.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5adaa00640 1 --2- 172.21.15.122:0/1590910886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2fbc120 0x563eb2fe7340 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f5acc01ab50 tx=0x7f5acc0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b913dec8aac20c23 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:37.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5ad0c00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-05-28T06:12:37.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5ad0c00640 1 -- 172.21.15.122:0/1590910886 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0d9020 con 0x563eb2fbc120 2024-05-28T06:12:37.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5ad0c00640 1 -- 172.21.15.122:0/1590910886 <== mon.0 v2:172.21.15.122:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f5acc0abd10 con 0x563eb2fbc120 2024-05-28T06:12:37.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 1 -- 172.21.15.122:0/1590910886 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5acc0ce070 con 0x563eb2fbc120 2024-05-28T06:12:37.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5ad0c00640 1 -- 172.21.15.122:0/1590910886 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f5acc0c81d0 con 0x563eb2fbc120 2024-05-28T06:12:37.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 10 client.6450 fetch_fsmap learned FSMap version 37 2024-05-28T06:12:37.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 1 -- 172.21.15.122:0/1590910886 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) -- 0x563eb2d88b30 con 0x563eb2fbc120 2024-05-28T06:12:37.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5ad0c00640 1 -- 172.21.15.122:0/1590910886 <== mon.0 v2:172.21.15.122:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5acc0ce070 con 0x563eb2fbc120 2024-05-28T06:12:37.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5ad0c00640 1 -- 172.21.15.122:0/1590910886 <== mon.0 v2:172.21.15.122:3300/0 5 ==== fsmap(e 37) ==== 3494+0+0 (secure 0 0 0) 0x7f5acc0c8370 con 0x563eb2fbc120 2024-05-28T06:12:37.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 10 client.6450 fetch_fsmap finished waiting for FSMap version 37 2024-05-28T06:12:37.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 10 client.6450 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-28T06:12:37.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 20 client.6450 populate_metadata read hostname 'smithi122' 2024-05-28T06:12:37.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 1 --2- 172.21.15.122:0/1590910886 >> [v2:172.21.15.122:6836/3289678231,v1:172.21.15.122:6837/3289678231] conn(0x563eb2fe7dc0 0x563eb302afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 4 client.6450 mds_command: new command op to 6300 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-28T06:12:37.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.658+0000 7f5aed601000 1 -- 172.21.15.122:0/1590910886 --> [v2:172.21.15.122:6836/3289678231,v1:172.21.15.122:6837/3289678231] -- command(tid 0: {"prefix": "status"}) -- 0x563eb2dcde40 con 0x563eb2fe7dc0 2024-05-28T06:12:37.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5ae3400640 1 --2- 172.21.15.122:0/1590910886 >> [v2:172.21.15.122:6836/3289678231,v1:172.21.15.122:6837/3289678231] conn(0x563eb2fe7dc0 0x563eb302afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:37.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5ae3400640 1 --2- 172.21.15.122:0/1590910886 >> [v2:172.21.15.122:6836/3289678231,v1:172.21.15.122:6837/3289678231] conn(0x563eb2fe7dc0 0x563eb302afb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e01d9d63f0332f1 server_cookie=26636c3f79227388 in_seq=0 out_seq=0 2024-05-28T06:12:37.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5ad0c00640 10 client.6450 ms_handle_connect on v2:172.21.15.122:6836/3289678231 2024-05-28T06:12:37.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5ad0c00640 1 -- 172.21.15.122:0/1590910886 <== mds.0 v2:172.21.15.122:6836/3289678231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x563eb2dcde40 con 0x563eb2fe7dc0 2024-05-28T06:12:37.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5ad0c00640 10 client.6450 handle_command_reply: tid=0 2024-05-28T06:12:37.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aed601000 1 client.6450 shutdown 2024-05-28T06:12:37.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aed601000 1 -- 172.21.15.122:0/1590910886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2fbc120 msgr2=0x563eb2fe7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:37.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aed601000 1 --2- 172.21.15.122:0/1590910886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2fbc120 0x563eb2fe7340 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f5acc01ab50 tx=0x7f5acc0046d0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aed601000 1 -- 172.21.15.122:0/1590910886 shutdown_connections 2024-05-28T06:12:37.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aed601000 1 --2- 172.21.15.122:0/1590910886 >> [v2:172.21.15.122:6836/3289678231,v1:172.21.15.122:6837/3289678231] conn(0x563eb2fe7dc0 0x563eb302afb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aed601000 1 --2- 172.21.15.122:0/1590910886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563eb2fbca40 0x563eb2fe7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aed601000 1 --2- 172.21.15.122:0/1590910886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563eb2fbc120 0x563eb2fe7340 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5ad0c00640 0 client.6450 ms_handle_reset on v2:172.21.15.122:6836/3289678231 2024-05-28T06:12:37.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aed601000 1 --2- 172.21.15.122:0/1590910886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eb2f6f650 0x563eb2fd0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aed601000 1 -- 172.21.15.122:0/1590910886 >> 172.21.15.122:0/1590910886 conn(0x563eb2f9cec0 msgr2=0x563eb2f6e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:37.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aed601000 1 -- 172.21.15.122:0/1590910886 shutdown_connections 2024-05-28T06:12:37.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aed601000 1 -- 172.21.15.122:0/1590910886 wait complete. 2024-05-28T06:12:37.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aed601000 20 client.6450 trim_cache size 0 max 16384 2024-05-28T06:12:37.666 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:12:37.666 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:12:37.666 INFO:teuthology.orchestra.run.smithi122.stdout: "whoami": 0, 2024-05-28T06:12:37.666 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 6300, 2024-05-28T06:12:37.666 INFO:teuthology.orchestra.run.smithi122.stdout: "want_state": "up:active", 2024-05-28T06:12:37.666 INFO:teuthology.orchestra.run.smithi122.stdout: "state": "up:active", 2024-05-28T06:12:37.667 INFO:teuthology.orchestra.run.smithi122.stdout: "fs_name": "cephfs", 2024-05-28T06:12:37.667 INFO:teuthology.orchestra.run.smithi122.stdout: "rank_uptime": 5.8747901340000004, 2024-05-28T06:12:37.667 INFO:teuthology.orchestra.run.smithi122.stdout: "mdsmap_epoch": 37, 2024-05-28T06:12:37.667 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_epoch": 62, 2024-05-28T06:12:37.667 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_epoch_barrier": 62, 2024-05-28T06:12:37.667 INFO:teuthology.orchestra.run.smithi122.stdout: "uptime": 11.778971691000001 2024-05-28T06:12:37.667 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:12:37.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aea200640 1 -- 172.21.15.122:0/2678497802 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5ac0068bf0 msgr2=0x7f5ac006b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:37.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aea200640 1 --2- 172.21.15.122:0/2678497802 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5ac0068bf0 0x7f5ac006b0b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0ad000 tx=0x7f5acc008040 comp rx=0 tx=0).stop 2024-05-28T06:12:37.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aea200640 1 -- 172.21.15.122:0/2678497802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ae40cced0 msgr2=0x7f5ae4157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:37.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aea200640 1 --2- 172.21.15.122:0/2678497802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ae40cced0 0x7f5ae4157e70 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4007ef0 tx=0x7f5ad400e4b0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aea200640 1 -- 172.21.15.122:0/2678497802 shutdown_connections 2024-05-28T06:12:37.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aea200640 1 --2- 172.21.15.122:0/2678497802 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5ac0068bf0 0x7f5ac006b0b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aea200640 1 --2- 172.21.15.122:0/2678497802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ae415c7a0 0x7f5ae4164de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aea200640 1 --2- 172.21.15.122:0/2678497802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ae4159280 0x7f5ae41648a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aea200640 1 --2- 172.21.15.122:0/2678497802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ae40cced0 0x7f5ae4157e70 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aea200640 1 -- 172.21.15.122:0/2678497802 >> 172.21.15.122:0/2678497802 conn(0x7f5ae4062a40 msgr2=0x7f5ae406b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:37.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aea200640 1 -- 172.21.15.122:0/2678497802 shutdown_connections 2024-05-28T06:12:37.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.662+0000 7f5aea200640 1 -- 172.21.15.122:0/2678497802 wait complete. 2024-05-28T06:12:37.681 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-28T06:12:37.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.818+0000 7f6113600640 1 Processor -- start 2024-05-28T06:12:37.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.818+0000 7f6113600640 1 -- start start 2024-05-28T06:12:37.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.818+0000 7f6113600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f610c0b0d90 0x7f610c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.818+0000 7f6113600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f610c06f0c0 0x7f610c06f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.818+0000 7f6113600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f610c15bd70 con 0x7f610c159280 2024-05-28T06:12:37.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.818+0000 7f6113600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f610c159660 con 0x7f610c0b0d90 2024-05-28T06:12:37.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.818+0000 7f6113600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f610c073e20 con 0x7f610c06f0c0 2024-05-28T06:12:37.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.818+0000 7f610be00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f610c0b0d90 0x7f610c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:37.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.818+0000 7f6110c00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f610c159280 0x7f610c073710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:37424/0 (socket says 172.21.15.122:37424) 2024-05-28T06:12:37.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.818+0000 7f6110c00640 1 -- 172.21.15.122:0/2393087201 learned_addr learned my addr 172.21.15.122:0/2393087201 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:37.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.818+0000 7f6111600640 1 --2- 172.21.15.122:0/2393087201 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f610c06f0c0 0x7f610c06f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:37.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.822+0000 7f610be00640 1 -- 172.21.15.122:0/2393087201 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f610c06f0c0 msgr2=0x7f610c06f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:37.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.822+0000 7f610be00640 1 --2- 172.21.15.122:0/2393087201 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f610c06f0c0 0x7f610c06f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.822+0000 7f610be00640 1 -- 172.21.15.122:0/2393087201 >> v1:172.21.15.153:6789/0 conn(0x7f610c159280 legacy=0x7f610c073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:37.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.822+0000 7f610be00640 1 -- 172.21.15.122:0/2393087201 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610c15c050 con 0x7f610c0b0d90 2024-05-28T06:12:37.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.826+0000 7f610be00640 1 --2- 172.21.15.122:0/2393087201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f610c0b0d90 0x7f610c0cf290 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f60f800ba90 tx=0x7f60f801eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befca4167d01c319 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:37.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.826+0000 7f610b400640 1 -- 172.21.15.122:0/2393087201 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f80b4070 con 0x7f610c0b0d90 2024-05-28T06:12:37.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.826+0000 7f610b400640 1 -- 172.21.15.122:0/2393087201 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60f80a7a40 con 0x7f610c0b0d90 2024-05-28T06:12:37.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.826+0000 7f610b400640 1 -- 172.21.15.122:0/2393087201 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f80a7e10 con 0x7f610c0b0d90 2024-05-28T06:12:37.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.826+0000 7f6113600640 1 -- 172.21.15.122:0/2393087201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f610c0b0d90 msgr2=0x7f610c0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:37.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.826+0000 7f6113600640 1 --2- 172.21.15.122:0/2393087201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f610c0b0d90 0x7f610c0cf290 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f60f800ba90 tx=0x7f60f801eb70 comp rx=0 tx=0).stop 2024-05-28T06:12:37.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.826+0000 7f6113600640 1 -- 172.21.15.122:0/2393087201 shutdown_connections 2024-05-28T06:12:37.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.826+0000 7f6113600640 1 --2- 172.21.15.122:0/2393087201 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f610c06f0c0 0x7f610c06f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.826+0000 7f6113600640 1 --2- 172.21.15.122:0/2393087201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f610c0b0d90 0x7f610c0cf290 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.826+0000 7f6113600640 1 -- 172.21.15.122:0/2393087201 >> 172.21.15.122:0/2393087201 conn(0x7f610c0b6c10 msgr2=0x7f610c0b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:37.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.826+0000 7f6113600640 1 -- 172.21.15.122:0/2393087201 shutdown_connections 2024-05-28T06:12:37.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.826+0000 7f6113600640 1 -- 172.21.15.122:0/2393087201 wait complete. 2024-05-28T06:12:37.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f6113600640 1 Processor -- start 2024-05-28T06:12:37.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f6113600640 1 -- start start 2024-05-28T06:12:37.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f6113600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f610c06f0c0 0x7f610c144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f6113600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f610c0b0d90 0x7f610c15a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f6113600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f610c159280 0x7f610c1571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f6113600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f610c0d1fc0 con 0x7f610c0b0d90 2024-05-28T06:12:37.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f6113600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f610c0d1e40 con 0x7f610c159280 2024-05-28T06:12:37.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f6113600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f610c0d2140 con 0x7f610c06f0c0 2024-05-28T06:12:37.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f610be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f610c0b0d90 0x7f610c15a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:37.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f6110c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f610c06f0c0 0x7f610c144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:37.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f610be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f610c0b0d90 0x7f610c15a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38046/0 (socket says 172.21.15.122:38046) 2024-05-28T06:12:37.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f610be00640 1 -- 172.21.15.122:0/2187820498 learned_addr learned my addr 172.21.15.122:0/2187820498 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:37.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f6111600640 1 --2- 172.21.15.122:0/2187820498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f610c159280 0x7f610c1571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:37.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f610be00640 1 -- 172.21.15.122:0/2187820498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f610c06f0c0 msgr2=0x7f610c144e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:37.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f610be00640 1 --2- 172.21.15.122:0/2187820498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f610c06f0c0 0x7f610c144e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f610be00640 1 -- 172.21.15.122:0/2187820498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f610c159280 msgr2=0x7f610c1571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:37.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f610be00640 1 --2- 172.21.15.122:0/2187820498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f610c159280 0x7f610c1571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:37.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f610be00640 1 -- 172.21.15.122:0/2187820498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610c150ea0 con 0x7f610c0b0d90 2024-05-28T06:12:37.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f610be00640 1 --2- 172.21.15.122:0/2187820498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f610c0b0d90 0x7f610c15a8e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f60f800ba90 tx=0x7f60f801b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:37.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f6108c00640 1 -- 172.21.15.122:0/2187820498 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f80bf070 con 0x7f610c0b0d90 2024-05-28T06:12:37.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f6108c00640 1 -- 172.21.15.122:0/2187820498 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60f80afbb0 con 0x7f610c0b0d90 2024-05-28T06:12:37.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f6108c00640 1 -- 172.21.15.122:0/2187820498 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f80b4040 con 0x7f610c0b0d90 2024-05-28T06:12:37.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f6113600640 1 -- 172.21.15.122:0/2187820498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f610c151180 con 0x7f610c0b0d90 2024-05-28T06:12:37.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.830+0000 7f6113600640 1 -- 172.21.15.122:0/2187820498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f610c151740 con 0x7f610c0b0d90 2024-05-28T06:12:37.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.834+0000 7f6113600640 1 -- 172.21.15.122:0/2187820498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f610c068c40 con 0x7f610c0b0d90 2024-05-28T06:12:37.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.834+0000 7f6108c00640 1 -- 172.21.15.122:0/2187820498 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f60f80b93d0 con 0x7f610c0b0d90 2024-05-28T06:12:37.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.834+0000 7f6108c00640 1 --2- 172.21.15.122:0/2187820498 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f60ec068bf0 0x7f60ec06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:37.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.834+0000 7f6108c00640 1 -- 172.21.15.122:0/2187820498 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f60f8121c40 con 0x7f610c0b0d90 2024-05-28T06:12:37.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.834+0000 7f6110c00640 1 --2- 172.21.15.122:0/2187820498 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f60ec068bf0 0x7f60ec06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:37.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.834+0000 7f6110c00640 1 --2- 172.21.15.122:0/2187820498 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f60ec068bf0 0x7f60ec06b0b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f610c151a30 tx=0x7f6100007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:37.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:37.838+0000 7f6108c00640 1 -- 172.21.15.122:0/2187820498 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f60f8018760 con 0x7f610c0b0d90 2024-05-28T06:12:38.033 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.034+0000 7f6113600640 1 -- 172.21.15.122:0/2187820498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f610c14f120 con 0x7f610c0b0d90 2024-05-28T06:12:38.033 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.034+0000 7f6108c00640 1 -- 172.21.15.122:0/2187820498 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) ==== 53+0+73 (secure 0 0 0) 0x7f60f80f1080 con 0x7f610c0b0d90 2024-05-28T06:12:38.033 INFO:teuthology.orchestra.run.smithi122.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-28T06:12:38.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.034+0000 7f6113600640 1 -- 172.21.15.122:0/2187820498 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f60ec068bf0 msgr2=0x7f60ec06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:38.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.034+0000 7f6113600640 1 --2- 172.21.15.122:0/2187820498 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f60ec068bf0 0x7f60ec06b0b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f610c151a30 tx=0x7f6100007e90 comp rx=0 tx=0).stop 2024-05-28T06:12:38.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.034+0000 7f6113600640 1 -- 172.21.15.122:0/2187820498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f610c0b0d90 msgr2=0x7f610c15a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:38.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.034+0000 7f6113600640 1 --2- 172.21.15.122:0/2187820498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f610c0b0d90 0x7f610c15a8e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f60f800ba90 tx=0x7f60f801b910 comp rx=0 tx=0).stop 2024-05-28T06:12:38.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.034+0000 7f6113600640 1 -- 172.21.15.122:0/2187820498 shutdown_connections 2024-05-28T06:12:38.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.034+0000 7f6113600640 1 --2- 172.21.15.122:0/2187820498 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f60ec068bf0 0x7f60ec06b0b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:38.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.034+0000 7f6113600640 1 --2- 172.21.15.122:0/2187820498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f610c159280 0x7f610c1571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:38.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.034+0000 7f6113600640 1 --2- 172.21.15.122:0/2187820498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f610c0b0d90 0x7f610c15a8e0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:38.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.034+0000 7f6113600640 1 --2- 172.21.15.122:0/2187820498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f610c06f0c0 0x7f610c144e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:38.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.034+0000 7f6113600640 1 -- 172.21.15.122:0/2187820498 >> 172.21.15.122:0/2187820498 conn(0x7f610c0b6c10 msgr2=0x7f610c152600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:38.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.034+0000 7f6113600640 1 -- 172.21.15.122:0/2187820498 shutdown_connections 2024-05-28T06:12:38.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.034+0000 7f6113600640 1 -- 172.21.15.122:0/2187820498 wait complete. 2024-05-28T06:12:38.054 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-28T06:12:38.054 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-28T06:12:38.054 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi122.front.sepia.ceph.com 2024-05-28T06:12:38.054 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-28T06:12:38.054 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-28T06:12:38.054 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-28T06:12:38.054 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-28T06:12:38.054 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-28T06:12:38.054 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-28T06:12:38.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:12:38.055 DEBUG:teuthology.orchestra.run.smithi122:> ip addr 2024-05-28T06:12:38.064 INFO:teuthology.orchestra.run.smithi122.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-28T06:12:38.064 INFO:teuthology.orchestra.run.smithi122.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-28T06:12:38.064 INFO:teuthology.orchestra.run.smithi122.stdout: inet 127.0.0.1/8 scope host lo 2024-05-28T06:12:38.064 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:12:38.064 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 ::1/128 scope host 2024-05-28T06:12:38.064 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:12:38.064 INFO:teuthology.orchestra.run.smithi122.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-28T06:12:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e4 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:12:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: altname enp7s0f0 2024-05-28T06:12:38.065 INFO:teuthology.orchestra.run.smithi122.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-28T06:12:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e5 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:12:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: altname enp7s0f1 2024-05-28T06:12:38.065 INFO:teuthology.orchestra.run.smithi122.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-28T06:12:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:14 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:12:38.065 INFO:teuthology.orchestra.run.smithi122.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-28T06:12:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:15 brd ff:ff:ff:ff:ff:ff 2024-05-28T06:12:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: inet 172.21.15.122/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-28T06:12:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft 42064sec preferred_lft 42064sec 2024-05-28T06:12:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::ec4:7aff:fe8f:d515/64 scope link 2024-05-28T06:12:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:12:38.066 INFO:teuthology.orchestra.run.smithi122.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-28T06:12:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 02:42:4d:d8:1b:5f brd ff:ff:ff:ff:ff:ff 2024-05-28T06:12:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-28T06:12:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:12:38.066 INFO:teuthology.orchestra.run.smithi122.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-28T06:12:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-28T06:12:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-28T06:12:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:12:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-28T06:12:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:12:38.067 INFO:teuthology.orchestra.run.smithi122.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-28T06:12:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-28T06:12:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-28T06:12:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:12:38.067 INFO:teuthology.orchestra.run.smithi122.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-28T06:12:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-28T06:12:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-28T06:12:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-05-28T06:12:38.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:12:38.069 DEBUG:teuthology.orchestra.run.smithi122:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-28T06:12:38.131 INFO:teuthology.orchestra.run.smithi122.stdout:1 2024-05-28T06:12:38.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:12:38.133 DEBUG:teuthology.orchestra.run.smithi122:> route 2024-05-28T06:12:38.188 INFO:teuthology.orchestra.run.smithi122.stdout:Kernel IP routing table 2024-05-28T06:12:38.188 INFO:teuthology.orchestra.run.smithi122.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-28T06:12:38.188 INFO:teuthology.orchestra.run.smithi122.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-28T06:12:38.188 INFO:teuthology.orchestra.run.smithi122.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-28T06:12:38.188 INFO:teuthology.orchestra.run.smithi122.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-28T06:12:38.188 INFO:teuthology.orchestra.run.smithi122.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-28T06:12:38.189 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-28T06:12:38.189 INFO:teuthology.orchestra.run.smithi122.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-28T06:12:38.189 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-28T06:12:38.189 INFO:teuthology.orchestra.run.smithi122.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-28T06:12:38.189 INFO:teuthology.orchestra.run.smithi122.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-28T06:12:38.189 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-28T06:12:38.189 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-05-28T06:12:38.189 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-28T06:12:38.189 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-28T06:12:38.190 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-28T06:12:38.190 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-05-28T06:12:38.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-28T06:12:38.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:12:38.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:12:38.326 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2024-05-28T06:12:38.334 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-28T06:12:38.334 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-28T06:12:38.335 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-28T06:12:38.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:12:38.335 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set brx.0 up 2024-05-28T06:12:38.399 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-28T06:12:38.399 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-28T06:12:38.451 INFO:teuthology.orchestra.run.smithi122.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-28T06:12:38.451 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-28T06:12:38.451 DEBUG:teuthology.orchestra.run.smithi122:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-28T06:12:38.499 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-28T06:12:38.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:12:38.499 DEBUG:teuthology.orchestra.run.smithi122:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-28T06:12:38.587 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-28T06:12:38.587 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-28T06:12:38.587 INFO:teuthology.orchestra.run.smithi122.stdout:invalid new device string format 2024-05-28T06:12:38.602 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-28T06:12:38.602 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-28T06:12:38.602 INFO:teuthology.orchestra.run.smithi122.stdout:invalid new device string format 2024-05-28T06:12:38.602 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.122:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-05-28T06:12:38.602 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-28T06:12:38.611 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-28T06:12:38.611 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-28T06:12:38.611 INFO:teuthology.orchestra.run.smithi122.stdout:invalid new device string format 2024-05-28T06:12:38.612 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.122:3300,172.21.15.153:3300,172.21.15.153:3301" 2024-05-28T06:12:38.612 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-28T06:12:38.612 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.122:6789,172.21.15.153:6789,172.21.15.153:6790" 2024-05-28T06:12:38.612 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.122:6789,172.21.15.153:6789,172.21.15.153:6790:/ 2024-05-28T06:12:38.612 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=e63a9349-baf2-4247-95d1-eb8599fad84f" will pass to kernel 2024-05-28T06:12:38.616 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-28T06:12:38.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:12:38.616 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-28T06:12:38.635 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-28T06:12:38.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-28T06:12:38.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-28T06:12:38.744 INFO:teuthology.orchestra.run.smithi122.stdout:client6079 2024-05-28T06:12:38.744 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:12:38.744 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:12:38.753 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-28T06:12:38.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.938+0000 7ff1bb400640 1 Processor -- start 2024-05-28T06:12:38.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.938+0000 7ff1bb400640 1 -- start start 2024-05-28T06:12:38.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.942+0000 7ff1bb400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff1b406cea0 0x7ff1b40b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:38.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.942+0000 7ff1bb400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1b40b4100 0x7ff1b40add80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:38.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.942+0000 7ff1bb400640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1b406be00 con 0x7ff1b415e7a0 2024-05-28T06:12:38.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.942+0000 7ff1bb400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7ff1b406c0e0 con 0x7ff1b406cea0 2024-05-28T06:12:38.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.942+0000 7ff1bb400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b406c3c0 con 0x7ff1b40b4100 2024-05-28T06:12:38.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.942+0000 7ff1b8a00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7ff1b415e7a0 0x7ff1b4162e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:59762/0 (socket says 172.21.15.122:59762) 2024-05-28T06:12:38.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.942+0000 7ff1b8a00640 1 -- 172.21.15.122:0/2989175543 learned_addr learned my addr 172.21.15.122:0/2989175543 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:38.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.942+0000 7ff1abe00640 1 --2- 172.21.15.122:0/2989175543 >> v2:172.21.15.122:3300/0 conn(0x7ff1b406cea0 0x7ff1b40b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:38.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.942+0000 7ff1b9400640 1 --2- 172.21.15.122:0/2989175543 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1b40b4100 0x7ff1b40add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:38.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.942+0000 7ff1b3e00640 1 -- 172.21.15.122:0/2989175543 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3255447389 0 0) 0x7ff1b406be00 con 0x7ff1b415e7a0 2024-05-28T06:12:38.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.942+0000 7ff1b3e00640 1 -- 172.21.15.122:0/2989175543 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff198003530 con 0x7ff1b415e7a0 2024-05-28T06:12:38.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.942+0000 7ff1abe00640 1 -- 172.21.15.122:0/2989175543 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1b40b4100 msgr2=0x7ff1b40add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:38.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.942+0000 7ff1abe00640 1 --2- 172.21.15.122:0/2989175543 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1b40b4100 0x7ff1b40add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:38.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.942+0000 7ff1abe00640 1 -- 172.21.15.122:0/2989175543 >> v1:172.21.15.122:6789/0 conn(0x7ff1b415e7a0 legacy=0x7ff1b4162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:38.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.942+0000 7ff1abe00640 1 -- 172.21.15.122:0/2989175543 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b406c6a0 con 0x7ff1b406cea0 2024-05-28T06:12:38.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.946+0000 7ff1abe00640 1 --2- 172.21.15.122:0/2989175543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1b406cea0 0x7ff1b40b3bc0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ff19c0097c0 tx=0x7ff19c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4649cb801478a1b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:38.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.946+0000 7ff1b3e00640 1 -- 172.21.15.122:0/2989175543 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19c0b0070 con 0x7ff1b406cea0 2024-05-28T06:12:38.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.946+0000 7ff1b3e00640 1 -- 172.21.15.122:0/2989175543 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff19c0ab600 con 0x7ff1b406cea0 2024-05-28T06:12:38.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.946+0000 7ff1b3e00640 1 -- 172.21.15.122:0/2989175543 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19c0ab9d0 con 0x7ff1b406cea0 2024-05-28T06:12:38.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.946+0000 7ff1bb400640 1 -- 172.21.15.122:0/2989175543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1b406cea0 msgr2=0x7ff1b40b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:38.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.946+0000 7ff1bb400640 1 --2- 172.21.15.122:0/2989175543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1b406cea0 0x7ff1b40b3bc0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ff19c0097c0 tx=0x7ff19c01c4a0 comp rx=0 tx=0).stop 2024-05-28T06:12:38.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.946+0000 7ff1bb400640 1 -- 172.21.15.122:0/2989175543 shutdown_connections 2024-05-28T06:12:38.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.946+0000 7ff1bb400640 1 --2- 172.21.15.122:0/2989175543 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1b40b4100 0x7ff1b40add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:38.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.946+0000 7ff1bb400640 1 --2- 172.21.15.122:0/2989175543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1b406cea0 0x7ff1b40b3bc0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:38.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.946+0000 7ff1bb400640 1 -- 172.21.15.122:0/2989175543 >> 172.21.15.122:0/2989175543 conn(0x7ff1b40b3130 msgr2=0x7ff1b40d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:38.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.946+0000 7ff1bb400640 1 -- 172.21.15.122:0/2989175543 shutdown_connections 2024-05-28T06:12:38.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.946+0000 7ff1bb400640 1 -- 172.21.15.122:0/2989175543 wait complete. 2024-05-28T06:12:38.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.946+0000 7ff1bb400640 1 Processor -- start 2024-05-28T06:12:38.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.946+0000 7ff1bb400640 1 -- start start 2024-05-28T06:12:38.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.946+0000 7ff1bb400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1b406cea0 0x7ff1b4160e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:38.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1bb400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1b40b4100 0x7ff1b415cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:38.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1bb400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b415e7a0 0x7ff1b415d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:38.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1bb400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b406bb10 con 0x7ff1b40b4100 2024-05-28T06:12:38.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1bb400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b406b990 con 0x7ff1b415e7a0 2024-05-28T06:12:38.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1bb400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b416b820 con 0x7ff1b406cea0 2024-05-28T06:12:38.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1abe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1b40b4100 0x7ff1b415cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:38.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1abe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1b40b4100 0x7ff1b415cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38062/0 (socket says 172.21.15.122:38062) 2024-05-28T06:12:38.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1abe00640 1 -- 172.21.15.122:0/2001344315 learned_addr learned my addr 172.21.15.122:0/2001344315 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:38.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1b9400640 1 --2- 172.21.15.122:0/2001344315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b415e7a0 0x7ff1b415d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:38.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1b8a00640 1 --2- 172.21.15.122:0/2001344315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1b406cea0 0x7ff1b4160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:38.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1abe00640 1 -- 172.21.15.122:0/2001344315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1b406cea0 msgr2=0x7ff1b4160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:38.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1abe00640 1 --2- 172.21.15.122:0/2001344315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1b406cea0 0x7ff1b4160e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:38.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1abe00640 1 -- 172.21.15.122:0/2001344315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b415e7a0 msgr2=0x7ff1b415d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:38.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1abe00640 1 --2- 172.21.15.122:0/2001344315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b415e7a0 0x7ff1b415d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:38.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1abe00640 1 -- 172.21.15.122:0/2001344315 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b415f950 con 0x7ff1b40b4100 2024-05-28T06:12:38.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1b9400640 1 --2- 172.21.15.122:0/2001344315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b415e7a0 0x7ff1b415d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:38.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1b8a00640 1 --2- 172.21.15.122:0/2001344315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1b406cea0 0x7ff1b4160e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:38.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1abe00640 1 --2- 172.21.15.122:0/2001344315 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1b40b4100 0x7ff1b415cc60 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ff19c01a0d0 tx=0x7ff19c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:38.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1b1600640 1 -- 172.21.15.122:0/2001344315 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19c0b0040 con 0x7ff1b40b4100 2024-05-28T06:12:38.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1b1600640 1 -- 172.21.15.122:0/2001344315 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff19c0b9070 con 0x7ff1b40b4100 2024-05-28T06:12:38.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1bb400640 1 -- 172.21.15.122:0/2001344315 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1b415fc30 con 0x7ff1b40b4100 2024-05-28T06:12:38.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1b1600640 1 -- 172.21.15.122:0/2001344315 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19c0b4650 con 0x7ff1b40b4100 2024-05-28T06:12:38.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1bb400640 1 -- 172.21.15.122:0/2001344315 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1b41601f0 con 0x7ff1b40b4100 2024-05-28T06:12:38.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1bb400640 1 -- 172.21.15.122:0/2001344315 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1b4068c40 con 0x7ff1b40b4100 2024-05-28T06:12:38.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.950+0000 7ff1b1600640 1 -- 172.21.15.122:0/2001344315 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7ff19c0b47f0 con 0x7ff1b40b4100 2024-05-28T06:12:38.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.954+0000 7ff1b1600640 1 --2- 172.21.15.122:0/2001344315 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff190068bf0 0x7ff19006b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:38.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.954+0000 7ff1b1600640 1 -- 172.21.15.122:0/2001344315 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7ff19c121590 con 0x7ff1b40b4100 2024-05-28T06:12:38.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.954+0000 7ff1b8a00640 1 --2- 172.21.15.122:0/2001344315 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff190068bf0 0x7ff19006b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:38.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.954+0000 7ff1b8a00640 1 --2- 172.21.15.122:0/2001344315 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff190068bf0 0x7ff19006b0b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4005c10 tx=0x7ff1a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:38.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:38.958+0000 7ff1b1600640 1 -- 172.21.15.122:0/2001344315 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff19c016090 con 0x7ff1b40b4100 2024-05-28T06:12:39.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.150+0000 7ff1bb400640 1 -- 172.21.15.122:0/2001344315 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7ff1b40d18e0 con 0x7ff1b40b4100 2024-05-28T06:12:39.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.830+0000 7ff1b1600640 1 -- 172.21.15.122:0/2001344315 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v38) ==== 136+0+0 (secure 0 0 0) 0x7ff19c0f0f10 con 0x7ff1b40b4100 2024-05-28T06:12:39.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.834+0000 7ff1bb400640 1 -- 172.21.15.122:0/2001344315 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff190068bf0 msgr2=0x7ff19006b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:39.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.834+0000 7ff1bb400640 1 --2- 172.21.15.122:0/2001344315 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff190068bf0 0x7ff19006b0b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4005c10 tx=0x7ff1a4009040 comp rx=0 tx=0).stop 2024-05-28T06:12:39.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.834+0000 7ff1bb400640 1 -- 172.21.15.122:0/2001344315 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1b40b4100 msgr2=0x7ff1b415cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:39.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.834+0000 7ff1bb400640 1 --2- 172.21.15.122:0/2001344315 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1b40b4100 0x7ff1b415cc60 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ff19c01a0d0 tx=0x7ff19c019240 comp rx=0 tx=0).stop 2024-05-28T06:12:39.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.834+0000 7ff1bb400640 1 -- 172.21.15.122:0/2001344315 shutdown_connections 2024-05-28T06:12:39.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.834+0000 7ff1bb400640 1 --2- 172.21.15.122:0/2001344315 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff190068bf0 0x7ff19006b0b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:39.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.834+0000 7ff1bb400640 1 --2- 172.21.15.122:0/2001344315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b415e7a0 0x7ff1b415d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:39.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.834+0000 7ff1bb400640 1 --2- 172.21.15.122:0/2001344315 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1b40b4100 0x7ff1b415cc60 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:39.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.834+0000 7ff1bb400640 1 --2- 172.21.15.122:0/2001344315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1b406cea0 0x7ff1b4160e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:39.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.834+0000 7ff1bb400640 1 -- 172.21.15.122:0/2001344315 >> 172.21.15.122:0/2001344315 conn(0x7ff1b40b3130 msgr2=0x7ff1b40b1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:39.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.834+0000 7ff1bb400640 1 -- 172.21.15.122:0/2001344315 shutdown_connections 2024-05-28T06:12:39.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.834+0000 7ff1bb400640 1 -- 172.21.15.122:0/2001344315 wait complete. 2024-05-28T06:12:39.855 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-28T06:12:39.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.994+0000 7f78de600640 1 Processor -- start 2024-05-28T06:12:39.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.994+0000 7f78de600640 1 -- start start 2024-05-28T06:12:39.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.994+0000 7f78de600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f78d815e8c0 0x7f78d806f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:39.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.994+0000 7f78de600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f78d8073da0 0x7f78d80ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:39.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.994+0000 7f78de600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78d80d0fe0 con 0x7f78d815eca0 2024-05-28T06:12:39.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.994+0000 7f78de600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f78d80d1440 con 0x7f78d815e8c0 2024-05-28T06:12:39.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.994+0000 7f78de600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f78d80d1720 con 0x7f78d8073da0 2024-05-28T06:12:39.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.994+0000 7f78d7400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f78d815e8c0 0x7f78d806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:39.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.994+0000 7f78d7400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f78d815e8c0 0x7f78d806f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38064/0 (socket says 172.21.15.122:38064) 2024-05-28T06:12:39.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.994+0000 7f78d7400640 1 -- 172.21.15.122:0/1002039110 learned_addr learned my addr 172.21.15.122:0/1002039110 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:39.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.994+0000 7f78d7400640 1 -- 172.21.15.122:0/1002039110 >> v2:172.21.15.153:3300/0 conn(0x7f78d8073da0 msgr2=0x7f78d80ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:39.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.994+0000 7f78d7400640 1 --2- 172.21.15.122:0/1002039110 >> v2:172.21.15.153:3300/0 conn(0x7f78d8073da0 0x7f78d80ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:39.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.994+0000 7f78d7400640 1 -- 172.21.15.122:0/1002039110 >> v1:172.21.15.153:6789/0 conn(0x7f78d815eca0 legacy=0x7f78d8073690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:39.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.994+0000 7f78d7400640 1 -- 172.21.15.122:0/1002039110 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d80d1a00 con 0x7f78d815e8c0 2024-05-28T06:12:39.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.998+0000 7f78d7400640 1 --2- 172.21.15.122:0/1002039110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78d815e8c0 0x7f78d806f350 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f78d806ba30 tx=0x7f78c801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0af24209220cb80 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:39.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.998+0000 7f78d6000640 1 -- 172.21.15.122:0/1002039110 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c80a56f0 con 0x7f78d815e8c0 2024-05-28T06:12:39.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.998+0000 7f78d6000640 1 -- 172.21.15.122:0/1002039110 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78c80a5890 con 0x7f78d815e8c0 2024-05-28T06:12:39.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.998+0000 7f78d6000640 1 -- 172.21.15.122:0/1002039110 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c80a5c60 con 0x7f78d815e8c0 2024-05-28T06:12:39.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.998+0000 7f78de600640 1 -- 172.21.15.122:0/1002039110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78d815e8c0 msgr2=0x7f78d806f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:40.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.998+0000 7f78de600640 1 --2- 172.21.15.122:0/1002039110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78d815e8c0 0x7f78d806f350 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f78d806ba30 tx=0x7f78c801c920 comp rx=0 tx=0).stop 2024-05-28T06:12:40.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.998+0000 7f78de600640 1 -- 172.21.15.122:0/1002039110 shutdown_connections 2024-05-28T06:12:40.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.998+0000 7f78de600640 1 --2- 172.21.15.122:0/1002039110 >> v2:172.21.15.153:3300/0 conn(0x7f78d8073da0 0x7f78d80ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.998+0000 7f78de600640 1 --2- 172.21.15.122:0/1002039110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78d815e8c0 0x7f78d806f350 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.998+0000 7f78de600640 1 -- 172.21.15.122:0/1002039110 >> 172.21.15.122:0/1002039110 conn(0x7f78d80b6b20 msgr2=0x7f78d80b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:40.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.998+0000 7f78de600640 1 -- 172.21.15.122:0/1002039110 shutdown_connections 2024-05-28T06:12:40.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:39.998+0000 7f78de600640 1 -- 172.21.15.122:0/1002039110 wait complete. 2024-05-28T06:12:40.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78de600640 1 Processor -- start 2024-05-28T06:12:40.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78de600640 1 -- start start 2024-05-28T06:12:40.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78de600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78d8073da0 0x7f78d8149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:40.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78de600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78d815e8c0 0x7f78d8160b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:40.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78de600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78d815eca0 0x7f78d814b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:40.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78de600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f78d80cf2b0 con 0x7f78d815eca0 2024-05-28T06:12:40.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78de600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f78d80cf130 con 0x7f78d815e8c0 2024-05-28T06:12:40.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78de600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f78d816b610 con 0x7f78d8073da0 2024-05-28T06:12:40.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78d7e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78d815eca0 0x7f78d814b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:40.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78d7e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78d815eca0 0x7f78d814b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38078/0 (socket says 172.21.15.122:38078) 2024-05-28T06:12:40.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78d7e00640 1 -- 172.21.15.122:0/16151486 learned_addr learned my addr 172.21.15.122:0/16151486 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:40.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78d7400640 1 --2- 172.21.15.122:0/16151486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78d8073da0 0x7f78d8149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:40.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78d6a00640 1 --2- 172.21.15.122:0/16151486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78d815e8c0 0x7f78d8160b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:40.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78d7e00640 1 -- 172.21.15.122:0/16151486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78d8073da0 msgr2=0x7f78d8149990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:40.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78d7e00640 1 --2- 172.21.15.122:0/16151486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78d8073da0 0x7f78d8149990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78d7e00640 1 -- 172.21.15.122:0/16151486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78d815e8c0 msgr2=0x7f78d8160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:40.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78d7e00640 1 --2- 172.21.15.122:0/16151486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78d815e8c0 0x7f78d8160b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78d7e00640 1 -- 172.21.15.122:0/16151486 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d80ca980 con 0x7f78d815eca0 2024-05-28T06:12:40.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78d7e00640 1 --2- 172.21.15.122:0/16151486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78d815eca0 0x7f78d814b2e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f78d000b430 tx=0x7f78d000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:40.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78cf400640 1 -- 172.21.15.122:0/16151486 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0015020 con 0x7f78d815eca0 2024-05-28T06:12:40.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78cf400640 1 -- 172.21.15.122:0/16151486 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d0011830 con 0x7f78d815eca0 2024-05-28T06:12:40.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78de600640 1 -- 172.21.15.122:0/16151486 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d81615c0 con 0x7f78d815eca0 2024-05-28T06:12:40.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78cf400640 1 -- 172.21.15.122:0/16151486 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0011c20 con 0x7f78d815eca0 2024-05-28T06:12:40.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.002+0000 7f78de600640 1 -- 172.21.15.122:0/16151486 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d8161b80 con 0x7f78d815eca0 2024-05-28T06:12:40.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.006+0000 7f78de600640 1 -- 172.21.15.122:0/16151486 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78d8068bd0 con 0x7f78d815eca0 2024-05-28T06:12:40.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.006+0000 7f78cf400640 1 -- 172.21.15.122:0/16151486 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f78d0018020 con 0x7f78d815eca0 2024-05-28T06:12:40.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.006+0000 7f78cf400640 1 --2- 172.21.15.122:0/16151486 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f78b8068bf0 0x7f78b806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:40.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.006+0000 7f78cf400640 1 -- 172.21.15.122:0/16151486 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f78d00879f0 con 0x7f78d815eca0 2024-05-28T06:12:40.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.006+0000 7f78d7400640 1 --2- 172.21.15.122:0/16151486 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f78b8068bf0 0x7f78b806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:40.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.006+0000 7f78d7400640 1 --2- 172.21.15.122:0/16151486 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f78b8068bf0 0x7f78b806b0b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f78c80ae000 tx=0x7f78c80a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:40.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.010+0000 7f78cf400640 1 -- 172.21.15.122:0/16151486 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f78d001f020 con 0x7f78d815eca0 2024-05-28T06:12:40.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.186+0000 7f78de600640 1 -- 172.21.15.122:0/16151486 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f78d8159290 con 0x7f78b8068bf0 2024-05-28T06:12:40.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.190+0000 7f78cf400640 1 -- 172.21.15.122:0/16151486 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f78d8159290 con 0x7f78b8068bf0 2024-05-28T06:12:40.189 INFO:teuthology.orchestra.run.smithi122.stdout:[ 2024-05-28T06:12:40.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:12:40.190 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "cephfs" 2024-05-28T06:12:40.190 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:12:40.190 INFO:teuthology.orchestra.run.smithi122.stdout:] 2024-05-28T06:12:40.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.190+0000 7f78de600640 1 -- 172.21.15.122:0/16151486 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f78b8068bf0 msgr2=0x7f78b806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:40.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.190+0000 7f78de600640 1 --2- 172.21.15.122:0/16151486 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f78b8068bf0 0x7f78b806b0b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f78c80ae000 tx=0x7f78c80a7070 comp rx=0 tx=0).stop 2024-05-28T06:12:40.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.190+0000 7f78de600640 1 -- 172.21.15.122:0/16151486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78d815eca0 msgr2=0x7f78d814b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:40.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.190+0000 7f78de600640 1 --2- 172.21.15.122:0/16151486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78d815eca0 0x7f78d814b2e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f78d000b430 tx=0x7f78d000b8f0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.190+0000 7f78de600640 1 -- 172.21.15.122:0/16151486 shutdown_connections 2024-05-28T06:12:40.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.190+0000 7f78de600640 1 --2- 172.21.15.122:0/16151486 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f78b8068bf0 0x7f78b806b0b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.190+0000 7f78de600640 1 --2- 172.21.15.122:0/16151486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78d815eca0 0x7f78d814b2e0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.190+0000 7f78de600640 1 --2- 172.21.15.122:0/16151486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78d815e8c0 0x7f78d8160b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.190+0000 7f78de600640 1 --2- 172.21.15.122:0/16151486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78d8073da0 0x7f78d8149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.190+0000 7f78de600640 1 -- 172.21.15.122:0/16151486 >> 172.21.15.122:0/16151486 conn(0x7f78d80b6b20 msgr2=0x7f78d81556e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:40.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.190+0000 7f78de600640 1 -- 172.21.15.122:0/16151486 shutdown_connections 2024-05-28T06:12:40.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.190+0000 7f78de600640 1 -- 172.21.15.122:0/16151486 wait complete. 2024-05-28T06:12:40.211 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-28T06:12:40.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.350+0000 7fb57a200640 1 Processor -- start 2024-05-28T06:12:40.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.350+0000 7fb57a200640 1 -- start start 2024-05-28T06:12:40.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.350+0000 7fb57a200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb57415ea50 0x7fb57415ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:40.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.354+0000 7fb57a200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb57415f370 0x7fb57415f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:40.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.354+0000 7fb57a200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb574162510 con 0x7fb57406caa0 2024-05-28T06:12:40.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.354+0000 7fb57a200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fb574163120 con 0x7fb57415ea50 2024-05-28T06:12:40.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.354+0000 7fb57a200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb5741627f0 con 0x7fb57415f370 2024-05-28T06:12:40.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.354+0000 7fb573400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb57415ea50 0x7fb57415ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:40.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.354+0000 7fb573e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fb57406caa0 0x7fb57406cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:59774/0 (socket says 172.21.15.122:59774) 2024-05-28T06:12:40.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.354+0000 7fb573e00640 1 -- 172.21.15.122:0/2874762750 learned_addr learned my addr 172.21.15.122:0/2874762750 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:40.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.354+0000 7fb56aa00640 1 --2- 172.21.15.122:0/2874762750 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb57415f370 0x7fb57415f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:40.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.354+0000 7fb573400640 1 -- 172.21.15.122:0/2874762750 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb57415f370 msgr2=0x7fb57415f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:40.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.354+0000 7fb573400640 1 --2- 172.21.15.122:0/2874762750 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb57415f370 0x7fb57415f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.354+0000 7fb573400640 1 -- 172.21.15.122:0/2874762750 >> v1:172.21.15.122:6789/0 conn(0x7fb57406caa0 legacy=0x7fb57406cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:40.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.354+0000 7fb573400640 1 -- 172.21.15.122:0/2874762750 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb574162ad0 con 0x7fb57415ea50 2024-05-28T06:12:40.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.354+0000 7fb572a00640 1 -- 172.21.15.122:0/2874762750 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2154360312 0 0) 0x7fb574162510 con 0x7fb57406caa0 2024-05-28T06:12:40.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.354+0000 7fb573400640 1 --2- 172.21.15.122:0/2874762750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb57415ea50 0x7fb57415ee30 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb5640097c0 tx=0x7fb56401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17da4c229a100397 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:40.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.354+0000 7fb572a00640 1 -- 172.21.15.122:0/2874762750 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5640b2070 con 0x7fb57415ea50 2024-05-28T06:12:40.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.354+0000 7fb572a00640 1 -- 172.21.15.122:0/2874762750 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5640ad680 con 0x7fb57415ea50 2024-05-28T06:12:40.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.354+0000 7fb572a00640 1 -- 172.21.15.122:0/2874762750 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5640ada50 con 0x7fb57415ea50 2024-05-28T06:12:40.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb57a200640 1 -- 172.21.15.122:0/2874762750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb57415ea50 msgr2=0x7fb57415ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:40.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb57a200640 1 --2- 172.21.15.122:0/2874762750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb57415ea50 0x7fb57415ee30 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb5640097c0 tx=0x7fb56401c470 comp rx=0 tx=0).stop 2024-05-28T06:12:40.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb57a200640 1 -- 172.21.15.122:0/2874762750 shutdown_connections 2024-05-28T06:12:40.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb57a200640 1 --2- 172.21.15.122:0/2874762750 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb57415f370 0x7fb57415f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb57a200640 1 --2- 172.21.15.122:0/2874762750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb57415ea50 0x7fb57415ee30 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb57a200640 1 -- 172.21.15.122:0/2874762750 >> 172.21.15.122:0/2874762750 conn(0x7fb5740b4190 msgr2=0x7fb5740b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:40.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb57a200640 1 -- 172.21.15.122:0/2874762750 shutdown_connections 2024-05-28T06:12:40.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb57a200640 1 -- 172.21.15.122:0/2874762750 wait complete. 2024-05-28T06:12:40.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb57a200640 1 Processor -- start 2024-05-28T06:12:40.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb57a200640 1 -- start start 2024-05-28T06:12:40.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb57a200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb57406caa0 0x7fb574158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:40.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb57a200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb57415ea50 0x7fb574156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:40.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb57a200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb57415f370 0x7fb5740b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:40.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb57a200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb57416b990 con 0x7fb57406caa0 2024-05-28T06:12:40.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb57a200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb57416b810 con 0x7fb57415ea50 2024-05-28T06:12:40.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb57a200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb57416bb10 con 0x7fb57415f370 2024-05-28T06:12:40.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb573400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb57406caa0 0x7fb574158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:40.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb573400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb57406caa0 0x7fb574158560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38092/0 (socket says 172.21.15.122:38092) 2024-05-28T06:12:40.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb573400640 1 -- 172.21.15.122:0/793613860 learned_addr learned my addr 172.21.15.122:0/793613860 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:40.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb573400640 1 -- 172.21.15.122:0/793613860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb57415f370 msgr2=0x7fb5740b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:40.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb573400640 1 --2- 172.21.15.122:0/793613860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb57415f370 0x7fb5740b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb573400640 1 -- 172.21.15.122:0/793613860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb57415ea50 msgr2=0x7fb574156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:40.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb56aa00640 1 --2- 172.21.15.122:0/793613860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb57415ea50 0x7fb574156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:40.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb573400640 1 --2- 172.21.15.122:0/793613860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb57415ea50 0x7fb574156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb573400640 1 -- 172.21.15.122:0/793613860 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5740af5b0 con 0x7fb57406caa0 2024-05-28T06:12:40.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.358+0000 7fb56aa00640 1 --2- 172.21.15.122:0/793613860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb57415ea50 0x7fb574156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:40.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.362+0000 7fb573400640 1 --2- 172.21.15.122:0/793613860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb57406caa0 0x7fb574158560 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb56401ab20 tx=0x7fb56401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:40.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.362+0000 7fb56be00640 1 -- 172.21.15.122:0/793613860 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5640bc020 con 0x7fb57406caa0 2024-05-28T06:12:40.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.362+0000 7fb56be00640 1 -- 172.21.15.122:0/793613860 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5640adc10 con 0x7fb57406caa0 2024-05-28T06:12:40.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.362+0000 7fb57a200640 1 -- 172.21.15.122:0/793613860 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5740af890 con 0x7fb57406caa0 2024-05-28T06:12:40.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.362+0000 7fb56be00640 1 -- 172.21.15.122:0/793613860 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5640b2040 con 0x7fb57406caa0 2024-05-28T06:12:40.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.362+0000 7fb57a200640 1 -- 172.21.15.122:0/793613860 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb574156e10 con 0x7fb57406caa0 2024-05-28T06:12:40.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.362+0000 7fb57a200640 1 -- 172.21.15.122:0/793613860 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb574068c40 con 0x7fb57406caa0 2024-05-28T06:12:40.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.362+0000 7fb56be00640 1 -- 172.21.15.122:0/793613860 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fb5640bf020 con 0x7fb57406caa0 2024-05-28T06:12:40.363 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.362+0000 7fb56be00640 1 --2- 172.21.15.122:0/793613860 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb550068bf0 0x7fb55006b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:40.363 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.362+0000 7fb56be00640 1 -- 172.21.15.122:0/793613860 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7fb564121a30 con 0x7fb57406caa0 2024-05-28T06:12:40.363 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.362+0000 7fb56aa00640 1 --2- 172.21.15.122:0/793613860 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb550068bf0 0x7fb55006b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:40.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.366+0000 7fb56aa00640 1 --2- 172.21.15.122:0/793613860 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb550068bf0 0x7fb55006b0b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb5741fb170 tx=0x7fb55c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:40.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.366+0000 7fb56be00640 1 -- 172.21.15.122:0/793613860 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb5640c6030 con 0x7fb57406caa0 2024-05-28T06:12:40.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.526+0000 7fb57a200640 1 -- 172.21.15.122:0/793613860 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fb5740b4ea0 con 0x7fb57406caa0 2024-05-28T06:12:40.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.526+0000 7fb56be00640 1 -- 172.21.15.122:0/793613860 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7fb564016090 con 0x7fb57406caa0 2024-05-28T06:12:40.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.526+0000 7fb57a200640 1 -- 172.21.15.122:0/793613860 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb550068bf0 msgr2=0x7fb55006b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:40.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.526+0000 7fb57a200640 1 --2- 172.21.15.122:0/793613860 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb550068bf0 0x7fb55006b0b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb5741fb170 tx=0x7fb55c008040 comp rx=0 tx=0).stop 2024-05-28T06:12:40.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.526+0000 7fb57a200640 1 -- 172.21.15.122:0/793613860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb57406caa0 msgr2=0x7fb574158560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:40.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.526+0000 7fb57a200640 1 --2- 172.21.15.122:0/793613860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb57406caa0 0x7fb574158560 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb56401ab20 tx=0x7fb56401acb0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.526+0000 7fb57a200640 1 -- 172.21.15.122:0/793613860 shutdown_connections 2024-05-28T06:12:40.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.526+0000 7fb57a200640 1 --2- 172.21.15.122:0/793613860 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb550068bf0 0x7fb55006b0b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.526+0000 7fb57a200640 1 --2- 172.21.15.122:0/793613860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb57415f370 0x7fb5740b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.526+0000 7fb57a200640 1 --2- 172.21.15.122:0/793613860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb57415ea50 0x7fb574156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.526+0000 7fb57a200640 1 --2- 172.21.15.122:0/793613860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb57406caa0 0x7fb574158560 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.526+0000 7fb57a200640 1 -- 172.21.15.122:0/793613860 >> 172.21.15.122:0/793613860 conn(0x7fb5740b4190 msgr2=0x7fb5741577b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:40.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.526+0000 7fb57a200640 1 -- 172.21.15.122:0/793613860 shutdown_connections 2024-05-28T06:12:40.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.526+0000 7fb57a200640 1 -- 172.21.15.122:0/793613860 wait complete. 2024-05-28T06:12:40.547 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_no_wait false 2024-05-28T06:12:40.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.686+0000 7f5b9ae00640 1 Processor -- start 2024-05-28T06:12:40.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.686+0000 7f5b9ae00640 1 -- start start 2024-05-28T06:12:40.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.686+0000 7f5b9ae00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5b9415c860 0x7f5b9409b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:40.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.686+0000 7f5b9ae00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5b9409bbd0 0x7f5b9409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:40.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.686+0000 7f5b9ae00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b940cd110 con 0x7f5b9409af80 2024-05-28T06:12:40.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.686+0000 7f5b9ae00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f5b940cdd20 con 0x7f5b9409bbd0 2024-05-28T06:12:40.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.686+0000 7f5b9ae00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5b940d1040 con 0x7f5b9415c860 2024-05-28T06:12:40.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.690+0000 7f5b9a400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f5b9409af80 0x7f5b94160240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:59778/0 (socket says 172.21.15.122:59778) 2024-05-28T06:12:40.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.690+0000 7f5b9a400640 1 -- 172.21.15.122:0/3695470604 learned_addr learned my addr 172.21.15.122:0/3695470604 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:40.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.690+0000 7f5b99000640 1 --2- 172.21.15.122:0/3695470604 >> v2:172.21.15.122:3300/0 conn(0x7f5b9409bbd0 0x7f5b9409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:40.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.690+0000 7f5b99a00640 1 --2- 172.21.15.122:0/3695470604 >> v2:172.21.15.153:3300/0 conn(0x7f5b9415c860 0x7f5b9409b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:40.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.690+0000 7f5b99000640 1 -- 172.21.15.122:0/3695470604 >> v2:172.21.15.153:3300/0 conn(0x7f5b9415c860 msgr2=0x7f5b9409b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:40.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.690+0000 7f5b99000640 1 --2- 172.21.15.122:0/3695470604 >> v2:172.21.15.153:3300/0 conn(0x7f5b9415c860 0x7f5b9409b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.690+0000 7f5b99000640 1 -- 172.21.15.122:0/3695470604 >> v1:172.21.15.122:6789/0 conn(0x7f5b9409af80 legacy=0x7f5b94160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:40.689 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.690+0000 7f5b99000640 1 -- 172.21.15.122:0/3695470604 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b940cd3f0 con 0x7f5b9409bbd0 2024-05-28T06:12:40.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.690+0000 7f5b99000640 1 --2- 172.21.15.122:0/3695470604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b9409bbd0 0x7f5b9409aa40 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5b940732a0 tx=0x7f5b8001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f63f379d8b677c server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:40.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.690+0000 7f5b93e00640 1 -- 172.21.15.122:0/3695470604 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b800b0070 con 0x7f5b9409bbd0 2024-05-28T06:12:40.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.690+0000 7f5b93e00640 1 -- 172.21.15.122:0/3695470604 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b800ab600 con 0x7f5b9409bbd0 2024-05-28T06:12:40.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.690+0000 7f5b93e00640 1 -- 172.21.15.122:0/3695470604 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b800ab9d0 con 0x7f5b9409bbd0 2024-05-28T06:12:40.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9ae00640 1 -- 172.21.15.122:0/3695470604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b9409bbd0 msgr2=0x7f5b9409aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:40.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9ae00640 1 --2- 172.21.15.122:0/3695470604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b9409bbd0 0x7f5b9409aa40 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5b940732a0 tx=0x7f5b8001c480 comp rx=0 tx=0).stop 2024-05-28T06:12:40.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9ae00640 1 -- 172.21.15.122:0/3695470604 shutdown_connections 2024-05-28T06:12:40.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9ae00640 1 --2- 172.21.15.122:0/3695470604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b9409bbd0 0x7f5b9409aa40 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9ae00640 1 --2- 172.21.15.122:0/3695470604 >> v2:172.21.15.153:3300/0 conn(0x7f5b9415c860 0x7f5b9409b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9ae00640 1 -- 172.21.15.122:0/3695470604 >> 172.21.15.122:0/3695470604 conn(0x7f5b940d2460 msgr2=0x7f5b940d2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:40.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9ae00640 1 -- 172.21.15.122:0/3695470604 shutdown_connections 2024-05-28T06:12:40.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9ae00640 1 -- 172.21.15.122:0/3695470604 wait complete. 2024-05-28T06:12:40.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9ae00640 1 Processor -- start 2024-05-28T06:12:40.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9ae00640 1 -- start start 2024-05-28T06:12:40.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9ae00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b9409af80 0x7f5b94150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:40.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9ae00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b9409bbd0 0x7f5b94152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:40.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9ae00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b9415c860 0x7f5b9415cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:40.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9ae00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5b940ce310 con 0x7f5b9415c860 2024-05-28T06:12:40.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9ae00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5b940ce190 con 0x7f5b9409af80 2024-05-28T06:12:40.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9ae00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f5b94169580 con 0x7f5b9409bbd0 2024-05-28T06:12:40.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9a400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b9415c860 0x7f5b9415cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:40.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9a400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b9415c860 0x7f5b9415cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38112/0 (socket says 172.21.15.122:38112) 2024-05-28T06:12:40.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9a400640 1 -- 172.21.15.122:0/709593420 learned_addr learned my addr 172.21.15.122:0/709593420 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:40.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b99000640 1 --2- 172.21.15.122:0/709593420 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b9409bbd0 0x7f5b94152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:40.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b99a00640 1 --2- 172.21.15.122:0/709593420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b9409af80 0x7f5b94150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:40.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9a400640 1 -- 172.21.15.122:0/709593420 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b9409bbd0 msgr2=0x7f5b94152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:40.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9a400640 1 --2- 172.21.15.122:0/709593420 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b9409bbd0 0x7f5b94152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9a400640 1 -- 172.21.15.122:0/709593420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b9409af80 msgr2=0x7f5b94150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:40.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9a400640 1 --2- 172.21.15.122:0/709593420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b9409af80 0x7f5b94150250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.694+0000 7f5b9a400640 1 -- 172.21.15.122:0/709593420 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9415f680 con 0x7f5b9415c860 2024-05-28T06:12:40.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.698+0000 7f5b99000640 1 --2- 172.21.15.122:0/709593420 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b9409bbd0 0x7f5b94152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:12:40.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.698+0000 7f5b9a400640 1 --2- 172.21.15.122:0/709593420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b9415c860 0x7f5b9415cea0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00ca80 tx=0x7f5b8c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:40.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.698+0000 7f5b91600640 1 -- 172.21.15.122:0/709593420 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c017070 con 0x7f5b9415c860 2024-05-28T06:12:40.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.698+0000 7f5b91600640 1 -- 172.21.15.122:0/709593420 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b8c00ac30 con 0x7f5b9415c860 2024-05-28T06:12:40.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.698+0000 7f5b91600640 1 -- 172.21.15.122:0/709593420 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c012600 con 0x7f5b9415c860 2024-05-28T06:12:40.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.698+0000 7f5b9ae00640 1 -- 172.21.15.122:0/709593420 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b941524d0 con 0x7f5b9415c860 2024-05-28T06:12:40.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.698+0000 7f5b9ae00640 1 -- 172.21.15.122:0/709593420 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b9415f920 con 0x7f5b9415c860 2024-05-28T06:12:40.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.698+0000 7f5b9ae00640 1 -- 172.21.15.122:0/709593420 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b94075620 con 0x7f5b9415c860 2024-05-28T06:12:40.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.698+0000 7f5b91600640 1 -- 172.21.15.122:0/709593420 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f5b8c01a070 con 0x7f5b9415c860 2024-05-28T06:12:40.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.698+0000 7f5b91600640 1 --2- 172.21.15.122:0/709593420 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5b74068bf0 0x7f5b7406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:40.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.698+0000 7f5b91600640 1 -- 172.21.15.122:0/709593420 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f5b8c087680 con 0x7f5b9415c860 2024-05-28T06:12:40.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.698+0000 7f5b99a00640 1 --2- 172.21.15.122:0/709593420 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5b74068bf0 0x7f5b7406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:40.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.702+0000 7f5b99a00640 1 --2- 172.21.15.122:0/709593420 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5b74068bf0 0x7f5b7406b0b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5b8800b9d0 tx=0x7f5b88008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:40.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.702+0000 7f5b91600640 1 -- 172.21.15.122:0/709593420 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5b8c00ae20 con 0x7f5b9415c860 2024-05-28T06:12:40.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.862+0000 7f5b9ae00640 1 -- 172.21.15.122:0/709593420 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}] v 0) -- 0x7f5b940b83e0 con 0x7f5b9415c860 2024-05-28T06:12:40.865 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.866+0000 7f5b91600640 1 -- 172.21.15.122:0/709593420 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}]=0 v15)=0 v15) ==== 136+0+0 (secure 0 0 0) 0x7f5b8c056770 con 0x7f5b9415c860 2024-05-28T06:12:40.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.866+0000 7f5b9ae00640 1 -- 172.21.15.122:0/709593420 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5b74068bf0 msgr2=0x7f5b7406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:40.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.866+0000 7f5b9ae00640 1 --2- 172.21.15.122:0/709593420 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5b74068bf0 0x7f5b7406b0b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5b8800b9d0 tx=0x7f5b88008040 comp rx=0 tx=0).stop 2024-05-28T06:12:40.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.866+0000 7f5b9ae00640 1 -- 172.21.15.122:0/709593420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b9415c860 msgr2=0x7f5b9415cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:40.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.866+0000 7f5b9ae00640 1 --2- 172.21.15.122:0/709593420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b9415c860 0x7f5b9415cea0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00ca80 tx=0x7f5b8c00cf40 comp rx=0 tx=0).stop 2024-05-28T06:12:40.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.870+0000 7f5b9ae00640 1 -- 172.21.15.122:0/709593420 shutdown_connections 2024-05-28T06:12:40.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.870+0000 7f5b9ae00640 1 --2- 172.21.15.122:0/709593420 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f5b74068bf0 0x7f5b7406b0b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.870+0000 7f5b9ae00640 1 --2- 172.21.15.122:0/709593420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b9415c860 0x7f5b9415cea0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.870+0000 7f5b9ae00640 1 --2- 172.21.15.122:0/709593420 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5b9409bbd0 0x7f5b94152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.870+0000 7f5b9ae00640 1 --2- 172.21.15.122:0/709593420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b9409af80 0x7f5b94150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:40.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.870+0000 7f5b9ae00640 1 -- 172.21.15.122:0/709593420 >> 172.21.15.122:0/709593420 conn(0x7f5b940d2460 msgr2=0x7f5b94156010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:40.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.870+0000 7f5b9ae00640 1 -- 172.21.15.122:0/709593420 shutdown_connections 2024-05-28T06:12:40.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:40.870+0000 7f5b9ae00640 1 -- 172.21.15.122:0/709593420 wait complete. 2024-05-28T06:12:40.883 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:40.882+0000 7f9deb000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:40.884 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:40.882+0000 7f9deb000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:40.884 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:40.882+0000 7f9deb000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:40.884 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:40.882+0000 7f9deb000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:40.884 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:40.882+0000 7f9deb000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:40.890 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-28T06:12:41.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.030+0000 7f0632a00640 1 Processor -- start 2024-05-28T06:12:41.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.030+0000 7f0632a00640 1 -- start start 2024-05-28T06:12:41.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.030+0000 7f0632a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f062c0b58d0 0x7f062c0b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:41.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.030+0000 7f0632a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f062c0ce4f0 0x7f062c0ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:41.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.030+0000 7f0632a00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f062c0b61f0 con 0x7f062c0722a0 2024-05-28T06:12:41.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.030+0000 7f0632a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f062c15d970 con 0x7f062c0ce4f0 2024-05-28T06:12:41.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.030+0000 7f0632a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f062c15dc50 con 0x7f062c0b58d0 2024-05-28T06:12:41.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f0630a00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f062c0722a0 0x7f062c072730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:59794/0 (socket says 172.21.15.122:59794) 2024-05-28T06:12:41.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f0630a00640 1 -- 172.21.15.122:0/3965700747 learned_addr learned my addr 172.21.15.122:0/3965700747 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:41.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f062b400640 1 -- 172.21.15.122:0/3965700747 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3530028610 0 0) 0x7f062c0b61f0 con 0x7f062c0722a0 2024-05-28T06:12:41.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f062be00640 1 --2- 172.21.15.122:0/3965700747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f062c0b58d0 0x7f062c0b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:41.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f062b400640 1 -- 172.21.15.122:0/3965700747 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0610003530 con 0x7f062c0722a0 2024-05-28T06:12:41.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f0623400640 1 --2- 172.21.15.122:0/3965700747 >> v2:172.21.15.153:3300/0 conn(0x7f062c0ce4f0 0x7f062c0ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:41.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f062b400640 1 -- 172.21.15.122:0/3965700747 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1759160233 0 0) 0x7f0610003530 con 0x7f062c0722a0 2024-05-28T06:12:41.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f062b400640 1 -- 172.21.15.122:0/3965700747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f062c0b58d0 msgr2=0x7f062c0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:41.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f062b400640 1 --2- 172.21.15.122:0/3965700747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f062c0b58d0 0x7f062c0b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:41.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f062b400640 1 -- 172.21.15.122:0/3965700747 >> v2:172.21.15.153:3300/0 conn(0x7f062c0ce4f0 msgr2=0x7f062c0ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:41.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f062b400640 1 --2- 172.21.15.122:0/3965700747 >> v2:172.21.15.153:3300/0 conn(0x7f062c0ce4f0 0x7f062c0ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:41.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f062b400640 1 -- 172.21.15.122:0/3965700747 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f062c15df30 con 0x7f062c0722a0 2024-05-28T06:12:41.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f062b400640 1 -- 172.21.15.122:0/3965700747 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f0624001a00 con 0x7f062c0722a0 2024-05-28T06:12:41.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f062b400640 1 -- 172.21.15.122:0/3965700747 >> v1:172.21.15.122:6789/0 conn(0x7f062c0722a0 legacy=0x7f062c072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:41.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f062b400640 1 --2- 172.21.15.122:0/3965700747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06100039c0 0x7f0610003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:41.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f062b400640 1 --2- 172.21.15.122:0/3965700747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0610004810 0x7f0610004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:41.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f062b400640 1 --2- 172.21.15.122:0/3965700747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f062c0b58d0 0x7f06100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:41.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f062b400640 1 -- 172.21.15.122:0/3965700747 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f062c15d970 con 0x7f0610004810 2024-05-28T06:12:41.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f062b400640 1 -- 172.21.15.122:0/3965700747 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f062c15dc50 con 0x7f06100039c0 2024-05-28T06:12:41.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f062b400640 1 -- 172.21.15.122:0/3965700747 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f061000b9d0 con 0x7f062c0b58d0 2024-05-28T06:12:41.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f0623400640 1 --2- 172.21.15.122:0/3965700747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0610004810 0x7f0610004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:41.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f062be00640 1 --2- 172.21.15.122:0/3965700747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06100039c0 0x7f0610003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:41.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f0630a00640 1 --2- 172.21.15.122:0/3965700747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f062c0b58d0 0x7f06100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:41.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f0623400640 1 -- 172.21.15.122:0/3965700747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f062c0b58d0 msgr2=0x7f06100051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:41.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f0623400640 1 --2- 172.21.15.122:0/3965700747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f062c0b58d0 0x7f06100051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:41.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f0623400640 1 -- 172.21.15.122:0/3965700747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06100039c0 msgr2=0x7f0610003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:41.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f0623400640 1 --2- 172.21.15.122:0/3965700747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06100039c0 0x7f0610003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:41.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f0623400640 1 -- 172.21.15.122:0/3965700747 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0610003530 con 0x7f0610004810 2024-05-28T06:12:41.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.034+0000 7f0630a00640 1 --2- 172.21.15.122:0/3965700747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f062c0b58d0 0x7f06100051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:12:41.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.038+0000 7f0623400640 1 --2- 172.21.15.122:0/3965700747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0610004810 0x7f0610004c90 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f0614009ae0 tx=0x7f061401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e74f63f67d376d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:41.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.038+0000 7f062b400640 1 -- 172.21.15.122:0/3965700747 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06140096b0 con 0x7f0610004810 2024-05-28T06:12:41.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.038+0000 7f062b400640 1 -- 172.21.15.122:0/3965700747 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06140a64d0 con 0x7f0610004810 2024-05-28T06:12:41.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.038+0000 7f062b400640 1 -- 172.21.15.122:0/3965700747 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06140a68c0 con 0x7f0610004810 2024-05-28T06:12:41.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.038+0000 7f0632a00640 1 -- 172.21.15.122:0/3965700747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0610004810 msgr2=0x7f0610004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:41.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.038+0000 7f0632a00640 1 --2- 172.21.15.122:0/3965700747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0610004810 0x7f0610004c90 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f0614009ae0 tx=0x7f061401cab0 comp rx=0 tx=0).stop 2024-05-28T06:12:41.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.038+0000 7f0630a00640 1 -- 172.21.15.122:0/3965700747 reap_dead start 2024-05-28T06:12:41.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.038+0000 7f0632a00640 1 -- 172.21.15.122:0/3965700747 shutdown_connections 2024-05-28T06:12:41.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.038+0000 7f0632a00640 1 -- 172.21.15.122:0/3965700747 >> 172.21.15.122:0/3965700747 conn(0x7f062c06bd90 msgr2=0x7f062c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:41.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.038+0000 7f0632a00640 1 -- 172.21.15.122:0/3965700747 shutdown_connections 2024-05-28T06:12:41.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.038+0000 7f0632a00640 1 -- 172.21.15.122:0/3965700747 wait complete. 2024-05-28T06:12:41.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.038+0000 7f0632a00640 1 Processor -- start 2024-05-28T06:12:41.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.038+0000 7f0632a00640 1 -- start start 2024-05-28T06:12:41.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.042+0000 7f0632a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0610004810 0x7f062c0b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:41.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.042+0000 7f0632a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f062c1e4ea0 0x7f062c130370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:41.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.042+0000 7f0632a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f062c1308b0 0x7f062c141d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:41.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.042+0000 7f0632a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f062c146260 con 0x7f062c1308b0 2024-05-28T06:12:41.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.042+0000 7f0632a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f062c15d640 con 0x7f062c1e4ea0 2024-05-28T06:12:41.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.042+0000 7f0632a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f062c0b2660 con 0x7f0610004810 2024-05-28T06:12:41.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.042+0000 7f0630a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f062c1308b0 0x7f062c141d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:41.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.042+0000 7f0630a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f062c1308b0 0x7f062c141d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38146/0 (socket says 172.21.15.122:38146) 2024-05-28T06:12:41.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.042+0000 7f0630a00640 1 -- 172.21.15.122:0/857281885 learned_addr learned my addr 172.21.15.122:0/857281885 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:41.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.042+0000 7f0630a00640 1 -- 172.21.15.122:0/857281885 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0610004810 msgr2=0x7f062c0b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:41.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.042+0000 7f0630a00640 1 --2- 172.21.15.122:0/857281885 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0610004810 0x7f062c0b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:41.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.042+0000 7f0630a00640 1 -- 172.21.15.122:0/857281885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f062c1e4ea0 msgr2=0x7f062c130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:41.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.042+0000 7f0630a00640 1 --2- 172.21.15.122:0/857281885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f062c1e4ea0 0x7f062c130370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:41.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.042+0000 7f0630a00640 1 -- 172.21.15.122:0/857281885 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f062c12de20 con 0x7f062c1308b0 2024-05-28T06:12:41.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.042+0000 7f0630a00640 1 --2- 172.21.15.122:0/857281885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f062c1308b0 0x7f062c141d20 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f0624000f90 tx=0x7f0624010cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:41.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.042+0000 7f0628c00640 1 -- 172.21.15.122:0/857281885 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062401a070 con 0x7f062c1308b0 2024-05-28T06:12:41.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.042+0000 7f0628c00640 1 -- 172.21.15.122:0/857281885 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0624011040 con 0x7f062c1308b0 2024-05-28T06:12:41.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.042+0000 7f0632a00640 1 -- 172.21.15.122:0/857281885 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f062c12e100 con 0x7f062c1308b0 2024-05-28T06:12:41.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.042+0000 7f0628c00640 1 -- 172.21.15.122:0/857281885 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062400ed20 con 0x7f062c1308b0 2024-05-28T06:12:41.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.042+0000 7f0632a00640 1 -- 172.21.15.122:0/857281885 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f062c12e6c0 con 0x7f062c1308b0 2024-05-28T06:12:41.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.042+0000 7f0632a00640 1 -- 172.21.15.122:0/857281885 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f062c068c40 con 0x7f062c1308b0 2024-05-28T06:12:41.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.042+0000 7f0628c00640 1 -- 172.21.15.122:0/857281885 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f062401d070 con 0x7f062c1308b0 2024-05-28T06:12:41.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.046+0000 7f0628c00640 1 --2- 172.21.15.122:0/857281885 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0608068c20 0x7f060806b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:41.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.046+0000 7f0628c00640 1 -- 172.21.15.122:0/857281885 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f062408a300 con 0x7f062c1308b0 2024-05-28T06:12:41.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.046+0000 7f062be00640 1 --2- 172.21.15.122:0/857281885 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0608068c20 0x7f060806b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:41.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.046+0000 7f062be00640 1 --2- 172.21.15.122:0/857281885 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0608068c20 0x7f060806b0e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f061c006d50 tx=0x7f061c006c40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:41.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.050+0000 7f0628c00640 1 -- 172.21.15.122:0/857281885 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0624059980 con 0x7f062c1308b0 2024-05-28T06:12:41.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.230+0000 7f0632a00640 1 -- 172.21.15.122:0/857281885 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f062c076020 con 0x7f0608068c20 2024-05-28T06:12:41.236 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:41.238+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:41.236 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:41.238+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:41.236 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:41.238+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:41.237 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:41.238+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:41.237 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:12:41.238+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:12:41.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.270+0000 7f0628c00640 1 -- 172.21.15.122:0/857281885 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f061c011810 con 0x7f0608068c20 2024-05-28T06:12:41.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.270+0000 7f0632a00640 1 -- 172.21.15.122:0/857281885 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0608068c20 msgr2=0x7f060806b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:41.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.270+0000 7f0632a00640 1 --2- 172.21.15.122:0/857281885 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0608068c20 0x7f060806b0e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f061c006d50 tx=0x7f061c006c40 comp rx=0 tx=0).stop 2024-05-28T06:12:41.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.270+0000 7f0632a00640 1 -- 172.21.15.122:0/857281885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f062c1308b0 msgr2=0x7f062c141d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:41.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.270+0000 7f0632a00640 1 --2- 172.21.15.122:0/857281885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f062c1308b0 0x7f062c141d20 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f0624000f90 tx=0x7f0624010cc0 comp rx=0 tx=0).stop 2024-05-28T06:12:41.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.274+0000 7f0632a00640 1 -- 172.21.15.122:0/857281885 shutdown_connections 2024-05-28T06:12:41.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.274+0000 7f0632a00640 1 --2- 172.21.15.122:0/857281885 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0608068c20 0x7f060806b0e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:41.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.274+0000 7f0632a00640 1 --2- 172.21.15.122:0/857281885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f062c1308b0 0x7f062c141d20 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:41.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.274+0000 7f0632a00640 1 --2- 172.21.15.122:0/857281885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f062c1e4ea0 0x7f062c130370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:41.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.274+0000 7f0632a00640 1 --2- 172.21.15.122:0/857281885 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0610004810 0x7f062c0b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:41.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.274+0000 7f0632a00640 1 -- 172.21.15.122:0/857281885 >> 172.21.15.122:0/857281885 conn(0x7f062c06bd90 msgr2=0x7f062c072730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:41.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.274+0000 7f0632a00640 1 -- 172.21.15.122:0/857281885 shutdown_connections 2024-05-28T06:12:41.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.274+0000 7f0632a00640 1 -- 172.21.15.122:0/857281885 wait complete. 2024-05-28T06:12:41.291 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-28T06:12:41.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.430+0000 7f3154a00640 1 Processor -- start 2024-05-28T06:12:41.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.430+0000 7f3154a00640 1 -- start start 2024-05-28T06:12:41.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f3154a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f315015c930 0x7f31500cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:41.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f3154a00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31500ce360 con 0x7f3150072a00 2024-05-28T06:12:41.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f3154a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31500d0070 con 0x7f3150073030 2024-05-28T06:12:41.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f3154a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f31500cfe40 con 0x7f315015c930 2024-05-28T06:12:41.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314e800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f3150072a00 0x7f315006ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:59800/0 (socket says 172.21.15.122:59800) 2024-05-28T06:12:41.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314e800640 1 -- 172.21.15.122:0/3872011021 learned_addr learned my addr 172.21.15.122:0/3872011021 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:12:41.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314ca00640 1 -- 172.21.15.122:0/3872011021 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3081605175 0 0) 0x7f31500ce360 con 0x7f3150072a00 2024-05-28T06:12:41.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314ca00640 1 -- 172.21.15.122:0/3872011021 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3134003530 con 0x7f3150072a00 2024-05-28T06:12:41.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314de00640 1 --2- 172.21.15.122:0/3872011021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f315015c930 0x7f31500cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:41.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314ca00640 1 -- 172.21.15.122:0/3872011021 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 977633993 0 0) 0x7f3134003530 con 0x7f3150072a00 2024-05-28T06:12:41.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314ca00640 1 -- 172.21.15.122:0/3872011021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f315015c930 msgr2=0x7f31500cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:41.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314ca00640 1 --2- 172.21.15.122:0/3872011021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f315015c930 0x7f31500cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:41.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314ca00640 1 -- 172.21.15.122:0/3872011021 >> v1:172.21.15.153:6789/0 conn(0x7f3150073030 legacy=0x7f31500722f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:41.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314ca00640 1 -- 172.21.15.122:0/3872011021 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31500d0350 con 0x7f3150072a00 2024-05-28T06:12:41.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314ca00640 1 -- 172.21.15.122:0/3872011021 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f3148001680 con 0x7f3150072a00 2024-05-28T06:12:41.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314de00640 1 --2- 172.21.15.122:0/3872011021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f315015c930 0x7f31500cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:12:41.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314ca00640 1 -- 172.21.15.122:0/3872011021 >> v1:172.21.15.122:6789/0 conn(0x7f3150072a00 legacy=0x7f315006ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:41.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314ca00640 1 --2- 172.21.15.122:0/3872011021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f315015c930 0x7f31340039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:41.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314ca00640 1 --2- 172.21.15.122:0/3872011021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3134003fe0 0x7f3134004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:41.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314ca00640 1 --2- 172.21.15.122:0/3872011021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3134004d50 0x7f31340051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:41.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314ca00640 1 -- 172.21.15.122:0/3872011021 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f313400bb60 con 0x7f3134004d50 2024-05-28T06:12:41.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314ca00640 1 -- 172.21.15.122:0/3872011021 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f313400bd10 con 0x7f3134003fe0 2024-05-28T06:12:41.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314ca00640 1 -- 172.21.15.122:0/3872011021 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f313400bf10 con 0x7f315015c930 2024-05-28T06:12:41.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314e800640 1 --2- 172.21.15.122:0/3872011021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3134004d50 0x7f31340051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:41.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314de00640 1 --2- 172.21.15.122:0/3872011021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f315015c930 0x7f31340039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:41.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314d400640 1 --2- 172.21.15.122:0/3872011021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3134003fe0 0x7f3134004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:41.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314e800640 1 -- 172.21.15.122:0/3872011021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f315015c930 msgr2=0x7f31340039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:41.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314e800640 1 --2- 172.21.15.122:0/3872011021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f315015c930 0x7f31340039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:41.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314e800640 1 -- 172.21.15.122:0/3872011021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3134003fe0 msgr2=0x7f3134004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:12:41.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314e800640 1 --2- 172.21.15.122:0/3872011021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3134003fe0 0x7f3134004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:41.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314e800640 1 -- 172.21.15.122:0/3872011021 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3134003530 con 0x7f3134004d50 2024-05-28T06:12:41.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.434+0000 7f314d400640 1 --2- 172.21.15.122:0/3872011021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3134003fe0 0x7f3134004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:12:41.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.438+0000 7f314e800640 1 --2- 172.21.15.122:0/3872011021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3134004d50 0x7f31340051d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3148005130 tx=0x7f314801fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db9655ad6773a39 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:41.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.438+0000 7f314ca00640 1 -- 172.21.15.122:0/3872011021 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3148004d30 con 0x7f3134004d50 2024-05-28T06:12:41.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.438+0000 7f314ca00640 1 -- 172.21.15.122:0/3872011021 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3148005ae0 con 0x7f3134004d50 2024-05-28T06:12:41.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.438+0000 7f314ca00640 1 -- 172.21.15.122:0/3872011021 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3148008110 con 0x7f3134004d50 2024-05-28T06:12:41.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.438+0000 7f3154a00640 1 -- 172.21.15.122:0/3872011021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3134004d50 msgr2=0x7f31340051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:41.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.438+0000 7f3154a00640 1 --2- 172.21.15.122:0/3872011021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3134004d50 0x7f31340051d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3148005130 tx=0x7f314801fab0 comp rx=0 tx=0).stop 2024-05-28T06:12:41.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.438+0000 7f314e800640 1 -- 172.21.15.122:0/3872011021 reap_dead start 2024-05-28T06:12:41.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.438+0000 7f3154a00640 1 -- 172.21.15.122:0/3872011021 shutdown_connections 2024-05-28T06:12:41.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.438+0000 7f3154a00640 1 -- 172.21.15.122:0/3872011021 >> 172.21.15.122:0/3872011021 conn(0x7f31500b26b0 msgr2=0x7f31500b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:41.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.438+0000 7f3154a00640 1 -- 172.21.15.122:0/3872011021 shutdown_connections 2024-05-28T06:12:41.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.438+0000 7f3154a00640 1 -- 172.21.15.122:0/3872011021 wait complete. 2024-05-28T06:12:41.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.438+0000 7f3154a00640 1 Processor -- start 2024-05-28T06:12:41.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.438+0000 7f3154a00640 1 -- start start 2024-05-28T06:12:41.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f3154a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3134004d50 0x7f3150151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:41.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f3154a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f315014ed70 0x7f315014f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:41.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f3154a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f315014c4a0 0x7f315014c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:41.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f3154a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f315006e6d0 con 0x7f315014ed70 2024-05-28T06:12:41.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f3154a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f315006e3f0 con 0x7f3134004d50 2024-05-28T06:12:41.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f3154a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f31500cf900 con 0x7f315014c4a0 2024-05-28T06:12:41.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f314d400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f315014ed70 0x7f315014f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:41.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f314d400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f315014ed70 0x7f315014f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38184/0 (socket says 172.21.15.122:38184) 2024-05-28T06:12:41.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f314d400640 1 -- 172.21.15.122:0/1856715847 learned_addr learned my addr 172.21.15.122:0/1856715847 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:12:41.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f314e800640 1 --2- 172.21.15.122:0/1856715847 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f315014c4a0 0x7f315014c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:41.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f314de00640 1 --2- 172.21.15.122:0/1856715847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3134004d50 0x7f3150151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:41.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f314d400640 1 -- 172.21.15.122:0/1856715847 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f315014c4a0 msgr2=0x7f315014c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:41.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f314d400640 1 --2- 172.21.15.122:0/1856715847 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f315014c4a0 0x7f315014c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:41.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f314d400640 1 -- 172.21.15.122:0/1856715847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3134004d50 msgr2=0x7f3150151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:41.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f314d400640 1 --2- 172.21.15.122:0/1856715847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3134004d50 0x7f3150151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:41.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f314d400640 1 -- 172.21.15.122:0/1856715847 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315014b400 con 0x7f315014ed70 2024-05-28T06:12:41.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f314e800640 1 --2- 172.21.15.122:0/1856715847 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f315014c4a0 0x7f315014c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:12:41.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f314d400640 1 --2- 172.21.15.122:0/1856715847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f315014ed70 0x7f315014f1d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f313800e4b0 tx=0x7f313800e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:41.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f3146000640 1 -- 172.21.15.122:0/1856715847 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31380053a0 con 0x7f315014ed70 2024-05-28T06:12:41.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f3146000640 1 -- 172.21.15.122:0/1856715847 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3138018070 con 0x7f315014ed70 2024-05-28T06:12:41.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f3146000640 1 -- 172.21.15.122:0/1856715847 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3138003820 con 0x7f315014ed70 2024-05-28T06:12:41.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f3154a00640 1 -- 172.21.15.122:0/1856715847 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315014b6e0 con 0x7f315014ed70 2024-05-28T06:12:41.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f3154a00640 1 -- 172.21.15.122:0/1856715847 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f315014bca0 con 0x7f315014ed70 2024-05-28T06:12:41.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f3154a00640 1 -- 172.21.15.122:0/1856715847 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3150068c40 con 0x7f315014ed70 2024-05-28T06:12:41.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.442+0000 7f3146000640 1 -- 172.21.15.122:0/1856715847 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f31380039c0 con 0x7f315014ed70 2024-05-28T06:12:41.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.446+0000 7f3146000640 1 --2- 172.21.15.122:0/1856715847 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f312c068bf0 0x7f312c06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:12:41.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.446+0000 7f3146000640 1 -- 172.21.15.122:0/1856715847 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f31380876a0 con 0x7f315014ed70 2024-05-28T06:12:41.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.446+0000 7f314de00640 1 --2- 172.21.15.122:0/1856715847 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f312c068bf0 0x7f312c06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:12:41.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.446+0000 7f314de00640 1 --2- 172.21.15.122:0/1856715847 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f312c068bf0 0x7f312c06b0b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f31400095c0 tx=0x7f3140009800 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:12:41.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.450+0000 7f3146000640 1 -- 172.21.15.122:0/1856715847 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3138056e20 con 0x7f315014ed70 2024-05-28T06:12:41.631 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.630+0000 7f3154a00640 1 -- 172.21.15.122:0/1856715847 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f3150076020 con 0x7f312c068bf0 2024-05-28T06:12:41.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.638+0000 7f3146000640 1 -- 172.21.15.122:0/1856715847 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f31400047c0 con 0x7f312c068bf0 2024-05-28T06:12:41.636 INFO:teuthology.orchestra.run.smithi122.stdout:/volumes/_nogroup/sv1/cebb1c22-3d4a-4984-898e-c5827a498bd3 2024-05-28T06:12:41.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.638+0000 7f3154a00640 1 -- 172.21.15.122:0/1856715847 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f312c068bf0 msgr2=0x7f312c06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:41.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.638+0000 7f3154a00640 1 --2- 172.21.15.122:0/1856715847 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f312c068bf0 0x7f312c06b0b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f31400095c0 tx=0x7f3140009800 comp rx=0 tx=0).stop 2024-05-28T06:12:41.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.638+0000 7f3154a00640 1 -- 172.21.15.122:0/1856715847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f315014ed70 msgr2=0x7f315014f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:12:41.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.638+0000 7f3154a00640 1 --2- 172.21.15.122:0/1856715847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f315014ed70 0x7f315014f1d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f313800e4b0 tx=0x7f313800e970 comp rx=0 tx=0).stop 2024-05-28T06:12:41.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.638+0000 7f3154a00640 1 -- 172.21.15.122:0/1856715847 shutdown_connections 2024-05-28T06:12:41.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.638+0000 7f3154a00640 1 --2- 172.21.15.122:0/1856715847 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f312c068bf0 0x7f312c06b0b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:41.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.638+0000 7f3154a00640 1 --2- 172.21.15.122:0/1856715847 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f315014c4a0 0x7f315014c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:41.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.638+0000 7f3154a00640 1 --2- 172.21.15.122:0/1856715847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f315014ed70 0x7f315014f1d0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:41.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.638+0000 7f3154a00640 1 --2- 172.21.15.122:0/1856715847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3134004d50 0x7f3150151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:12:41.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.638+0000 7f3154a00640 1 -- 172.21.15.122:0/1856715847 >> 172.21.15.122:0/1856715847 conn(0x7f31500b26b0 msgr2=0x7f315014e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:12:41.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.638+0000 7f3154a00640 1 -- 172.21.15.122:0/1856715847 shutdown_connections 2024-05-28T06:12:41.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:12:41.638+0000 7f3154a00640 1 -- 172.21.15.122:0/1856715847 wait complete. 2024-05-28T06:12:41.658 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 3 files each 1024MB size under directory volumes/_nogroup/sv1/cebb1c22-3d4a-4984-898e-c5827a498bd3 2024-05-28T06:12:41.658 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:12:41.658 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:12:41.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:12:41.667 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/cebb1c22-3d4a-4984-898e-c5827a498bd3/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-28T06:12:48.331 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:12:48.339 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:12:50.070 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records in 2024-05-28T06:12:50.070 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records out 2024-05-28T06:12:50.071 INFO:teuthology.orchestra.run.smithi122.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.34247 s, 129 MB/s 2024-05-28T06:12:50.072 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:12:50.072 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:12:50.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:12:50.081 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/cebb1c22-3d4a-4984-898e-c5827a498bd3/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-28T06:12:59.333 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records in 2024-05-28T06:12:59.333 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records out 2024-05-28T06:12:59.333 INFO:teuthology.orchestra.run.smithi122.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 9.20046 s, 117 MB/s 2024-05-28T06:12:59.334 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:12:59.335 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:12:59.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:12:59.344 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/cebb1c22-3d4a-4984-898e-c5827a498bd3/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-28T06:13:08.697 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records in 2024-05-28T06:13:08.697 INFO:teuthology.orchestra.run.smithi122.stderr:1024+0 records out 2024-05-28T06:13:08.697 INFO:teuthology.orchestra.run.smithi122.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 9.30077 s, 115 MB/s 2024-05-28T06:13:08.699 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-28T06:13:08.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.842+0000 7f1563600640 1 Processor -- start 2024-05-28T06:13:08.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.842+0000 7f1563600640 1 -- start start 2024-05-28T06:13:08.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.842+0000 7f1563600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f155c0b58d0 0x7f155c0b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:08.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.842+0000 7f1563600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f155c0ce4f0 0x7f155c0ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:08.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.842+0000 7f1563600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f155c0b61f0 con 0x7f155c0722a0 2024-05-28T06:13:08.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.842+0000 7f1563600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f155c15d970 con 0x7f155c0b58d0 2024-05-28T06:13:08.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.842+0000 7f1563600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f155c15dc50 con 0x7f155c0ce4f0 2024-05-28T06:13:08.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.842+0000 7f1560c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f155c0b58d0 0x7f155c0b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:08.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.842+0000 7f1560c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f155c0b58d0 0x7f155c0b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45160/0 (socket says 172.21.15.122:45160) 2024-05-28T06:13:08.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.842+0000 7f1560c00640 1 -- 172.21.15.122:0/352105216 learned_addr learned my addr 172.21.15.122:0/352105216 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:08.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.842+0000 7f1553e00640 1 --2- 172.21.15.122:0/352105216 >> v2:172.21.15.153:3300/0 conn(0x7f155c0ce4f0 0x7f155c0ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:08.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.842+0000 7f1560c00640 1 -- 172.21.15.122:0/352105216 >> v2:172.21.15.153:3300/0 conn(0x7f155c0ce4f0 msgr2=0x7f155c0ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:08.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.842+0000 7f1560c00640 1 --2- 172.21.15.122:0/352105216 >> v2:172.21.15.153:3300/0 conn(0x7f155c0ce4f0 0x7f155c0ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:08.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.842+0000 7f1560c00640 1 -- 172.21.15.122:0/352105216 >> v1:172.21.15.153:6789/0 conn(0x7f155c0722a0 legacy=0x7f155c0726f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:08.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.842+0000 7f1560c00640 1 -- 172.21.15.122:0/352105216 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f155c15df30 con 0x7f155c0b58d0 2024-05-28T06:13:08.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.846+0000 7f1560c00640 1 --2- 172.21.15.122:0/352105216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f155c0b58d0 0x7f155c0b5cb0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f155c0d0470 tx=0x7f154c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd570c88c6cfb9a server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:08.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.846+0000 7f155be00640 1 -- 172.21.15.122:0/352105216 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c0aa5f0 con 0x7f155c0b58d0 2024-05-28T06:13:08.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.846+0000 7f155be00640 1 -- 172.21.15.122:0/352105216 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f154c0af070 con 0x7f155c0b58d0 2024-05-28T06:13:08.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.846+0000 7f155be00640 1 -- 172.21.15.122:0/352105216 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c0aa9b0 con 0x7f155c0b58d0 2024-05-28T06:13:08.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.846+0000 7f1563600640 1 -- 172.21.15.122:0/352105216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f155c0b58d0 msgr2=0x7f155c0b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:08.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.846+0000 7f1563600640 1 --2- 172.21.15.122:0/352105216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f155c0b58d0 0x7f155c0b5cb0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f155c0d0470 tx=0x7f154c01c4f0 comp rx=0 tx=0).stop 2024-05-28T06:13:08.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.846+0000 7f1563600640 1 -- 172.21.15.122:0/352105216 shutdown_connections 2024-05-28T06:13:08.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.846+0000 7f1563600640 1 --2- 172.21.15.122:0/352105216 >> v2:172.21.15.153:3300/0 conn(0x7f155c0ce4f0 0x7f155c0ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:08.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.846+0000 7f1563600640 1 --2- 172.21.15.122:0/352105216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f155c0b58d0 0x7f155c0b5cb0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:08.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.846+0000 7f1563600640 1 -- 172.21.15.122:0/352105216 >> 172.21.15.122:0/352105216 conn(0x7f155c06bd90 msgr2=0x7f155c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:08.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.846+0000 7f1563600640 1 -- 172.21.15.122:0/352105216 shutdown_connections 2024-05-28T06:13:08.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.846+0000 7f1563600640 1 -- 172.21.15.122:0/352105216 wait complete. 2024-05-28T06:13:08.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1563600640 1 Processor -- start 2024-05-28T06:13:08.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1563600640 1 -- start start 2024-05-28T06:13:08.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1563600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f155c0722a0 0x7f155c15c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:08.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1563600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f155c0b58d0 0x7f155c13aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:08.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1563600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f155c0ce4f0 0x7f155c0b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:08.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1563600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f155c146260 con 0x7f155c0b58d0 2024-05-28T06:13:08.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1563600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f155c169a60 con 0x7f155c0722a0 2024-05-28T06:13:08.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1563600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f155c0ae900 con 0x7f155c0ce4f0 2024-05-28T06:13:08.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1553e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f155c0b58d0 0x7f155c13aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:08.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1553e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f155c0b58d0 0x7f155c13aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45170/0 (socket says 172.21.15.122:45170) 2024-05-28T06:13:08.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1553e00640 1 -- 172.21.15.122:0/1441006902 learned_addr learned my addr 172.21.15.122:0/1441006902 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:08.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1560c00640 1 --2- 172.21.15.122:0/1441006902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f155c0722a0 0x7f155c15c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:08.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1561600640 1 --2- 172.21.15.122:0/1441006902 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f155c0ce4f0 0x7f155c0b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:08.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1553e00640 1 -- 172.21.15.122:0/1441006902 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f155c0ce4f0 msgr2=0x7f155c0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:08.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1553e00640 1 --2- 172.21.15.122:0/1441006902 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f155c0ce4f0 0x7f155c0b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:08.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1553e00640 1 -- 172.21.15.122:0/1441006902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f155c0722a0 msgr2=0x7f155c15c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:08.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1553e00640 1 --2- 172.21.15.122:0/1441006902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f155c0722a0 0x7f155c15c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:08.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1553e00640 1 -- 172.21.15.122:0/1441006902 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f155c0adcf0 con 0x7f155c0b58d0 2024-05-28T06:13:08.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1561600640 1 --2- 172.21.15.122:0/1441006902 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f155c0ce4f0 0x7f155c0b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:13:08.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1553e00640 1 --2- 172.21.15.122:0/1441006902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f155c0b58d0 0x7f155c13aa70 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f154400e870 tx=0x7f154400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:08.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1559600640 1 -- 172.21.15.122:0/1441006902 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1544017070 con 0x7f155c0b58d0 2024-05-28T06:13:08.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1559600640 1 -- 172.21.15.122:0/1441006902 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f154400c940 con 0x7f155c0b58d0 2024-05-28T06:13:08.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1559600640 1 -- 172.21.15.122:0/1441006902 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154400ccf0 con 0x7f155c0b58d0 2024-05-28T06:13:08.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1563600640 1 -- 172.21.15.122:0/1441006902 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f155c0adfd0 con 0x7f155c0b58d0 2024-05-28T06:13:08.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1563600640 1 -- 172.21.15.122:0/1441006902 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f155c0ae590 con 0x7f155c0b58d0 2024-05-28T06:13:08.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.850+0000 7f1563600640 1 -- 172.21.15.122:0/1441006902 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f155c068c40 con 0x7f155c0b58d0 2024-05-28T06:13:08.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.854+0000 7f1559600640 1 -- 172.21.15.122:0/1441006902 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 19) ==== 88854+0+0 (secure 0 0 0) 0x7f154401a070 con 0x7f155c0b58d0 2024-05-28T06:13:08.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.854+0000 7f1559600640 1 --2- 172.21.15.122:0/1441006902 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1538068d10 0x7f153806b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:08.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.854+0000 7f1559600640 1 -- 172.21.15.122:0/1441006902 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f1544085280 con 0x7f155c0b58d0 2024-05-28T06:13:08.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.854+0000 7f1560c00640 1 --2- 172.21.15.122:0/1441006902 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1538068d10 0x7f153806b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:08.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.854+0000 7f1560c00640 1 --2- 172.21.15.122:0/1441006902 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1538068d10 0x7f153806b1d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f154c0ae000 tx=0x7f154c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:08.857 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:08.858+0000 7f1559600640 1 -- 172.21.15.122:0/1441006902 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1544056df0 con 0x7f155c0b58d0 2024-05-28T06:13:09.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.042+0000 7f1563600640 1 -- 172.21.15.122:0/1441006902 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f155c076020 con 0x7f1538068d10 2024-05-28T06:13:09.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.054+0000 7f1559600640 1 -- 172.21.15.122:0/1441006902 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f154c0af040 con 0x7f1538068d10 2024-05-28T06:13:09.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.058+0000 7f1563600640 1 -- 172.21.15.122:0/1441006902 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1538068d10 msgr2=0x7f153806b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:09.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.058+0000 7f1563600640 1 --2- 172.21.15.122:0/1441006902 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1538068d10 0x7f153806b1d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f154c0ae000 tx=0x7f154c0a7000 comp rx=0 tx=0).stop 2024-05-28T06:13:09.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.058+0000 7f1563600640 1 -- 172.21.15.122:0/1441006902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f155c0b58d0 msgr2=0x7f155c13aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:09.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.058+0000 7f1563600640 1 --2- 172.21.15.122:0/1441006902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f155c0b58d0 0x7f155c13aa70 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f154400e870 tx=0x7f154400ec70 comp rx=0 tx=0).stop 2024-05-28T06:13:09.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.058+0000 7f1563600640 1 -- 172.21.15.122:0/1441006902 shutdown_connections 2024-05-28T06:13:09.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.058+0000 7f1563600640 1 --2- 172.21.15.122:0/1441006902 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1538068d10 0x7f153806b1d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:09.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.058+0000 7f1563600640 1 --2- 172.21.15.122:0/1441006902 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f155c0ce4f0 0x7f155c0b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:09.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.058+0000 7f1563600640 1 --2- 172.21.15.122:0/1441006902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f155c0b58d0 0x7f155c13aa70 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:09.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.058+0000 7f1563600640 1 --2- 172.21.15.122:0/1441006902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f155c0722a0 0x7f155c15c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:09.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.058+0000 7f1563600640 1 -- 172.21.15.122:0/1441006902 >> 172.21.15.122:0/1441006902 conn(0x7f155c06bd90 msgr2=0x7f155c143820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:09.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.058+0000 7f1563600640 1 -- 172.21.15.122:0/1441006902 shutdown_connections 2024-05-28T06:13:09.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.058+0000 7f1563600640 1 -- 172.21.15.122:0/1441006902 wait complete. 2024-05-28T06:13:09.075 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-28T06:13:09.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.214+0000 7fa1d7800640 1 Processor -- start 2024-05-28T06:13:09.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.214+0000 7fa1d7800640 1 -- start start 2024-05-28T06:13:09.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.218+0000 7fa1d7800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa1d015f4c0 0x7fa1d006e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:09.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.218+0000 7fa1d7800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa1d015e8b0 0x7fa1d015ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:09.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.218+0000 7fa1d7800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1d0141420 con 0x7fa1d01588b0 2024-05-28T06:13:09.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.218+0000 7fa1d7800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa1d0158c90 con 0x7fa1d015e8b0 2024-05-28T06:13:09.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.218+0000 7fa1d7800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa1d0140e60 con 0x7fa1d015f4c0 2024-05-28T06:13:09.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.218+0000 7fa1d5800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa1d015e8b0 0x7fa1d015ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:09.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.218+0000 7fa1c7e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa1d015f4c0 0x7fa1d006e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:09.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.218+0000 7fa1d4e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa1d01588b0 0x7fa1d0140580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:60742/0 (socket says 172.21.15.122:60742) 2024-05-28T06:13:09.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.218+0000 7fa1d4e00640 1 -- 172.21.15.122:0/841407942 learned_addr learned my addr 172.21.15.122:0/841407942 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:13:09.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.218+0000 7fa1d5800640 1 -- 172.21.15.122:0/841407942 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa1d015f4c0 msgr2=0x7fa1d006e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:09.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.218+0000 7fa1d5800640 1 --2- 172.21.15.122:0/841407942 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa1d015f4c0 0x7fa1d006e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:09.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.218+0000 7fa1d5800640 1 -- 172.21.15.122:0/841407942 >> v1:172.21.15.153:6789/0 conn(0x7fa1d01588b0 legacy=0x7fa1d0140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:09.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.218+0000 7fa1d5800640 1 -- 172.21.15.122:0/841407942 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d0141140 con 0x7fa1d015e8b0 2024-05-28T06:13:09.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.222+0000 7fa1d5800640 1 --2- 172.21.15.122:0/841407942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1d015e8b0 0x7fa1d015ed40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009d90 tx=0x7fa1c801c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec0c30137823a466 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:09.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.222+0000 7fa1cfe00640 1 -- 172.21.15.122:0/841407942 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c80ac070 con 0x7fa1d015e8b0 2024-05-28T06:13:09.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.222+0000 7fa1cfe00640 1 -- 172.21.15.122:0/841407942 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c80a66a0 con 0x7fa1d015e8b0 2024-05-28T06:13:09.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.222+0000 7fa1cfe00640 1 -- 172.21.15.122:0/841407942 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c80a6a70 con 0x7fa1d015e8b0 2024-05-28T06:13:09.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.222+0000 7fa1d7800640 1 -- 172.21.15.122:0/841407942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1d015e8b0 msgr2=0x7fa1d015ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:09.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.222+0000 7fa1d7800640 1 --2- 172.21.15.122:0/841407942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1d015e8b0 0x7fa1d015ed40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009d90 tx=0x7fa1c801c800 comp rx=0 tx=0).stop 2024-05-28T06:13:09.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.222+0000 7fa1d7800640 1 -- 172.21.15.122:0/841407942 shutdown_connections 2024-05-28T06:13:09.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.222+0000 7fa1d7800640 1 --2- 172.21.15.122:0/841407942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1d015e8b0 0x7fa1d015ed40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:09.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.222+0000 7fa1d7800640 1 --2- 172.21.15.122:0/841407942 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa1d015f4c0 0x7fa1d006e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:09.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.222+0000 7fa1d7800640 1 -- 172.21.15.122:0/841407942 >> 172.21.15.122:0/841407942 conn(0x7fa1d006bd90 msgr2=0x7fa1d006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:09.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.222+0000 7fa1d7800640 1 -- 172.21.15.122:0/841407942 shutdown_connections 2024-05-28T06:13:09.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.222+0000 7fa1d7800640 1 -- 172.21.15.122:0/841407942 wait complete. 2024-05-28T06:13:09.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.222+0000 7fa1d7800640 1 Processor -- start 2024-05-28T06:13:09.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.222+0000 7fa1d7800640 1 -- start start 2024-05-28T06:13:09.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1d7800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1d01588b0 0x7fa1d0134860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:09.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1d7800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1d015e8b0 0x7fa1d0157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:09.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1d7800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa1d015f4c0 0x7fa1d00ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:09.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1d7800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d00cfa00 con 0x7fa1d015e8b0 2024-05-28T06:13:09.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1d7800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d00cf880 con 0x7fa1d01588b0 2024-05-28T06:13:09.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1d7800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa1d00cfb80 con 0x7fa1d015f4c0 2024-05-28T06:13:09.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1c7e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1d015e8b0 0x7fa1d0157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:09.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1c7e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1d015e8b0 0x7fa1d0157900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45184/0 (socket says 172.21.15.122:45184) 2024-05-28T06:13:09.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1c7e00640 1 -- 172.21.15.122:0/1767663750 learned_addr learned my addr 172.21.15.122:0/1767663750 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:09.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1d4e00640 1 --2- 172.21.15.122:0/1767663750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1d01588b0 0x7fa1d0134860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:09.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1d5800640 1 --2- 172.21.15.122:0/1767663750 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa1d015f4c0 0x7fa1d00ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:09.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1c7e00640 1 -- 172.21.15.122:0/1767663750 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa1d015f4c0 msgr2=0x7fa1d00ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:09.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1c7e00640 1 --2- 172.21.15.122:0/1767663750 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa1d015f4c0 0x7fa1d00ae270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:09.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1c7e00640 1 -- 172.21.15.122:0/1767663750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1d01588b0 msgr2=0x7fa1d0134860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:09.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1c7e00640 1 --2- 172.21.15.122:0/1767663750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1d01588b0 0x7fa1d0134860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:09.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1c7e00640 1 -- 172.21.15.122:0/1767663750 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d01389e0 con 0x7fa1d015e8b0 2024-05-28T06:13:09.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1d4e00640 1 --2- 172.21.15.122:0/1767663750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1d01588b0 0x7fa1d0134860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:13:09.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1c7e00640 1 --2- 172.21.15.122:0/1767663750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1d015e8b0 0x7fa1d0157900 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa1b800e8a0 tx=0x7fa1b800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:09.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1cd600640 1 -- 172.21.15.122:0/1767663750 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8017070 con 0x7fa1d015e8b0 2024-05-28T06:13:09.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1cd600640 1 -- 172.21.15.122:0/1767663750 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b800c940 con 0x7fa1d015e8b0 2024-05-28T06:13:09.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1d7800640 1 -- 172.21.15.122:0/1767663750 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d00b40d0 con 0x7fa1d015e8b0 2024-05-28T06:13:09.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1cd600640 1 -- 172.21.15.122:0/1767663750 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b800cd10 con 0x7fa1d015e8b0 2024-05-28T06:13:09.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1d7800640 1 -- 172.21.15.122:0/1767663750 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d00ae7b0 con 0x7fa1d015e8b0 2024-05-28T06:13:09.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1d7800640 1 -- 172.21.15.122:0/1767663750 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d0068c40 con 0x7fa1d015e8b0 2024-05-28T06:13:09.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.226+0000 7fa1cd600640 1 -- 172.21.15.122:0/1767663750 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 19) ==== 88854+0+0 (secure 0 0 0) 0x7fa1b801a070 con 0x7fa1d015e8b0 2024-05-28T06:13:09.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.230+0000 7fa1cd600640 1 --2- 172.21.15.122:0/1767663750 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa1ac068d40 0x7fa1ac06b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:09.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.230+0000 7fa1cd600640 1 -- 172.21.15.122:0/1767663750 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7fa1b8085320 con 0x7fa1d015e8b0 2024-05-28T06:13:09.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.230+0000 7fa1d4e00640 1 --2- 172.21.15.122:0/1767663750 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa1ac068d40 0x7fa1ac06b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:09.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.230+0000 7fa1d4e00640 1 --2- 172.21.15.122:0/1767663750 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa1ac068d40 0x7fa1ac06b200 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0000f70 tx=0x7fa1c0007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:09.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.234+0000 7fa1cd600640 1 -- 172.21.15.122:0/1767663750 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa1b80574e0 con 0x7fa1d015e8b0 2024-05-28T06:13:09.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.418+0000 7fa1d7800640 1 -- 172.21.15.122:0/1767663750 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fa1d0076020 con 0x7fa1ac068d40 2024-05-28T06:13:09.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.422+0000 7fa1cd600640 1 -- 172.21.15.122:0/1767663750 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7fa1c00075a0 con 0x7fa1ac068d40 2024-05-28T06:13:09.423 INFO:teuthology.orchestra.run.smithi122.stdout:/volumes/_nogroup/sv1/cebb1c22-3d4a-4984-898e-c5827a498bd3 2024-05-28T06:13:09.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.426+0000 7fa1d7800640 1 -- 172.21.15.122:0/1767663750 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa1ac068d40 msgr2=0x7fa1ac06b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:09.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.426+0000 7fa1d7800640 1 --2- 172.21.15.122:0/1767663750 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa1ac068d40 0x7fa1ac06b200 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0000f70 tx=0x7fa1c0007d50 comp rx=0 tx=0).stop 2024-05-28T06:13:09.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.426+0000 7fa1d7800640 1 -- 172.21.15.122:0/1767663750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1d015e8b0 msgr2=0x7fa1d0157900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:09.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.426+0000 7fa1d7800640 1 --2- 172.21.15.122:0/1767663750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1d015e8b0 0x7fa1d0157900 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa1b800e8a0 tx=0x7fa1b800ed60 comp rx=0 tx=0).stop 2024-05-28T06:13:09.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.426+0000 7fa1d7800640 1 -- 172.21.15.122:0/1767663750 shutdown_connections 2024-05-28T06:13:09.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.426+0000 7fa1d7800640 1 --2- 172.21.15.122:0/1767663750 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa1ac068d40 0x7fa1ac06b200 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:09.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.426+0000 7fa1d7800640 1 --2- 172.21.15.122:0/1767663750 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa1d015f4c0 0x7fa1d00ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:09.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.426+0000 7fa1d7800640 1 --2- 172.21.15.122:0/1767663750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1d015e8b0 0x7fa1d0157900 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:09.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.426+0000 7fa1d7800640 1 --2- 172.21.15.122:0/1767663750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1d01588b0 0x7fa1d0134860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:09.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.426+0000 7fa1d7800640 1 -- 172.21.15.122:0/1767663750 >> 172.21.15.122:0/1767663750 conn(0x7fa1d006bd90 msgr2=0x7fa1d00cc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:09.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.426+0000 7fa1d7800640 1 -- 172.21.15.122:0/1767663750 shutdown_connections 2024-05-28T06:13:09.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:09.426+0000 7fa1d7800640 1 -- 172.21.15.122:0/1767663750 wait complete. 2024-05-28T06:13:09.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:13:09.444 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/cebb1c22-3d4a-4984-898e-c5827a498bd3 2024-05-28T06:13:09.445 DEBUG:teuthology.orchestra.run.smithi122:> ) 2024-05-28T06:13:09.453 INFO:teuthology.orchestra.run.smithi122.stdout:# file: volumes/_nogroup/sv1/cebb1c22-3d4a-4984-898e-c5827a498bd3 2024-05-28T06:13:09.454 INFO:teuthology.orchestra.run.smithi122.stdout:ceph.dir.rbytes="3055190016" 2024-05-28T06:13:09.454 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:13:09.455 INFO:tasks.cephfs.test_volumes:r_size = 3055190016 exp_size = 3221225472 2024-05-28T06:13:11.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:13:11.456 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/cebb1c22-3d4a-4984-898e-c5827a498bd3 2024-05-28T06:13:11.456 DEBUG:teuthology.orchestra.run.smithi122:> ) 2024-05-28T06:13:11.467 INFO:teuthology.orchestra.run.smithi122.stdout:# file: volumes/_nogroup/sv1/cebb1c22-3d4a-4984-898e-c5827a498bd3 2024-05-28T06:13:11.467 INFO:teuthology.orchestra.run.smithi122.stdout:ceph.dir.rbytes="3221225472" 2024-05-28T06:13:11.467 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:13:11.468 INFO:tasks.cephfs.test_volumes:r_size = 3221225472 exp_size = 3221225472 2024-05-28T06:13:11.468 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone47511 2024-05-28T06:13:11.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.666+0000 7febd7200640 1 Processor -- start 2024-05-28T06:13:11.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.666+0000 7febd7200640 1 -- start start 2024-05-28T06:13:11.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.666+0000 7febd7200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7febd006dbc0 0x7febd00d1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:11.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.666+0000 7febd7200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febd00d18c0 con 0x7febd006ccb0 2024-05-28T06:13:11.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.666+0000 7febd7200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febd00ccbf0 con 0x7febd015ebe0 2024-05-28T06:13:11.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.666+0000 7febd7200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7febd00cd240 con 0x7febd006dbc0 2024-05-28T06:13:11.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.666+0000 7febd6800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7febd006ccb0 0x7febd00c8170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:51110/0 (socket says 172.21.15.122:51110) 2024-05-28T06:13:11.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.666+0000 7febd6800640 1 -- 172.21.15.122:0/2927290021 learned_addr learned my addr 172.21.15.122:0/2927290021 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:13:11.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.666+0000 7febd5400640 1 --2- 172.21.15.122:0/2927290021 >> v2:172.21.15.153:3300/0 conn(0x7febd006dbc0 0x7febd00d1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:11.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.666+0000 7febd4a00640 1 -- 172.21.15.122:0/2927290021 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1435448859 0 0) 0x7febd00d18c0 con 0x7febd006ccb0 2024-05-28T06:13:11.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.666+0000 7febd4a00640 1 -- 172.21.15.122:0/2927290021 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febb8003530 con 0x7febd006ccb0 2024-05-28T06:13:11.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.666+0000 7febd5400640 1 -- 172.21.15.122:0/2927290021 >> v1:172.21.15.153:6789/0 conn(0x7febd015ebe0 legacy=0x7febd006d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:11.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.666+0000 7febd5400640 1 -- 172.21.15.122:0/2927290021 >> v1:172.21.15.122:6789/0 conn(0x7febd006ccb0 legacy=0x7febd00c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:11.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.666+0000 7febd5400640 1 -- 172.21.15.122:0/2927290021 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd00cced0 con 0x7febd006dbc0 2024-05-28T06:13:11.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.670+0000 7febd5400640 1 --2- 172.21.15.122:0/2927290021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febd006dbc0 0x7febd00d1220 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7febc00097c0 tx=0x7febc001c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9422431c5a78c35 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:11.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.670+0000 7febd4a00640 1 -- 172.21.15.122:0/2927290021 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc00b1070 con 0x7febd006dbc0 2024-05-28T06:13:11.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.670+0000 7febd4a00640 1 -- 172.21.15.122:0/2927290021 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc00ac410 con 0x7febd006dbc0 2024-05-28T06:13:11.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.670+0000 7febd4a00640 1 -- 172.21.15.122:0/2927290021 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc00ac7e0 con 0x7febd006dbc0 2024-05-28T06:13:11.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.670+0000 7febd7200640 1 -- 172.21.15.122:0/2927290021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febd006dbc0 msgr2=0x7febd00d1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:11.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.670+0000 7febd7200640 1 --2- 172.21.15.122:0/2927290021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febd006dbc0 0x7febd00d1220 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7febc00097c0 tx=0x7febc001c3d0 comp rx=0 tx=0).stop 2024-05-28T06:13:11.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.670+0000 7febd7200640 1 -- 172.21.15.122:0/2927290021 shutdown_connections 2024-05-28T06:13:11.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.670+0000 7febd7200640 1 --2- 172.21.15.122:0/2927290021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febd006dbc0 0x7febd00d1220 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:11.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.670+0000 7febd7200640 1 -- 172.21.15.122:0/2927290021 >> 172.21.15.122:0/2927290021 conn(0x7febd00b3ff0 msgr2=0x7febd00b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:11.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.670+0000 7febd7200640 1 -- 172.21.15.122:0/2927290021 shutdown_connections 2024-05-28T06:13:11.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.670+0000 7febd7200640 1 -- 172.21.15.122:0/2927290021 wait complete. 2024-05-28T06:13:11.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febd7200640 1 Processor -- start 2024-05-28T06:13:11.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febd7200640 1 -- start start 2024-05-28T06:13:11.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febd7200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febd006ccb0 0x7febd00cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:11.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febd7200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febd006dbc0 0x7febd00b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:11.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febd7200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febd015ebe0 0x7febd015aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:11.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febd7200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7febd016ce30 con 0x7febd015ebe0 2024-05-28T06:13:11.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febd7200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7febd00c8ea0 con 0x7febd006dbc0 2024-05-28T06:13:11.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febd7200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7febd016cfb0 con 0x7febd006ccb0 2024-05-28T06:13:11.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febd6800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febd015ebe0 0x7febd015aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:11.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febd6800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febd015ebe0 0x7febd015aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45186/0 (socket says 172.21.15.122:45186) 2024-05-28T06:13:11.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febd6800640 1 -- 172.21.15.122:0/2500426970 learned_addr learned my addr 172.21.15.122:0/2500426970 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:11.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febd5e00640 1 --2- 172.21.15.122:0/2500426970 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febd006ccb0 0x7febd00cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:11.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febd5400640 1 --2- 172.21.15.122:0/2500426970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febd006dbc0 0x7febd00b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:11.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febd6800640 1 -- 172.21.15.122:0/2500426970 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febd006ccb0 msgr2=0x7febd00cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:11.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febd6800640 1 --2- 172.21.15.122:0/2500426970 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febd006ccb0 0x7febd00cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:11.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febd6800640 1 -- 172.21.15.122:0/2500426970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febd006dbc0 msgr2=0x7febd00b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:11.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febd6800640 1 --2- 172.21.15.122:0/2500426970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febd006dbc0 0x7febd00b61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:11.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febd6800640 1 -- 172.21.15.122:0/2500426970 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd00b66e0 con 0x7febd015ebe0 2024-05-28T06:13:11.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febd5400640 1 --2- 172.21.15.122:0/2500426970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febd006dbc0 0x7febd00b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:13:11.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febd6800640 1 --2- 172.21.15.122:0/2500426970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febd015ebe0 0x7febd015aa60 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7febcc00cad0 tx=0x7febcc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:11.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febca000640 1 -- 172.21.15.122:0/2500426970 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febcc017070 con 0x7febd015ebe0 2024-05-28T06:13:11.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febca000640 1 -- 172.21.15.122:0/2500426970 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febcc00ac30 con 0x7febd015ebe0 2024-05-28T06:13:11.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febca000640 1 -- 172.21.15.122:0/2500426970 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febcc012400 con 0x7febd015ebe0 2024-05-28T06:13:11.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febd7200640 1 -- 172.21.15.122:0/2500426970 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febd00cbb90 con 0x7febd015ebe0 2024-05-28T06:13:11.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.674+0000 7febd7200640 1 -- 172.21.15.122:0/2500426970 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febd00cc150 con 0x7febd015ebe0 2024-05-28T06:13:11.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.678+0000 7febd7200640 1 -- 172.21.15.122:0/2500426970 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febd0075620 con 0x7febd015ebe0 2024-05-28T06:13:11.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.678+0000 7febca000640 1 -- 172.21.15.122:0/2500426970 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 19) ==== 88854+0+0 (secure 0 0 0) 0x7febcc01a070 con 0x7febd015ebe0 2024-05-28T06:13:11.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.678+0000 7febca000640 1 --2- 172.21.15.122:0/2500426970 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7febb4068d10 0x7febb406b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:11.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.678+0000 7febca000640 1 -- 172.21.15.122:0/2500426970 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7febcc084e40 con 0x7febd015ebe0 2024-05-28T06:13:11.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.678+0000 7febd5e00640 1 --2- 172.21.15.122:0/2500426970 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7febb4068d10 0x7febb406b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:11.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.678+0000 7febd5e00640 1 --2- 172.21.15.122:0/2500426970 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7febb4068d10 0x7febb406b1d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7febc4001770 tx=0x7febc4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:11.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.682+0000 7febca000640 1 -- 172.21.15.122:0/2500426970 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7febcc0569b0 con 0x7febd015ebe0 2024-05-28T06:13:11.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.874+0000 7febd7200640 1 -- 172.21.15.122:0/2500426970 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone47511", "target": ["mon-mgr", ""]}) -- 0x7febd00d18c0 con 0x7febb4068d10 2024-05-28T06:13:11.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.930+0000 7febca000640 1 -- 172.21.15.122:0/2500426970 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7febd00d18c0 con 0x7febb4068d10 2024-05-28T06:13:11.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.934+0000 7febd7200640 1 -- 172.21.15.122:0/2500426970 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7febb4068d10 msgr2=0x7febb406b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:11.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.934+0000 7febd7200640 1 --2- 172.21.15.122:0/2500426970 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7febb4068d10 0x7febb406b1d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7febc4001770 tx=0x7febc4009040 comp rx=0 tx=0).stop 2024-05-28T06:13:11.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.934+0000 7febd7200640 1 -- 172.21.15.122:0/2500426970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febd015ebe0 msgr2=0x7febd015aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:11.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.934+0000 7febd7200640 1 --2- 172.21.15.122:0/2500426970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febd015ebe0 0x7febd015aa60 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7febcc00cad0 tx=0x7febcc00cf90 comp rx=0 tx=0).stop 2024-05-28T06:13:11.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.934+0000 7febd7200640 1 -- 172.21.15.122:0/2500426970 shutdown_connections 2024-05-28T06:13:11.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.934+0000 7febd7200640 1 --2- 172.21.15.122:0/2500426970 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7febb4068d10 0x7febb406b1d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:11.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.934+0000 7febd7200640 1 --2- 172.21.15.122:0/2500426970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febd015ebe0 0x7febd015aa60 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:11.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.934+0000 7febd7200640 1 --2- 172.21.15.122:0/2500426970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febd006dbc0 0x7febd00b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:11.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.934+0000 7febd7200640 1 --2- 172.21.15.122:0/2500426970 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febd006ccb0 0x7febd00cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:11.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.934+0000 7febd7200640 1 -- 172.21.15.122:0/2500426970 >> 172.21.15.122:0/2500426970 conn(0x7febd00b3ff0 msgr2=0x7febd00b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:11.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.934+0000 7febd7200640 1 -- 172.21.15.122:0/2500426970 shutdown_connections 2024-05-28T06:13:11.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:11.934+0000 7febd7200640 1 -- 172.21.15.122:0/2500426970 wait complete. 2024-05-28T06:13:11.936 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:11.934+0000 7f9dee200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:11.936 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:11.934+0000 7f9dee200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:11.936 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:11.934+0000 7f9dee200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:11.936 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:11.934+0000 7f9dee200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:11.936 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:11.934+0000 7f9dee200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:11.951 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:11.954+0000 7f9ded800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:11.951 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:11.954+0000 7f9ded800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:11.951 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:11.954+0000 7f9ded800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:11.952 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:11.954+0000 7f9ded800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:11.952 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:11.954+0000 7f9ded800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:11.958 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone47512 2024-05-28T06:13:12.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.106+0000 7fc9b0200640 1 Processor -- start 2024-05-28T06:13:12.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.106+0000 7fc9b0200640 1 -- start start 2024-05-28T06:13:12.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.110+0000 7fc9b0200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc9a80cff30 0x7fc9a806f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:12.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.110+0000 7fc9b0200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc9a80cdb00 0x7fc9a80b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:12.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.110+0000 7fc9b0200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9a80cdf00 con 0x7fc9a806f6c0 2024-05-28T06:13:12.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.110+0000 7fc9b0200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fc9a806fb30 con 0x7fc9a80cdb00 2024-05-28T06:13:12.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.110+0000 7fc9b0200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc9a80d0310 con 0x7fc9a80cff30 2024-05-28T06:13:12.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.110+0000 7fc9ae200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc9a80cdb00 0x7fc9a80b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:12.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.110+0000 7fc9ae200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc9a80cdb00 0x7fc9a80b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45230/0 (socket says 172.21.15.122:45230) 2024-05-28T06:13:12.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.110+0000 7fc9ae200640 1 -- 172.21.15.122:0/3387167011 learned_addr learned my addr 172.21.15.122:0/3387167011 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:12.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.110+0000 7fc9ad800640 1 --2- 172.21.15.122:0/3387167011 >> v2:172.21.15.153:3300/0 conn(0x7fc9a80cff30 0x7fc9a806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:12.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.110+0000 7fc9ae200640 1 -- 172.21.15.122:0/3387167011 >> v2:172.21.15.153:3300/0 conn(0x7fc9a80cff30 msgr2=0x7fc9a806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:12.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.110+0000 7fc9ae200640 1 --2- 172.21.15.122:0/3387167011 >> v2:172.21.15.153:3300/0 conn(0x7fc9a80cff30 0x7fc9a806f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:12.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.110+0000 7fc9ae200640 1 -- 172.21.15.122:0/3387167011 >> v1:172.21.15.153:6789/0 conn(0x7fc9a806f6c0 legacy=0x7fc9a80cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:12.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.110+0000 7fc9ae200640 1 -- 172.21.15.122:0/3387167011 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a815be20 con 0x7fc9a80cdb00 2024-05-28T06:13:12.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.110+0000 7fc9ad800640 1 --2- 172.21.15.122:0/3387167011 >> v2:172.21.15.153:3300/0 conn(0x7fc9a80cff30 0x7fc9a806f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:13:12.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.114+0000 7fc9ae200640 1 --2- 172.21.15.122:0/3387167011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9a80cdb00 0x7fc9a80b49b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80b3dc0 tx=0x7fc9a001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc438cb23c8fdec server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:12.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.114+0000 7fc9a7e00640 1 -- 172.21.15.122:0/3387167011 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a00a5880 con 0x7fc9a80cdb00 2024-05-28T06:13:12.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.114+0000 7fc9a7e00640 1 -- 172.21.15.122:0/3387167011 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a00a5a20 con 0x7fc9a80cdb00 2024-05-28T06:13:12.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.114+0000 7fc9a7e00640 1 -- 172.21.15.122:0/3387167011 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a00a5df0 con 0x7fc9a80cdb00 2024-05-28T06:13:12.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.114+0000 7fc9b0200640 1 -- 172.21.15.122:0/3387167011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9a80cdb00 msgr2=0x7fc9a80b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:12.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.114+0000 7fc9b0200640 1 --2- 172.21.15.122:0/3387167011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9a80cdb00 0x7fc9a80b49b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80b3dc0 tx=0x7fc9a001c9c0 comp rx=0 tx=0).stop 2024-05-28T06:13:12.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.114+0000 7fc9b0200640 1 -- 172.21.15.122:0/3387167011 shutdown_connections 2024-05-28T06:13:12.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.114+0000 7fc9b0200640 1 --2- 172.21.15.122:0/3387167011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9a80cdb00 0x7fc9a80b49b0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:12.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.114+0000 7fc9b0200640 1 --2- 172.21.15.122:0/3387167011 >> v2:172.21.15.153:3300/0 conn(0x7fc9a80cff30 0x7fc9a806f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:12.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.114+0000 7fc9b0200640 1 -- 172.21.15.122:0/3387167011 >> 172.21.15.122:0/3387167011 conn(0x7fc9a806bd90 msgr2=0x7fc9a806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:12.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.114+0000 7fc9b0200640 1 -- 172.21.15.122:0/3387167011 shutdown_connections 2024-05-28T06:13:12.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.114+0000 7fc9b0200640 1 -- 172.21.15.122:0/3387167011 wait complete. 2024-05-28T06:13:12.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.114+0000 7fc9b0200640 1 Processor -- start 2024-05-28T06:13:12.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.114+0000 7fc9b0200640 1 -- start start 2024-05-28T06:13:12.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9b0200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9a806f6c0 0x7fc9a8148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:12.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9b0200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9a80cdb00 0x7fc9a8154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:12.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9b0200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9a80cff30 0x7fc9a8151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:12.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9b0200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a80b5700 con 0x7fc9a806f6c0 2024-05-28T06:13:12.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9b0200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a815baf0 con 0x7fc9a80cdb00 2024-05-28T06:13:12.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9b0200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a80b5880 con 0x7fc9a80cff30 2024-05-28T06:13:12.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9ad800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9a806f6c0 0x7fc9a8148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:12.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9ad800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9a806f6c0 0x7fc9a8148280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45234/0 (socket says 172.21.15.122:45234) 2024-05-28T06:13:12.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9ad800640 1 -- 172.21.15.122:0/876660140 learned_addr learned my addr 172.21.15.122:0/876660140 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:12.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9ae200640 1 --2- 172.21.15.122:0/876660140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9a80cff30 0x7fc9a8151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:12.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9ace00640 1 --2- 172.21.15.122:0/876660140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9a80cdb00 0x7fc9a8154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:12.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9ad800640 1 -- 172.21.15.122:0/876660140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9a80cff30 msgr2=0x7fc9a8151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:12.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9ad800640 1 --2- 172.21.15.122:0/876660140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9a80cff30 0x7fc9a8151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:12.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9ad800640 1 -- 172.21.15.122:0/876660140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9a80cdb00 msgr2=0x7fc9a8154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:12.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9ad800640 1 --2- 172.21.15.122:0/876660140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9a80cdb00 0x7fc9a8154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:12.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9ad800640 1 -- 172.21.15.122:0/876660140 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a8153fc0 con 0x7fc9a806f6c0 2024-05-28T06:13:12.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9ace00640 1 --2- 172.21.15.122:0/876660140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9a80cdb00 0x7fc9a8154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:13:12.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9ad800640 1 --2- 172.21.15.122:0/876660140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9a806f6c0 0x7fc9a8148280 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00d800 tx=0x7fc99c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:12.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9a5600640 1 -- 172.21.15.122:0/876660140 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c00b6c0 con 0x7fc9a806f6c0 2024-05-28T06:13:12.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9a5600640 1 -- 172.21.15.122:0/876660140 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc99c019070 con 0x7fc9a806f6c0 2024-05-28T06:13:12.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9a5600640 1 -- 172.21.15.122:0/876660140 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c00baa0 con 0x7fc9a806f6c0 2024-05-28T06:13:12.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9b0200640 1 -- 172.21.15.122:0/876660140 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a8152f20 con 0x7fc9a806f6c0 2024-05-28T06:13:12.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9b0200640 1 -- 172.21.15.122:0/876660140 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a81534e0 con 0x7fc9a806f6c0 2024-05-28T06:13:12.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9b0200640 1 -- 172.21.15.122:0/876660140 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9a8068c40 con 0x7fc9a806f6c0 2024-05-28T06:13:12.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.118+0000 7fc9a5600640 1 -- 172.21.15.122:0/876660140 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 19) ==== 88854+0+0 (secure 0 0 0) 0x7fc99c00bc40 con 0x7fc9a806f6c0 2024-05-28T06:13:12.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.122+0000 7fc9a5600640 1 --2- 172.21.15.122:0/876660140 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc988068d10 0x7fc98806b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:12.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.122+0000 7fc9a5600640 1 -- 172.21.15.122:0/876660140 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7fc99c085470 con 0x7fc9a806f6c0 2024-05-28T06:13:12.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.122+0000 7fc9ace00640 1 --2- 172.21.15.122:0/876660140 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc988068d10 0x7fc98806b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:12.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.122+0000 7fc9ace00640 1 --2- 172.21.15.122:0/876660140 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc988068d10 0x7fc98806b1d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc9a815b8e0 tx=0x7fc994009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:12.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.126+0000 7fc9a5600640 1 -- 172.21.15.122:0/876660140 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc99c057630 con 0x7fc9a806f6c0 2024-05-28T06:13:12.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:12.310+0000 7fc9b0200640 1 -- 172.21.15.122:0/876660140 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone47512", "target": ["mon-mgr", ""]}) -- 0x7fc9a80ccdf0 con 0x7fc988068d10 2024-05-28T06:13:12.936 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:12.938+0000 7f9db2c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:12.936 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:12.938+0000 7f9db2c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:12.936 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:12.938+0000 7f9db2c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:12.936 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:12.938+0000 7f9db2c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:12.936 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:12.938+0000 7f9db2c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:13.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.026+0000 7fc9a5600640 1 -- 172.21.15.122:0/876660140 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc9a80ccdf0 con 0x7fc988068d10 2024-05-28T06:13:13.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.026+0000 7fc9b0200640 1 -- 172.21.15.122:0/876660140 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc988068d10 msgr2=0x7fc98806b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:13.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.026+0000 7fc9b0200640 1 --2- 172.21.15.122:0/876660140 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc988068d10 0x7fc98806b1d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc9a815b8e0 tx=0x7fc994009040 comp rx=0 tx=0).stop 2024-05-28T06:13:13.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.026+0000 7fc9b0200640 1 -- 172.21.15.122:0/876660140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9a806f6c0 msgr2=0x7fc9a8148280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:13.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.026+0000 7fc9b0200640 1 --2- 172.21.15.122:0/876660140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9a806f6c0 0x7fc9a8148280 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00d800 tx=0x7fc99c00dcc0 comp rx=0 tx=0).stop 2024-05-28T06:13:13.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.030+0000 7fc9b0200640 1 -- 172.21.15.122:0/876660140 shutdown_connections 2024-05-28T06:13:13.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.030+0000 7fc9b0200640 1 --2- 172.21.15.122:0/876660140 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc988068d10 0x7fc98806b1d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:13.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.030+0000 7fc9b0200640 1 --2- 172.21.15.122:0/876660140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9a80cff30 0x7fc9a8151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:13.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.030+0000 7fc9b0200640 1 --2- 172.21.15.122:0/876660140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9a80cdb00 0x7fc9a8154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:13.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.030+0000 7fc9b0200640 1 --2- 172.21.15.122:0/876660140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9a806f6c0 0x7fc9a8148280 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:13.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.030+0000 7fc9b0200640 1 -- 172.21.15.122:0/876660140 >> 172.21.15.122:0/876660140 conn(0x7fc9a806bd90 msgr2=0x7fc9a814e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:13.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.030+0000 7fc9b0200640 1 -- 172.21.15.122:0/876660140 shutdown_connections 2024-05-28T06:13:13.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.030+0000 7fc9b0200640 1 -- 172.21.15.122:0/876660140 wait complete. 2024-05-28T06:13:13.037 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:13.038+0000 7f9def600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:13.037 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:13.038+0000 7f9def600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:13.037 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:13.038+0000 7f9def600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:13.037 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:13.038+0000 7f9def600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:13.037 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:13.038+0000 7f9def600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:13.057 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone47513 2024-05-28T06:13:13.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.354+0000 7f9b39600640 1 Processor -- start 2024-05-28T06:13:13.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.358+0000 7f9b39600640 1 -- start start 2024-05-28T06:13:13.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.358+0000 7f9b39600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9b340b5470 0x7f9b340b5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:13.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.358+0000 7f9b39600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b34071ea0 0x7f9b34072330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:13.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.358+0000 7f9b39600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b340b4220 con 0x7f9b3415a8e0 2024-05-28T06:13:13.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.358+0000 7f9b39600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f9b340b5fe0 con 0x7f9b340b5470 2024-05-28T06:13:13.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.358+0000 7f9b39600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9b340b62c0 con 0x7f9b34071ea0 2024-05-28T06:13:13.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.362+0000 7f9b33400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b34071ea0 0x7f9b34072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:13.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.362+0000 7f9b33400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b34071ea0 0x7f9b34072330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:41496/0 (socket says 172.21.15.122:41496) 2024-05-28T06:13:13.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.362+0000 7f9b33400640 1 -- 172.21.15.122:0/1555656973 learned_addr learned my addr 172.21.15.122:0/1555656973 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:13.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.366+0000 7f9b33400640 1 -- 172.21.15.122:0/1555656973 >> v2:172.21.15.122:3300/0 conn(0x7f9b340b5470 msgr2=0x7f9b340b5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:13.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.366+0000 7f9b33400640 1 --2- 172.21.15.122:0/1555656973 >> v2:172.21.15.122:3300/0 conn(0x7f9b340b5470 0x7f9b340b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:13.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.366+0000 7f9b33400640 1 -- 172.21.15.122:0/1555656973 >> v1:172.21.15.122:6789/0 conn(0x7f9b3415a8e0 legacy=0x7f9b3415acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:13.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.366+0000 7f9b33400640 1 -- 172.21.15.122:0/1555656973 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b340b65a0 con 0x7f9b34071ea0 2024-05-28T06:13:13.373 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.374+0000 7f9b33400640 1 --2- 172.21.15.122:0/1555656973 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b34071ea0 0x7f9b34072330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00d1e0 tx=0x7f9b2c01ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a612c53c9c5db087 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:13.373 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.374+0000 7f9b31600640 1 -- 172.21.15.122:0/1555656973 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0ad070 con 0x7f9b34071ea0 2024-05-28T06:13:13.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.374+0000 7f9b31600640 1 -- 172.21.15.122:0/1555656973 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b2c0a7cb0 con 0x7f9b34071ea0 2024-05-28T06:13:13.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.374+0000 7f9b31600640 1 -- 172.21.15.122:0/1555656973 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0a7e60 con 0x7f9b34071ea0 2024-05-28T06:13:13.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.374+0000 7f9b39600640 1 -- 172.21.15.122:0/1555656973 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b34071ea0 msgr2=0x7f9b34072330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:13.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.374+0000 7f9b39600640 1 --2- 172.21.15.122:0/1555656973 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b34071ea0 0x7f9b34072330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00d1e0 tx=0x7f9b2c01ed10 comp rx=0 tx=0).stop 2024-05-28T06:13:13.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.374+0000 7f9b39600640 1 -- 172.21.15.122:0/1555656973 shutdown_connections 2024-05-28T06:13:13.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.374+0000 7f9b39600640 1 --2- 172.21.15.122:0/1555656973 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b34071ea0 0x7f9b34072330 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:13.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.374+0000 7f9b39600640 1 --2- 172.21.15.122:0/1555656973 >> v2:172.21.15.122:3300/0 conn(0x7f9b340b5470 0x7f9b340b5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:13.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.374+0000 7f9b39600640 1 -- 172.21.15.122:0/1555656973 >> 172.21.15.122:0/1555656973 conn(0x7f9b340700f0 msgr2=0x7f9b3406b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:13.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.378+0000 7f9b39600640 1 -- 172.21.15.122:0/1555656973 shutdown_connections 2024-05-28T06:13:13.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.378+0000 7f9b39600640 1 -- 172.21.15.122:0/1555656973 wait complete. 2024-05-28T06:13:13.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.378+0000 7f9b39600640 1 Processor -- start 2024-05-28T06:13:13.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.378+0000 7f9b39600640 1 -- start start 2024-05-28T06:13:13.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.382+0000 7f9b39600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b34071ea0 0x7f9b34140e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:13.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.382+0000 7f9b39600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b340b5470 0x7f9b34152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:13.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.382+0000 7f9b39600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b3415a8e0 0x7f9b34150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:13.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.382+0000 7f9b39600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9b340cfa10 con 0x7f9b3415a8e0 2024-05-28T06:13:13.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.382+0000 7f9b39600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3415b5e0 con 0x7f9b340b5470 2024-05-28T06:13:13.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.382+0000 7f9b39600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9b340cfb90 con 0x7f9b34071ea0 2024-05-28T06:13:13.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.382+0000 7f9b32a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b34071ea0 0x7f9b34140e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:13.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.382+0000 7f9b32a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b34071ea0 0x7f9b34140e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:41500/0 (socket says 172.21.15.122:41500) 2024-05-28T06:13:13.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.382+0000 7f9b32a00640 1 -- 172.21.15.122:0/1567964999 learned_addr learned my addr 172.21.15.122:0/1567964999 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:13.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.382+0000 7f9b32000640 1 --2- 172.21.15.122:0/1567964999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b340b5470 0x7f9b34152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:13.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.382+0000 7f9b33400640 1 --2- 172.21.15.122:0/1567964999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b3415a8e0 0x7f9b34150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:13.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.382+0000 7f9b32000640 1 -- 172.21.15.122:0/1567964999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b34071ea0 msgr2=0x7f9b34140e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:13.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.382+0000 7f9b32000640 1 --2- 172.21.15.122:0/1567964999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b34071ea0 0x7f9b34140e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:13.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.382+0000 7f9b32000640 1 -- 172.21.15.122:0/1567964999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b3415a8e0 msgr2=0x7f9b34150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:13.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.382+0000 7f9b32000640 1 --2- 172.21.15.122:0/1567964999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b3415a8e0 0x7f9b34150960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:13.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.382+0000 7f9b32000640 1 -- 172.21.15.122:0/1567964999 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b341593e0 con 0x7f9b340b5470 2024-05-28T06:13:13.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.382+0000 7f9b33400640 1 --2- 172.21.15.122:0/1567964999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b3415a8e0 0x7f9b34150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:13:13.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.382+0000 7f9b32000640 1 --2- 172.21.15.122:0/1567964999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b340b5470 0x7f9b34152900 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000b420 tx=0x7f9b2000b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:13.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.382+0000 7f9b2aa00640 1 -- 172.21.15.122:0/1567964999 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20011830 con 0x7f9b340b5470 2024-05-28T06:13:13.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.382+0000 7f9b2aa00640 1 -- 172.21.15.122:0/1567964999 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b20016070 con 0x7f9b340b5470 2024-05-28T06:13:13.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.382+0000 7f9b2aa00640 1 -- 172.21.15.122:0/1567964999 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20011bf0 con 0x7f9b340b5470 2024-05-28T06:13:13.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.386+0000 7f9b39600640 1 -- 172.21.15.122:0/1567964999 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b34158340 con 0x7f9b340b5470 2024-05-28T06:13:13.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.386+0000 7f9b39600640 1 -- 172.21.15.122:0/1567964999 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b34158900 con 0x7f9b340b5470 2024-05-28T06:13:13.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.390+0000 7f9b39600640 1 -- 172.21.15.122:0/1567964999 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b34068c40 con 0x7f9b340b5470 2024-05-28T06:13:13.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.390+0000 7f9b2aa00640 1 -- 172.21.15.122:0/1567964999 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 19) ==== 88854+0+0 (secure 0 0 0) 0x7f9b20032be0 con 0x7f9b340b5470 2024-05-28T06:13:13.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.390+0000 7f9b2aa00640 1 --2- 172.21.15.122:0/1567964999 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9b14068d60 0x7f9b1406b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:13.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.390+0000 7f9b2aa00640 1 -- 172.21.15.122:0/1567964999 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f9b200845a0 con 0x7f9b340b5470 2024-05-28T06:13:13.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.394+0000 7f9b32a00640 1 --2- 172.21.15.122:0/1567964999 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9b14068d60 0x7f9b1406b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:13.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.398+0000 7f9b32a00640 1 --2- 172.21.15.122:0/1567964999 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9b14068d60 0x7f9b1406b220 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9b340b31c0 tx=0x7f9b24009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:13.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.402+0000 7f9b2aa00640 1 -- 172.21.15.122:0/1567964999 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9b20056110 con 0x7f9b340b5470 2024-05-28T06:13:13.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.482+0000 7f9b2aa00640 1 -- 172.21.15.122:0/1567964999 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mgrmap(e 20) ==== 89058+0+0 (secure 0 0 0) 0x7f9b20052780 con 0x7f9b340b5470 2024-05-28T06:13:13.860 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:13.858+0000 7f9b39600640 1 -- 172.21.15.122:0/1567964999 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone47513", "target": ["mon-mgr", ""]}) -- 0x7f9b34076020 con 0x7f9b14068d60 2024-05-28T06:13:14.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.390+0000 7f9b2aa00640 1 -- 172.21.15.122:0/1567964999 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9b240015b0 con 0x7f9b14068d60 2024-05-28T06:13:14.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.406+0000 7f9b39600640 1 -- 172.21.15.122:0/1567964999 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9b14068d60 msgr2=0x7f9b1406b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:14.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.406+0000 7f9b39600640 1 --2- 172.21.15.122:0/1567964999 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9b14068d60 0x7f9b1406b220 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9b340b31c0 tx=0x7f9b24009040 comp rx=0 tx=0).stop 2024-05-28T06:13:14.406 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.406+0000 7f9b39600640 1 -- 172.21.15.122:0/1567964999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b340b5470 msgr2=0x7f9b34152900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:14.406 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.406+0000 7f9b39600640 1 --2- 172.21.15.122:0/1567964999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b340b5470 0x7f9b34152900 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000b420 tx=0x7f9b2000b8e0 comp rx=0 tx=0).stop 2024-05-28T06:13:14.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.406+0000 7f9b39600640 1 -- 172.21.15.122:0/1567964999 shutdown_connections 2024-05-28T06:13:14.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.406+0000 7f9b39600640 1 --2- 172.21.15.122:0/1567964999 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9b14068d60 0x7f9b1406b220 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:14.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.406+0000 7f9b39600640 1 --2- 172.21.15.122:0/1567964999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b3415a8e0 0x7f9b34150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:14.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.406+0000 7f9b39600640 1 --2- 172.21.15.122:0/1567964999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b340b5470 0x7f9b34152900 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:14.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.406+0000 7f9b39600640 1 --2- 172.21.15.122:0/1567964999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b34071ea0 0x7f9b34140e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:14.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.406+0000 7f9b39600640 1 -- 172.21.15.122:0/1567964999 >> 172.21.15.122:0/1567964999 conn(0x7f9b340700f0 msgr2=0x7f9b3406b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:14.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.410+0000 7f9b39600640 1 -- 172.21.15.122:0/1567964999 shutdown_connections 2024-05-28T06:13:14.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.410+0000 7f9b39600640 1 -- 172.21.15.122:0/1567964999 wait complete. 2024-05-28T06:13:14.462 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:14.462+0000 7f9def600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:14.463 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:14.462+0000 7f9def600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:14.463 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:14.462+0000 7f9def600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:14.463 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:14.462+0000 7f9def600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:14.463 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:14.462+0000 7f9def600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:14.479 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone47514 2024-05-28T06:13:14.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.862+0000 7f3f59400640 1 Processor -- start 2024-05-28T06:13:14.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.862+0000 7f3f59400640 1 -- start start 2024-05-28T06:13:14.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.866+0000 7f3f59400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3f4c0e3530 0x7f3f4c03aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:14.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.866+0000 7f3f59400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f4c03af50 0x7f3f4c0574d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:14.864 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.866+0000 7f3f59400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f4c058850 con 0x7f3f4c057a10 2024-05-28T06:13:14.864 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.866+0000 7f3f59400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f3f4c03c430 con 0x7f3f4c0e3530 2024-05-28T06:13:14.864 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.866+0000 7f3f59400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3f4c03b3b0 con 0x7f3f4c03af50 2024-05-28T06:13:14.865 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.866+0000 7f3f51e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f4c03af50 0x7f3f4c0574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:14.865 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.866+0000 7f3f51e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f4c03af50 0x7f3f4c0574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:41528/0 (socket says 172.21.15.122:41528) 2024-05-28T06:13:14.865 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.866+0000 7f3f51e00640 1 -- 172.21.15.122:0/769307762 learned_addr learned my addr 172.21.15.122:0/769307762 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:14.865 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.866+0000 7f3f51e00640 1 -- 172.21.15.122:0/769307762 >> v2:172.21.15.122:3300/0 conn(0x7f3f4c0e3530 msgr2=0x7f3f4c03aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:14.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.866+0000 7f3f51e00640 1 --2- 172.21.15.122:0/769307762 >> v2:172.21.15.122:3300/0 conn(0x7f3f4c0e3530 0x7f3f4c03aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:14.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.866+0000 7f3f51e00640 1 -- 172.21.15.122:0/769307762 >> v1:172.21.15.153:6789/0 conn(0x7f3f4c057a10 legacy=0x7f3f4c00e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:14.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.866+0000 7f3f51e00640 1 -- 172.21.15.122:0/769307762 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4c03c660 con 0x7f3f4c03af50 2024-05-28T06:13:14.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.874+0000 7f3f51e00640 1 --2- 172.21.15.122:0/769307762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f4c03af50 0x7f3f4c0574d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009870 tx=0x7f3f4001c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b3836ade23c9eef server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:14.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.874+0000 7f3f51400640 1 -- 172.21.15.122:0/769307762 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f400aa610 con 0x7f3f4c03af50 2024-05-28T06:13:14.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.874+0000 7f3f51400640 1 -- 172.21.15.122:0/769307762 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f400af070 con 0x7f3f4c03af50 2024-05-28T06:13:14.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.874+0000 7f3f51400640 1 -- 172.21.15.122:0/769307762 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f400aa9d0 con 0x7f3f4c03af50 2024-05-28T06:13:14.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.878+0000 7f3f59400640 1 -- 172.21.15.122:0/769307762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f4c03af50 msgr2=0x7f3f4c0574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:14.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.878+0000 7f3f59400640 1 --2- 172.21.15.122:0/769307762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f4c03af50 0x7f3f4c0574d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009870 tx=0x7f3f4001c4f0 comp rx=0 tx=0).stop 2024-05-28T06:13:14.878 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.878+0000 7f3f59400640 1 -- 172.21.15.122:0/769307762 shutdown_connections 2024-05-28T06:13:14.878 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.878+0000 7f3f59400640 1 --2- 172.21.15.122:0/769307762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f4c03af50 0x7f3f4c0574d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:14.878 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.878+0000 7f3f59400640 1 --2- 172.21.15.122:0/769307762 >> v2:172.21.15.122:3300/0 conn(0x7f3f4c0e3530 0x7f3f4c03aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:14.878 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.878+0000 7f3f59400640 1 -- 172.21.15.122:0/769307762 >> 172.21.15.122:0/769307762 conn(0x7f3f4c00ff20 msgr2=0x7f3f4c010330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:14.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.886+0000 7f3f59400640 1 -- 172.21.15.122:0/769307762 shutdown_connections 2024-05-28T06:13:14.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.886+0000 7f3f59400640 1 -- 172.21.15.122:0/769307762 wait complete. 2024-05-28T06:13:14.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.894+0000 7f3f59400640 1 Processor -- start 2024-05-28T06:13:14.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.898+0000 7f3f59400640 1 -- start start 2024-05-28T06:13:14.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.898+0000 7f3f59400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f4c03af50 0x7f3f4c009320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:14.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.898+0000 7f3f59400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f4c057a10 0x7f3f4c052750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:14.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.898+0000 7f3f59400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f4c0e3530 0x7f3f4c189770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:14.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.898+0000 7f3f59400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c057ea0 con 0x7f3f4c03af50 2024-05-28T06:13:14.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.898+0000 7f3f59400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c0e3910 con 0x7f3f4c0e3530 2024-05-28T06:13:14.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.898+0000 7f3f59400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3f4c058020 con 0x7f3f4c057a10 2024-05-28T06:13:14.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.898+0000 7f3f51e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f4c057a10 0x7f3f4c052750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:14.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.898+0000 7f3f51e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f4c057a10 0x7f3f4c052750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:41536/0 (socket says 172.21.15.122:41536) 2024-05-28T06:13:14.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.898+0000 7f3f51e00640 1 -- 172.21.15.122:0/3329202568 learned_addr learned my addr 172.21.15.122:0/3329202568 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:14.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.898+0000 7f3f53200640 1 --2- 172.21.15.122:0/3329202568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f4c0e3530 0x7f3f4c189770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:14.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.898+0000 7f3f51e00640 1 -- 172.21.15.122:0/3329202568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f4c0e3530 msgr2=0x7f3f4c189770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:14.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.898+0000 7f3f51e00640 1 --2- 172.21.15.122:0/3329202568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f4c0e3530 0x7f3f4c189770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:14.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.898+0000 7f3f51e00640 1 -- 172.21.15.122:0/3329202568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f4c03af50 msgr2=0x7f3f4c009320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:14.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.898+0000 7f3f51e00640 1 --2- 172.21.15.122:0/3329202568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f4c03af50 0x7f3f4c009320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:14.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.898+0000 7f3f51e00640 1 -- 172.21.15.122:0/3329202568 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4c009c90 con 0x7f3f4c057a10 2024-05-28T06:13:14.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.898+0000 7f3f51e00640 1 --2- 172.21.15.122:0/3329202568 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f4c057a10 0x7f3f4c052750 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3f400ac040 tx=0x7f3f4001ad30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:14.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.902+0000 7f3f4aa00640 1 -- 172.21.15.122:0/3329202568 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f400bd5f0 con 0x7f3f4c057a10 2024-05-28T06:13:14.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.902+0000 7f3f4aa00640 1 -- 172.21.15.122:0/3329202568 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f400bd790 con 0x7f3f4c057a10 2024-05-28T06:13:14.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.902+0000 7f3f4aa00640 1 -- 172.21.15.122:0/3329202568 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f400bdb80 con 0x7f3f4c057a10 2024-05-28T06:13:14.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.902+0000 7f3f59400640 1 -- 172.21.15.122:0/3329202568 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f4c009f70 con 0x7f3f4c057a10 2024-05-28T06:13:14.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.902+0000 7f3f59400640 1 -- 172.21.15.122:0/3329202568 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f4c00a530 con 0x7f3f4c057a10 2024-05-28T06:13:14.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.906+0000 7f3f59400640 1 -- 172.21.15.122:0/3329202568 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f2c0052a0 con 0x7f3f4c057a10 2024-05-28T06:13:14.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.906+0000 7f3f4aa00640 1 -- 172.21.15.122:0/3329202568 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 20) ==== 89058+0+0 (secure 0 0 0) 0x7f3f400059a0 con 0x7f3f4c057a10 2024-05-28T06:13:14.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.910+0000 7f3f4aa00640 1 --2- 172.21.15.122:0/3329202568 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3f34069050 0x7f3f3406b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:14.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.910+0000 7f3f4aa00640 1 -- 172.21.15.122:0/3329202568 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f3f4011faa0 con 0x7f3f4c057a10 2024-05-28T06:13:14.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.918+0000 7f3f4aa00640 1 -- 172.21.15.122:0/3329202568 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3f400a7070 con 0x7f3f4c057a10 2024-05-28T06:13:14.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.926+0000 7f3f52800640 1 --2- 172.21.15.122:0/3329202568 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3f34069050 0x7f3f3406b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:14.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:14.994+0000 7f3f52800640 1 --2- 172.21.15.122:0/3329202568 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3f34069050 0x7f3f3406b510 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3f44009730 tx=0x7f3f44006ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:15.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:15.402+0000 7f3f59400640 1 -- 172.21.15.122:0/3329202568 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone47514", "target": ["mon-mgr", ""]}) -- 0x7f3f2c000bd0 con 0x7f3f34069050 2024-05-28T06:13:15.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:15.586+0000 7f3f4aa00640 1 -- 172.21.15.122:0/3329202568 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mgrmap(e 21) ==== 89109+0+0 (secure 0 0 0) 0x7f3f400ed870 con 0x7f3f4c057a10 2024-05-28T06:13:16.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.366+0000 7f3f4aa00640 1 -- 172.21.15.122:0/3329202568 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3f2c000bd0 con 0x7f3f34069050 2024-05-28T06:13:16.371 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.370+0000 7f3f59400640 1 -- 172.21.15.122:0/3329202568 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3f34069050 msgr2=0x7f3f3406b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:16.371 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.370+0000 7f3f59400640 1 --2- 172.21.15.122:0/3329202568 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3f34069050 0x7f3f3406b510 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3f44009730 tx=0x7f3f44006ca0 comp rx=0 tx=0).stop 2024-05-28T06:13:16.371 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.370+0000 7f3f59400640 1 -- 172.21.15.122:0/3329202568 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f4c057a10 msgr2=0x7f3f4c052750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:16.371 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.370+0000 7f3f59400640 1 --2- 172.21.15.122:0/3329202568 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f4c057a10 0x7f3f4c052750 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3f400ac040 tx=0x7f3f4001ad30 comp rx=0 tx=0).stop 2024-05-28T06:13:16.371 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.370+0000 7f3f59400640 1 -- 172.21.15.122:0/3329202568 shutdown_connections 2024-05-28T06:13:16.371 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.370+0000 7f3f59400640 1 --2- 172.21.15.122:0/3329202568 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3f34069050 0x7f3f3406b510 secure :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3f44009730 tx=0x7f3f44006ca0 comp rx=0 tx=0).stop 2024-05-28T06:13:16.371 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.370+0000 7f3f59400640 1 --2- 172.21.15.122:0/3329202568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f4c0e3530 0x7f3f4c189770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:16.371 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.370+0000 7f3f59400640 1 --2- 172.21.15.122:0/3329202568 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f4c057a10 0x7f3f4c052750 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:16.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.370+0000 7f3f59400640 1 --2- 172.21.15.122:0/3329202568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f4c03af50 0x7f3f4c009320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:16.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.370+0000 7f3f59400640 1 -- 172.21.15.122:0/3329202568 >> 172.21.15.122:0/3329202568 conn(0x7f3f4c00ff20 msgr2=0x7f3f4c04f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:16.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.374+0000 7f3f59400640 1 -- 172.21.15.122:0/3329202568 shutdown_connections 2024-05-28T06:13:16.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.374+0000 7f3f59400640 1 -- 172.21.15.122:0/3329202568 wait complete. 2024-05-28T06:13:16.440 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone47515 2024-05-28T06:13:16.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.842+0000 7f9c7a000640 1 Processor -- start 2024-05-28T06:13:16.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.842+0000 7f9c7a000640 1 -- start start 2024-05-28T06:13:16.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.846+0000 7f9c7a000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c7413f500 0x7f9c740b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:16.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.846+0000 7f9c7a000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9c7413f8e0 0x7f9c740b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:16.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.846+0000 7f9c7a000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9c740ce3f0 0x7f9c740ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:16.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.846+0000 7f9c7a000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f9c74141ff0 con 0x7f9c740ce3f0 2024-05-28T06:13:16.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.846+0000 7f9c7a000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9c741422d0 con 0x7f9c7413f8e0 2024-05-28T06:13:16.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.846+0000 7f9c7a000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9c741425b0 con 0x7f9c7413f500 2024-05-28T06:13:16.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.846+0000 7f9c73400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c7413f500 0x7f9c740b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:16.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.846+0000 7f9c73400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c7413f500 0x7f9c740b58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:44370/0 (socket says 172.21.15.122:44370) 2024-05-28T06:13:16.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.846+0000 7f9c73400640 1 -- 172.21.15.122:0/1197971195 learned_addr learned my addr 172.21.15.122:0/1197971195 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:16.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.850+0000 7f9c72a00640 1 --2- 172.21.15.122:0/1197971195 >> v2:172.21.15.153:3300/0 conn(0x7f9c7413f8e0 0x7f9c740b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:16.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.850+0000 7f9c73400640 1 -- 172.21.15.122:0/1197971195 >> v2:172.21.15.153:3300/0 conn(0x7f9c7413f8e0 msgr2=0x7f9c740b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:16.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.850+0000 7f9c73400640 1 --2- 172.21.15.122:0/1197971195 >> v2:172.21.15.153:3300/0 conn(0x7f9c7413f8e0 0x7f9c740b5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:16.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.850+0000 7f9c73400640 1 -- 172.21.15.122:0/1197971195 >> v2:172.21.15.122:3300/0 conn(0x7f9c740ce3f0 msgr2=0x7f9c740ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:16.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.850+0000 7f9c73400640 1 --2- 172.21.15.122:0/1197971195 >> v2:172.21.15.122:3300/0 conn(0x7f9c740ce3f0 0x7f9c740ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:16.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.850+0000 7f9c73400640 1 -- 172.21.15.122:0/1197971195 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c74142890 con 0x7f9c7413f500 2024-05-28T06:13:16.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.862+0000 7f9c73400640 1 --2- 172.21.15.122:0/1197971195 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c7413f500 0x7f9c740b58d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9c74073340 tx=0x7f9c6001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90b6d650648784c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:16.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.862+0000 7f9c72000640 1 -- 172.21.15.122:0/1197971195 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c600b0070 con 0x7f9c7413f500 2024-05-28T06:13:16.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.862+0000 7f9c72000640 1 -- 172.21.15.122:0/1197971195 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c600ab600 con 0x7f9c7413f500 2024-05-28T06:13:16.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.866+0000 7f9c72000640 1 -- 172.21.15.122:0/1197971195 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c600ab9d0 con 0x7f9c7413f500 2024-05-28T06:13:16.865 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.866+0000 7f9c7a000640 1 -- 172.21.15.122:0/1197971195 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c7413f500 msgr2=0x7f9c740b58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:16.865 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.866+0000 7f9c7a000640 1 --2- 172.21.15.122:0/1197971195 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c7413f500 0x7f9c740b58d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9c74073340 tx=0x7f9c6001c540 comp rx=0 tx=0).stop 2024-05-28T06:13:16.865 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.866+0000 7f9c7a000640 1 -- 172.21.15.122:0/1197971195 shutdown_connections 2024-05-28T06:13:16.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.866+0000 7f9c7a000640 1 --2- 172.21.15.122:0/1197971195 >> v2:172.21.15.122:3300/0 conn(0x7f9c740ce3f0 0x7f9c740ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:16.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.866+0000 7f9c7a000640 1 --2- 172.21.15.122:0/1197971195 >> v2:172.21.15.153:3300/0 conn(0x7f9c7413f8e0 0x7f9c740b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:16.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.866+0000 7f9c7a000640 1 --2- 172.21.15.122:0/1197971195 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c7413f500 0x7f9c740b58d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:16.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.866+0000 7f9c7a000640 1 -- 172.21.15.122:0/1197971195 >> 172.21.15.122:0/1197971195 conn(0x7f9c740700f0 msgr2=0x7f9c7406b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:16.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.870+0000 7f9c7a000640 1 -- 172.21.15.122:0/1197971195 shutdown_connections 2024-05-28T06:13:16.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.870+0000 7f9c7a000640 1 -- 172.21.15.122:0/1197971195 wait complete. 2024-05-28T06:13:16.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.878+0000 7f9c7a000640 1 Processor -- start 2024-05-28T06:13:16.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.882+0000 7f9c7a000640 1 -- start start 2024-05-28T06:13:16.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.882+0000 7f9c7a000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c740ce3f0 0x7f9c74138c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:16.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.882+0000 7f9c7a000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c7413f500 0x7f9c740b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:16.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.882+0000 7f9c7a000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c7413f8e0 0x7f9c740b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:16.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.882+0000 7f9c7a000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9c74072a40 con 0x7f9c7413f500 2024-05-28T06:13:16.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.882+0000 7f9c7a000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9c740728c0 con 0x7f9c7413f8e0 2024-05-28T06:13:16.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.882+0000 7f9c7a000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9c74072bc0 con 0x7f9c740ce3f0 2024-05-28T06:13:16.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.882+0000 7f9c73400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c740ce3f0 0x7f9c74138c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:16.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.882+0000 7f9c73400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c740ce3f0 0x7f9c74138c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:44378/0 (socket says 172.21.15.122:44378) 2024-05-28T06:13:16.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.882+0000 7f9c73400640 1 -- 172.21.15.122:0/3149682991 learned_addr learned my addr 172.21.15.122:0/3149682991 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:16.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.882+0000 7f9c73e00640 1 --2- 172.21.15.122:0/3149682991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c7413f8e0 0x7f9c740b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:16.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.882+0000 7f9c73400640 1 -- 172.21.15.122:0/3149682991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c7413f8e0 msgr2=0x7f9c740b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:16.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.882+0000 7f9c73400640 1 --2- 172.21.15.122:0/3149682991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c7413f8e0 0x7f9c740b2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:16.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.882+0000 7f9c73400640 1 -- 172.21.15.122:0/3149682991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c7413f500 msgr2=0x7f9c740b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:16.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.882+0000 7f9c73400640 1 --2- 172.21.15.122:0/3149682991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c7413f500 0x7f9c740b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:16.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.882+0000 7f9c73400640 1 -- 172.21.15.122:0/3149682991 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c74157650 con 0x7f9c740ce3f0 2024-05-28T06:13:16.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.886+0000 7f9c73400640 1 --2- 172.21.15.122:0/3149682991 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c740ce3f0 0x7f9c74138c70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9c6001cde0 tx=0x7f9c6001ad80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:16.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.886+0000 7f9c6b400640 1 -- 172.21.15.122:0/3149682991 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c600b0040 con 0x7f9c740ce3f0 2024-05-28T06:13:16.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.886+0000 7f9c6b400640 1 -- 172.21.15.122:0/3149682991 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c600bc070 con 0x7f9c740ce3f0 2024-05-28T06:13:16.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.886+0000 7f9c6b400640 1 -- 172.21.15.122:0/3149682991 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c600b6880 con 0x7f9c740ce3f0 2024-05-28T06:13:16.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.886+0000 7f9c7a000640 1 -- 172.21.15.122:0/3149682991 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c74157930 con 0x7f9c740ce3f0 2024-05-28T06:13:16.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.886+0000 7f9c7a000640 1 -- 172.21.15.122:0/3149682991 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c74157ef0 con 0x7f9c740ce3f0 2024-05-28T06:13:16.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.894+0000 7f9c6b400640 1 -- 172.21.15.122:0/3149682991 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 21) ==== 89109+0+0 (secure 0 0 0) 0x7f9c600ab4c0 con 0x7f9c740ce3f0 2024-05-28T06:13:16.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.894+0000 7f9c7a000640 1 -- 172.21.15.122:0/3149682991 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c74068c40 con 0x7f9c740ce3f0 2024-05-28T06:13:16.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.898+0000 7f9c6b400640 1 --2- 172.21.15.122:0/3149682991 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9c54069030 0x7f9c5406b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:16.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.898+0000 7f9c6b400640 1 -- 172.21.15.122:0/3149682991 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f9c6011f810 con 0x7f9c740ce3f0 2024-05-28T06:13:16.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.902+0000 7f9c72a00640 1 --2- 172.21.15.122:0/3149682991 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9c54069030 0x7f9c5406b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:16.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.902+0000 7f9c6b400640 1 -- 172.21.15.122:0/3149682991 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9c60016150 con 0x7f9c740ce3f0 2024-05-28T06:13:16.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:16.910+0000 7f9c72a00640 1 --2- 172.21.15.122:0/3149682991 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9c54069030 0x7f9c5406b4f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9c740cda90 tx=0x7f9c64008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:17.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:17.446+0000 7f9c7a000640 1 -- 172.21.15.122:0/3149682991 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone47515", "target": ["mon-mgr", ""]}) -- 0x7f9c7406e2b0 con 0x7f9c54069030 2024-05-28T06:13:18.401 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:13:18.406 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:13:18.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:18.506+0000 7f9c6b400640 1 -- 172.21.15.122:0/3149682991 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9c7406e2b0 con 0x7f9c54069030 2024-05-28T06:13:18.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:18.522+0000 7f9c7a000640 1 -- 172.21.15.122:0/3149682991 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9c54069030 msgr2=0x7f9c5406b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:18.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:18.522+0000 7f9c7a000640 1 --2- 172.21.15.122:0/3149682991 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9c54069030 0x7f9c5406b4f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9c740cda90 tx=0x7f9c64008040 comp rx=0 tx=0).stop 2024-05-28T06:13:18.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:18.522+0000 7f9c7a000640 1 -- 172.21.15.122:0/3149682991 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c740ce3f0 msgr2=0x7f9c74138c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:18.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:18.522+0000 7f9c7a000640 1 --2- 172.21.15.122:0/3149682991 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c740ce3f0 0x7f9c74138c70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9c6001cde0 tx=0x7f9c6001ad80 comp rx=0 tx=0).stop 2024-05-28T06:13:18.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:18.522+0000 7f9c7a000640 1 -- 172.21.15.122:0/3149682991 shutdown_connections 2024-05-28T06:13:18.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:18.522+0000 7f9c7a000640 1 --2- 172.21.15.122:0/3149682991 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9c54069030 0x7f9c5406b4f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:18.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:18.522+0000 7f9c7a000640 1 --2- 172.21.15.122:0/3149682991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c7413f8e0 0x7f9c740b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:18.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:18.522+0000 7f9c7a000640 1 --2- 172.21.15.122:0/3149682991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c7413f500 0x7f9c740b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:18.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:18.522+0000 7f9c7a000640 1 --2- 172.21.15.122:0/3149682991 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c740ce3f0 0x7f9c74138c70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:18.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:18.522+0000 7f9c7a000640 1 -- 172.21.15.122:0/3149682991 >> 172.21.15.122:0/3149682991 conn(0x7f9c740700f0 msgr2=0x7f9c74141890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:18.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:18.526+0000 7f9c7a000640 1 -- 172.21.15.122:0/3149682991 shutdown_connections 2024-05-28T06:13:18.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:18.526+0000 7f9c7a000640 1 -- 172.21.15.122:0/3149682991 wait complete. 2024-05-28T06:13:18.613 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone47516 2024-05-28T06:13:19.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.050+0000 7f4868c00640 1 Processor -- start 2024-05-28T06:13:19.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.050+0000 7f4868c00640 1 -- start start 2024-05-28T06:13:19.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.050+0000 7f4868c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f486409b080 0x7f48640b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:19.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.050+0000 7f4868c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48640d0bf0 con 0x7f4864160240 2024-05-28T06:13:19.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.050+0000 7f4868c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48640d0eb0 con 0x7f486409aca0 2024-05-28T06:13:19.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.050+0000 7f4868c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f48640b5460 con 0x7f486409b080 2024-05-28T06:13:19.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.050+0000 7f4862800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f486409b080 0x7f48640b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:19.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.050+0000 7f4862800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f486409b080 0x7f48640b35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:58478/0 (socket says 172.21.15.122:58478) 2024-05-28T06:13:19.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.054+0000 7f4862800640 1 -- 172.21.15.122:0/2259452500 learned_addr learned my addr 172.21.15.122:0/2259452500 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:19.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.054+0000 7f4862800640 1 -- 172.21.15.122:0/2259452500 >> v1:172.21.15.153:6789/0 conn(0x7f486409aca0 legacy=0x7f486415fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:19.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.054+0000 7f4862800640 1 -- 172.21.15.122:0/2259452500 >> v1:172.21.15.122:6789/0 conn(0x7f4864160240 legacy=0x7f48640b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:19.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.054+0000 7f4862800640 1 -- 172.21.15.122:0/2259452500 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48640d1190 con 0x7f486409b080 2024-05-28T06:13:19.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.062+0000 7f4862800640 1 --2- 172.21.15.122:0/2259452500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f486409b080 0x7f48640b35b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f485c009e50 tx=0x7f485c01c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=154cff478ee3b8ab server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:19.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.062+0000 7f4861400640 1 -- 172.21.15.122:0/2259452500 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c0a5780 con 0x7f486409b080 2024-05-28T06:13:19.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.062+0000 7f4861400640 1 -- 172.21.15.122:0/2259452500 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f485c0a5920 con 0x7f486409b080 2024-05-28T06:13:19.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.062+0000 7f4861400640 1 -- 172.21.15.122:0/2259452500 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c0a5cf0 con 0x7f486409b080 2024-05-28T06:13:19.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.066+0000 7f4868c00640 1 -- 172.21.15.122:0/2259452500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f486409b080 msgr2=0x7f48640b35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:19.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.066+0000 7f4868c00640 1 --2- 172.21.15.122:0/2259452500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f486409b080 0x7f48640b35b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f485c009e50 tx=0x7f485c01c9b0 comp rx=0 tx=0).stop 2024-05-28T06:13:19.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.066+0000 7f4868c00640 1 -- 172.21.15.122:0/2259452500 shutdown_connections 2024-05-28T06:13:19.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.066+0000 7f4868c00640 1 --2- 172.21.15.122:0/2259452500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f486409b080 0x7f48640b35b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:19.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.066+0000 7f4868c00640 1 -- 172.21.15.122:0/2259452500 >> 172.21.15.122:0/2259452500 conn(0x7f48640b4100 msgr2=0x7f48640b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:19.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.066+0000 7f4868c00640 1 -- 172.21.15.122:0/2259452500 shutdown_connections 2024-05-28T06:13:19.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.066+0000 7f4868c00640 1 -- 172.21.15.122:0/2259452500 wait complete. 2024-05-28T06:13:19.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.074+0000 7f4868c00640 1 Processor -- start 2024-05-28T06:13:19.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.078+0000 7f4868c00640 1 -- start start 2024-05-28T06:13:19.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.082+0000 7f4868c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f486409aca0 0x7f4864151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:19.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.082+0000 7f4868c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f486409b080 0x7f4864155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:19.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.082+0000 7f4868c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4864160240 0x7f4864158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:19.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.082+0000 7f4868c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f48640b6c20 con 0x7f4864160240 2024-05-28T06:13:19.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.082+0000 7f4868c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f48640b6aa0 con 0x7f486409aca0 2024-05-28T06:13:19.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.082+0000 7f4868c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4864168750 con 0x7f486409b080 2024-05-28T06:13:19.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.086+0000 7f485be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f486409b080 0x7f4864155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:19.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.086+0000 7f4861e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f486409aca0 0x7f4864151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:19.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.086+0000 7f4861e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f486409aca0 0x7f4864151830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:58492/0 (socket says 172.21.15.122:58492) 2024-05-28T06:13:19.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.086+0000 7f4861e00640 1 -- 172.21.15.122:0/2056507788 learned_addr learned my addr 172.21.15.122:0/2056507788 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:19.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.086+0000 7f485be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f486409b080 0x7f4864155310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:44384/0 (socket says 172.21.15.122:44384) 2024-05-28T06:13:19.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.086+0000 7f4862800640 1 --2- 172.21.15.122:0/2056507788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4864160240 0x7f4864158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:19.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.086+0000 7f4862800640 1 -- 172.21.15.122:0/2056507788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f486409b080 msgr2=0x7f4864155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:19.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.086+0000 7f4862800640 1 --2- 172.21.15.122:0/2056507788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f486409b080 0x7f4864155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:19.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.086+0000 7f4862800640 1 -- 172.21.15.122:0/2056507788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f486409aca0 msgr2=0x7f4864151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:19.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.086+0000 7f4862800640 1 --2- 172.21.15.122:0/2056507788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f486409aca0 0x7f4864151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:19.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.086+0000 7f4862800640 1 -- 172.21.15.122:0/2056507788 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4864151d70 con 0x7f4864160240 2024-05-28T06:13:19.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.086+0000 7f4861e00640 1 --2- 172.21.15.122:0/2056507788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f486409aca0 0x7f4864151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:13:19.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.090+0000 7f4862800640 1 --2- 172.21.15.122:0/2056507788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4864160240 0x7f4864158d00 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f485c0ab000 tx=0x7f485c019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:19.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.090+0000 7f485a000640 1 -- 172.21.15.122:0/2056507788 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c0b8470 con 0x7f4864160240 2024-05-28T06:13:19.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.090+0000 7f485a000640 1 -- 172.21.15.122:0/2056507788 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f485c0b8610 con 0x7f4864160240 2024-05-28T06:13:19.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.090+0000 7f485a000640 1 -- 172.21.15.122:0/2056507788 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c0b8a00 con 0x7f4864160240 2024-05-28T06:13:19.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.098+0000 7f4868c00640 1 -- 172.21.15.122:0/2056507788 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4864154270 con 0x7f4864160240 2024-05-28T06:13:19.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.098+0000 7f4868c00640 1 -- 172.21.15.122:0/2056507788 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4864154830 con 0x7f4864160240 2024-05-28T06:13:19.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.102+0000 7f485a000640 1 -- 172.21.15.122:0/2056507788 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 21) ==== 89109+0+0 (secure 0 0 0) 0x7f485c0c0020 con 0x7f4864160240 2024-05-28T06:13:19.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.106+0000 7f485a000640 1 --2- 172.21.15.122:0/2056507788 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4840069030 0x7f484006b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:19.105 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.106+0000 7f485a000640 1 -- 172.21.15.122:0/2056507788 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f485c11fca0 con 0x7f4864160240 2024-05-28T06:13:19.105 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.106+0000 7f4868c00640 1 -- 172.21.15.122:0/2056507788 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4864068c40 con 0x7f4864160240 2024-05-28T06:13:19.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.114+0000 7f485a000640 1 -- 172.21.15.122:0/2056507788 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f485c0165a0 con 0x7f4864160240 2024-05-28T06:13:19.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.118+0000 7f4861e00640 1 --2- 172.21.15.122:0/2056507788 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4840069030 0x7f484006b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:19.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.122+0000 7f4861e00640 1 --2- 172.21.15.122:0/2056507788 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4840069030 0x7f484006b4f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f48640b83b0 tx=0x7f484c003700 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:19.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:19.666+0000 7f4868c00640 1 -- 172.21.15.122:0/2056507788 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone47516", "target": ["mon-mgr", ""]}) -- 0x7f4864071740 con 0x7f4840069030 2024-05-28T06:13:20.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:20.774+0000 7f485a000640 1 -- 172.21.15.122:0/2056507788 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4864071740 con 0x7f4840069030 2024-05-28T06:13:20.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:20.790+0000 7f4868c00640 1 -- 172.21.15.122:0/2056507788 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4840069030 msgr2=0x7f484006b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:20.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:20.790+0000 7f4868c00640 1 --2- 172.21.15.122:0/2056507788 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4840069030 0x7f484006b4f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f48640b83b0 tx=0x7f484c003700 comp rx=0 tx=0).stop 2024-05-28T06:13:20.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:20.790+0000 7f4868c00640 1 -- 172.21.15.122:0/2056507788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4864160240 msgr2=0x7f4864158d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:20.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:20.790+0000 7f4868c00640 1 --2- 172.21.15.122:0/2056507788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4864160240 0x7f4864158d00 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f485c0ab000 tx=0x7f485c019750 comp rx=0 tx=0).stop 2024-05-28T06:13:20.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:20.794+0000 7f4868c00640 1 -- 172.21.15.122:0/2056507788 shutdown_connections 2024-05-28T06:13:20.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:20.794+0000 7f4868c00640 1 --2- 172.21.15.122:0/2056507788 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4840069030 0x7f484006b4f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:20.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:20.794+0000 7f4868c00640 1 --2- 172.21.15.122:0/2056507788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4864160240 0x7f4864158d00 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:20.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:20.794+0000 7f4868c00640 1 --2- 172.21.15.122:0/2056507788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f486409b080 0x7f4864155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:20.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:20.794+0000 7f4868c00640 1 --2- 172.21.15.122:0/2056507788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f486409aca0 0x7f4864151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:20.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:20.794+0000 7f4868c00640 1 -- 172.21.15.122:0/2056507788 >> 172.21.15.122:0/2056507788 conn(0x7f48640b4100 msgr2=0x7f48640d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:20.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:20.794+0000 7f4868c00640 1 -- 172.21.15.122:0/2056507788 shutdown_connections 2024-05-28T06:13:20.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:20.798+0000 7f4868c00640 1 -- 172.21.15.122:0/2056507788 wait complete. 2024-05-28T06:13:20.863 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone47517 2024-05-28T06:13:21.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.342+0000 7fabc5a00640 1 Processor -- start 2024-05-28T06:13:21.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.342+0000 7fabc5a00640 1 -- start start 2024-05-28T06:13:21.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.346+0000 7fabc5a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fabb8033e40 0x7fabb80eb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:21.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.346+0000 7fabc5a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabb8005ea0 0x7fabb80062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:21.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.346+0000 7fabc5a00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabb8034220 con 0x7fabb8047c20 2024-05-28T06:13:21.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.346+0000 7fabc5a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fabb8050210 con 0x7fabb8033e40 2024-05-28T06:13:21.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.346+0000 7fabc5a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fabb8037bc0 con 0x7fabb8005ea0 2024-05-28T06:13:21.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.346+0000 7fabbfe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fabb8033e40 0x7fabb80eb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:21.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.346+0000 7fabbfe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fabb8033e40 0x7fabb80eb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:58504/0 (socket says 172.21.15.122:58504) 2024-05-28T06:13:21.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.346+0000 7fabbfe00640 1 -- 172.21.15.122:0/506061510 learned_addr learned my addr 172.21.15.122:0/506061510 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:21.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.350+0000 7fabbfe00640 1 -- 172.21.15.122:0/506061510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabb8005ea0 msgr2=0x7fabb80062d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-28T06:13:21.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.350+0000 7fabbfe00640 1 --2- 172.21.15.122:0/506061510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabb8005ea0 0x7fabb80062d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:21.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.350+0000 7fabbfe00640 1 -- 172.21.15.122:0/506061510 >> v1:172.21.15.122:6789/0 conn(0x7fabb8047c20 legacy=0x7fabb80eb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:21.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.350+0000 7fabbfe00640 1 -- 172.21.15.122:0/506061510 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb804fa30 con 0x7fabb8033e40 2024-05-28T06:13:21.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.362+0000 7fabbfe00640 1 --2- 172.21.15.122:0/506061510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabb8033e40 0x7fabb80eb180 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fabac009870 tx=0x7fabac01ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=405646b6bf211cd8 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:21.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.366+0000 7fabbea00640 1 -- 172.21.15.122:0/506061510 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabac0b5070 con 0x7fabb8033e40 2024-05-28T06:13:21.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.366+0000 7fabbea00640 1 -- 172.21.15.122:0/506061510 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabac0a89f0 con 0x7fabb8033e40 2024-05-28T06:13:21.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.366+0000 7fabbea00640 1 -- 172.21.15.122:0/506061510 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabac0a8dc0 con 0x7fabb8033e40 2024-05-28T06:13:21.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.370+0000 7fabc5a00640 1 -- 172.21.15.122:0/506061510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabb8033e40 msgr2=0x7fabb80eb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:21.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.370+0000 7fabc5a00640 1 --2- 172.21.15.122:0/506061510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabb8033e40 0x7fabb80eb180 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fabac009870 tx=0x7fabac01ed30 comp rx=0 tx=0).stop 2024-05-28T06:13:21.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.374+0000 7fabc5a00640 1 -- 172.21.15.122:0/506061510 shutdown_connections 2024-05-28T06:13:21.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.378+0000 7fabc5a00640 1 --2- 172.21.15.122:0/506061510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabb8005ea0 0x7fabb80062d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:21.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.378+0000 7fabc5a00640 1 --2- 172.21.15.122:0/506061510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabb8033e40 0x7fabb80eb180 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:21.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.378+0000 7fabc5a00640 1 -- 172.21.15.122:0/506061510 >> 172.21.15.122:0/506061510 conn(0x7fabb8009fc0 msgr2=0x7fabb800a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:21.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.378+0000 7fabc5a00640 1 -- 172.21.15.122:0/506061510 shutdown_connections 2024-05-28T06:13:21.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.378+0000 7fabc5a00640 1 -- 172.21.15.122:0/506061510 wait complete. 2024-05-28T06:13:21.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.382+0000 7fabc5a00640 1 Processor -- start 2024-05-28T06:13:21.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.382+0000 7fabc5a00640 1 -- start start 2024-05-28T06:13:21.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.386+0000 7fabc5a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabb8005ea0 0x7fabb80ea1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:21.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.386+0000 7fabc5a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabb8033e40 0x7fabb80dd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:21.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.386+0000 7fabc5a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabb8047c20 0x7fabb80dc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:21.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.386+0000 7fabc5a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fabb804fd80 con 0x7fabb8033e40 2024-05-28T06:13:21.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.386+0000 7fabc5a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fabb804f090 con 0x7fabb8047c20 2024-05-28T06:13:21.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.386+0000 7fabc5a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fabb804f5c0 con 0x7fabb8005ea0 2024-05-28T06:13:21.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.386+0000 7fabbf400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabb8033e40 0x7fabb80dd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:21.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.386+0000 7fabbf400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabb8033e40 0x7fabb80dd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56726/0 (socket says 172.21.15.122:56726) 2024-05-28T06:13:21.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.386+0000 7fabbf400640 1 -- 172.21.15.122:0/1847370034 learned_addr learned my addr 172.21.15.122:0/1847370034 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:21.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.386+0000 7fabc5000640 1 --2- 172.21.15.122:0/1847370034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabb8047c20 0x7fabb80dc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:21.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.386+0000 7fabbfe00640 1 --2- 172.21.15.122:0/1847370034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabb8005ea0 0x7fabb80ea1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:21.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.386+0000 7fabc5000640 1 -- 172.21.15.122:0/1847370034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabb8005ea0 msgr2=0x7fabb80ea1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:21.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.386+0000 7fabc5000640 1 --2- 172.21.15.122:0/1847370034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabb8005ea0 0x7fabb80ea1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:21.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.386+0000 7fabc5000640 1 -- 172.21.15.122:0/1847370034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabb8033e40 msgr2=0x7fabb80dd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:21.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.390+0000 7fabc5000640 1 --2- 172.21.15.122:0/1847370034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabb8033e40 0x7fabb80dd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:21.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.390+0000 7fabc5000640 1 -- 172.21.15.122:0/1847370034 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb80ddf10 con 0x7fabb8047c20 2024-05-28T06:13:21.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.390+0000 7fabbf400640 1 --2- 172.21.15.122:0/1847370034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabb8033e40 0x7fabb80dd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:13:21.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.394+0000 7fabc5000640 1 --2- 172.21.15.122:0/1847370034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabb8047c20 0x7fabb80dc060 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fabc0051000 tx=0x7fabc00695a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:21.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.398+0000 7fabb3e00640 1 -- 172.21.15.122:0/1847370034 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc008f070 con 0x7fabb8047c20 2024-05-28T06:13:21.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.398+0000 7fabb3e00640 1 -- 172.21.15.122:0/1847370034 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc0063280 con 0x7fabb8047c20 2024-05-28T06:13:21.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.398+0000 7fabb3e00640 1 -- 172.21.15.122:0/1847370034 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc0075580 con 0x7fabb8047c20 2024-05-28T06:13:21.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.398+0000 7fabc5a00640 1 -- 172.21.15.122:0/1847370034 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb80de1f0 con 0x7fabb8047c20 2024-05-28T06:13:21.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.398+0000 7fabc5a00640 1 -- 172.21.15.122:0/1847370034 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb80de7b0 con 0x7fabb8047c20 2024-05-28T06:13:21.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.398+0000 7fabb3e00640 1 -- 172.21.15.122:0/1847370034 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 21) ==== 89109+0+0 (secure 0 0 0) 0x7fabc0075720 con 0x7fabb8047c20 2024-05-28T06:13:21.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.402+0000 7fabb3e00640 1 --2- 172.21.15.122:0/1847370034 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7faba00690b0 0x7faba006b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:21.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.402+0000 7fabb3e00640 1 -- 172.21.15.122:0/1847370034 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7fabc00ffea0 con 0x7fabb8047c20 2024-05-28T06:13:21.406 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.402+0000 7fabc5a00640 1 -- 172.21.15.122:0/1847370034 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb80053a0 con 0x7fabb8047c20 2024-05-28T06:13:21.411 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.410+0000 7fabbfe00640 1 --2- 172.21.15.122:0/1847370034 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7faba00690b0 0x7faba006b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:21.417 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.418+0000 7fabb3e00640 1 -- 172.21.15.122:0/1847370034 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fabc00d1eb0 con 0x7fabb8047c20 2024-05-28T06:13:21.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:21.426+0000 7fabbfe00640 1 --2- 172.21.15.122:0/1847370034 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7faba00690b0 0x7faba006b570 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fabac0b2000 tx=0x7fabac0aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:22.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:22.066+0000 7fabc5a00640 1 -- 172.21.15.122:0/1847370034 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone47517", "target": ["mon-mgr", ""]}) -- 0x7fabb80dc5a0 con 0x7faba00690b0 2024-05-28T06:13:24.067 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.066+0000 7fabb3e00640 1 -- 172.21.15.122:0/1847370034 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fabb80dc5a0 con 0x7faba00690b0 2024-05-28T06:13:24.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.086+0000 7fabc5a00640 1 -- 172.21.15.122:0/1847370034 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7faba00690b0 msgr2=0x7faba006b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:24.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.086+0000 7fabc5a00640 1 --2- 172.21.15.122:0/1847370034 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7faba00690b0 0x7faba006b570 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fabac0b2000 tx=0x7fabac0aa070 comp rx=0 tx=0).stop 2024-05-28T06:13:24.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.086+0000 7fabc5a00640 1 -- 172.21.15.122:0/1847370034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabb8047c20 msgr2=0x7fabb80dc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:24.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.086+0000 7fabc5a00640 1 --2- 172.21.15.122:0/1847370034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabb8047c20 0x7fabb80dc060 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fabc0051000 tx=0x7fabc00695a0 comp rx=0 tx=0).stop 2024-05-28T06:13:24.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.086+0000 7fabc5a00640 1 -- 172.21.15.122:0/1847370034 shutdown_connections 2024-05-28T06:13:24.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.086+0000 7fabc5a00640 1 --2- 172.21.15.122:0/1847370034 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7faba00690b0 0x7faba006b570 secure :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fabac0b2000 tx=0x7fabac0aa070 comp rx=0 tx=0).stop 2024-05-28T06:13:24.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.086+0000 7fabc5a00640 1 --2- 172.21.15.122:0/1847370034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabb8047c20 0x7fabb80dc060 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:24.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.086+0000 7fabc5a00640 1 --2- 172.21.15.122:0/1847370034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabb8033e40 0x7fabb80dd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:24.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.086+0000 7fabc5a00640 1 --2- 172.21.15.122:0/1847370034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabb8005ea0 0x7fabb80ea1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:24.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.086+0000 7fabc5a00640 1 -- 172.21.15.122:0/1847370034 >> 172.21.15.122:0/1847370034 conn(0x7fabb8009fc0 msgr2=0x7fabb8006c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:24.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.086+0000 7fabc5a00640 1 -- 172.21.15.122:0/1847370034 shutdown_connections 2024-05-28T06:13:24.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.086+0000 7fabc5a00640 1 -- 172.21.15.122:0/1847370034 wait complete. 2024-05-28T06:13:24.196 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:13:24.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.594+0000 7fdf73000640 1 Processor -- start 2024-05-28T06:13:24.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.594+0000 7fdf73000640 1 -- start start 2024-05-28T06:13:24.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.594+0000 7fdf73000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdf6c073c80 0x7fdf6c0d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:24.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.594+0000 7fdf73000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf6c0b46c0 con 0x7fdf6c15ea20 2024-05-28T06:13:24.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.594+0000 7fdf73000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf6c0b49a0 con 0x7fdf6c0b36b0 2024-05-28T06:13:24.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.594+0000 7fdf73000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fdf6c15ee00 con 0x7fdf6c073c80 2024-05-28T06:13:24.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.594+0000 7fdf6b400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdf6c073c80 0x7fdf6c0d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:24.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.594+0000 7fdf6b400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdf6c073c80 0x7fdf6c0d0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56736/0 (socket says 172.21.15.122:56736) 2024-05-28T06:13:24.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.594+0000 7fdf6b400640 1 -- 172.21.15.122:0/301899667 learned_addr learned my addr 172.21.15.122:0/301899667 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:24.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.598+0000 7fdf6b400640 1 -- 172.21.15.122:0/301899667 >> v1:172.21.15.153:6789/0 conn(0x7fdf6c0b36b0 legacy=0x7fdf6c0ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:24.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.598+0000 7fdf6b400640 1 -- 172.21.15.122:0/301899667 >> v1:172.21.15.122:6789/0 conn(0x7fdf6c15ea20 legacy=0x7fdf6c0b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:24.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.598+0000 7fdf6b400640 1 -- 172.21.15.122:0/301899667 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf6c0d1e50 con 0x7fdf6c073c80 2024-05-28T06:13:24.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.602+0000 7fdf6b400640 1 --2- 172.21.15.122:0/301899667 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf6c073c80 0x7fdf6c0d0e10 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fdf58009870 tx=0x7fdf5801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ecb5a4cd636c01 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:24.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.602+0000 7fdf6aa00640 1 -- 172.21.15.122:0/301899667 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf580b0070 con 0x7fdf6c073c80 2024-05-28T06:13:24.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.602+0000 7fdf6aa00640 1 -- 172.21.15.122:0/301899667 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf580ab600 con 0x7fdf6c073c80 2024-05-28T06:13:24.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.602+0000 7fdf6aa00640 1 -- 172.21.15.122:0/301899667 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf580ab9d0 con 0x7fdf6c073c80 2024-05-28T06:13:24.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.602+0000 7fdf73000640 1 -- 172.21.15.122:0/301899667 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf6c073c80 msgr2=0x7fdf6c0d0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:24.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.602+0000 7fdf73000640 1 --2- 172.21.15.122:0/301899667 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf6c073c80 0x7fdf6c0d0e10 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fdf58009870 tx=0x7fdf5801c520 comp rx=0 tx=0).stop 2024-05-28T06:13:24.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.602+0000 7fdf73000640 1 -- 172.21.15.122:0/301899667 shutdown_connections 2024-05-28T06:13:24.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.602+0000 7fdf73000640 1 --2- 172.21.15.122:0/301899667 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf6c073c80 0x7fdf6c0d0e10 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:24.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.602+0000 7fdf73000640 1 -- 172.21.15.122:0/301899667 >> 172.21.15.122:0/301899667 conn(0x7fdf6c0b6c10 msgr2=0x7fdf6c0b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:24.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.602+0000 7fdf73000640 1 -- 172.21.15.122:0/301899667 shutdown_connections 2024-05-28T06:13:24.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.602+0000 7fdf73000640 1 -- 172.21.15.122:0/301899667 wait complete. 2024-05-28T06:13:24.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.606+0000 7fdf73000640 1 Processor -- start 2024-05-28T06:13:24.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.606+0000 7fdf73000640 1 -- start start 2024-05-28T06:13:24.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.606+0000 7fdf73000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf6c073c80 0x7fdf6c169aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:24.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.606+0000 7fdf73000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf6c0b36b0 0x7fdf6c156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:24.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.606+0000 7fdf73000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf6c15ea20 0x7fdf6c151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:24.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.606+0000 7fdf73000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6c16cd30 con 0x7fdf6c15ea20 2024-05-28T06:13:24.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.606+0000 7fdf73000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6c0b56d0 con 0x7fdf6c0b36b0 2024-05-28T06:13:24.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.606+0000 7fdf73000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdf6c16ceb0 con 0x7fdf6c073c80 2024-05-28T06:13:24.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.610+0000 7fdf71000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf6c15ea20 0x7fdf6c151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:24.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.610+0000 7fdf71000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf6c15ea20 0x7fdf6c151960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56746/0 (socket says 172.21.15.122:56746) 2024-05-28T06:13:24.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.610+0000 7fdf71000640 1 -- 172.21.15.122:0/1236164031 learned_addr learned my addr 172.21.15.122:0/1236164031 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:24.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.610+0000 7fdf6b400640 1 --2- 172.21.15.122:0/1236164031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf6c0b36b0 0x7fdf6c156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:24.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.610+0000 7fdf6be00640 1 --2- 172.21.15.122:0/1236164031 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf6c073c80 0x7fdf6c169aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:24.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.610+0000 7fdf71000640 1 -- 172.21.15.122:0/1236164031 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf6c073c80 msgr2=0x7fdf6c169aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:24.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.610+0000 7fdf71000640 1 --2- 172.21.15.122:0/1236164031 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf6c073c80 0x7fdf6c169aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:24.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.610+0000 7fdf71000640 1 -- 172.21.15.122:0/1236164031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf6c0b36b0 msgr2=0x7fdf6c156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:24.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.610+0000 7fdf71000640 1 --2- 172.21.15.122:0/1236164031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf6c0b36b0 0x7fdf6c156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:24.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.610+0000 7fdf71000640 1 -- 172.21.15.122:0/1236164031 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf6c14f650 con 0x7fdf6c15ea20 2024-05-28T06:13:24.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.610+0000 7fdf6be00640 1 --2- 172.21.15.122:0/1236164031 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf6c073c80 0x7fdf6c169aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:13:24.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.614+0000 7fdf71000640 1 --2- 172.21.15.122:0/1236164031 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf6c15ea20 0x7fdf6c151960 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400c780 tx=0x7fdf6400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:24.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.614+0000 7fdf63e00640 1 -- 172.21.15.122:0/1236164031 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf64004b70 con 0x7fdf6c15ea20 2024-05-28T06:13:24.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.618+0000 7fdf63e00640 1 -- 172.21.15.122:0/1236164031 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf64004d10 con 0x7fdf6c15ea20 2024-05-28T06:13:24.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.618+0000 7fdf63e00640 1 -- 172.21.15.122:0/1236164031 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6400aa90 con 0x7fdf6c15ea20 2024-05-28T06:13:24.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.618+0000 7fdf73000640 1 -- 172.21.15.122:0/1236164031 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf6c1530e0 con 0x7fdf6c15ea20 2024-05-28T06:13:24.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.622+0000 7fdf73000640 1 -- 172.21.15.122:0/1236164031 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf6c1536a0 con 0x7fdf6c15ea20 2024-05-28T06:13:24.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.626+0000 7fdf73000640 1 -- 172.21.15.122:0/1236164031 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf6c068c40 con 0x7fdf6c15ea20 2024-05-28T06:13:24.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.626+0000 7fdf63e00640 1 -- 172.21.15.122:0/1236164031 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 21) ==== 89109+0+0 (secure 0 0 0) 0x7fdf6400ac30 con 0x7fdf6c15ea20 2024-05-28T06:13:24.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.630+0000 7fdf63e00640 1 --2- 172.21.15.122:0/1236164031 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdf4c0690b0 0x7fdf4c06b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:24.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.630+0000 7fdf63e00640 1 -- 172.21.15.122:0/1236164031 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7fdf64085640 con 0x7fdf6c15ea20 2024-05-28T06:13:24.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.634+0000 7fdf6be00640 1 --2- 172.21.15.122:0/1236164031 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdf4c0690b0 0x7fdf4c06b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:24.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.634+0000 7fdf6be00640 1 --2- 172.21.15.122:0/1236164031 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdf4c0690b0 0x7fdf4c06b570 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c001650 tx=0x7fdf5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:24.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:24.642+0000 7fdf63e00640 1 -- 172.21.15.122:0/1236164031 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdf64020070 con 0x7fdf6c15ea20 2024-05-28T06:13:25.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.250+0000 7fdf73000640 1 -- 172.21.15.122:0/1236164031 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fdf6c0cd6b0 con 0x7fdf6c15ea20 2024-05-28T06:13:25.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.254+0000 7fdf63e00640 1 -- 172.21.15.122:0/1236164031 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2399 (secure 0 0 0) 0x7fdf64057650 con 0x7fdf6c15ea20 2024-05-28T06:13:25.252 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:13:25.252 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:13:25.252 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:13:25.252 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:13:25.252 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:13:25.252 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:13:25.252 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:13:25.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:25.252 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:13:25.252 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:13:25.252 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:13:25.252 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:13:25.253 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:13:25.253 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:25.253 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:13:25.253 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:13:25.253 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:13:25.253 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:13:25.253 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:25.253 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 481, 2024-05-28T06:13:25.253 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:13:25.253 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:13:25.253 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:13:25.253 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:13:25.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:25.253 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:13:25.254 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 62, 2024-05-28T06:13:25.254 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:13:25.254 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:13:25.254 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:13:25.254 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:13:25.254 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:13:25.254 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:13:25.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:25.254 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:13:25.254 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:13:25.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:13:25.254 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:13:25.254 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:13:25.255 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:13:25.255 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:25.255 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:13:25.255 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:13:25.255 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 2385, 2024-05-28T06:13:25.255 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 9857975464, 2024-05-28T06:13:25.255 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 19365961728, 2024-05-28T06:13:25.255 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 753728151552, 2024-05-28T06:13:25.255 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:13:25.255 INFO:teuthology.orchestra.run.smithi122.stdout: "read_bytes_sec": 566535756, 2024-05-28T06:13:25.255 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 579506057, 2024-05-28T06:13:25.255 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 137, 2024-05-28T06:13:25.256 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 156 2024-05-28T06:13:25.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:25.256 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:13:25.256 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 38, 2024-05-28T06:13:25.256 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 4, 2024-05-28T06:13:25.256 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:13:25.256 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:13:25.256 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:13:25.256 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:13:25.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:13:25.256 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 4, 2024-05-28T06:13:25.256 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:13:25.256 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "c", 2024-05-28T06:13:25.256 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:13:25.257 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 6300 2024-05-28T06:13:25.257 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:13:25.257 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:25.257 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:13:25.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:25.257 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:13:25.257 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:13:25.257 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:13:25.257 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:13:25.257 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:13:25.257 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:13:25.257 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:13:25.258 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:25.258 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:13:25.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:25.258 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:13:25.258 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 8, 2024-05-28T06:13:25.258 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:10:43.307303+0000", 2024-05-28T06:13:25.258 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:13:25.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:25.258 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:13:25.258 INFO:teuthology.orchestra.run.smithi122.stdout: "d99f5b57-79d0-4ca8-9bc6-54c2cbc59c2a": { 2024-05-28T06:13:25.258 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "5 ongoing+pending clones; Avg progress is 29.01% (0s)\n [========....................] ", 2024-05-28T06:13:25.258 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.29010000824928284, 2024-05-28T06:13:25.258 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:13:25.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:25.259 INFO:teuthology.orchestra.run.smithi122.stdout: "f6823e37-281c-440e-aebe-a3bb39be0858": { 2024-05-28T06:13:25.259 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "4 ongoing clones; Avg progress is 23.307% (7s)\n [======......................] (remaining: 23s)", 2024-05-28T06:13:25.259 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.2330700010061264, 2024-05-28T06:13:25.259 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:13:25.259 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:13:25.259 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:13:25.259 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:13:25.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.258+0000 7fdf73000640 1 -- 172.21.15.122:0/1236164031 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdf4c0690b0 msgr2=0x7fdf4c06b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:25.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.258+0000 7fdf73000640 1 --2- 172.21.15.122:0/1236164031 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdf4c0690b0 0x7fdf4c06b570 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c001650 tx=0x7fdf5c009040 comp rx=0 tx=0).stop 2024-05-28T06:13:25.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.258+0000 7fdf73000640 1 -- 172.21.15.122:0/1236164031 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf6c15ea20 msgr2=0x7fdf6c151960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:25.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.258+0000 7fdf73000640 1 --2- 172.21.15.122:0/1236164031 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf6c15ea20 0x7fdf6c151960 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400c780 tx=0x7fdf6400cc40 comp rx=0 tx=0).stop 2024-05-28T06:13:25.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.258+0000 7fdf73000640 1 -- 172.21.15.122:0/1236164031 shutdown_connections 2024-05-28T06:13:25.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.258+0000 7fdf73000640 1 --2- 172.21.15.122:0/1236164031 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fdf4c0690b0 0x7fdf4c06b570 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:25.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.258+0000 7fdf73000640 1 --2- 172.21.15.122:0/1236164031 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf6c15ea20 0x7fdf6c151960 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:25.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.258+0000 7fdf73000640 1 --2- 172.21.15.122:0/1236164031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf6c0b36b0 0x7fdf6c156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:25.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.258+0000 7fdf73000640 1 --2- 172.21.15.122:0/1236164031 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf6c073c80 0x7fdf6c169aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:25.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.258+0000 7fdf73000640 1 -- 172.21.15.122:0/1236164031 >> 172.21.15.122:0/1236164031 conn(0x7fdf6c0b6c10 msgr2=0x7fdf6c0b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:25.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.258+0000 7fdf73000640 1 -- 172.21.15.122:0/1236164031 shutdown_connections 2024-05-28T06:13:25.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.258+0000 7fdf73000640 1 -- 172.21.15.122:0/1236164031 wait complete. 2024-05-28T06:13:25.320 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone47511 2024-05-28T06:13:25.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.886+0000 7f70ada00640 1 Processor -- start 2024-05-28T06:13:25.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.886+0000 7f70ada00640 1 -- start start 2024-05-28T06:13:25.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.890+0000 7f70ada00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f70a815fd30 0x7f70a80b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:25.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.890+0000 7f70ada00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f70a80d0010 0x7f70a80d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:25.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.890+0000 7f70ada00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70a80c5f90 0x7f70a80c6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:25.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.890+0000 7f70ada00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f70a8160110 con 0x7f70a815fd30 2024-05-28T06:13:25.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.890+0000 7f70ada00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f70a80d0be0 con 0x7f70a80d0010 2024-05-28T06:13:25.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.890+0000 7f70ada00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f70a80d0ec0 con 0x7f70a80c5f90 2024-05-28T06:13:25.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.890+0000 7f70a7e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f70a815fd30 0x7f70a80b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:25.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.890+0000 7f70a7e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f70a815fd30 0x7f70a80b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57194/0 (socket says 172.21.15.122:57194) 2024-05-28T06:13:25.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.890+0000 7f70a7e00640 1 -- 172.21.15.122:0/3304895732 learned_addr learned my addr 172.21.15.122:0/3304895732 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:25.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.890+0000 7f70a7400640 1 --2- 172.21.15.122:0/3304895732 >> v2:172.21.15.153:3300/0 conn(0x7f70a80d0010 0x7f70a80d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:25.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.894+0000 7f70ad000640 1 --2- 172.21.15.122:0/3304895732 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70a80c5f90 0x7f70a80c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:25.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.894+0000 7f70a7e00640 1 -- 172.21.15.122:0/3304895732 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70a80c5f90 msgr2=0x7f70a80c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:25.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.894+0000 7f70a7e00640 1 --2- 172.21.15.122:0/3304895732 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70a80c5f90 0x7f70a80c6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:25.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.894+0000 7f70a7e00640 1 -- 172.21.15.122:0/3304895732 >> v2:172.21.15.153:3300/0 conn(0x7f70a80d0010 msgr2=0x7f70a80d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:25.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.894+0000 7f70a7e00640 1 --2- 172.21.15.122:0/3304895732 >> v2:172.21.15.153:3300/0 conn(0x7f70a80d0010 0x7f70a80d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:25.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.894+0000 7f70a7e00640 1 -- 172.21.15.122:0/3304895732 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a809b4f0 con 0x7f70a815fd30 2024-05-28T06:13:25.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.898+0000 7f70a7e00640 1 --2- 172.21.15.122:0/3304895732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70a815fd30 0x7f70a80b32b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f70a80d1980 tx=0x7f709801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7697973bda6e4fb server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:25.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.922+0000 7f70a6a00640 1 -- 172.21.15.122:0/3304895732 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70980b0070 con 0x7f70a815fd30 2024-05-28T06:13:25.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.922+0000 7f70a6a00640 1 -- 172.21.15.122:0/3304895732 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70980ab600 con 0x7f70a815fd30 2024-05-28T06:13:25.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.922+0000 7f70a6a00640 1 -- 172.21.15.122:0/3304895732 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70980ab9d0 con 0x7f70a815fd30 2024-05-28T06:13:25.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.922+0000 7f70ada00640 1 -- 172.21.15.122:0/3304895732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70a815fd30 msgr2=0x7f70a80b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:25.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.922+0000 7f70ada00640 1 --2- 172.21.15.122:0/3304895732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70a815fd30 0x7f70a80b32b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f70a80d1980 tx=0x7f709801c520 comp rx=0 tx=0).stop 2024-05-28T06:13:25.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.938+0000 7f70ada00640 1 -- 172.21.15.122:0/3304895732 shutdown_connections 2024-05-28T06:13:25.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.938+0000 7f70ada00640 1 --2- 172.21.15.122:0/3304895732 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70a80c5f90 0x7f70a80c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:25.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.938+0000 7f70ada00640 1 --2- 172.21.15.122:0/3304895732 >> v2:172.21.15.153:3300/0 conn(0x7f70a80d0010 0x7f70a80d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:25.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.938+0000 7f70ada00640 1 --2- 172.21.15.122:0/3304895732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70a815fd30 0x7f70a80b32b0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:25.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.938+0000 7f70ada00640 1 -- 172.21.15.122:0/3304895732 >> 172.21.15.122:0/3304895732 conn(0x7f70a80b3f30 msgr2=0x7f70a80b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:25.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.942+0000 7f70ada00640 1 -- 172.21.15.122:0/3304895732 shutdown_connections 2024-05-28T06:13:25.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.946+0000 7f70ada00640 1 -- 172.21.15.122:0/3304895732 wait complete. 2024-05-28T06:13:25.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.962+0000 7f70ada00640 1 Processor -- start 2024-05-28T06:13:25.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.962+0000 7f70ada00640 1 -- start start 2024-05-28T06:13:25.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.962+0000 7f70ada00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70a80c5f90 0x7f70a8207510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:25.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.962+0000 7f70ada00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70a80d0010 0x7f70a80caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:25.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.962+0000 7f70ada00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70a815fd30 0x7f70a80c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:25.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.966+0000 7f70ada00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f70a80d1320 con 0x7f70a815fd30 2024-05-28T06:13:25.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.966+0000 7f70a7e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70a80c5f90 0x7f70a8207510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:25.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.966+0000 7f70a7e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70a80c5f90 0x7f70a8207510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:42400/0 (socket says 172.21.15.122:42400) 2024-05-28T06:13:25.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.966+0000 7f70a7e00640 1 -- 172.21.15.122:0/2859559849 learned_addr learned my addr 172.21.15.122:0/2859559849 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:25.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.966+0000 7f70ada00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f70a80d11a0 con 0x7f70a80c5f90 2024-05-28T06:13:25.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.966+0000 7f70ada00640 1 -- 172.21.15.122:0/2859559849 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f70a809bcf0 con 0x7f70a80d0010 2024-05-28T06:13:25.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.966+0000 7f70ad000640 1 --2- 172.21.15.122:0/2859559849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70a815fd30 0x7f70a80c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:25.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.970+0000 7f70a7e00640 1 -- 172.21.15.122:0/2859559849 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70a80d0010 msgr2=0x7f70a80caf70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-28T06:13:25.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.970+0000 7f70a7e00640 1 --2- 172.21.15.122:0/2859559849 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70a80d0010 0x7f70a80caf70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:25.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.970+0000 7f70a7e00640 1 -- 172.21.15.122:0/2859559849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70a815fd30 msgr2=0x7f70a80c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:25.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.970+0000 7f70a7e00640 1 --2- 172.21.15.122:0/2859559849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70a815fd30 0x7f70a80c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:25.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.970+0000 7f70a7e00640 1 -- 172.21.15.122:0/2859559849 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a80cb800 con 0x7f70a80c5f90 2024-05-28T06:13:25.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.970+0000 7f70a7e00640 1 --2- 172.21.15.122:0/2859559849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70a80c5f90 0x7f70a8207510 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f70980ae040 tx=0x7f709801ad60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:25.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.974+0000 7f709fe00640 1 -- 172.21.15.122:0/2859559849 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70980b0040 con 0x7f70a80c5f90 2024-05-28T06:13:25.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.974+0000 7f709fe00640 1 -- 172.21.15.122:0/2859559849 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70980bc070 con 0x7f70a80c5f90 2024-05-28T06:13:25.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.974+0000 7f709fe00640 1 -- 172.21.15.122:0/2859559849 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70980b6680 con 0x7f70a80c5f90 2024-05-28T06:13:25.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.974+0000 7f70ada00640 1 -- 172.21.15.122:0/2859559849 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70a80cbae0 con 0x7f70a80c5f90 2024-05-28T06:13:25.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.978+0000 7f70ada00640 1 -- 172.21.15.122:0/2859559849 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70a814b0d0 con 0x7f70a80c5f90 2024-05-28T06:13:25.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:25.982+0000 7f70ada00640 1 -- 172.21.15.122:0/2859559849 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70a814b2d0 con 0x7f70a80c5f90 2024-05-28T06:13:26.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:26.002+0000 7f709fe00640 1 -- 172.21.15.122:0/2859559849 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 21) ==== 89109+0+0 (secure 0 0 0) 0x7f70980b6820 con 0x7f70a80c5f90 2024-05-28T06:13:26.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:26.002+0000 7f709fe00640 1 --2- 172.21.15.122:0/2859559849 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7088069030 0x7f708806b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:26.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:26.010+0000 7f709fe00640 1 -- 172.21.15.122:0/2859559849 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f7098120080 con 0x7f70a80c5f90 2024-05-28T06:13:26.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:26.010+0000 7f70a7400640 1 --2- 172.21.15.122:0/2859559849 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7088069030 0x7f708806b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:26.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:26.022+0000 7f709fe00640 1 -- 172.21.15.122:0/2859559849 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7098016110 con 0x7f70a80c5f90 2024-05-28T06:13:26.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:26.030+0000 7f70a7400640 1 --2- 172.21.15.122:0/2859559849 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7088069030 0x7f708806b4f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f70a80b8470 tx=0x7f7094009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:26.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:26.594+0000 7f70ada00640 1 -- 172.21.15.122:0/2859559849 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone47511", "target": ["mon-mgr", ""]}) -- 0x7f70a8075620 con 0x7f7088069030 2024-05-28T06:13:26.698 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:26.698+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:26.698 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:26.698+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:26.699 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:26.698+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:26.699 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:26.698+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:26.699 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:26.698+0000 7f9de7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-28T06:13:27.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:27.594+0000 7f709fe00640 1 -- 172.21.15.122:0/2859559849 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mgrmap(e 22) ==== 89160+0+0 (secure 0 0 0) 0x7f70980ee100 con 0x7f70a80c5f90 2024-05-28T06:13:28.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.290+0000 7f709fe00640 1 -- 172.21.15.122:0/2859559849 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f70a8075620 con 0x7f7088069030 2024-05-28T06:13:28.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.294+0000 7f70ada00640 1 -- 172.21.15.122:0/2859559849 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7088069030 msgr2=0x7f708806b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:28.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.294+0000 7f70ada00640 1 --2- 172.21.15.122:0/2859559849 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7088069030 0x7f708806b4f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f70a80b8470 tx=0x7f7094009190 comp rx=0 tx=0).stop 2024-05-28T06:13:28.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.294+0000 7f70ada00640 1 -- 172.21.15.122:0/2859559849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70a80c5f90 msgr2=0x7f70a8207510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:28.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.294+0000 7f70ada00640 1 --2- 172.21.15.122:0/2859559849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70a80c5f90 0x7f70a8207510 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f70980ae040 tx=0x7f709801ad60 comp rx=0 tx=0).stop 2024-05-28T06:13:28.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.294+0000 7f70ada00640 1 -- 172.21.15.122:0/2859559849 shutdown_connections 2024-05-28T06:13:28.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.294+0000 7f70ada00640 1 --2- 172.21.15.122:0/2859559849 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7088069030 0x7f708806b4f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:28.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.294+0000 7f70ada00640 1 --2- 172.21.15.122:0/2859559849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70a815fd30 0x7f70a80c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:28.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.294+0000 7f70ada00640 1 --2- 172.21.15.122:0/2859559849 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70a80d0010 0x7f70a80caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:28.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.294+0000 7f70ada00640 1 --2- 172.21.15.122:0/2859559849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70a80c5f90 0x7f70a8207510 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:28.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.294+0000 7f70ada00640 1 -- 172.21.15.122:0/2859559849 >> 172.21.15.122:0/2859559849 conn(0x7f70a80b3f30 msgr2=0x7f70a80ce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:28.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.294+0000 7f70ada00640 1 -- 172.21.15.122:0/2859559849 shutdown_connections 2024-05-28T06:13:28.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.294+0000 7f70ada00640 1 -- 172.21.15.122:0/2859559849 wait complete. 2024-05-28T06:13:28.369 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone47512 2024-05-28T06:13:28.370 INFO:tasks.ceph.mgr.y.smithi122.stderr:Exception in thread Thread-9: 2024-05-28T06:13:28.370 INFO:tasks.ceph.mgr.y.smithi122.stderr:Traceback (most recent call last): 2024-05-28T06:13:28.370 INFO:tasks.ceph.mgr.y.smithi122.stderr: File "/usr/share/ceph/mgr/volumes/fs/operations/versions/subvolume_v1.py", line 660, in _get_clone_source 2024-05-28T06:13:28.370 INFO:tasks.ceph.mgr.y.smithi122.stderr: 'volume' : self.metadata_mgr.get_option("source", "volume"), 2024-05-28T06:13:28.371 INFO:tasks.ceph.mgr.y.smithi122.stderr: File "/usr/share/ceph/mgr/volumes/fs/operations/versions/metadata_manager.py", line 159, in get_option 2024-05-28T06:13:28.371 INFO:tasks.ceph.mgr.y.smithi122.stderr: raise MetadataMgrException(-errno.ENOENT, "section '{0}' does not exist".format(section)) 2024-05-28T06:13:28.371 INFO:tasks.ceph.mgr.y.smithi122.stderr:volumes.fs.exception.MetadataMgrException: -2 (section 'source' does not exist) 2024-05-28T06:13:28.371 INFO:tasks.ceph.mgr.y.smithi122.stderr: 2024-05-28T06:13:28.371 INFO:tasks.ceph.mgr.y.smithi122.stderr:During handling of the above exception, another exception occurred: 2024-05-28T06:13:28.371 INFO:tasks.ceph.mgr.y.smithi122.stderr: 2024-05-28T06:13:28.371 INFO:tasks.ceph.mgr.y.smithi122.stderr:Traceback (most recent call last): 2024-05-28T06:13:28.371 INFO:tasks.ceph.mgr.y.smithi122.stderr: File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner 2024-05-28T06:13:28.388 INFO:tasks.ceph.mgr.y.smithi122.stderr: self.run() 2024-05-28T06:13:28.388 INFO:tasks.ceph.mgr.y.smithi122.stderr: File "/usr/share/ceph/mgr/mgr_util.py", line 82, in run 2024-05-28T06:13:28.388 INFO:tasks.ceph.mgr.y.smithi122.stderr: self.function(*self.args, **self.kwargs) 2024-05-28T06:13:28.388 INFO:tasks.ceph.mgr.y.smithi122.stderr: File "/usr/share/ceph/mgr/volumes/fs/stats_util.py", line 262, in _update_progress_bars 2024-05-28T06:13:28.388 INFO:tasks.ceph.mgr.y.smithi122.stderr: clones = self._get_info_for_all_clones() 2024-05-28T06:13:28.388 INFO:tasks.ceph.mgr.y.smithi122.stderr: File "/usr/share/ceph/mgr/volumes/fs/stats_util.py", line 158, in _get_info_for_all_clones 2024-05-28T06:13:28.388 INFO:tasks.ceph.mgr.y.smithi122.stderr: self._get_clone_src_info(fsh, ci) 2024-05-28T06:13:28.388 INFO:tasks.ceph.mgr.y.smithi122.stderr: File "/usr/share/ceph/mgr/volumes/fs/stats_util.py", line 135, in _get_clone_src_info 2024-05-28T06:13:28.388 INFO:tasks.ceph.mgr.y.smithi122.stderr: with open_clone_sv_pair_in_vol( 2024-05-28T06:13:28.388 INFO:tasks.ceph.mgr.y.smithi122.stderr: File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ 2024-05-28T06:13:28.396 INFO:tasks.ceph.mgr.y.smithi122.stderr: return next(self.gen) 2024-05-28T06:13:28.396 INFO:tasks.ceph.mgr.y.smithi122.stderr: File "/usr/share/ceph/mgr/volumes/fs/operations/subvolume.py", line 108, in open_clone_sv_pair_in_vol 2024-05-28T06:13:28.396 INFO:tasks.ceph.mgr.y.smithi122.stderr: dst_sv.get_clone_source() 2024-05-28T06:13:28.396 INFO:tasks.ceph.mgr.y.smithi122.stderr: File "/usr/share/ceph/mgr/volumes/fs/operations/versions/subvolume_v1.py", line 677, in get_clone_source 2024-05-28T06:13:28.396 INFO:tasks.ceph.mgr.y.smithi122.stderr: src = self._get_clone_source() 2024-05-28T06:13:28.396 INFO:tasks.ceph.mgr.y.smithi122.stderr: File "/usr/share/ceph/mgr/volumes/fs/operations/versions/subvolume_v1.py", line 673, in _get_clone_source 2024-05-28T06:13:28.396 INFO:tasks.ceph.mgr.y.smithi122.stderr: raise VolumeException(-errno.EINVAL, "error fetching subvolume metadata") 2024-05-28T06:13:28.396 INFO:tasks.ceph.mgr.y.smithi122.stderr:volumes.fs.exception.VolumeException: -22 (error fetching subvolume metadata) 2024-05-28T06:13:28.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.761+0000 7f7199e00640 1 Processor -- start 2024-05-28T06:13:28.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.761+0000 7f7199e00640 1 -- start start 2024-05-28T06:13:28.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.765+0000 7f7199e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f71940d0120 0x7f71940b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:28.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.765+0000 7f7199e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71940b6220 0x7f71940b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:28.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.765+0000 7f7199e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71940cfba0 con 0x7f71940cd110 2024-05-28T06:13:28.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.765+0000 7f7193400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71940b6220 0x7f71940b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:28.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.765+0000 7f7193400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71940b6220 0x7f71940b3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:55196/0 (socket says 172.21.15.122:55196) 2024-05-28T06:13:28.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.765+0000 7f7193400640 1 -- 172.21.15.122:0/475696029 learned_addr learned my addr 172.21.15.122:0/475696029 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:28.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.765+0000 7f7199e00640 1 -- 172.21.15.122:0/475696029 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f71940cf300 con 0x7f71940d0120 2024-05-28T06:13:28.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.765+0000 7f7199e00640 1 -- 172.21.15.122:0/475696029 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f71940cf5e0 con 0x7f71940b6220 2024-05-28T06:13:28.768 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.769+0000 7f7193400640 1 -- 172.21.15.122:0/475696029 >> v2:172.21.15.153:3300/0 conn(0x7f71940d0120 msgr2=0x7f71940b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:28.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.769+0000 7f7192000640 1 --2- 172.21.15.122:0/475696029 >> v2:172.21.15.153:3300/0 conn(0x7f71940d0120 0x7f71940b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:28.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.769+0000 7f7193400640 1 --2- 172.21.15.122:0/475696029 >> v2:172.21.15.153:3300/0 conn(0x7f71940d0120 0x7f71940b5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:28.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.769+0000 7f7193400640 1 -- 172.21.15.122:0/475696029 >> v1:172.21.15.122:6789/0 conn(0x7f71940cd110 legacy=0x7f71940ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:28.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.769+0000 7f7193400640 1 -- 172.21.15.122:0/475696029 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71940cf8c0 con 0x7f71940b6220 2024-05-28T06:13:28.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.769+0000 7f7192000640 1 --2- 172.21.15.122:0/475696029 >> v2:172.21.15.153:3300/0 conn(0x7f71940d0120 0x7f71940b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:13:28.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.777+0000 7f7193400640 1 --2- 172.21.15.122:0/475696029 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71940b6220 0x7f71940b3b80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f718000dc90 tx=0x7f71800208b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7946d726ce94eaeb server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:28.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.777+0000 7f7191600640 1 -- 172.21.15.122:0/475696029 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718000d2d0 con 0x7f71940b6220 2024-05-28T06:13:28.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.777+0000 7f7191600640 1 -- 172.21.15.122:0/475696029 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71800a9650 con 0x7f71940b6220 2024-05-28T06:13:28.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.777+0000 7f7191600640 1 -- 172.21.15.122:0/475696029 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71800a9a20 con 0x7f71940b6220 2024-05-28T06:13:28.777 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.777+0000 7f7199e00640 1 -- 172.21.15.122:0/475696029 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71940b6220 msgr2=0x7f71940b3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:28.777 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.777+0000 7f7199e00640 1 --2- 172.21.15.122:0/475696029 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71940b6220 0x7f71940b3b80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f718000dc90 tx=0x7f71800208b0 comp rx=0 tx=0).stop 2024-05-28T06:13:28.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.777+0000 7f7199e00640 1 -- 172.21.15.122:0/475696029 shutdown_connections 2024-05-28T06:13:28.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.777+0000 7f7199e00640 1 --2- 172.21.15.122:0/475696029 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71940b6220 0x7f71940b3b80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:28.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.777+0000 7f7199e00640 1 --2- 172.21.15.122:0/475696029 >> v2:172.21.15.153:3300/0 conn(0x7f71940d0120 0x7f71940b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:28.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.777+0000 7f7199e00640 1 -- 172.21.15.122:0/475696029 >> 172.21.15.122:0/475696029 conn(0x7f719406bd90 msgr2=0x7f719406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:28.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.777+0000 7f7199e00640 1 -- 172.21.15.122:0/475696029 shutdown_connections 2024-05-28T06:13:28.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.777+0000 7f7199e00640 1 -- 172.21.15.122:0/475696029 wait complete. 2024-05-28T06:13:28.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.781+0000 7f7199e00640 1 Processor -- start 2024-05-28T06:13:28.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.781+0000 7f7199e00640 1 -- start start 2024-05-28T06:13:28.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.781+0000 7f7199e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71940b6220 0x7f71940aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:28.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.785+0000 7f7199e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71940cd110 0x7f7194141420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:28.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.785+0000 7f7199e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7194140b20 0x7f719415ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:28.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.785+0000 7f7199e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f71940b4c60 con 0x7f7194140b20 2024-05-28T06:13:28.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.785+0000 7f7199e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f71940b4ae0 con 0x7f71940cd110 2024-05-28T06:13:28.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.785+0000 7f7199e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f71940b4de0 con 0x7f71940b6220 2024-05-28T06:13:28.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.785+0000 7f7192a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71940b6220 0x7f71940aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:28.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.785+0000 7f7192000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71940cd110 0x7f7194141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:28.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.785+0000 7f7192a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71940b6220 0x7f71940aef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:55210/0 (socket says 172.21.15.122:55210) 2024-05-28T06:13:28.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.785+0000 7f7192a00640 1 -- 172.21.15.122:0/627698841 learned_addr learned my addr 172.21.15.122:0/627698841 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:28.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.785+0000 7f7192a00640 1 -- 172.21.15.122:0/627698841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71940cd110 msgr2=0x7f7194141420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:28.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.785+0000 7f7192a00640 1 --2- 172.21.15.122:0/627698841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71940cd110 0x7f7194141420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:28.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.785+0000 7f7192a00640 1 -- 172.21.15.122:0/627698841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7194140b20 msgr2=0x7f719415ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:28.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.785+0000 7f7192a00640 1 --2- 172.21.15.122:0/627698841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7194140b20 0x7f719415ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:28.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.785+0000 7f7192a00640 1 -- 172.21.15.122:0/627698841 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7194157ed0 con 0x7f71940b6220 2024-05-28T06:13:28.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.785+0000 7f7192000640 1 --2- 172.21.15.122:0/627698841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71940cd110 0x7f7194141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:13:28.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.789+0000 7f7192a00640 1 --2- 172.21.15.122:0/627698841 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71940b6220 0x7f71940aef60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f718c00c7c0 tx=0x7f718c00cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:28.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.789+0000 7f718b400640 1 -- 172.21.15.122:0/627698841 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c003ba0 con 0x7f71940b6220 2024-05-28T06:13:28.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.789+0000 7f718b400640 1 -- 172.21.15.122:0/627698841 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f718c003d40 con 0x7f71940b6220 2024-05-28T06:13:28.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.789+0000 7f718b400640 1 -- 172.21.15.122:0/627698841 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c00aa70 con 0x7f71940b6220 2024-05-28T06:13:28.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.789+0000 7f7199e00640 1 -- 172.21.15.122:0/627698841 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71941581b0 con 0x7f71940b6220 2024-05-28T06:13:28.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.789+0000 7f7199e00640 1 -- 172.21.15.122:0/627698841 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7194158770 con 0x7f71940b6220 2024-05-28T06:13:28.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.793+0000 7f7199e00640 1 -- 172.21.15.122:0/627698841 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7194068c40 con 0x7f71940b6220 2024-05-28T06:13:28.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.793+0000 7f718b400640 1 -- 172.21.15.122:0/627698841 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 22) ==== 89160+0+0 (secure 0 0 0) 0x7f718c00ac10 con 0x7f71940b6220 2024-05-28T06:13:28.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.793+0000 7f718b400640 1 --2- 172.21.15.122:0/627698841 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7174069140 0x7f717406b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:28.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.797+0000 7f718b400640 1 -- 172.21.15.122:0/627698841 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f718c0852d0 con 0x7f71940b6220 2024-05-28T06:13:28.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.809+0000 7f718b400640 1 -- 172.21.15.122:0/627698841 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f718c0572e0 con 0x7f71940b6220 2024-05-28T06:13:28.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.821+0000 7f7192000640 1 --2- 172.21.15.122:0/627698841 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7174069140 0x7f717406b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:28.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:28.841+0000 7f7192000640 1 --2- 172.21.15.122:0/627698841 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7174069140 0x7f717406b600 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7194141c70 tx=0x7f7184008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:29.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.297+0000 7f7199e00640 1 -- 172.21.15.122:0/627698841 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone47512", "target": ["mon-mgr", ""]}) -- 0x7f719406f840 con 0x7f7174069140 2024-05-28T06:13:29.404 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:29.405+0000 7f9de7e00640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-28T06:13:29.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.405+0000 7f718b400640 1 -- 172.21.15.122:0/627698841 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f719406f840 con 0x7f7174069140 2024-05-28T06:13:29.405 INFO:teuthology.orchestra.run.smithi122.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-28T06:13:29.417 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-28T06:13:29.418 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone47513 2024-05-28T06:13:29.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.769+0000 7f1f03e00640 1 Processor -- start 2024-05-28T06:13:29.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.773+0000 7f1f03e00640 1 -- start start 2024-05-28T06:13:29.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.773+0000 7f1f03e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1f0415adb0 0x7f1f040d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:29.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.773+0000 7f1f03e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f040d07a0 0x7f1f040add80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:29.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.773+0000 7f1f03e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f04070370 con 0x7f1f04072550 2024-05-28T06:13:29.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.773+0000 7f1f03e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f1f0406ca40 con 0x7f1f0415adb0 2024-05-28T06:13:29.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.773+0000 7f1f03e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1f040ce850 con 0x7f1f040d07a0 2024-05-28T06:13:29.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.777+0000 7f1f02000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1f0415adb0 0x7f1f040d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:29.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.777+0000 7f1f03400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f040d07a0 0x7f1f040add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:29.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.777+0000 7f1f03400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f040d07a0 0x7f1f040add80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:55220/0 (socket says 172.21.15.122:55220) 2024-05-28T06:13:29.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.777+0000 7f1f03400640 1 -- 172.21.15.122:0/2157977650 learned_addr learned my addr 172.21.15.122:0/2157977650 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:29.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.777+0000 7f1f02000640 1 -- 172.21.15.122:0/2157977650 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f040d07a0 msgr2=0x7f1f040add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:29.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.777+0000 7f1f02000640 1 --2- 172.21.15.122:0/2157977650 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f040d07a0 0x7f1f040add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:29.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.777+0000 7f1f02000640 1 -- 172.21.15.122:0/2157977650 >> v1:172.21.15.153:6789/0 conn(0x7f1f04072550 legacy=0x7f1f04072930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:29.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.777+0000 7f1f02000640 1 -- 172.21.15.122:0/2157977650 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f040ceb30 con 0x7f1f0415adb0 2024-05-28T06:13:29.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.777+0000 7f1f03400640 1 --2- 172.21.15.122:0/2157977650 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f040d07a0 0x7f1f040add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:13:29.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.785+0000 7f1f02000640 1 --2- 172.21.15.122:0/2157977650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f0415adb0 0x7f1f040d0260 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1ef000dbe0 tx=0x7f1ef0020740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04c1d41e8fd03b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:29.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.785+0000 7f1f01600640 1 -- 172.21.15.122:0/2157977650 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef000d2d0 con 0x7f1f0415adb0 2024-05-28T06:13:29.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.785+0000 7f1f01600640 1 -- 172.21.15.122:0/2157977650 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef00a95f0 con 0x7f1f0415adb0 2024-05-28T06:13:29.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.785+0000 7f1f01600640 1 -- 172.21.15.122:0/2157977650 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef000d2d0 con 0x7f1f0415adb0 2024-05-28T06:13:29.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.789+0000 7f1f03e00640 1 -- 172.21.15.122:0/2157977650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f0415adb0 msgr2=0x7f1f040d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:29.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.789+0000 7f1f03e00640 1 --2- 172.21.15.122:0/2157977650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f0415adb0 0x7f1f040d0260 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1ef000dbe0 tx=0x7f1ef0020740 comp rx=0 tx=0).stop 2024-05-28T06:13:29.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.793+0000 7f1f03e00640 1 -- 172.21.15.122:0/2157977650 shutdown_connections 2024-05-28T06:13:29.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.793+0000 7f1f03e00640 1 --2- 172.21.15.122:0/2157977650 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f040d07a0 0x7f1f040add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:29.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.793+0000 7f1f03e00640 1 --2- 172.21.15.122:0/2157977650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f0415adb0 0x7f1f040d0260 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:29.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.793+0000 7f1f03e00640 1 -- 172.21.15.122:0/2157977650 >> 172.21.15.122:0/2157977650 conn(0x7f1f040cd680 msgr2=0x7f1f040cda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:29.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.793+0000 7f1f03e00640 1 -- 172.21.15.122:0/2157977650 shutdown_connections 2024-05-28T06:13:29.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.793+0000 7f1f03e00640 1 -- 172.21.15.122:0/2157977650 wait complete. 2024-05-28T06:13:29.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.797+0000 7f1f03e00640 1 Processor -- start 2024-05-28T06:13:29.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.797+0000 7f1f03e00640 1 -- start start 2024-05-28T06:13:29.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.801+0000 7f1f03e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f04072550 0x7f1f0415b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:29.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.801+0000 7f1f03e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f040d07a0 0x7f1f041512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:29.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.801+0000 7f1f02000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f040d07a0 0x7f1f041512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:29.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.801+0000 7f1f02000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f040d07a0 0x7f1f041512d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57230/0 (socket says 172.21.15.122:57230) 2024-05-28T06:13:29.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.801+0000 7f1f02000640 1 -- 172.21.15.122:0/554768802 learned_addr learned my addr 172.21.15.122:0/554768802 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:29.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.801+0000 7f1f02a00640 1 --2- 172.21.15.122:0/554768802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f04072550 0x7f1f0415b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:29.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.801+0000 7f1f03e00640 1 --2- 172.21.15.122:0/554768802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f0415adb0 0x7f1f04141660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:29.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.801+0000 7f1f03e00640 1 -- 172.21.15.122:0/554768802 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1f040ae650 con 0x7f1f040d07a0 2024-05-28T06:13:29.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.801+0000 7f1f03e00640 1 -- 172.21.15.122:0/554768802 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1f040ae4d0 con 0x7f1f0415adb0 2024-05-28T06:13:29.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.801+0000 7f1f03e00640 1 -- 172.21.15.122:0/554768802 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f1f041677c0 con 0x7f1f04072550 2024-05-28T06:13:29.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.801+0000 7f1f03400640 1 --2- 172.21.15.122:0/554768802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f0415adb0 0x7f1f04141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:29.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.801+0000 7f1f02a00640 1 -- 172.21.15.122:0/554768802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f0415adb0 msgr2=0x7f1f04141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:29.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.801+0000 7f1f02a00640 1 --2- 172.21.15.122:0/554768802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f0415adb0 0x7f1f04141660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:29.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.801+0000 7f1f02a00640 1 -- 172.21.15.122:0/554768802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f040d07a0 msgr2=0x7f1f041512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:29.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.801+0000 7f1f02a00640 1 --2- 172.21.15.122:0/554768802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f040d07a0 0x7f1f041512d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:29.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.801+0000 7f1f02a00640 1 -- 172.21.15.122:0/554768802 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0415e0c0 con 0x7f1f04072550 2024-05-28T06:13:29.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.801+0000 7f1f03400640 1 --2- 172.21.15.122:0/554768802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f0415adb0 0x7f1f04141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:13:29.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.801+0000 7f1f02000640 1 --2- 172.21.15.122:0/554768802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f040d07a0 0x7f1f041512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:13:29.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.801+0000 7f1f02a00640 1 --2- 172.21.15.122:0/554768802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f04072550 0x7f1f0415b5a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4009c10 tx=0x7f1ef4013f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:29.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.801+0000 7f1efaa00640 1 -- 172.21.15.122:0/554768802 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4014d10 con 0x7f1f04072550 2024-05-28T06:13:29.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.801+0000 7f1efaa00640 1 -- 172.21.15.122:0/554768802 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef4004020 con 0x7f1f04072550 2024-05-28T06:13:29.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.801+0000 7f1f03e00640 1 -- 172.21.15.122:0/554768802 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0415d860 con 0x7f1f04072550 2024-05-28T06:13:29.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.801+0000 7f1efaa00640 1 -- 172.21.15.122:0/554768802 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4004410 con 0x7f1f04072550 2024-05-28T06:13:29.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.805+0000 7f1f03e00640 1 -- 172.21.15.122:0/554768802 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f0415db00 con 0x7f1f04072550 2024-05-28T06:13:29.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.805+0000 7f1eefe00640 1 -- 172.21.15.122:0/554768802 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f0414fb10 con 0x7f1f04072550 2024-05-28T06:13:29.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.809+0000 7f1efaa00640 1 -- 172.21.15.122:0/554768802 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 22) ==== 89160+0+0 (secure 0 0 0) 0x7f1ef40128e0 con 0x7f1f04072550 2024-05-28T06:13:29.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.809+0000 7f1efaa00640 1 --2- 172.21.15.122:0/554768802 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1ee40690f0 0x7f1ee406b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:29.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.809+0000 7f1efaa00640 1 -- 172.21.15.122:0/554768802 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f1ef408d3c0 con 0x7f1f04072550 2024-05-28T06:13:29.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.813+0000 7f1efaa00640 1 -- 172.21.15.122:0/554768802 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1ef405f410 con 0x7f1f04072550 2024-05-28T06:13:29.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.817+0000 7f1f02000640 1 --2- 172.21.15.122:0/554768802 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1ee40690f0 0x7f1ee406b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:29.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:29.817+0000 7f1f02000640 1 --2- 172.21.15.122:0/554768802 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f1ee40690f0 0x7f1ee406b5b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1ef000dbe0 tx=0x7f1ef00ab070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:30.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:30.329+0000 7f1eefe00640 1 -- 172.21.15.122:0/554768802 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone47513", "target": ["mon-mgr", ""]}) -- 0x7f1f04075620 con 0x7f1ee40690f0 2024-05-28T06:13:30.712 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-05-28T06:13:30.713+0000 7f9de7e00640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-28T06:13:30.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:30.713+0000 7f1efaa00640 1 -- 172.21.15.122:0/554768802 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f1f04075620 con 0x7f1ee40690f0 2024-05-28T06:13:30.714 INFO:teuthology.orchestra.run.smithi122.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-28T06:13:30.737 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-28T06:13:30.737 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone47514 2024-05-28T06:13:31.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.105+0000 7fcb4ba00640 1 Processor -- start 2024-05-28T06:13:31.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.105+0000 7fcb4ba00640 1 -- start start 2024-05-28T06:13:31.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.109+0000 7fcb4ba00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcb3c04f500 0x7fcb3c04f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:31.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.109+0000 7fcb4ba00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb3c0482b0 0x7fcb3c038d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:31.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.109+0000 7fcb4ba00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb3c04fe20 con 0x7fcb3c047d60 2024-05-28T06:13:31.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.109+0000 7fcb4ba00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fcb3c006b20 con 0x7fcb3c04f500 2024-05-28T06:13:31.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.109+0000 7fcb4ba00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcb3c006e00 con 0x7fcb3c0482b0 2024-05-28T06:13:31.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.109+0000 7fcb4a400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb3c0482b0 0x7fcb3c038d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:31.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.109+0000 7fcb49000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcb3c04f500 0x7fcb3c04f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:31.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.109+0000 7fcb4a400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb3c0482b0 0x7fcb3c038d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:55242/0 (socket says 172.21.15.122:55242) 2024-05-28T06:13:31.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.109+0000 7fcb4a400640 1 -- 172.21.15.122:0/3676590124 learned_addr learned my addr 172.21.15.122:0/3676590124 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:31.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.113+0000 7fcb49000640 1 -- 172.21.15.122:0/3676590124 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb3c0482b0 msgr2=0x7fcb3c038d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:31.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.113+0000 7fcb49000640 1 --2- 172.21.15.122:0/3676590124 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb3c0482b0 0x7fcb3c038d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:31.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.113+0000 7fcb49000640 1 -- 172.21.15.122:0/3676590124 >> v1:172.21.15.122:6789/0 conn(0x7fcb3c047d60 legacy=0x7fcb3c052e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:31.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.113+0000 7fcb49000640 1 -- 172.21.15.122:0/3676590124 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb3c0070e0 con 0x7fcb3c04f500 2024-05-28T06:13:31.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.129+0000 7fcb49000640 1 --2- 172.21.15.122:0/3676590124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb3c04f500 0x7fcb3c04f8e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcb380097c0 tx=0x7fcb3801c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9da6cbcc6c82fbde server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:31.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.129+0000 7fcb43400640 1 -- 172.21.15.122:0/3676590124 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb380b0070 con 0x7fcb3c04f500 2024-05-28T06:13:31.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.129+0000 7fcb43400640 1 -- 172.21.15.122:0/3676590124 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb380ab600 con 0x7fcb3c04f500 2024-05-28T06:13:31.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.129+0000 7fcb43400640 1 -- 172.21.15.122:0/3676590124 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb380ab9d0 con 0x7fcb3c04f500 2024-05-28T06:13:31.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.133+0000 7fcb4ba00640 1 -- 172.21.15.122:0/3676590124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb3c04f500 msgr2=0x7fcb3c04f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:31.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.133+0000 7fcb4ba00640 1 --2- 172.21.15.122:0/3676590124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb3c04f500 0x7fcb3c04f8e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcb380097c0 tx=0x7fcb3801c460 comp rx=0 tx=0).stop 2024-05-28T06:13:31.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.133+0000 7fcb4ba00640 1 -- 172.21.15.122:0/3676590124 shutdown_connections 2024-05-28T06:13:31.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.133+0000 7fcb4ba00640 1 --2- 172.21.15.122:0/3676590124 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb3c0482b0 0x7fcb3c038d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:31.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.133+0000 7fcb4ba00640 1 --2- 172.21.15.122:0/3676590124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb3c04f500 0x7fcb3c04f8e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:31.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.133+0000 7fcb4ba00640 1 -- 172.21.15.122:0/3676590124 >> 172.21.15.122:0/3676590124 conn(0x7fcb3c054ca0 msgr2=0x7fcb3c0550b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:31.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.137+0000 7fcb4ba00640 1 -- 172.21.15.122:0/3676590124 shutdown_connections 2024-05-28T06:13:31.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.137+0000 7fcb4ba00640 1 -- 172.21.15.122:0/3676590124 wait complete. 2024-05-28T06:13:31.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.141+0000 7fcb4ba00640 1 Processor -- start 2024-05-28T06:13:31.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.141+0000 7fcb4ba00640 1 -- start start 2024-05-28T06:13:31.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.149+0000 7fcb4ba00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb3c047d60 0x7fcb3c0d0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:31.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.149+0000 7fcb4ba00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb3c0482b0 0x7fcb3c04aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:31.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.149+0000 7fcb4ba00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb3c04f500 0x7fcb3c04afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:31.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.153+0000 7fcb4ba00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3c0f1fd0 con 0x7fcb3c0482b0 2024-05-28T06:13:31.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.153+0000 7fcb4ba00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3c0f1e50 con 0x7fcb3c047d60 2024-05-28T06:13:31.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.153+0000 7fcb4ba00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fcb3c0f2150 con 0x7fcb3c04f500 2024-05-28T06:13:31.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.153+0000 7fcb4a400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb3c04f500 0x7fcb3c04afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:31.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.153+0000 7fcb4a400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb3c04f500 0x7fcb3c04afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:55252/0 (socket says 172.21.15.122:55252) 2024-05-28T06:13:31.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.153+0000 7fcb4a400640 1 -- 172.21.15.122:0/3154301536 learned_addr learned my addr 172.21.15.122:0/3154301536 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:31.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.153+0000 7fcb49000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb3c047d60 0x7fcb3c0d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:31.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.153+0000 7fcb43e00640 1 --2- 172.21.15.122:0/3154301536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb3c0482b0 0x7fcb3c04aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:31.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.153+0000 7fcb4a400640 1 -- 172.21.15.122:0/3154301536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb3c047d60 msgr2=0x7fcb3c0d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:31.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.153+0000 7fcb4a400640 1 --2- 172.21.15.122:0/3154301536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb3c047d60 0x7fcb3c0d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:31.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.153+0000 7fcb4a400640 1 -- 172.21.15.122:0/3154301536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb3c0482b0 msgr2=0x7fcb3c04aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:31.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.153+0000 7fcb4a400640 1 --2- 172.21.15.122:0/3154301536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb3c0482b0 0x7fcb3c04aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:31.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.153+0000 7fcb4a400640 1 -- 172.21.15.122:0/3154301536 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb3c0494c0 con 0x7fcb3c04f500 2024-05-28T06:13:31.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.153+0000 7fcb4a400640 1 --2- 172.21.15.122:0/3154301536 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb3c04f500 0x7fcb3c04afd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcb44074780 tx=0x7fcb440695a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:31.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.153+0000 7fcb40c00640 1 -- 172.21.15.122:0/3154301536 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44098070 con 0x7fcb3c04f500 2024-05-28T06:13:31.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.153+0000 7fcb40c00640 1 -- 172.21.15.122:0/3154301536 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb44075560 con 0x7fcb3c04f500 2024-05-28T06:13:31.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.153+0000 7fcb40c00640 1 -- 172.21.15.122:0/3154301536 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44075950 con 0x7fcb3c04f500 2024-05-28T06:13:31.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.153+0000 7fcb4ba00640 1 -- 172.21.15.122:0/3154301536 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb3c0497a0 con 0x7fcb3c04f500 2024-05-28T06:13:31.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.157+0000 7fcb4ba00640 1 -- 172.21.15.122:0/3154301536 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb3c049d60 con 0x7fcb3c04f500 2024-05-28T06:13:31.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.161+0000 7fcb40c00640 1 -- 172.21.15.122:0/3154301536 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 22) ==== 89160+0+0 (secure 0 0 0) 0x7fcb4409b070 con 0x7fcb3c04f500 2024-05-28T06:13:31.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.165+0000 7fcb36000640 1 -- 172.21.15.122:0/3154301536 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb180052a0 con 0x7fcb3c04f500 2024-05-28T06:13:31.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.165+0000 7fcb40c00640 1 --2- 172.21.15.122:0/3154301536 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcb240690c0 0x7fcb2406b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:31.167 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.165+0000 7fcb40c00640 1 -- 172.21.15.122:0/3154301536 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7fcb44100490 con 0x7fcb3c04f500 2024-05-28T06:13:31.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.169+0000 7fcb40c00640 1 -- 172.21.15.122:0/3154301536 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcb44090070 con 0x7fcb3c04f500 2024-05-28T06:13:31.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.205+0000 7fcb49000640 1 --2- 172.21.15.122:0/3154301536 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcb240690c0 0x7fcb2406b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:31.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.205+0000 7fcb49000640 1 --2- 172.21.15.122:0/3154301536 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcb240690c0 0x7fcb2406b580 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fcb380ad000 tx=0x7fcb380a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:31.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:31.773+0000 7fcb36000640 1 -- 172.21.15.122:0/3154301536 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone47514", "target": ["mon-mgr", ""]}) -- 0x7fcb18000bd0 con 0x7fcb240690c0 2024-05-28T06:13:33.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.101+0000 7fcb40c00640 1 -- 172.21.15.122:0/3154301536 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcb18000bd0 con 0x7fcb240690c0 2024-05-28T06:13:33.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.113+0000 7fcb36000640 1 -- 172.21.15.122:0/3154301536 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcb240690c0 msgr2=0x7fcb2406b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:33.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.113+0000 7fcb36000640 1 --2- 172.21.15.122:0/3154301536 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcb240690c0 0x7fcb2406b580 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fcb380ad000 tx=0x7fcb380a6000 comp rx=0 tx=0).stop 2024-05-28T06:13:33.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.113+0000 7fcb36000640 1 -- 172.21.15.122:0/3154301536 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb3c04f500 msgr2=0x7fcb3c04afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:33.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.113+0000 7fcb36000640 1 --2- 172.21.15.122:0/3154301536 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb3c04f500 0x7fcb3c04afd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcb44074780 tx=0x7fcb440695a0 comp rx=0 tx=0).stop 2024-05-28T06:13:33.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.113+0000 7fcb36000640 1 -- 172.21.15.122:0/3154301536 shutdown_connections 2024-05-28T06:13:33.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.113+0000 7fcb36000640 1 --2- 172.21.15.122:0/3154301536 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fcb240690c0 0x7fcb2406b580 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:33.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.113+0000 7fcb36000640 1 --2- 172.21.15.122:0/3154301536 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb3c04f500 0x7fcb3c04afd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:33.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.113+0000 7fcb36000640 1 --2- 172.21.15.122:0/3154301536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb3c0482b0 0x7fcb3c04aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:33.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.113+0000 7fcb36000640 1 --2- 172.21.15.122:0/3154301536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb3c047d60 0x7fcb3c0d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:33.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.113+0000 7fcb36000640 1 -- 172.21.15.122:0/3154301536 >> 172.21.15.122:0/3154301536 conn(0x7fcb3c054ca0 msgr2=0x7fcb3c033ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:33.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.117+0000 7fcb36000640 1 -- 172.21.15.122:0/3154301536 shutdown_connections 2024-05-28T06:13:33.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.117+0000 7fcb36000640 1 -- 172.21.15.122:0/3154301536 wait complete. 2024-05-28T06:13:33.212 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone47515 2024-05-28T06:13:33.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.593+0000 7f2fdde00640 1 Processor -- start 2024-05-28T06:13:33.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.593+0000 7f2fdde00640 1 -- start start 2024-05-28T06:13:33.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.597+0000 7f2fdde00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2fd80b18b0 0x7f2fd8163c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:33.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.597+0000 7f2fdde00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fd8070280 con 0x7f2fd80af230 2024-05-28T06:13:33.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.597+0000 7f2fdde00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fd8070560 con 0x7f2fd80c5430 2024-05-28T06:13:33.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.597+0000 7f2fdde00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f2fd8070030 con 0x7f2fd80b18b0 2024-05-28T06:13:33.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.597+0000 7f2fd7e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2fd80b18b0 0x7f2fd8163c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:33.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.597+0000 7f2fd7e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2fd80b18b0 0x7f2fd8163c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:42468/0 (socket says 172.21.15.122:42468) 2024-05-28T06:13:33.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.597+0000 7f2fd7e00640 1 -- 172.21.15.122:0/936821991 learned_addr learned my addr 172.21.15.122:0/936821991 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:33.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.601+0000 7f2fd7400640 1 -- 172.21.15.122:0/936821991 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4191480430 0 0) 0x7f2fd8070560 con 0x7f2fd80c5430 2024-05-28T06:13:33.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.601+0000 7f2fd7400640 1 -- 172.21.15.122:0/936821991 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fc0003530 con 0x7f2fd80c5430 2024-05-28T06:13:33.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.601+0000 7f2fd7400640 1 -- 172.21.15.122:0/936821991 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1296692122 0 0) 0x7f2fd8070280 con 0x7f2fd80af230 2024-05-28T06:13:33.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.601+0000 7f2fd7400640 1 -- 172.21.15.122:0/936821991 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fd8070560 con 0x7f2fd80af230 2024-05-28T06:13:33.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.605+0000 7f2fd7e00640 1 -- 172.21.15.122:0/936821991 >> v1:172.21.15.153:6789/0 conn(0x7f2fd80c5430 legacy=0x7f2fd80c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:33.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.605+0000 7f2fd7e00640 1 -- 172.21.15.122:0/936821991 >> v1:172.21.15.122:6789/0 conn(0x7f2fd80af230 legacy=0x7f2fd809b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:33.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.605+0000 7f2fd7e00640 1 -- 172.21.15.122:0/936821991 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd809ab70 con 0x7f2fd80b18b0 2024-05-28T06:13:33.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.637+0000 7f2fd7e00640 1 --2- 172.21.15.122:0/936821991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fd80b18b0 0x7f2fd8163c80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4009870 tx=0x7f2fc401c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9587e01d40f845f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:33.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.637+0000 7f2fd7400640 1 -- 172.21.15.122:0/936821991 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc40ab5f0 con 0x7f2fd80b18b0 2024-05-28T06:13:33.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.637+0000 7f2fd7400640 1 -- 172.21.15.122:0/936821991 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc40b0070 con 0x7f2fd80b18b0 2024-05-28T06:13:33.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.637+0000 7f2fd7400640 1 -- 172.21.15.122:0/936821991 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc40ab9b0 con 0x7f2fd80b18b0 2024-05-28T06:13:33.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.669+0000 7f2fdde00640 1 -- 172.21.15.122:0/936821991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fd80b18b0 msgr2=0x7f2fd8163c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:33.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.669+0000 7f2fdde00640 1 --2- 172.21.15.122:0/936821991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fd80b18b0 0x7f2fd8163c80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4009870 tx=0x7f2fc401c540 comp rx=0 tx=0).stop 2024-05-28T06:13:33.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.673+0000 7f2fdde00640 1 -- 172.21.15.122:0/936821991 shutdown_connections 2024-05-28T06:13:33.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.673+0000 7f2fdde00640 1 --2- 172.21.15.122:0/936821991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fd80b18b0 0x7f2fd8163c80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:33.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.673+0000 7f2fdde00640 1 -- 172.21.15.122:0/936821991 >> 172.21.15.122:0/936821991 conn(0x7f2fd80b3f50 msgr2=0x7f2fd80b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:33.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.677+0000 7f2fdde00640 1 -- 172.21.15.122:0/936821991 shutdown_connections 2024-05-28T06:13:33.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.677+0000 7f2fdde00640 1 -- 172.21.15.122:0/936821991 wait complete. 2024-05-28T06:13:33.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.693+0000 7f2fdde00640 1 Processor -- start 2024-05-28T06:13:33.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.693+0000 7f2fdde00640 1 -- start start 2024-05-28T06:13:33.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.697+0000 7f2fdde00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fd80af230 0x7f2fd815e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:33.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.697+0000 7f2fdde00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fd80b18b0 0x7f2fd8164330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:33.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.697+0000 7f2fdde00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fd80c5430 0x7f2fd8164870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:33.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.697+0000 7f2fdde00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd8171450 con 0x7f2fd80c5430 2024-05-28T06:13:33.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.697+0000 7f2fdde00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd81712d0 con 0x7f2fd80af230 2024-05-28T06:13:33.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.697+0000 7f2fdde00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f2fd81715d0 con 0x7f2fd80b18b0 2024-05-28T06:13:33.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.697+0000 7f2fdd400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fd80c5430 0x7f2fd8164870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:33.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.697+0000 7f2fdd400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fd80c5430 0x7f2fd8164870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57238/0 (socket says 172.21.15.122:57238) 2024-05-28T06:13:33.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.697+0000 7f2fdd400640 1 -- 172.21.15.122:0/31928113 learned_addr learned my addr 172.21.15.122:0/31928113 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:33.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.697+0000 7f2fdd400640 1 -- 172.21.15.122:0/31928113 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fd80b18b0 msgr2=0x7f2fd8164330 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-28T06:13:33.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.697+0000 7f2fdd400640 1 --2- 172.21.15.122:0/31928113 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fd80b18b0 0x7f2fd8164330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:33.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.697+0000 7f2fdd400640 1 -- 172.21.15.122:0/31928113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fd80af230 msgr2=0x7f2fd815e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:33.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.697+0000 7f2fdd400640 1 --2- 172.21.15.122:0/31928113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fd80af230 0x7f2fd815e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:33.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.697+0000 7f2fdd400640 1 -- 172.21.15.122:0/31928113 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd8164f10 con 0x7f2fd80c5430 2024-05-28T06:13:33.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.701+0000 7f2fdd400640 1 --2- 172.21.15.122:0/31928113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fd80c5430 0x7f2fd8164870 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f2fd000c7b0 tx=0x7f2fd000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:33.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.701+0000 7f2fd4c00640 1 -- 172.21.15.122:0/31928113 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0003db0 con 0x7f2fd80c5430 2024-05-28T06:13:33.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.701+0000 7f2fd4c00640 1 -- 172.21.15.122:0/31928113 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd0005070 con 0x7f2fd80c5430 2024-05-28T06:13:33.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.701+0000 7f2fd4c00640 1 -- 172.21.15.122:0/31928113 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0005460 con 0x7f2fd80c5430 2024-05-28T06:13:33.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.701+0000 7f2fdde00640 1 -- 172.21.15.122:0/31928113 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fd81651f0 con 0x7f2fd80c5430 2024-05-28T06:13:33.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.701+0000 7f2fdde00640 1 -- 172.21.15.122:0/31928113 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fd81657b0 con 0x7f2fd80c5430 2024-05-28T06:13:33.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.705+0000 7f2fdde00640 1 -- 172.21.15.122:0/31928113 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fd8075620 con 0x7f2fd80c5430 2024-05-28T06:13:33.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.717+0000 7f2fd4c00640 1 -- 172.21.15.122:0/31928113 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 22) ==== 89160+0+0 (secure 0 0 0) 0x7f2fd0005600 con 0x7f2fd80c5430 2024-05-28T06:13:33.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.717+0000 7f2fd4c00640 1 --2- 172.21.15.122:0/31928113 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2fb8069140 0x7f2fb806b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:33.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.717+0000 7f2fd4c00640 1 -- 172.21.15.122:0/31928113 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f2fd0085db0 con 0x7f2fd80c5430 2024-05-28T06:13:33.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.729+0000 7f2fd4c00640 1 -- 172.21.15.122:0/31928113 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2fd0057dc0 con 0x7f2fd80c5430 2024-05-28T06:13:33.753 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.753+0000 7f2fdca00640 1 --2- 172.21.15.122:0/31928113 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2fb8069140 0x7f2fb806b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:33.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:33.765+0000 7f2fdca00640 1 --2- 172.21.15.122:0/31928113 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2fb8069140 0x7f2fb806b600 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc007fd0 tx=0x7f2fcc007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:34.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:34.293+0000 7f2fdde00640 1 -- 172.21.15.122:0/31928113 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone47515", "target": ["mon-mgr", ""]}) -- 0x7f2fd80d2200 con 0x7f2fb8069140 2024-05-28T06:13:35.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.309+0000 7f2fd4c00640 1 -- 172.21.15.122:0/31928113 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2fd80d2200 con 0x7f2fb8069140 2024-05-28T06:13:35.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.313+0000 7f2fdde00640 1 -- 172.21.15.122:0/31928113 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2fb8069140 msgr2=0x7f2fb806b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:35.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.313+0000 7f2fdde00640 1 --2- 172.21.15.122:0/31928113 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2fb8069140 0x7f2fb806b600 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc007fd0 tx=0x7f2fcc007900 comp rx=0 tx=0).stop 2024-05-28T06:13:35.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.313+0000 7f2fdde00640 1 -- 172.21.15.122:0/31928113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fd80c5430 msgr2=0x7f2fd8164870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:35.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.313+0000 7f2fdde00640 1 --2- 172.21.15.122:0/31928113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fd80c5430 0x7f2fd8164870 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f2fd000c7b0 tx=0x7f2fd000cc70 comp rx=0 tx=0).stop 2024-05-28T06:13:35.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.313+0000 7f2fdde00640 1 -- 172.21.15.122:0/31928113 shutdown_connections 2024-05-28T06:13:35.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.313+0000 7f2fdde00640 1 --2- 172.21.15.122:0/31928113 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2fb8069140 0x7f2fb806b600 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:35.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.313+0000 7f2fdde00640 1 --2- 172.21.15.122:0/31928113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fd80c5430 0x7f2fd8164870 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:35.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.313+0000 7f2fdde00640 1 --2- 172.21.15.122:0/31928113 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fd80b18b0 0x7f2fd8164330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:35.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.313+0000 7f2fdde00640 1 --2- 172.21.15.122:0/31928113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fd80af230 0x7f2fd815e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:35.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.313+0000 7f2fdde00640 1 -- 172.21.15.122:0/31928113 >> 172.21.15.122:0/31928113 conn(0x7f2fd80b3f50 msgr2=0x7f2fd809b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:35.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.313+0000 7f2fdde00640 1 -- 172.21.15.122:0/31928113 shutdown_connections 2024-05-28T06:13:35.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.313+0000 7f2fdde00640 1 -- 172.21.15.122:0/31928113 wait complete. 2024-05-28T06:13:35.340 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone47516 2024-05-28T06:13:35.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.681+0000 7f8bee400640 1 Processor -- start 2024-05-28T06:13:35.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.681+0000 7f8bee400640 1 -- start start 2024-05-28T06:13:35.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.685+0000 7f8bee400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8be8162be0 0x7f8be80cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:35.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.685+0000 7f8bee400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8be80cccf0 0x7f8be80722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:35.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.685+0000 7f8bee400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8be80727e0 0x7f8be81667e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:35.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.685+0000 7f8bee400640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f8be81641b0 con 0x7f8be8162be0 2024-05-28T06:13:35.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.685+0000 7f8bee400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8be8072c50 con 0x7f8be80cccf0 2024-05-28T06:13:35.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.685+0000 7f8be7400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8be8162be0 0x7f8be80cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:35.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.685+0000 7f8bee400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8be806e070 con 0x7f8be80727e0 2024-05-28T06:13:35.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.685+0000 7f8be7400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8be8162be0 0x7f8be80cc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51172/0 (socket says 172.21.15.122:51172) 2024-05-28T06:13:35.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.685+0000 7f8be7400640 1 -- 172.21.15.122:0/2909049335 learned_addr learned my addr 172.21.15.122:0/2909049335 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:35.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.685+0000 7f8bdea00640 1 --2- 172.21.15.122:0/2909049335 >> v2:172.21.15.153:3300/0 conn(0x7f8be80cccf0 0x7f8be80722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:35.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.685+0000 7f8be7e00640 1 --2- 172.21.15.122:0/2909049335 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8be80727e0 0x7f8be81667e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:35.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.689+0000 7f8bdea00640 1 -- 172.21.15.122:0/2909049335 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8be80727e0 msgr2=0x7f8be81667e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:35.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.689+0000 7f8bdea00640 1 --2- 172.21.15.122:0/2909049335 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8be80727e0 0x7f8be81667e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:35.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.689+0000 7f8bdea00640 1 -- 172.21.15.122:0/2909049335 >> v2:172.21.15.122:3300/0 conn(0x7f8be8162be0 msgr2=0x7f8be80cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:35.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.689+0000 7f8bdea00640 1 --2- 172.21.15.122:0/2909049335 >> v2:172.21.15.122:3300/0 conn(0x7f8be8162be0 0x7f8be80cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:35.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.689+0000 7f8bdea00640 1 -- 172.21.15.122:0/2909049335 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be806e350 con 0x7f8be80cccf0 2024-05-28T06:13:35.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.689+0000 7f8be7e00640 1 --2- 172.21.15.122:0/2909049335 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8be80727e0 0x7f8be81667e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:13:35.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.713+0000 7f8bdea00640 1 --2- 172.21.15.122:0/2909049335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be80cccf0 0x7f8be80722a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8be806f450 tx=0x7f8bd801c1b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=284479bf2e189ad0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:35.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.713+0000 7f8be6a00640 1 -- 172.21.15.122:0/2909049335 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd80b0070 con 0x7f8be80cccf0 2024-05-28T06:13:35.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.717+0000 7f8be6a00640 1 -- 172.21.15.122:0/2909049335 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bd80ab600 con 0x7f8be80cccf0 2024-05-28T06:13:35.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.717+0000 7f8be6a00640 1 -- 172.21.15.122:0/2909049335 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd80ab9d0 con 0x7f8be80cccf0 2024-05-28T06:13:35.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.717+0000 7f8bee400640 1 -- 172.21.15.122:0/2909049335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be80cccf0 msgr2=0x7f8be80722a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:35.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.717+0000 7f8bee400640 1 --2- 172.21.15.122:0/2909049335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be80cccf0 0x7f8be80722a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8be806f450 tx=0x7f8bd801c1b0 comp rx=0 tx=0).stop 2024-05-28T06:13:35.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.717+0000 7f8bee400640 1 -- 172.21.15.122:0/2909049335 shutdown_connections 2024-05-28T06:13:35.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.717+0000 7f8bee400640 1 --2- 172.21.15.122:0/2909049335 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8be80727e0 0x7f8be81667e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:35.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.717+0000 7f8bee400640 1 --2- 172.21.15.122:0/2909049335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be80cccf0 0x7f8be80722a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:35.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.717+0000 7f8bee400640 1 --2- 172.21.15.122:0/2909049335 >> v2:172.21.15.122:3300/0 conn(0x7f8be8162be0 0x7f8be80cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:35.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.717+0000 7f8bee400640 1 -- 172.21.15.122:0/2909049335 >> 172.21.15.122:0/2909049335 conn(0x7f8be806bd90 msgr2=0x7f8be806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:35.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.717+0000 7f8bee400640 1 -- 172.21.15.122:0/2909049335 shutdown_connections 2024-05-28T06:13:35.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.717+0000 7f8bee400640 1 -- 172.21.15.122:0/2909049335 wait complete. 2024-05-28T06:13:35.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.721+0000 7f8bee400640 1 Processor -- start 2024-05-28T06:13:35.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.725+0000 7f8bee400640 1 -- start start 2024-05-28T06:13:35.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.729+0000 7f8bee400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8be80727e0 0x7f8be8155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:35.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.729+0000 7f8bee400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be80cccf0 0x7f8be8140f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:35.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.729+0000 7f8bee400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8be8162be0 0x7f8be81441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:35.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.729+0000 7f8bee400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8be8162fc0 con 0x7f8be80727e0 2024-05-28T06:13:35.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.729+0000 7f8bee400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8be806eed0 con 0x7f8be80cccf0 2024-05-28T06:13:35.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.729+0000 7f8bee400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8be80ce6e0 con 0x7f8be8162be0 2024-05-28T06:13:35.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.729+0000 7f8bdea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be80cccf0 0x7f8be8140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:35.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.729+0000 7f8bdea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be80cccf0 0x7f8be8140f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:57434/0 (socket says 172.21.15.122:57434) 2024-05-28T06:13:35.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.729+0000 7f8bdea00640 1 -- 172.21.15.122:0/1593998958 learned_addr learned my addr 172.21.15.122:0/1593998958 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:35.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.729+0000 7f8be7e00640 1 --2- 172.21.15.122:0/1593998958 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8be8162be0 0x7f8be81441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:35.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.733+0000 7f8bdea00640 1 -- 172.21.15.122:0/1593998958 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8be8162be0 msgr2=0x7f8be81441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:35.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.733+0000 7f8bdea00640 1 --2- 172.21.15.122:0/1593998958 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8be8162be0 0x7f8be81441a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:35.735 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.733+0000 7f8bdea00640 1 -- 172.21.15.122:0/1593998958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8be80727e0 msgr2=0x7f8be8155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:35.735 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.733+0000 7f8bdea00640 1 --2- 172.21.15.122:0/1593998958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8be80727e0 0x7f8be8155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:35.735 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.733+0000 7f8bdea00640 1 -- 172.21.15.122:0/1593998958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be8141440 con 0x7f8be80cccf0 2024-05-28T06:13:35.735 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.733+0000 7f8bdea00640 1 --2- 172.21.15.122:0/1593998958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be80cccf0 0x7f8be8140f00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8019de0 tx=0x7f8bd8018f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:35.735 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.733+0000 7f8bdfe00640 1 -- 172.21.15.122:0/1593998958 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd80b9020 con 0x7f8be80cccf0 2024-05-28T06:13:35.735 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.733+0000 7f8bdfe00640 1 -- 172.21.15.122:0/1593998958 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bd80b5680 con 0x7f8be80cccf0 2024-05-28T06:13:35.735 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.733+0000 7f8bdfe00640 1 -- 172.21.15.122:0/1593998958 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd80b0040 con 0x7f8be80cccf0 2024-05-28T06:13:35.735 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.733+0000 7f8bee400640 1 -- 172.21.15.122:0/1593998958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be8155e50 con 0x7f8be80cccf0 2024-05-28T06:13:35.735 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.733+0000 7f8bee400640 1 -- 172.21.15.122:0/1593998958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be8156410 con 0x7f8be80cccf0 2024-05-28T06:13:35.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.737+0000 7f8bdfe00640 1 -- 172.21.15.122:0/1593998958 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 22) ==== 89160+0+0 (secure 0 0 0) 0x7f8bd80bc020 con 0x7f8be80cccf0 2024-05-28T06:13:35.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.737+0000 7f8bdfe00640 1 --2- 172.21.15.122:0/1593998958 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8bc4069070 0x7f8bc406b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:35.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.741+0000 7f8bdfe00640 1 -- 172.21.15.122:0/1593998958 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f8bd80af170 con 0x7f8be80cccf0 2024-05-28T06:13:35.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.741+0000 7f8bdcc00640 1 -- 172.21.15.122:0/1593998958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8be8068c40 con 0x7f8be80cccf0 2024-05-28T06:13:35.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.753+0000 7f8bdfe00640 1 -- 172.21.15.122:0/1593998958 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8bd8123020 con 0x7f8be80cccf0 2024-05-28T06:13:35.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.757+0000 7f8be7400640 1 --2- 172.21.15.122:0/1593998958 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8bc4069070 0x7f8bc406b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:35.768 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:35.769+0000 7f8be7400640 1 --2- 172.21.15.122:0/1593998958 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8bc4069070 0x7f8bc406b530 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8bd000b7f0 tx=0x7f8bd0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:36.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:36.145+0000 7f8bdcc00640 1 -- 172.21.15.122:0/1593998958 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone47516", "target": ["mon-mgr", ""]}) -- 0x7f8be8076020 con 0x7f8bc4069070 2024-05-28T06:13:36.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:36.881+0000 7f8bdfe00640 1 -- 172.21.15.122:0/1593998958 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8bd000bdd0 con 0x7f8bc4069070 2024-05-28T06:13:36.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:36.889+0000 7f8bdcc00640 1 -- 172.21.15.122:0/1593998958 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8bc4069070 msgr2=0x7f8bc406b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:36.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:36.889+0000 7f8bdcc00640 1 --2- 172.21.15.122:0/1593998958 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8bc4069070 0x7f8bc406b530 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8bd000b7f0 tx=0x7f8bd0008040 comp rx=0 tx=0).stop 2024-05-28T06:13:36.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:36.889+0000 7f8bdcc00640 1 -- 172.21.15.122:0/1593998958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be80cccf0 msgr2=0x7f8be8140f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:36.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:36.889+0000 7f8bdcc00640 1 --2- 172.21.15.122:0/1593998958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be80cccf0 0x7f8be8140f00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8019de0 tx=0x7f8bd8018f50 comp rx=0 tx=0).stop 2024-05-28T06:13:36.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:36.889+0000 7f8bdcc00640 1 -- 172.21.15.122:0/1593998958 shutdown_connections 2024-05-28T06:13:36.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:36.889+0000 7f8bdcc00640 1 --2- 172.21.15.122:0/1593998958 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8bc4069070 0x7f8bc406b530 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:36.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:36.889+0000 7f8bdcc00640 1 --2- 172.21.15.122:0/1593998958 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8be8162be0 0x7f8be81441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:36.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:36.889+0000 7f8bdcc00640 1 --2- 172.21.15.122:0/1593998958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be80cccf0 0x7f8be8140f00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:36.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:36.889+0000 7f8bdcc00640 1 --2- 172.21.15.122:0/1593998958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8be80727e0 0x7f8be8155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:36.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:36.889+0000 7f8bdcc00640 1 -- 172.21.15.122:0/1593998958 >> 172.21.15.122:0/1593998958 conn(0x7f8be806bd90 msgr2=0x7f8be8161a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:36.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:36.889+0000 7f8bdcc00640 1 -- 172.21.15.122:0/1593998958 shutdown_connections 2024-05-28T06:13:36.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:36.889+0000 7f8bdcc00640 1 -- 172.21.15.122:0/1593998958 wait complete. 2024-05-28T06:13:36.939 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone47517 2024-05-28T06:13:37.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.197+0000 7f87a2a00640 1 Processor -- start 2024-05-28T06:13:37.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.197+0000 7f87a2a00640 1 -- start start 2024-05-28T06:13:37.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.197+0000 7f87a2a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f879c09ba50 0x7f879c0d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:37.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.197+0000 7f87a2a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f879c0b2620 0x7f879c0b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:37.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.197+0000 7f87a2a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f879c0b1e90 con 0x7f879c15c890 2024-05-28T06:13:37.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.197+0000 7f87a2a00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f879c0cddb0 con 0x7f879c09ba50 2024-05-28T06:13:37.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.197+0000 7f87a2a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f879c0ce090 con 0x7f879c0b2620 2024-05-28T06:13:37.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.197+0000 7f87a0c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f879c09ba50 0x7f879c0d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:37.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.197+0000 7f87a0c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f879c09ba50 0x7f879c0d0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51186/0 (socket says 172.21.15.122:51186) 2024-05-28T06:13:37.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.197+0000 7f87a0c00640 1 -- 172.21.15.122:0/3618907648 learned_addr learned my addr 172.21.15.122:0/3618907648 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:37.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.197+0000 7f87a0c00640 1 -- 172.21.15.122:0/3618907648 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f879c0b2620 msgr2=0x7f879c0b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:37.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.197+0000 7f87a0c00640 1 --2- 172.21.15.122:0/3618907648 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f879c0b2620 0x7f879c0b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:37.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.197+0000 7f87a0c00640 1 -- 172.21.15.122:0/3618907648 >> v1:172.21.15.153:6789/0 conn(0x7f879c15c890 legacy=0x7f879c0d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:37.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.197+0000 7f87a0c00640 1 -- 172.21.15.122:0/3618907648 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879c0b2100 con 0x7f879c09ba50 2024-05-28T06:13:37.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.201+0000 7f87a0c00640 1 --2- 172.21.15.122:0/3618907648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f879c09ba50 0x7f879c0d0770 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f8788009870 tx=0x7f878801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8052621940057565 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:37.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.201+0000 7f879be00640 1 -- 172.21.15.122:0/3618907648 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87880ab640 con 0x7f879c09ba50 2024-05-28T06:13:37.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.201+0000 7f879be00640 1 -- 172.21.15.122:0/3618907648 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87880b0070 con 0x7f879c09ba50 2024-05-28T06:13:37.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.201+0000 7f879be00640 1 -- 172.21.15.122:0/3618907648 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87880aba00 con 0x7f879c09ba50 2024-05-28T06:13:37.204 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.205+0000 7f87a2a00640 1 -- 172.21.15.122:0/3618907648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f879c09ba50 msgr2=0x7f879c0d0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:37.204 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.205+0000 7f87a2a00640 1 --2- 172.21.15.122:0/3618907648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f879c09ba50 0x7f879c0d0770 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f8788009870 tx=0x7f878801c520 comp rx=0 tx=0).stop 2024-05-28T06:13:37.204 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.205+0000 7f87a2a00640 1 -- 172.21.15.122:0/3618907648 shutdown_connections 2024-05-28T06:13:37.204 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.205+0000 7f87a2a00640 1 --2- 172.21.15.122:0/3618907648 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f879c0b2620 0x7f879c0b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:37.204 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.205+0000 7f87a2a00640 1 --2- 172.21.15.122:0/3618907648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f879c09ba50 0x7f879c0d0770 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:37.204 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.205+0000 7f87a2a00640 1 -- 172.21.15.122:0/3618907648 >> 172.21.15.122:0/3618907648 conn(0x7f879c0b3f80 msgr2=0x7f879c0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:37.204 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.205+0000 7f87a2a00640 1 -- 172.21.15.122:0/3618907648 shutdown_connections 2024-05-28T06:13:37.204 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.205+0000 7f87a2a00640 1 -- 172.21.15.122:0/3618907648 wait complete. 2024-05-28T06:13:37.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.205+0000 7f87a2a00640 1 Processor -- start 2024-05-28T06:13:37.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.205+0000 7f87a2a00640 1 -- start start 2024-05-28T06:13:37.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.205+0000 7f87a2a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f879c09ba50 0x7f879c0b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:37.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.205+0000 7f87a2a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f879c0b2620 0x7f879c152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:37.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.205+0000 7f87a2a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f879c15c890 0x7f879c154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:37.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.205+0000 7f87a2a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f879c169440 con 0x7f879c0b2620 2024-05-28T06:13:37.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.205+0000 7f87a2a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f879c1692c0 con 0x7f879c15c890 2024-05-28T06:13:37.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.205+0000 7f87a2a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f879c1695c0 con 0x7f879c09ba50 2024-05-28T06:13:37.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.209+0000 7f87a0c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f879c0b2620 0x7f879c152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:37.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.209+0000 7f87a0c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f879c0b2620 0x7f879c152ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51200/0 (socket says 172.21.15.122:51200) 2024-05-28T06:13:37.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.209+0000 7f87a0c00640 1 -- 172.21.15.122:0/154345328 learned_addr learned my addr 172.21.15.122:0/154345328 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:37.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.209+0000 7f87a1600640 1 --2- 172.21.15.122:0/154345328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f879c09ba50 0x7f879c0b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:37.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.209+0000 7f87a2000640 1 --2- 172.21.15.122:0/154345328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f879c15c890 0x7f879c154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:37.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.209+0000 7f87a0c00640 1 -- 172.21.15.122:0/154345328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f879c09ba50 msgr2=0x7f879c0b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:37.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.209+0000 7f87a0c00640 1 --2- 172.21.15.122:0/154345328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f879c09ba50 0x7f879c0b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:37.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.209+0000 7f87a0c00640 1 -- 172.21.15.122:0/154345328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f879c15c890 msgr2=0x7f879c154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:37.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.209+0000 7f87a0c00640 1 --2- 172.21.15.122:0/154345328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f879c15c890 0x7f879c154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:37.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.209+0000 7f87a0c00640 1 -- 172.21.15.122:0/154345328 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879c166940 con 0x7f879c0b2620 2024-05-28T06:13:37.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.209+0000 7f87a2000640 1 --2- 172.21.15.122:0/154345328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f879c15c890 0x7f879c154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:13:37.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.209+0000 7f87a0c00640 1 --2- 172.21.15.122:0/154345328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f879c0b2620 0x7f879c152ab0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f87880ad040 tx=0x7f878801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:37.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.209+0000 7f8799600640 1 -- 172.21.15.122:0/154345328 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87880be3f0 con 0x7f879c0b2620 2024-05-28T06:13:37.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.209+0000 7f8799600640 1 -- 172.21.15.122:0/154345328 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87880be5b0 con 0x7f879c0b2620 2024-05-28T06:13:37.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.209+0000 7f87a2a00640 1 -- 172.21.15.122:0/154345328 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f879c166380 con 0x7f879c0b2620 2024-05-28T06:13:37.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.209+0000 7f8799600640 1 -- 172.21.15.122:0/154345328 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87880be9a0 con 0x7f879c0b2620 2024-05-28T06:13:37.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.209+0000 7f87a2a00640 1 -- 172.21.15.122:0/154345328 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f879c06cb40 con 0x7f879c0b2620 2024-05-28T06:13:37.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.209+0000 7f87a2a00640 1 -- 172.21.15.122:0/154345328 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f879c075620 con 0x7f879c0b2620 2024-05-28T06:13:37.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.209+0000 7f8799600640 1 -- 172.21.15.122:0/154345328 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 22) ==== 89160+0+0 (secure 0 0 0) 0x7f879c0b3800 con 0x7f879c0b2620 2024-05-28T06:13:37.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.213+0000 7f8799600640 1 --2- 172.21.15.122:0/154345328 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f877c069070 0x7f877c06b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:37.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.213+0000 7f8799600640 1 -- 172.21.15.122:0/154345328 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f878811f660 con 0x7f879c0b2620 2024-05-28T06:13:37.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.213+0000 7f87a1600640 1 --2- 172.21.15.122:0/154345328 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f877c069070 0x7f877c06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:37.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.213+0000 7f87a1600640 1 --2- 172.21.15.122:0/154345328 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f877c069070 0x7f877c06b530 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f87900098e0 tx=0x7f8790009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:37.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.217+0000 7f8799600640 1 -- 172.21.15.122:0/154345328 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f87880c4060 con 0x7f879c0b2620 2024-05-28T06:13:37.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.569+0000 7f87a2a00640 1 -- 172.21.15.122:0/154345328 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone47517", "target": ["mon-mgr", ""]}) -- 0x7f879c1597a0 con 0x7f877c069070 2024-05-28T06:13:37.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.673+0000 7f8799600640 1 -- 172.21.15.122:0/154345328 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f879c1597a0 con 0x7f877c069070 2024-05-28T06:13:37.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.677+0000 7f87a2a00640 1 -- 172.21.15.122:0/154345328 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f877c069070 msgr2=0x7f877c06b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:37.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.677+0000 7f87a2a00640 1 --2- 172.21.15.122:0/154345328 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f877c069070 0x7f877c06b530 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f87900098e0 tx=0x7f8790009060 comp rx=0 tx=0).stop 2024-05-28T06:13:37.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.677+0000 7f87a2a00640 1 -- 172.21.15.122:0/154345328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f879c0b2620 msgr2=0x7f879c152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:37.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.677+0000 7f87a2a00640 1 --2- 172.21.15.122:0/154345328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f879c0b2620 0x7f879c152ab0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f87880ad040 tx=0x7f878801ad60 comp rx=0 tx=0).stop 2024-05-28T06:13:37.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.677+0000 7f87a2a00640 1 -- 172.21.15.122:0/154345328 shutdown_connections 2024-05-28T06:13:37.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.677+0000 7f87a2a00640 1 --2- 172.21.15.122:0/154345328 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f877c069070 0x7f877c06b530 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:37.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.677+0000 7f87a2a00640 1 --2- 172.21.15.122:0/154345328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f879c15c890 0x7f879c154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:37.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.677+0000 7f87a2a00640 1 --2- 172.21.15.122:0/154345328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f879c0b2620 0x7f879c152ab0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:37.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.677+0000 7f87a2a00640 1 --2- 172.21.15.122:0/154345328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f879c09ba50 0x7f879c0b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:37.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.677+0000 7f87a2a00640 1 -- 172.21.15.122:0/154345328 >> 172.21.15.122:0/154345328 conn(0x7f879c0b3f80 msgr2=0x7f879c0ce700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:37.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.677+0000 7f87a2a00640 1 -- 172.21.15.122:0/154345328 shutdown_connections 2024-05-28T06:13:37.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.677+0000 7f87a2a00640 1 -- 172.21.15.122:0/154345328 wait complete. 2024-05-28T06:13:37.696 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-28T06:13:37.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.833+0000 7fd681c00640 1 Processor -- start 2024-05-28T06:13:37.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.833+0000 7fd681c00640 1 -- start start 2024-05-28T06:13:37.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.833+0000 7fd681c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd67c159280 0x7fd67c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:37.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.833+0000 7fd681c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd67c15c7a0 0x7fd67c06f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:37.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.833+0000 7fd681c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd67c0b54d0 con 0x7fd67c0cced0 2024-05-28T06:13:37.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.833+0000 7fd681c00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fd67c15c310 con 0x7fd67c159280 2024-05-28T06:13:37.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.833+0000 7fd681c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd67c0b57b0 con 0x7fd67c15c7a0 2024-05-28T06:13:37.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.833+0000 7fd67aa00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd67c159280 0x7fd67c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:37.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.833+0000 7fd67aa00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd67c159280 0x7fd67c0b4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51210/0 (socket says 172.21.15.122:51210) 2024-05-28T06:13:37.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.833+0000 7fd67b400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fd67c0cced0 0x7fd67c15f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47342/0 (socket says 172.21.15.122:47342) 2024-05-28T06:13:37.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.833+0000 7fd67aa00640 1 -- 172.21.15.122:0/1303019091 learned_addr learned my addr 172.21.15.122:0/1303019091 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:37.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.833+0000 7fd672000640 1 --2- 172.21.15.122:0/1303019091 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd67c15c7a0 0x7fd67c06f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:37.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.833+0000 7fd67aa00640 1 -- 172.21.15.122:0/1303019091 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd67c15c7a0 msgr2=0x7fd67c06f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:37.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.833+0000 7fd67aa00640 1 --2- 172.21.15.122:0/1303019091 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd67c15c7a0 0x7fd67c06f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:37.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.833+0000 7fd67aa00640 1 -- 172.21.15.122:0/1303019091 >> v1:172.21.15.122:6789/0 conn(0x7fd67c0cced0 legacy=0x7fd67c15f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:37.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.833+0000 7fd67aa00640 1 -- 172.21.15.122:0/1303019091 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67c15bfa0 con 0x7fd67c159280 2024-05-28T06:13:37.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.833+0000 7fd67a000640 1 -- 172.21.15.122:0/1303019091 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4286107933 0 0) 0x7fd67c0b54d0 con 0x7fd67c0cced0 2024-05-28T06:13:37.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.837+0000 7fd67aa00640 1 --2- 172.21.15.122:0/1303019091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd67c159280 0x7fd67c0b4e10 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fd66c009e50 tx=0x7fd66c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d33e1711d706e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:37.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.837+0000 7fd67a000640 1 -- 172.21.15.122:0/1303019091 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c0a5700 con 0x7fd67c159280 2024-05-28T06:13:37.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.837+0000 7fd67a000640 1 -- 172.21.15.122:0/1303019091 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd66c0a58a0 con 0x7fd67c159280 2024-05-28T06:13:37.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.837+0000 7fd67a000640 1 -- 172.21.15.122:0/1303019091 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c0a5c70 con 0x7fd67c159280 2024-05-28T06:13:37.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.837+0000 7fd681c00640 1 -- 172.21.15.122:0/1303019091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd67c159280 msgr2=0x7fd67c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:37.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.837+0000 7fd681c00640 1 --2- 172.21.15.122:0/1303019091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd67c159280 0x7fd67c0b4e10 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fd66c009e50 tx=0x7fd66c01ca30 comp rx=0 tx=0).stop 2024-05-28T06:13:37.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.837+0000 7fd681c00640 1 -- 172.21.15.122:0/1303019091 shutdown_connections 2024-05-28T06:13:37.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.837+0000 7fd681c00640 1 --2- 172.21.15.122:0/1303019091 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd67c15c7a0 0x7fd67c06f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:37.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.837+0000 7fd681c00640 1 --2- 172.21.15.122:0/1303019091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd67c159280 0x7fd67c0b4e10 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:37.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.837+0000 7fd681c00640 1 -- 172.21.15.122:0/1303019091 >> 172.21.15.122:0/1303019091 conn(0x7fd67c062a40 msgr2=0x7fd67c06b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:37.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.837+0000 7fd681c00640 1 -- 172.21.15.122:0/1303019091 shutdown_connections 2024-05-28T06:13:37.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.837+0000 7fd681c00640 1 -- 172.21.15.122:0/1303019091 wait complete. 2024-05-28T06:13:37.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd681c00640 1 Processor -- start 2024-05-28T06:13:37.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd681c00640 1 -- start start 2024-05-28T06:13:37.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd681c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd67c0cced0 0x7fd67c164ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:37.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd681c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd67c159280 0x7fd67c164020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:37.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd681c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd67c15c7a0 0x7fd67c0aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:37.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd681c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c0cd710 con 0x7fd67c15c7a0 2024-05-28T06:13:37.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd681c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c15cb80 con 0x7fd67c159280 2024-05-28T06:13:37.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd681c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd67c1632a0 con 0x7fd67c0cced0 2024-05-28T06:13:37.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd67b400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd67c15c7a0 0x7fd67c0aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:37.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd67b400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd67c15c7a0 0x7fd67c0aaf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51212/0 (socket says 172.21.15.122:51212) 2024-05-28T06:13:37.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd67b400640 1 -- 172.21.15.122:0/1920272760 learned_addr learned my addr 172.21.15.122:0/1920272760 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:37.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd67aa00640 1 --2- 172.21.15.122:0/1920272760 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd67c0cced0 0x7fd67c164ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:37.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd672000640 1 --2- 172.21.15.122:0/1920272760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd67c159280 0x7fd67c164020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:37.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd67b400640 1 -- 172.21.15.122:0/1920272760 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd67c0cced0 msgr2=0x7fd67c164ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:37.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd67b400640 1 --2- 172.21.15.122:0/1920272760 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd67c0cced0 0x7fd67c164ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:37.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd67b400640 1 -- 172.21.15.122:0/1920272760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd67c159280 msgr2=0x7fd67c164020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:37.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd67b400640 1 --2- 172.21.15.122:0/1920272760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd67c159280 0x7fd67c164020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:37.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd67b400640 1 -- 172.21.15.122:0/1920272760 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67c1653e0 con 0x7fd67c15c7a0 2024-05-28T06:13:37.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd67aa00640 1 --2- 172.21.15.122:0/1920272760 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd67c0cced0 0x7fd67c164ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:13:37.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd67b400640 1 --2- 172.21.15.122:0/1920272760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd67c15c7a0 0x7fd67c0aaf20 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fd67400c3e0 tx=0x7fd67400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:37.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd673400640 1 -- 172.21.15.122:0/1920272760 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6740074e0 con 0x7fd67c15c7a0 2024-05-28T06:13:37.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd673400640 1 -- 172.21.15.122:0/1920272760 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6740047f0 con 0x7fd67c15c7a0 2024-05-28T06:13:37.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd673400640 1 -- 172.21.15.122:0/1920272760 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd674004be0 con 0x7fd67c15c7a0 2024-05-28T06:13:37.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.841+0000 7fd681c00640 1 -- 172.21.15.122:0/1920272760 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd67c1635a0 con 0x7fd67c15c7a0 2024-05-28T06:13:37.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.845+0000 7fd681c00640 1 -- 172.21.15.122:0/1920272760 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd67c0a9a10 con 0x7fd67c15c7a0 2024-05-28T06:13:37.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.845+0000 7fd681c00640 1 -- 172.21.15.122:0/1920272760 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd67c068bd0 con 0x7fd67c15c7a0 2024-05-28T06:13:37.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.845+0000 7fd673400640 1 -- 172.21.15.122:0/1920272760 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 22) ==== 89160+0+0 (secure 0 0 0) 0x7fd674011070 con 0x7fd67c15c7a0 2024-05-28T06:13:37.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.845+0000 7fd673400640 1 --2- 172.21.15.122:0/1920272760 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd658069070 0x7fd65806b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:37.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.845+0000 7fd673400640 1 -- 172.21.15.122:0/1920272760 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7fd674084e10 con 0x7fd67c15c7a0 2024-05-28T06:13:37.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.845+0000 7fd67aa00640 1 --2- 172.21.15.122:0/1920272760 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd658069070 0x7fd65806b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:37.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.845+0000 7fd67aa00640 1 --2- 172.21.15.122:0/1920272760 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd658069070 0x7fd65806b530 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0ae000 tx=0x7fd66c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:37.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:37.849+0000 7fd673400640 1 -- 172.21.15.122:0/1920272760 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd67c1635a0 con 0x7fd67c15c7a0 2024-05-28T06:13:38.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.033+0000 7fd681c00640 1 -- 172.21.15.122:0/1920272760 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fd67c163d40 con 0x7fd658069070 2024-05-28T06:13:38.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.033+0000 7fd673400640 1 -- 172.21.15.122:0/1920272760 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fd66c009150 con 0x7fd658069070 2024-05-28T06:13:38.034 INFO:teuthology.orchestra.run.smithi122.stdout:[ 2024-05-28T06:13:38.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:13:38.034 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "cephfs" 2024-05-28T06:13:38.034 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:13:38.034 INFO:teuthology.orchestra.run.smithi122.stdout:] 2024-05-28T06:13:38.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.037+0000 7fd681c00640 1 -- 172.21.15.122:0/1920272760 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd658069070 msgr2=0x7fd65806b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:38.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.037+0000 7fd681c00640 1 --2- 172.21.15.122:0/1920272760 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd658069070 0x7fd65806b530 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0ae000 tx=0x7fd66c0a7070 comp rx=0 tx=0).stop 2024-05-28T06:13:38.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.037+0000 7fd681c00640 1 -- 172.21.15.122:0/1920272760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd67c15c7a0 msgr2=0x7fd67c0aaf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:38.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.037+0000 7fd681c00640 1 --2- 172.21.15.122:0/1920272760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd67c15c7a0 0x7fd67c0aaf20 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fd67400c3e0 tx=0x7fd67400c8a0 comp rx=0 tx=0).stop 2024-05-28T06:13:38.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.037+0000 7fd681c00640 1 -- 172.21.15.122:0/1920272760 shutdown_connections 2024-05-28T06:13:38.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.037+0000 7fd681c00640 1 --2- 172.21.15.122:0/1920272760 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd658069070 0x7fd65806b530 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:38.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.037+0000 7fd681c00640 1 --2- 172.21.15.122:0/1920272760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd67c15c7a0 0x7fd67c0aaf20 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:38.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.037+0000 7fd681c00640 1 --2- 172.21.15.122:0/1920272760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd67c159280 0x7fd67c164020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:38.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.037+0000 7fd681c00640 1 --2- 172.21.15.122:0/1920272760 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd67c0cced0 0x7fd67c164ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:38.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.037+0000 7fd681c00640 1 -- 172.21.15.122:0/1920272760 >> 172.21.15.122:0/1920272760 conn(0x7fd67c062a40 msgr2=0x7fd67c06df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:38.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.037+0000 7fd681c00640 1 -- 172.21.15.122:0/1920272760 shutdown_connections 2024-05-28T06:13:38.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.037+0000 7fd681c00640 1 -- 172.21.15.122:0/1920272760 wait complete. 2024-05-28T06:13:38.055 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:13:38.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.189+0000 7f4194c00640 1 Processor -- start 2024-05-28T06:13:38.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.189+0000 7f4194c00640 1 -- start start 2024-05-28T06:13:38.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.193+0000 7f4194c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4190160510 0x7f419009b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:38.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.193+0000 7f4194c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41901608f0 0x7f419015d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:38.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.193+0000 7f4194c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41900cd3c0 con 0x7f419009b990 2024-05-28T06:13:38.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.193+0000 7f4194c00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f41900cd6a0 con 0x7f4190160510 2024-05-28T06:13:38.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.193+0000 7f4194c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f41900cd980 con 0x7f41901608f0 2024-05-28T06:13:38.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.193+0000 7f418f400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4190160510 0x7f419009b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:38.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.193+0000 7f418f400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4190160510 0x7f419009b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51220/0 (socket says 172.21.15.122:51220) 2024-05-28T06:13:38.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.193+0000 7f418f400640 1 -- 172.21.15.122:0/2323690035 learned_addr learned my addr 172.21.15.122:0/2323690035 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:38.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.193+0000 7f418fe00640 1 --2- 172.21.15.122:0/2323690035 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41901608f0 0x7f419015d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:38.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.193+0000 7f418f400640 1 -- 172.21.15.122:0/2323690035 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41901608f0 msgr2=0x7f419015d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:38.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.193+0000 7f418f400640 1 --2- 172.21.15.122:0/2323690035 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41901608f0 0x7f419015d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:38.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.193+0000 7f418f400640 1 -- 172.21.15.122:0/2323690035 >> v1:172.21.15.153:6789/0 conn(0x7f419009b990 legacy=0x7f41900d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:38.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.193+0000 7f418f400640 1 -- 172.21.15.122:0/2323690035 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41900cdc60 con 0x7f4190160510 2024-05-28T06:13:38.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.193+0000 7f418f400640 1 --2- 172.21.15.122:0/2323690035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4190160510 0x7f419009b450 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f4180009e50 tx=0x7f418001f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317a3ba9d9ddf331 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:38.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f418ea00640 1 -- 172.21.15.122:0/2323690035 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41800b4070 con 0x7f4190160510 2024-05-28T06:13:38.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f418ea00640 1 -- 172.21.15.122:0/2323690035 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41800af400 con 0x7f4190160510 2024-05-28T06:13:38.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f418ea00640 1 -- 172.21.15.122:0/2323690035 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41800af7d0 con 0x7f4190160510 2024-05-28T06:13:38.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f4194c00640 1 -- 172.21.15.122:0/2323690035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4190160510 msgr2=0x7f419009b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:38.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f4194c00640 1 --2- 172.21.15.122:0/2323690035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4190160510 0x7f419009b450 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f4180009e50 tx=0x7f418001f210 comp rx=0 tx=0).stop 2024-05-28T06:13:38.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f4194c00640 1 -- 172.21.15.122:0/2323690035 shutdown_connections 2024-05-28T06:13:38.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f4194c00640 1 --2- 172.21.15.122:0/2323690035 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41901608f0 0x7f419015d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:38.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f4194c00640 1 --2- 172.21.15.122:0/2323690035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4190160510 0x7f419009b450 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:38.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f4194c00640 1 -- 172.21.15.122:0/2323690035 >> 172.21.15.122:0/2323690035 conn(0x7f41900d24d0 msgr2=0x7f41900d28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:38.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f4194c00640 1 -- 172.21.15.122:0/2323690035 shutdown_connections 2024-05-28T06:13:38.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f4194c00640 1 -- 172.21.15.122:0/2323690035 wait complete. 2024-05-28T06:13:38.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f4194c00640 1 Processor -- start 2024-05-28T06:13:38.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f4194c00640 1 -- start start 2024-05-28T06:13:38.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f4194c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4190160510 0x7f419015f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:38.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f4194c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41901608f0 0x7f41900cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:38.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f4194c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41900cbdc0 0x7f419006caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:38.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f4194c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f41900d07b0 con 0x7f41900cbdc0 2024-05-28T06:13:38.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f4194c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f41900cd050 con 0x7f4190160510 2024-05-28T06:13:38.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f4194c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f41900d0930 con 0x7f41901608f0 2024-05-28T06:13:38.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f418fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41900cbdc0 0x7f419006caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:38.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f418f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4190160510 0x7f419015f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:38.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f418f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4190160510 0x7f419015f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:57476/0 (socket says 172.21.15.122:57476) 2024-05-28T06:13:38.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f418f400640 1 -- 172.21.15.122:0/2670359861 learned_addr learned my addr 172.21.15.122:0/2670359861 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:38.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.197+0000 7f4186a00640 1 --2- 172.21.15.122:0/2670359861 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41901608f0 0x7f41900cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:38.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.201+0000 7f418fe00640 1 -- 172.21.15.122:0/2670359861 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41901608f0 msgr2=0x7f41900cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:38.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.201+0000 7f418fe00640 1 --2- 172.21.15.122:0/2670359861 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41901608f0 0x7f41900cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:38.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.201+0000 7f418fe00640 1 -- 172.21.15.122:0/2670359861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4190160510 msgr2=0x7f419015f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:38.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.201+0000 7f418fe00640 1 --2- 172.21.15.122:0/2670359861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4190160510 0x7f419015f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:38.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.201+0000 7f418fe00640 1 -- 172.21.15.122:0/2670359861 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41900cc560 con 0x7f41900cbdc0 2024-05-28T06:13:38.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.201+0000 7f418fe00640 1 --2- 172.21.15.122:0/2670359861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41900cbdc0 0x7f419006caa0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f418800d4b0 tx=0x7f418800d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:38.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.201+0000 7f4187e00640 1 -- 172.21.15.122:0/2670359861 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4188004020 con 0x7f41900cbdc0 2024-05-28T06:13:38.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.201+0000 7f4187e00640 1 -- 172.21.15.122:0/2670359861 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41880041e0 con 0x7f41900cbdc0 2024-05-28T06:13:38.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.201+0000 7f4194c00640 1 -- 172.21.15.122:0/2670359861 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41900cc840 con 0x7f41900cbdc0 2024-05-28T06:13:38.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.201+0000 7f4187e00640 1 -- 172.21.15.122:0/2670359861 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41880043d0 con 0x7f41900cbdc0 2024-05-28T06:13:38.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.201+0000 7f4194c00640 1 -- 172.21.15.122:0/2670359861 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41900b5660 con 0x7f41900cbdc0 2024-05-28T06:13:38.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.201+0000 7f4194c00640 1 -- 172.21.15.122:0/2670359861 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4190075620 con 0x7f41900cbdc0 2024-05-28T06:13:38.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.201+0000 7f4187e00640 1 -- 172.21.15.122:0/2670359861 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 22) ==== 89160+0+0 (secure 0 0 0) 0x7f418801b020 con 0x7f41900cbdc0 2024-05-28T06:13:38.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.201+0000 7f4187e00640 1 --2- 172.21.15.122:0/2670359861 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f416c069070 0x7f416c06b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:38.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.201+0000 7f4187e00640 1 -- 172.21.15.122:0/2670359861 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f41880852a0 con 0x7f41900cbdc0 2024-05-28T06:13:38.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.201+0000 7f418f400640 1 --2- 172.21.15.122:0/2670359861 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f416c069070 0x7f416c06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:38.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.205+0000 7f418f400640 1 --2- 172.21.15.122:0/2670359861 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f416c069070 0x7f416c06b530 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4180000f90 tx=0x7f41800aa000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:38.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.205+0000 7f4187e00640 1 -- 172.21.15.122:0/2670359861 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4188056940 con 0x7f41900cbdc0 2024-05-28T06:13:38.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.421+0000 7f4194c00640 1 -- 172.21.15.122:0/2670359861 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f41900d3370 con 0x7f41900cbdc0 2024-05-28T06:13:38.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.421+0000 7f4187e00640 1 -- 172.21.15.122:0/2670359861 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2419 (secure 0 0 0) 0x7f418805ac40 con 0x7f41900cbdc0 2024-05-28T06:13:38.423 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:13:38.423 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:13:38.423 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:13:38.424 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:13:38.424 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:13:38.424 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:13:38.424 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:13:38.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:38.424 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:13:38.424 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:13:38.424 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:13:38.424 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:13:38.424 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:13:38.424 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:38.425 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:13:38.425 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:13:38.425 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:13:38.425 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:13:38.425 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:38.425 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 494, 2024-05-28T06:13:38.425 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:13:38.425 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:13:38.425 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:13:38.425 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:13:38.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:38.425 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:13:38.425 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 62, 2024-05-28T06:13:38.426 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:13:38.426 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:13:38.426 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:13:38.426 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:13:38.426 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:13:38.426 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:13:38.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:38.426 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:13:38.426 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:13:38.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:13:38.426 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:13:38.427 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:13:38.427 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:13:38.427 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:38.427 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:13:38.427 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:13:38.427 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 4073, 2024-05-28T06:13:38.427 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 16930084193, 2024-05-28T06:13:38.427 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 33925615616, 2024-05-28T06:13:38.427 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 739168497664, 2024-05-28T06:13:38.427 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:13:38.427 INFO:teuthology.orchestra.run.smithi122.stdout: "read_bytes_sec": 589725269, 2024-05-28T06:13:38.428 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 589073115, 2024-05-28T06:13:38.428 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 142, 2024-05-28T06:13:38.428 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 155 2024-05-28T06:13:38.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:38.428 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:13:38.428 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 38, 2024-05-28T06:13:38.428 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 4, 2024-05-28T06:13:38.428 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:13:38.428 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:13:38.428 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:13:38.428 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:13:38.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:13:38.429 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 4, 2024-05-28T06:13:38.429 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:13:38.429 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "c", 2024-05-28T06:13:38.429 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:13:38.429 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 6300 2024-05-28T06:13:38.429 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:13:38.429 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:38.429 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:13:38.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:38.429 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:13:38.429 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:13:38.430 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:13:38.430 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:13:38.430 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:13:38.430 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:13:38.430 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:13:38.430 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:38.430 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:13:38.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:38.430 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:13:38.430 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 10, 2024-05-28T06:13:38.430 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:13:37.375536+0000", 2024-05-28T06:13:38.430 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:13:38.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:38.431 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:13:38.431 INFO:teuthology.orchestra.run.smithi122.stdout: "d99f5b57-79d0-4ca8-9bc6-54c2cbc59c2a": { 2024-05-28T06:13:38.431 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "6 ongoing+pending clones; Avg progress is 40.929% (3s)\n [===========.................] (remaining: 5s)", 2024-05-28T06:13:38.431 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.40928998589515686, 2024-05-28T06:13:38.431 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:13:38.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:38.431 INFO:teuthology.orchestra.run.smithi122.stdout: "f6823e37-281c-440e-aebe-a3bb39be0858": { 2024-05-28T06:13:38.431 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "4 ongoing clones; Avg progress is 22.266% (11s)\n [======......................] (remaining: 39s)", 2024-05-28T06:13:38.431 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.22266000509262085, 2024-05-28T06:13:38.431 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:13:38.431 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:13:38.432 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:13:38.432 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:13:38.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.425+0000 7f4194c00640 1 -- 172.21.15.122:0/2670359861 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f416c069070 msgr2=0x7f416c06b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:38.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.425+0000 7f4194c00640 1 --2- 172.21.15.122:0/2670359861 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f416c069070 0x7f416c06b530 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4180000f90 tx=0x7f41800aa000 comp rx=0 tx=0).stop 2024-05-28T06:13:38.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.425+0000 7f4194c00640 1 -- 172.21.15.122:0/2670359861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41900cbdc0 msgr2=0x7f419006caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:38.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.425+0000 7f4194c00640 1 --2- 172.21.15.122:0/2670359861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41900cbdc0 0x7f419006caa0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f418800d4b0 tx=0x7f418800d970 comp rx=0 tx=0).stop 2024-05-28T06:13:38.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.425+0000 7f4194c00640 1 -- 172.21.15.122:0/2670359861 shutdown_connections 2024-05-28T06:13:38.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.425+0000 7f4194c00640 1 --2- 172.21.15.122:0/2670359861 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f416c069070 0x7f416c06b530 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:38.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.425+0000 7f4194c00640 1 --2- 172.21.15.122:0/2670359861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41900cbdc0 0x7f419006caa0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:38.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.425+0000 7f4194c00640 1 --2- 172.21.15.122:0/2670359861 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f41901608f0 0x7f41900cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:38.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.425+0000 7f4194c00640 1 --2- 172.21.15.122:0/2670359861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4190160510 0x7f419015f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:38.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.425+0000 7f4194c00640 1 -- 172.21.15.122:0/2670359861 >> 172.21.15.122:0/2670359861 conn(0x7f41900d24d0 msgr2=0x7f41900cf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:38.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.425+0000 7f4194c00640 1 -- 172.21.15.122:0/2670359861 shutdown_connections 2024-05-28T06:13:38.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:38.425+0000 7f4194c00640 1 -- 172.21.15.122:0/2670359861 wait complete. 2024-05-28T06:13:43.445 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:13:43.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.593+0000 7f491e600640 1 Processor -- start 2024-05-28T06:13:43.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.593+0000 7f491e600640 1 -- start start 2024-05-28T06:13:43.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.593+0000 7f491e600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f49180b58d0 0x7f49180b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:43.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.593+0000 7f491e600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f491815e730 0x7f491815ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:43.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.593+0000 7f491e600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49180b61f0 con 0x7f49180ce4f0 2024-05-28T06:13:43.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.593+0000 7f491e600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f491815d970 con 0x7f49180b58d0 2024-05-28T06:13:43.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.593+0000 7f491e600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f491815dc50 con 0x7f491815e730 2024-05-28T06:13:43.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.593+0000 7f4917400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f49180b58d0 0x7f49180b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:43.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.593+0000 7f4917400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f49180b58d0 0x7f49180b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51242/0 (socket says 172.21.15.122:51242) 2024-05-28T06:13:43.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.593+0000 7f4917400640 1 -- 172.21.15.122:0/3130496515 learned_addr learned my addr 172.21.15.122:0/3130496515 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:43.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.593+0000 7f4916a00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f49180ce4f0 0x7f49180ce980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47358/0 (socket says 172.21.15.122:47358) 2024-05-28T06:13:43.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.593+0000 7f4917e00640 1 --2- 172.21.15.122:0/3130496515 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f491815e730 0x7f491815ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:43.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.593+0000 7f4917400640 1 -- 172.21.15.122:0/3130496515 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f491815e730 msgr2=0x7f491815ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:43.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.593+0000 7f4917400640 1 --2- 172.21.15.122:0/3130496515 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f491815e730 0x7f491815ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:43.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.593+0000 7f4917400640 1 -- 172.21.15.122:0/3130496515 >> v1:172.21.15.122:6789/0 conn(0x7f49180ce4f0 legacy=0x7f49180ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:43.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.593+0000 7f4916000640 1 -- 172.21.15.122:0/3130496515 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1764914525 0 0) 0x7f49180b61f0 con 0x7f49180ce4f0 2024-05-28T06:13:43.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.593+0000 7f4917400640 1 -- 172.21.15.122:0/3130496515 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f491815df30 con 0x7f49180b58d0 2024-05-28T06:13:43.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.593+0000 7f4917e00640 1 --2- 172.21.15.122:0/3130496515 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f491815e730 0x7f491815ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:13:43.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.597+0000 7f4917400640 1 --2- 172.21.15.122:0/3130496515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49180b58d0 0x7f49180b5cb0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f4908009870 tx=0x7f490801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ecefccf53693c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:43.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.597+0000 7f4916000640 1 -- 172.21.15.122:0/3130496515 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49080ab5f0 con 0x7f49180b58d0 2024-05-28T06:13:43.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.597+0000 7f4916000640 1 -- 172.21.15.122:0/3130496515 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49080b0070 con 0x7f49180b58d0 2024-05-28T06:13:43.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.597+0000 7f4916000640 1 -- 172.21.15.122:0/3130496515 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49080ab9b0 con 0x7f49180b58d0 2024-05-28T06:13:43.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.597+0000 7f491e600640 1 -- 172.21.15.122:0/3130496515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49180b58d0 msgr2=0x7f49180b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:43.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.597+0000 7f491e600640 1 --2- 172.21.15.122:0/3130496515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49180b58d0 0x7f49180b5cb0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f4908009870 tx=0x7f490801c560 comp rx=0 tx=0).stop 2024-05-28T06:13:43.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.597+0000 7f491e600640 1 -- 172.21.15.122:0/3130496515 shutdown_connections 2024-05-28T06:13:43.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.597+0000 7f491e600640 1 --2- 172.21.15.122:0/3130496515 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f491815e730 0x7f491815ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:43.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.597+0000 7f491e600640 1 --2- 172.21.15.122:0/3130496515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49180b58d0 0x7f49180b5cb0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:43.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.597+0000 7f491e600640 1 -- 172.21.15.122:0/3130496515 >> 172.21.15.122:0/3130496515 conn(0x7f491806bd90 msgr2=0x7f491806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:43.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.597+0000 7f491e600640 1 -- 172.21.15.122:0/3130496515 shutdown_connections 2024-05-28T06:13:43.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.597+0000 7f491e600640 1 -- 172.21.15.122:0/3130496515 wait complete. 2024-05-28T06:13:43.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.597+0000 7f491e600640 1 Processor -- start 2024-05-28T06:13:43.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.597+0000 7f491e600640 1 -- start start 2024-05-28T06:13:43.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f491e600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49180b58d0 0x7f491813ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:43.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f491e600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49180ce4f0 0x7f49180b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:43.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f491e600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f491815e730 0x7f49180b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:43.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f491e600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f49181693d0 con 0x7f49180ce4f0 2024-05-28T06:13:43.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f491e600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4918169250 con 0x7f49180b58d0 2024-05-28T06:13:43.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f491e600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4918169550 con 0x7f491815e730 2024-05-28T06:13:43.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f4916a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49180ce4f0 0x7f49180b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:43.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f4916a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49180ce4f0 0x7f49180b3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51250/0 (socket says 172.21.15.122:51250) 2024-05-28T06:13:43.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f4916a00640 1 -- 172.21.15.122:0/3870111487 learned_addr learned my addr 172.21.15.122:0/3870111487 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:43.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f4917400640 1 --2- 172.21.15.122:0/3870111487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49180b58d0 0x7f491813ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:43.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f4917e00640 1 --2- 172.21.15.122:0/3870111487 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f491815e730 0x7f49180b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:43.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f4916a00640 1 -- 172.21.15.122:0/3870111487 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f491815e730 msgr2=0x7f49180b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:43.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f4916a00640 1 --2- 172.21.15.122:0/3870111487 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f491815e730 0x7f49180b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:43.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f4916a00640 1 -- 172.21.15.122:0/3870111487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49180b58d0 msgr2=0x7f491813ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:43.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f4916a00640 1 --2- 172.21.15.122:0/3870111487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49180b58d0 0x7f491813ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:43.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f4916a00640 1 -- 172.21.15.122:0/3870111487 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49180b04b0 con 0x7f49180ce4f0 2024-05-28T06:13:43.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f4917400640 1 --2- 172.21.15.122:0/3870111487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49180b58d0 0x7f491813ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:13:43.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f4917e00640 1 --2- 172.21.15.122:0/3870111487 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f491815e730 0x7f49180b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:13:43.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f4916a00640 1 --2- 172.21.15.122:0/3870111487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49180ce4f0 0x7f49180b3f90 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f49040011f0 tx=0x7f490400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:43.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f490f400640 1 -- 172.21.15.122:0/3870111487 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4904018070 con 0x7f49180ce4f0 2024-05-28T06:13:43.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f490f400640 1 -- 172.21.15.122:0/3870111487 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49040074e0 con 0x7f49180ce4f0 2024-05-28T06:13:43.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f490f400640 1 -- 172.21.15.122:0/3870111487 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4904004a10 con 0x7f49180ce4f0 2024-05-28T06:13:43.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f491e600640 1 -- 172.21.15.122:0/3870111487 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49181584d0 con 0x7f49180ce4f0 2024-05-28T06:13:43.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f491e600640 1 -- 172.21.15.122:0/3870111487 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4918158a90 con 0x7f49180ce4f0 2024-05-28T06:13:43.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.601+0000 7f491e600640 1 -- 172.21.15.122:0/3870111487 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4918068c40 con 0x7f49180ce4f0 2024-05-28T06:13:43.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.605+0000 7f490f400640 1 -- 172.21.15.122:0/3870111487 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 22) ==== 89160+0+0 (secure 0 0 0) 0x7f4904004bb0 con 0x7f49180ce4f0 2024-05-28T06:13:43.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.605+0000 7f490f400640 1 --2- 172.21.15.122:0/3870111487 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f48f8069070 0x7f48f806b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:43.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.605+0000 7f490f400640 1 -- 172.21.15.122:0/3870111487 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f4904084810 con 0x7f49180ce4f0 2024-05-28T06:13:43.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.605+0000 7f4917400640 1 --2- 172.21.15.122:0/3870111487 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f48f8069070 0x7f48f806b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:43.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.605+0000 7f4917400640 1 --2- 172.21.15.122:0/3870111487 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f48f8069070 0x7f48f806b530 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f49080af000 tx=0x7f49080a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:43.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.609+0000 7f490f400640 1 -- 172.21.15.122:0/3870111487 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f49040567e0 con 0x7f49180ce4f0 2024-05-28T06:13:43.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.825+0000 7f491e600640 1 -- 172.21.15.122:0/3870111487 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f49180b0680 con 0x7f49180ce4f0 2024-05-28T06:13:43.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.825+0000 7f490f400640 1 -- 172.21.15.122:0/3870111487 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2419 (secure 0 0 0) 0x7f49040560e0 con 0x7f49180ce4f0 2024-05-28T06:13:43.825 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:13:43.825 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:13:43.825 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:13:43.825 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:13:43.825 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:13:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:13:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:13:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:13:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:13:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:13:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:13:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:13:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:13:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:13:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:13:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:13:43.826 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 499, 2024-05-28T06:13:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:13:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:13:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:13:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:13:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:13:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 62, 2024-05-28T06:13:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:13:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:13:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:13:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:13:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:13:43.827 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:13:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:13:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:13:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:13:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:13:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:13:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:13:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:13:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:13:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 4906, 2024-05-28T06:13:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 20428474059, 2024-05-28T06:13:43.828 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 41283346432, 2024-05-28T06:13:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 731810766848, 2024-05-28T06:13:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:13:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: "read_bytes_sec": 564981604, 2024-05-28T06:13:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 569587085, 2024-05-28T06:13:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 138, 2024-05-28T06:13:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 157 2024-05-28T06:13:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:13:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 38, 2024-05-28T06:13:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 4, 2024-05-28T06:13:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:13:43.829 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:13:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:13:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:13:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:13:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 4, 2024-05-28T06:13:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:13:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "c", 2024-05-28T06:13:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:13:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 6300 2024-05-28T06:13:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:13:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:13:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:43.830 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:13:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:13:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:13:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:13:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:13:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:13:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:13:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:13:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:13:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 10, 2024-05-28T06:13:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:13:37.375536+0000", 2024-05-28T06:13:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:13:43.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:13:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: "d99f5b57-79d0-4ca8-9bc6-54c2cbc59c2a": { 2024-05-28T06:13:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "6 ongoing+pending clones; Avg progress is 40.929% (3s)\n [===========.................] (remaining: 5s)", 2024-05-28T06:13:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.40928998589515686, 2024-05-28T06:13:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:13:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: "f6823e37-281c-440e-aebe-a3bb39be0858": { 2024-05-28T06:13:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "4 ongoing clones; Avg progress is 22.266% (11s)\n [======......................] (remaining: 39s)", 2024-05-28T06:13:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.22266000509262085, 2024-05-28T06:13:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:13:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:13:43.832 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:13:43.832 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:13:43.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.825+0000 7f491e600640 1 -- 172.21.15.122:0/3870111487 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f48f8069070 msgr2=0x7f48f806b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:43.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.825+0000 7f491e600640 1 --2- 172.21.15.122:0/3870111487 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f48f8069070 0x7f48f806b530 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f49080af000 tx=0x7f49080a7000 comp rx=0 tx=0).stop 2024-05-28T06:13:43.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.825+0000 7f491e600640 1 -- 172.21.15.122:0/3870111487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49180ce4f0 msgr2=0x7f49180b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:43.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.825+0000 7f491e600640 1 --2- 172.21.15.122:0/3870111487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49180ce4f0 0x7f49180b3f90 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f49040011f0 tx=0x7f490400c9b0 comp rx=0 tx=0).stop 2024-05-28T06:13:43.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.825+0000 7f491e600640 1 -- 172.21.15.122:0/3870111487 shutdown_connections 2024-05-28T06:13:43.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.825+0000 7f491e600640 1 --2- 172.21.15.122:0/3870111487 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f48f8069070 0x7f48f806b530 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:43.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.825+0000 7f491e600640 1 --2- 172.21.15.122:0/3870111487 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f491815e730 0x7f49180b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:43.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.825+0000 7f491e600640 1 --2- 172.21.15.122:0/3870111487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49180ce4f0 0x7f49180b3f90 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:43.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.825+0000 7f491e600640 1 --2- 172.21.15.122:0/3870111487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49180b58d0 0x7f491813ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:43.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.825+0000 7f491e600640 1 -- 172.21.15.122:0/3870111487 >> 172.21.15.122:0/3870111487 conn(0x7f491806bd90 msgr2=0x7f491813ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:43.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.829+0000 7f491e600640 1 -- 172.21.15.122:0/3870111487 shutdown_connections 2024-05-28T06:13:43.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:43.829+0000 7f491e600640 1 -- 172.21.15.122:0/3870111487 wait complete. 2024-05-28T06:13:48.522 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:13:48.527 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:13:48.848 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:13:48.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.993+0000 7f708ae00640 1 Processor -- start 2024-05-28T06:13:48.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.993+0000 7f708ae00640 1 -- start start 2024-05-28T06:13:48.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.993+0000 7f708ae00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f708415c760 0x7f70840b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:48.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.993+0000 7f708ae00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f708409b150 0x7f70840cd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:48.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.993+0000 7f708ae00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70840c8af0 con 0x7f70840c83a0 2024-05-28T06:13:48.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.993+0000 7f708ae00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f70840c8dd0 con 0x7f708409b150 2024-05-28T06:13:48.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.993+0000 7f708ae00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f70840c90b0 con 0x7f708415c760 2024-05-28T06:13:48.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.993+0000 7f7089a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f708415c760 0x7f70840b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:48.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.993+0000 7f7089a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f708415c760 0x7f70840b1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:60522/0 (socket says 172.21.15.122:60522) 2024-05-28T06:13:48.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.993+0000 7f7089a00640 1 -- 172.21.15.122:0/4093973789 learned_addr learned my addr 172.21.15.122:0/4093973789 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:48.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.993+0000 7f7089000640 1 --1- 172.21.15.122:0/4093973789 >> v1:172.21.15.153:6789/0 conn(0x7f70840c83a0 0x7f708409aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:38416/0 (socket says 172.21.15.122:38416) 2024-05-28T06:13:48.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.993+0000 7f708a400640 1 --2- 172.21.15.122:0/4093973789 >> v2:172.21.15.153:3300/0 conn(0x7f708409b150 0x7f70840cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:48.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.993+0000 7f7089a00640 1 -- 172.21.15.122:0/4093973789 >> v2:172.21.15.153:3300/0 conn(0x7f708409b150 msgr2=0x7f70840cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:13:48.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.993+0000 7f7089a00640 1 --2- 172.21.15.122:0/4093973789 >> v2:172.21.15.153:3300/0 conn(0x7f708409b150 0x7f70840cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:48.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.993+0000 7f7089a00640 1 -- 172.21.15.122:0/4093973789 >> v1:172.21.15.153:6789/0 conn(0x7f70840c83a0 legacy=0x7f708409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:48.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.997+0000 7f7089a00640 1 -- 172.21.15.122:0/4093973789 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70840ccc40 con 0x7f708415c760 2024-05-28T06:13:48.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.997+0000 7f7089a00640 1 --2- 172.21.15.122:0/4093973789 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f708415c760 0x7f70840b1880 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7078009870 tx=0x7f707801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6758dd8e594daab server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:48.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.997+0000 7f7083e00640 1 -- 172.21.15.122:0/4093973789 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70780a9640 con 0x7f708415c760 2024-05-28T06:13:48.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.997+0000 7f7083e00640 1 -- 172.21.15.122:0/4093973789 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f708415cd50 con 0x7f708415c760 2024-05-28T06:13:48.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.997+0000 7f7083e00640 1 -- 172.21.15.122:0/4093973789 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70780a9a00 con 0x7f708415c760 2024-05-28T06:13:48.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.997+0000 7f708ae00640 1 -- 172.21.15.122:0/4093973789 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f708415c760 msgr2=0x7f70840b1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:48.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.997+0000 7f708ae00640 1 --2- 172.21.15.122:0/4093973789 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f708415c760 0x7f70840b1880 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7078009870 tx=0x7f707801c560 comp rx=0 tx=0).stop 2024-05-28T06:13:48.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.997+0000 7f708ae00640 1 -- 172.21.15.122:0/4093973789 shutdown_connections 2024-05-28T06:13:48.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.997+0000 7f708ae00640 1 --2- 172.21.15.122:0/4093973789 >> v2:172.21.15.153:3300/0 conn(0x7f708409b150 0x7f70840cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:48.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.997+0000 7f708ae00640 1 --2- 172.21.15.122:0/4093973789 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f708415c760 0x7f70840b1880 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:48.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:48.997+0000 7f708ae00640 1 -- 172.21.15.122:0/4093973789 >> 172.21.15.122:0/4093973789 conn(0x7f70840d2470 msgr2=0x7f70840d2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:48.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.001+0000 7f708ae00640 1 -- 172.21.15.122:0/4093973789 shutdown_connections 2024-05-28T06:13:48.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.001+0000 7f708ae00640 1 -- 172.21.15.122:0/4093973789 wait complete. 2024-05-28T06:13:49.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.001+0000 7f708ae00640 1 Processor -- start 2024-05-28T06:13:49.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.001+0000 7f708ae00640 1 -- start start 2024-05-28T06:13:49.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.001+0000 7f708ae00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f708409b150 0x7f7084152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:49.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.001+0000 7f708ae00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70840c83a0 0x7f7084159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:49.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.001+0000 7f708ae00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f708415c760 0x7f70840ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:49.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.001+0000 7f708ae00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f70840ce240 con 0x7f70840c83a0 2024-05-28T06:13:49.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.001+0000 7f708ae00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f70840ce0c0 con 0x7f708415c760 2024-05-28T06:13:49.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.001+0000 7f708ae00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f70840ce3c0 con 0x7f708409b150 2024-05-28T06:13:49.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.001+0000 7f7089000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70840c83a0 0x7f7084159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:49.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.001+0000 7f7089a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f708409b150 0x7f7084152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:49.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.001+0000 7f7089000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70840c83a0 0x7f7084159e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36514/0 (socket says 172.21.15.122:36514) 2024-05-28T06:13:49.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.001+0000 7f7089000640 1 -- 172.21.15.122:0/1778335758 learned_addr learned my addr 172.21.15.122:0/1778335758 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:49.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.001+0000 7f708a400640 1 --2- 172.21.15.122:0/1778335758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f708415c760 0x7f70840ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:49.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.001+0000 7f7089000640 1 -- 172.21.15.122:0/1778335758 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f708409b150 msgr2=0x7f7084152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:49.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.001+0000 7f7089000640 1 --2- 172.21.15.122:0/1778335758 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f708409b150 0x7f7084152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:49.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.001+0000 7f7089000640 1 -- 172.21.15.122:0/1778335758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f708415c760 msgr2=0x7f70840ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:49.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.001+0000 7f7089000640 1 --2- 172.21.15.122:0/1778335758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f708415c760 0x7f70840ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:49.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.001+0000 7f7089000640 1 -- 172.21.15.122:0/1778335758 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f708415a7e0 con 0x7f70840c83a0 2024-05-28T06:13:49.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.001+0000 7f7089000640 1 --2- 172.21.15.122:0/1778335758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70840c83a0 0x7f7084159e70 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f707000c3a0 tx=0x7f707000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:49.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.005+0000 7f7081600640 1 -- 172.21.15.122:0/1778335758 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70700074e0 con 0x7f70840c83a0 2024-05-28T06:13:49.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.005+0000 7f7081600640 1 -- 172.21.15.122:0/1778335758 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7070007680 con 0x7f70840c83a0 2024-05-28T06:13:49.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.005+0000 7f7081600640 1 -- 172.21.15.122:0/1778335758 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070004a30 con 0x7f70840c83a0 2024-05-28T06:13:49.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.005+0000 7f708ae00640 1 -- 172.21.15.122:0/1778335758 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f708415aac0 con 0x7f70840c83a0 2024-05-28T06:13:49.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.005+0000 7f708ae00640 1 -- 172.21.15.122:0/1778335758 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70840c9820 con 0x7f70840c83a0 2024-05-28T06:13:49.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.005+0000 7f708ae00640 1 -- 172.21.15.122:0/1778335758 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7084075620 con 0x7f70840c83a0 2024-05-28T06:13:49.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.005+0000 7f7081600640 1 -- 172.21.15.122:0/1778335758 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 22) ==== 89160+0+0 (secure 0 0 0) 0x7f707001a020 con 0x7f70840c83a0 2024-05-28T06:13:49.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.005+0000 7f7081600640 1 --2- 172.21.15.122:0/1778335758 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7064069070 0x7f706406b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:49.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.005+0000 7f7081600640 1 -- 172.21.15.122:0/1778335758 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f7070084a80 con 0x7f70840c83a0 2024-05-28T06:13:49.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.005+0000 7f7089a00640 1 --2- 172.21.15.122:0/1778335758 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7064069070 0x7f706406b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:49.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.005+0000 7f7089a00640 1 --2- 172.21.15.122:0/1778335758 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7064069070 0x7f706406b530 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f70780ae000 tx=0x7f70780a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:49.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.009+0000 7f7081600640 1 -- 172.21.15.122:0/1778335758 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7070056440 con 0x7f70840c83a0 2024-05-28T06:13:49.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.221+0000 7f708ae00640 1 -- 172.21.15.122:0/1778335758 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f708406fdb0 con 0x7f70840c83a0 2024-05-28T06:13:49.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.221+0000 7f7081600640 1 -- 172.21.15.122:0/1778335758 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2417 (secure 0 0 0) 0x7f707005a740 con 0x7f70840c83a0 2024-05-28T06:13:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:13:49.223 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:13:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:13:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:13:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:13:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:13:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:13:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 504, 2024-05-28T06:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 62, 2024-05-28T06:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 4906, 2024-05-28T06:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 20428474059, 2024-05-28T06:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 41283346432, 2024-05-28T06:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 731810766848, 2024-05-28T06:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "read_bytes_sec": 282697398, 2024-05-28T06:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 291465177, 2024-05-28T06:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 69, 2024-05-28T06:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 81 2024-05-28T06:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 38, 2024-05-28T06:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 4, 2024-05-28T06:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 4, 2024-05-28T06:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "c", 2024-05-28T06:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 6300 2024-05-28T06:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 10, 2024-05-28T06:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:13:37.375536+0000", 2024-05-28T06:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "d99f5b57-79d0-4ca8-9bc6-54c2cbc59c2a": { 2024-05-28T06:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "6 ongoing+pending clones; Avg progress is 40.929% (3s)\n [===========.................] (remaining: 5s)", 2024-05-28T06:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.40928998589515686, 2024-05-28T06:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "f6823e37-281c-440e-aebe-a3bb39be0858": { 2024-05-28T06:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "4 ongoing clones; Avg progress is 22.266% (11s)\n [======......................] (remaining: 39s)", 2024-05-28T06:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.22266000509262085, 2024-05-28T06:13:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:13:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:13:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:13:49.233 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:13:49.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.225+0000 7f708ae00640 1 -- 172.21.15.122:0/1778335758 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7064069070 msgr2=0x7f706406b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:49.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.225+0000 7f708ae00640 1 --2- 172.21.15.122:0/1778335758 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7064069070 0x7f706406b530 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f70780ae000 tx=0x7f70780a7000 comp rx=0 tx=0).stop 2024-05-28T06:13:49.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.225+0000 7f708ae00640 1 -- 172.21.15.122:0/1778335758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70840c83a0 msgr2=0x7f7084159e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:49.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.225+0000 7f708ae00640 1 --2- 172.21.15.122:0/1778335758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70840c83a0 0x7f7084159e70 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f707000c3a0 tx=0x7f707000c860 comp rx=0 tx=0).stop 2024-05-28T06:13:49.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.225+0000 7f708ae00640 1 -- 172.21.15.122:0/1778335758 shutdown_connections 2024-05-28T06:13:49.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.225+0000 7f708ae00640 1 --2- 172.21.15.122:0/1778335758 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7064069070 0x7f706406b530 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:49.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.225+0000 7f708ae00640 1 --2- 172.21.15.122:0/1778335758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f708415c760 0x7f70840ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:49.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.225+0000 7f708ae00640 1 --2- 172.21.15.122:0/1778335758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70840c83a0 0x7f7084159e70 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:49.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.225+0000 7f708ae00640 1 --2- 172.21.15.122:0/1778335758 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f708409b150 0x7f7084152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:49.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.225+0000 7f708ae00640 1 -- 172.21.15.122:0/1778335758 >> 172.21.15.122:0/1778335758 conn(0x7f70840d2470 msgr2=0x7f7084071840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:49.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.225+0000 7f708ae00640 1 -- 172.21.15.122:0/1778335758 shutdown_connections 2024-05-28T06:13:49.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:49.225+0000 7f708ae00640 1 -- 172.21.15.122:0/1778335758 wait complete. 2024-05-28T06:13:54.245 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:13:54.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.393+0000 7fa4a1c00640 1 Processor -- start 2024-05-28T06:13:54.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.393+0000 7fa4a1c00640 1 -- start start 2024-05-28T06:13:54.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.393+0000 7fa4a1c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa49c09b800 0x7fa49c15d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:54.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.393+0000 7fa4a1c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa49c0d0830 con 0x7fa49c0d0270 2024-05-28T06:13:54.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.393+0000 7fa4a1c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa49c09aa40 con 0x7fa49c0d0c80 2024-05-28T06:13:54.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.393+0000 7fa4a1c00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fa49c09ad20 con 0x7fa49c09b800 2024-05-28T06:13:54.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.393+0000 7fa49b400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa49c09b800 0x7fa49c15d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:54.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.393+0000 7fa49b400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa49c09b800 0x7fa49c15d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36522/0 (socket says 172.21.15.122:36522) 2024-05-28T06:13:54.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.393+0000 7fa49b400640 1 -- 172.21.15.122:0/2276994132 learned_addr learned my addr 172.21.15.122:0/2276994132 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:54.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.393+0000 7fa49b400640 1 -- 172.21.15.122:0/2276994132 >> v1:172.21.15.153:6789/0 conn(0x7fa49c0d0c80 legacy=0x7fa49c0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:54.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.393+0000 7fa49b400640 1 -- 172.21.15.122:0/2276994132 >> v1:172.21.15.122:6789/0 conn(0x7fa49c0d0270 legacy=0x7fa49c0cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:54.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.393+0000 7fa49b400640 1 -- 172.21.15.122:0/2276994132 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c09b000 con 0x7fa49c09b800 2024-05-28T06:13:54.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.393+0000 7fa49a000640 1 -- 172.21.15.122:0/2276994132 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3630312396 0 0) 0x7fa49c0d0830 con 0x7fa49c0d0270 2024-05-28T06:13:54.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.397+0000 7fa49b400640 1 --2- 172.21.15.122:0/2276994132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49c09b800 0x7fa49c15d7e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fa494009e50 tx=0x7fa49401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8e0b2adcc9ac1a server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:54.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.397+0000 7fa49a000640 1 -- 172.21.15.122:0/2276994132 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4940a56e0 con 0x7fa49c09b800 2024-05-28T06:13:54.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.397+0000 7fa49a000640 1 -- 172.21.15.122:0/2276994132 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4940a5880 con 0x7fa49c09b800 2024-05-28T06:13:54.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.397+0000 7fa49a000640 1 -- 172.21.15.122:0/2276994132 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4940a5c50 con 0x7fa49c09b800 2024-05-28T06:13:54.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.397+0000 7fa4a1c00640 1 -- 172.21.15.122:0/2276994132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49c09b800 msgr2=0x7fa49c15d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:54.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.397+0000 7fa4a1c00640 1 --2- 172.21.15.122:0/2276994132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49c09b800 0x7fa49c15d7e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fa494009e50 tx=0x7fa49401c9a0 comp rx=0 tx=0).stop 2024-05-28T06:13:54.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.397+0000 7fa4a1c00640 1 -- 172.21.15.122:0/2276994132 shutdown_connections 2024-05-28T06:13:54.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.397+0000 7fa4a1c00640 1 --2- 172.21.15.122:0/2276994132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49c09b800 0x7fa49c15d7e0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:54.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.397+0000 7fa4a1c00640 1 -- 172.21.15.122:0/2276994132 >> 172.21.15.122:0/2276994132 conn(0x7fa49c0b4190 msgr2=0x7fa49c0b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:54.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.397+0000 7fa4a1c00640 1 -- 172.21.15.122:0/2276994132 shutdown_connections 2024-05-28T06:13:54.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.397+0000 7fa4a1c00640 1 -- 172.21.15.122:0/2276994132 wait complete. 2024-05-28T06:13:54.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa4a1c00640 1 Processor -- start 2024-05-28T06:13:54.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa4a1c00640 1 -- start start 2024-05-28T06:13:54.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa4a1c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa49c09b800 0x7fa49c153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:54.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa4a1c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49c0d0270 0x7fa49c1560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:54.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa4a1c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa49c0d0c80 0x7fa49c156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:54.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa4a1c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c16a9e0 con 0x7fa49c0d0270 2024-05-28T06:13:54.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa4a1c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c16a860 con 0x7fa49c0d0c80 2024-05-28T06:13:54.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa4a1c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fa49c16ab60 con 0x7fa49c09b800 2024-05-28T06:13:54.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa492000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49c0d0270 0x7fa49c1560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:54.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa492000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49c0d0270 0x7fa49c1560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36536/0 (socket says 172.21.15.122:36536) 2024-05-28T06:13:54.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa492000640 1 -- 172.21.15.122:0/2603669496 learned_addr learned my addr 172.21.15.122:0/2603669496 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:54.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa49b400640 1 --2- 172.21.15.122:0/2603669496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa49c0d0c80 0x7fa49c156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:54.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa49aa00640 1 --2- 172.21.15.122:0/2603669496 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa49c09b800 0x7fa49c153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:54.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa492000640 1 -- 172.21.15.122:0/2603669496 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa49c09b800 msgr2=0x7fa49c153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:54.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa492000640 1 --2- 172.21.15.122:0/2603669496 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa49c09b800 0x7fa49c153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:54.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa492000640 1 -- 172.21.15.122:0/2603669496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa49c0d0c80 msgr2=0x7fa49c156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:54.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa492000640 1 --2- 172.21.15.122:0/2603669496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa49c0d0c80 0x7fa49c156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:54.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa492000640 1 -- 172.21.15.122:0/2603669496 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c1587a0 con 0x7fa49c0d0270 2024-05-28T06:13:54.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa49b400640 1 --2- 172.21.15.122:0/2603669496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa49c0d0c80 0x7fa49c156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:13:54.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa492000640 1 --2- 172.21.15.122:0/2603669496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49c0d0270 0x7fa49c1560e0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fa48400c440 tx=0x7fa48400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:54.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa493400640 1 -- 172.21.15.122:0/2603669496 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa484005480 con 0x7fa49c0d0270 2024-05-28T06:13:54.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa493400640 1 -- 172.21.15.122:0/2603669496 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa484003600 con 0x7fa49c0d0270 2024-05-28T06:13:54.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa493400640 1 -- 172.21.15.122:0/2603669496 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4840039f0 con 0x7fa49c0d0270 2024-05-28T06:13:54.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa4a1c00640 1 -- 172.21.15.122:0/2603669496 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa49c155980 con 0x7fa49c0d0270 2024-05-28T06:13:54.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa4a1c00640 1 -- 172.21.15.122:0/2603669496 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa49c157fa0 con 0x7fa49c0d0270 2024-05-28T06:13:54.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.401+0000 7fa4a1c00640 1 -- 172.21.15.122:0/2603669496 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa49c068c40 con 0x7fa49c0d0270 2024-05-28T06:13:54.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.405+0000 7fa493400640 1 -- 172.21.15.122:0/2603669496 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 22) ==== 89160+0+0 (secure 0 0 0) 0x7fa484003b90 con 0x7fa49c0d0270 2024-05-28T06:13:54.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.405+0000 7fa493400640 1 --2- 172.21.15.122:0/2603669496 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa478069070 0x7fa47806b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:54.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.405+0000 7fa493400640 1 -- 172.21.15.122:0/2603669496 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7fa484085000 con 0x7fa49c0d0270 2024-05-28T06:13:54.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.405+0000 7fa49aa00640 1 --2- 172.21.15.122:0/2603669496 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa478069070 0x7fa47806b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:54.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.405+0000 7fa49aa00640 1 --2- 172.21.15.122:0/2603669496 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa478069070 0x7fa47806b530 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa48c000f70 tx=0x7fa48c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:54.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.409+0000 7fa493400640 1 -- 172.21.15.122:0/2603669496 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa4840569c0 con 0x7fa49c0d0270 2024-05-28T06:13:54.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.621+0000 7fa4a1c00640 1 -- 172.21.15.122:0/2603669496 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa49c0c60f0 con 0x7fa49c0d0270 2024-05-28T06:13:54.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.625+0000 7fa493400640 1 -- 172.21.15.122:0/2603669496 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2411 (secure 0 0 0) 0x7fa48405acc0 con 0x7fa49c0d0270 2024-05-28T06:13:54.623 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:13:54.623 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:13:54.623 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:13:54.623 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:13:54.623 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:13:54.623 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:13:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:13:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:13:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:13:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:13:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:13:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:13:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:13:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:13:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:13:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:13:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 510, 2024-05-28T06:13:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:13:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:13:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:13:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:13:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:13:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 62, 2024-05-28T06:13:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:13:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:13:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:13:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:13:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:13:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:13:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:13:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:13:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:13:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:13:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:13:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:13:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:13:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:13:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 4905, 2024-05-28T06:13:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 20428521938, 2024-05-28T06:13:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 41283436544, 2024-05-28T06:13:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 731810676736, 2024-05-28T06:13:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:13:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: "read_bytes_sec": 3495066, 2024-05-28T06:13:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 6302789, 2024-05-28T06:13:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 1, 2024-05-28T06:13:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 6 2024-05-28T06:13:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:13:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 38, 2024-05-28T06:13:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 4, 2024-05-28T06:13:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:13:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:13:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:13:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:13:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:13:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 4, 2024-05-28T06:13:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:13:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "c", 2024-05-28T06:13:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:13:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 6300 2024-05-28T06:13:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:13:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:13:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:13:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:13:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:13:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:13:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:13:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:13:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:13:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:13:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:13:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:13:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 10, 2024-05-28T06:13:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:13:37.375536+0000", 2024-05-28T06:13:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:13:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:13:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: "d99f5b57-79d0-4ca8-9bc6-54c2cbc59c2a": { 2024-05-28T06:13:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "6 ongoing+pending clones; Avg progress is 40.929% (3s)\n [===========.................] (remaining: 5s)", 2024-05-28T06:13:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.40928998589515686, 2024-05-28T06:13:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:13:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:13:54.630 INFO:teuthology.orchestra.run.smithi122.stdout: "f6823e37-281c-440e-aebe-a3bb39be0858": { 2024-05-28T06:13:54.630 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "4 ongoing clones; Avg progress is 22.266% (11s)\n [======......................] (remaining: 39s)", 2024-05-28T06:13:54.630 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.22266000509262085, 2024-05-28T06:13:54.630 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:13:54.630 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:13:54.630 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:13:54.630 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:13:54.631 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.625+0000 7fa4a1c00640 1 -- 172.21.15.122:0/2603669496 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa478069070 msgr2=0x7fa47806b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:54.631 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.625+0000 7fa4a1c00640 1 --2- 172.21.15.122:0/2603669496 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa478069070 0x7fa47806b530 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa48c000f70 tx=0x7fa48c009040 comp rx=0 tx=0).stop 2024-05-28T06:13:54.631 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.625+0000 7fa4a1c00640 1 -- 172.21.15.122:0/2603669496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49c0d0270 msgr2=0x7fa49c1560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:54.631 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.625+0000 7fa4a1c00640 1 --2- 172.21.15.122:0/2603669496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49c0d0270 0x7fa49c1560e0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fa48400c440 tx=0x7fa48400c900 comp rx=0 tx=0).stop 2024-05-28T06:13:54.631 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.625+0000 7fa4a1c00640 1 -- 172.21.15.122:0/2603669496 shutdown_connections 2024-05-28T06:13:54.631 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.625+0000 7fa4a1c00640 1 --2- 172.21.15.122:0/2603669496 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fa478069070 0x7fa47806b530 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:54.631 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.625+0000 7fa4a1c00640 1 --2- 172.21.15.122:0/2603669496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa49c0d0c80 0x7fa49c156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:54.631 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.625+0000 7fa4a1c00640 1 --2- 172.21.15.122:0/2603669496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49c0d0270 0x7fa49c1560e0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:54.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.625+0000 7fa4a1c00640 1 --2- 172.21.15.122:0/2603669496 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa49c09b800 0x7fa49c153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:54.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.625+0000 7fa4a1c00640 1 -- 172.21.15.122:0/2603669496 >> 172.21.15.122:0/2603669496 conn(0x7fa49c0b4190 msgr2=0x7fa49c074d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:54.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.625+0000 7fa4a1c00640 1 -- 172.21.15.122:0/2603669496 shutdown_connections 2024-05-28T06:13:54.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:54.625+0000 7fa4a1c00640 1 -- 172.21.15.122:0/2603669496 wait complete. 2024-05-28T06:13:59.646 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:13:59.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.797+0000 7f2647200640 1 Processor -- start 2024-05-28T06:13:59.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.797+0000 7f2647200640 1 -- start start 2024-05-28T06:13:59.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.801+0000 7f2647200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26480b1cb0 0x7f26480b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:59.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.801+0000 7f2647200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f264815edd0 con 0x7f26480b2b70 2024-05-28T06:13:59.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.801+0000 7f2647200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f264815f080 con 0x7f264806c0a0 2024-05-28T06:13:59.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.801+0000 7f2647200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f264815f9b0 con 0x7f26480b1cb0 2024-05-28T06:13:59.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.801+0000 7f2645400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f26480b2b70 0x7f264806b990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:49662/0 (socket says 172.21.15.122:49662) 2024-05-28T06:13:59.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.801+0000 7f2645400640 1 -- 172.21.15.122:0/4123576900 learned_addr learned my addr 172.21.15.122:0/4123576900 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:13:59.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.801+0000 7f2645e00640 1 --2- 172.21.15.122:0/4123576900 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26480b1cb0 0x7f26480b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:59.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.801+0000 7f2644a00640 1 -- 172.21.15.122:0/4123576900 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2727969991 0 0) 0x7f264815edd0 con 0x7f26480b2b70 2024-05-28T06:13:59.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.801+0000 7f2644a00640 1 -- 172.21.15.122:0/4123576900 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f262c003530 con 0x7f26480b2b70 2024-05-28T06:13:59.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.801+0000 7f2645e00640 1 -- 172.21.15.122:0/4123576900 >> v1:172.21.15.153:6789/0 conn(0x7f264806c0a0 legacy=0x7f26480d1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:59.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.801+0000 7f2645e00640 1 -- 172.21.15.122:0/4123576900 >> v1:172.21.15.122:6789/0 conn(0x7f26480b2b70 legacy=0x7f264806b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:59.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.801+0000 7f2645e00640 1 -- 172.21.15.122:0/4123576900 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f264815f360 con 0x7f26480b1cb0 2024-05-28T06:13:59.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.805+0000 7f2645e00640 1 --2- 172.21.15.122:0/4123576900 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26480b1cb0 0x7f26480b2630 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f26380097f0 tx=0x7f263801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bce4f30dc29b7cf server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:59.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.805+0000 7f2644a00640 1 -- 172.21.15.122:0/4123576900 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26380b1070 con 0x7f26480b1cb0 2024-05-28T06:13:59.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.805+0000 7f2644a00640 1 -- 172.21.15.122:0/4123576900 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26380ac5f0 con 0x7f26480b1cb0 2024-05-28T06:13:59.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.805+0000 7f2644a00640 1 -- 172.21.15.122:0/4123576900 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26380ac9a0 con 0x7f26480b1cb0 2024-05-28T06:13:59.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.805+0000 7f2647200640 1 -- 172.21.15.122:0/4123576900 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26480b1cb0 msgr2=0x7f26480b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:59.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.805+0000 7f2647200640 1 --2- 172.21.15.122:0/4123576900 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26480b1cb0 0x7f26480b2630 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f26380097f0 tx=0x7f263801c4e0 comp rx=0 tx=0).stop 2024-05-28T06:13:59.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.805+0000 7f2647200640 1 -- 172.21.15.122:0/4123576900 shutdown_connections 2024-05-28T06:13:59.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.805+0000 7f2647200640 1 --2- 172.21.15.122:0/4123576900 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26480b1cb0 0x7f26480b2630 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:59.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.805+0000 7f2647200640 1 -- 172.21.15.122:0/4123576900 >> 172.21.15.122:0/4123576900 conn(0x7f264809aa40 msgr2=0x7f26480b68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:13:59.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.805+0000 7f2647200640 1 -- 172.21.15.122:0/4123576900 shutdown_connections 2024-05-28T06:13:59.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.805+0000 7f2647200640 1 -- 172.21.15.122:0/4123576900 wait complete. 2024-05-28T06:13:59.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.805+0000 7f2647200640 1 Processor -- start 2024-05-28T06:13:59.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.805+0000 7f2647200640 1 -- start start 2024-05-28T06:13:59.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f2647200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f264806c0a0 0x7f264813f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:59.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f2647200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26480b1cb0 0x7f264813dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:59.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f2647200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26480b2b70 0x7f264815a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:59.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f2647200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f264816c570 con 0x7f264806c0a0 2024-05-28T06:13:59.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f2647200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f264806c820 con 0x7f26480b2b70 2024-05-28T06:13:59.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f2647200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f264816c6f0 con 0x7f26480b1cb0 2024-05-28T06:13:59.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f2645e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f264806c0a0 0x7f264813f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:59.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f2645e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f264806c0a0 0x7f264813f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:34504/0 (socket says 172.21.15.122:34504) 2024-05-28T06:13:59.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f2645e00640 1 -- 172.21.15.122:0/1736965891 learned_addr learned my addr 172.21.15.122:0/1736965891 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:13:59.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f2645400640 1 --2- 172.21.15.122:0/1736965891 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26480b1cb0 0x7f264813dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:59.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f2646800640 1 --2- 172.21.15.122:0/1736965891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26480b2b70 0x7f264815a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:59.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f2645e00640 1 -- 172.21.15.122:0/1736965891 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26480b1cb0 msgr2=0x7f264813dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:59.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f2645e00640 1 --2- 172.21.15.122:0/1736965891 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26480b1cb0 0x7f264813dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:59.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f2645e00640 1 -- 172.21.15.122:0/1736965891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26480b2b70 msgr2=0x7f264815a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:13:59.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f2645e00640 1 --2- 172.21.15.122:0/1736965891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26480b2b70 0x7f264815a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:13:59.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f2645e00640 1 -- 172.21.15.122:0/1736965891 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f264813f970 con 0x7f264806c0a0 2024-05-28T06:13:59.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f2645e00640 1 --2- 172.21.15.122:0/1736965891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f264806c0a0 0x7f264813f270 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f26380af040 tx=0x7f263801ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:59.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f263e000640 1 -- 172.21.15.122:0/1736965891 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26380bd070 con 0x7f264806c0a0 2024-05-28T06:13:59.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f263e000640 1 -- 172.21.15.122:0/1736965891 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26380b2040 con 0x7f264806c0a0 2024-05-28T06:13:59.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f2647200640 1 -- 172.21.15.122:0/1736965891 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f264813fc50 con 0x7f264806c0a0 2024-05-28T06:13:59.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f263e000640 1 -- 172.21.15.122:0/1736965891 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26380b1050 con 0x7f264806c0a0 2024-05-28T06:13:59.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f2647200640 1 -- 172.21.15.122:0/1736965891 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2648140210 con 0x7f264806c0a0 2024-05-28T06:13:59.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f2647200640 1 -- 172.21.15.122:0/1736965891 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2648075620 con 0x7f264806c0a0 2024-05-28T06:13:59.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.809+0000 7f263e000640 1 -- 172.21.15.122:0/1736965891 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 23) ==== 89109+0+0 (secure 0 0 0) 0x7f2638004230 con 0x7f264806c0a0 2024-05-28T06:13:59.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.813+0000 7f263e000640 1 --2- 172.21.15.122:0/1736965891 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2628068fe0 0x7f262806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:13:59.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.813+0000 7f263e000640 1 -- 172.21.15.122:0/1736965891 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f263811ee60 con 0x7f264806c0a0 2024-05-28T06:13:59.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.813+0000 7f2645400640 1 --2- 172.21.15.122:0/1736965891 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2628068fe0 0x7f262806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:13:59.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.813+0000 7f2645400640 1 --2- 172.21.15.122:0/1736965891 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2628068fe0 0x7f262806b4a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f264806bd50 tx=0x7f2634009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:13:59.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:13:59.817+0000 7f263e000640 1 -- 172.21.15.122:0/1736965891 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f26380a9070 con 0x7f264806c0a0 2024-05-28T06:14:00.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:00.029+0000 7f2647200640 1 -- 172.21.15.122:0/1736965891 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f264815d8b0 con 0x7f264806c0a0 2024-05-28T06:14:00.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:00.033+0000 7f263e000640 1 -- 172.21.15.122:0/1736965891 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2403 (secure 0 0 0) 0x7f26380160d0 con 0x7f264806c0a0 2024-05-28T06:14:00.031 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:14:00.031 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:14:00.032 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:14:00.032 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:14:00.032 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:14:00.032 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:14:00.032 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:14:00.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:00.032 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:14:00.032 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:14:00.033 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:14:00.033 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:14:00.033 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:14:00.033 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:00.033 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:14:00.033 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:14:00.033 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:14:00.033 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:14:00.033 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:00.034 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 515, 2024-05-28T06:14:00.034 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:14:00.034 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:14:00.034 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:14:00.034 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:14:00.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:00.034 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:14:00.034 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 62, 2024-05-28T06:14:00.034 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:14:00.035 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:14:00.035 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:14:00.035 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:14:00.035 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:14:00.035 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:14:00.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:00.035 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:14:00.035 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:14:00.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:14:00.035 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:14:00.036 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:14:00.036 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:00.036 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:00.036 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:14:00.036 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:14:00.036 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 4905, 2024-05-28T06:14:00.036 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 20428523553, 2024-05-28T06:14:00.036 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 41283436544, 2024-05-28T06:14:00.036 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 731810676736, 2024-05-28T06:14:00.036 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:14:00.037 INFO:teuthology.orchestra.run.smithi122.stdout: "read_bytes_sec": 85, 2024-05-28T06:14:00.037 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 4862, 2024-05-28T06:14:00.037 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 0, 2024-05-28T06:14:00.037 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 1 2024-05-28T06:14:00.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:00.037 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:14:00.037 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 38, 2024-05-28T06:14:00.037 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 4, 2024-05-28T06:14:00.037 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:14:00.037 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:14:00.037 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:14:00.037 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:14:00.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:14:00.038 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 4, 2024-05-28T06:14:00.038 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:14:00.038 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "c", 2024-05-28T06:14:00.038 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:14:00.038 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 6300 2024-05-28T06:14:00.038 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:00.038 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:00.038 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:14:00.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:00.038 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:14:00.039 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:14:00.039 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:14:00.039 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:14:00.039 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:14:00.039 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:14:00.039 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:14:00.039 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:00.039 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:14:00.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:00.039 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:14:00.039 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 10, 2024-05-28T06:14:00.039 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:13:37.375536+0000", 2024-05-28T06:14:00.039 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:14:00.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:00.040 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:14:00.040 INFO:teuthology.orchestra.run.smithi122.stdout: "d99f5b57-79d0-4ca8-9bc6-54c2cbc59c2a": { 2024-05-28T06:14:00.040 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "6 ongoing+pending clones; Avg progress is 40.929% (3s)\n [===========.................] (remaining: 5s)", 2024-05-28T06:14:00.040 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.40928998589515686, 2024-05-28T06:14:00.040 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:14:00.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:00.040 INFO:teuthology.orchestra.run.smithi122.stdout: "f6823e37-281c-440e-aebe-a3bb39be0858": { 2024-05-28T06:14:00.040 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "4 ongoing clones; Avg progress is 22.266% (11s)\n [======......................] (remaining: 39s)", 2024-05-28T06:14:00.040 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.22266000509262085, 2024-05-28T06:14:00.040 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:14:00.041 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:00.041 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:00.041 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:14:00.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:00.033+0000 7f2647200640 1 -- 172.21.15.122:0/1736965891 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2628068fe0 msgr2=0x7f262806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:00.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:00.033+0000 7f2647200640 1 --2- 172.21.15.122:0/1736965891 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2628068fe0 0x7f262806b4a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f264806bd50 tx=0x7f2634009040 comp rx=0 tx=0).stop 2024-05-28T06:14:00.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:00.033+0000 7f2647200640 1 -- 172.21.15.122:0/1736965891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f264806c0a0 msgr2=0x7f264813f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:00.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:00.033+0000 7f2647200640 1 --2- 172.21.15.122:0/1736965891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f264806c0a0 0x7f264813f270 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f26380af040 tx=0x7f263801ad20 comp rx=0 tx=0).stop 2024-05-28T06:14:00.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:00.033+0000 7f2647200640 1 -- 172.21.15.122:0/1736965891 shutdown_connections 2024-05-28T06:14:00.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:00.033+0000 7f2647200640 1 --2- 172.21.15.122:0/1736965891 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f2628068fe0 0x7f262806b4a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:00.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:00.033+0000 7f2647200640 1 --2- 172.21.15.122:0/1736965891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26480b2b70 0x7f264815a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:00.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:00.033+0000 7f2647200640 1 --2- 172.21.15.122:0/1736965891 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26480b1cb0 0x7f264813dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:00.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:00.033+0000 7f2647200640 1 --2- 172.21.15.122:0/1736965891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f264806c0a0 0x7f264813f270 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:00.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:00.033+0000 7f2647200640 1 -- 172.21.15.122:0/1736965891 >> 172.21.15.122:0/1736965891 conn(0x7f264809aa40 msgr2=0x7f264815e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:00.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:00.033+0000 7f2647200640 1 -- 172.21.15.122:0/1736965891 shutdown_connections 2024-05-28T06:14:00.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:00.033+0000 7f2647200640 1 -- 172.21.15.122:0/1736965891 wait complete. 2024-05-28T06:14:05.054 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:14:05.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.197+0000 7f7f70200640 1 Processor -- start 2024-05-28T06:14:05.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.197+0000 7f7f70200640 1 -- start start 2024-05-28T06:14:05.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f70200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7f680cff30 0x7f7f6806f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:05.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f70200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f680cdf00 con 0x7f7f6806f6c0 2024-05-28T06:14:05.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f70200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f680d0310 con 0x7f7f680cdb00 2024-05-28T06:14:05.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f70200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7f6806fb30 con 0x7f7f680cff30 2024-05-28T06:14:05.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f6ce00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f7f6806f6c0 0x7f7f680cd3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:49674/0 (socket says 172.21.15.122:49674) 2024-05-28T06:14:05.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f6ce00640 1 -- 172.21.15.122:0/2554110405 learned_addr learned my addr 172.21.15.122:0/2554110405 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:14:05.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f6d800640 1 --2- 172.21.15.122:0/2554110405 >> v2:172.21.15.153:3300/0 conn(0x7f7f680cff30 0x7f7f6806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:05.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f67e00640 1 -- 172.21.15.122:0/2554110405 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 449496169 0 0) 0x7f7f54001120 con 0x7f7f6806f6c0 2024-05-28T06:14:05.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f67e00640 1 -- 172.21.15.122:0/2554110405 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f50003530 con 0x7f7f6806f6c0 2024-05-28T06:14:05.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f67e00640 1 -- 172.21.15.122:0/2554110405 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 210364391 0 0) 0x7f7f680d0310 con 0x7f7f680cdb00 2024-05-28T06:14:05.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f67e00640 1 -- 172.21.15.122:0/2554110405 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f54001120 con 0x7f7f680cdb00 2024-05-28T06:14:05.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f67e00640 1 -- 172.21.15.122:0/2554110405 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1293862746 0 0) 0x7f7f50003530 con 0x7f7f6806f6c0 2024-05-28T06:14:05.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f67e00640 1 -- 172.21.15.122:0/2554110405 >> v2:172.21.15.153:3300/0 conn(0x7f7f680cff30 msgr2=0x7f7f6806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:05.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f67e00640 1 --2- 172.21.15.122:0/2554110405 >> v2:172.21.15.153:3300/0 conn(0x7f7f680cff30 0x7f7f6806f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:05.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f67e00640 1 -- 172.21.15.122:0/2554110405 >> v1:172.21.15.153:6789/0 conn(0x7f7f680cdb00 legacy=0x7f7f680b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:05.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f67e00640 1 -- 172.21.15.122:0/2554110405 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f6815be20 con 0x7f7f6806f6c0 2024-05-28T06:14:05.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f67e00640 1 -- 172.21.15.122:0/2554110405 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f7f54001850 con 0x7f7f6806f6c0 2024-05-28T06:14:05.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f67e00640 1 -- 172.21.15.122:0/2554110405 >> v1:172.21.15.122:6789/0 conn(0x7f7f6806f6c0 legacy=0x7f7f680cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:05.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f67e00640 1 --2- 172.21.15.122:0/2554110405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f50003b50 0x7f7f50003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:05.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f67e00640 1 --2- 172.21.15.122:0/2554110405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f50004810 0x7f7f50004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:05.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f67e00640 1 --2- 172.21.15.122:0/2554110405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f500051d0 0x7f7f5000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:05.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f67e00640 1 -- 172.21.15.122:0/2554110405 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6806fb30 con 0x7f7f500051d0 2024-05-28T06:14:05.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f67e00640 1 -- 172.21.15.122:0/2554110405 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5000c050 con 0x7f7f50003b50 2024-05-28T06:14:05.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f67e00640 1 -- 172.21.15.122:0/2554110405 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7f5000c250 con 0x7f7f50004810 2024-05-28T06:14:05.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f6e200640 1 --2- 172.21.15.122:0/2554110405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f500051d0 0x7f7f5000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:05.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f6d800640 1 --2- 172.21.15.122:0/2554110405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f50003b50 0x7f7f50003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:05.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f6ce00640 1 --2- 172.21.15.122:0/2554110405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f50004810 0x7f7f50004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:05.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f6e200640 1 -- 172.21.15.122:0/2554110405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f50004810 msgr2=0x7f7f50004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:05.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f6e200640 1 --2- 172.21.15.122:0/2554110405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f50004810 0x7f7f50004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:05.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f6e200640 1 -- 172.21.15.122:0/2554110405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f50003b50 msgr2=0x7f7f50003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:05.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f6e200640 1 --2- 172.21.15.122:0/2554110405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f50003b50 0x7f7f50003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:05.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.201+0000 7f7f6e200640 1 -- 172.21.15.122:0/2554110405 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f50003530 con 0x7f7f500051d0 2024-05-28T06:14:05.204 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.205+0000 7f7f6e200640 1 -- 172.21.15.122:0/2554110405 reap_dead start 2024-05-28T06:14:05.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.205+0000 7f7f6e200640 1 --2- 172.21.15.122:0/2554110405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f500051d0 0x7f7f5000b9d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f7f60001fd0 tx=0x7f7f6001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40acecab2f43c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:05.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.205+0000 7f7f67e00640 1 -- 172.21.15.122:0/2554110405 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f60001c20 con 0x7f7f500051d0 2024-05-28T06:14:05.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.205+0000 7f7f67e00640 1 -- 172.21.15.122:0/2554110405 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f60003b80 con 0x7f7f500051d0 2024-05-28T06:14:05.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.205+0000 7f7f67e00640 1 -- 172.21.15.122:0/2554110405 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f600050d0 con 0x7f7f500051d0 2024-05-28T06:14:05.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.205+0000 7f7f70200640 1 -- 172.21.15.122:0/2554110405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f500051d0 msgr2=0x7f7f5000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:05.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.205+0000 7f7f70200640 1 --2- 172.21.15.122:0/2554110405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f500051d0 0x7f7f5000b9d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f7f60001fd0 tx=0x7f7f6001c900 comp rx=0 tx=0).stop 2024-05-28T06:14:05.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.205+0000 7f7f70200640 1 -- 172.21.15.122:0/2554110405 shutdown_connections 2024-05-28T06:14:05.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.205+0000 7f7f70200640 1 --2- 172.21.15.122:0/2554110405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f500051d0 0x7f7f5000b9d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:05.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.205+0000 7f7f70200640 1 -- 172.21.15.122:0/2554110405 >> 172.21.15.122:0/2554110405 conn(0x7f7f6806bd90 msgr2=0x7f7f6806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:05.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.205+0000 7f7f70200640 1 -- 172.21.15.122:0/2554110405 shutdown_connections 2024-05-28T06:14:05.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.205+0000 7f7f70200640 1 -- 172.21.15.122:0/2554110405 wait complete. 2024-05-28T06:14:05.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.205+0000 7f7f70200640 1 Processor -- start 2024-05-28T06:14:05.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.205+0000 7f7f70200640 1 -- start start 2024-05-28T06:14:05.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.209+0000 7f7f70200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f500051d0 0x7f7f68141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:05.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.209+0000 7f7f70200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f681f8a60 0x7f7f680ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:05.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.209+0000 7f7f70200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f681f7e10 0x7f7f681f8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:05.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.209+0000 7f7f70200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6815c6c0 con 0x7f7f681f8a60 2024-05-28T06:14:05.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.209+0000 7f7f70200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6815c3e0 con 0x7f7f500051d0 2024-05-28T06:14:05.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.209+0000 7f7f70200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7f6815baf0 con 0x7f7f681f7e10 2024-05-28T06:14:05.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.209+0000 7f7f6ce00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f681f8a60 0x7f7f680ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:05.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.209+0000 7f7f6ce00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f681f8a60 0x7f7f680ae290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:34514/0 (socket says 172.21.15.122:34514) 2024-05-28T06:14:05.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.209+0000 7f7f6ce00640 1 -- 172.21.15.122:0/1129615318 learned_addr learned my addr 172.21.15.122:0/1129615318 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:05.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.209+0000 7f7f6d800640 1 --2- 172.21.15.122:0/1129615318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f500051d0 0x7f7f68141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:05.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.209+0000 7f7f6e200640 1 --2- 172.21.15.122:0/1129615318 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f681f7e10 0x7f7f681f8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:05.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.209+0000 7f7f6ce00640 1 -- 172.21.15.122:0/1129615318 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f681f7e10 msgr2=0x7f7f681f8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:05.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.209+0000 7f7f6ce00640 1 --2- 172.21.15.122:0/1129615318 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f681f7e10 0x7f7f681f8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:05.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.209+0000 7f7f6ce00640 1 -- 172.21.15.122:0/1129615318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f500051d0 msgr2=0x7f7f68141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:05.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.209+0000 7f7f6ce00640 1 --2- 172.21.15.122:0/1129615318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f500051d0 0x7f7f68141d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:05.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.209+0000 7f7f6ce00640 1 -- 172.21.15.122:0/1129615318 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f680aeb60 con 0x7f7f681f8a60 2024-05-28T06:14:05.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.209+0000 7f7f6ce00640 1 --2- 172.21.15.122:0/1129615318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f681f8a60 0x7f7f680ae290 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f7f540058b0 tx=0x7f7f540126b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:05.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.209+0000 7f7f65600640 1 -- 172.21.15.122:0/1129615318 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5401c070 con 0x7f7f681f8a60 2024-05-28T06:14:05.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.209+0000 7f7f65600640 1 -- 172.21.15.122:0/1129615318 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f54014750 con 0x7f7f681f8a60 2024-05-28T06:14:05.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.209+0000 7f7f65600640 1 -- 172.21.15.122:0/1129615318 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f54014b40 con 0x7f7f681f8a60 2024-05-28T06:14:05.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.209+0000 7f7f70200640 1 -- 172.21.15.122:0/1129615318 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f680aee40 con 0x7f7f681f8a60 2024-05-28T06:14:05.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.209+0000 7f7f70200640 1 -- 172.21.15.122:0/1129615318 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f680afed0 con 0x7f7f681f8a60 2024-05-28T06:14:05.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.209+0000 7f7f70200640 1 -- 172.21.15.122:0/1129615318 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f68068c40 con 0x7f7f681f8a60 2024-05-28T06:14:05.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.213+0000 7f7f65600640 1 -- 172.21.15.122:0/1129615318 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 23) ==== 89109+0+0 (secure 0 0 0) 0x7f7f54014ce0 con 0x7f7f681f8a60 2024-05-28T06:14:05.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.213+0000 7f7f65600640 1 --2- 172.21.15.122:0/1129615318 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7f48068fe0 0x7f7f4806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:05.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.213+0000 7f7f65600640 1 -- 172.21.15.122:0/1129615318 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f7f54087da0 con 0x7f7f681f8a60 2024-05-28T06:14:05.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.213+0000 7f7f6d800640 1 --2- 172.21.15.122:0/1129615318 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7f48068fe0 0x7f7f4806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:05.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.213+0000 7f7f6d800640 1 --2- 172.21.15.122:0/1129615318 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7f48068fe0 0x7f7f4806b4a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009b60 tx=0x7f7f5c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:05.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.217+0000 7f7f65600640 1 -- 172.21.15.122:0/1129615318 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7f680cdf00 con 0x7f7f681f8a60 2024-05-28T06:14:05.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.429+0000 7f7f70200640 1 -- 172.21.15.122:0/1129615318 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f7f681571d0 con 0x7f7f681f8a60 2024-05-28T06:14:05.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.433+0000 7f7f65600640 1 -- 172.21.15.122:0/1129615318 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2372 (secure 0 0 0) 0x7f7f540594e0 con 0x7f7f681f8a60 2024-05-28T06:14:05.431 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:14:05.431 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:14:05.431 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:14:05.431 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:14:05.432 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:14:05.432 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:14:05.432 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:14:05.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:05.432 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:14:05.432 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:14:05.432 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:14:05.432 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:14:05.432 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:14:05.432 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:05.432 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:14:05.432 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:14:05.432 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:14:05.432 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:14:05.432 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:05.433 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 521, 2024-05-28T06:14:05.433 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:14:05.433 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:14:05.433 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:14:05.433 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:14:05.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:05.433 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:14:05.433 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 62, 2024-05-28T06:14:05.433 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:14:05.433 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:14:05.433 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:14:05.433 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:14:05.433 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:14:05.434 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:14:05.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:05.434 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:14:05.434 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:14:05.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:14:05.434 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:14:05.434 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:14:05.434 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:05.434 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:05.434 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:14:05.434 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:14:05.434 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 4905, 2024-05-28T06:14:05.434 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 20428523694, 2024-05-28T06:14:05.435 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 41283436544, 2024-05-28T06:14:05.435 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 731810676736, 2024-05-28T06:14:05.435 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:14:05.435 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 853, 2024-05-28T06:14:05.435 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 0, 2024-05-28T06:14:05.435 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 0 2024-05-28T06:14:05.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:05.435 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:14:05.435 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 38, 2024-05-28T06:14:05.435 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 4, 2024-05-28T06:14:05.435 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:14:05.435 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:14:05.435 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:14:05.435 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:14:05.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:14:05.436 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 4, 2024-05-28T06:14:05.436 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:14:05.436 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "c", 2024-05-28T06:14:05.436 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:14:05.436 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 6300 2024-05-28T06:14:05.436 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:05.436 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:05.436 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:14:05.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:05.436 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:14:05.436 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:14:05.436 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:14:05.436 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:14:05.437 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:14:05.437 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:14:05.437 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:14:05.437 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:05.437 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:14:05.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:05.437 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:14:05.437 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 10, 2024-05-28T06:14:05.437 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:13:37.375536+0000", 2024-05-28T06:14:05.437 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:14:05.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:05.437 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:14:05.437 INFO:teuthology.orchestra.run.smithi122.stdout: "d99f5b57-79d0-4ca8-9bc6-54c2cbc59c2a": { 2024-05-28T06:14:05.437 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "6 ongoing+pending clones; Avg progress is 40.929% (3s)\n [===========.................] (remaining: 5s)", 2024-05-28T06:14:05.437 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.40928998589515686, 2024-05-28T06:14:05.437 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:14:05.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:05.438 INFO:teuthology.orchestra.run.smithi122.stdout: "f6823e37-281c-440e-aebe-a3bb39be0858": { 2024-05-28T06:14:05.438 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "4 ongoing clones; Avg progress is 22.266% (11s)\n [======......................] (remaining: 39s)", 2024-05-28T06:14:05.438 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.22266000509262085, 2024-05-28T06:14:05.438 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:14:05.438 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:05.438 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:05.438 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:14:05.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.433+0000 7f7f70200640 1 -- 172.21.15.122:0/1129615318 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7f48068fe0 msgr2=0x7f7f4806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:05.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.433+0000 7f7f70200640 1 --2- 172.21.15.122:0/1129615318 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7f48068fe0 0x7f7f4806b4a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009b60 tx=0x7f7f5c009190 comp rx=0 tx=0).stop 2024-05-28T06:14:05.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.433+0000 7f7f70200640 1 -- 172.21.15.122:0/1129615318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f681f8a60 msgr2=0x7f7f680ae290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:05.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.433+0000 7f7f70200640 1 --2- 172.21.15.122:0/1129615318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f681f8a60 0x7f7f680ae290 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f7f540058b0 tx=0x7f7f540126b0 comp rx=0 tx=0).stop 2024-05-28T06:14:05.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.433+0000 7f7f70200640 1 -- 172.21.15.122:0/1129615318 shutdown_connections 2024-05-28T06:14:05.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.433+0000 7f7f70200640 1 --2- 172.21.15.122:0/1129615318 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7f48068fe0 0x7f7f4806b4a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:05.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.433+0000 7f7f70200640 1 --2- 172.21.15.122:0/1129615318 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f681f7e10 0x7f7f681f8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:05.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.433+0000 7f7f70200640 1 --2- 172.21.15.122:0/1129615318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f681f8a60 0x7f7f680ae290 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:05.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.433+0000 7f7f70200640 1 --2- 172.21.15.122:0/1129615318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f500051d0 0x7f7f68141d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:05.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.433+0000 7f7f70200640 1 -- 172.21.15.122:0/1129615318 >> 172.21.15.122:0/1129615318 conn(0x7f7f6806bd90 msgr2=0x7f7f680b4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:05.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.433+0000 7f7f70200640 1 -- 172.21.15.122:0/1129615318 shutdown_connections 2024-05-28T06:14:05.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:05.433+0000 7f7f70200640 1 -- 172.21.15.122:0/1129615318 wait complete. 2024-05-28T06:14:10.455 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:14:10.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde8c00640 1 Processor -- start 2024-05-28T06:14:10.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde8c00640 1 -- start start 2024-05-28T06:14:10.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde8c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdde415ea50 0x7fdde415ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:10.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde8c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdde4162510 con 0x7fdde415f370 2024-05-28T06:14:10.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde8c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdde41627f0 con 0x7fdde406dab0 2024-05-28T06:14:10.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde8c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdde4163120 con 0x7fdde415ea50 2024-05-28T06:14:10.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdddbe00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fdde415f370 0x7fdde415f790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:39752/0 (socket says 172.21.15.122:39752) 2024-05-28T06:14:10.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdddbe00640 1 -- 172.21.15.122:0/4005213494 learned_addr learned my addr 172.21.15.122:0/4005213494 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:14:10.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde1400640 1 -- 172.21.15.122:0/4005213494 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3851296887 0 0) 0x7fdde4162510 con 0x7fdde415f370 2024-05-28T06:14:10.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde1400640 1 -- 172.21.15.122:0/4005213494 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddc8003530 con 0x7fdde415f370 2024-05-28T06:14:10.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde1e00640 1 --2- 172.21.15.122:0/4005213494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdde415ea50 0x7fdde415ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:10.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde1400640 1 -- 172.21.15.122:0/4005213494 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2397113594 0 0) 0x7fddc8003530 con 0x7fdde415f370 2024-05-28T06:14:10.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde1400640 1 -- 172.21.15.122:0/4005213494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdde415ea50 msgr2=0x7fdde415ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:10.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde1400640 1 --2- 172.21.15.122:0/4005213494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdde415ea50 0x7fdde415ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:10.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde1400640 1 -- 172.21.15.122:0/4005213494 >> v1:172.21.15.153:6789/0 conn(0x7fdde406dab0 legacy=0x7fdde40d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:10.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde1400640 1 -- 172.21.15.122:0/4005213494 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde4162ad0 con 0x7fdde415f370 2024-05-28T06:14:10.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde1400640 1 -- 172.21.15.122:0/4005213494 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7fddcc001680 con 0x7fdde415f370 2024-05-28T06:14:10.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde1400640 1 -- 172.21.15.122:0/4005213494 >> v1:172.21.15.122:6789/0 conn(0x7fdde415f370 legacy=0x7fdde415f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:10.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde1400640 1 --2- 172.21.15.122:0/4005213494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddc80039f0 0x7fddc8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:10.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde1400640 1 --2- 172.21.15.122:0/4005213494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddc8004810 0x7fddc8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:10.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde1400640 1 --2- 172.21.15.122:0/4005213494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdde415ea50 0x7fddc80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:10.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde1400640 1 -- 172.21.15.122:0/4005213494 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fddc800ba80 con 0x7fddc8004810 2024-05-28T06:14:10.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde1400640 1 -- 172.21.15.122:0/4005213494 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fddc800bc00 con 0x7fddc80039f0 2024-05-28T06:14:10.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde1400640 1 -- 172.21.15.122:0/4005213494 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fddc800be00 con 0x7fdde415ea50 2024-05-28T06:14:10.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdddbe00640 1 --2- 172.21.15.122:0/4005213494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddc8004810 0x7fddc8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:10.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde2800640 1 --2- 172.21.15.122:0/4005213494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdde415ea50 0x7fddc80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:10.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.601+0000 7fdde1e00640 1 --2- 172.21.15.122:0/4005213494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddc80039f0 0x7fddc8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:10.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.605+0000 7fdddbe00640 1 -- 172.21.15.122:0/4005213494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdde415ea50 msgr2=0x7fddc80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:10.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.605+0000 7fdddbe00640 1 --2- 172.21.15.122:0/4005213494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdde415ea50 0x7fddc80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:10.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.605+0000 7fdddbe00640 1 -- 172.21.15.122:0/4005213494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddc80039f0 msgr2=0x7fddc8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:10.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.605+0000 7fdddbe00640 1 --2- 172.21.15.122:0/4005213494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddc80039f0 0x7fddc8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:10.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.605+0000 7fdddbe00640 1 -- 172.21.15.122:0/4005213494 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc8003530 con 0x7fddc8004810 2024-05-28T06:14:10.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.605+0000 7fdddbe00640 1 --2- 172.21.15.122:0/4005213494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddc8004810 0x7fddc8004c90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fddcc00c210 tx=0x7fddcc01f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1d81ebfa04132e server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:10.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.605+0000 7fdde1400640 1 -- 172.21.15.122:0/4005213494 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc007d20 con 0x7fddc8004810 2024-05-28T06:14:10.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.605+0000 7fdde1400640 1 -- 172.21.15.122:0/4005213494 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddcc005ae0 con 0x7fddc8004810 2024-05-28T06:14:10.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.605+0000 7fdde1400640 1 -- 172.21.15.122:0/4005213494 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc007070 con 0x7fddc8004810 2024-05-28T06:14:10.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.605+0000 7fdde8c00640 1 -- 172.21.15.122:0/4005213494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddc8004810 msgr2=0x7fddc8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:10.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.605+0000 7fdde8c00640 1 --2- 172.21.15.122:0/4005213494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddc8004810 0x7fddc8004c90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fddcc00c210 tx=0x7fddcc01f390 comp rx=0 tx=0).stop 2024-05-28T06:14:10.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.605+0000 7fdde2800640 1 -- 172.21.15.122:0/4005213494 reap_dead start 2024-05-28T06:14:10.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.605+0000 7fdde8c00640 1 -- 172.21.15.122:0/4005213494 shutdown_connections 2024-05-28T06:14:10.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.605+0000 7fdde8c00640 1 -- 172.21.15.122:0/4005213494 >> 172.21.15.122:0/4005213494 conn(0x7fdde40b4190 msgr2=0x7fdde40b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:10.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.605+0000 7fdde8c00640 1 -- 172.21.15.122:0/4005213494 shutdown_connections 2024-05-28T06:14:10.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.605+0000 7fdde8c00640 1 -- 172.21.15.122:0/4005213494 wait complete. 2024-05-28T06:14:10.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.609+0000 7fdde8c00640 1 Processor -- start 2024-05-28T06:14:10.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.609+0000 7fdde8c00640 1 -- start start 2024-05-28T06:14:10.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.609+0000 7fdde8c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddc8004810 0x7fdde415bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:10.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.609+0000 7fdde8c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdde40b03f0 0x7fdde40b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:10.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.609+0000 7fdde8c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdde40c8620 0x7fdde40c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:10.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.609+0000 7fdde8c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdde415ee30 con 0x7fdde40b03f0 2024-05-28T06:14:10.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.609+0000 7fdde8c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdde409b7a0 con 0x7fddc8004810 2024-05-28T06:14:10.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.609+0000 7fdde8c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fdde415efb0 con 0x7fdde40c8620 2024-05-28T06:14:10.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.609+0000 7fdddbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdde40b03f0 0x7fdde40b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:10.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.609+0000 7fdde2800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdde40c8620 0x7fdde40c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:10.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.609+0000 7fdddbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdde40b03f0 0x7fdde40b0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47650/0 (socket says 172.21.15.122:47650) 2024-05-28T06:14:10.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.609+0000 7fdddbe00640 1 -- 172.21.15.122:0/557669181 learned_addr learned my addr 172.21.15.122:0/557669181 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:10.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.609+0000 7fdde1e00640 1 --2- 172.21.15.122:0/557669181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddc8004810 0x7fdde415bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:10.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.609+0000 7fdddbe00640 1 -- 172.21.15.122:0/557669181 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdde40c8620 msgr2=0x7fdde40c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:10.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.609+0000 7fdddbe00640 1 --2- 172.21.15.122:0/557669181 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdde40c8620 0x7fdde40c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:10.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.609+0000 7fdddbe00640 1 -- 172.21.15.122:0/557669181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddc8004810 msgr2=0x7fdde415bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:10.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.609+0000 7fdddbe00640 1 --2- 172.21.15.122:0/557669181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddc8004810 0x7fdde415bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:10.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.609+0000 7fdddbe00640 1 -- 172.21.15.122:0/557669181 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde415c4b0 con 0x7fdde40b03f0 2024-05-28T06:14:10.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.609+0000 7fdde2800640 1 --2- 172.21.15.122:0/557669181 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdde40c8620 0x7fdde40c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:14:10.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.609+0000 7fdddbe00640 1 --2- 172.21.15.122:0/557669181 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdde40b03f0 0x7fdde40b0870 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fddcc09bae0 tx=0x7fddc8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:10.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.609+0000 7fddda000640 1 -- 172.21.15.122:0/557669181 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc007d20 con 0x7fdde40b03f0 2024-05-28T06:14:10.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.613+0000 7fddda000640 1 -- 172.21.15.122:0/557669181 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddcc0047f0 con 0x7fdde40b03f0 2024-05-28T06:14:10.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.613+0000 7fdde8c00640 1 -- 172.21.15.122:0/557669181 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde40c7280 con 0x7fdde40b03f0 2024-05-28T06:14:10.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.613+0000 7fddda000640 1 -- 172.21.15.122:0/557669181 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc004bc0 con 0x7fdde40b03f0 2024-05-28T06:14:10.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.613+0000 7fdde8c00640 1 -- 172.21.15.122:0/557669181 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde40c7840 con 0x7fdde40b03f0 2024-05-28T06:14:10.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.613+0000 7fdde8c00640 1 -- 172.21.15.122:0/557669181 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdde4068c40 con 0x7fdde40b03f0 2024-05-28T06:14:10.613 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.613+0000 7fddda000640 1 -- 172.21.15.122:0/557669181 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 23) ==== 89109+0+0 (secure 0 0 0) 0x7fddcc007070 con 0x7fdde40b03f0 2024-05-28T06:14:10.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.613+0000 7fddda000640 1 --2- 172.21.15.122:0/557669181 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fddc0068fe0 0x7fddc006b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:10.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.613+0000 7fddda000640 1 -- 172.21.15.122:0/557669181 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7fddcc122970 con 0x7fdde40b03f0 2024-05-28T06:14:10.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.613+0000 7fdde1e00640 1 --2- 172.21.15.122:0/557669181 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fddc0068fe0 0x7fddc006b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:10.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.617+0000 7fdde1e00640 1 --2- 172.21.15.122:0/557669181 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fddc0068fe0 0x7fddc006b4a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009be0 tx=0x7fddd4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:10.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.617+0000 7fddda000640 1 -- 172.21.15.122:0/557669181 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdde415c4b0 con 0x7fdde40b03f0 2024-05-28T06:14:10.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.833+0000 7fdde8c00640 1 -- 172.21.15.122:0/557669181 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fdde40b4ea0 con 0x7fdde40b03f0 2024-05-28T06:14:10.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.833+0000 7fddda000640 1 -- 172.21.15.122:0/557669181 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2372 (secure 0 0 0) 0x7fddcc0190a0 con 0x7fdde40b03f0 2024-05-28T06:14:10.832 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:14:10.832 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:14:10.832 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:14:10.833 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:14:10.833 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:14:10.833 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:14:10.833 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:14:10.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:10.833 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:14:10.833 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:14:10.833 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:14:10.833 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:14:10.833 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:14:10.833 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:10.833 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:14:10.833 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:14:10.833 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:14:10.834 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:14:10.834 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:10.834 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 526, 2024-05-28T06:14:10.834 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:14:10.834 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:14:10.834 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:14:10.834 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:14:10.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:10.834 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:14:10.834 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 62, 2024-05-28T06:14:10.834 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:14:10.834 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:14:10.834 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:14:10.835 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:14:10.835 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:14:10.835 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:14:10.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:10.835 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:14:10.835 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:14:10.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:14:10.835 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:14:10.835 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:14:10.835 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:10.835 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:10.835 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:14:10.835 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:14:10.835 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 4905, 2024-05-28T06:14:10.835 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 20428523694, 2024-05-28T06:14:10.836 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 41283436544, 2024-05-28T06:14:10.836 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 731810676736, 2024-05-28T06:14:10.836 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280, 2024-05-28T06:14:10.836 INFO:teuthology.orchestra.run.smithi122.stdout: "write_bytes_sec": 255, 2024-05-28T06:14:10.836 INFO:teuthology.orchestra.run.smithi122.stdout: "read_op_per_sec": 0, 2024-05-28T06:14:10.836 INFO:teuthology.orchestra.run.smithi122.stdout: "write_op_per_sec": 0 2024-05-28T06:14:10.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:10.836 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:14:10.836 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 38, 2024-05-28T06:14:10.836 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 4, 2024-05-28T06:14:10.836 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:14:10.836 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:14:10.836 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:14:10.836 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:14:10.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:14:10.837 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 4, 2024-05-28T06:14:10.837 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:14:10.837 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "c", 2024-05-28T06:14:10.837 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:14:10.837 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 6300 2024-05-28T06:14:10.837 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:10.837 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:10.837 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:14:10.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:10.837 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:14:10.837 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:14:10.837 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:14:10.837 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:14:10.838 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:14:10.838 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:14:10.838 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:14:10.838 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:10.838 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:14:10.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:10.838 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:14:10.838 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 10, 2024-05-28T06:14:10.838 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:13:37.375536+0000", 2024-05-28T06:14:10.838 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:14:10.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:10.838 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:14:10.838 INFO:teuthology.orchestra.run.smithi122.stdout: "d99f5b57-79d0-4ca8-9bc6-54c2cbc59c2a": { 2024-05-28T06:14:10.839 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "6 ongoing+pending clones; Avg progress is 40.929% (3s)\n [===========.................] (remaining: 5s)", 2024-05-28T06:14:10.839 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.40928998589515686, 2024-05-28T06:14:10.839 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:14:10.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:10.839 INFO:teuthology.orchestra.run.smithi122.stdout: "f6823e37-281c-440e-aebe-a3bb39be0858": { 2024-05-28T06:14:10.839 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "4 ongoing clones; Avg progress is 22.266% (11s)\n [======......................] (remaining: 39s)", 2024-05-28T06:14:10.839 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.22266000509262085, 2024-05-28T06:14:10.839 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:14:10.839 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:10.839 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:10.839 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:14:10.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.833+0000 7fdde8c00640 1 -- 172.21.15.122:0/557669181 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fddc0068fe0 msgr2=0x7fddc006b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:10.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.833+0000 7fdde8c00640 1 --2- 172.21.15.122:0/557669181 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fddc0068fe0 0x7fddc006b4a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009be0 tx=0x7fddd4009190 comp rx=0 tx=0).stop 2024-05-28T06:14:10.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.833+0000 7fdde8c00640 1 -- 172.21.15.122:0/557669181 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdde40b03f0 msgr2=0x7fdde40b0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:10.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.833+0000 7fdde8c00640 1 --2- 172.21.15.122:0/557669181 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdde40b03f0 0x7fdde40b0870 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fddcc09bae0 tx=0x7fddc8005840 comp rx=0 tx=0).stop 2024-05-28T06:14:10.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.833+0000 7fdde8c00640 1 -- 172.21.15.122:0/557669181 shutdown_connections 2024-05-28T06:14:10.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.833+0000 7fdde8c00640 1 --2- 172.21.15.122:0/557669181 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fddc0068fe0 0x7fddc006b4a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:10.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.833+0000 7fdde8c00640 1 --2- 172.21.15.122:0/557669181 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdde40c8620 0x7fdde40c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:10.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.833+0000 7fdde8c00640 1 --2- 172.21.15.122:0/557669181 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdde40b03f0 0x7fdde40b0870 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:10.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.833+0000 7fdde8c00640 1 --2- 172.21.15.122:0/557669181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddc8004810 0x7fdde415bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:10.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.833+0000 7fdde8c00640 1 -- 172.21.15.122:0/557669181 >> 172.21.15.122:0/557669181 conn(0x7fdde40b4190 msgr2=0x7fdde415dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:10.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.833+0000 7fdde8c00640 1 -- 172.21.15.122:0/557669181 shutdown_connections 2024-05-28T06:14:10.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:10.833+0000 7fdde8c00640 1 -- 172.21.15.122:0/557669181 wait complete. 2024-05-28T06:14:15.855 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:14:15.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:15.997+0000 7f4da7e00640 1 Processor -- start 2024-05-28T06:14:15.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:15.997+0000 7f4da7e00640 1 -- start start 2024-05-28T06:14:15.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.001+0000 7f4da7e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4da815ed90 0x7f4da815bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:15.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.001+0000 7f4da7e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4da815c2f0 0x7f4da806f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:16.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.001+0000 7f4da7e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4da8062b80 con 0x7f4da80adfe0 2024-05-28T06:14:16.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.001+0000 7f4da7e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f4da815c780 con 0x7f4da815ed90 2024-05-28T06:14:16.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.001+0000 7f4da7e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f4da80af690 con 0x7f4da815c2f0 2024-05-28T06:14:16.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.001+0000 7f4da6a00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f4da80adfe0 0x7f4da80ae3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:54682/0 (socket says 172.21.15.122:54682) 2024-05-28T06:14:16.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.001+0000 7f4da6a00640 1 -- 172.21.15.122:0/929045584 learned_addr learned my addr 172.21.15.122:0/929045584 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:14:16.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.001+0000 7f4d9e000640 1 --2- 172.21.15.122:0/929045584 >> v2:172.21.15.122:3300/0 conn(0x7f4da815ed90 0x7f4da815bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:16.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.001+0000 7f4da7400640 1 --2- 172.21.15.122:0/929045584 >> v2:172.21.15.153:3300/0 conn(0x7f4da815c2f0 0x7f4da806f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:16.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.001+0000 7f4da6000640 1 -- 172.21.15.122:0/929045584 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2202883333 0 0) 0x7f4da8062b80 con 0x7f4da80adfe0 2024-05-28T06:14:16.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.001+0000 7f4da6000640 1 -- 172.21.15.122:0/929045584 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d8c003530 con 0x7f4da80adfe0 2024-05-28T06:14:16.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.001+0000 7f4d9e000640 1 -- 172.21.15.122:0/929045584 >> v2:172.21.15.153:3300/0 conn(0x7f4da815c2f0 msgr2=0x7f4da806f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:16.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.001+0000 7f4d9e000640 1 --2- 172.21.15.122:0/929045584 >> v2:172.21.15.153:3300/0 conn(0x7f4da815c2f0 0x7f4da806f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:16.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.001+0000 7f4d9e000640 1 -- 172.21.15.122:0/929045584 >> v1:172.21.15.122:6789/0 conn(0x7f4da80adfe0 legacy=0x7f4da80ae3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:16.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.001+0000 7f4d9e000640 1 -- 172.21.15.122:0/929045584 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da80af970 con 0x7f4da815ed90 2024-05-28T06:14:16.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.001+0000 7f4da7400640 1 --2- 172.21.15.122:0/929045584 >> v2:172.21.15.153:3300/0 conn(0x7f4da815c2f0 0x7f4da806f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:14:16.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.005+0000 7f4d9e000640 1 --2- 172.21.15.122:0/929045584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4da815ed90 0x7f4da815bdb0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f4da806e760 tx=0x7f4d9001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145c5cbea628a11a server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:16.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.005+0000 7f4da6000640 1 -- 172.21.15.122:0/929045584 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d900b1070 con 0x7f4da815ed90 2024-05-28T06:14:16.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.005+0000 7f4da6000640 1 -- 172.21.15.122:0/929045584 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d900ac620 con 0x7f4da815ed90 2024-05-28T06:14:16.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.005+0000 7f4da6000640 1 -- 172.21.15.122:0/929045584 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d900ac9d0 con 0x7f4da815ed90 2024-05-28T06:14:16.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.005+0000 7f4da7e00640 1 -- 172.21.15.122:0/929045584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4da815ed90 msgr2=0x7f4da815bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:16.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.005+0000 7f4da7e00640 1 --2- 172.21.15.122:0/929045584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4da815ed90 0x7f4da815bdb0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f4da806e760 tx=0x7f4d9001c3c0 comp rx=0 tx=0).stop 2024-05-28T06:14:16.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.005+0000 7f4da7e00640 1 -- 172.21.15.122:0/929045584 shutdown_connections 2024-05-28T06:14:16.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.005+0000 7f4da7e00640 1 --2- 172.21.15.122:0/929045584 >> v2:172.21.15.153:3300/0 conn(0x7f4da815c2f0 0x7f4da806f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:16.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.005+0000 7f4da7e00640 1 --2- 172.21.15.122:0/929045584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4da815ed90 0x7f4da815bdb0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:16.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.005+0000 7f4da7e00640 1 -- 172.21.15.122:0/929045584 >> 172.21.15.122:0/929045584 conn(0x7f4da8073450 msgr2=0x7f4da806b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:16.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.005+0000 7f4da7e00640 1 -- 172.21.15.122:0/929045584 shutdown_connections 2024-05-28T06:14:16.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.005+0000 7f4da7e00640 1 -- 172.21.15.122:0/929045584 wait complete. 2024-05-28T06:14:16.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.005+0000 7f4da7e00640 1 Processor -- start 2024-05-28T06:14:16.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.005+0000 7f4da7e00640 1 -- start start 2024-05-28T06:14:16.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4da7e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4da80adfe0 0x7f4da8159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:16.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4da7e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4da815c2f0 0x7f4da8150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:16.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4da7e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4da815ed90 0x7f4da80b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:16.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4da7e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4da80703d0 con 0x7f4da815ed90 2024-05-28T06:14:16.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4da7e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4da80aead0 con 0x7f4da80adfe0 2024-05-28T06:14:16.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4da7e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f4da8070550 con 0x7f4da815c2f0 2024-05-28T06:14:16.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4da7400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4da815ed90 0x7f4da80b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:16.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4da7400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4da815ed90 0x7f4da80b4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:32976/0 (socket says 172.21.15.122:32976) 2024-05-28T06:14:16.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4da7400640 1 -- 172.21.15.122:0/1165988181 learned_addr learned my addr 172.21.15.122:0/1165988181 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:16.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4da6a00640 1 --2- 172.21.15.122:0/1165988181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4da80adfe0 0x7f4da8159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:16.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4d9e000640 1 --2- 172.21.15.122:0/1165988181 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4da815c2f0 0x7f4da8150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:16.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4da7400640 1 -- 172.21.15.122:0/1165988181 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4da815c2f0 msgr2=0x7f4da8150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:16.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4da7400640 1 --2- 172.21.15.122:0/1165988181 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4da815c2f0 0x7f4da8150b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:16.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4da7400640 1 -- 172.21.15.122:0/1165988181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4da80adfe0 msgr2=0x7f4da8159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:16.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4da7400640 1 --2- 172.21.15.122:0/1165988181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4da80adfe0 0x7f4da8159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:16.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4da7400640 1 -- 172.21.15.122:0/1165988181 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da8160d20 con 0x7f4da815ed90 2024-05-28T06:14:16.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4da6a00640 1 --2- 172.21.15.122:0/1165988181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4da80adfe0 0x7f4da8159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:14:16.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4da7400640 1 --2- 172.21.15.122:0/1165988181 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4da815ed90 0x7f4da80b4b30 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f4da0007ef0 tx=0x7f4da000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:16.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4d9f400640 1 -- 172.21.15.122:0/1165988181 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da001a070 con 0x7f4da815ed90 2024-05-28T06:14:16.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4d9f400640 1 -- 172.21.15.122:0/1165988181 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da0003ba0 con 0x7f4da815ed90 2024-05-28T06:14:16.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4d9f400640 1 -- 172.21.15.122:0/1165988181 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da0004030 con 0x7f4da815ed90 2024-05-28T06:14:16.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4da7e00640 1 -- 172.21.15.122:0/1165988181 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4da81589b0 con 0x7f4da815ed90 2024-05-28T06:14:16.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4da7e00640 1 -- 172.21.15.122:0/1165988181 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da8152520 con 0x7f4da815ed90 2024-05-28T06:14:16.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4da7e00640 1 -- 172.21.15.122:0/1165988181 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4da8075620 con 0x7f4da815ed90 2024-05-28T06:14:16.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.009+0000 7f4d9f400640 1 -- 172.21.15.122:0/1165988181 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 23) ==== 89109+0+0 (secure 0 0 0) 0x7f4da001d070 con 0x7f4da815ed90 2024-05-28T06:14:16.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.013+0000 7f4d9f400640 1 --2- 172.21.15.122:0/1165988181 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4d84069010 0x7f4d8406b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:16.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.013+0000 7f4d9f400640 1 -- 172.21.15.122:0/1165988181 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f4da00855a0 con 0x7f4da815ed90 2024-05-28T06:14:16.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.013+0000 7f4da6a00640 1 --2- 172.21.15.122:0/1165988181 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4d84069010 0x7f4d8406b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:16.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.013+0000 7f4da6a00640 1 --2- 172.21.15.122:0/1165988181 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4d84069010 0x7f4d8406b4d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4d98005890 tx=0x7f4d98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:16.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.017+0000 7f4d9f400640 1 -- 172.21.15.122:0/1165988181 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4da0010070 con 0x7f4da815ed90 2024-05-28T06:14:16.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.229+0000 7f4da7e00640 1 -- 172.21.15.122:0/1165988181 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f4da8157b30 con 0x7f4da815ed90 2024-05-28T06:14:16.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.229+0000 7f4d9f400640 1 -- 172.21.15.122:0/1165988181 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2279 (secure 0 0 0) 0x7f4da0056f60 con 0x7f4da815ed90 2024-05-28T06:14:16.228 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:14:16.229 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:14:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:14:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:14:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:14:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:14:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:14:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:14:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:14:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:14:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:14:16.229 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:14:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:14:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:14:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:14:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:14:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 531, 2024-05-28T06:14:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:14:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:14:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:14:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:14:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:14:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 62, 2024-05-28T06:14:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:14:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:14:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:14:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:14:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:14:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:14:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:14:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:14:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:14:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:14:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:14:16.231 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:14:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:14:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 4905, 2024-05-28T06:14:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 20428523694, 2024-05-28T06:14:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 41283436544, 2024-05-28T06:14:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 731810676736, 2024-05-28T06:14:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280 2024-05-28T06:14:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:14:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 38, 2024-05-28T06:14:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 4, 2024-05-28T06:14:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:14:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:14:16.232 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:14:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:14:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:14:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 4, 2024-05-28T06:14:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:14:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "c", 2024-05-28T06:14:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:14:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 6300 2024-05-28T06:14:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:14:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:14:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:14:16.233 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:14:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:14:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:14:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:14:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:14:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:14:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:14:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 10, 2024-05-28T06:14:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:13:37.375536+0000", 2024-05-28T06:14:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:14:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:16.234 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:14:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: "d99f5b57-79d0-4ca8-9bc6-54c2cbc59c2a": { 2024-05-28T06:14:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "6 ongoing+pending clones; Avg progress is 40.929% (3s)\n [===========.................] (remaining: 5s)", 2024-05-28T06:14:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.40928998589515686, 2024-05-28T06:14:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:14:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: "f6823e37-281c-440e-aebe-a3bb39be0858": { 2024-05-28T06:14:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "4 ongoing clones; Avg progress is 22.266% (11s)\n [======......................] (remaining: 39s)", 2024-05-28T06:14:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.22266000509262085, 2024-05-28T06:14:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:14:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:16.235 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:16.235 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:14:16.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.229+0000 7f4da7e00640 1 -- 172.21.15.122:0/1165988181 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4d84069010 msgr2=0x7f4d8406b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:16.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.229+0000 7f4da7e00640 1 --2- 172.21.15.122:0/1165988181 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4d84069010 0x7f4d8406b4d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4d98005890 tx=0x7f4d98009040 comp rx=0 tx=0).stop 2024-05-28T06:14:16.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.229+0000 7f4da7e00640 1 -- 172.21.15.122:0/1165988181 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4da815ed90 msgr2=0x7f4da80b4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:16.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.229+0000 7f4da7e00640 1 --2- 172.21.15.122:0/1165988181 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4da815ed90 0x7f4da80b4b30 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f4da0007ef0 tx=0x7f4da000d4a0 comp rx=0 tx=0).stop 2024-05-28T06:14:16.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.229+0000 7f4da7e00640 1 -- 172.21.15.122:0/1165988181 shutdown_connections 2024-05-28T06:14:16.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.229+0000 7f4da7e00640 1 --2- 172.21.15.122:0/1165988181 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4d84069010 0x7f4d8406b4d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:16.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.229+0000 7f4da7e00640 1 --2- 172.21.15.122:0/1165988181 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4da815ed90 0x7f4da80b4b30 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:16.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.229+0000 7f4da7e00640 1 --2- 172.21.15.122:0/1165988181 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4da815c2f0 0x7f4da8150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:16.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.229+0000 7f4da7e00640 1 --2- 172.21.15.122:0/1165988181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4da80adfe0 0x7f4da8159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:16.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.229+0000 7f4da7e00640 1 -- 172.21.15.122:0/1165988181 >> 172.21.15.122:0/1165988181 conn(0x7f4da8073450 msgr2=0x7f4da80b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:16.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.229+0000 7f4da7e00640 1 -- 172.21.15.122:0/1165988181 shutdown_connections 2024-05-28T06:14:16.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:16.229+0000 7f4da7e00640 1 -- 172.21.15.122:0/1165988181 wait complete. 2024-05-28T06:14:18.587 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:14:18.592 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:14:21.251 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:14:21.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.397+0000 7f4537200640 1 Processor -- start 2024-05-28T06:14:21.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.397+0000 7f4537200640 1 -- start start 2024-05-28T06:14:21.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.401+0000 7f4537200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f45380b6680 0x7f45380d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:21.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.401+0000 7f4537200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45380afb80 con 0x7f45380d1300 2024-05-28T06:14:21.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.401+0000 7f4537200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45380b0d10 con 0x7f4538145f90 2024-05-28T06:14:21.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.401+0000 7f4537200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f45380d1dc0 con 0x7f45380b6680 2024-05-28T06:14:21.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.401+0000 7f452d400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f45380d1300 0x7f45380b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:54694/0 (socket says 172.21.15.122:54694) 2024-05-28T06:14:21.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.401+0000 7f452d400640 1 -- 172.21.15.122:0/2549185268 learned_addr learned my addr 172.21.15.122:0/2549185268 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:14:21.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.401+0000 7f4536800640 1 --2- 172.21.15.122:0/2549185268 >> v2:172.21.15.122:3300/0 conn(0x7f45380b6680 0x7f45380d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:21.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.401+0000 7f4535400640 1 -- 172.21.15.122:0/2549185268 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1326557057 0 0) 0x7f4520001120 con 0x7f45380d1300 2024-05-28T06:14:21.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.401+0000 7f4536800640 1 -- 172.21.15.122:0/2549185268 >> v1:172.21.15.153:6789/0 conn(0x7f4538145f90 legacy=0x7f45380b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:21.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.401+0000 7f4536800640 1 -- 172.21.15.122:0/2549185268 >> v1:172.21.15.122:6789/0 conn(0x7f45380d1300 legacy=0x7f45380b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:21.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.401+0000 7f4536800640 1 -- 172.21.15.122:0/2549185268 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45380d20a0 con 0x7f45380b6680 2024-05-28T06:14:21.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.405+0000 7f4536800640 1 --2- 172.21.15.122:0/2549185268 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45380b6680 0x7f45380d1740 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f45300097c0 tx=0x7f453001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d9deff6c19ff28 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:21.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.405+0000 7f4535400640 1 -- 172.21.15.122:0/2549185268 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45300b0070 con 0x7f45380b6680 2024-05-28T06:14:21.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.405+0000 7f4535400640 1 -- 172.21.15.122:0/2549185268 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45300ab600 con 0x7f45380b6680 2024-05-28T06:14:21.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.405+0000 7f4535400640 1 -- 172.21.15.122:0/2549185268 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45300ab9d0 con 0x7f45380b6680 2024-05-28T06:14:21.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.405+0000 7f4537200640 1 -- 172.21.15.122:0/2549185268 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45380b6680 msgr2=0x7f45380d1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:21.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.405+0000 7f4537200640 1 --2- 172.21.15.122:0/2549185268 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45380b6680 0x7f45380d1740 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f45300097c0 tx=0x7f453001c410 comp rx=0 tx=0).stop 2024-05-28T06:14:21.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.405+0000 7f4537200640 1 -- 172.21.15.122:0/2549185268 shutdown_connections 2024-05-28T06:14:21.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.405+0000 7f4537200640 1 --2- 172.21.15.122:0/2549185268 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45380b6680 0x7f45380d1740 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:21.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.405+0000 7f4537200640 1 -- 172.21.15.122:0/2549185268 >> 172.21.15.122:0/2549185268 conn(0x7f45380b6be0 msgr2=0x7f453809aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:21.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.405+0000 7f4537200640 1 -- 172.21.15.122:0/2549185268 shutdown_connections 2024-05-28T06:14:21.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.405+0000 7f4537200640 1 -- 172.21.15.122:0/2549185268 wait complete. 2024-05-28T06:14:21.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.405+0000 7f4537200640 1 Processor -- start 2024-05-28T06:14:21.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.405+0000 7f4537200640 1 -- start start 2024-05-28T06:14:21.406 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.405+0000 7f4537200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45380b6680 0x7f453806efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:21.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.405+0000 7f4537200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45380d1300 0x7f453815c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:21.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.405+0000 7f4537200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4538145f90 0x7f4538070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:21.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.405+0000 7f4537200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f453816a5e0 con 0x7f45380b6680 2024-05-28T06:14:21.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.405+0000 7f4537200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4538146370 con 0x7f45380d1300 2024-05-28T06:14:21.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.405+0000 7f4537200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f453816a760 con 0x7f4538145f90 2024-05-28T06:14:21.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.409+0000 7f4535e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45380b6680 0x7f453806efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:21.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.409+0000 7f4535e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45380b6680 0x7f453806efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:32992/0 (socket says 172.21.15.122:32992) 2024-05-28T06:14:21.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.409+0000 7f4535e00640 1 -- 172.21.15.122:0/442207483 learned_addr learned my addr 172.21.15.122:0/442207483 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:21.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.409+0000 7f4536800640 1 --2- 172.21.15.122:0/442207483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4538145f90 0x7f4538070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:21.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.409+0000 7f452d400640 1 --2- 172.21.15.122:0/442207483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45380d1300 0x7f453815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:21.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.409+0000 7f4535e00640 1 -- 172.21.15.122:0/442207483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4538145f90 msgr2=0x7f4538070aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:21.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.409+0000 7f4535e00640 1 --2- 172.21.15.122:0/442207483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4538145f90 0x7f4538070aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:21.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.409+0000 7f4535e00640 1 -- 172.21.15.122:0/442207483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45380d1300 msgr2=0x7f453815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:21.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.409+0000 7f4535e00640 1 --2- 172.21.15.122:0/442207483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45380d1300 0x7f453815c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:21.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.409+0000 7f4535e00640 1 -- 172.21.15.122:0/442207483 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4538070600 con 0x7f45380b6680 2024-05-28T06:14:21.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.409+0000 7f4536800640 1 --2- 172.21.15.122:0/442207483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4538145f90 0x7f4538070aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:14:21.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.409+0000 7f452d400640 1 --2- 172.21.15.122:0/442207483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45380d1300 0x7f453815c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:14:21.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.409+0000 7f4535e00640 1 --2- 172.21.15.122:0/442207483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45380b6680 0x7f453806efc0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f452800c7a0 tx=0x7f452800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:21.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.409+0000 7f452ea00640 1 -- 172.21.15.122:0/442207483 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4528003b80 con 0x7f45380b6680 2024-05-28T06:14:21.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.409+0000 7f452ea00640 1 -- 172.21.15.122:0/442207483 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4528003d20 con 0x7f45380b6680 2024-05-28T06:14:21.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.409+0000 7f452ea00640 1 -- 172.21.15.122:0/442207483 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452800aa90 con 0x7f45380b6680 2024-05-28T06:14:21.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.409+0000 7f4537200640 1 -- 172.21.15.122:0/442207483 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f453806f5a0 con 0x7f45380b6680 2024-05-28T06:14:21.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.409+0000 7f4537200640 1 -- 172.21.15.122:0/442207483 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f453806fb60 con 0x7f45380b6680 2024-05-28T06:14:21.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.409+0000 7f4537200640 1 -- 172.21.15.122:0/442207483 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4538075620 con 0x7f45380b6680 2024-05-28T06:14:21.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.409+0000 7f452ea00640 1 -- 172.21.15.122:0/442207483 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 23) ==== 89109+0+0 (secure 0 0 0) 0x7f452800ac30 con 0x7f45380b6680 2024-05-28T06:14:21.411 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.413+0000 7f452ea00640 1 --2- 172.21.15.122:0/442207483 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4514068fe0 0x7f451406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:21.411 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.413+0000 7f452ea00640 1 -- 172.21.15.122:0/442207483 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f45280852a0 con 0x7f45380b6680 2024-05-28T06:14:21.411 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.413+0000 7f452d400640 1 --2- 172.21.15.122:0/442207483 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4514068fe0 0x7f451406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:21.412 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.413+0000 7f452d400640 1 --2- 172.21.15.122:0/442207483 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4514068fe0 0x7f451406b4a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4520007fd0 tx=0x7f4520009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:21.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.417+0000 7f452ea00640 1 -- 172.21.15.122:0/442207483 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f45280572b0 con 0x7f45380b6680 2024-05-28T06:14:21.631 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.633+0000 7f4537200640 1 -- 172.21.15.122:0/442207483 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f4538073b30 con 0x7f45380b6680 2024-05-28T06:14:21.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.633+0000 7f452ea00640 1 -- 172.21.15.122:0/442207483 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2279 (secure 0 0 0) 0x7f4528056bb0 con 0x7f45380b6680 2024-05-28T06:14:21.632 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:14:21.632 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:14:21.633 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:14:21.633 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:14:21.633 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:14:21.633 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:14:21.633 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:14:21.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:21.633 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:14:21.633 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:14:21.633 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:14:21.633 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:14:21.633 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:14:21.633 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:21.633 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:14:21.634 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:14:21.634 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:14:21.634 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:14:21.634 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:21.634 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 537, 2024-05-28T06:14:21.634 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:14:21.634 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:14:21.634 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:14:21.634 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:14:21.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:21.634 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:14:21.634 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 62, 2024-05-28T06:14:21.634 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:14:21.635 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:14:21.635 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:14:21.635 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:14:21.635 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:14:21.635 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:14:21.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:21.635 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:14:21.635 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:14:21.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:14:21.635 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:14:21.635 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:14:21.635 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:21.635 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:21.636 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:14:21.636 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:14:21.636 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 4905, 2024-05-28T06:14:21.636 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 20428523694, 2024-05-28T06:14:21.636 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 41283436544, 2024-05-28T06:14:21.636 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 731810676736, 2024-05-28T06:14:21.636 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280 2024-05-28T06:14:21.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:21.636 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:14:21.636 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 38, 2024-05-28T06:14:21.636 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 4, 2024-05-28T06:14:21.636 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:14:21.636 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:14:21.637 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:14:21.637 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:14:21.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:14:21.637 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 4, 2024-05-28T06:14:21.637 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:14:21.637 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "c", 2024-05-28T06:14:21.637 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:14:21.637 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 6300 2024-05-28T06:14:21.637 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:21.637 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:21.637 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:14:21.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:21.637 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:14:21.638 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:14:21.638 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:14:21.638 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:14:21.638 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:14:21.638 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:14:21.638 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:14:21.638 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:21.638 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:14:21.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:21.638 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:14:21.638 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 10, 2024-05-28T06:14:21.638 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:13:37.375536+0000", 2024-05-28T06:14:21.638 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:14:21.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:21.639 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:14:21.639 INFO:teuthology.orchestra.run.smithi122.stdout: "d99f5b57-79d0-4ca8-9bc6-54c2cbc59c2a": { 2024-05-28T06:14:21.639 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "6 ongoing+pending clones; Avg progress is 40.929% (3s)\n [===========.................] (remaining: 5s)", 2024-05-28T06:14:21.639 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.40928998589515686, 2024-05-28T06:14:21.639 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:14:21.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:21.639 INFO:teuthology.orchestra.run.smithi122.stdout: "f6823e37-281c-440e-aebe-a3bb39be0858": { 2024-05-28T06:14:21.639 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "4 ongoing clones; Avg progress is 22.266% (11s)\n [======......................] (remaining: 39s)", 2024-05-28T06:14:21.639 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.22266000509262085, 2024-05-28T06:14:21.639 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:14:21.639 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:21.639 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:21.639 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:14:21.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.633+0000 7f4537200640 1 -- 172.21.15.122:0/442207483 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4514068fe0 msgr2=0x7f451406b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:21.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.633+0000 7f4537200640 1 --2- 172.21.15.122:0/442207483 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4514068fe0 0x7f451406b4a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4520007fd0 tx=0x7f4520009040 comp rx=0 tx=0).stop 2024-05-28T06:14:21.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.633+0000 7f4537200640 1 -- 172.21.15.122:0/442207483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45380b6680 msgr2=0x7f453806efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:21.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.633+0000 7f4537200640 1 --2- 172.21.15.122:0/442207483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45380b6680 0x7f453806efc0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f452800c7a0 tx=0x7f452800cc60 comp rx=0 tx=0).stop 2024-05-28T06:14:21.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.633+0000 7f4537200640 1 -- 172.21.15.122:0/442207483 shutdown_connections 2024-05-28T06:14:21.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.633+0000 7f4537200640 1 --2- 172.21.15.122:0/442207483 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4514068fe0 0x7f451406b4a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:21.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.633+0000 7f4537200640 1 --2- 172.21.15.122:0/442207483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4538145f90 0x7f4538070aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:21.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.633+0000 7f4537200640 1 --2- 172.21.15.122:0/442207483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45380d1300 0x7f453815c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:21.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.633+0000 7f4537200640 1 --2- 172.21.15.122:0/442207483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45380b6680 0x7f453806efc0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:21.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.633+0000 7f4537200640 1 -- 172.21.15.122:0/442207483 >> 172.21.15.122:0/442207483 conn(0x7f45380b6be0 msgr2=0x7f453809c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:21.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.637+0000 7f4537200640 1 -- 172.21.15.122:0/442207483 shutdown_connections 2024-05-28T06:14:21.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:21.637+0000 7f4537200640 1 -- 172.21.15.122:0/442207483 wait complete. 2024-05-28T06:14:26.656 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-28T06:14:26.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.801+0000 7f64b3000640 1 Processor -- start 2024-05-28T06:14:26.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.801+0000 7f64b3000640 1 -- start start 2024-05-28T06:14:26.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.801+0000 7f64b3000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f64ac0b58d0 0x7f64ac0b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:26.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.801+0000 7f64b3000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64ac15e730 0x7f64ac15ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:26.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.801+0000 7f64b3000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64ac0b61f0 con 0x7f64ac0ce4f0 2024-05-28T06:14:26.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.801+0000 7f64b3000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f64ac15d970 con 0x7f64ac0b58d0 2024-05-28T06:14:26.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.801+0000 7f64b3000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f64ac15dc50 con 0x7f64ac15e730 2024-05-28T06:14:26.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.805+0000 7f64b1000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64ac15e730 0x7f64ac15ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:26.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.805+0000 7f64b1000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64ac15e730 0x7f64ac15ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:60194/0 (socket says 172.21.15.122:60194) 2024-05-28T06:14:26.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.805+0000 7f64b1000640 1 -- 172.21.15.122:0/1932126910 learned_addr learned my addr 172.21.15.122:0/1932126910 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:26.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.805+0000 7f64a3400640 1 --1- 172.21.15.122:0/1932126910 >> v1:172.21.15.153:6789/0 conn(0x7f64ac0ce4f0 0x7f64ac0ce980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:32786/0 (socket says 172.21.15.122:32786) 2024-05-28T06:14:26.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.805+0000 7f64abe00640 1 --2- 172.21.15.122:0/1932126910 >> v2:172.21.15.153:3300/0 conn(0x7f64ac0b58d0 0x7f64ac0b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:26.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.805+0000 7f64b1000640 1 -- 172.21.15.122:0/1932126910 >> v2:172.21.15.153:3300/0 conn(0x7f64ac0b58d0 msgr2=0x7f64ac0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:26.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.805+0000 7f64b1000640 1 --2- 172.21.15.122:0/1932126910 >> v2:172.21.15.153:3300/0 conn(0x7f64ac0b58d0 0x7f64ac0b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:26.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.805+0000 7f64b1000640 1 -- 172.21.15.122:0/1932126910 >> v1:172.21.15.153:6789/0 conn(0x7f64ac0ce4f0 legacy=0x7f64ac0ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:26.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.805+0000 7f64ab400640 1 -- 172.21.15.122:0/1932126910 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 197415439 0 0) 0x7f64ac0b61f0 con 0x7f64ac0ce4f0 2024-05-28T06:14:26.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.805+0000 7f64b1000640 1 -- 172.21.15.122:0/1932126910 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ac15df30 con 0x7f64ac15e730 2024-05-28T06:14:26.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.805+0000 7f64b1000640 1 --2- 172.21.15.122:0/1932126910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64ac15e730 0x7f64ac15ebc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f64a4009e50 tx=0x7f64a401ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d3a7c7b409c425e server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:26.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.809+0000 7f64ab400640 1 -- 172.21.15.122:0/1932126910 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a40a5790 con 0x7f64ac15e730 2024-05-28T06:14:26.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.809+0000 7f64ab400640 1 -- 172.21.15.122:0/1932126910 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a40a5930 con 0x7f64ac15e730 2024-05-28T06:14:26.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.809+0000 7f64ab400640 1 -- 172.21.15.122:0/1932126910 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a40a5d00 con 0x7f64ac15e730 2024-05-28T06:14:26.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.809+0000 7f64b3000640 1 -- 172.21.15.122:0/1932126910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64ac15e730 msgr2=0x7f64ac15ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:26.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.809+0000 7f64b3000640 1 --2- 172.21.15.122:0/1932126910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64ac15e730 0x7f64ac15ebc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f64a4009e50 tx=0x7f64a401ca30 comp rx=0 tx=0).stop 2024-05-28T06:14:26.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.809+0000 7f64b3000640 1 -- 172.21.15.122:0/1932126910 shutdown_connections 2024-05-28T06:14:26.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.809+0000 7f64b3000640 1 --2- 172.21.15.122:0/1932126910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64ac15e730 0x7f64ac15ebc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:26.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.809+0000 7f64b3000640 1 --2- 172.21.15.122:0/1932126910 >> v2:172.21.15.153:3300/0 conn(0x7f64ac0b58d0 0x7f64ac0b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:26.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.809+0000 7f64b3000640 1 -- 172.21.15.122:0/1932126910 >> 172.21.15.122:0/1932126910 conn(0x7f64ac06bd90 msgr2=0x7f64ac06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:26.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.809+0000 7f64b3000640 1 -- 172.21.15.122:0/1932126910 shutdown_connections 2024-05-28T06:14:26.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.809+0000 7f64b3000640 1 -- 172.21.15.122:0/1932126910 wait complete. 2024-05-28T06:14:26.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.809+0000 7f64b3000640 1 Processor -- start 2024-05-28T06:14:26.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.809+0000 7f64b3000640 1 -- start start 2024-05-28T06:14:26.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.809+0000 7f64b3000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64ac0b58d0 0x7f64ac0b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:26.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.809+0000 7f64b3000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64ac0ce4f0 0x7f64ac141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:26.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.809+0000 7f64b3000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64ac15e730 0x7f64ac13aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:26.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.809+0000 7f64b3000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac1693d0 con 0x7f64ac0ce4f0 2024-05-28T06:14:26.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.809+0000 7f64b3000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac169250 con 0x7f64ac15e730 2024-05-28T06:14:26.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.809+0000 7f64b3000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f64ac169550 con 0x7f64ac0b58d0 2024-05-28T06:14:26.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.809+0000 7f64a3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64ac0ce4f0 0x7f64ac141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:26.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.809+0000 7f64a3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64ac0ce4f0 0x7f64ac141e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52018/0 (socket says 172.21.15.122:52018) 2024-05-28T06:14:26.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.809+0000 7f64a3400640 1 -- 172.21.15.122:0/183455234 learned_addr learned my addr 172.21.15.122:0/183455234 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:26.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.813+0000 7f64abe00640 1 --2- 172.21.15.122:0/183455234 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64ac0b58d0 0x7f64ac0b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:26.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.813+0000 7f64b1000640 1 --2- 172.21.15.122:0/183455234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64ac15e730 0x7f64ac13aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:26.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.813+0000 7f64a3400640 1 -- 172.21.15.122:0/183455234 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64ac0b58d0 msgr2=0x7f64ac0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:26.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.813+0000 7f64a3400640 1 --2- 172.21.15.122:0/183455234 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64ac0b58d0 0x7f64ac0b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:26.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.813+0000 7f64a3400640 1 -- 172.21.15.122:0/183455234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64ac15e730 msgr2=0x7f64ac13aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:26.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.813+0000 7f64a3400640 1 --2- 172.21.15.122:0/183455234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64ac15e730 0x7f64ac13aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:26.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.813+0000 7f64a3400640 1 -- 172.21.15.122:0/183455234 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ac140e80 con 0x7f64ac0ce4f0 2024-05-28T06:14:26.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.813+0000 7f64a3400640 1 --2- 172.21.15.122:0/183455234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64ac0ce4f0 0x7f64ac141e60 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f64940011f0 tx=0x7f649400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:26.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.813+0000 7f64a8c00640 1 -- 172.21.15.122:0/183455234 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6494018070 con 0x7f64ac0ce4f0 2024-05-28T06:14:26.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.813+0000 7f64a8c00640 1 -- 172.21.15.122:0/183455234 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64940074e0 con 0x7f64ac0ce4f0 2024-05-28T06:14:26.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.813+0000 7f64a8c00640 1 -- 172.21.15.122:0/183455234 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6494004a10 con 0x7f64ac0ce4f0 2024-05-28T06:14:26.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.813+0000 7f64b3000640 1 -- 172.21.15.122:0/183455234 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64ac141160 con 0x7f64ac0ce4f0 2024-05-28T06:14:26.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.813+0000 7f64b3000640 1 -- 172.21.15.122:0/183455234 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64ac141720 con 0x7f64ac0ce4f0 2024-05-28T06:14:26.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.813+0000 7f64b3000640 1 -- 172.21.15.122:0/183455234 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64ac068c40 con 0x7f64ac0ce4f0 2024-05-28T06:14:26.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.813+0000 7f64a8c00640 1 -- 172.21.15.122:0/183455234 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 23) ==== 89109+0+0 (secure 0 0 0) 0x7f6494004bb0 con 0x7f64ac0ce4f0 2024-05-28T06:14:26.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.813+0000 7f64a8c00640 1 --2- 172.21.15.122:0/183455234 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6488068fe0 0x7f648806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:26.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.817+0000 7f64a8c00640 1 -- 172.21.15.122:0/183455234 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f6494084a80 con 0x7f64ac0ce4f0 2024-05-28T06:14:26.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.817+0000 7f64abe00640 1 --2- 172.21.15.122:0/183455234 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6488068fe0 0x7f648806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:26.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.817+0000 7f64abe00640 1 --2- 172.21.15.122:0/183455234 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6488068fe0 0x7f648806b4a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f649c009af0 tx=0x7f649c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:26.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:26.821+0000 7f64a8c00640 1 -- 172.21.15.122:0/183455234 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6494056790 con 0x7f64ac0ce4f0 2024-05-28T06:14:27.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.029+0000 7f64b3000640 1 -- 172.21.15.122:0/183455234 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f64ac06cfd0 con 0x7f64ac0ce4f0 2024-05-28T06:14:27.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.029+0000 7f64a8c00640 1 -- 172.21.15.122:0/183455234 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2279 (secure 0 0 0) 0x7f6494056090 con 0x7f64ac0ce4f0 2024-05-28T06:14:27.030 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:14:27.030 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:14:27.030 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "e63a9349-baf2-4247-95d1-eb8599fad84f", 2024-05-28T06:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: "health": { 2024-05-28T06:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "HEALTH_OK", 2024-05-28T06:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: "checks": {}, 2024-05-28T06:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: "mutes": [] 2024-05-28T06:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: "election_epoch": 4, 2024-05-28T06:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum": [ 2024-05-28T06:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-05-28T06:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: 1, 2024-05-28T06:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: 2 2024-05-28T06:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_names": [ 2024-05-28T06:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: "a", 2024-05-28T06:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: "b", 2024-05-28T06:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: "c" 2024-05-28T06:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: "quorum_age": 542, 2024-05-28T06:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": { 2024-05-28T06:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 1, 2024-05-28T06:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: "min_mon_release_name": "squid", 2024-05-28T06:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: "num_mons": 3 2024-05-28T06:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap": { 2024-05-28T06:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 62, 2024-05-28T06:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: "num_osds": 8, 2024-05-28T06:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: "num_up_osds": 8, 2024-05-28T06:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_up_since": 1716876336, 2024-05-28T06:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: "num_in_osds": 8, 2024-05-28T06:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_in_since": 1716876326, 2024-05-28T06:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: "num_remapped_pgs": 0 2024-05-28T06:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap": { 2024-05-28T06:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: "pgs_by_state": [ 2024-05-28T06:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: "state_name": "active+clean", 2024-05-28T06:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: "count": 97 2024-05-28T06:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pgs": 97, 2024-05-28T06:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: "num_pools": 3, 2024-05-28T06:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: "num_objects": 4905, 2024-05-28T06:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: "data_bytes": 20428523694, 2024-05-28T06:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_used": 41283436544, 2024-05-28T06:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_avail": 731810676736, 2024-05-28T06:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: "bytes_total": 773094113280 2024-05-28T06:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: "fsmap": { 2024-05-28T06:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 38, 2024-05-28T06:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 4, 2024-05-28T06:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-05-28T06:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-05-28T06:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1, 2024-05-28T06:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: "by_rank": [ 2024-05-28T06:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-05-28T06:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: "filesystem_id": 4, 2024-05-28T06:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: "rank": 0, 2024-05-28T06:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "c", 2024-05-28T06:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: "status": "up:active", 2024-05-28T06:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: "gid": 6300 2024-05-28T06:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: "up:standby": 3 2024-05-28T06:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: "mgrmap": { 2024-05-28T06:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: "available": true, 2024-05-28T06:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: "num_standbys": 1, 2024-05-28T06:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: "modules": [ 2024-05-28T06:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: "iostat", 2024-05-28T06:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: "nfs", 2024-05-28T06:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: "restful" 2024-05-28T06:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-05-28T06:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: "servicemap": { 2024-05-28T06:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 10, 2024-05-28T06:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-05-28T06:13:37.375536+0000", 2024-05-28T06:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: "services": {} 2024-05-28T06:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: "progress_events": { 2024-05-28T06:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: "d99f5b57-79d0-4ca8-9bc6-54c2cbc59c2a": { 2024-05-28T06:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "6 ongoing+pending clones; Avg progress is 40.929% (3s)\n [===========.................] (remaining: 5s)", 2024-05-28T06:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.40928998589515686, 2024-05-28T06:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-05-28T06:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout: "f6823e37-281c-440e-aebe-a3bb39be0858": { 2024-05-28T06:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout: "message": "4 ongoing clones; Avg progress is 22.266% (11s)\n [======......................] (remaining: 39s)", 2024-05-28T06:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout: "progress": 0.22266000509262085, 2024-05-28T06:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout: "add_to_ceph_s": true 2024-05-28T06:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-05-28T06:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:14:27.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.033+0000 7f64b3000640 1 -- 172.21.15.122:0/183455234 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6488068fe0 msgr2=0x7f648806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:27.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.033+0000 7f64b3000640 1 --2- 172.21.15.122:0/183455234 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6488068fe0 0x7f648806b4a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f649c009af0 tx=0x7f649c008040 comp rx=0 tx=0).stop 2024-05-28T06:14:27.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.033+0000 7f64b3000640 1 -- 172.21.15.122:0/183455234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64ac0ce4f0 msgr2=0x7f64ac141e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:27.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.033+0000 7f64b3000640 1 --2- 172.21.15.122:0/183455234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64ac0ce4f0 0x7f64ac141e60 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f64940011f0 tx=0x7f649400c9b0 comp rx=0 tx=0).stop 2024-05-28T06:14:27.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.033+0000 7f64b3000640 1 -- 172.21.15.122:0/183455234 shutdown_connections 2024-05-28T06:14:27.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.033+0000 7f64b3000640 1 --2- 172.21.15.122:0/183455234 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6488068fe0 0x7f648806b4a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:27.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.033+0000 7f64b3000640 1 --2- 172.21.15.122:0/183455234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64ac15e730 0x7f64ac13aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:27.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.033+0000 7f64b3000640 1 --2- 172.21.15.122:0/183455234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64ac0ce4f0 0x7f64ac141e60 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:27.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.033+0000 7f64b3000640 1 --2- 172.21.15.122:0/183455234 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64ac0b58d0 0x7f64ac0b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:27.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.033+0000 7f64b3000640 1 -- 172.21.15.122:0/183455234 >> 172.21.15.122:0/183455234 conn(0x7f64ac06bd90 msgr2=0x7f64ac15cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:27.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.033+0000 7f64b3000640 1 -- 172.21.15.122:0/183455234 shutdown_connections 2024-05-28T06:14:27.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.033+0000 7f64b3000640 1 -- 172.21.15.122:0/183455234 wait complete. 2024-05-28T06:14:27.054 INFO:tasks.cephfs_test_runner:Test that 2 progress bars are printed when number of clone jobs is ... ERROR 2024-05-28T06:14:27.055 INFO:tasks.cephfs_test_runner: 2024-05-28T06:14:27.055 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-28T06:14:27.055 INFO:tasks.cephfs_test_runner:ERROR: test_progress_bars_for_7_clones (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-28T06:14:27.055 INFO:tasks.cephfs_test_runner:Test that 2 progress bars are printed when number of clone jobs is 2024-05-28T06:14:27.055 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-28T06:14:27.055 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-28T06:14:27.055 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_9ed025fbf4406fb54980a0647506b15895b6d863/qa/tasks/cephfs/test_volumes.py", line 7778, in tearDown 2024-05-28T06:14:27.055 INFO:tasks.cephfs_test_runner: self.wait_if_cloning_is_ongoing() 2024-05-28T06:14:27.055 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_9ed025fbf4406fb54980a0647506b15895b6d863/qa/tasks/cephfs/test_volumes.py", line 7759, in wait_if_cloning_is_ongoing 2024-05-28T06:14:27.055 INFO:tasks.cephfs_test_runner: while proceed(): 2024-05-28T06:14:27.055 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/contextutil.py", line 134, in __call__ 2024-05-28T06:14:27.055 INFO:tasks.cephfs_test_runner: raise MaxWhileTries(error_msg) 2024-05-28T06:14:27.056 INFO:tasks.cephfs_test_runner:teuthology.exceptions.MaxWhileTries: reached maximum tries (11) after waiting for 50 seconds 2024-05-28T06:14:27.056 INFO:tasks.cephfs_test_runner: 2024-05-28T06:14:27.056 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-28T06:14:27.056 INFO:tasks.cephfs_test_runner:Ran 3 tests in 487.968s 2024-05-28T06:14:27.056 INFO:tasks.cephfs_test_runner: 2024-05-28T06:14:27.056 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-05-28T06:14:27.056 INFO:tasks.cephfs_test_runner: 2024-05-28T06:14:27.056 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-28T06:14:27.056 INFO:tasks.cephfs_test_runner:ERROR: test_progress_bars_for_7_clones (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-28T06:14:27.056 INFO:tasks.cephfs_test_runner:Test that 2 progress bars are printed when number of clone jobs is 2024-05-28T06:14:27.056 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-28T06:14:27.056 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-28T06:14:27.056 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_9ed025fbf4406fb54980a0647506b15895b6d863/qa/tasks/cephfs/test_volumes.py", line 7778, in tearDown 2024-05-28T06:14:27.056 INFO:tasks.cephfs_test_runner: self.wait_if_cloning_is_ongoing() 2024-05-28T06:14:27.057 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_9ed025fbf4406fb54980a0647506b15895b6d863/qa/tasks/cephfs/test_volumes.py", line 7759, in wait_if_cloning_is_ongoing 2024-05-28T06:14:27.057 INFO:tasks.cephfs_test_runner: while proceed(): 2024-05-28T06:14:27.057 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/contextutil.py", line 134, in __call__ 2024-05-28T06:14:27.057 INFO:tasks.cephfs_test_runner: raise MaxWhileTries(error_msg) 2024-05-28T06:14:27.057 INFO:tasks.cephfs_test_runner:teuthology.exceptions.MaxWhileTries: reached maximum tries (11) after waiting for 50 seconds 2024-05-28T06:14:27.057 INFO:tasks.cephfs_test_runner: 2024-05-28T06:14:27.057 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_9ed025fbf4406fb54980a0647506b15895b6d863/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_progress_bars_for_7_clones (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-28T06:14:27.283 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=ee142806619343eeb8f623c67c931144 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_9ed025fbf4406fb54980a0647506b15895b6d863/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_progress_bars_for_7_clones (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-28T06:14:27.284 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-28T06:14:27.293 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-28T06:14:27.301 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-28T06:14:27.301 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:14:27.301 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:14:27.316 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:14:27.316 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:14:27.366 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:14:27.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.545+0000 7f6e70e00640 1 Processor -- start 2024-05-28T06:14:27.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.545+0000 7f6e70e00640 1 -- start start 2024-05-28T06:14:27.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.549+0000 7f6e70e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6e6c0b59c0 0x7f6e6c0cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:27.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.549+0000 7f6e70e00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e6c0d0310 con 0x7f6e6c0cff30 2024-05-28T06:14:27.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.549+0000 7f6e70e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e6c15be20 con 0x7f6e6c06f890 2024-05-28T06:14:27.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.549+0000 7f6e70e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f6e6c15c100 con 0x7f6e6c0b59c0 2024-05-28T06:14:27.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.549+0000 7f6e69e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f6e6c0cff30 0x7f6e6c06f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:49720/0 (socket says 172.21.15.122:49720) 2024-05-28T06:14:27.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.549+0000 7f6e6a800640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6e6c0b59c0 0x7f6e6c0cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:27.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.549+0000 7f6e69e00640 1 -- 172.21.15.122:0/2728415375 learned_addr learned my addr 172.21.15.122:0/2728415375 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:14:27.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.549+0000 7f6e6a800640 1 -- 172.21.15.122:0/2728415375 >> v1:172.21.15.153:6789/0 conn(0x7f6e6c06f890 legacy=0x7f6e6c0cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:27.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.549+0000 7f6e6a800640 1 -- 172.21.15.122:0/2728415375 >> v1:172.21.15.122:6789/0 conn(0x7f6e6c0cff30 legacy=0x7f6e6c06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:27.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.549+0000 7f6e6a800640 1 -- 172.21.15.122:0/2728415375 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e6c15c3e0 con 0x7f6e6c0b59c0 2024-05-28T06:14:27.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.553+0000 7f6e6a800640 1 --2- 172.21.15.122:0/2728415375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e6c0b59c0 0x7f6e6c0cdb00 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f6e64009d90 tx=0x7f6e6401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224ab22b22c427e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:27.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.553+0000 7f6e69400640 1 -- 172.21.15.122:0/2728415375 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e640b2070 con 0x7f6e6c0b59c0 2024-05-28T06:14:27.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.553+0000 7f6e69400640 1 -- 172.21.15.122:0/2728415375 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e640a59a0 con 0x7f6e6c0b59c0 2024-05-28T06:14:27.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.553+0000 7f6e69400640 1 -- 172.21.15.122:0/2728415375 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e640a5d70 con 0x7f6e6c0b59c0 2024-05-28T06:14:27.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.553+0000 7f6e70e00640 1 -- 172.21.15.122:0/2728415375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e6c0b59c0 msgr2=0x7f6e6c0cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:27.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.553+0000 7f6e70e00640 1 --2- 172.21.15.122:0/2728415375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e6c0b59c0 0x7f6e6c0cdb00 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f6e64009d90 tx=0x7f6e6401c940 comp rx=0 tx=0).stop 2024-05-28T06:14:27.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.553+0000 7f6e70e00640 1 -- 172.21.15.122:0/2728415375 shutdown_connections 2024-05-28T06:14:27.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.553+0000 7f6e70e00640 1 --2- 172.21.15.122:0/2728415375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e6c0b59c0 0x7f6e6c0cdb00 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:27.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.553+0000 7f6e70e00640 1 -- 172.21.15.122:0/2728415375 >> 172.21.15.122:0/2728415375 conn(0x7f6e6c06bd90 msgr2=0x7f6e6c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:27.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.553+0000 7f6e70e00640 1 -- 172.21.15.122:0/2728415375 shutdown_connections 2024-05-28T06:14:27.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.553+0000 7f6e70e00640 1 -- 172.21.15.122:0/2728415375 wait complete. 2024-05-28T06:14:27.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.553+0000 7f6e70e00640 1 Processor -- start 2024-05-28T06:14:27.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.553+0000 7f6e70e00640 1 -- start start 2024-05-28T06:14:27.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.553+0000 7f6e70e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e6c06f890 0x7f6e6c15b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:27.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e70e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e6c0b59c0 0x7f6e6c0b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:27.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e70e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e6c0cff30 0x7f6e6c145fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:27.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e70e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c168cd0 con 0x7f6e6c0b59c0 2024-05-28T06:14:27.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e70e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c168b50 con 0x7f6e6c06f890 2024-05-28T06:14:27.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e70e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6e6c168e50 con 0x7f6e6c0cff30 2024-05-28T06:14:27.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e61400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e6c0b59c0 0x7f6e6c0b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:27.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e61400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e6c0b59c0 0x7f6e6c0b02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52036/0 (socket says 172.21.15.122:52036) 2024-05-28T06:14:27.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e61400640 1 -- 172.21.15.122:0/4289699012 learned_addr learned my addr 172.21.15.122:0/4289699012 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:27.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e69e00640 1 --2- 172.21.15.122:0/4289699012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e6c06f890 0x7f6e6c15b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:27.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e6a800640 1 --2- 172.21.15.122:0/4289699012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e6c0cff30 0x7f6e6c145fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:27.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e61400640 1 -- 172.21.15.122:0/4289699012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e6c0cff30 msgr2=0x7f6e6c145fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:27.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e61400640 1 --2- 172.21.15.122:0/4289699012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e6c0cff30 0x7f6e6c145fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:27.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e61400640 1 -- 172.21.15.122:0/4289699012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e6c06f890 msgr2=0x7f6e6c15b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:27.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e61400640 1 --2- 172.21.15.122:0/4289699012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e6c06f890 0x7f6e6c15b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:27.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e61400640 1 -- 172.21.15.122:0/4289699012 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e6c0b33b0 con 0x7f6e6c0b59c0 2024-05-28T06:14:27.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e6a800640 1 --2- 172.21.15.122:0/4289699012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e6c0cff30 0x7f6e6c145fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:14:27.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e61400640 1 --2- 172.21.15.122:0/4289699012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e6c0b59c0 0x7f6e6c0b02a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f6e5400c460 tx=0x7f6e5400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:27.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e62a00640 1 -- 172.21.15.122:0/4289699012 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e54016020 con 0x7f6e6c0b59c0 2024-05-28T06:14:27.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e62a00640 1 -- 172.21.15.122:0/4289699012 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e540052d0 con 0x7f6e6c0b59c0 2024-05-28T06:14:27.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e62a00640 1 -- 172.21.15.122:0/4289699012 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e54007260 con 0x7f6e6c0b59c0 2024-05-28T06:14:27.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e70e00640 1 -- 172.21.15.122:0/4289699012 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e6c146510 con 0x7f6e6c0b59c0 2024-05-28T06:14:27.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e70e00640 1 -- 172.21.15.122:0/4289699012 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e6c155590 con 0x7f6e6c0b59c0 2024-05-28T06:14:27.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e70e00640 1 -- 172.21.15.122:0/4289699012 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e6c068c40 con 0x7f6e6c0b59c0 2024-05-28T06:14:27.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.557+0000 7f6e62a00640 1 -- 172.21.15.122:0/4289699012 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 23) ==== 89109+0+0 (secure 0 0 0) 0x7f6e54007400 con 0x7f6e6c0b59c0 2024-05-28T06:14:27.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.561+0000 7f6e62a00640 1 --2- 172.21.15.122:0/4289699012 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6e48069010 0x7f6e4806b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:27.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.561+0000 7f6e62a00640 1 -- 172.21.15.122:0/4289699012 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f6e54084fe0 con 0x7f6e6c0b59c0 2024-05-28T06:14:27.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.561+0000 7f6e69e00640 1 --2- 172.21.15.122:0/4289699012 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6e48069010 0x7f6e4806b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:27.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.561+0000 7f6e69e00640 1 --2- 172.21.15.122:0/4289699012 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6e48069010 0x7f6e4806b4d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c005890 tx=0x7f6e5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:27.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.565+0000 7f6e62a00640 1 -- 172.21.15.122:0/4289699012 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6e54020020 con 0x7f6e6c0b59c0 2024-05-28T06:14:27.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.721+0000 7f6e70e00640 1 -- 172.21.15.122:0/4289699012 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e6c157c70 con 0x7f6e6c0b59c0 2024-05-28T06:14:27.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.725+0000 7f6e62a00640 1 -- 172.21.15.122:0/4289699012 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+16708 (secure 0 0 0) 0x7f6e54005480 con 0x7f6e6c0b59c0 2024-05-28T06:14:27.723 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:14:27.723 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":62,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:12:32.775809+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:12:28.875891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-28T06:12:30.137302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:14:27.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.725+0000 7f6e70e00640 1 -- 172.21.15.122:0/4289699012 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6e48069010 msgr2=0x7f6e4806b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:27.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.725+0000 7f6e70e00640 1 --2- 172.21.15.122:0/4289699012 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6e48069010 0x7f6e4806b4d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c005890 tx=0x7f6e5c009040 comp rx=0 tx=0).stop 2024-05-28T06:14:27.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.725+0000 7f6e70e00640 1 -- 172.21.15.122:0/4289699012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e6c0b59c0 msgr2=0x7f6e6c0b02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:27.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.725+0000 7f6e70e00640 1 --2- 172.21.15.122:0/4289699012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e6c0b59c0 0x7f6e6c0b02a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f6e5400c460 tx=0x7f6e5400c920 comp rx=0 tx=0).stop 2024-05-28T06:14:27.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.725+0000 7f6e70e00640 1 -- 172.21.15.122:0/4289699012 shutdown_connections 2024-05-28T06:14:27.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.725+0000 7f6e70e00640 1 --2- 172.21.15.122:0/4289699012 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6e48069010 0x7f6e4806b4d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:27.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.725+0000 7f6e70e00640 1 --2- 172.21.15.122:0/4289699012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e6c0cff30 0x7f6e6c145fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:27.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.725+0000 7f6e70e00640 1 --2- 172.21.15.122:0/4289699012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e6c0b59c0 0x7f6e6c0b02a0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:27.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.725+0000 7f6e70e00640 1 --2- 172.21.15.122:0/4289699012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e6c06f890 0x7f6e6c15b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:27.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.725+0000 7f6e70e00640 1 -- 172.21.15.122:0/4289699012 >> 172.21.15.122:0/4289699012 conn(0x7f6e6c06bd90 msgr2=0x7f6e6c0af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:27.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.725+0000 7f6e70e00640 1 -- 172.21.15.122:0/4289699012 shutdown_connections 2024-05-28T06:14:27.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.725+0000 7f6e70e00640 1 -- 172.21.15.122:0/4289699012 wait complete. 2024-05-28T06:14:27.744 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-28T06:05:37.269421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-28T06:12:28.875891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-05-28T06:12:30.137302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-28T06:14:27.745 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-28T06:14:27.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.885+0000 7f9e32000640 1 Processor -- start 2024-05-28T06:14:27.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.885+0000 7f9e32000640 1 -- start start 2024-05-28T06:14:27.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.885+0000 7f9e32000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e2c15ea20 0x7f9e2c0d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:27.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.885+0000 7f9e32000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9e2c0b36b0 0x7f9e2c0b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:27.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.885+0000 7f9e32000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e2c0b46c0 con 0x7f9e2c073c80 2024-05-28T06:14:27.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.885+0000 7f9e32000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9e2c0b4060 con 0x7f9e2c0b36b0 2024-05-28T06:14:27.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.885+0000 7f9e32000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9e2c15ee00 con 0x7f9e2c15ea20 2024-05-28T06:14:27.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.885+0000 7f9e2b400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e2c15ea20 0x7f9e2c0d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:27.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.885+0000 7f9e2be00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9e2c0b36b0 0x7f9e2c0b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:27.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.885+0000 7f9e2b400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e2c15ea20 0x7f9e2c0d0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:60220/0 (socket says 172.21.15.122:60220) 2024-05-28T06:14:27.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.885+0000 7f9e2b400640 1 -- 172.21.15.122:0/1334845910 learned_addr learned my addr 172.21.15.122:0/1334845910 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:27.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.885+0000 7f9e22a00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9e2c073c80 0x7f9e2c0b4fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.122:32804/0 (socket says 172.21.15.122:32804) 2024-05-28T06:14:27.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.889+0000 7f9e2b400640 1 -- 172.21.15.122:0/1334845910 >> v2:172.21.15.153:3300/0 conn(0x7f9e2c0b36b0 msgr2=0x7f9e2c0b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:27.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.889+0000 7f9e2b400640 1 --2- 172.21.15.122:0/1334845910 >> v2:172.21.15.153:3300/0 conn(0x7f9e2c0b36b0 0x7f9e2c0b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:27.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.889+0000 7f9e2b400640 1 -- 172.21.15.122:0/1334845910 >> v1:172.21.15.153:6789/0 conn(0x7f9e2c073c80 legacy=0x7f9e2c0b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:27.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.889+0000 7f9e2b400640 1 -- 172.21.15.122:0/1334845910 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e2c0b49a0 con 0x7f9e2c15ea20 2024-05-28T06:14:27.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.889+0000 7f9e2be00640 1 --2- 172.21.15.122:0/1334845910 >> v2:172.21.15.153:3300/0 conn(0x7f9e2c0b36b0 0x7f9e2c0b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:14:27.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.889+0000 7f9e2b400640 1 --2- 172.21.15.122:0/1334845910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e2c15ea20 0x7f9e2c0d0e10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c009870 tx=0x7f9e1c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=695b2bbd1bbe0ff2 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:27.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.889+0000 7f9e2aa00640 1 -- 172.21.15.122:0/1334845910 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c0b2070 con 0x7f9e2c15ea20 2024-05-28T06:14:27.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.889+0000 7f9e2aa00640 1 -- 172.21.15.122:0/1334845910 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e1c0a9070 con 0x7f9e2c15ea20 2024-05-28T06:14:27.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.889+0000 7f9e2aa00640 1 -- 172.21.15.122:0/1334845910 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c0ad880 con 0x7f9e2c15ea20 2024-05-28T06:14:27.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e32000640 1 -- 172.21.15.122:0/1334845910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e2c15ea20 msgr2=0x7f9e2c0d0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:27.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e32000640 1 --2- 172.21.15.122:0/1334845910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e2c15ea20 0x7f9e2c0d0e10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c009870 tx=0x7f9e1c01c560 comp rx=0 tx=0).stop 2024-05-28T06:14:27.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e32000640 1 -- 172.21.15.122:0/1334845910 shutdown_connections 2024-05-28T06:14:27.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e32000640 1 --2- 172.21.15.122:0/1334845910 >> v2:172.21.15.153:3300/0 conn(0x7f9e2c0b36b0 0x7f9e2c0b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:27.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e32000640 1 --2- 172.21.15.122:0/1334845910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e2c15ea20 0x7f9e2c0d0e10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:27.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e32000640 1 -- 172.21.15.122:0/1334845910 >> 172.21.15.122:0/1334845910 conn(0x7f9e2c0b6c10 msgr2=0x7f9e2c0b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:27.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e32000640 1 -- 172.21.15.122:0/1334845910 shutdown_connections 2024-05-28T06:14:27.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e32000640 1 -- 172.21.15.122:0/1334845910 wait complete. 2024-05-28T06:14:27.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e32000640 1 Processor -- start 2024-05-28T06:14:27.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e32000640 1 -- start start 2024-05-28T06:14:27.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e32000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e2c073c80 0x7f9e2c0cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:27.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e32000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e2c0b36b0 0x7f9e2c0cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:27.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e32000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e2c15ea20 0x7f9e2c13bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:27.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e32000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2c0ce960 con 0x7f9e2c15ea20 2024-05-28T06:14:27.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e32000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2c0b56d0 con 0x7f9e2c0b36b0 2024-05-28T06:14:27.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e32000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9e2c0ceae0 con 0x7f9e2c073c80 2024-05-28T06:14:27.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e2be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e2c15ea20 0x7f9e2c13bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:27.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e2be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e2c15ea20 0x7f9e2c13bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52052/0 (socket says 172.21.15.122:52052) 2024-05-28T06:14:27.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e2be00640 1 -- 172.21.15.122:0/2995872162 learned_addr learned my addr 172.21.15.122:0/2995872162 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:27.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e2b400640 1 --2- 172.21.15.122:0/2995872162 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e2c073c80 0x7f9e2c0cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:27.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e22a00640 1 --2- 172.21.15.122:0/2995872162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e2c0b36b0 0x7f9e2c0cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:27.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e2be00640 1 -- 172.21.15.122:0/2995872162 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e2c073c80 msgr2=0x7f9e2c0cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:27.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e2be00640 1 --2- 172.21.15.122:0/2995872162 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e2c073c80 0x7f9e2c0cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:27.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e2be00640 1 -- 172.21.15.122:0/2995872162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e2c0b36b0 msgr2=0x7f9e2c0cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:27.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e2be00640 1 --2- 172.21.15.122:0/2995872162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e2c0b36b0 0x7f9e2c0cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:27.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.893+0000 7f9e2be00640 1 -- 172.21.15.122:0/2995872162 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e2c14df10 con 0x7f9e2c15ea20 2024-05-28T06:14:27.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.897+0000 7f9e2be00640 1 --2- 172.21.15.122:0/2995872162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e2c15ea20 0x7f9e2c13bbc0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400efc0 tx=0x7f9e24009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:27.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.897+0000 7f9e23e00640 1 -- 172.21.15.122:0/2995872162 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e24018030 con 0x7f9e2c15ea20 2024-05-28T06:14:27.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.897+0000 7f9e23e00640 1 -- 172.21.15.122:0/2995872162 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e2400cde0 con 0x7f9e2c15ea20 2024-05-28T06:14:27.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.897+0000 7f9e23e00640 1 -- 172.21.15.122:0/2995872162 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e24003bc0 con 0x7f9e2c15ea20 2024-05-28T06:14:27.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.897+0000 7f9e32000640 1 -- 172.21.15.122:0/2995872162 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e2c14e1f0 con 0x7f9e2c15ea20 2024-05-28T06:14:27.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.897+0000 7f9e32000640 1 -- 172.21.15.122:0/2995872162 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e2c14e7b0 con 0x7f9e2c15ea20 2024-05-28T06:14:27.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.897+0000 7f9e32000640 1 -- 172.21.15.122:0/2995872162 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e2c068c40 con 0x7f9e2c15ea20 2024-05-28T06:14:27.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.897+0000 7f9e23e00640 1 -- 172.21.15.122:0/2995872162 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 23) ==== 89109+0+0 (secure 0 0 0) 0x7f9e2401b070 con 0x7f9e2c15ea20 2024-05-28T06:14:27.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.897+0000 7f9e23e00640 1 --2- 172.21.15.122:0/2995872162 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9e08068fe0 0x7f9e0806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:27.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.897+0000 7f9e23e00640 1 -- 172.21.15.122:0/2995872162 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f9e24085c70 con 0x7f9e2c15ea20 2024-05-28T06:14:27.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.897+0000 7f9e2b400640 1 --2- 172.21.15.122:0/2995872162 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9e08068fe0 0x7f9e0806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:27.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.897+0000 7f9e2b400640 1 --2- 172.21.15.122:0/2995872162 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9e08068fe0 0x7f9e0806b4a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c0af000 tx=0x7f9e1c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:27.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:27.901+0000 7f9e23e00640 1 -- 172.21.15.122:0/2995872162 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9e24022070 con 0x7f9e2c15ea20 2024-05-28T06:14:28.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.061+0000 7f9e32000640 1 -- 172.21.15.122:0/2995872162 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9e2c0754e0 con 0x7f9e2c15ea20 2024-05-28T06:14:28.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.061+0000 7f9e23e00640 1 -- 172.21.15.122:0/2995872162 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v62) ==== 93+0+10 (secure 0 0 0) 0x7f9e24010040 con 0x7f9e2c15ea20 2024-05-28T06:14:28.060 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 1 2024-05-28T06:14:28.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.061+0000 7f9e32000640 1 -- 172.21.15.122:0/2995872162 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9e08068fe0 msgr2=0x7f9e0806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:28.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.061+0000 7f9e32000640 1 --2- 172.21.15.122:0/2995872162 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9e08068fe0 0x7f9e0806b4a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c0af000 tx=0x7f9e1c0a7000 comp rx=0 tx=0).stop 2024-05-28T06:14:28.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.061+0000 7f9e32000640 1 -- 172.21.15.122:0/2995872162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e2c15ea20 msgr2=0x7f9e2c13bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:28.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.061+0000 7f9e32000640 1 --2- 172.21.15.122:0/2995872162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e2c15ea20 0x7f9e2c13bbc0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400efc0 tx=0x7f9e24009f90 comp rx=0 tx=0).stop 2024-05-28T06:14:28.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.061+0000 7f9e32000640 1 -- 172.21.15.122:0/2995872162 shutdown_connections 2024-05-28T06:14:28.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.061+0000 7f9e32000640 1 --2- 172.21.15.122:0/2995872162 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9e08068fe0 0x7f9e0806b4a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.061+0000 7f9e32000640 1 --2- 172.21.15.122:0/2995872162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e2c15ea20 0x7f9e2c13bbc0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.061+0000 7f9e32000640 1 --2- 172.21.15.122:0/2995872162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e2c0b36b0 0x7f9e2c0cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.061+0000 7f9e32000640 1 --2- 172.21.15.122:0/2995872162 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e2c073c80 0x7f9e2c0cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.061+0000 7f9e32000640 1 -- 172.21.15.122:0/2995872162 >> 172.21.15.122:0/2995872162 conn(0x7f9e2c0b6c10 msgr2=0x7f9e2c155cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:28.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.061+0000 7f9e32000640 1 -- 172.21.15.122:0/2995872162 shutdown_connections 2024-05-28T06:14:28.064 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.061+0000 7f9e32000640 1 -- 172.21.15.122:0/2995872162 wait complete. 2024-05-28T06:14:28.082 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-28T06:14:28.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.221+0000 7febf1600640 1 Processor -- start 2024-05-28T06:14:28.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.221+0000 7febf1600640 1 -- start start 2024-05-28T06:14:28.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febf1600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7febec0b59c0 0x7febec0cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:28.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febf1600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febec0d0310 con 0x7febec06f890 2024-05-28T06:14:28.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febf1600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febec15be20 con 0x7febec0cff30 2024-05-28T06:14:28.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febf1600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7febec15c100 con 0x7febec0b59c0 2024-05-28T06:14:28.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febea000640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7febec06f890 0x7febec0cd3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:49734/0 (socket says 172.21.15.122:49734) 2024-05-28T06:14:28.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febea000640 1 -- 172.21.15.122:0/2521847567 learned_addr learned my addr 172.21.15.122:0/2521847567 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:14:28.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febeb400640 1 --2- 172.21.15.122:0/2521847567 >> v2:172.21.15.153:3300/0 conn(0x7febec0b59c0 0x7febec0cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:28.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febe9600640 1 -- 172.21.15.122:0/2521847567 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2443496003 0 0) 0x7febec0d0310 con 0x7febec06f890 2024-05-28T06:14:28.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febe9600640 1 -- 172.21.15.122:0/2521847567 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febd0005740 con 0x7febec06f890 2024-05-28T06:14:28.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febe9600640 1 -- 172.21.15.122:0/2521847567 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1833205459 0 0) 0x7febec15be20 con 0x7febec0cff30 2024-05-28T06:14:28.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febe9600640 1 -- 172.21.15.122:0/2521847567 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febec0d0310 con 0x7febec0cff30 2024-05-28T06:14:28.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febe9600640 1 -- 172.21.15.122:0/2521847567 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1118413401 0 0) 0x7febd0005740 con 0x7febec06f890 2024-05-28T06:14:28.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febe9600640 1 -- 172.21.15.122:0/2521847567 >> v2:172.21.15.153:3300/0 conn(0x7febec0b59c0 msgr2=0x7febec0cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:28.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febe9600640 1 --2- 172.21.15.122:0/2521847567 >> v2:172.21.15.153:3300/0 conn(0x7febec0b59c0 0x7febec0cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febe9600640 1 -- 172.21.15.122:0/2521847567 >> v1:172.21.15.153:6789/0 conn(0x7febec0cff30 legacy=0x7febec06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:28.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febe9600640 1 -- 172.21.15.122:0/2521847567 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febec15c3e0 con 0x7febec06f890 2024-05-28T06:14:28.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febe9600640 1 -- 172.21.15.122:0/2521847567 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7febd8001680 con 0x7febec06f890 2024-05-28T06:14:28.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febeb400640 1 --2- 172.21.15.122:0/2521847567 >> v2:172.21.15.153:3300/0 conn(0x7febec0b59c0 0x7febec0cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:14:28.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febe9600640 1 -- 172.21.15.122:0/2521847567 >> v1:172.21.15.122:6789/0 conn(0x7febec06f890 legacy=0x7febec0cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:28.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febe9600640 1 --2- 172.21.15.122:0/2521847567 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febd0005d60 0x7febd0006160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:28.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febe9600640 1 --2- 172.21.15.122:0/2521847567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febd0006a20 0x7febd0006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:28.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febe9600640 1 --2- 172.21.15.122:0/2521847567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febd00073e0 0x7febd000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:28.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febe9600640 1 -- 172.21.15.122:0/2521847567 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7febec15c100 con 0x7febd00073e0 2024-05-28T06:14:28.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febe9600640 1 -- 172.21.15.122:0/2521847567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7febd000e260 con 0x7febd0006a20 2024-05-28T06:14:28.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febe9600640 1 -- 172.21.15.122:0/2521847567 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7febd000e460 con 0x7febd0005d60 2024-05-28T06:14:28.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febeb400640 1 --2- 172.21.15.122:0/2521847567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febd00073e0 0x7febd000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:28.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febea000640 1 --2- 172.21.15.122:0/2521847567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febd0006a20 0x7febd0006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:28.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febeaa00640 1 --2- 172.21.15.122:0/2521847567 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febd0005d60 0x7febd0006160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:28.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febeb400640 1 -- 172.21.15.122:0/2521847567 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febd0005d60 msgr2=0x7febd0006160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:28.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febeb400640 1 --2- 172.21.15.122:0/2521847567 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febd0005d60 0x7febd0006160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febeb400640 1 -- 172.21.15.122:0/2521847567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febd0006a20 msgr2=0x7febd0006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:28.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febeb400640 1 --2- 172.21.15.122:0/2521847567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febd0006a20 0x7febd0006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.225+0000 7febeb400640 1 -- 172.21.15.122:0/2521847567 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd0005740 con 0x7febd00073e0 2024-05-28T06:14:28.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.229+0000 7febeb400640 1 -- 172.21.15.122:0/2521847567 reap_dead start 2024-05-28T06:14:28.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.229+0000 7febeb400640 1 --2- 172.21.15.122:0/2521847567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febd00073e0 0x7febd000dbe0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7febe400e350 tx=0x7febe401ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd6641bc136b615 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:28.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.229+0000 7febe9600640 1 -- 172.21.15.122:0/2521847567 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe4009de0 con 0x7febd00073e0 2024-05-28T06:14:28.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.229+0000 7febe9600640 1 -- 172.21.15.122:0/2521847567 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febe40039a0 con 0x7febd00073e0 2024-05-28T06:14:28.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.229+0000 7febe9600640 1 -- 172.21.15.122:0/2521847567 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe4003d90 con 0x7febd00073e0 2024-05-28T06:14:28.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.229+0000 7febf1600640 1 -- 172.21.15.122:0/2521847567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febd00073e0 msgr2=0x7febd000dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:28.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.229+0000 7febf1600640 1 --2- 172.21.15.122:0/2521847567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febd00073e0 0x7febd000dbe0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7febe400e350 tx=0x7febe401ce80 comp rx=0 tx=0).stop 2024-05-28T06:14:28.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.229+0000 7febf1600640 1 -- 172.21.15.122:0/2521847567 shutdown_connections 2024-05-28T06:14:28.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.229+0000 7febf1600640 1 --2- 172.21.15.122:0/2521847567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febd00073e0 0x7febd000dbe0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.229+0000 7febf1600640 1 -- 172.21.15.122:0/2521847567 >> 172.21.15.122:0/2521847567 conn(0x7febec06bd90 msgr2=0x7febec06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:28.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.229+0000 7febf1600640 1 -- 172.21.15.122:0/2521847567 shutdown_connections 2024-05-28T06:14:28.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.229+0000 7febf1600640 1 -- 172.21.15.122:0/2521847567 wait complete. 2024-05-28T06:14:28.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.229+0000 7febf1600640 1 Processor -- start 2024-05-28T06:14:28.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febf1600640 1 -- start start 2024-05-28T06:14:28.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febf1600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febd00073e0 0x7febec1583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:28.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febf1600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febec1448d0 0x7febec144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:28.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febf1600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febec1ef4d0 0x7febec1ef950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:28.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febf1600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7febec0cd3f0 con 0x7febec1ef4d0 2024-05-28T06:14:28.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febf1600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7febec15baf0 con 0x7febec1448d0 2024-05-28T06:14:28.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febf1600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7febec0cd570 con 0x7febd00073e0 2024-05-28T06:14:28.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febeb400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febec1ef4d0 0x7febec1ef950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:28.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febeb400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febec1ef4d0 0x7febec1ef950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52080/0 (socket says 172.21.15.122:52080) 2024-05-28T06:14:28.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febeb400640 1 -- 172.21.15.122:0/3986081217 learned_addr learned my addr 172.21.15.122:0/3986081217 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:28.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febeaa00640 1 --2- 172.21.15.122:0/3986081217 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febd00073e0 0x7febec1583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:28.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febea000640 1 --2- 172.21.15.122:0/3986081217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febec1448d0 0x7febec144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:28.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febeb400640 1 -- 172.21.15.122:0/3986081217 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febd00073e0 msgr2=0x7febec1583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:28.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febeb400640 1 --2- 172.21.15.122:0/3986081217 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febd00073e0 0x7febec1583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febeb400640 1 -- 172.21.15.122:0/3986081217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febec1448d0 msgr2=0x7febec144d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:28.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febeb400640 1 --2- 172.21.15.122:0/3986081217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febec1448d0 0x7febec144d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febeb400640 1 -- 172.21.15.122:0/3986081217 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febec1497f0 con 0x7febec1ef4d0 2024-05-28T06:14:28.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febeaa00640 1 --2- 172.21.15.122:0/3986081217 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febd00073e0 0x7febec1583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:14:28.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febea000640 1 --2- 172.21.15.122:0/3986081217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febec1448d0 0x7febec144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:14:28.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febeb400640 1 --2- 172.21.15.122:0/3986081217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febec1ef4d0 0x7febec1ef950 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7febe40989b0 tx=0x7febe4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:28.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febe2a00640 1 -- 172.21.15.122:0/3986081217 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe4009de0 con 0x7febec1ef4d0 2024-05-28T06:14:28.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febe2a00640 1 -- 172.21.15.122:0/3986081217 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febe40b6440 con 0x7febec1ef4d0 2024-05-28T06:14:28.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febf1600640 1 -- 172.21.15.122:0/3986081217 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febec149ad0 con 0x7febec1ef4d0 2024-05-28T06:14:28.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febe2a00640 1 -- 172.21.15.122:0/3986081217 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe40b6810 con 0x7febec1ef4d0 2024-05-28T06:14:28.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febf1600640 1 -- 172.21.15.122:0/3986081217 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febec14a090 con 0x7febec1ef4d0 2024-05-28T06:14:28.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.233+0000 7febf1600640 1 -- 172.21.15.122:0/3986081217 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febec068c40 con 0x7febec1ef4d0 2024-05-28T06:14:28.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.237+0000 7febe2a00640 1 -- 172.21.15.122:0/3986081217 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 23) ==== 89109+0+0 (secure 0 0 0) 0x7febe40b69b0 con 0x7febec1ef4d0 2024-05-28T06:14:28.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.237+0000 7febe2a00640 1 --2- 172.21.15.122:0/3986081217 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7febcc068fe0 0x7febcc06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:28.238 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.237+0000 7febe2a00640 1 -- 172.21.15.122:0/3986081217 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7febe4120330 con 0x7febec1ef4d0 2024-05-28T06:14:28.238 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.237+0000 7febeaa00640 1 --2- 172.21.15.122:0/3986081217 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7febcc068fe0 0x7febcc06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:28.238 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.237+0000 7febeaa00640 1 --2- 172.21.15.122:0/3986081217 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7febcc068fe0 0x7febcc06b4a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7febdc000c10 tx=0x7febdc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:28.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.241+0000 7febe2a00640 1 -- 172.21.15.122:0/3986081217 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7febe4016b90 con 0x7febec1ef4d0 2024-05-28T06:14:28.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.397+0000 7febf1600640 1 -- 172.21.15.122:0/3986081217 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7febec155f70 con 0x7febec1ef4d0 2024-05-28T06:14:28.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.397+0000 7febe2a00640 1 -- 172.21.15.122:0/3986081217 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v62) ==== 104+0+11 (secure 0 0 0) 0x7febe40f2040 con 0x7febec1ef4d0 2024-05-28T06:14:28.397 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 32 2024-05-28T06:14:28.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.401+0000 7febf1600640 1 -- 172.21.15.122:0/3986081217 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7febcc068fe0 msgr2=0x7febcc06b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:28.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.401+0000 7febf1600640 1 --2- 172.21.15.122:0/3986081217 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7febcc068fe0 0x7febcc06b4a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7febdc000c10 tx=0x7febdc009040 comp rx=0 tx=0).stop 2024-05-28T06:14:28.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.401+0000 7febf1600640 1 -- 172.21.15.122:0/3986081217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febec1ef4d0 msgr2=0x7febec1ef950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:28.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.401+0000 7febf1600640 1 --2- 172.21.15.122:0/3986081217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febec1ef4d0 0x7febec1ef950 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7febe40989b0 tx=0x7febe4009750 comp rx=0 tx=0).stop 2024-05-28T06:14:28.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.401+0000 7febf1600640 1 -- 172.21.15.122:0/3986081217 shutdown_connections 2024-05-28T06:14:28.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.401+0000 7febf1600640 1 --2- 172.21.15.122:0/3986081217 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7febcc068fe0 0x7febcc06b4a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.401+0000 7febf1600640 1 --2- 172.21.15.122:0/3986081217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7febec1ef4d0 0x7febec1ef950 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.401+0000 7febf1600640 1 --2- 172.21.15.122:0/3986081217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febec1448d0 0x7febec144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.401+0000 7febf1600640 1 --2- 172.21.15.122:0/3986081217 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febd00073e0 0x7febec1583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.401+0000 7febf1600640 1 -- 172.21.15.122:0/3986081217 >> 172.21.15.122:0/3986081217 conn(0x7febec06bd90 msgr2=0x7febec072270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:28.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.401+0000 7febf1600640 1 -- 172.21.15.122:0/3986081217 shutdown_connections 2024-05-28T06:14:28.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.401+0000 7febf1600640 1 -- 172.21.15.122:0/3986081217 wait complete. 2024-05-28T06:14:28.419 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-28T06:14:28.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.557+0000 7fe803a00640 1 Processor -- start 2024-05-28T06:14:28.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.557+0000 7fe803a00640 1 -- start start 2024-05-28T06:14:28.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.561+0000 7fe803a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe7fc0722f0 0x7fe7fc06fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:28.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.561+0000 7fe803a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe7fc15eb90 0x7fe7fc0b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:28.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.561+0000 7fe803a00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7fc15fb00 con 0x7fe7fc0726d0 2024-05-28T06:14:28.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.561+0000 7fe803a00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fe7fc070200 con 0x7fe7fc15eb90 2024-05-28T06:14:28.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.561+0000 7fe803a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe7fc15fde0 con 0x7fe7fc0722f0 2024-05-28T06:14:28.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.561+0000 7fe801a00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fe7fc0726d0 0x7fe7fc06e450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:49750/0 (socket says 172.21.15.122:49750) 2024-05-28T06:14:28.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.561+0000 7fe801a00640 1 -- 172.21.15.122:0/3061955693 learned_addr learned my addr 172.21.15.122:0/3061955693 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:14:28.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.561+0000 7fe7fbe00640 1 --2- 172.21.15.122:0/3061955693 >> v2:172.21.15.122:3300/0 conn(0x7fe7fc15eb90 0x7fe7fc0b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:28.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.561+0000 7fe801000640 1 --2- 172.21.15.122:0/3061955693 >> v2:172.21.15.153:3300/0 conn(0x7fe7fc0722f0 0x7fe7fc06fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:28.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.561+0000 7fe7fb400640 1 -- 172.21.15.122:0/3061955693 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1733074463 0 0) 0x7fe7fc15fb00 con 0x7fe7fc0726d0 2024-05-28T06:14:28.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.561+0000 7fe7fb400640 1 -- 172.21.15.122:0/3061955693 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7e4003530 con 0x7fe7fc0726d0 2024-05-28T06:14:28.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.561+0000 7fe7fbe00640 1 -- 172.21.15.122:0/3061955693 >> v2:172.21.15.153:3300/0 conn(0x7fe7fc0722f0 msgr2=0x7fe7fc06fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:28.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.561+0000 7fe7fbe00640 1 --2- 172.21.15.122:0/3061955693 >> v2:172.21.15.153:3300/0 conn(0x7fe7fc0722f0 0x7fe7fc06fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.561+0000 7fe7fbe00640 1 -- 172.21.15.122:0/3061955693 >> v1:172.21.15.122:6789/0 conn(0x7fe7fc0726d0 legacy=0x7fe7fc06e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:28.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.561+0000 7fe7fbe00640 1 -- 172.21.15.122:0/3061955693 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7fc0b44a0 con 0x7fe7fc15eb90 2024-05-28T06:14:28.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.565+0000 7fe7fbe00640 1 --2- 172.21.15.122:0/3061955693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7fc15eb90 0x7fe7fc0b31a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc073bc0 tx=0x7fe7e801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b317a8fd605356ac server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:28.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.565+0000 7fe7fb400640 1 -- 172.21.15.122:0/3061955693 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e80b1070 con 0x7fe7fc15eb90 2024-05-28T06:14:28.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.565+0000 7fe7fb400640 1 -- 172.21.15.122:0/3061955693 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7e80ac620 con 0x7fe7fc15eb90 2024-05-28T06:14:28.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.565+0000 7fe7fb400640 1 -- 172.21.15.122:0/3061955693 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e80ac9f0 con 0x7fe7fc15eb90 2024-05-28T06:14:28.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.565+0000 7fe803a00640 1 -- 172.21.15.122:0/3061955693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7fc15eb90 msgr2=0x7fe7fc0b31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:28.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.565+0000 7fe803a00640 1 --2- 172.21.15.122:0/3061955693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7fc15eb90 0x7fe7fc0b31a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc073bc0 tx=0x7fe7e801c3c0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.566 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.565+0000 7fe803a00640 1 -- 172.21.15.122:0/3061955693 shutdown_connections 2024-05-28T06:14:28.566 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.565+0000 7fe803a00640 1 --2- 172.21.15.122:0/3061955693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7fc15eb90 0x7fe7fc0b31a0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.566 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.565+0000 7fe803a00640 1 --2- 172.21.15.122:0/3061955693 >> v2:172.21.15.153:3300/0 conn(0x7fe7fc0722f0 0x7fe7fc06fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.566 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.565+0000 7fe803a00640 1 -- 172.21.15.122:0/3061955693 >> 172.21.15.122:0/3061955693 conn(0x7fe7fc0b26b0 msgr2=0x7fe7fc0b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:28.567 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.565+0000 7fe803a00640 1 -- 172.21.15.122:0/3061955693 shutdown_connections 2024-05-28T06:14:28.567 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.565+0000 7fe803a00640 1 -- 172.21.15.122:0/3061955693 wait complete. 2024-05-28T06:14:28.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.565+0000 7fe803a00640 1 Processor -- start 2024-05-28T06:14:28.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.565+0000 7fe803a00640 1 -- start start 2024-05-28T06:14:28.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe803a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7fc0722f0 0x7fe7fc14e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:28.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe803a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7fc0726d0 0x7fe7fc155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:28.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe803a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7fc15eb90 0x7fe7fc0af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:28.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe803a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe7fc06f4f0 con 0x7fe7fc0726d0 2024-05-28T06:14:28.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe803a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe7fc06f370 con 0x7fe7fc0722f0 2024-05-28T06:14:28.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe803a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe7fc06f670 con 0x7fe7fc15eb90 2024-05-28T06:14:28.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe7fbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7fc0726d0 0x7fe7fc155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:28.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe7fbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7fc0726d0 0x7fe7fc155f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52106/0 (socket says 172.21.15.122:52106) 2024-05-28T06:14:28.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe7fbe00640 1 -- 172.21.15.122:0/3483436262 learned_addr learned my addr 172.21.15.122:0/3483436262 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:28.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe801000640 1 --2- 172.21.15.122:0/3483436262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7fc0722f0 0x7fe7fc14e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:28.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe801a00640 1 --2- 172.21.15.122:0/3483436262 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7fc15eb90 0x7fe7fc0af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:28.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe7fbe00640 1 -- 172.21.15.122:0/3483436262 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7fc15eb90 msgr2=0x7fe7fc0af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:28.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe7fbe00640 1 --2- 172.21.15.122:0/3483436262 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7fc15eb90 0x7fe7fc0af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe7fbe00640 1 -- 172.21.15.122:0/3483436262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7fc0722f0 msgr2=0x7fe7fc14e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:28.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe7fbe00640 1 --2- 172.21.15.122:0/3483436262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7fc0722f0 0x7fe7fc14e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe7fbe00640 1 -- 172.21.15.122:0/3483436262 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7fc1531d0 con 0x7fe7fc0726d0 2024-05-28T06:14:28.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe801000640 1 --2- 172.21.15.122:0/3483436262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7fc0722f0 0x7fe7fc14e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:14:28.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe7fbe00640 1 --2- 172.21.15.122:0/3483436262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7fc0726d0 0x7fe7fc155f30 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fe7e80af040 tx=0x7fe7e8019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:28.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe7f8c00640 1 -- 172.21.15.122:0/3483436262 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e80b9020 con 0x7fe7fc0726d0 2024-05-28T06:14:28.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe7f8c00640 1 -- 172.21.15.122:0/3483436262 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7e80b5410 con 0x7fe7fc0726d0 2024-05-28T06:14:28.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe7f8c00640 1 -- 172.21.15.122:0/3483436262 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e80b1040 con 0x7fe7fc0726d0 2024-05-28T06:14:28.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe803a00640 1 -- 172.21.15.122:0/3483436262 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7fc1509a0 con 0x7fe7fc0726d0 2024-05-28T06:14:28.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe803a00640 1 -- 172.21.15.122:0/3483436262 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7fc0ae8b0 con 0x7fe7fc0726d0 2024-05-28T06:14:28.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.569+0000 7fe803a00640 1 -- 172.21.15.122:0/3483436262 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7fc068c40 con 0x7fe7fc0726d0 2024-05-28T06:14:28.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.573+0000 7fe7f8c00640 1 -- 172.21.15.122:0/3483436262 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 23) ==== 89109+0+0 (secure 0 0 0) 0x7fe7e80bc020 con 0x7fe7fc0726d0 2024-05-28T06:14:28.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.573+0000 7fe7f8c00640 1 --2- 172.21.15.122:0/3483436262 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe7dc068fe0 0x7fe7dc06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:28.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.573+0000 7fe7f8c00640 1 -- 172.21.15.122:0/3483436262 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7fe7e811f040 con 0x7fe7fc0726d0 2024-05-28T06:14:28.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.573+0000 7fe801000640 1 --2- 172.21.15.122:0/3483436262 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe7dc068fe0 0x7fe7dc06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:28.578 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.573+0000 7fe801000640 1 --2- 172.21.15.122:0/3483436262 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe7dc068fe0 0x7fe7dc06b4a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0007a70 tx=0x7fe7f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:28.578 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.577+0000 7fe7f8c00640 1 -- 172.21.15.122:0/3483436262 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe7e80c3030 con 0x7fe7fc0726d0 2024-05-28T06:14:28.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.733+0000 7fe803a00640 1 -- 172.21.15.122:0/3483436262 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe7fc0d02a0 con 0x7fe7fc0726d0 2024-05-28T06:14:28.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.733+0000 7fe7f8c00640 1 -- 172.21.15.122:0/3483436262 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v62) ==== 100+0+11 (secure 0 0 0) 0x7fe7e8016070 con 0x7fe7fc0726d0 2024-05-28T06:14:28.734 INFO:teuthology.orchestra.run.smithi122.stdout:pg_num: 64 2024-05-28T06:14:28.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.737+0000 7fe803a00640 1 -- 172.21.15.122:0/3483436262 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe7dc068fe0 msgr2=0x7fe7dc06b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:28.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.737+0000 7fe803a00640 1 --2- 172.21.15.122:0/3483436262 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe7dc068fe0 0x7fe7dc06b4a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0007a70 tx=0x7fe7f0008040 comp rx=0 tx=0).stop 2024-05-28T06:14:28.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.737+0000 7fe803a00640 1 -- 172.21.15.122:0/3483436262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7fc0726d0 msgr2=0x7fe7fc155f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:28.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.737+0000 7fe803a00640 1 --2- 172.21.15.122:0/3483436262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7fc0726d0 0x7fe7fc155f30 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fe7e80af040 tx=0x7fe7e8019160 comp rx=0 tx=0).stop 2024-05-28T06:14:28.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.737+0000 7fe803a00640 1 -- 172.21.15.122:0/3483436262 shutdown_connections 2024-05-28T06:14:28.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.737+0000 7fe803a00640 1 --2- 172.21.15.122:0/3483436262 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe7dc068fe0 0x7fe7dc06b4a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.737+0000 7fe803a00640 1 --2- 172.21.15.122:0/3483436262 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7fc15eb90 0x7fe7fc0af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.737+0000 7fe803a00640 1 --2- 172.21.15.122:0/3483436262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7fc0726d0 0x7fe7fc155f30 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.737+0000 7fe803a00640 1 --2- 172.21.15.122:0/3483436262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7fc0722f0 0x7fe7fc14e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.737+0000 7fe803a00640 1 -- 172.21.15.122:0/3483436262 >> 172.21.15.122:0/3483436262 conn(0x7fe7fc0b26b0 msgr2=0x7fe7fc074d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:28.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.737+0000 7fe803a00640 1 -- 172.21.15.122:0/3483436262 shutdown_connections 2024-05-28T06:14:28.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.737+0000 7fe803a00640 1 -- 172.21.15.122:0/3483436262 wait complete. 2024-05-28T06:14:28.757 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-28T06:14:28.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.897+0000 7ffbe8800640 1 Processor -- start 2024-05-28T06:14:28.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.897+0000 7ffbe8800640 1 -- start start 2024-05-28T06:14:28.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.897+0000 7ffbe8800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbe0159280 0x7ffbe00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:28.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.897+0000 7ffbe8800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffbe015c7a0 0x7ffbe006f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:28.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.897+0000 7ffbe8800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbe00b54d0 con 0x7ffbe00cced0 2024-05-28T06:14:28.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.897+0000 7ffbe8800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ffbe015c310 con 0x7ffbe015c7a0 2024-05-28T06:14:28.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.897+0000 7ffbe8800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ffbe00b57b0 con 0x7ffbe0159280 2024-05-28T06:14:28.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.897+0000 7ffbe6800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7ffbe00cced0 0x7ffbe015f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:49754/0 (socket says 172.21.15.122:49754) 2024-05-28T06:14:28.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.897+0000 7ffbe6800640 1 -- 172.21.15.122:0/765819341 learned_addr learned my addr 172.21.15.122:0/765819341 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:14:28.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.897+0000 7ffbe5e00640 1 --2- 172.21.15.122:0/765819341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbe0159280 0x7ffbe00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:28.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.897+0000 7ffbe5400640 1 --2- 172.21.15.122:0/765819341 >> v2:172.21.15.153:3300/0 conn(0x7ffbe015c7a0 0x7ffbe006f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:28.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.897+0000 7ffbe4a00640 1 -- 172.21.15.122:0/765819341 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1244108930 0 0) 0x7ffbe00b54d0 con 0x7ffbe00cced0 2024-05-28T06:14:28.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.897+0000 7ffbe4a00640 1 -- 172.21.15.122:0/765819341 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbc8003530 con 0x7ffbe00cced0 2024-05-28T06:14:28.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.897+0000 7ffbe5e00640 1 -- 172.21.15.122:0/765819341 >> v2:172.21.15.153:3300/0 conn(0x7ffbe015c7a0 msgr2=0x7ffbe006f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:28.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.897+0000 7ffbe5e00640 1 --2- 172.21.15.122:0/765819341 >> v2:172.21.15.153:3300/0 conn(0x7ffbe015c7a0 0x7ffbe006f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.897+0000 7ffbe5e00640 1 -- 172.21.15.122:0/765819341 >> v1:172.21.15.122:6789/0 conn(0x7ffbe00cced0 legacy=0x7ffbe015f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:28.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.897+0000 7ffbe5e00640 1 -- 172.21.15.122:0/765819341 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe015bfa0 con 0x7ffbe0159280 2024-05-28T06:14:28.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.901+0000 7ffbe5e00640 1 --2- 172.21.15.122:0/765819341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbe0159280 0x7ffbe00b4e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40097c0 tx=0x7ffbd401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a586a285be2cc7a server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:28.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.901+0000 7ffbe4a00640 1 -- 172.21.15.122:0/765819341 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd40b0070 con 0x7ffbe0159280 2024-05-28T06:14:28.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.901+0000 7ffbe4a00640 1 -- 172.21.15.122:0/765819341 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbd40ab600 con 0x7ffbe0159280 2024-05-28T06:14:28.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.901+0000 7ffbe4a00640 1 -- 172.21.15.122:0/765819341 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd40ab9d0 con 0x7ffbe0159280 2024-05-28T06:14:28.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.901+0000 7ffbe8800640 1 -- 172.21.15.122:0/765819341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbe0159280 msgr2=0x7ffbe00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:28.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.901+0000 7ffbe8800640 1 --2- 172.21.15.122:0/765819341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbe0159280 0x7ffbe00b4e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40097c0 tx=0x7ffbd401c4a0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.901+0000 7ffbe8800640 1 -- 172.21.15.122:0/765819341 shutdown_connections 2024-05-28T06:14:28.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.901+0000 7ffbe8800640 1 --2- 172.21.15.122:0/765819341 >> v2:172.21.15.153:3300/0 conn(0x7ffbe015c7a0 0x7ffbe006f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.901+0000 7ffbe8800640 1 --2- 172.21.15.122:0/765819341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbe0159280 0x7ffbe00b4e10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.901+0000 7ffbe8800640 1 -- 172.21.15.122:0/765819341 >> 172.21.15.122:0/765819341 conn(0x7ffbe0062a40 msgr2=0x7ffbe006b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:28.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.901+0000 7ffbe8800640 1 -- 172.21.15.122:0/765819341 shutdown_connections 2024-05-28T06:14:28.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.901+0000 7ffbe8800640 1 -- 172.21.15.122:0/765819341 wait complete. 2024-05-28T06:14:28.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbe8800640 1 Processor -- start 2024-05-28T06:14:28.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbe8800640 1 -- start start 2024-05-28T06:14:28.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbe8800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbe00cced0 0x7ffbe0160490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:28.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbe8800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbe0159280 0x7ffbe0156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:28.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbe8800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbe015c7a0 0x7ffbe0153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:28.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbe8800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe00cd870 con 0x7ffbe015c7a0 2024-05-28T06:14:28.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbe8800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe00cd6f0 con 0x7ffbe0159280 2024-05-28T06:14:28.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbe8800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ffbe015cb80 con 0x7ffbe00cced0 2024-05-28T06:14:28.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbe6800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbe015c7a0 0x7ffbe0153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:28.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbe6800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbe015c7a0 0x7ffbe0153210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52116/0 (socket says 172.21.15.122:52116) 2024-05-28T06:14:28.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbe6800640 1 -- 172.21.15.122:0/2981313705 learned_addr learned my addr 172.21.15.122:0/2981313705 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:28.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbe5e00640 1 --2- 172.21.15.122:0/2981313705 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbe00cced0 0x7ffbe0160490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:28.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbe5400640 1 --2- 172.21.15.122:0/2981313705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbe0159280 0x7ffbe0156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:28.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbe6800640 1 -- 172.21.15.122:0/2981313705 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbe00cced0 msgr2=0x7ffbe0160490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:28.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbe6800640 1 --2- 172.21.15.122:0/2981313705 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbe00cced0 0x7ffbe0160490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbe6800640 1 -- 172.21.15.122:0/2981313705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbe0159280 msgr2=0x7ffbe0156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:28.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbe6800640 1 --2- 172.21.15.122:0/2981313705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbe0159280 0x7ffbe0156860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:28.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbe6800640 1 -- 172.21.15.122:0/2981313705 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe0155800 con 0x7ffbe015c7a0 2024-05-28T06:14:28.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbe6800640 1 --2- 172.21.15.122:0/2981313705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbe015c7a0 0x7ffbe0153210 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00caa0 tx=0x7ffbdc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:28.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbda000640 1 -- 172.21.15.122:0/2981313705 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc017070 con 0x7ffbe015c7a0 2024-05-28T06:14:28.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbda000640 1 -- 172.21.15.122:0/2981313705 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbdc00ac00 con 0x7ffbe015c7a0 2024-05-28T06:14:28.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbe8800640 1 -- 172.21.15.122:0/2981313705 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbe0155aa0 con 0x7ffbe015c7a0 2024-05-28T06:14:28.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbda000640 1 -- 172.21.15.122:0/2981313705 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc012400 con 0x7ffbe015c7a0 2024-05-28T06:14:28.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbe8800640 1 -- 172.21.15.122:0/2981313705 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbe0156060 con 0x7ffbe015c7a0 2024-05-28T06:14:28.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.905+0000 7ffbe8800640 1 -- 172.21.15.122:0/2981313705 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbe0156540 con 0x7ffbe015c7a0 2024-05-28T06:14:28.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.909+0000 7ffbda000640 1 -- 172.21.15.122:0/2981313705 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 23) ==== 89109+0+0 (secure 0 0 0) 0x7ffbdc01a070 con 0x7ffbe015c7a0 2024-05-28T06:14:28.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.909+0000 7ffbda000640 1 --2- 172.21.15.122:0/2981313705 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffbc4069010 0x7ffbc406b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:28.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.909+0000 7ffbda000640 1 -- 172.21.15.122:0/2981313705 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7ffbdc0852d0 con 0x7ffbe015c7a0 2024-05-28T06:14:28.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.909+0000 7ffbe5e00640 1 --2- 172.21.15.122:0/2981313705 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffbc4069010 0x7ffbc406b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:28.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.909+0000 7ffbe5e00640 1 --2- 172.21.15.122:0/2981313705 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffbc4069010 0x7ffbc406b4d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40ad000 tx=0x7ffbd40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:28.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:28.913+0000 7ffbda000640 1 -- 172.21.15.122:0/2981313705 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffbe0156540 con 0x7ffbe015c7a0 2024-05-28T06:14:29.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:29.081+0000 7ffbe8800640 1 -- 172.21.15.122:0/2981313705 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ffbe0160a30 con 0x7ffbe015c7a0 2024-05-28T06:14:29.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:29.085+0000 7ffbda000640 1 -- 172.21.15.122:0/2981313705 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v62) ==== 80+0+0 (secure 0 0 0) 0x7ffbdc056a70 con 0x7ffbe015c7a0 2024-05-28T06:14:29.083 INFO:teuthology.orchestra.run.smithi122.stderr:listed 0 entries 2024-05-28T06:14:29.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:29.085+0000 7ffbe8800640 1 -- 172.21.15.122:0/2981313705 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffbc4069010 msgr2=0x7ffbc406b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:29.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:29.085+0000 7ffbe8800640 1 --2- 172.21.15.122:0/2981313705 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffbc4069010 0x7ffbc406b4d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40ad000 tx=0x7ffbd40a6000 comp rx=0 tx=0).stop 2024-05-28T06:14:29.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:29.085+0000 7ffbe8800640 1 -- 172.21.15.122:0/2981313705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbe015c7a0 msgr2=0x7ffbe0153210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:29.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:29.085+0000 7ffbe8800640 1 --2- 172.21.15.122:0/2981313705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbe015c7a0 0x7ffbe0153210 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00caa0 tx=0x7ffbdc00cf60 comp rx=0 tx=0).stop 2024-05-28T06:14:29.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:29.085+0000 7ffbe8800640 1 -- 172.21.15.122:0/2981313705 shutdown_connections 2024-05-28T06:14:29.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:29.085+0000 7ffbe8800640 1 --2- 172.21.15.122:0/2981313705 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ffbc4069010 0x7ffbc406b4d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:29.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:29.085+0000 7ffbe8800640 1 --2- 172.21.15.122:0/2981313705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbe015c7a0 0x7ffbe0153210 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:29.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:29.085+0000 7ffbe8800640 1 --2- 172.21.15.122:0/2981313705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbe0159280 0x7ffbe0156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:29.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:29.085+0000 7ffbe8800640 1 --2- 172.21.15.122:0/2981313705 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbe00cced0 0x7ffbe0160490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:29.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:29.085+0000 7ffbe8800640 1 -- 172.21.15.122:0/2981313705 >> 172.21.15.122:0/2981313705 conn(0x7ffbe0062a40 msgr2=0x7ffbe0074d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:29.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:29.085+0000 7ffbe8800640 1 -- 172.21.15.122:0/2981313705 shutdown_connections 2024-05-28T06:14:29.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:29.085+0000 7ffbe8800640 1 -- 172.21.15.122:0/2981313705 wait complete. 2024-05-28T06:14:29.104 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-28T06:14:29.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:14:29.105 DEBUG:teuthology.orchestra.run.smithi122:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-28T06:14:29.152 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2024-05-28T06:14:29.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:14:29.152 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-28T06:14:29.175 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-05-28T06:14:29.175 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:14:29.226 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350136k,nr_inodes=4087534,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2578 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-28T06:14:29.227 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:14:29.227 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:14:29.236 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350304k,nr_inodes=4087576,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5271 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-28T06:14:29.236 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-05-28T06:14:29.236 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-28T06:14:29.285 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350304k,nr_inodes=4087576,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5271 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-28T06:14:29.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:14:29.285 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2024-05-28T06:14:29.294 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-28T06:14:29.294 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-28T06:14:29.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:14:29.295 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-28T06:14:29.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:14:29.359 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-28T06:14:29.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:14:29.423 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link delete ceph-brx 2024-05-28T06:14:29.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:14:29.577 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2024-05-28T06:14:29.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:14:29.587 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link delete ceph-brx 2024-05-28T06:14:29.652 INFO:teuthology.orchestra.run.smithi122.stderr:Cannot find device "ceph-brx" 2024-05-28T06:14:29.654 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-28T06:14:29.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:14:29.655 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-05-28T06:14:29.664 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-28T06:14:29.664 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-28T06:14:29.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:14:29.665 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-28T06:14:29.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:14:29.731 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-28T06:14:29.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:14:29.798 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-05-28T06:14:29.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:14:29.976 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-05-28T06:14:29.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-28T06:14:29.986 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-05-28T06:14:30.055 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2024-05-28T06:14:30.057 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-28T06:14:30.057 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-28T06:14:30.066 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-28T06:14:30.066 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-28T06:14:30.204 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.205+0000 7fae42e00640 1 Processor -- start 2024-05-28T06:14:30.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.205+0000 7fae42e00640 1 -- start start 2024-05-28T06:14:30.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.205+0000 7fae42e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fae3c0cff30 0x7fae3c06f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:30.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.205+0000 7fae42e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fae3c0cdb00 0x7fae3c0b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:30.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.205+0000 7fae42e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae3c0cdf00 con 0x7fae3c06f6c0 2024-05-28T06:14:30.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.205+0000 7fae42e00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fae3c06fb30 con 0x7fae3c0cdb00 2024-05-28T06:14:30.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.205+0000 7fae42e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fae3c0d0310 con 0x7fae3c0cff30 2024-05-28T06:14:30.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.205+0000 7fae40e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fae3c0cdb00 0x7fae3c0b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:30.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.205+0000 7fae40e00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fae3c0cdb00 0x7fae3c0b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52130/0 (socket says 172.21.15.122:52130) 2024-05-28T06:14:30.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.205+0000 7fae40e00640 1 -- 172.21.15.122:0/3747928420 learned_addr learned my addr 172.21.15.122:0/3747928420 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:30.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.205+0000 7fae3be00640 1 --2- 172.21.15.122:0/3747928420 >> v2:172.21.15.153:3300/0 conn(0x7fae3c0cff30 0x7fae3c06f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:30.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.209+0000 7fae40e00640 1 -- 172.21.15.122:0/3747928420 >> v2:172.21.15.153:3300/0 conn(0x7fae3c0cff30 msgr2=0x7fae3c06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:30.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.209+0000 7fae40e00640 1 --2- 172.21.15.122:0/3747928420 >> v2:172.21.15.153:3300/0 conn(0x7fae3c0cff30 0x7fae3c06f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:30.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.209+0000 7fae40e00640 1 -- 172.21.15.122:0/3747928420 >> v1:172.21.15.153:6789/0 conn(0x7fae3c06f6c0 legacy=0x7fae3c0cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:30.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.209+0000 7fae40e00640 1 -- 172.21.15.122:0/3747928420 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae3c15be20 con 0x7fae3c0cdb00 2024-05-28T06:14:30.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.209+0000 7fae40e00640 1 --2- 172.21.15.122:0/3747928420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae3c0cdb00 0x7fae3c0b49b0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0b3dc0 tx=0x7fae3401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f37406c0c1e8e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:30.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.209+0000 7fae3b400640 1 -- 172.21.15.122:0/3747928420 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae340a5880 con 0x7fae3c0cdb00 2024-05-28T06:14:30.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.209+0000 7fae3b400640 1 -- 172.21.15.122:0/3747928420 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae340a5a20 con 0x7fae3c0cdb00 2024-05-28T06:14:30.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.209+0000 7fae3b400640 1 -- 172.21.15.122:0/3747928420 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae340a5df0 con 0x7fae3c0cdb00 2024-05-28T06:14:30.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.209+0000 7fae42e00640 1 -- 172.21.15.122:0/3747928420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae3c0cdb00 msgr2=0x7fae3c0b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:30.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.209+0000 7fae42e00640 1 --2- 172.21.15.122:0/3747928420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae3c0cdb00 0x7fae3c0b49b0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0b3dc0 tx=0x7fae3401c9c0 comp rx=0 tx=0).stop 2024-05-28T06:14:30.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.209+0000 7fae42e00640 1 -- 172.21.15.122:0/3747928420 shutdown_connections 2024-05-28T06:14:30.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.209+0000 7fae42e00640 1 --2- 172.21.15.122:0/3747928420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae3c0cdb00 0x7fae3c0b49b0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:30.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.209+0000 7fae42e00640 1 --2- 172.21.15.122:0/3747928420 >> v2:172.21.15.153:3300/0 conn(0x7fae3c0cff30 0x7fae3c06f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:30.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.209+0000 7fae42e00640 1 -- 172.21.15.122:0/3747928420 >> 172.21.15.122:0/3747928420 conn(0x7fae3c06bd90 msgr2=0x7fae3c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:30.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.209+0000 7fae42e00640 1 -- 172.21.15.122:0/3747928420 shutdown_connections 2024-05-28T06:14:30.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.209+0000 7fae42e00640 1 -- 172.21.15.122:0/3747928420 wait complete. 2024-05-28T06:14:30.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae42e00640 1 Processor -- start 2024-05-28T06:14:30.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae42e00640 1 -- start start 2024-05-28T06:14:30.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae42e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae3c06f6c0 0x7fae3c0aa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:30.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae42e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae3c0cdb00 0x7fae3c0a9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:30.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae42e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae3c0cff30 0x7fae3c14ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:30.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae42e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c0b5700 con 0x7fae3c06f6c0 2024-05-28T06:14:30.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae42e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c15baf0 con 0x7fae3c0cff30 2024-05-28T06:14:30.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae42e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fae3c0b5880 con 0x7fae3c0cdb00 2024-05-28T06:14:30.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae3be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae3c06f6c0 0x7fae3c0aa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:30.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae3be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae3c06f6c0 0x7fae3c0aa6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52134/0 (socket says 172.21.15.122:52134) 2024-05-28T06:14:30.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae3be00640 1 -- 172.21.15.122:0/1722214453 learned_addr learned my addr 172.21.15.122:0/1722214453 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:30.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae40e00640 1 --2- 172.21.15.122:0/1722214453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae3c0cff30 0x7fae3c14ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:30.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae33400640 1 --2- 172.21.15.122:0/1722214453 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae3c0cdb00 0x7fae3c0a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:30.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae3be00640 1 -- 172.21.15.122:0/1722214453 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae3c0cdb00 msgr2=0x7fae3c0a9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:30.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae3be00640 1 --2- 172.21.15.122:0/1722214453 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae3c0cdb00 0x7fae3c0a9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:30.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae3be00640 1 -- 172.21.15.122:0/1722214453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae3c0cff30 msgr2=0x7fae3c14ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:30.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae3be00640 1 --2- 172.21.15.122:0/1722214453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae3c0cff30 0x7fae3c14ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:30.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae3be00640 1 -- 172.21.15.122:0/1722214453 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae3c0aa290 con 0x7fae3c06f6c0 2024-05-28T06:14:30.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae3be00640 1 --2- 172.21.15.122:0/1722214453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae3c06f6c0 0x7fae3c0aa6c0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fae2c00e870 tx=0x7fae2c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:30.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae38c00640 1 -- 172.21.15.122:0/1722214453 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2c017070 con 0x7fae3c06f6c0 2024-05-28T06:14:30.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae38c00640 1 -- 172.21.15.122:0/1722214453 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae2c00c940 con 0x7fae3c06f6c0 2024-05-28T06:14:30.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae38c00640 1 -- 172.21.15.122:0/1722214453 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2c00ccf0 con 0x7fae3c06f6c0 2024-05-28T06:14:30.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae42e00640 1 -- 172.21.15.122:0/1722214453 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae3c0ab720 con 0x7fae3c06f6c0 2024-05-28T06:14:30.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.213+0000 7fae42e00640 1 -- 172.21.15.122:0/1722214453 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae3c0ad3d0 con 0x7fae3c06f6c0 2024-05-28T06:14:30.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.217+0000 7fae42e00640 1 -- 172.21.15.122:0/1722214453 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae3c068c40 con 0x7fae3c06f6c0 2024-05-28T06:14:30.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.217+0000 7fae38c00640 1 -- 172.21.15.122:0/1722214453 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 23) ==== 89109+0+0 (secure 0 0 0) 0x7fae2c01a070 con 0x7fae3c06f6c0 2024-05-28T06:14:30.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.217+0000 7fae38c00640 1 --2- 172.21.15.122:0/1722214453 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fae18068fe0 0x7fae1806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:30.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.217+0000 7fae38c00640 1 -- 172.21.15.122:0/1722214453 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7fae2c085450 con 0x7fae3c06f6c0 2024-05-28T06:14:30.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.217+0000 7fae33400640 1 --2- 172.21.15.122:0/1722214453 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fae18068fe0 0x7fae1806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:30.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.217+0000 7fae33400640 1 --2- 172.21.15.122:0/1722214453 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fae18068fe0 0x7fae1806b4a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0b2620 tx=0x7fae24009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:30.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.221+0000 7fae38c00640 1 -- 172.21.15.122:0/1722214453 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fae2c057240 con 0x7fae3c06f6c0 2024-05-28T06:14:30.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.417+0000 7fae42e00640 1 -- 172.21.15.122:0/1722214453 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fae3c076020 con 0x7fae18068fe0 2024-05-28T06:14:30.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.425+0000 7fae38c00640 1 -- 172.21.15.122:0/1722214453 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254112 (secure 0 0 0) 0x7fae240050d0 con 0x7fae18068fe0 2024-05-28T06:14:30.426 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:14:30.427 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-05-28T06:14:30.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.429+0000 7fae42e00640 1 -- 172.21.15.122:0/1722214453 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fae18068fe0 msgr2=0x7fae1806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:30.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.429+0000 7fae42e00640 1 --2- 172.21.15.122:0/1722214453 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fae18068fe0 0x7fae1806b4a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0b2620 tx=0x7fae24009040 comp rx=0 tx=0).stop 2024-05-28T06:14:30.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.429+0000 7fae42e00640 1 -- 172.21.15.122:0/1722214453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae3c06f6c0 msgr2=0x7fae3c0aa6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:30.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.429+0000 7fae42e00640 1 --2- 172.21.15.122:0/1722214453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae3c06f6c0 0x7fae3c0aa6c0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fae2c00e870 tx=0x7fae2c00ec70 comp rx=0 tx=0).stop 2024-05-28T06:14:30.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.429+0000 7fae42e00640 1 -- 172.21.15.122:0/1722214453 shutdown_connections 2024-05-28T06:14:30.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.429+0000 7fae42e00640 1 --2- 172.21.15.122:0/1722214453 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fae18068fe0 0x7fae1806b4a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:30.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.429+0000 7fae42e00640 1 --2- 172.21.15.122:0/1722214453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae3c0cff30 0x7fae3c14ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:30.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.429+0000 7fae42e00640 1 --2- 172.21.15.122:0/1722214453 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae3c0cdb00 0x7fae3c0a9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:30.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.429+0000 7fae42e00640 1 --2- 172.21.15.122:0/1722214453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae3c06f6c0 0x7fae3c0aa6c0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:30.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.429+0000 7fae42e00640 1 -- 172.21.15.122:0/1722214453 >> 172.21.15.122:0/1722214453 conn(0x7fae3c06bd90 msgr2=0x7fae3c06e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:30.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.429+0000 7fae42e00640 1 -- 172.21.15.122:0/1722214453 shutdown_connections 2024-05-28T06:14:30.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.429+0000 7fae42e00640 1 -- 172.21.15.122:0/1722214453 wait complete. 2024-05-28T06:14:30.447 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2024-05-28T06:14:29.388873+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":20428523694,"num_objects":4905,"num_object_clones":1,"num_object_copies":9810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4905,"num_whiteouts":1,"num_read":4316,"num_read_kb":16875700,"num_write":5712,"num_write_kb":19951851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5624,"ondisk_log_size":5624,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":40315856,"kb_used_data":39905424,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":714658864,"statfs":{"total":773094113280,"available":731810676736,"internally_reserved":0,"allocated":40863154176,"data_stored":40859567620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":420204081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002569"},"pg_stats":[{"pgid":"9.3f","version":"62'66","reported_seq":152,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.097052+0000","last_change":"2024-05-28T06:12:31.797507+0000","last_active":"2024-05-28T06:13:37.097052+0000","last_peered":"2024-05-28T06:13:37.097052+0000","last_clean":"2024-05-28T06:13:37.097052+0000","last_became_active":"2024-05-28T06:12:31.793751+0000","last_became_peered":"2024-05-28T06:12:31.793751+0000","last_unstale":"2024-05-28T06:13:37.097052+0000","last_undegraded":"2024-05-28T06:13:37.097052+0000","last_fullsized":"2024-05-28T06:13:37.097052+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:49:14.729612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":74,"num_read_kb":303104,"num_write":66,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"62'79","reported_seq":163,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.161320+0000","last_change":"2024-05-28T06:12:31.799024+0000","last_active":"2024-05-28T06:13:37.161320+0000","last_peered":"2024-05-28T06:13:37.161320+0000","last_clean":"2024-05-28T06:13:37.161320+0000","last_became_active":"2024-05-28T06:12:31.798788+0000","last_became_peered":"2024-05-28T06:12:31.798788+0000","last_unstale":"2024-05-28T06:13:37.161320+0000","last_undegraded":"2024-05-28T06:13:37.161320+0000","last_fullsized":"2024-05-28T06:13:37.161320+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:59:06.307827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":72,"num_read_kb":294912,"num_write":79,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"62'75","reported_seq":155,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.965534+0000","last_change":"2024-05-28T06:12:31.802734+0000","last_active":"2024-05-28T06:13:36.965534+0000","last_peered":"2024-05-28T06:13:36.965534+0000","last_clean":"2024-05-28T06:13:36.965534+0000","last_became_active":"2024-05-28T06:12:31.802019+0000","last_became_peered":"2024-05-28T06:12:31.802019+0000","last_unstale":"2024-05-28T06:13:36.965534+0000","last_undegraded":"2024-05-28T06:13:36.965534+0000","last_fullsized":"2024-05-28T06:13:36.965534+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:55:16.457872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":68,"num_read_kb":270338,"num_write":75,"num_write_kb":282627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"62'77","reported_seq":133,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.236029+0000","last_change":"2024-05-28T06:12:31.802404+0000","last_active":"2024-05-28T06:13:37.236029+0000","last_peered":"2024-05-28T06:13:37.236029+0000","last_clean":"2024-05-28T06:13:37.236029+0000","last_became_active":"2024-05-28T06:12:31.801804+0000","last_became_peered":"2024-05-28T06:12:31.801804+0000","last_unstale":"2024-05-28T06:13:37.236029+0000","last_undegraded":"2024-05-28T06:13:37.236029+0000","last_fullsized":"2024-05-28T06:13:37.236029+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:08:26.147408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322961408,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":44,"num_read_kb":180224,"num_write":77,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"62'58","reported_seq":110,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.912606+0000","last_change":"2024-05-28T06:12:31.798616+0000","last_active":"2024-05-28T06:13:36.912606+0000","last_peered":"2024-05-28T06:13:36.912606+0000","last_clean":"2024-05-28T06:13:36.912606+0000","last_became_active":"2024-05-28T06:12:31.798238+0000","last_became_peered":"2024-05-28T06:12:31.798238+0000","last_unstale":"2024-05-28T06:13:36.912606+0000","last_undegraded":"2024-05-28T06:13:36.912606+0000","last_fullsized":"2024-05-28T06:13:36.912606+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T18:11:53.921729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":40,"num_read_kb":163840,"num_write":58,"num_write_kb":237568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"62'88","reported_seq":191,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:38.925842+0000","last_change":"2024-05-28T06:12:31.791032+0000","last_active":"2024-05-28T06:13:38.925842+0000","last_peered":"2024-05-28T06:13:38.925842+0000","last_clean":"2024-05-28T06:13:38.925842+0000","last_became_active":"2024-05-28T06:12:31.790779+0000","last_became_peered":"2024-05-28T06:12:31.790779+0000","last_unstale":"2024-05-28T06:13:38.925842+0000","last_undegraded":"2024-05-28T06:13:38.925842+0000","last_fullsized":"2024-05-28T06:13:38.925842+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:24:28.859928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352321536,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":91,"num_read_kb":364546,"num_write":88,"num_write_kb":344066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"62'63","reported_seq":123,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.740575+0000","last_change":"2024-05-28T06:12:31.786902+0000","last_active":"2024-05-28T06:13:36.740575+0000","last_peered":"2024-05-28T06:13:36.740575+0000","last_clean":"2024-05-28T06:13:36.740575+0000","last_became_active":"2024-05-28T06:12:31.786592+0000","last_became_peered":"2024-05-28T06:12:31.786592+0000","last_unstale":"2024-05-28T06:13:36.740575+0000","last_undegraded":"2024-05-28T06:13:36.740575+0000","last_fullsized":"2024-05-28T06:13:36.740575+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:13:29.656977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":48,"num_read_kb":196608,"num_write":63,"num_write_kb":258048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"62'75","reported_seq":138,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.435924+0000","last_change":"2024-05-28T06:12:31.788445+0000","last_active":"2024-05-28T06:13:37.435924+0000","last_peered":"2024-05-28T06:13:37.435924+0000","last_clean":"2024-05-28T06:13:37.435924+0000","last_became_active":"2024-05-28T06:12:31.788168+0000","last_became_peered":"2024-05-28T06:12:31.788168+0000","last_unstale":"2024-05-28T06:13:37.435924+0000","last_undegraded":"2024-05-28T06:13:37.435924+0000","last_fullsized":"2024-05-28T06:13:37.435924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:04:14.908029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":51,"num_read_kb":208896,"num_write":75,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"62'83","reported_seq":150,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:39.926708+0000","last_change":"2024-05-28T06:12:31.783886+0000","last_active":"2024-05-28T06:13:39.926708+0000","last_peered":"2024-05-28T06:13:39.926708+0000","last_clean":"2024-05-28T06:13:39.926708+0000","last_became_active":"2024-05-28T06:12:31.783599+0000","last_became_peered":"2024-05-28T06:12:31.783599+0000","last_unstale":"2024-05-28T06:13:39.926708+0000","last_undegraded":"2024-05-28T06:13:39.926708+0000","last_fullsized":"2024-05-28T06:13:39.926708+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:42:44.413357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":55,"num_read_kb":221185,"num_write":82,"num_write_kb":327681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"62'62","reported_seq":137,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.029161+0000","last_change":"2024-05-28T06:12:31.797210+0000","last_active":"2024-05-28T06:13:37.029161+0000","last_peered":"2024-05-28T06:13:37.029161+0000","last_clean":"2024-05-28T06:13:37.029161+0000","last_became_active":"2024-05-28T06:12:31.793687+0000","last_became_peered":"2024-05-28T06:12:31.793687+0000","last_unstale":"2024-05-28T06:13:37.029161+0000","last_undegraded":"2024-05-28T06:13:37.029161+0000","last_fullsized":"2024-05-28T06:13:37.029161+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:58:28.495952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":63,"num_read_kb":258048,"num_write":62,"num_write_kb":253952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"62'91","reported_seq":204,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.050023+0000","last_change":"2024-05-28T06:12:31.789629+0000","last_active":"2024-05-28T06:13:37.050023+0000","last_peered":"2024-05-28T06:13:37.050023+0000","last_clean":"2024-05-28T06:13:37.050023+0000","last_became_active":"2024-05-28T06:12:31.789337+0000","last_became_peered":"2024-05-28T06:12:31.789337+0000","last_unstale":"2024-05-28T06:13:37.050023+0000","last_undegraded":"2024-05-28T06:13:37.050023+0000","last_fullsized":"2024-05-28T06:13:37.050023+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:11:11.445809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381681664,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":101,"num_read_kb":413696,"num_write":91,"num_write_kb":372736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"62'76","reported_seq":187,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.477161+0000","last_change":"2024-05-28T06:12:31.796464+0000","last_active":"2024-05-28T06:13:37.477161+0000","last_peered":"2024-05-28T06:13:37.477161+0000","last_clean":"2024-05-28T06:13:37.477161+0000","last_became_active":"2024-05-28T06:12:31.796167+0000","last_became_peered":"2024-05-28T06:12:31.796167+0000","last_unstale":"2024-05-28T06:13:37.477161+0000","last_undegraded":"2024-05-28T06:13:37.477161+0000","last_fullsized":"2024-05-28T06:13:37.477161+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:53:57.139243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":99,"num_read_kb":389124,"num_write":76,"num_write_kb":303105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"62'82","reported_seq":177,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.303156+0000","last_change":"2024-05-28T06:12:31.799523+0000","last_active":"2024-05-28T06:13:37.303156+0000","last_peered":"2024-05-28T06:13:37.303156+0000","last_clean":"2024-05-28T06:13:37.303156+0000","last_became_active":"2024-05-28T06:12:31.799169+0000","last_became_peered":"2024-05-28T06:12:31.799169+0000","last_unstale":"2024-05-28T06:13:37.303156+0000","last_undegraded":"2024-05-28T06:13:37.303156+0000","last_fullsized":"2024-05-28T06:13:37.303156+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:24:13.601910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343932928,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":83,"num_read_kb":339968,"num_write":82,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"62'87","reported_seq":163,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.516157+0000","last_change":"2024-05-28T06:12:31.790257+0000","last_active":"2024-05-28T06:13:37.516157+0000","last_peered":"2024-05-28T06:13:37.516157+0000","last_clean":"2024-05-28T06:13:37.516157+0000","last_became_active":"2024-05-28T06:12:31.789907+0000","last_became_peered":"2024-05-28T06:12:31.789907+0000","last_unstale":"2024-05-28T06:13:37.516157+0000","last_undegraded":"2024-05-28T06:13:37.516157+0000","last_fullsized":"2024-05-28T06:13:37.516157+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:22:57.588310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364904448,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":64,"num_read_kb":262144,"num_write":87,"num_write_kb":356352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"62'63","reported_seq":106,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.034266+0000","last_change":"2024-05-28T06:12:31.788326+0000","last_active":"2024-05-28T06:13:36.034266+0000","last_peered":"2024-05-28T06:13:36.034266+0000","last_clean":"2024-05-28T06:13:36.034266+0000","last_became_active":"2024-05-28T06:12:31.788073+0000","last_became_peered":"2024-05-28T06:12:31.788073+0000","last_unstale":"2024-05-28T06:13:36.034266+0000","last_undegraded":"2024-05-28T06:13:36.034266+0000","last_fullsized":"2024-05-28T06:13:36.034266+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:39:57.840865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":31,"num_read_kb":126976,"num_write":63,"num_write_kb":258048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"62'64","reported_seq":130,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.162230+0000","last_change":"2024-05-28T06:12:31.802252+0000","last_active":"2024-05-28T06:13:37.162230+0000","last_peered":"2024-05-28T06:13:37.162230+0000","last_clean":"2024-05-28T06:13:37.162230+0000","last_became_active":"2024-05-28T06:12:31.800507+0000","last_became_peered":"2024-05-28T06:12:31.800507+0000","last_unstale":"2024-05-28T06:13:37.162230+0000","last_undegraded":"2024-05-28T06:13:37.162230+0000","last_fullsized":"2024-05-28T06:13:37.162230+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:27:01.826955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":54,"num_read_kb":221184,"num_write":64,"num_write_kb":262144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"62'67","reported_seq":121,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.761745+0000","last_change":"2024-05-28T06:12:31.798684+0000","last_active":"2024-05-28T06:13:36.761745+0000","last_peered":"2024-05-28T06:13:36.761745+0000","last_clean":"2024-05-28T06:13:36.761745+0000","last_became_active":"2024-05-28T06:12:31.798292+0000","last_became_peered":"2024-05-28T06:12:31.798292+0000","last_unstale":"2024-05-28T06:13:36.761745+0000","last_undegraded":"2024-05-28T06:13:36.761745+0000","last_fullsized":"2024-05-28T06:13:36.761745+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:52:20.582079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":42,"num_read_kb":172032,"num_write":67,"num_write_kb":266241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"62'85","reported_seq":191,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.360362+0000","last_change":"2024-05-28T06:12:31.805307+0000","last_active":"2024-05-28T06:13:37.360362+0000","last_peered":"2024-05-28T06:13:37.360362+0000","last_clean":"2024-05-28T06:13:37.360362+0000","last_became_active":"2024-05-28T06:12:31.805031+0000","last_became_peered":"2024-05-28T06:12:31.805031+0000","last_unstale":"2024-05-28T06:13:37.360362+0000","last_undegraded":"2024-05-28T06:13:37.360362+0000","last_fullsized":"2024-05-28T06:13:37.360362+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:54:23.878943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544581,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":94,"num_read_kb":372739,"num_write":85,"num_write_kb":327683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"62'90","reported_seq":169,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.608022+0000","last_change":"2024-05-28T06:12:31.792875+0000","last_active":"2024-05-28T06:13:37.608022+0000","last_peered":"2024-05-28T06:13:37.608022+0000","last_clean":"2024-05-28T06:13:37.608022+0000","last_became_active":"2024-05-28T06:12:31.792620+0000","last_became_peered":"2024-05-28T06:12:31.792620+0000","last_unstale":"2024-05-28T06:13:37.608022+0000","last_undegraded":"2024-05-28T06:13:37.608022+0000","last_fullsized":"2024-05-28T06:13:37.608022+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:22:45.579115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369098752,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":67,"num_read_kb":274432,"num_write":90,"num_write_kb":360449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"62'72","reported_seq":146,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.372054+0000","last_change":"2024-05-28T06:12:31.790299+0000","last_active":"2024-05-28T06:13:37.372054+0000","last_peered":"2024-05-28T06:13:37.372054+0000","last_clean":"2024-05-28T06:13:37.372054+0000","last_became_active":"2024-05-28T06:12:31.790044+0000","last_became_peered":"2024-05-28T06:12:31.790044+0000","last_unstale":"2024-05-28T06:13:37.372054+0000","last_undegraded":"2024-05-28T06:13:37.372054+0000","last_fullsized":"2024-05-28T06:13:37.372054+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:33:57.828699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":62,"num_read_kb":253952,"num_write":71,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"62'82","reported_seq":189,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.612855+0000","last_change":"2024-05-28T06:12:31.799285+0000","last_active":"2024-05-28T06:13:37.612855+0000","last_peered":"2024-05-28T06:13:37.612855+0000","last_clean":"2024-05-28T06:13:37.612855+0000","last_became_active":"2024-05-28T06:12:31.798652+0000","last_became_peered":"2024-05-28T06:12:31.798652+0000","last_unstale":"2024-05-28T06:13:37.612855+0000","last_undegraded":"2024-05-28T06:13:37.612855+0000","last_fullsized":"2024-05-28T06:13:37.612855+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:27:01.826955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327155712,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":95,"num_read_kb":376835,"num_write":82,"num_write_kb":319490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"62'78","reported_seq":151,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.490749+0000","last_change":"2024-05-28T06:12:31.802895+0000","last_active":"2024-05-28T06:13:37.490749+0000","last_peered":"2024-05-28T06:13:37.490749+0000","last_clean":"2024-05-28T06:13:37.490749+0000","last_became_active":"2024-05-28T06:12:31.795520+0000","last_became_peered":"2024-05-28T06:12:31.795520+0000","last_unstale":"2024-05-28T06:13:37.490749+0000","last_undegraded":"2024-05-28T06:13:37.490749+0000","last_fullsized":"2024-05-28T06:13:37.490749+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:06:30.752272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":61,"num_read_kb":241666,"num_write":77,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"62'83","reported_seq":152,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.174936+0000","last_change":"2024-05-28T06:12:31.806502+0000","last_active":"2024-05-28T06:13:37.174936+0000","last_peered":"2024-05-28T06:13:37.174936+0000","last_clean":"2024-05-28T06:13:37.174936+0000","last_became_active":"2024-05-28T06:12:31.805993+0000","last_became_peered":"2024-05-28T06:12:31.805993+0000","last_unstale":"2024-05-28T06:13:37.174936+0000","last_undegraded":"2024-05-28T06:13:37.174936+0000","last_fullsized":"2024-05-28T06:13:37.174936+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:43:33.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":348127232,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":57,"num_read_kb":233472,"num_write":83,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"62'79","reported_seq":147,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.284280+0000","last_change":"2024-05-28T06:12:31.801483+0000","last_active":"2024-05-28T06:13:37.284280+0000","last_peered":"2024-05-28T06:13:37.284280+0000","last_clean":"2024-05-28T06:13:37.284280+0000","last_became_active":"2024-05-28T06:12:31.801026+0000","last_became_peered":"2024-05-28T06:12:31.801026+0000","last_unstale":"2024-05-28T06:13:37.284280+0000","last_undegraded":"2024-05-28T06:13:37.284280+0000","last_fullsized":"2024-05-28T06:13:37.284280+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:09:57.797411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":56,"num_read_kb":229376,"num_write":79,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"62'79","reported_seq":159,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.558623+0000","last_change":"2024-05-28T06:12:31.798043+0000","last_active":"2024-05-28T06:13:37.558623+0000","last_peered":"2024-05-28T06:13:37.558623+0000","last_clean":"2024-05-28T06:13:37.558623+0000","last_became_active":"2024-05-28T06:12:31.794016+0000","last_became_peered":"2024-05-28T06:12:31.794016+0000","last_unstale":"2024-05-28T06:13:37.558623+0000","last_undegraded":"2024-05-28T06:13:37.558623+0000","last_fullsized":"2024-05-28T06:13:37.558623+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:35:46.267952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":68,"num_read_kb":266243,"num_write":79,"num_write_kb":307202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"62'66","reported_seq":144,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.394733+0000","last_change":"2024-05-28T06:12:31.788822+0000","last_active":"2024-05-28T06:13:37.394733+0000","last_peered":"2024-05-28T06:13:37.394733+0000","last_clean":"2024-05-28T06:13:37.394733+0000","last_became_active":"2024-05-28T06:12:31.788550+0000","last_became_peered":"2024-05-28T06:12:31.788550+0000","last_unstale":"2024-05-28T06:13:37.394733+0000","last_undegraded":"2024-05-28T06:13:37.394733+0000","last_fullsized":"2024-05-28T06:13:37.394733+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:55:16.457872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":66,"num_read_kb":270336,"num_write":65,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"62'82","reported_seq":160,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.317767+0000","last_change":"2024-05-28T06:12:31.793103+0000","last_active":"2024-05-28T06:13:37.317767+0000","last_peered":"2024-05-28T06:13:37.317767+0000","last_clean":"2024-05-28T06:13:37.317767+0000","last_became_active":"2024-05-28T06:12:31.792595+0000","last_became_peered":"2024-05-28T06:12:31.792595+0000","last_unstale":"2024-05-28T06:13:37.317767+0000","last_undegraded":"2024-05-28T06:13:37.317767+0000","last_fullsized":"2024-05-28T06:13:37.317767+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:30:32.490570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343932928,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":66,"num_read_kb":270336,"num_write":82,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"62'82","reported_seq":128,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.630699+0000","last_change":"2024-05-28T06:12:31.800295+0000","last_active":"2024-05-28T06:13:37.630699+0000","last_peered":"2024-05-28T06:13:37.630699+0000","last_clean":"2024-05-28T06:13:37.630699+0000","last_became_active":"2024-05-28T06:12:31.800042+0000","last_became_peered":"2024-05-28T06:12:31.800042+0000","last_unstale":"2024-05-28T06:13:37.630699+0000","last_undegraded":"2024-05-28T06:13:37.630699+0000","last_fullsized":"2024-05-28T06:13:37.630699+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:30:39.340469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327155712,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":34,"num_read_kb":131074,"num_write":82,"num_write_kb":319490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"62'85","reported_seq":168,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.421829+0000","last_change":"2024-05-28T06:12:31.798980+0000","last_active":"2024-05-28T06:13:37.421829+0000","last_peered":"2024-05-28T06:13:37.421829+0000","last_clean":"2024-05-28T06:13:37.421829+0000","last_became_active":"2024-05-28T06:12:31.798695+0000","last_became_peered":"2024-05-28T06:12:31.798695+0000","last_unstale":"2024-05-28T06:13:37.421829+0000","last_undegraded":"2024-05-28T06:13:37.421829+0000","last_fullsized":"2024-05-28T06:13:37.421829+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:40:22.486569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352321668,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":71,"num_read_kb":286721,"num_write":85,"num_write_kb":344065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"62'77","reported_seq":154,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.316493+0000","last_change":"2024-05-28T06:12:31.803916+0000","last_active":"2024-05-28T06:13:37.316493+0000","last_peered":"2024-05-28T06:13:37.316493+0000","last_clean":"2024-05-28T06:13:37.316493+0000","last_became_active":"2024-05-28T06:12:31.803396+0000","last_became_peered":"2024-05-28T06:12:31.803396+0000","last_unstale":"2024-05-28T06:13:37.316493+0000","last_undegraded":"2024-05-28T06:13:37.316493+0000","last_fullsized":"2024-05-28T06:13:37.316493+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:59:14.477995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322961408,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":65,"num_read_kb":266240,"num_write":77,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"62'69","reported_seq":175,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.352635+0000","last_change":"2024-05-28T06:12:31.797444+0000","last_active":"2024-05-28T06:13:37.352635+0000","last_peered":"2024-05-28T06:13:37.352635+0000","last_clean":"2024-05-28T06:13:37.352635+0000","last_became_active":"2024-05-28T06:12:31.797170+0000","last_became_peered":"2024-05-28T06:12:31.797170+0000","last_unstale":"2024-05-28T06:13:37.352635+0000","last_undegraded":"2024-05-28T06:13:37.352635+0000","last_fullsized":"2024-05-28T06:13:37.352635+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:48:34.278938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":94,"num_read_kb":385024,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"62'71","reported_seq":154,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.532423+0000","last_change":"2024-05-28T06:12:31.787961+0000","last_active":"2024-05-28T06:13:36.532423+0000","last_peered":"2024-05-28T06:13:36.532423+0000","last_clean":"2024-05-28T06:13:36.532423+0000","last_became_active":"2024-05-28T06:12:31.787700+0000","last_became_peered":"2024-05-28T06:12:31.787700+0000","last_unstale":"2024-05-28T06:13:36.532423+0000","last_undegraded":"2024-05-28T06:13:36.532423+0000","last_fullsized":"2024-05-28T06:13:36.532423+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:43:33.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":71,"num_read_kb":290816,"num_write":71,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"62'67","reported_seq":121,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.317857+0000","last_change":"2024-05-28T06:12:31.802935+0000","last_active":"2024-05-28T06:13:37.317857+0000","last_peered":"2024-05-28T06:13:37.317857+0000","last_clean":"2024-05-28T06:13:37.317857+0000","last_became_active":"2024-05-28T06:12:31.802678+0000","last_became_peered":"2024-05-28T06:12:31.802678+0000","last_unstale":"2024-05-28T06:13:37.317857+0000","last_undegraded":"2024-05-28T06:13:37.317857+0000","last_fullsized":"2024-05-28T06:13:37.317857+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:08:26.147408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":42,"num_read_kb":172032,"num_write":67,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.799783+0000","last_change":"2024-05-28T06:12:30.791032+0000","last_active":"2024-05-28T06:12:32.799783+0000","last_peered":"2024-05-28T06:12:32.799783+0000","last_clean":"2024-05-28T06:12:32.799783+0000","last_became_active":"2024-05-28T06:12:30.790720+0000","last_became_peered":"2024-05-28T06:12:30.790720+0000","last_unstale":"2024-05-28T06:12:32.799783+0000","last_undegraded":"2024-05-28T06:12:32.799783+0000","last_fullsized":"2024-05-28T06:12:32.799783+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:02:31.893460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"62'75","reported_seq":156,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.146636+0000","last_change":"2024-05-28T06:12:31.801501+0000","last_active":"2024-05-28T06:13:37.146636+0000","last_peered":"2024-05-28T06:13:37.146636+0000","last_clean":"2024-05-28T06:13:37.146636+0000","last_became_active":"2024-05-28T06:12:31.801239+0000","last_became_peered":"2024-05-28T06:12:31.801239+0000","last_unstale":"2024-05-28T06:13:37.146636+0000","last_undegraded":"2024-05-28T06:13:37.146636+0000","last_fullsized":"2024-05-28T06:13:37.146636+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:12:32.364138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301990149,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":69,"num_read_kb":278529,"num_write":75,"num_write_kb":294914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.780843+0000","last_change":"2024-05-28T06:12:30.799690+0000","last_active":"2024-05-28T06:12:32.780843+0000","last_peered":"2024-05-28T06:12:32.780843+0000","last_clean":"2024-05-28T06:12:32.780843+0000","last_became_active":"2024-05-28T06:12:30.799345+0000","last_became_peered":"2024-05-28T06:12:30.799345+0000","last_unstale":"2024-05-28T06:12:32.780843+0000","last_undegraded":"2024-05-28T06:12:32.780843+0000","last_fullsized":"2024-05-28T06:12:32.780843+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:53:56.132162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"62'73","reported_seq":159,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.030308+0000","last_change":"2024-05-28T06:12:31.787304+0000","last_active":"2024-05-28T06:13:37.030308+0000","last_peered":"2024-05-28T06:13:37.030308+0000","last_clean":"2024-05-28T06:13:37.030308+0000","last_became_active":"2024-05-28T06:12:31.786982+0000","last_became_peered":"2024-05-28T06:12:31.786982+0000","last_unstale":"2024-05-28T06:13:37.030308+0000","last_undegraded":"2024-05-28T06:13:37.030308+0000","last_fullsized":"2024-05-28T06:13:37.030308+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:30:34.090290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":74,"num_read_kb":286724,"num_write":73,"num_write_kb":282626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"62'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.799729+0000","last_change":"2024-05-28T06:12:30.784064+0000","last_active":"2024-05-28T06:12:32.799729+0000","last_peered":"2024-05-28T06:12:32.799729+0000","last_clean":"2024-05-28T06:12:32.799729+0000","last_became_active":"2024-05-28T06:12:30.783801+0000","last_became_peered":"2024-05-28T06:12:30.783801+0000","last_unstale":"2024-05-28T06:12:32.799729+0000","last_undegraded":"2024-05-28T06:12:32.799729+0000","last_fullsized":"2024-05-28T06:12:32.799729+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:21:00.162134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"62'85","reported_seq":183,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.591565+0000","last_change":"2024-05-28T06:12:31.799781+0000","last_active":"2024-05-28T06:13:36.591565+0000","last_peered":"2024-05-28T06:13:36.591565+0000","last_clean":"2024-05-28T06:13:36.591565+0000","last_became_active":"2024-05-28T06:12:31.799517+0000","last_became_peered":"2024-05-28T06:12:31.799517+0000","last_unstale":"2024-05-28T06:13:36.591565+0000","last_undegraded":"2024-05-28T06:13:36.591565+0000","last_fullsized":"2024-05-28T06:13:36.591565+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:53:57.139243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356515840,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":86,"num_read_kb":352256,"num_write":85,"num_write_kb":348160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.782540+0000","last_change":"2024-05-28T06:12:30.795765+0000","last_active":"2024-05-28T06:12:32.782540+0000","last_peered":"2024-05-28T06:12:32.782540+0000","last_clean":"2024-05-28T06:12:32.782540+0000","last_became_active":"2024-05-28T06:12:30.795164+0000","last_became_peered":"2024-05-28T06:12:30.795164+0000","last_unstale":"2024-05-28T06:12:32.782540+0000","last_undegraded":"2024-05-28T06:12:32.782540+0000","last_fullsized":"2024-05-28T06:12:32.782540+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:20:40.469531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"62'74","reported_seq":143,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.356354+0000","last_change":"2024-05-28T06:12:31.801832+0000","last_active":"2024-05-28T06:13:37.356354+0000","last_peered":"2024-05-28T06:13:37.356354+0000","last_clean":"2024-05-28T06:13:37.356354+0000","last_became_active":"2024-05-28T06:12:31.795154+0000","last_became_peered":"2024-05-28T06:12:31.795154+0000","last_unstale":"2024-05-28T06:13:37.356354+0000","last_undegraded":"2024-05-28T06:13:37.356354+0000","last_fullsized":"2024-05-28T06:13:37.356354+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:49:40.536846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":57,"num_read_kb":233472,"num_write":74,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.560759+0000","last_change":"2024-05-28T06:12:30.793046+0000","last_active":"2024-05-28T06:12:33.560759+0000","last_peered":"2024-05-28T06:12:33.560759+0000","last_clean":"2024-05-28T06:12:33.560759+0000","last_became_active":"2024-05-28T06:12:30.792752+0000","last_became_peered":"2024-05-28T06:12:30.792752+0000","last_unstale":"2024-05-28T06:12:33.560759+0000","last_undegraded":"2024-05-28T06:12:33.560759+0000","last_fullsized":"2024-05-28T06:12:33.560759+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:03:08.736169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"62'75","reported_seq":181,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.392229+0000","last_change":"2024-05-28T06:12:31.789865+0000","last_active":"2024-05-28T06:13:37.392229+0000","last_peered":"2024-05-28T06:13:37.392229+0000","last_clean":"2024-05-28T06:13:37.392229+0000","last_became_active":"2024-05-28T06:12:31.789614+0000","last_became_peered":"2024-05-28T06:12:31.789614+0000","last_unstale":"2024-05-28T06:13:37.392229+0000","last_undegraded":"2024-05-28T06:13:37.392229+0000","last_fullsized":"2024-05-28T06:13:37.392229+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:06:00.739339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":94,"num_read_kb":385024,"num_write":75,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.798994+0000","last_change":"2024-05-28T06:12:30.790331+0000","last_active":"2024-05-28T06:12:32.798994+0000","last_peered":"2024-05-28T06:12:32.798994+0000","last_clean":"2024-05-28T06:12:32.798994+0000","last_became_active":"2024-05-28T06:12:30.790028+0000","last_became_peered":"2024-05-28T06:12:30.790028+0000","last_unstale":"2024-05-28T06:12:32.798994+0000","last_undegraded":"2024-05-28T06:12:32.798994+0000","last_fullsized":"2024-05-28T06:12:32.798994+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:01:52.086398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"62'77","reported_seq":163,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.256784+0000","last_change":"2024-05-28T06:12:31.798571+0000","last_active":"2024-05-28T06:13:37.256784+0000","last_peered":"2024-05-28T06:13:37.256784+0000","last_clean":"2024-05-28T06:13:37.256784+0000","last_became_active":"2024-05-28T06:12:31.797004+0000","last_became_peered":"2024-05-28T06:12:31.797004+0000","last_unstale":"2024-05-28T06:13:37.256784+0000","last_undegraded":"2024-05-28T06:13:37.256784+0000","last_fullsized":"2024-05-28T06:13:37.256784+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:21:06.719589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":74,"num_read_kb":294914,"num_write":77,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.781942+0000","last_change":"2024-05-28T06:12:30.792493+0000","last_active":"2024-05-28T06:12:32.781942+0000","last_peered":"2024-05-28T06:12:32.781942+0000","last_clean":"2024-05-28T06:12:32.781942+0000","last_became_active":"2024-05-28T06:12:30.791832+0000","last_became_peered":"2024-05-28T06:12:30.791832+0000","last_unstale":"2024-05-28T06:12:32.781942+0000","last_undegraded":"2024-05-28T06:12:32.781942+0000","last_fullsized":"2024-05-28T06:12:32.781942+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:02:31.893460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"62'76","reported_seq":152,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.164180+0000","last_change":"2024-05-28T06:12:31.804063+0000","last_active":"2024-05-28T06:13:37.164180+0000","last_peered":"2024-05-28T06:13:37.164180+0000","last_clean":"2024-05-28T06:13:37.164180+0000","last_became_active":"2024-05-28T06:12:31.803791+0000","last_became_peered":"2024-05-28T06:12:31.803791+0000","last_unstale":"2024-05-28T06:13:37.164180+0000","last_undegraded":"2024-05-28T06:13:37.164180+0000","last_fullsized":"2024-05-28T06:13:37.164180+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:05:13.800609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":64,"num_read_kb":253954,"num_write":76,"num_write_kb":303105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.560668+0000","last_change":"2024-05-28T06:12:30.792385+0000","last_active":"2024-05-28T06:12:33.560668+0000","last_peered":"2024-05-28T06:12:33.560668+0000","last_clean":"2024-05-28T06:12:33.560668+0000","last_became_active":"2024-05-28T06:12:30.789854+0000","last_became_peered":"2024-05-28T06:12:30.789854+0000","last_unstale":"2024-05-28T06:12:33.560668+0000","last_undegraded":"2024-05-28T06:12:33.560668+0000","last_fullsized":"2024-05-28T06:12:33.560668+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:52:08.811888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"62'64","reported_seq":112,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.060841+0000","last_change":"2024-05-28T06:12:31.791507+0000","last_active":"2024-05-28T06:13:37.060841+0000","last_peered":"2024-05-28T06:13:37.060841+0000","last_clean":"2024-05-28T06:13:37.060841+0000","last_became_active":"2024-05-28T06:12:31.788910+0000","last_became_peered":"2024-05-28T06:12:31.788910+0000","last_unstale":"2024-05-28T06:13:37.060841+0000","last_undegraded":"2024-05-28T06:13:37.060841+0000","last_fullsized":"2024-05-28T06:13:37.060841+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:33:08.387840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":36,"num_read_kb":147456,"num_write":64,"num_write_kb":262144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"62'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.561581+0000","last_change":"2024-05-28T06:12:30.796608+0000","last_active":"2024-05-28T06:12:33.561581+0000","last_peered":"2024-05-28T06:12:33.561581+0000","last_clean":"2024-05-28T06:12:33.561581+0000","last_became_active":"2024-05-28T06:12:30.796011+0000","last_became_peered":"2024-05-28T06:12:30.796011+0000","last_unstale":"2024-05-28T06:12:33.561581+0000","last_undegraded":"2024-05-28T06:12:33.561581+0000","last_fullsized":"2024-05-28T06:12:33.561581+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:03:08.736169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"62'71","reported_seq":123,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.804571+0000","last_change":"2024-05-28T06:12:31.807786+0000","last_active":"2024-05-28T06:13:36.804571+0000","last_peered":"2024-05-28T06:13:36.804571+0000","last_clean":"2024-05-28T06:13:36.804571+0000","last_became_active":"2024-05-28T06:12:31.807524+0000","last_became_peered":"2024-05-28T06:12:31.807524+0000","last_unstale":"2024-05-28T06:13:36.804571+0000","last_undegraded":"2024-05-28T06:13:36.804571+0000","last_fullsized":"2024-05-28T06:13:36.804571+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:53:57.139243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":40,"num_read_kb":163840,"num_write":71,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.780950+0000","last_change":"2024-05-28T06:12:30.798374+0000","last_active":"2024-05-28T06:12:32.780950+0000","last_peered":"2024-05-28T06:12:32.780950+0000","last_clean":"2024-05-28T06:12:32.780950+0000","last_became_active":"2024-05-28T06:12:30.798033+0000","last_became_peered":"2024-05-28T06:12:30.798033+0000","last_unstale":"2024-05-28T06:12:32.780950+0000","last_undegraded":"2024-05-28T06:12:32.780950+0000","last_fullsized":"2024-05-28T06:12:32.780950+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:30:33.083208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"62'70","reported_seq":163,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.240601+0000","last_change":"2024-05-28T06:12:31.791600+0000","last_active":"2024-05-28T06:13:37.240601+0000","last_peered":"2024-05-28T06:13:37.240601+0000","last_clean":"2024-05-28T06:13:37.240601+0000","last_became_active":"2024-05-28T06:12:31.789590+0000","last_became_peered":"2024-05-28T06:12:31.789590+0000","last_unstale":"2024-05-28T06:13:37.240601+0000","last_undegraded":"2024-05-28T06:13:37.240601+0000","last_fullsized":"2024-05-28T06:13:37.240601+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:21:06.719589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":81,"num_read_kb":331776,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"62'24","reported_seq":38,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:39.929351+0000","last_change":"2024-05-28T06:12:30.794636+0000","last_active":"2024-05-28T06:13:39.929351+0000","last_peered":"2024-05-28T06:13:39.929351+0000","last_clean":"2024-05-28T06:13:39.929351+0000","last_became_active":"2024-05-28T06:12:30.794322+0000","last_became_peered":"2024-05-28T06:12:30.794322+0000","last_unstale":"2024-05-28T06:13:39.929351+0000","last_undegraded":"2024-05-28T06:13:39.929351+0000","last_fullsized":"2024-05-28T06:13:39.929351+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:21:00.162134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"62'68","reported_seq":141,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.027341+0000","last_change":"2024-05-28T06:12:31.806694+0000","last_active":"2024-05-28T06:13:37.027341+0000","last_peered":"2024-05-28T06:13:37.027341+0000","last_clean":"2024-05-28T06:13:37.027341+0000","last_became_active":"2024-05-28T06:12:31.806339+0000","last_became_peered":"2024-05-28T06:12:31.806339+0000","last_unstale":"2024-05-28T06:13:37.027341+0000","last_undegraded":"2024-05-28T06:13:37.027341+0000","last_fullsized":"2024-05-28T06:13:37.027341+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:30:32.490570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":61,"num_read_kb":245761,"num_write":67,"num_write_kb":266241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"62'423","reported_seq":437,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:55.891712+0000","last_change":"2024-05-28T06:12:30.791461+0000","last_active":"2024-05-28T06:13:55.891712+0000","last_peered":"2024-05-28T06:13:55.891712+0000","last_clean":"2024-05-28T06:13:55.891712+0000","last_became_active":"2024-05-28T06:12:30.791190+0000","last_became_peered":"2024-05-28T06:12:30.791190+0000","last_unstale":"2024-05-28T06:13:55.891712+0000","last_undegraded":"2024-05-28T06:13:55.891712+0000","last_fullsized":"2024-05-28T06:13:55.891712+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:01:52.086398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1666114,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":422,"num_write_kb":1782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"62'75","reported_seq":136,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.086390+0000","last_change":"2024-05-28T06:12:31.796224+0000","last_active":"2024-05-28T06:13:37.086390+0000","last_peered":"2024-05-28T06:13:37.086390+0000","last_clean":"2024-05-28T06:13:37.086390+0000","last_became_active":"2024-05-28T06:12:31.794242+0000","last_became_peered":"2024-05-28T06:12:31.794242+0000","last_unstale":"2024-05-28T06:13:37.086390+0000","last_undegraded":"2024-05-28T06:13:37.086390+0000","last_fullsized":"2024-05-28T06:13:37.086390+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:21:56.535399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":49,"num_read_kb":200704,"num_write":75,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.780490+0000","last_change":"2024-05-28T06:12:30.794765+0000","last_active":"2024-05-28T06:12:32.780490+0000","last_peered":"2024-05-28T06:12:32.780490+0000","last_clean":"2024-05-28T06:12:32.780490+0000","last_became_active":"2024-05-28T06:12:30.794488+0000","last_became_peered":"2024-05-28T06:12:30.794488+0000","last_unstale":"2024-05-28T06:12:32.780490+0000","last_undegraded":"2024-05-28T06:12:32.780490+0000","last_fullsized":"2024-05-28T06:12:32.780490+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:30:31.483489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"62'92","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.393713+0000","last_change":"2024-05-28T06:12:31.803083+0000","last_active":"2024-05-28T06:13:37.393713+0000","last_peered":"2024-05-28T06:13:37.393713+0000","last_clean":"2024-05-28T06:13:37.393713+0000","last_became_active":"2024-05-28T06:12:31.802789+0000","last_became_peered":"2024-05-28T06:12:31.802789+0000","last_unstale":"2024-05-28T06:13:37.393713+0000","last_undegraded":"2024-05-28T06:13:37.393713+0000","last_fullsized":"2024-05-28T06:13:37.393713+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:24:28.859928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369098752,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":53,"num_read_kb":212993,"num_write":92,"num_write_kb":360450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.800554+0000","last_change":"2024-05-28T06:12:30.795959+0000","last_active":"2024-05-28T06:12:32.800554+0000","last_peered":"2024-05-28T06:12:32.800554+0000","last_clean":"2024-05-28T06:12:32.800554+0000","last_became_active":"2024-05-28T06:12:30.795666+0000","last_became_peered":"2024-05-28T06:12:30.795666+0000","last_unstale":"2024-05-28T06:12:32.800554+0000","last_undegraded":"2024-05-28T06:12:32.800554+0000","last_fullsized":"2024-05-28T06:12:32.800554+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:52:42.932309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"62'63","reported_seq":133,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.235936+0000","last_change":"2024-05-28T06:12:31.795558+0000","last_active":"2024-05-28T06:13:37.235936+0000","last_peered":"2024-05-28T06:13:37.235936+0000","last_clean":"2024-05-28T06:13:37.235936+0000","last_became_active":"2024-05-28T06:12:31.795281+0000","last_became_peered":"2024-05-28T06:12:31.795281+0000","last_unstale":"2024-05-28T06:13:37.235936+0000","last_undegraded":"2024-05-28T06:13:37.235936+0000","last_fullsized":"2024-05-28T06:13:37.235936+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:54:31.487426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":58,"num_read_kb":237568,"num_write":63,"num_write_kb":258048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.782127+0000","last_change":"2024-05-28T06:12:30.792703+0000","last_active":"2024-05-28T06:12:32.782127+0000","last_peered":"2024-05-28T06:12:32.782127+0000","last_clean":"2024-05-28T06:12:32.782127+0000","last_became_active":"2024-05-28T06:12:30.792218+0000","last_became_peered":"2024-05-28T06:12:30.792218+0000","last_unstale":"2024-05-28T06:12:32.782127+0000","last_undegraded":"2024-05-28T06:12:32.782127+0000","last_fullsized":"2024-05-28T06:12:32.782127+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:14:39.566092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"62'95","reported_seq":176,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.404448+0000","last_change":"2024-05-28T06:12:31.806242+0000","last_active":"2024-05-28T06:13:37.404448+0000","last_peered":"2024-05-28T06:13:37.404448+0000","last_clean":"2024-05-28T06:13:37.404448+0000","last_became_active":"2024-05-28T06:12:31.805628+0000","last_became_peered":"2024-05-28T06:12:31.805628+0000","last_unstale":"2024-05-28T06:13:37.404448+0000","last_undegraded":"2024-05-28T06:13:37.404448+0000","last_fullsized":"2024-05-28T06:13:37.404448+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:21:56.535399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394264837,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":69,"num_read_kb":282624,"num_write":95,"num_write_kb":385025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.560455+0000","last_change":"2024-05-28T06:12:30.797372+0000","last_active":"2024-05-28T06:12:33.560455+0000","last_peered":"2024-05-28T06:12:33.560455+0000","last_clean":"2024-05-28T06:12:33.560455+0000","last_became_active":"2024-05-28T06:12:30.797105+0000","last_became_peered":"2024-05-28T06:12:30.797105+0000","last_unstale":"2024-05-28T06:12:33.560455+0000","last_undegraded":"2024-05-28T06:12:33.560455+0000","last_fullsized":"2024-05-28T06:12:33.560455+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:01:52.086398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"62'67","reported_seq":104,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.315357+0000","last_change":"2024-05-28T06:12:31.802256+0000","last_active":"2024-05-28T06:13:37.315357+0000","last_peered":"2024-05-28T06:13:37.315357+0000","last_clean":"2024-05-28T06:13:37.315357+0000","last_became_active":"2024-05-28T06:12:31.800610+0000","last_became_peered":"2024-05-28T06:12:31.800610+0000","last_unstale":"2024-05-28T06:13:37.315357+0000","last_undegraded":"2024-05-28T06:13:37.315357+0000","last_fullsized":"2024-05-28T06:13:37.315357+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:22:44.741189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":25,"num_read_kb":102400,"num_write":67,"num_write_kb":266241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.781051+0000","last_change":"2024-05-28T06:12:30.797106+0000","last_active":"2024-05-28T06:12:32.781051+0000","last_peered":"2024-05-28T06:12:32.781051+0000","last_clean":"2024-05-28T06:12:32.781051+0000","last_became_active":"2024-05-28T06:12:30.795350+0000","last_became_peered":"2024-05-28T06:12:30.795350+0000","last_unstale":"2024-05-28T06:12:32.781051+0000","last_undegraded":"2024-05-28T06:12:32.781051+0000","last_fullsized":"2024-05-28T06:12:32.781051+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:24:27.852847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"62'86","reported_seq":179,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.289872+0000","last_change":"2024-05-28T06:12:31.794618+0000","last_active":"2024-05-28T06:13:37.289872+0000","last_peered":"2024-05-28T06:13:37.289872+0000","last_clean":"2024-05-28T06:13:37.289872+0000","last_became_active":"2024-05-28T06:12:31.794358+0000","last_became_peered":"2024-05-28T06:12:31.794358+0000","last_unstale":"2024-05-28T06:13:37.289872+0000","last_undegraded":"2024-05-28T06:13:37.289872+0000","last_fullsized":"2024-05-28T06:13:37.289872+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:30:32.490570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356515972,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":81,"num_read_kb":327681,"num_write":86,"num_write_kb":348161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.799366+0000","last_change":"2024-05-28T06:12:30.793010+0000","last_active":"2024-05-28T06:12:32.799366+0000","last_peered":"2024-05-28T06:12:32.799366+0000","last_clean":"2024-05-28T06:12:32.799366+0000","last_became_active":"2024-05-28T06:12:30.792705+0000","last_became_peered":"2024-05-28T06:12:30.792705+0000","last_unstale":"2024-05-28T06:12:32.799366+0000","last_undegraded":"2024-05-28T06:12:32.799366+0000","last_fullsized":"2024-05-28T06:12:32.799366+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:37:55.600898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"62'65","reported_seq":138,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.196607+0000","last_change":"2024-05-28T06:12:31.790772+0000","last_active":"2024-05-28T06:13:37.196607+0000","last_peered":"2024-05-28T06:13:37.196607+0000","last_clean":"2024-05-28T06:13:37.196607+0000","last_became_active":"2024-05-28T06:12:31.790509+0000","last_became_peered":"2024-05-28T06:12:31.790509+0000","last_unstale":"2024-05-28T06:13:37.196607+0000","last_undegraded":"2024-05-28T06:13:37.196607+0000","last_fullsized":"2024-05-28T06:13:37.196607+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:25:51.424031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658501,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":61,"num_read_kb":233476,"num_write":65,"num_write_kb":245763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.782296+0000","last_change":"2024-05-28T06:12:30.797084+0000","last_active":"2024-05-28T06:12:32.782296+0000","last_peered":"2024-05-28T06:12:32.782296+0000","last_clean":"2024-05-28T06:12:32.782296+0000","last_became_active":"2024-05-28T06:12:30.795903+0000","last_became_peered":"2024-05-28T06:12:30.795903+0000","last_unstale":"2024-05-28T06:12:32.782296+0000","last_undegraded":"2024-05-28T06:12:32.782296+0000","last_fullsized":"2024-05-28T06:12:32.782296+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:54:30.480345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"62'70","reported_seq":161,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.493094+0000","last_change":"2024-05-28T06:12:31.809139+0000","last_active":"2024-05-28T06:13:37.493094+0000","last_peered":"2024-05-28T06:13:37.493094+0000","last_clean":"2024-05-28T06:13:37.493094+0000","last_became_active":"2024-05-28T06:12:31.807373+0000","last_became_peered":"2024-05-28T06:12:31.807373+0000","last_unstale":"2024-05-28T06:13:37.493094+0000","last_undegraded":"2024-05-28T06:13:37.493094+0000","last_fullsized":"2024-05-28T06:13:37.493094+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:30:34.090290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":79,"num_read_kb":323584,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.799295+0000","last_change":"2024-05-28T06:12:30.793875+0000","last_active":"2024-05-28T06:12:32.799295+0000","last_peered":"2024-05-28T06:12:32.799295+0000","last_clean":"2024-05-28T06:12:32.799295+0000","last_became_active":"2024-05-28T06:12:30.793587+0000","last_became_peered":"2024-05-28T06:12:30.793587+0000","last_unstale":"2024-05-28T06:12:32.799295+0000","last_undegraded":"2024-05-28T06:12:32.799295+0000","last_fullsized":"2024-05-28T06:12:32.799295+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:03:08.736169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"62'97","reported_seq":189,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.393853+0000","last_change":"2024-05-28T06:12:31.794925+0000","last_active":"2024-05-28T06:13:37.393853+0000","last_peered":"2024-05-28T06:13:37.393853+0000","last_clean":"2024-05-28T06:13:37.393853+0000","last_became_active":"2024-05-28T06:12:31.793880+0000","last_became_peered":"2024-05-28T06:12:31.793880+0000","last_unstale":"2024-05-28T06:13:37.393853+0000","last_undegraded":"2024-05-28T06:13:37.393853+0000","last_fullsized":"2024-05-28T06:13:37.393853+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:24:28.859928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406847488,"num_objects":97,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":80,"num_read_kb":327680,"num_write":97,"num_write_kb":397312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"62'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.780684+0000","last_change":"2024-05-28T06:12:30.794189+0000","last_active":"2024-05-28T06:12:32.780684+0000","last_peered":"2024-05-28T06:12:32.780684+0000","last_clean":"2024-05-28T06:12:32.780684+0000","last_became_active":"2024-05-28T06:12:30.793922+0000","last_became_peered":"2024-05-28T06:12:30.793922+0000","last_unstale":"2024-05-28T06:12:32.780684+0000","last_undegraded":"2024-05-28T06:12:32.780684+0000","last_fullsized":"2024-05-28T06:12:32.780684+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:08:25.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"62'79","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.489511+0000","last_change":"2024-05-28T06:12:31.797123+0000","last_active":"2024-05-28T06:13:36.489511+0000","last_peered":"2024-05-28T06:13:36.489511+0000","last_clean":"2024-05-28T06:13:36.489511+0000","last_became_active":"2024-05-28T06:12:31.796849+0000","last_became_peered":"2024-05-28T06:12:31.796849+0000","last_unstale":"2024-05-28T06:13:36.489511+0000","last_undegraded":"2024-05-28T06:13:36.489511+0000","last_fullsized":"2024-05-28T06:13:36.489511+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:55:16.457872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":66,"num_read_kb":249861,"num_write":79,"num_write_kb":307202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.561764+0000","last_change":"2024-05-28T06:12:30.796022+0000","last_active":"2024-05-28T06:12:33.561764+0000","last_peered":"2024-05-28T06:12:33.561764+0000","last_clean":"2024-05-28T06:12:33.561764+0000","last_became_active":"2024-05-28T06:12:30.794505+0000","last_became_peered":"2024-05-28T06:12:30.794505+0000","last_unstale":"2024-05-28T06:12:33.561764+0000","last_undegraded":"2024-05-28T06:12:33.561764+0000","last_fullsized":"2024-05-28T06:12:33.561764+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:32:08.488200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"62'69","reported_seq":139,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.116548+0000","last_change":"2024-05-28T06:12:31.802246+0000","last_active":"2024-05-28T06:13:37.116548+0000","last_peered":"2024-05-28T06:13:37.116548+0000","last_clean":"2024-05-28T06:13:37.116548+0000","last_became_active":"2024-05-28T06:12:31.801961+0000","last_became_peered":"2024-05-28T06:12:31.801961+0000","last_unstale":"2024-05-28T06:13:37.116548+0000","last_undegraded":"2024-05-28T06:13:37.116548+0000","last_fullsized":"2024-05-28T06:13:37.116548+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:21:56.535399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":58,"num_read_kb":237568,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.781996+0000","last_change":"2024-05-28T06:12:30.790810+0000","last_active":"2024-05-28T06:12:32.781996+0000","last_peered":"2024-05-28T06:12:32.781996+0000","last_clean":"2024-05-28T06:12:32.781996+0000","last_became_active":"2024-05-28T06:12:30.790513+0000","last_became_peered":"2024-05-28T06:12:30.790513+0000","last_unstale":"2024-05-28T06:12:32.781996+0000","last_undegraded":"2024-05-28T06:12:32.781996+0000","last_fullsized":"2024-05-28T06:12:32.781996+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:31:14.976810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"62'80","reported_seq":130,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.201588+0000","last_change":"2024-05-28T06:12:31.804263+0000","last_active":"2024-05-28T06:13:37.201588+0000","last_peered":"2024-05-28T06:13:37.201588+0000","last_clean":"2024-05-28T06:13:37.201588+0000","last_became_active":"2024-05-28T06:12:31.803936+0000","last_became_peered":"2024-05-28T06:12:31.803936+0000","last_unstale":"2024-05-28T06:13:37.201588+0000","last_undegraded":"2024-05-28T06:13:37.201588+0000","last_fullsized":"2024-05-28T06:13:37.201588+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:30:34.090290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":38,"num_read_kb":155648,"num_write":80,"num_write_kb":327680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.562377+0000","last_change":"2024-05-28T06:12:30.798073+0000","last_active":"2024-05-28T06:12:33.562377+0000","last_peered":"2024-05-28T06:12:33.562377+0000","last_clean":"2024-05-28T06:12:33.562377+0000","last_became_active":"2024-05-28T06:12:30.797794+0000","last_became_peered":"2024-05-28T06:12:30.797794+0000","last_unstale":"2024-05-28T06:12:33.562377+0000","last_undegraded":"2024-05-28T06:12:33.562377+0000","last_fullsized":"2024-05-28T06:12:33.562377+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:05:17.937721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"62'86","reported_seq":178,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.316401+0000","last_change":"2024-05-28T06:12:31.800014+0000","last_active":"2024-05-28T06:13:37.316401+0000","last_peered":"2024-05-28T06:13:37.316401+0000","last_clean":"2024-05-28T06:13:37.316401+0000","last_became_active":"2024-05-28T06:12:31.799714+0000","last_became_peered":"2024-05-28T06:12:31.799714+0000","last_unstale":"2024-05-28T06:13:37.316401+0000","last_undegraded":"2024-05-28T06:13:37.316401+0000","last_fullsized":"2024-05-28T06:13:37.316401+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:54:23.878943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360710144,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":80,"num_read_kb":327680,"num_write":86,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"62'40","reported_seq":54,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:43.843635+0000","last_change":"2024-05-28T06:12:30.790726+0000","last_active":"2024-05-28T06:13:43.843635+0000","last_peered":"2024-05-28T06:13:43.843635+0000","last_clean":"2024-05-28T06:13:43.843635+0000","last_became_active":"2024-05-28T06:12:30.790486+0000","last_became_peered":"2024-05-28T06:12:30.790486+0000","last_unstale":"2024-05-28T06:13:43.843635+0000","last_undegraded":"2024-05-28T06:13:43.843635+0000","last_fullsized":"2024-05-28T06:13:43.843635+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:31:14.976810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"62'83","reported_seq":190,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.421892+0000","last_change":"2024-05-28T06:12:31.791575+0000","last_active":"2024-05-28T06:13:37.421892+0000","last_peered":"2024-05-28T06:13:37.421892+0000","last_clean":"2024-05-28T06:13:37.421892+0000","last_became_active":"2024-05-28T06:12:31.789316+0000","last_became_peered":"2024-05-28T06:12:31.789316+0000","last_unstale":"2024-05-28T06:13:37.421892+0000","last_undegraded":"2024-05-28T06:13:37.421892+0000","last_fullsized":"2024-05-28T06:13:37.421892+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:56:28.051898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339738624,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":95,"num_read_kb":385025,"num_write":83,"num_write_kb":331777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.800751+0000","last_change":"2024-05-28T06:12:30.791618+0000","last_active":"2024-05-28T06:12:32.800751+0000","last_peered":"2024-05-28T06:12:32.800751+0000","last_clean":"2024-05-28T06:12:32.800751+0000","last_became_active":"2024-05-28T06:12:30.791296+0000","last_became_peered":"2024-05-28T06:12:30.791296+0000","last_unstale":"2024-05-28T06:12:32.800751+0000","last_undegraded":"2024-05-28T06:12:32.800751+0000","last_fullsized":"2024-05-28T06:12:32.800751+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:32:08.488200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"62'90","reported_seq":150,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.548239+0000","last_change":"2024-05-28T06:12:31.799676+0000","last_active":"2024-05-28T06:13:37.548239+0000","last_peered":"2024-05-28T06:13:37.548239+0000","last_clean":"2024-05-28T06:13:37.548239+0000","last_became_active":"2024-05-28T06:12:31.799396+0000","last_became_peered":"2024-05-28T06:12:31.799396+0000","last_unstale":"2024-05-28T06:13:37.548239+0000","last_undegraded":"2024-05-28T06:13:37.548239+0000","last_fullsized":"2024-05-28T06:13:37.548239+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:54:23.878943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356516084,"num_objects":88,"num_object_clones":1,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":1,"num_read":49,"num_read_kb":200704,"num_write":88,"num_write_kb":348162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.782544+0000","last_change":"2024-05-28T06:12:30.790898+0000","last_active":"2024-05-28T06:12:32.782544+0000","last_peered":"2024-05-28T06:12:32.782544+0000","last_clean":"2024-05-28T06:12:32.782544+0000","last_became_active":"2024-05-28T06:12:30.790609+0000","last_became_peered":"2024-05-28T06:12:30.790609+0000","last_unstale":"2024-05-28T06:12:32.782544+0000","last_undegraded":"2024-05-28T06:12:32.782544+0000","last_fullsized":"2024-05-28T06:12:32.782544+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:42:43.406276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"62'86","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.545733+0000","last_change":"2024-05-28T06:12:31.793575+0000","last_active":"2024-05-28T06:13:37.545733+0000","last_peered":"2024-05-28T06:13:37.545733+0000","last_clean":"2024-05-28T06:13:37.545733+0000","last_became_active":"2024-05-28T06:12:31.792189+0000","last_became_peered":"2024-05-28T06:12:31.792189+0000","last_unstale":"2024-05-28T06:13:37.545733+0000","last_undegraded":"2024-05-28T06:13:37.545733+0000","last_fullsized":"2024-05-28T06:13:37.545733+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:37:03.595280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360710144,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":59,"num_read_kb":241664,"num_write":86,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.561734+0000","last_change":"2024-05-28T06:12:30.787551+0000","last_active":"2024-05-28T06:12:33.561734+0000","last_peered":"2024-05-28T06:12:33.561734+0000","last_clean":"2024-05-28T06:12:33.561734+0000","last_became_active":"2024-05-28T06:12:30.786731+0000","last_became_peered":"2024-05-28T06:12:30.786731+0000","last_unstale":"2024-05-28T06:12:33.561734+0000","last_undegraded":"2024-05-28T06:12:33.561734+0000","last_fullsized":"2024-05-28T06:12:33.561734+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:57:56.110796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"62'95","reported_seq":193,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.520900+0000","last_change":"2024-05-28T06:12:31.804270+0000","last_active":"2024-05-28T06:13:37.520900+0000","last_peered":"2024-05-28T06:13:37.520900+0000","last_clean":"2024-05-28T06:13:37.520900+0000","last_became_active":"2024-05-28T06:12:31.803980+0000","last_became_peered":"2024-05-28T06:12:31.803980+0000","last_unstale":"2024-05-28T06:13:37.520900+0000","last_undegraded":"2024-05-28T06:13:37.520900+0000","last_fullsized":"2024-05-28T06:13:37.520900+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:08:26.147408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390070272,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":86,"num_read_kb":339971,"num_write":95,"num_write_kb":380929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.560646+0000","last_change":"2024-05-28T06:12:30.790132+0000","last_active":"2024-05-28T06:12:33.560646+0000","last_peered":"2024-05-28T06:12:33.560646+0000","last_clean":"2024-05-28T06:12:33.560646+0000","last_became_active":"2024-05-28T06:12:30.789856+0000","last_became_peered":"2024-05-28T06:12:30.789856+0000","last_unstale":"2024-05-28T06:12:33.560646+0000","last_undegraded":"2024-05-28T06:12:33.560646+0000","last_fullsized":"2024-05-28T06:12:33.560646+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:05:08.097047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"62'94","reported_seq":181,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.051192+0000","last_change":"2024-05-28T06:12:31.801507+0000","last_active":"2024-05-28T06:13:37.051192+0000","last_peered":"2024-05-28T06:13:37.051192+0000","last_clean":"2024-05-28T06:13:37.051192+0000","last_became_active":"2024-05-28T06:12:31.801228+0000","last_became_peered":"2024-05-28T06:12:31.801228+0000","last_unstale":"2024-05-28T06:13:37.051192+0000","last_undegraded":"2024-05-28T06:13:37.051192+0000","last_fullsized":"2024-05-28T06:13:37.051192+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:24:13.601910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394264576,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":75,"num_read_kb":307200,"num_write":94,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"62'31","reported_seq":75,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:42.926546+0000","last_change":"2024-05-28T06:12:30.790873+0000","last_active":"2024-05-28T06:13:42.926546+0000","last_peered":"2024-05-28T06:13:42.926546+0000","last_clean":"2024-05-28T06:13:42.926546+0000","last_became_active":"2024-05-28T06:12:30.790623+0000","last_became_peered":"2024-05-28T06:12:30.790623+0000","last_unstale":"2024-05-28T06:13:42.926546+0000","last_undegraded":"2024-05-28T06:13:42.926546+0000","last_fullsized":"2024-05-28T06:13:42.926546+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:52:42.932309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4250,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":30,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"62'86","reported_seq":176,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.744527+0000","last_change":"2024-05-28T06:12:31.803993+0000","last_active":"2024-05-28T06:13:36.744527+0000","last_peered":"2024-05-28T06:13:36.744527+0000","last_clean":"2024-05-28T06:13:36.744527+0000","last_became_active":"2024-05-28T06:12:31.803709+0000","last_became_peered":"2024-05-28T06:12:31.803709+0000","last_unstale":"2024-05-28T06:13:36.744527+0000","last_undegraded":"2024-05-28T06:13:36.744527+0000","last_fullsized":"2024-05-28T06:13:36.744527+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:02:56.823249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360710144,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":78,"num_read_kb":319488,"num_write":86,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.780340+0000","last_change":"2024-05-28T06:12:30.793567+0000","last_active":"2024-05-28T06:12:32.780340+0000","last_peered":"2024-05-28T06:12:32.780340+0000","last_clean":"2024-05-28T06:12:32.780340+0000","last_became_active":"2024-05-28T06:12:30.793086+0000","last_became_peered":"2024-05-28T06:12:30.793086+0000","last_unstale":"2024-05-28T06:12:32.780340+0000","last_undegraded":"2024-05-28T06:12:32.780340+0000","last_fullsized":"2024-05-28T06:12:32.780340+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:55:15.450791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"62'88","reported_seq":146,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.479297+0000","last_change":"2024-05-28T06:12:31.789343+0000","last_active":"2024-05-28T06:13:37.479297+0000","last_peered":"2024-05-28T06:13:37.479297+0000","last_clean":"2024-05-28T06:13:37.479297+0000","last_became_active":"2024-05-28T06:12:31.789082+0000","last_became_peered":"2024-05-28T06:12:31.789082+0000","last_unstale":"2024-05-28T06:13:37.479297+0000","last_undegraded":"2024-05-28T06:13:37.479297+0000","last_fullsized":"2024-05-28T06:13:37.479297+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:52:29.999357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356515972,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":46,"num_read_kb":180226,"num_write":88,"num_write_kb":348162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.800527+0000","last_change":"2024-05-28T06:12:30.796037+0000","last_active":"2024-05-28T06:12:32.800527+0000","last_peered":"2024-05-28T06:12:32.800527+0000","last_clean":"2024-05-28T06:12:32.800527+0000","last_became_active":"2024-05-28T06:12:30.795716+0000","last_became_peered":"2024-05-28T06:12:30.795716+0000","last_unstale":"2024-05-28T06:12:32.800527+0000","last_undegraded":"2024-05-28T06:12:32.800527+0000","last_fullsized":"2024-05-28T06:12:32.800527+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:17:05.591509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":248,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.560577+0000","last_change":"2024-05-28T06:05:38.517922+0000","last_active":"2024-05-28T06:12:33.560577+0000","last_peered":"2024-05-28T06:12:33.560577+0000","last_clean":"2024-05-28T06:12:33.560577+0000","last_became_active":"2024-05-28T06:05:38.514745+0000","last_became_peered":"2024-05-28T06:05:38.514745+0000","last_unstale":"2024-05-28T06:12:33.560577+0000","last_undegraded":"2024-05-28T06:12:33.560577+0000","last_fullsized":"2024-05-28T06:12:33.560577+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_clean_scrub_stamp":"2024-05-28T06:05:37.485018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:23:27.978203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":20426262164,"num_objects":4880,"num_object_clones":1,"num_object_copies":9760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4880,"num_whiteouts":1,"num_read":4170,"num_read_kb":16875570,"num_write":4948,"num_write_kb":19947563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40852594688,"data_stored":40852524328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4957,"ondisk_log_size":4957,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1671162,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":605,"num_write_kb":1872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3407872,"data_stored":3342324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":550,"ondisk_log_size":550,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574958,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5940600,"kb_used_data":5891376,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":88431240,"statfs":{"total":96636764160,"available":90553589760,"internally_reserved":0,"allocated":6032769024,"data_stored":6032315492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574958,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3842848,"kb_used_data":3793624,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":90528992,"statfs":{"total":96636764160,"available":92701687808,"internally_reserved":0,"allocated":3884670976,"data_stored":3884240533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574957,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4842296,"kb_used_data":4793072,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":89529544,"statfs":{"total":96636764160,"available":91678253056,"internally_reserved":0,"allocated":4908105728,"data_stored":4907651869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574956,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4073928,"kb_used_data":4020544,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":90297912,"statfs":{"total":96636764160,"available":92465061888,"internally_reserved":0,"allocated":4117037056,"data_stored":4116593628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574959,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6505336,"kb_used_data":6451952,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":87866504,"statfs":{"total":96636764160,"available":89975300096,"internally_reserved":0,"allocated":6606798848,"data_stored":6606344671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574958,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3781416,"kb_used_data":3732192,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":90590424,"statfs":{"total":96636764160,"available":92764594176,"internally_reserved":0,"allocated":3821764608,"data_stored":3821326029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574958,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5935988,"kb_used_data":5882604,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":88435852,"statfs":{"total":96636764160,"available":90558312448,"internally_reserved":0,"allocated":6023786496,"data_stored":6023340306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574957,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5393444,"kb_used_data":5340060,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":88978396,"statfs":{"total":96636764160,"available":91113877504,"internally_reserved":0,"allocated":5468221440,"data_stored":5467755092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1687552,"data_stored":1670946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1675264,"data_stored":1666114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5465194496,"data_stored":5465178749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6023028736,"data_stored":6023020937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3821010944,"data_stored":3821010944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6606045184,"data_stored":6606029586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4114616320,"data_stored":4114612485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4907352064,"data_stored":4907336188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3883925504,"data_stored":3883925504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6031421440,"data_stored":6031409935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-28T06:14:30.450 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-28T06:14:30.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.625+0000 7fc32f000640 1 Processor -- start 2024-05-28T06:14:30.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.625+0000 7fc32f000640 1 -- start start 2024-05-28T06:14:30.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.629+0000 7fc32f000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3280cff30 0x7fc32806f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:30.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.629+0000 7fc32f000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc3280cdb00 0x7fc3280b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:30.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.629+0000 7fc32f000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3280d0310 con 0x7fc32806f6c0 2024-05-28T06:14:30.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.629+0000 7fc32f000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fc32806fb00 con 0x7fc3280cdb00 2024-05-28T06:14:30.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.629+0000 7fc32f000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc3280cdf30 con 0x7fc3280cff30 2024-05-28T06:14:30.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.629+0000 7fc32d000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc3280cdb00 0x7fc3280b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:30.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.629+0000 7fc327400640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fc32806f6c0 0x7fc3280cd3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:49768/0 (socket says 172.21.15.122:49768) 2024-05-28T06:14:30.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.629+0000 7fc327400640 1 -- 172.21.15.122:0/1237175740 learned_addr learned my addr 172.21.15.122:0/1237175740 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:14:30.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.629+0000 7fc327e00640 1 --2- 172.21.15.122:0/1237175740 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3280cff30 0x7fc32806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:30.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.629+0000 7fc32d000640 1 -- 172.21.15.122:0/1237175740 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3280cff30 msgr2=0x7fc32806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:30.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.629+0000 7fc32d000640 1 --2- 172.21.15.122:0/1237175740 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3280cff30 0x7fc32806f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:30.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.629+0000 7fc32d000640 1 -- 172.21.15.122:0/1237175740 >> v1:172.21.15.122:6789/0 conn(0x7fc32806f6c0 legacy=0x7fc3280cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:30.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.629+0000 7fc32d000640 1 -- 172.21.15.122:0/1237175740 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc32815be20 con 0x7fc3280cdb00 2024-05-28T06:14:30.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.629+0000 7fc326a00640 1 -- 172.21.15.122:0/1237175740 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3122347871 0 0) 0x7fc3280d0310 con 0x7fc32806f6c0 2024-05-28T06:14:30.631 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.633+0000 7fc32d000640 1 --2- 172.21.15.122:0/1237175740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3280cdb00 0x7fc3280b49b0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fc3200097c0 tx=0x7fc32001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad579b6cefde7381 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:30.631 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.633+0000 7fc326a00640 1 -- 172.21.15.122:0/1237175740 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3200a7070 con 0x7fc3280cdb00 2024-05-28T06:14:30.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.633+0000 7fc326a00640 1 -- 172.21.15.122:0/1237175740 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3200b0070 con 0x7fc3280cdb00 2024-05-28T06:14:30.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.633+0000 7fc326a00640 1 -- 172.21.15.122:0/1237175740 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3200ab890 con 0x7fc3280cdb00 2024-05-28T06:14:30.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.633+0000 7fc32f000640 1 -- 172.21.15.122:0/1237175740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3280cdb00 msgr2=0x7fc3280b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:30.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.633+0000 7fc32f000640 1 --2- 172.21.15.122:0/1237175740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3280cdb00 0x7fc3280b49b0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fc3200097c0 tx=0x7fc32001c470 comp rx=0 tx=0).stop 2024-05-28T06:14:30.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.633+0000 7fc32f000640 1 -- 172.21.15.122:0/1237175740 shutdown_connections 2024-05-28T06:14:30.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.633+0000 7fc32f000640 1 --2- 172.21.15.122:0/1237175740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3280cdb00 0x7fc3280b49b0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:30.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.633+0000 7fc32f000640 1 --2- 172.21.15.122:0/1237175740 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3280cff30 0x7fc32806f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:30.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.633+0000 7fc32f000640 1 -- 172.21.15.122:0/1237175740 >> 172.21.15.122:0/1237175740 conn(0x7fc32806bd90 msgr2=0x7fc32806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:30.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.633+0000 7fc32f000640 1 -- 172.21.15.122:0/1237175740 shutdown_connections 2024-05-28T06:14:30.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.633+0000 7fc32f000640 1 -- 172.21.15.122:0/1237175740 wait complete. 2024-05-28T06:14:30.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.633+0000 7fc32f000640 1 Processor -- start 2024-05-28T06:14:30.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.633+0000 7fc32f000640 1 -- start start 2024-05-28T06:14:30.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc32f000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc32806f6c0 0x7fc328156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:30.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc32f000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3280cdb00 0x7fc32814b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:30.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc32f000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3280cff30 0x7fc328130ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:30.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc32f000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc3280b5700 con 0x7fc3280cdb00 2024-05-28T06:14:30.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc32f000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc32815baf0 con 0x7fc32806f6c0 2024-05-28T06:14:30.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc32f000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fc3280b5880 con 0x7fc3280cff30 2024-05-28T06:14:30.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc327400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3280cdb00 0x7fc32814b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:30.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc327e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc32806f6c0 0x7fc328156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:30.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc327e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc32806f6c0 0x7fc328156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:47892/0 (socket says 172.21.15.122:47892) 2024-05-28T06:14:30.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc327e00640 1 -- 172.21.15.122:0/2267966399 learned_addr learned my addr 172.21.15.122:0/2267966399 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:30.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc327400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3280cdb00 0x7fc32814b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52150/0 (socket says 172.21.15.122:52150) 2024-05-28T06:14:30.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc32d000640 1 --2- 172.21.15.122:0/2267966399 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3280cff30 0x7fc328130ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:30.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc327400640 1 -- 172.21.15.122:0/2267966399 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3280cff30 msgr2=0x7fc328130ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:30.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc327400640 1 --2- 172.21.15.122:0/2267966399 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3280cff30 0x7fc328130ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:30.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc327400640 1 -- 172.21.15.122:0/2267966399 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc32806f6c0 msgr2=0x7fc328156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:30.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc327400640 1 --2- 172.21.15.122:0/2267966399 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc32806f6c0 0x7fc328156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:30.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc327400640 1 -- 172.21.15.122:0/2267966399 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc32814bdf0 con 0x7fc3280cdb00 2024-05-28T06:14:30.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc327400640 1 --2- 172.21.15.122:0/2267966399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3280cdb00 0x7fc32814b680 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fc31400c430 tx=0x7fc31400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:30.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc31fe00640 1 -- 172.21.15.122:0/2267966399 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc314017070 con 0x7fc3280cdb00 2024-05-28T06:14:30.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc31fe00640 1 -- 172.21.15.122:0/2267966399 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc314005cf0 con 0x7fc3280cdb00 2024-05-28T06:14:30.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc31fe00640 1 -- 172.21.15.122:0/2267966399 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc314007310 con 0x7fc3280cdb00 2024-05-28T06:14:30.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc32f000640 1 -- 172.21.15.122:0/2267966399 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc32814c0d0 con 0x7fc3280cdb00 2024-05-28T06:14:30.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc32f000640 1 -- 172.21.15.122:0/2267966399 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc32812eb70 con 0x7fc3280cdb00 2024-05-28T06:14:30.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc32f000640 1 -- 172.21.15.122:0/2267966399 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc328068c40 con 0x7fc3280cdb00 2024-05-28T06:14:30.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.637+0000 7fc31fe00640 1 -- 172.21.15.122:0/2267966399 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 23) ==== 89109+0+0 (secure 0 0 0) 0x7fc31401a070 con 0x7fc3280cdb00 2024-05-28T06:14:30.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.641+0000 7fc31fe00640 1 --2- 172.21.15.122:0/2267966399 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc308068fe0 0x7fc30806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:30.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.641+0000 7fc31fe00640 1 -- 172.21.15.122:0/2267966399 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7fc3140849c0 con 0x7fc3280cdb00 2024-05-28T06:14:30.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.641+0000 7fc327e00640 1 --2- 172.21.15.122:0/2267966399 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc308068fe0 0x7fc30806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:30.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.641+0000 7fc327e00640 1 --2- 172.21.15.122:0/2267966399 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc308068fe0 0x7fc30806b4a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc318003b90 tx=0x7fc3180098d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:30.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.645+0000 7fc31fe00640 1 -- 172.21.15.122:0/2267966399 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc3140561c0 con 0x7fc3280cdb00 2024-05-28T06:14:30.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.801+0000 7fc32f000640 1 -- 172.21.15.122:0/2267966399 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc32814c5f0 con 0x7fc308068fe0 2024-05-28T06:14:30.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.809+0000 7fc31fe00640 1 -- 172.21.15.122:0/2267966399 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254112 (secure 0 0 0) 0x7fc318004760 con 0x7fc308068fe0 2024-05-28T06:14:30.811 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:14:30.813 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-05-28T06:14:30.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.813+0000 7fc32f000640 1 -- 172.21.15.122:0/2267966399 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc308068fe0 msgr2=0x7fc30806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:30.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.813+0000 7fc32f000640 1 --2- 172.21.15.122:0/2267966399 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc308068fe0 0x7fc30806b4a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc318003b90 tx=0x7fc3180098d0 comp rx=0 tx=0).stop 2024-05-28T06:14:30.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.813+0000 7fc32f000640 1 -- 172.21.15.122:0/2267966399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3280cdb00 msgr2=0x7fc32814b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:30.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.813+0000 7fc32f000640 1 --2- 172.21.15.122:0/2267966399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3280cdb00 0x7fc32814b680 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fc31400c430 tx=0x7fc31400c8f0 comp rx=0 tx=0).stop 2024-05-28T06:14:30.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.813+0000 7fc32f000640 1 -- 172.21.15.122:0/2267966399 shutdown_connections 2024-05-28T06:14:30.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.813+0000 7fc32f000640 1 --2- 172.21.15.122:0/2267966399 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fc308068fe0 0x7fc30806b4a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:30.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.813+0000 7fc32f000640 1 --2- 172.21.15.122:0/2267966399 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3280cff30 0x7fc328130ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:30.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.813+0000 7fc32f000640 1 --2- 172.21.15.122:0/2267966399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3280cdb00 0x7fc32814b680 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:30.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.813+0000 7fc32f000640 1 --2- 172.21.15.122:0/2267966399 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc32806f6c0 0x7fc328156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:30.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.813+0000 7fc32f000640 1 -- 172.21.15.122:0/2267966399 >> 172.21.15.122:0/2267966399 conn(0x7fc32806bd90 msgr2=0x7fc32815cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:30.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.813+0000 7fc32f000640 1 -- 172.21.15.122:0/2267966399 shutdown_connections 2024-05-28T06:14:30.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:30.813+0000 7fc32f000640 1 -- 172.21.15.122:0/2267966399 wait complete. 2024-05-28T06:14:30.832 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2024-05-28T06:14:29.388873+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":20428523694,"num_objects":4905,"num_object_clones":1,"num_object_copies":9810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4905,"num_whiteouts":1,"num_read":4316,"num_read_kb":16875700,"num_write":5712,"num_write_kb":19951851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5624,"ondisk_log_size":5624,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":40315856,"kb_used_data":39905424,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":714658864,"statfs":{"total":773094113280,"available":731810676736,"internally_reserved":0,"allocated":40863154176,"data_stored":40859567620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":420204081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002569"},"pg_stats":[{"pgid":"9.3f","version":"62'66","reported_seq":152,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.097052+0000","last_change":"2024-05-28T06:12:31.797507+0000","last_active":"2024-05-28T06:13:37.097052+0000","last_peered":"2024-05-28T06:13:37.097052+0000","last_clean":"2024-05-28T06:13:37.097052+0000","last_became_active":"2024-05-28T06:12:31.793751+0000","last_became_peered":"2024-05-28T06:12:31.793751+0000","last_unstale":"2024-05-28T06:13:37.097052+0000","last_undegraded":"2024-05-28T06:13:37.097052+0000","last_fullsized":"2024-05-28T06:13:37.097052+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:49:14.729612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":74,"num_read_kb":303104,"num_write":66,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"62'79","reported_seq":163,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.161320+0000","last_change":"2024-05-28T06:12:31.799024+0000","last_active":"2024-05-28T06:13:37.161320+0000","last_peered":"2024-05-28T06:13:37.161320+0000","last_clean":"2024-05-28T06:13:37.161320+0000","last_became_active":"2024-05-28T06:12:31.798788+0000","last_became_peered":"2024-05-28T06:12:31.798788+0000","last_unstale":"2024-05-28T06:13:37.161320+0000","last_undegraded":"2024-05-28T06:13:37.161320+0000","last_fullsized":"2024-05-28T06:13:37.161320+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:59:06.307827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":72,"num_read_kb":294912,"num_write":79,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"62'75","reported_seq":155,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.965534+0000","last_change":"2024-05-28T06:12:31.802734+0000","last_active":"2024-05-28T06:13:36.965534+0000","last_peered":"2024-05-28T06:13:36.965534+0000","last_clean":"2024-05-28T06:13:36.965534+0000","last_became_active":"2024-05-28T06:12:31.802019+0000","last_became_peered":"2024-05-28T06:12:31.802019+0000","last_unstale":"2024-05-28T06:13:36.965534+0000","last_undegraded":"2024-05-28T06:13:36.965534+0000","last_fullsized":"2024-05-28T06:13:36.965534+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:55:16.457872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":68,"num_read_kb":270338,"num_write":75,"num_write_kb":282627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"62'77","reported_seq":133,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.236029+0000","last_change":"2024-05-28T06:12:31.802404+0000","last_active":"2024-05-28T06:13:37.236029+0000","last_peered":"2024-05-28T06:13:37.236029+0000","last_clean":"2024-05-28T06:13:37.236029+0000","last_became_active":"2024-05-28T06:12:31.801804+0000","last_became_peered":"2024-05-28T06:12:31.801804+0000","last_unstale":"2024-05-28T06:13:37.236029+0000","last_undegraded":"2024-05-28T06:13:37.236029+0000","last_fullsized":"2024-05-28T06:13:37.236029+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:08:26.147408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322961408,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":44,"num_read_kb":180224,"num_write":77,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"62'58","reported_seq":110,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.912606+0000","last_change":"2024-05-28T06:12:31.798616+0000","last_active":"2024-05-28T06:13:36.912606+0000","last_peered":"2024-05-28T06:13:36.912606+0000","last_clean":"2024-05-28T06:13:36.912606+0000","last_became_active":"2024-05-28T06:12:31.798238+0000","last_became_peered":"2024-05-28T06:12:31.798238+0000","last_unstale":"2024-05-28T06:13:36.912606+0000","last_undegraded":"2024-05-28T06:13:36.912606+0000","last_fullsized":"2024-05-28T06:13:36.912606+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T18:11:53.921729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":40,"num_read_kb":163840,"num_write":58,"num_write_kb":237568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"62'88","reported_seq":191,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:38.925842+0000","last_change":"2024-05-28T06:12:31.791032+0000","last_active":"2024-05-28T06:13:38.925842+0000","last_peered":"2024-05-28T06:13:38.925842+0000","last_clean":"2024-05-28T06:13:38.925842+0000","last_became_active":"2024-05-28T06:12:31.790779+0000","last_became_peered":"2024-05-28T06:12:31.790779+0000","last_unstale":"2024-05-28T06:13:38.925842+0000","last_undegraded":"2024-05-28T06:13:38.925842+0000","last_fullsized":"2024-05-28T06:13:38.925842+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:24:28.859928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352321536,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":91,"num_read_kb":364546,"num_write":88,"num_write_kb":344066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"62'63","reported_seq":123,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.740575+0000","last_change":"2024-05-28T06:12:31.786902+0000","last_active":"2024-05-28T06:13:36.740575+0000","last_peered":"2024-05-28T06:13:36.740575+0000","last_clean":"2024-05-28T06:13:36.740575+0000","last_became_active":"2024-05-28T06:12:31.786592+0000","last_became_peered":"2024-05-28T06:12:31.786592+0000","last_unstale":"2024-05-28T06:13:36.740575+0000","last_undegraded":"2024-05-28T06:13:36.740575+0000","last_fullsized":"2024-05-28T06:13:36.740575+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:13:29.656977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":48,"num_read_kb":196608,"num_write":63,"num_write_kb":258048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"62'75","reported_seq":138,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.435924+0000","last_change":"2024-05-28T06:12:31.788445+0000","last_active":"2024-05-28T06:13:37.435924+0000","last_peered":"2024-05-28T06:13:37.435924+0000","last_clean":"2024-05-28T06:13:37.435924+0000","last_became_active":"2024-05-28T06:12:31.788168+0000","last_became_peered":"2024-05-28T06:12:31.788168+0000","last_unstale":"2024-05-28T06:13:37.435924+0000","last_undegraded":"2024-05-28T06:13:37.435924+0000","last_fullsized":"2024-05-28T06:13:37.435924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:04:14.908029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":51,"num_read_kb":208896,"num_write":75,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"62'83","reported_seq":150,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:39.926708+0000","last_change":"2024-05-28T06:12:31.783886+0000","last_active":"2024-05-28T06:13:39.926708+0000","last_peered":"2024-05-28T06:13:39.926708+0000","last_clean":"2024-05-28T06:13:39.926708+0000","last_became_active":"2024-05-28T06:12:31.783599+0000","last_became_peered":"2024-05-28T06:12:31.783599+0000","last_unstale":"2024-05-28T06:13:39.926708+0000","last_undegraded":"2024-05-28T06:13:39.926708+0000","last_fullsized":"2024-05-28T06:13:39.926708+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:42:44.413357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":55,"num_read_kb":221185,"num_write":82,"num_write_kb":327681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"62'62","reported_seq":137,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.029161+0000","last_change":"2024-05-28T06:12:31.797210+0000","last_active":"2024-05-28T06:13:37.029161+0000","last_peered":"2024-05-28T06:13:37.029161+0000","last_clean":"2024-05-28T06:13:37.029161+0000","last_became_active":"2024-05-28T06:12:31.793687+0000","last_became_peered":"2024-05-28T06:12:31.793687+0000","last_unstale":"2024-05-28T06:13:37.029161+0000","last_undegraded":"2024-05-28T06:13:37.029161+0000","last_fullsized":"2024-05-28T06:13:37.029161+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:58:28.495952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":63,"num_read_kb":258048,"num_write":62,"num_write_kb":253952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"62'91","reported_seq":204,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.050023+0000","last_change":"2024-05-28T06:12:31.789629+0000","last_active":"2024-05-28T06:13:37.050023+0000","last_peered":"2024-05-28T06:13:37.050023+0000","last_clean":"2024-05-28T06:13:37.050023+0000","last_became_active":"2024-05-28T06:12:31.789337+0000","last_became_peered":"2024-05-28T06:12:31.789337+0000","last_unstale":"2024-05-28T06:13:37.050023+0000","last_undegraded":"2024-05-28T06:13:37.050023+0000","last_fullsized":"2024-05-28T06:13:37.050023+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:11:11.445809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381681664,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":101,"num_read_kb":413696,"num_write":91,"num_write_kb":372736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"62'76","reported_seq":187,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.477161+0000","last_change":"2024-05-28T06:12:31.796464+0000","last_active":"2024-05-28T06:13:37.477161+0000","last_peered":"2024-05-28T06:13:37.477161+0000","last_clean":"2024-05-28T06:13:37.477161+0000","last_became_active":"2024-05-28T06:12:31.796167+0000","last_became_peered":"2024-05-28T06:12:31.796167+0000","last_unstale":"2024-05-28T06:13:37.477161+0000","last_undegraded":"2024-05-28T06:13:37.477161+0000","last_fullsized":"2024-05-28T06:13:37.477161+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:53:57.139243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":99,"num_read_kb":389124,"num_write":76,"num_write_kb":303105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"62'82","reported_seq":177,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.303156+0000","last_change":"2024-05-28T06:12:31.799523+0000","last_active":"2024-05-28T06:13:37.303156+0000","last_peered":"2024-05-28T06:13:37.303156+0000","last_clean":"2024-05-28T06:13:37.303156+0000","last_became_active":"2024-05-28T06:12:31.799169+0000","last_became_peered":"2024-05-28T06:12:31.799169+0000","last_unstale":"2024-05-28T06:13:37.303156+0000","last_undegraded":"2024-05-28T06:13:37.303156+0000","last_fullsized":"2024-05-28T06:13:37.303156+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:24:13.601910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343932928,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":83,"num_read_kb":339968,"num_write":82,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"62'87","reported_seq":163,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.516157+0000","last_change":"2024-05-28T06:12:31.790257+0000","last_active":"2024-05-28T06:13:37.516157+0000","last_peered":"2024-05-28T06:13:37.516157+0000","last_clean":"2024-05-28T06:13:37.516157+0000","last_became_active":"2024-05-28T06:12:31.789907+0000","last_became_peered":"2024-05-28T06:12:31.789907+0000","last_unstale":"2024-05-28T06:13:37.516157+0000","last_undegraded":"2024-05-28T06:13:37.516157+0000","last_fullsized":"2024-05-28T06:13:37.516157+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:22:57.588310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364904448,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":64,"num_read_kb":262144,"num_write":87,"num_write_kb":356352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"62'63","reported_seq":106,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.034266+0000","last_change":"2024-05-28T06:12:31.788326+0000","last_active":"2024-05-28T06:13:36.034266+0000","last_peered":"2024-05-28T06:13:36.034266+0000","last_clean":"2024-05-28T06:13:36.034266+0000","last_became_active":"2024-05-28T06:12:31.788073+0000","last_became_peered":"2024-05-28T06:12:31.788073+0000","last_unstale":"2024-05-28T06:13:36.034266+0000","last_undegraded":"2024-05-28T06:13:36.034266+0000","last_fullsized":"2024-05-28T06:13:36.034266+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:39:57.840865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":31,"num_read_kb":126976,"num_write":63,"num_write_kb":258048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"62'64","reported_seq":130,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.162230+0000","last_change":"2024-05-28T06:12:31.802252+0000","last_active":"2024-05-28T06:13:37.162230+0000","last_peered":"2024-05-28T06:13:37.162230+0000","last_clean":"2024-05-28T06:13:37.162230+0000","last_became_active":"2024-05-28T06:12:31.800507+0000","last_became_peered":"2024-05-28T06:12:31.800507+0000","last_unstale":"2024-05-28T06:13:37.162230+0000","last_undegraded":"2024-05-28T06:13:37.162230+0000","last_fullsized":"2024-05-28T06:13:37.162230+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:27:01.826955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":54,"num_read_kb":221184,"num_write":64,"num_write_kb":262144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"62'67","reported_seq":121,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.761745+0000","last_change":"2024-05-28T06:12:31.798684+0000","last_active":"2024-05-28T06:13:36.761745+0000","last_peered":"2024-05-28T06:13:36.761745+0000","last_clean":"2024-05-28T06:13:36.761745+0000","last_became_active":"2024-05-28T06:12:31.798292+0000","last_became_peered":"2024-05-28T06:12:31.798292+0000","last_unstale":"2024-05-28T06:13:36.761745+0000","last_undegraded":"2024-05-28T06:13:36.761745+0000","last_fullsized":"2024-05-28T06:13:36.761745+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:52:20.582079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":42,"num_read_kb":172032,"num_write":67,"num_write_kb":266241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"62'85","reported_seq":191,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.360362+0000","last_change":"2024-05-28T06:12:31.805307+0000","last_active":"2024-05-28T06:13:37.360362+0000","last_peered":"2024-05-28T06:13:37.360362+0000","last_clean":"2024-05-28T06:13:37.360362+0000","last_became_active":"2024-05-28T06:12:31.805031+0000","last_became_peered":"2024-05-28T06:12:31.805031+0000","last_unstale":"2024-05-28T06:13:37.360362+0000","last_undegraded":"2024-05-28T06:13:37.360362+0000","last_fullsized":"2024-05-28T06:13:37.360362+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:54:23.878943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544581,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":94,"num_read_kb":372739,"num_write":85,"num_write_kb":327683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"62'90","reported_seq":169,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.608022+0000","last_change":"2024-05-28T06:12:31.792875+0000","last_active":"2024-05-28T06:13:37.608022+0000","last_peered":"2024-05-28T06:13:37.608022+0000","last_clean":"2024-05-28T06:13:37.608022+0000","last_became_active":"2024-05-28T06:12:31.792620+0000","last_became_peered":"2024-05-28T06:12:31.792620+0000","last_unstale":"2024-05-28T06:13:37.608022+0000","last_undegraded":"2024-05-28T06:13:37.608022+0000","last_fullsized":"2024-05-28T06:13:37.608022+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:22:45.579115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369098752,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":67,"num_read_kb":274432,"num_write":90,"num_write_kb":360449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"62'72","reported_seq":146,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.372054+0000","last_change":"2024-05-28T06:12:31.790299+0000","last_active":"2024-05-28T06:13:37.372054+0000","last_peered":"2024-05-28T06:13:37.372054+0000","last_clean":"2024-05-28T06:13:37.372054+0000","last_became_active":"2024-05-28T06:12:31.790044+0000","last_became_peered":"2024-05-28T06:12:31.790044+0000","last_unstale":"2024-05-28T06:13:37.372054+0000","last_undegraded":"2024-05-28T06:13:37.372054+0000","last_fullsized":"2024-05-28T06:13:37.372054+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:33:57.828699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":62,"num_read_kb":253952,"num_write":71,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"62'82","reported_seq":189,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.612855+0000","last_change":"2024-05-28T06:12:31.799285+0000","last_active":"2024-05-28T06:13:37.612855+0000","last_peered":"2024-05-28T06:13:37.612855+0000","last_clean":"2024-05-28T06:13:37.612855+0000","last_became_active":"2024-05-28T06:12:31.798652+0000","last_became_peered":"2024-05-28T06:12:31.798652+0000","last_unstale":"2024-05-28T06:13:37.612855+0000","last_undegraded":"2024-05-28T06:13:37.612855+0000","last_fullsized":"2024-05-28T06:13:37.612855+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:27:01.826955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327155712,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":95,"num_read_kb":376835,"num_write":82,"num_write_kb":319490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"62'78","reported_seq":151,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.490749+0000","last_change":"2024-05-28T06:12:31.802895+0000","last_active":"2024-05-28T06:13:37.490749+0000","last_peered":"2024-05-28T06:13:37.490749+0000","last_clean":"2024-05-28T06:13:37.490749+0000","last_became_active":"2024-05-28T06:12:31.795520+0000","last_became_peered":"2024-05-28T06:12:31.795520+0000","last_unstale":"2024-05-28T06:13:37.490749+0000","last_undegraded":"2024-05-28T06:13:37.490749+0000","last_fullsized":"2024-05-28T06:13:37.490749+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:06:30.752272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":61,"num_read_kb":241666,"num_write":77,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"62'83","reported_seq":152,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.174936+0000","last_change":"2024-05-28T06:12:31.806502+0000","last_active":"2024-05-28T06:13:37.174936+0000","last_peered":"2024-05-28T06:13:37.174936+0000","last_clean":"2024-05-28T06:13:37.174936+0000","last_became_active":"2024-05-28T06:12:31.805993+0000","last_became_peered":"2024-05-28T06:12:31.805993+0000","last_unstale":"2024-05-28T06:13:37.174936+0000","last_undegraded":"2024-05-28T06:13:37.174936+0000","last_fullsized":"2024-05-28T06:13:37.174936+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:43:33.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":348127232,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":57,"num_read_kb":233472,"num_write":83,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"62'79","reported_seq":147,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.284280+0000","last_change":"2024-05-28T06:12:31.801483+0000","last_active":"2024-05-28T06:13:37.284280+0000","last_peered":"2024-05-28T06:13:37.284280+0000","last_clean":"2024-05-28T06:13:37.284280+0000","last_became_active":"2024-05-28T06:12:31.801026+0000","last_became_peered":"2024-05-28T06:12:31.801026+0000","last_unstale":"2024-05-28T06:13:37.284280+0000","last_undegraded":"2024-05-28T06:13:37.284280+0000","last_fullsized":"2024-05-28T06:13:37.284280+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:09:57.797411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":56,"num_read_kb":229376,"num_write":79,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"62'79","reported_seq":159,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.558623+0000","last_change":"2024-05-28T06:12:31.798043+0000","last_active":"2024-05-28T06:13:37.558623+0000","last_peered":"2024-05-28T06:13:37.558623+0000","last_clean":"2024-05-28T06:13:37.558623+0000","last_became_active":"2024-05-28T06:12:31.794016+0000","last_became_peered":"2024-05-28T06:12:31.794016+0000","last_unstale":"2024-05-28T06:13:37.558623+0000","last_undegraded":"2024-05-28T06:13:37.558623+0000","last_fullsized":"2024-05-28T06:13:37.558623+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:35:46.267952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":68,"num_read_kb":266243,"num_write":79,"num_write_kb":307202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"62'66","reported_seq":144,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.394733+0000","last_change":"2024-05-28T06:12:31.788822+0000","last_active":"2024-05-28T06:13:37.394733+0000","last_peered":"2024-05-28T06:13:37.394733+0000","last_clean":"2024-05-28T06:13:37.394733+0000","last_became_active":"2024-05-28T06:12:31.788550+0000","last_became_peered":"2024-05-28T06:12:31.788550+0000","last_unstale":"2024-05-28T06:13:37.394733+0000","last_undegraded":"2024-05-28T06:13:37.394733+0000","last_fullsized":"2024-05-28T06:13:37.394733+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:55:16.457872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":66,"num_read_kb":270336,"num_write":65,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"62'82","reported_seq":160,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.317767+0000","last_change":"2024-05-28T06:12:31.793103+0000","last_active":"2024-05-28T06:13:37.317767+0000","last_peered":"2024-05-28T06:13:37.317767+0000","last_clean":"2024-05-28T06:13:37.317767+0000","last_became_active":"2024-05-28T06:12:31.792595+0000","last_became_peered":"2024-05-28T06:12:31.792595+0000","last_unstale":"2024-05-28T06:13:37.317767+0000","last_undegraded":"2024-05-28T06:13:37.317767+0000","last_fullsized":"2024-05-28T06:13:37.317767+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:30:32.490570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343932928,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":66,"num_read_kb":270336,"num_write":82,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"62'82","reported_seq":128,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.630699+0000","last_change":"2024-05-28T06:12:31.800295+0000","last_active":"2024-05-28T06:13:37.630699+0000","last_peered":"2024-05-28T06:13:37.630699+0000","last_clean":"2024-05-28T06:13:37.630699+0000","last_became_active":"2024-05-28T06:12:31.800042+0000","last_became_peered":"2024-05-28T06:12:31.800042+0000","last_unstale":"2024-05-28T06:13:37.630699+0000","last_undegraded":"2024-05-28T06:13:37.630699+0000","last_fullsized":"2024-05-28T06:13:37.630699+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:30:39.340469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327155712,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":34,"num_read_kb":131074,"num_write":82,"num_write_kb":319490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"62'85","reported_seq":168,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.421829+0000","last_change":"2024-05-28T06:12:31.798980+0000","last_active":"2024-05-28T06:13:37.421829+0000","last_peered":"2024-05-28T06:13:37.421829+0000","last_clean":"2024-05-28T06:13:37.421829+0000","last_became_active":"2024-05-28T06:12:31.798695+0000","last_became_peered":"2024-05-28T06:12:31.798695+0000","last_unstale":"2024-05-28T06:13:37.421829+0000","last_undegraded":"2024-05-28T06:13:37.421829+0000","last_fullsized":"2024-05-28T06:13:37.421829+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:40:22.486569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352321668,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":71,"num_read_kb":286721,"num_write":85,"num_write_kb":344065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"62'77","reported_seq":154,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.316493+0000","last_change":"2024-05-28T06:12:31.803916+0000","last_active":"2024-05-28T06:13:37.316493+0000","last_peered":"2024-05-28T06:13:37.316493+0000","last_clean":"2024-05-28T06:13:37.316493+0000","last_became_active":"2024-05-28T06:12:31.803396+0000","last_became_peered":"2024-05-28T06:12:31.803396+0000","last_unstale":"2024-05-28T06:13:37.316493+0000","last_undegraded":"2024-05-28T06:13:37.316493+0000","last_fullsized":"2024-05-28T06:13:37.316493+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:59:14.477995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322961408,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":65,"num_read_kb":266240,"num_write":77,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"62'69","reported_seq":175,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.352635+0000","last_change":"2024-05-28T06:12:31.797444+0000","last_active":"2024-05-28T06:13:37.352635+0000","last_peered":"2024-05-28T06:13:37.352635+0000","last_clean":"2024-05-28T06:13:37.352635+0000","last_became_active":"2024-05-28T06:12:31.797170+0000","last_became_peered":"2024-05-28T06:12:31.797170+0000","last_unstale":"2024-05-28T06:13:37.352635+0000","last_undegraded":"2024-05-28T06:13:37.352635+0000","last_fullsized":"2024-05-28T06:13:37.352635+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:48:34.278938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":94,"num_read_kb":385024,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"62'71","reported_seq":154,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.532423+0000","last_change":"2024-05-28T06:12:31.787961+0000","last_active":"2024-05-28T06:13:36.532423+0000","last_peered":"2024-05-28T06:13:36.532423+0000","last_clean":"2024-05-28T06:13:36.532423+0000","last_became_active":"2024-05-28T06:12:31.787700+0000","last_became_peered":"2024-05-28T06:12:31.787700+0000","last_unstale":"2024-05-28T06:13:36.532423+0000","last_undegraded":"2024-05-28T06:13:36.532423+0000","last_fullsized":"2024-05-28T06:13:36.532423+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:43:33.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":71,"num_read_kb":290816,"num_write":71,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"62'67","reported_seq":121,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.317857+0000","last_change":"2024-05-28T06:12:31.802935+0000","last_active":"2024-05-28T06:13:37.317857+0000","last_peered":"2024-05-28T06:13:37.317857+0000","last_clean":"2024-05-28T06:13:37.317857+0000","last_became_active":"2024-05-28T06:12:31.802678+0000","last_became_peered":"2024-05-28T06:12:31.802678+0000","last_unstale":"2024-05-28T06:13:37.317857+0000","last_undegraded":"2024-05-28T06:13:37.317857+0000","last_fullsized":"2024-05-28T06:13:37.317857+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:08:26.147408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":42,"num_read_kb":172032,"num_write":67,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.799783+0000","last_change":"2024-05-28T06:12:30.791032+0000","last_active":"2024-05-28T06:12:32.799783+0000","last_peered":"2024-05-28T06:12:32.799783+0000","last_clean":"2024-05-28T06:12:32.799783+0000","last_became_active":"2024-05-28T06:12:30.790720+0000","last_became_peered":"2024-05-28T06:12:30.790720+0000","last_unstale":"2024-05-28T06:12:32.799783+0000","last_undegraded":"2024-05-28T06:12:32.799783+0000","last_fullsized":"2024-05-28T06:12:32.799783+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:02:31.893460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"62'75","reported_seq":156,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.146636+0000","last_change":"2024-05-28T06:12:31.801501+0000","last_active":"2024-05-28T06:13:37.146636+0000","last_peered":"2024-05-28T06:13:37.146636+0000","last_clean":"2024-05-28T06:13:37.146636+0000","last_became_active":"2024-05-28T06:12:31.801239+0000","last_became_peered":"2024-05-28T06:12:31.801239+0000","last_unstale":"2024-05-28T06:13:37.146636+0000","last_undegraded":"2024-05-28T06:13:37.146636+0000","last_fullsized":"2024-05-28T06:13:37.146636+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:12:32.364138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301990149,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":69,"num_read_kb":278529,"num_write":75,"num_write_kb":294914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.780843+0000","last_change":"2024-05-28T06:12:30.799690+0000","last_active":"2024-05-28T06:12:32.780843+0000","last_peered":"2024-05-28T06:12:32.780843+0000","last_clean":"2024-05-28T06:12:32.780843+0000","last_became_active":"2024-05-28T06:12:30.799345+0000","last_became_peered":"2024-05-28T06:12:30.799345+0000","last_unstale":"2024-05-28T06:12:32.780843+0000","last_undegraded":"2024-05-28T06:12:32.780843+0000","last_fullsized":"2024-05-28T06:12:32.780843+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:53:56.132162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"62'73","reported_seq":159,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.030308+0000","last_change":"2024-05-28T06:12:31.787304+0000","last_active":"2024-05-28T06:13:37.030308+0000","last_peered":"2024-05-28T06:13:37.030308+0000","last_clean":"2024-05-28T06:13:37.030308+0000","last_became_active":"2024-05-28T06:12:31.786982+0000","last_became_peered":"2024-05-28T06:12:31.786982+0000","last_unstale":"2024-05-28T06:13:37.030308+0000","last_undegraded":"2024-05-28T06:13:37.030308+0000","last_fullsized":"2024-05-28T06:13:37.030308+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:30:34.090290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":74,"num_read_kb":286724,"num_write":73,"num_write_kb":282626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"62'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.799729+0000","last_change":"2024-05-28T06:12:30.784064+0000","last_active":"2024-05-28T06:12:32.799729+0000","last_peered":"2024-05-28T06:12:32.799729+0000","last_clean":"2024-05-28T06:12:32.799729+0000","last_became_active":"2024-05-28T06:12:30.783801+0000","last_became_peered":"2024-05-28T06:12:30.783801+0000","last_unstale":"2024-05-28T06:12:32.799729+0000","last_undegraded":"2024-05-28T06:12:32.799729+0000","last_fullsized":"2024-05-28T06:12:32.799729+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:21:00.162134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"62'85","reported_seq":183,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.591565+0000","last_change":"2024-05-28T06:12:31.799781+0000","last_active":"2024-05-28T06:13:36.591565+0000","last_peered":"2024-05-28T06:13:36.591565+0000","last_clean":"2024-05-28T06:13:36.591565+0000","last_became_active":"2024-05-28T06:12:31.799517+0000","last_became_peered":"2024-05-28T06:12:31.799517+0000","last_unstale":"2024-05-28T06:13:36.591565+0000","last_undegraded":"2024-05-28T06:13:36.591565+0000","last_fullsized":"2024-05-28T06:13:36.591565+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:53:57.139243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356515840,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":86,"num_read_kb":352256,"num_write":85,"num_write_kb":348160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.782540+0000","last_change":"2024-05-28T06:12:30.795765+0000","last_active":"2024-05-28T06:12:32.782540+0000","last_peered":"2024-05-28T06:12:32.782540+0000","last_clean":"2024-05-28T06:12:32.782540+0000","last_became_active":"2024-05-28T06:12:30.795164+0000","last_became_peered":"2024-05-28T06:12:30.795164+0000","last_unstale":"2024-05-28T06:12:32.782540+0000","last_undegraded":"2024-05-28T06:12:32.782540+0000","last_fullsized":"2024-05-28T06:12:32.782540+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:20:40.469531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"62'74","reported_seq":143,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.356354+0000","last_change":"2024-05-28T06:12:31.801832+0000","last_active":"2024-05-28T06:13:37.356354+0000","last_peered":"2024-05-28T06:13:37.356354+0000","last_clean":"2024-05-28T06:13:37.356354+0000","last_became_active":"2024-05-28T06:12:31.795154+0000","last_became_peered":"2024-05-28T06:12:31.795154+0000","last_unstale":"2024-05-28T06:13:37.356354+0000","last_undegraded":"2024-05-28T06:13:37.356354+0000","last_fullsized":"2024-05-28T06:13:37.356354+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:49:40.536846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":57,"num_read_kb":233472,"num_write":74,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.560759+0000","last_change":"2024-05-28T06:12:30.793046+0000","last_active":"2024-05-28T06:12:33.560759+0000","last_peered":"2024-05-28T06:12:33.560759+0000","last_clean":"2024-05-28T06:12:33.560759+0000","last_became_active":"2024-05-28T06:12:30.792752+0000","last_became_peered":"2024-05-28T06:12:30.792752+0000","last_unstale":"2024-05-28T06:12:33.560759+0000","last_undegraded":"2024-05-28T06:12:33.560759+0000","last_fullsized":"2024-05-28T06:12:33.560759+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:03:08.736169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"62'75","reported_seq":181,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.392229+0000","last_change":"2024-05-28T06:12:31.789865+0000","last_active":"2024-05-28T06:13:37.392229+0000","last_peered":"2024-05-28T06:13:37.392229+0000","last_clean":"2024-05-28T06:13:37.392229+0000","last_became_active":"2024-05-28T06:12:31.789614+0000","last_became_peered":"2024-05-28T06:12:31.789614+0000","last_unstale":"2024-05-28T06:13:37.392229+0000","last_undegraded":"2024-05-28T06:13:37.392229+0000","last_fullsized":"2024-05-28T06:13:37.392229+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:06:00.739339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":94,"num_read_kb":385024,"num_write":75,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.798994+0000","last_change":"2024-05-28T06:12:30.790331+0000","last_active":"2024-05-28T06:12:32.798994+0000","last_peered":"2024-05-28T06:12:32.798994+0000","last_clean":"2024-05-28T06:12:32.798994+0000","last_became_active":"2024-05-28T06:12:30.790028+0000","last_became_peered":"2024-05-28T06:12:30.790028+0000","last_unstale":"2024-05-28T06:12:32.798994+0000","last_undegraded":"2024-05-28T06:12:32.798994+0000","last_fullsized":"2024-05-28T06:12:32.798994+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:01:52.086398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"62'77","reported_seq":163,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.256784+0000","last_change":"2024-05-28T06:12:31.798571+0000","last_active":"2024-05-28T06:13:37.256784+0000","last_peered":"2024-05-28T06:13:37.256784+0000","last_clean":"2024-05-28T06:13:37.256784+0000","last_became_active":"2024-05-28T06:12:31.797004+0000","last_became_peered":"2024-05-28T06:12:31.797004+0000","last_unstale":"2024-05-28T06:13:37.256784+0000","last_undegraded":"2024-05-28T06:13:37.256784+0000","last_fullsized":"2024-05-28T06:13:37.256784+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:21:06.719589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":74,"num_read_kb":294914,"num_write":77,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.781942+0000","last_change":"2024-05-28T06:12:30.792493+0000","last_active":"2024-05-28T06:12:32.781942+0000","last_peered":"2024-05-28T06:12:32.781942+0000","last_clean":"2024-05-28T06:12:32.781942+0000","last_became_active":"2024-05-28T06:12:30.791832+0000","last_became_peered":"2024-05-28T06:12:30.791832+0000","last_unstale":"2024-05-28T06:12:32.781942+0000","last_undegraded":"2024-05-28T06:12:32.781942+0000","last_fullsized":"2024-05-28T06:12:32.781942+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:02:31.893460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"62'76","reported_seq":152,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.164180+0000","last_change":"2024-05-28T06:12:31.804063+0000","last_active":"2024-05-28T06:13:37.164180+0000","last_peered":"2024-05-28T06:13:37.164180+0000","last_clean":"2024-05-28T06:13:37.164180+0000","last_became_active":"2024-05-28T06:12:31.803791+0000","last_became_peered":"2024-05-28T06:12:31.803791+0000","last_unstale":"2024-05-28T06:13:37.164180+0000","last_undegraded":"2024-05-28T06:13:37.164180+0000","last_fullsized":"2024-05-28T06:13:37.164180+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:05:13.800609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":64,"num_read_kb":253954,"num_write":76,"num_write_kb":303105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.560668+0000","last_change":"2024-05-28T06:12:30.792385+0000","last_active":"2024-05-28T06:12:33.560668+0000","last_peered":"2024-05-28T06:12:33.560668+0000","last_clean":"2024-05-28T06:12:33.560668+0000","last_became_active":"2024-05-28T06:12:30.789854+0000","last_became_peered":"2024-05-28T06:12:30.789854+0000","last_unstale":"2024-05-28T06:12:33.560668+0000","last_undegraded":"2024-05-28T06:12:33.560668+0000","last_fullsized":"2024-05-28T06:12:33.560668+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:52:08.811888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"62'64","reported_seq":112,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.060841+0000","last_change":"2024-05-28T06:12:31.791507+0000","last_active":"2024-05-28T06:13:37.060841+0000","last_peered":"2024-05-28T06:13:37.060841+0000","last_clean":"2024-05-28T06:13:37.060841+0000","last_became_active":"2024-05-28T06:12:31.788910+0000","last_became_peered":"2024-05-28T06:12:31.788910+0000","last_unstale":"2024-05-28T06:13:37.060841+0000","last_undegraded":"2024-05-28T06:13:37.060841+0000","last_fullsized":"2024-05-28T06:13:37.060841+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:33:08.387840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":36,"num_read_kb":147456,"num_write":64,"num_write_kb":262144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"62'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.561581+0000","last_change":"2024-05-28T06:12:30.796608+0000","last_active":"2024-05-28T06:12:33.561581+0000","last_peered":"2024-05-28T06:12:33.561581+0000","last_clean":"2024-05-28T06:12:33.561581+0000","last_became_active":"2024-05-28T06:12:30.796011+0000","last_became_peered":"2024-05-28T06:12:30.796011+0000","last_unstale":"2024-05-28T06:12:33.561581+0000","last_undegraded":"2024-05-28T06:12:33.561581+0000","last_fullsized":"2024-05-28T06:12:33.561581+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:03:08.736169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"62'71","reported_seq":123,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.804571+0000","last_change":"2024-05-28T06:12:31.807786+0000","last_active":"2024-05-28T06:13:36.804571+0000","last_peered":"2024-05-28T06:13:36.804571+0000","last_clean":"2024-05-28T06:13:36.804571+0000","last_became_active":"2024-05-28T06:12:31.807524+0000","last_became_peered":"2024-05-28T06:12:31.807524+0000","last_unstale":"2024-05-28T06:13:36.804571+0000","last_undegraded":"2024-05-28T06:13:36.804571+0000","last_fullsized":"2024-05-28T06:13:36.804571+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:53:57.139243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":40,"num_read_kb":163840,"num_write":71,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.780950+0000","last_change":"2024-05-28T06:12:30.798374+0000","last_active":"2024-05-28T06:12:32.780950+0000","last_peered":"2024-05-28T06:12:32.780950+0000","last_clean":"2024-05-28T06:12:32.780950+0000","last_became_active":"2024-05-28T06:12:30.798033+0000","last_became_peered":"2024-05-28T06:12:30.798033+0000","last_unstale":"2024-05-28T06:12:32.780950+0000","last_undegraded":"2024-05-28T06:12:32.780950+0000","last_fullsized":"2024-05-28T06:12:32.780950+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:30:33.083208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"62'70","reported_seq":163,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.240601+0000","last_change":"2024-05-28T06:12:31.791600+0000","last_active":"2024-05-28T06:13:37.240601+0000","last_peered":"2024-05-28T06:13:37.240601+0000","last_clean":"2024-05-28T06:13:37.240601+0000","last_became_active":"2024-05-28T06:12:31.789590+0000","last_became_peered":"2024-05-28T06:12:31.789590+0000","last_unstale":"2024-05-28T06:13:37.240601+0000","last_undegraded":"2024-05-28T06:13:37.240601+0000","last_fullsized":"2024-05-28T06:13:37.240601+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:21:06.719589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":81,"num_read_kb":331776,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"62'24","reported_seq":38,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:39.929351+0000","last_change":"2024-05-28T06:12:30.794636+0000","last_active":"2024-05-28T06:13:39.929351+0000","last_peered":"2024-05-28T06:13:39.929351+0000","last_clean":"2024-05-28T06:13:39.929351+0000","last_became_active":"2024-05-28T06:12:30.794322+0000","last_became_peered":"2024-05-28T06:12:30.794322+0000","last_unstale":"2024-05-28T06:13:39.929351+0000","last_undegraded":"2024-05-28T06:13:39.929351+0000","last_fullsized":"2024-05-28T06:13:39.929351+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:21:00.162134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"62'68","reported_seq":141,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.027341+0000","last_change":"2024-05-28T06:12:31.806694+0000","last_active":"2024-05-28T06:13:37.027341+0000","last_peered":"2024-05-28T06:13:37.027341+0000","last_clean":"2024-05-28T06:13:37.027341+0000","last_became_active":"2024-05-28T06:12:31.806339+0000","last_became_peered":"2024-05-28T06:12:31.806339+0000","last_unstale":"2024-05-28T06:13:37.027341+0000","last_undegraded":"2024-05-28T06:13:37.027341+0000","last_fullsized":"2024-05-28T06:13:37.027341+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:30:32.490570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":61,"num_read_kb":245761,"num_write":67,"num_write_kb":266241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"62'423","reported_seq":437,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:55.891712+0000","last_change":"2024-05-28T06:12:30.791461+0000","last_active":"2024-05-28T06:13:55.891712+0000","last_peered":"2024-05-28T06:13:55.891712+0000","last_clean":"2024-05-28T06:13:55.891712+0000","last_became_active":"2024-05-28T06:12:30.791190+0000","last_became_peered":"2024-05-28T06:12:30.791190+0000","last_unstale":"2024-05-28T06:13:55.891712+0000","last_undegraded":"2024-05-28T06:13:55.891712+0000","last_fullsized":"2024-05-28T06:13:55.891712+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:01:52.086398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1666114,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":422,"num_write_kb":1782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"62'75","reported_seq":136,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.086390+0000","last_change":"2024-05-28T06:12:31.796224+0000","last_active":"2024-05-28T06:13:37.086390+0000","last_peered":"2024-05-28T06:13:37.086390+0000","last_clean":"2024-05-28T06:13:37.086390+0000","last_became_active":"2024-05-28T06:12:31.794242+0000","last_became_peered":"2024-05-28T06:12:31.794242+0000","last_unstale":"2024-05-28T06:13:37.086390+0000","last_undegraded":"2024-05-28T06:13:37.086390+0000","last_fullsized":"2024-05-28T06:13:37.086390+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:21:56.535399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":49,"num_read_kb":200704,"num_write":75,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.780490+0000","last_change":"2024-05-28T06:12:30.794765+0000","last_active":"2024-05-28T06:12:32.780490+0000","last_peered":"2024-05-28T06:12:32.780490+0000","last_clean":"2024-05-28T06:12:32.780490+0000","last_became_active":"2024-05-28T06:12:30.794488+0000","last_became_peered":"2024-05-28T06:12:30.794488+0000","last_unstale":"2024-05-28T06:12:32.780490+0000","last_undegraded":"2024-05-28T06:12:32.780490+0000","last_fullsized":"2024-05-28T06:12:32.780490+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:30:31.483489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"62'92","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.393713+0000","last_change":"2024-05-28T06:12:31.803083+0000","last_active":"2024-05-28T06:13:37.393713+0000","last_peered":"2024-05-28T06:13:37.393713+0000","last_clean":"2024-05-28T06:13:37.393713+0000","last_became_active":"2024-05-28T06:12:31.802789+0000","last_became_peered":"2024-05-28T06:12:31.802789+0000","last_unstale":"2024-05-28T06:13:37.393713+0000","last_undegraded":"2024-05-28T06:13:37.393713+0000","last_fullsized":"2024-05-28T06:13:37.393713+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:24:28.859928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369098752,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":53,"num_read_kb":212993,"num_write":92,"num_write_kb":360450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.800554+0000","last_change":"2024-05-28T06:12:30.795959+0000","last_active":"2024-05-28T06:12:32.800554+0000","last_peered":"2024-05-28T06:12:32.800554+0000","last_clean":"2024-05-28T06:12:32.800554+0000","last_became_active":"2024-05-28T06:12:30.795666+0000","last_became_peered":"2024-05-28T06:12:30.795666+0000","last_unstale":"2024-05-28T06:12:32.800554+0000","last_undegraded":"2024-05-28T06:12:32.800554+0000","last_fullsized":"2024-05-28T06:12:32.800554+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:52:42.932309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"62'63","reported_seq":133,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.235936+0000","last_change":"2024-05-28T06:12:31.795558+0000","last_active":"2024-05-28T06:13:37.235936+0000","last_peered":"2024-05-28T06:13:37.235936+0000","last_clean":"2024-05-28T06:13:37.235936+0000","last_became_active":"2024-05-28T06:12:31.795281+0000","last_became_peered":"2024-05-28T06:12:31.795281+0000","last_unstale":"2024-05-28T06:13:37.235936+0000","last_undegraded":"2024-05-28T06:13:37.235936+0000","last_fullsized":"2024-05-28T06:13:37.235936+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:54:31.487426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":58,"num_read_kb":237568,"num_write":63,"num_write_kb":258048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.782127+0000","last_change":"2024-05-28T06:12:30.792703+0000","last_active":"2024-05-28T06:12:32.782127+0000","last_peered":"2024-05-28T06:12:32.782127+0000","last_clean":"2024-05-28T06:12:32.782127+0000","last_became_active":"2024-05-28T06:12:30.792218+0000","last_became_peered":"2024-05-28T06:12:30.792218+0000","last_unstale":"2024-05-28T06:12:32.782127+0000","last_undegraded":"2024-05-28T06:12:32.782127+0000","last_fullsized":"2024-05-28T06:12:32.782127+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:14:39.566092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"62'95","reported_seq":176,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.404448+0000","last_change":"2024-05-28T06:12:31.806242+0000","last_active":"2024-05-28T06:13:37.404448+0000","last_peered":"2024-05-28T06:13:37.404448+0000","last_clean":"2024-05-28T06:13:37.404448+0000","last_became_active":"2024-05-28T06:12:31.805628+0000","last_became_peered":"2024-05-28T06:12:31.805628+0000","last_unstale":"2024-05-28T06:13:37.404448+0000","last_undegraded":"2024-05-28T06:13:37.404448+0000","last_fullsized":"2024-05-28T06:13:37.404448+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:21:56.535399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394264837,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":69,"num_read_kb":282624,"num_write":95,"num_write_kb":385025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.560455+0000","last_change":"2024-05-28T06:12:30.797372+0000","last_active":"2024-05-28T06:12:33.560455+0000","last_peered":"2024-05-28T06:12:33.560455+0000","last_clean":"2024-05-28T06:12:33.560455+0000","last_became_active":"2024-05-28T06:12:30.797105+0000","last_became_peered":"2024-05-28T06:12:30.797105+0000","last_unstale":"2024-05-28T06:12:33.560455+0000","last_undegraded":"2024-05-28T06:12:33.560455+0000","last_fullsized":"2024-05-28T06:12:33.560455+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:01:52.086398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"62'67","reported_seq":104,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.315357+0000","last_change":"2024-05-28T06:12:31.802256+0000","last_active":"2024-05-28T06:13:37.315357+0000","last_peered":"2024-05-28T06:13:37.315357+0000","last_clean":"2024-05-28T06:13:37.315357+0000","last_became_active":"2024-05-28T06:12:31.800610+0000","last_became_peered":"2024-05-28T06:12:31.800610+0000","last_unstale":"2024-05-28T06:13:37.315357+0000","last_undegraded":"2024-05-28T06:13:37.315357+0000","last_fullsized":"2024-05-28T06:13:37.315357+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:22:44.741189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":25,"num_read_kb":102400,"num_write":67,"num_write_kb":266241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.781051+0000","last_change":"2024-05-28T06:12:30.797106+0000","last_active":"2024-05-28T06:12:32.781051+0000","last_peered":"2024-05-28T06:12:32.781051+0000","last_clean":"2024-05-28T06:12:32.781051+0000","last_became_active":"2024-05-28T06:12:30.795350+0000","last_became_peered":"2024-05-28T06:12:30.795350+0000","last_unstale":"2024-05-28T06:12:32.781051+0000","last_undegraded":"2024-05-28T06:12:32.781051+0000","last_fullsized":"2024-05-28T06:12:32.781051+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:24:27.852847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"62'86","reported_seq":179,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.289872+0000","last_change":"2024-05-28T06:12:31.794618+0000","last_active":"2024-05-28T06:13:37.289872+0000","last_peered":"2024-05-28T06:13:37.289872+0000","last_clean":"2024-05-28T06:13:37.289872+0000","last_became_active":"2024-05-28T06:12:31.794358+0000","last_became_peered":"2024-05-28T06:12:31.794358+0000","last_unstale":"2024-05-28T06:13:37.289872+0000","last_undegraded":"2024-05-28T06:13:37.289872+0000","last_fullsized":"2024-05-28T06:13:37.289872+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:30:32.490570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356515972,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":81,"num_read_kb":327681,"num_write":86,"num_write_kb":348161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.799366+0000","last_change":"2024-05-28T06:12:30.793010+0000","last_active":"2024-05-28T06:12:32.799366+0000","last_peered":"2024-05-28T06:12:32.799366+0000","last_clean":"2024-05-28T06:12:32.799366+0000","last_became_active":"2024-05-28T06:12:30.792705+0000","last_became_peered":"2024-05-28T06:12:30.792705+0000","last_unstale":"2024-05-28T06:12:32.799366+0000","last_undegraded":"2024-05-28T06:12:32.799366+0000","last_fullsized":"2024-05-28T06:12:32.799366+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:37:55.600898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"62'65","reported_seq":138,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.196607+0000","last_change":"2024-05-28T06:12:31.790772+0000","last_active":"2024-05-28T06:13:37.196607+0000","last_peered":"2024-05-28T06:13:37.196607+0000","last_clean":"2024-05-28T06:13:37.196607+0000","last_became_active":"2024-05-28T06:12:31.790509+0000","last_became_peered":"2024-05-28T06:12:31.790509+0000","last_unstale":"2024-05-28T06:13:37.196607+0000","last_undegraded":"2024-05-28T06:13:37.196607+0000","last_fullsized":"2024-05-28T06:13:37.196607+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:25:51.424031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658501,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":61,"num_read_kb":233476,"num_write":65,"num_write_kb":245763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.782296+0000","last_change":"2024-05-28T06:12:30.797084+0000","last_active":"2024-05-28T06:12:32.782296+0000","last_peered":"2024-05-28T06:12:32.782296+0000","last_clean":"2024-05-28T06:12:32.782296+0000","last_became_active":"2024-05-28T06:12:30.795903+0000","last_became_peered":"2024-05-28T06:12:30.795903+0000","last_unstale":"2024-05-28T06:12:32.782296+0000","last_undegraded":"2024-05-28T06:12:32.782296+0000","last_fullsized":"2024-05-28T06:12:32.782296+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:54:30.480345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"62'70","reported_seq":161,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.493094+0000","last_change":"2024-05-28T06:12:31.809139+0000","last_active":"2024-05-28T06:13:37.493094+0000","last_peered":"2024-05-28T06:13:37.493094+0000","last_clean":"2024-05-28T06:13:37.493094+0000","last_became_active":"2024-05-28T06:12:31.807373+0000","last_became_peered":"2024-05-28T06:12:31.807373+0000","last_unstale":"2024-05-28T06:13:37.493094+0000","last_undegraded":"2024-05-28T06:13:37.493094+0000","last_fullsized":"2024-05-28T06:13:37.493094+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:30:34.090290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":79,"num_read_kb":323584,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.799295+0000","last_change":"2024-05-28T06:12:30.793875+0000","last_active":"2024-05-28T06:12:32.799295+0000","last_peered":"2024-05-28T06:12:32.799295+0000","last_clean":"2024-05-28T06:12:32.799295+0000","last_became_active":"2024-05-28T06:12:30.793587+0000","last_became_peered":"2024-05-28T06:12:30.793587+0000","last_unstale":"2024-05-28T06:12:32.799295+0000","last_undegraded":"2024-05-28T06:12:32.799295+0000","last_fullsized":"2024-05-28T06:12:32.799295+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:03:08.736169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"62'97","reported_seq":189,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.393853+0000","last_change":"2024-05-28T06:12:31.794925+0000","last_active":"2024-05-28T06:13:37.393853+0000","last_peered":"2024-05-28T06:13:37.393853+0000","last_clean":"2024-05-28T06:13:37.393853+0000","last_became_active":"2024-05-28T06:12:31.793880+0000","last_became_peered":"2024-05-28T06:12:31.793880+0000","last_unstale":"2024-05-28T06:13:37.393853+0000","last_undegraded":"2024-05-28T06:13:37.393853+0000","last_fullsized":"2024-05-28T06:13:37.393853+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:24:28.859928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406847488,"num_objects":97,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":80,"num_read_kb":327680,"num_write":97,"num_write_kb":397312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"62'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.780684+0000","last_change":"2024-05-28T06:12:30.794189+0000","last_active":"2024-05-28T06:12:32.780684+0000","last_peered":"2024-05-28T06:12:32.780684+0000","last_clean":"2024-05-28T06:12:32.780684+0000","last_became_active":"2024-05-28T06:12:30.793922+0000","last_became_peered":"2024-05-28T06:12:30.793922+0000","last_unstale":"2024-05-28T06:12:32.780684+0000","last_undegraded":"2024-05-28T06:12:32.780684+0000","last_fullsized":"2024-05-28T06:12:32.780684+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:08:25.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"62'79","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.489511+0000","last_change":"2024-05-28T06:12:31.797123+0000","last_active":"2024-05-28T06:13:36.489511+0000","last_peered":"2024-05-28T06:13:36.489511+0000","last_clean":"2024-05-28T06:13:36.489511+0000","last_became_active":"2024-05-28T06:12:31.796849+0000","last_became_peered":"2024-05-28T06:12:31.796849+0000","last_unstale":"2024-05-28T06:13:36.489511+0000","last_undegraded":"2024-05-28T06:13:36.489511+0000","last_fullsized":"2024-05-28T06:13:36.489511+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:55:16.457872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":66,"num_read_kb":249861,"num_write":79,"num_write_kb":307202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.561764+0000","last_change":"2024-05-28T06:12:30.796022+0000","last_active":"2024-05-28T06:12:33.561764+0000","last_peered":"2024-05-28T06:12:33.561764+0000","last_clean":"2024-05-28T06:12:33.561764+0000","last_became_active":"2024-05-28T06:12:30.794505+0000","last_became_peered":"2024-05-28T06:12:30.794505+0000","last_unstale":"2024-05-28T06:12:33.561764+0000","last_undegraded":"2024-05-28T06:12:33.561764+0000","last_fullsized":"2024-05-28T06:12:33.561764+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:32:08.488200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"62'69","reported_seq":139,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.116548+0000","last_change":"2024-05-28T06:12:31.802246+0000","last_active":"2024-05-28T06:13:37.116548+0000","last_peered":"2024-05-28T06:13:37.116548+0000","last_clean":"2024-05-28T06:13:37.116548+0000","last_became_active":"2024-05-28T06:12:31.801961+0000","last_became_peered":"2024-05-28T06:12:31.801961+0000","last_unstale":"2024-05-28T06:13:37.116548+0000","last_undegraded":"2024-05-28T06:13:37.116548+0000","last_fullsized":"2024-05-28T06:13:37.116548+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:21:56.535399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":58,"num_read_kb":237568,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.781996+0000","last_change":"2024-05-28T06:12:30.790810+0000","last_active":"2024-05-28T06:12:32.781996+0000","last_peered":"2024-05-28T06:12:32.781996+0000","last_clean":"2024-05-28T06:12:32.781996+0000","last_became_active":"2024-05-28T06:12:30.790513+0000","last_became_peered":"2024-05-28T06:12:30.790513+0000","last_unstale":"2024-05-28T06:12:32.781996+0000","last_undegraded":"2024-05-28T06:12:32.781996+0000","last_fullsized":"2024-05-28T06:12:32.781996+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:31:14.976810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"62'80","reported_seq":130,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.201588+0000","last_change":"2024-05-28T06:12:31.804263+0000","last_active":"2024-05-28T06:13:37.201588+0000","last_peered":"2024-05-28T06:13:37.201588+0000","last_clean":"2024-05-28T06:13:37.201588+0000","last_became_active":"2024-05-28T06:12:31.803936+0000","last_became_peered":"2024-05-28T06:12:31.803936+0000","last_unstale":"2024-05-28T06:13:37.201588+0000","last_undegraded":"2024-05-28T06:13:37.201588+0000","last_fullsized":"2024-05-28T06:13:37.201588+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:30:34.090290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":38,"num_read_kb":155648,"num_write":80,"num_write_kb":327680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.562377+0000","last_change":"2024-05-28T06:12:30.798073+0000","last_active":"2024-05-28T06:12:33.562377+0000","last_peered":"2024-05-28T06:12:33.562377+0000","last_clean":"2024-05-28T06:12:33.562377+0000","last_became_active":"2024-05-28T06:12:30.797794+0000","last_became_peered":"2024-05-28T06:12:30.797794+0000","last_unstale":"2024-05-28T06:12:33.562377+0000","last_undegraded":"2024-05-28T06:12:33.562377+0000","last_fullsized":"2024-05-28T06:12:33.562377+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:05:17.937721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"62'86","reported_seq":178,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.316401+0000","last_change":"2024-05-28T06:12:31.800014+0000","last_active":"2024-05-28T06:13:37.316401+0000","last_peered":"2024-05-28T06:13:37.316401+0000","last_clean":"2024-05-28T06:13:37.316401+0000","last_became_active":"2024-05-28T06:12:31.799714+0000","last_became_peered":"2024-05-28T06:12:31.799714+0000","last_unstale":"2024-05-28T06:13:37.316401+0000","last_undegraded":"2024-05-28T06:13:37.316401+0000","last_fullsized":"2024-05-28T06:13:37.316401+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:54:23.878943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360710144,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":80,"num_read_kb":327680,"num_write":86,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"62'40","reported_seq":54,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:43.843635+0000","last_change":"2024-05-28T06:12:30.790726+0000","last_active":"2024-05-28T06:13:43.843635+0000","last_peered":"2024-05-28T06:13:43.843635+0000","last_clean":"2024-05-28T06:13:43.843635+0000","last_became_active":"2024-05-28T06:12:30.790486+0000","last_became_peered":"2024-05-28T06:12:30.790486+0000","last_unstale":"2024-05-28T06:13:43.843635+0000","last_undegraded":"2024-05-28T06:13:43.843635+0000","last_fullsized":"2024-05-28T06:13:43.843635+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:31:14.976810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"62'83","reported_seq":190,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.421892+0000","last_change":"2024-05-28T06:12:31.791575+0000","last_active":"2024-05-28T06:13:37.421892+0000","last_peered":"2024-05-28T06:13:37.421892+0000","last_clean":"2024-05-28T06:13:37.421892+0000","last_became_active":"2024-05-28T06:12:31.789316+0000","last_became_peered":"2024-05-28T06:12:31.789316+0000","last_unstale":"2024-05-28T06:13:37.421892+0000","last_undegraded":"2024-05-28T06:13:37.421892+0000","last_fullsized":"2024-05-28T06:13:37.421892+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:56:28.051898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339738624,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":95,"num_read_kb":385025,"num_write":83,"num_write_kb":331777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.800751+0000","last_change":"2024-05-28T06:12:30.791618+0000","last_active":"2024-05-28T06:12:32.800751+0000","last_peered":"2024-05-28T06:12:32.800751+0000","last_clean":"2024-05-28T06:12:32.800751+0000","last_became_active":"2024-05-28T06:12:30.791296+0000","last_became_peered":"2024-05-28T06:12:30.791296+0000","last_unstale":"2024-05-28T06:12:32.800751+0000","last_undegraded":"2024-05-28T06:12:32.800751+0000","last_fullsized":"2024-05-28T06:12:32.800751+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:32:08.488200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"62'90","reported_seq":150,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.548239+0000","last_change":"2024-05-28T06:12:31.799676+0000","last_active":"2024-05-28T06:13:37.548239+0000","last_peered":"2024-05-28T06:13:37.548239+0000","last_clean":"2024-05-28T06:13:37.548239+0000","last_became_active":"2024-05-28T06:12:31.799396+0000","last_became_peered":"2024-05-28T06:12:31.799396+0000","last_unstale":"2024-05-28T06:13:37.548239+0000","last_undegraded":"2024-05-28T06:13:37.548239+0000","last_fullsized":"2024-05-28T06:13:37.548239+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:54:23.878943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356516084,"num_objects":88,"num_object_clones":1,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":1,"num_read":49,"num_read_kb":200704,"num_write":88,"num_write_kb":348162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.782544+0000","last_change":"2024-05-28T06:12:30.790898+0000","last_active":"2024-05-28T06:12:32.782544+0000","last_peered":"2024-05-28T06:12:32.782544+0000","last_clean":"2024-05-28T06:12:32.782544+0000","last_became_active":"2024-05-28T06:12:30.790609+0000","last_became_peered":"2024-05-28T06:12:30.790609+0000","last_unstale":"2024-05-28T06:12:32.782544+0000","last_undegraded":"2024-05-28T06:12:32.782544+0000","last_fullsized":"2024-05-28T06:12:32.782544+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:42:43.406276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"62'86","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.545733+0000","last_change":"2024-05-28T06:12:31.793575+0000","last_active":"2024-05-28T06:13:37.545733+0000","last_peered":"2024-05-28T06:13:37.545733+0000","last_clean":"2024-05-28T06:13:37.545733+0000","last_became_active":"2024-05-28T06:12:31.792189+0000","last_became_peered":"2024-05-28T06:12:31.792189+0000","last_unstale":"2024-05-28T06:13:37.545733+0000","last_undegraded":"2024-05-28T06:13:37.545733+0000","last_fullsized":"2024-05-28T06:13:37.545733+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:37:03.595280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360710144,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":59,"num_read_kb":241664,"num_write":86,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.561734+0000","last_change":"2024-05-28T06:12:30.787551+0000","last_active":"2024-05-28T06:12:33.561734+0000","last_peered":"2024-05-28T06:12:33.561734+0000","last_clean":"2024-05-28T06:12:33.561734+0000","last_became_active":"2024-05-28T06:12:30.786731+0000","last_became_peered":"2024-05-28T06:12:30.786731+0000","last_unstale":"2024-05-28T06:12:33.561734+0000","last_undegraded":"2024-05-28T06:12:33.561734+0000","last_fullsized":"2024-05-28T06:12:33.561734+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:57:56.110796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"62'95","reported_seq":193,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.520900+0000","last_change":"2024-05-28T06:12:31.804270+0000","last_active":"2024-05-28T06:13:37.520900+0000","last_peered":"2024-05-28T06:13:37.520900+0000","last_clean":"2024-05-28T06:13:37.520900+0000","last_became_active":"2024-05-28T06:12:31.803980+0000","last_became_peered":"2024-05-28T06:12:31.803980+0000","last_unstale":"2024-05-28T06:13:37.520900+0000","last_undegraded":"2024-05-28T06:13:37.520900+0000","last_fullsized":"2024-05-28T06:13:37.520900+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:08:26.147408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390070272,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":86,"num_read_kb":339971,"num_write":95,"num_write_kb":380929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.560646+0000","last_change":"2024-05-28T06:12:30.790132+0000","last_active":"2024-05-28T06:12:33.560646+0000","last_peered":"2024-05-28T06:12:33.560646+0000","last_clean":"2024-05-28T06:12:33.560646+0000","last_became_active":"2024-05-28T06:12:30.789856+0000","last_became_peered":"2024-05-28T06:12:30.789856+0000","last_unstale":"2024-05-28T06:12:33.560646+0000","last_undegraded":"2024-05-28T06:12:33.560646+0000","last_fullsized":"2024-05-28T06:12:33.560646+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:05:08.097047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"62'94","reported_seq":181,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.051192+0000","last_change":"2024-05-28T06:12:31.801507+0000","last_active":"2024-05-28T06:13:37.051192+0000","last_peered":"2024-05-28T06:13:37.051192+0000","last_clean":"2024-05-28T06:13:37.051192+0000","last_became_active":"2024-05-28T06:12:31.801228+0000","last_became_peered":"2024-05-28T06:12:31.801228+0000","last_unstale":"2024-05-28T06:13:37.051192+0000","last_undegraded":"2024-05-28T06:13:37.051192+0000","last_fullsized":"2024-05-28T06:13:37.051192+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:24:13.601910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394264576,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":75,"num_read_kb":307200,"num_write":94,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"62'31","reported_seq":75,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:42.926546+0000","last_change":"2024-05-28T06:12:30.790873+0000","last_active":"2024-05-28T06:13:42.926546+0000","last_peered":"2024-05-28T06:13:42.926546+0000","last_clean":"2024-05-28T06:13:42.926546+0000","last_became_active":"2024-05-28T06:12:30.790623+0000","last_became_peered":"2024-05-28T06:12:30.790623+0000","last_unstale":"2024-05-28T06:13:42.926546+0000","last_undegraded":"2024-05-28T06:13:42.926546+0000","last_fullsized":"2024-05-28T06:13:42.926546+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:52:42.932309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4250,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":30,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"62'86","reported_seq":176,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.744527+0000","last_change":"2024-05-28T06:12:31.803993+0000","last_active":"2024-05-28T06:13:36.744527+0000","last_peered":"2024-05-28T06:13:36.744527+0000","last_clean":"2024-05-28T06:13:36.744527+0000","last_became_active":"2024-05-28T06:12:31.803709+0000","last_became_peered":"2024-05-28T06:12:31.803709+0000","last_unstale":"2024-05-28T06:13:36.744527+0000","last_undegraded":"2024-05-28T06:13:36.744527+0000","last_fullsized":"2024-05-28T06:13:36.744527+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:02:56.823249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360710144,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":78,"num_read_kb":319488,"num_write":86,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.780340+0000","last_change":"2024-05-28T06:12:30.793567+0000","last_active":"2024-05-28T06:12:32.780340+0000","last_peered":"2024-05-28T06:12:32.780340+0000","last_clean":"2024-05-28T06:12:32.780340+0000","last_became_active":"2024-05-28T06:12:30.793086+0000","last_became_peered":"2024-05-28T06:12:30.793086+0000","last_unstale":"2024-05-28T06:12:32.780340+0000","last_undegraded":"2024-05-28T06:12:32.780340+0000","last_fullsized":"2024-05-28T06:12:32.780340+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:55:15.450791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"62'88","reported_seq":146,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.479297+0000","last_change":"2024-05-28T06:12:31.789343+0000","last_active":"2024-05-28T06:13:37.479297+0000","last_peered":"2024-05-28T06:13:37.479297+0000","last_clean":"2024-05-28T06:13:37.479297+0000","last_became_active":"2024-05-28T06:12:31.789082+0000","last_became_peered":"2024-05-28T06:12:31.789082+0000","last_unstale":"2024-05-28T06:13:37.479297+0000","last_undegraded":"2024-05-28T06:13:37.479297+0000","last_fullsized":"2024-05-28T06:13:37.479297+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:52:29.999357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356515972,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":46,"num_read_kb":180226,"num_write":88,"num_write_kb":348162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.800527+0000","last_change":"2024-05-28T06:12:30.796037+0000","last_active":"2024-05-28T06:12:32.800527+0000","last_peered":"2024-05-28T06:12:32.800527+0000","last_clean":"2024-05-28T06:12:32.800527+0000","last_became_active":"2024-05-28T06:12:30.795716+0000","last_became_peered":"2024-05-28T06:12:30.795716+0000","last_unstale":"2024-05-28T06:12:32.800527+0000","last_undegraded":"2024-05-28T06:12:32.800527+0000","last_fullsized":"2024-05-28T06:12:32.800527+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:17:05.591509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":248,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.560577+0000","last_change":"2024-05-28T06:05:38.517922+0000","last_active":"2024-05-28T06:12:33.560577+0000","last_peered":"2024-05-28T06:12:33.560577+0000","last_clean":"2024-05-28T06:12:33.560577+0000","last_became_active":"2024-05-28T06:05:38.514745+0000","last_became_peered":"2024-05-28T06:05:38.514745+0000","last_unstale":"2024-05-28T06:12:33.560577+0000","last_undegraded":"2024-05-28T06:12:33.560577+0000","last_fullsized":"2024-05-28T06:12:33.560577+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_clean_scrub_stamp":"2024-05-28T06:05:37.485018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:23:27.978203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":20426262164,"num_objects":4880,"num_object_clones":1,"num_object_copies":9760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4880,"num_whiteouts":1,"num_read":4170,"num_read_kb":16875570,"num_write":4948,"num_write_kb":19947563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40852594688,"data_stored":40852524328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4957,"ondisk_log_size":4957,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1671162,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":605,"num_write_kb":1872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3407872,"data_stored":3342324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":550,"ondisk_log_size":550,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574958,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5940600,"kb_used_data":5891376,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":88431240,"statfs":{"total":96636764160,"available":90553589760,"internally_reserved":0,"allocated":6032769024,"data_stored":6032315492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574958,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3842848,"kb_used_data":3793624,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":90528992,"statfs":{"total":96636764160,"available":92701687808,"internally_reserved":0,"allocated":3884670976,"data_stored":3884240533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574957,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4842296,"kb_used_data":4793072,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":89529544,"statfs":{"total":96636764160,"available":91678253056,"internally_reserved":0,"allocated":4908105728,"data_stored":4907651869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574956,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4073928,"kb_used_data":4020544,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":90297912,"statfs":{"total":96636764160,"available":92465061888,"internally_reserved":0,"allocated":4117037056,"data_stored":4116593628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574959,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6505336,"kb_used_data":6451952,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":87866504,"statfs":{"total":96636764160,"available":89975300096,"internally_reserved":0,"allocated":6606798848,"data_stored":6606344671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574958,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3781416,"kb_used_data":3732192,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":90590424,"statfs":{"total":96636764160,"available":92764594176,"internally_reserved":0,"allocated":3821764608,"data_stored":3821326029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574958,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5935988,"kb_used_data":5882604,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":88435852,"statfs":{"total":96636764160,"available":90558312448,"internally_reserved":0,"allocated":6023786496,"data_stored":6023340306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574957,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5393444,"kb_used_data":5340060,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":88978396,"statfs":{"total":96636764160,"available":91113877504,"internally_reserved":0,"allocated":5468221440,"data_stored":5467755092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1687552,"data_stored":1670946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1675264,"data_stored":1666114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5465194496,"data_stored":5465178749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6023028736,"data_stored":6023020937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3821010944,"data_stored":3821010944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6606045184,"data_stored":6606029586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4114616320,"data_stored":4114612485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4907352064,"data_stored":4907336188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3883925504,"data_stored":3883925504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6031421440,"data_stored":6031409935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-28T06:14:30.835 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-28T06:14:30.836 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-28T06:14:31.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.037+0000 7ff834000640 1 Processor -- start 2024-05-28T06:14:31.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.037+0000 7ff834000640 1 -- start start 2024-05-28T06:14:31.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.041+0000 7ff834000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff82c0d0c80 0x7ff82c09b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:31.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.041+0000 7ff834000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff82c0d0270 0x7ff82c15d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:31.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.041+0000 7ff831600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff82c0d0c80 0x7ff82c09b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:31.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.041+0000 7ff834000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff82c0d0830 con 0x7ff82c0d1060 2024-05-28T06:14:31.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.041+0000 7ff834000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7ff82c09aa40 con 0x7ff82c0d0270 2024-05-28T06:14:31.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.041+0000 7ff834000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff82c09ad20 con 0x7ff82c0d0c80 2024-05-28T06:14:31.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.041+0000 7ff830c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff82c0d0270 0x7ff82c15d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:31.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.041+0000 7ff831600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff82c0d0c80 0x7ff82c09b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:60320/0 (socket says 172.21.15.122:60320) 2024-05-28T06:14:31.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.041+0000 7ff831600640 1 -- 172.21.15.122:0/2559787104 learned_addr learned my addr 172.21.15.122:0/2559787104 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:31.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.041+0000 7ff830c00640 1 -- 172.21.15.122:0/2559787104 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff82c0d0c80 msgr2=0x7ff82c09b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:31.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.041+0000 7ff830c00640 1 --2- 172.21.15.122:0/2559787104 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff82c0d0c80 0x7ff82c09b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:31.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.041+0000 7ff830c00640 1 -- 172.21.15.122:0/2559787104 >> v1:172.21.15.122:6789/0 conn(0x7ff82c0d1060 legacy=0x7ff82c160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:31.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.041+0000 7ff830c00640 1 -- 172.21.15.122:0/2559787104 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff82c09b000 con 0x7ff82c0d0270 2024-05-28T06:14:31.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.041+0000 7ff82be00640 1 -- 172.21.15.122:0/2559787104 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3656763711 0 0) 0x7ff82c0d0830 con 0x7ff82c0d1060 2024-05-28T06:14:31.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.045+0000 7ff830c00640 1 --2- 172.21.15.122:0/2559787104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff82c0d0270 0x7ff82c15d7e0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7ff8180097c0 tx=0x7ff81801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe8f212ed382210 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:31.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.045+0000 7ff82be00640 1 -- 172.21.15.122:0/2559787104 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8180b0070 con 0x7ff82c0d0270 2024-05-28T06:14:31.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.045+0000 7ff82be00640 1 -- 172.21.15.122:0/2559787104 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8180ab600 con 0x7ff82c0d0270 2024-05-28T06:14:31.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.045+0000 7ff82be00640 1 -- 172.21.15.122:0/2559787104 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8180ab9d0 con 0x7ff82c0d0270 2024-05-28T06:14:31.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.045+0000 7ff834000640 1 -- 172.21.15.122:0/2559787104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff82c0d0270 msgr2=0x7ff82c15d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:31.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.045+0000 7ff834000640 1 --2- 172.21.15.122:0/2559787104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff82c0d0270 0x7ff82c15d7e0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7ff8180097c0 tx=0x7ff81801c410 comp rx=0 tx=0).stop 2024-05-28T06:14:31.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.045+0000 7ff834000640 1 -- 172.21.15.122:0/2559787104 shutdown_connections 2024-05-28T06:14:31.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.045+0000 7ff834000640 1 --2- 172.21.15.122:0/2559787104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff82c0d0270 0x7ff82c15d7e0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:31.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.045+0000 7ff834000640 1 --2- 172.21.15.122:0/2559787104 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff82c0d0c80 0x7ff82c09b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:31.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.045+0000 7ff834000640 1 -- 172.21.15.122:0/2559787104 >> 172.21.15.122:0/2559787104 conn(0x7ff82c0b4190 msgr2=0x7ff82c0b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:31.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.045+0000 7ff834000640 1 -- 172.21.15.122:0/2559787104 shutdown_connections 2024-05-28T06:14:31.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.045+0000 7ff834000640 1 -- 172.21.15.122:0/2559787104 wait complete. 2024-05-28T06:14:31.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff834000640 1 Processor -- start 2024-05-28T06:14:31.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff834000640 1 -- start start 2024-05-28T06:14:31.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff834000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff82c0d0270 0x7ff82c14b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:31.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff834000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff82c0d0c80 0x7ff82c070120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:31.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff834000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff82c0d1060 0x7ff82c070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:31.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff834000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff82c1697c0 con 0x7ff82c0d0270 2024-05-28T06:14:31.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff834000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff82c169640 con 0x7ff82c0d0c80 2024-05-28T06:14:31.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff834000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff82c169940 con 0x7ff82c0d1060 2024-05-28T06:14:31.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff831600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff82c0d0270 0x7ff82c14b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:31.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff831600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff82c0d0270 0x7ff82c14b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52156/0 (socket says 172.21.15.122:52156) 2024-05-28T06:14:31.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff831600640 1 -- 172.21.15.122:0/2961220764 learned_addr learned my addr 172.21.15.122:0/2961220764 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:31.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff830c00640 1 --2- 172.21.15.122:0/2961220764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff82c0d0c80 0x7ff82c070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:31.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff832000640 1 --2- 172.21.15.122:0/2961220764 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff82c0d1060 0x7ff82c070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:31.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff831600640 1 -- 172.21.15.122:0/2961220764 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff82c0d1060 msgr2=0x7ff82c070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:31.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff831600640 1 --2- 172.21.15.122:0/2961220764 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff82c0d1060 0x7ff82c070660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:31.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff831600640 1 -- 172.21.15.122:0/2961220764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff82c0d0c80 msgr2=0x7ff82c070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:31.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff831600640 1 --2- 172.21.15.122:0/2961220764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff82c0d0c80 0x7ff82c070120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:31.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff831600640 1 -- 172.21.15.122:0/2961220764 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff82c156540 con 0x7ff82c0d0270 2024-05-28T06:14:31.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff832000640 1 --2- 172.21.15.122:0/2961220764 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff82c0d1060 0x7ff82c070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:14:31.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff831600640 1 --2- 172.21.15.122:0/2961220764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff82c0d0270 0x7ff82c14b880 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7ff82000e7f0 tx=0x7ff82000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:31.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff829600640 1 -- 172.21.15.122:0/2961220764 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff820017070 con 0x7ff82c0d0270 2024-05-28T06:14:31.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff829600640 1 -- 172.21.15.122:0/2961220764 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff82000c940 con 0x7ff82c0d0270 2024-05-28T06:14:31.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff829600640 1 -- 172.21.15.122:0/2961220764 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82000cd30 con 0x7ff82c0d0270 2024-05-28T06:14:31.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff834000640 1 -- 172.21.15.122:0/2961220764 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff82c0c6b90 con 0x7ff82c0d0270 2024-05-28T06:14:31.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.049+0000 7ff834000640 1 -- 172.21.15.122:0/2961220764 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff82c0c7150 con 0x7ff82c0d0270 2024-05-28T06:14:31.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.053+0000 7ff834000640 1 -- 172.21.15.122:0/2961220764 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff82c068c40 con 0x7ff82c0d0270 2024-05-28T06:14:31.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.053+0000 7ff829600640 1 -- 172.21.15.122:0/2961220764 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 23) ==== 89109+0+0 (secure 0 0 0) 0x7ff82001a070 con 0x7ff82c0d0270 2024-05-28T06:14:31.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.053+0000 7ff829600640 1 --2- 172.21.15.122:0/2961220764 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff80c068fe0 0x7ff80c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:31.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.053+0000 7ff829600640 1 -- 172.21.15.122:0/2961220764 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7ff8200854d0 con 0x7ff82c0d0270 2024-05-28T06:14:31.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.053+0000 7ff830c00640 1 --2- 172.21.15.122:0/2961220764 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff80c068fe0 0x7ff80c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:31.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.053+0000 7ff830c00640 1 --2- 172.21.15.122:0/2961220764 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff80c068fe0 0x7ff80c06b4a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff8180ad000 tx=0x7ff818008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:31.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.057+0000 7ff829600640 1 -- 172.21.15.122:0/2961220764 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff820057260 con 0x7ff82c0d0270 2024-05-28T06:14:31.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.213+0000 7ff834000640 1 -- 172.21.15.122:0/2961220764 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff82c076020 con 0x7ff80c068fe0 2024-05-28T06:14:31.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.217+0000 7ff829600640 1 -- 172.21.15.122:0/2961220764 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254112 (secure 0 0 0) 0x7ff8180b6470 con 0x7ff80c068fe0 2024-05-28T06:14:31.220 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:14:31.221 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-05-28T06:14:31.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.221+0000 7ff834000640 1 -- 172.21.15.122:0/2961220764 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff80c068fe0 msgr2=0x7ff80c06b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:31.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.221+0000 7ff834000640 1 --2- 172.21.15.122:0/2961220764 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff80c068fe0 0x7ff80c06b4a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff8180ad000 tx=0x7ff818008040 comp rx=0 tx=0).stop 2024-05-28T06:14:31.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.221+0000 7ff834000640 1 -- 172.21.15.122:0/2961220764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff82c0d0270 msgr2=0x7ff82c14b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:31.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.221+0000 7ff834000640 1 --2- 172.21.15.122:0/2961220764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff82c0d0270 0x7ff82c14b880 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7ff82000e7f0 tx=0x7ff82000ecb0 comp rx=0 tx=0).stop 2024-05-28T06:14:31.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.221+0000 7ff834000640 1 -- 172.21.15.122:0/2961220764 shutdown_connections 2024-05-28T06:14:31.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.221+0000 7ff834000640 1 --2- 172.21.15.122:0/2961220764 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff80c068fe0 0x7ff80c06b4a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:31.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.221+0000 7ff834000640 1 --2- 172.21.15.122:0/2961220764 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff82c0d1060 0x7ff82c070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:31.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.221+0000 7ff834000640 1 --2- 172.21.15.122:0/2961220764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff82c0d0c80 0x7ff82c070120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:31.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.221+0000 7ff834000640 1 --2- 172.21.15.122:0/2961220764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff82c0d0270 0x7ff82c14b880 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:31.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.221+0000 7ff834000640 1 -- 172.21.15.122:0/2961220764 >> 172.21.15.122:0/2961220764 conn(0x7ff82c0b4190 msgr2=0x7ff82c155e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:31.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.221+0000 7ff834000640 1 -- 172.21.15.122:0/2961220764 shutdown_connections 2024-05-28T06:14:31.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.221+0000 7ff834000640 1 -- 172.21.15.122:0/2961220764 wait complete. 2024-05-28T06:14:31.240 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2024-05-28T06:14:29.388873+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":20428523694,"num_objects":4905,"num_object_clones":1,"num_object_copies":9810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4905,"num_whiteouts":1,"num_read":4316,"num_read_kb":16875700,"num_write":5712,"num_write_kb":19951851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5624,"ondisk_log_size":5624,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":40315856,"kb_used_data":39905424,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":714658864,"statfs":{"total":773094113280,"available":731810676736,"internally_reserved":0,"allocated":40863154176,"data_stored":40859567620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":420204081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002569"},"pg_stats":[{"pgid":"9.3f","version":"62'66","reported_seq":152,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.097052+0000","last_change":"2024-05-28T06:12:31.797507+0000","last_active":"2024-05-28T06:13:37.097052+0000","last_peered":"2024-05-28T06:13:37.097052+0000","last_clean":"2024-05-28T06:13:37.097052+0000","last_became_active":"2024-05-28T06:12:31.793751+0000","last_became_peered":"2024-05-28T06:12:31.793751+0000","last_unstale":"2024-05-28T06:13:37.097052+0000","last_undegraded":"2024-05-28T06:13:37.097052+0000","last_fullsized":"2024-05-28T06:13:37.097052+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:49:14.729612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":74,"num_read_kb":303104,"num_write":66,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"62'79","reported_seq":163,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.161320+0000","last_change":"2024-05-28T06:12:31.799024+0000","last_active":"2024-05-28T06:13:37.161320+0000","last_peered":"2024-05-28T06:13:37.161320+0000","last_clean":"2024-05-28T06:13:37.161320+0000","last_became_active":"2024-05-28T06:12:31.798788+0000","last_became_peered":"2024-05-28T06:12:31.798788+0000","last_unstale":"2024-05-28T06:13:37.161320+0000","last_undegraded":"2024-05-28T06:13:37.161320+0000","last_fullsized":"2024-05-28T06:13:37.161320+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:59:06.307827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":72,"num_read_kb":294912,"num_write":79,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"62'75","reported_seq":155,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.965534+0000","last_change":"2024-05-28T06:12:31.802734+0000","last_active":"2024-05-28T06:13:36.965534+0000","last_peered":"2024-05-28T06:13:36.965534+0000","last_clean":"2024-05-28T06:13:36.965534+0000","last_became_active":"2024-05-28T06:12:31.802019+0000","last_became_peered":"2024-05-28T06:12:31.802019+0000","last_unstale":"2024-05-28T06:13:36.965534+0000","last_undegraded":"2024-05-28T06:13:36.965534+0000","last_fullsized":"2024-05-28T06:13:36.965534+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:55:16.457872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":68,"num_read_kb":270338,"num_write":75,"num_write_kb":282627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"62'77","reported_seq":133,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.236029+0000","last_change":"2024-05-28T06:12:31.802404+0000","last_active":"2024-05-28T06:13:37.236029+0000","last_peered":"2024-05-28T06:13:37.236029+0000","last_clean":"2024-05-28T06:13:37.236029+0000","last_became_active":"2024-05-28T06:12:31.801804+0000","last_became_peered":"2024-05-28T06:12:31.801804+0000","last_unstale":"2024-05-28T06:13:37.236029+0000","last_undegraded":"2024-05-28T06:13:37.236029+0000","last_fullsized":"2024-05-28T06:13:37.236029+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:08:26.147408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322961408,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":44,"num_read_kb":180224,"num_write":77,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"62'58","reported_seq":110,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.912606+0000","last_change":"2024-05-28T06:12:31.798616+0000","last_active":"2024-05-28T06:13:36.912606+0000","last_peered":"2024-05-28T06:13:36.912606+0000","last_clean":"2024-05-28T06:13:36.912606+0000","last_became_active":"2024-05-28T06:12:31.798238+0000","last_became_peered":"2024-05-28T06:12:31.798238+0000","last_unstale":"2024-05-28T06:13:36.912606+0000","last_undegraded":"2024-05-28T06:13:36.912606+0000","last_fullsized":"2024-05-28T06:13:36.912606+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T18:11:53.921729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":40,"num_read_kb":163840,"num_write":58,"num_write_kb":237568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"62'88","reported_seq":191,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:38.925842+0000","last_change":"2024-05-28T06:12:31.791032+0000","last_active":"2024-05-28T06:13:38.925842+0000","last_peered":"2024-05-28T06:13:38.925842+0000","last_clean":"2024-05-28T06:13:38.925842+0000","last_became_active":"2024-05-28T06:12:31.790779+0000","last_became_peered":"2024-05-28T06:12:31.790779+0000","last_unstale":"2024-05-28T06:13:38.925842+0000","last_undegraded":"2024-05-28T06:13:38.925842+0000","last_fullsized":"2024-05-28T06:13:38.925842+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:24:28.859928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352321536,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":91,"num_read_kb":364546,"num_write":88,"num_write_kb":344066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"62'63","reported_seq":123,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.740575+0000","last_change":"2024-05-28T06:12:31.786902+0000","last_active":"2024-05-28T06:13:36.740575+0000","last_peered":"2024-05-28T06:13:36.740575+0000","last_clean":"2024-05-28T06:13:36.740575+0000","last_became_active":"2024-05-28T06:12:31.786592+0000","last_became_peered":"2024-05-28T06:12:31.786592+0000","last_unstale":"2024-05-28T06:13:36.740575+0000","last_undegraded":"2024-05-28T06:13:36.740575+0000","last_fullsized":"2024-05-28T06:13:36.740575+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:13:29.656977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":48,"num_read_kb":196608,"num_write":63,"num_write_kb":258048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"62'75","reported_seq":138,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.435924+0000","last_change":"2024-05-28T06:12:31.788445+0000","last_active":"2024-05-28T06:13:37.435924+0000","last_peered":"2024-05-28T06:13:37.435924+0000","last_clean":"2024-05-28T06:13:37.435924+0000","last_became_active":"2024-05-28T06:12:31.788168+0000","last_became_peered":"2024-05-28T06:12:31.788168+0000","last_unstale":"2024-05-28T06:13:37.435924+0000","last_undegraded":"2024-05-28T06:13:37.435924+0000","last_fullsized":"2024-05-28T06:13:37.435924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:04:14.908029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":51,"num_read_kb":208896,"num_write":75,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"62'83","reported_seq":150,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:39.926708+0000","last_change":"2024-05-28T06:12:31.783886+0000","last_active":"2024-05-28T06:13:39.926708+0000","last_peered":"2024-05-28T06:13:39.926708+0000","last_clean":"2024-05-28T06:13:39.926708+0000","last_became_active":"2024-05-28T06:12:31.783599+0000","last_became_peered":"2024-05-28T06:12:31.783599+0000","last_unstale":"2024-05-28T06:13:39.926708+0000","last_undegraded":"2024-05-28T06:13:39.926708+0000","last_fullsized":"2024-05-28T06:13:39.926708+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:42:44.413357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":55,"num_read_kb":221185,"num_write":82,"num_write_kb":327681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"62'62","reported_seq":137,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.029161+0000","last_change":"2024-05-28T06:12:31.797210+0000","last_active":"2024-05-28T06:13:37.029161+0000","last_peered":"2024-05-28T06:13:37.029161+0000","last_clean":"2024-05-28T06:13:37.029161+0000","last_became_active":"2024-05-28T06:12:31.793687+0000","last_became_peered":"2024-05-28T06:12:31.793687+0000","last_unstale":"2024-05-28T06:13:37.029161+0000","last_undegraded":"2024-05-28T06:13:37.029161+0000","last_fullsized":"2024-05-28T06:13:37.029161+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:58:28.495952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":63,"num_read_kb":258048,"num_write":62,"num_write_kb":253952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"62'91","reported_seq":204,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.050023+0000","last_change":"2024-05-28T06:12:31.789629+0000","last_active":"2024-05-28T06:13:37.050023+0000","last_peered":"2024-05-28T06:13:37.050023+0000","last_clean":"2024-05-28T06:13:37.050023+0000","last_became_active":"2024-05-28T06:12:31.789337+0000","last_became_peered":"2024-05-28T06:12:31.789337+0000","last_unstale":"2024-05-28T06:13:37.050023+0000","last_undegraded":"2024-05-28T06:13:37.050023+0000","last_fullsized":"2024-05-28T06:13:37.050023+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:11:11.445809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381681664,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":101,"num_read_kb":413696,"num_write":91,"num_write_kb":372736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"62'76","reported_seq":187,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.477161+0000","last_change":"2024-05-28T06:12:31.796464+0000","last_active":"2024-05-28T06:13:37.477161+0000","last_peered":"2024-05-28T06:13:37.477161+0000","last_clean":"2024-05-28T06:13:37.477161+0000","last_became_active":"2024-05-28T06:12:31.796167+0000","last_became_peered":"2024-05-28T06:12:31.796167+0000","last_unstale":"2024-05-28T06:13:37.477161+0000","last_undegraded":"2024-05-28T06:13:37.477161+0000","last_fullsized":"2024-05-28T06:13:37.477161+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:53:57.139243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":99,"num_read_kb":389124,"num_write":76,"num_write_kb":303105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"62'82","reported_seq":177,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.303156+0000","last_change":"2024-05-28T06:12:31.799523+0000","last_active":"2024-05-28T06:13:37.303156+0000","last_peered":"2024-05-28T06:13:37.303156+0000","last_clean":"2024-05-28T06:13:37.303156+0000","last_became_active":"2024-05-28T06:12:31.799169+0000","last_became_peered":"2024-05-28T06:12:31.799169+0000","last_unstale":"2024-05-28T06:13:37.303156+0000","last_undegraded":"2024-05-28T06:13:37.303156+0000","last_fullsized":"2024-05-28T06:13:37.303156+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:24:13.601910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343932928,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":83,"num_read_kb":339968,"num_write":82,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"62'87","reported_seq":163,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.516157+0000","last_change":"2024-05-28T06:12:31.790257+0000","last_active":"2024-05-28T06:13:37.516157+0000","last_peered":"2024-05-28T06:13:37.516157+0000","last_clean":"2024-05-28T06:13:37.516157+0000","last_became_active":"2024-05-28T06:12:31.789907+0000","last_became_peered":"2024-05-28T06:12:31.789907+0000","last_unstale":"2024-05-28T06:13:37.516157+0000","last_undegraded":"2024-05-28T06:13:37.516157+0000","last_fullsized":"2024-05-28T06:13:37.516157+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:22:57.588310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364904448,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":64,"num_read_kb":262144,"num_write":87,"num_write_kb":356352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"62'63","reported_seq":106,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.034266+0000","last_change":"2024-05-28T06:12:31.788326+0000","last_active":"2024-05-28T06:13:36.034266+0000","last_peered":"2024-05-28T06:13:36.034266+0000","last_clean":"2024-05-28T06:13:36.034266+0000","last_became_active":"2024-05-28T06:12:31.788073+0000","last_became_peered":"2024-05-28T06:12:31.788073+0000","last_unstale":"2024-05-28T06:13:36.034266+0000","last_undegraded":"2024-05-28T06:13:36.034266+0000","last_fullsized":"2024-05-28T06:13:36.034266+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:39:57.840865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":31,"num_read_kb":126976,"num_write":63,"num_write_kb":258048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"62'64","reported_seq":130,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.162230+0000","last_change":"2024-05-28T06:12:31.802252+0000","last_active":"2024-05-28T06:13:37.162230+0000","last_peered":"2024-05-28T06:13:37.162230+0000","last_clean":"2024-05-28T06:13:37.162230+0000","last_became_active":"2024-05-28T06:12:31.800507+0000","last_became_peered":"2024-05-28T06:12:31.800507+0000","last_unstale":"2024-05-28T06:13:37.162230+0000","last_undegraded":"2024-05-28T06:13:37.162230+0000","last_fullsized":"2024-05-28T06:13:37.162230+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:27:01.826955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":54,"num_read_kb":221184,"num_write":64,"num_write_kb":262144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"62'67","reported_seq":121,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.761745+0000","last_change":"2024-05-28T06:12:31.798684+0000","last_active":"2024-05-28T06:13:36.761745+0000","last_peered":"2024-05-28T06:13:36.761745+0000","last_clean":"2024-05-28T06:13:36.761745+0000","last_became_active":"2024-05-28T06:12:31.798292+0000","last_became_peered":"2024-05-28T06:12:31.798292+0000","last_unstale":"2024-05-28T06:13:36.761745+0000","last_undegraded":"2024-05-28T06:13:36.761745+0000","last_fullsized":"2024-05-28T06:13:36.761745+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:52:20.582079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":42,"num_read_kb":172032,"num_write":67,"num_write_kb":266241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"62'85","reported_seq":191,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.360362+0000","last_change":"2024-05-28T06:12:31.805307+0000","last_active":"2024-05-28T06:13:37.360362+0000","last_peered":"2024-05-28T06:13:37.360362+0000","last_clean":"2024-05-28T06:13:37.360362+0000","last_became_active":"2024-05-28T06:12:31.805031+0000","last_became_peered":"2024-05-28T06:12:31.805031+0000","last_unstale":"2024-05-28T06:13:37.360362+0000","last_undegraded":"2024-05-28T06:13:37.360362+0000","last_fullsized":"2024-05-28T06:13:37.360362+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:54:23.878943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544581,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":94,"num_read_kb":372739,"num_write":85,"num_write_kb":327683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"62'90","reported_seq":169,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.608022+0000","last_change":"2024-05-28T06:12:31.792875+0000","last_active":"2024-05-28T06:13:37.608022+0000","last_peered":"2024-05-28T06:13:37.608022+0000","last_clean":"2024-05-28T06:13:37.608022+0000","last_became_active":"2024-05-28T06:12:31.792620+0000","last_became_peered":"2024-05-28T06:12:31.792620+0000","last_unstale":"2024-05-28T06:13:37.608022+0000","last_undegraded":"2024-05-28T06:13:37.608022+0000","last_fullsized":"2024-05-28T06:13:37.608022+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:22:45.579115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369098752,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":67,"num_read_kb":274432,"num_write":90,"num_write_kb":360449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"62'72","reported_seq":146,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.372054+0000","last_change":"2024-05-28T06:12:31.790299+0000","last_active":"2024-05-28T06:13:37.372054+0000","last_peered":"2024-05-28T06:13:37.372054+0000","last_clean":"2024-05-28T06:13:37.372054+0000","last_became_active":"2024-05-28T06:12:31.790044+0000","last_became_peered":"2024-05-28T06:12:31.790044+0000","last_unstale":"2024-05-28T06:13:37.372054+0000","last_undegraded":"2024-05-28T06:13:37.372054+0000","last_fullsized":"2024-05-28T06:13:37.372054+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:33:57.828699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":62,"num_read_kb":253952,"num_write":71,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"62'82","reported_seq":189,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.612855+0000","last_change":"2024-05-28T06:12:31.799285+0000","last_active":"2024-05-28T06:13:37.612855+0000","last_peered":"2024-05-28T06:13:37.612855+0000","last_clean":"2024-05-28T06:13:37.612855+0000","last_became_active":"2024-05-28T06:12:31.798652+0000","last_became_peered":"2024-05-28T06:12:31.798652+0000","last_unstale":"2024-05-28T06:13:37.612855+0000","last_undegraded":"2024-05-28T06:13:37.612855+0000","last_fullsized":"2024-05-28T06:13:37.612855+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:27:01.826955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327155712,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":95,"num_read_kb":376835,"num_write":82,"num_write_kb":319490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"62'78","reported_seq":151,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.490749+0000","last_change":"2024-05-28T06:12:31.802895+0000","last_active":"2024-05-28T06:13:37.490749+0000","last_peered":"2024-05-28T06:13:37.490749+0000","last_clean":"2024-05-28T06:13:37.490749+0000","last_became_active":"2024-05-28T06:12:31.795520+0000","last_became_peered":"2024-05-28T06:12:31.795520+0000","last_unstale":"2024-05-28T06:13:37.490749+0000","last_undegraded":"2024-05-28T06:13:37.490749+0000","last_fullsized":"2024-05-28T06:13:37.490749+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:06:30.752272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":61,"num_read_kb":241666,"num_write":77,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"62'83","reported_seq":152,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.174936+0000","last_change":"2024-05-28T06:12:31.806502+0000","last_active":"2024-05-28T06:13:37.174936+0000","last_peered":"2024-05-28T06:13:37.174936+0000","last_clean":"2024-05-28T06:13:37.174936+0000","last_became_active":"2024-05-28T06:12:31.805993+0000","last_became_peered":"2024-05-28T06:12:31.805993+0000","last_unstale":"2024-05-28T06:13:37.174936+0000","last_undegraded":"2024-05-28T06:13:37.174936+0000","last_fullsized":"2024-05-28T06:13:37.174936+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:43:33.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":348127232,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":57,"num_read_kb":233472,"num_write":83,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"62'79","reported_seq":147,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.284280+0000","last_change":"2024-05-28T06:12:31.801483+0000","last_active":"2024-05-28T06:13:37.284280+0000","last_peered":"2024-05-28T06:13:37.284280+0000","last_clean":"2024-05-28T06:13:37.284280+0000","last_became_active":"2024-05-28T06:12:31.801026+0000","last_became_peered":"2024-05-28T06:12:31.801026+0000","last_unstale":"2024-05-28T06:13:37.284280+0000","last_undegraded":"2024-05-28T06:13:37.284280+0000","last_fullsized":"2024-05-28T06:13:37.284280+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:09:57.797411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":56,"num_read_kb":229376,"num_write":79,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"62'79","reported_seq":159,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.558623+0000","last_change":"2024-05-28T06:12:31.798043+0000","last_active":"2024-05-28T06:13:37.558623+0000","last_peered":"2024-05-28T06:13:37.558623+0000","last_clean":"2024-05-28T06:13:37.558623+0000","last_became_active":"2024-05-28T06:12:31.794016+0000","last_became_peered":"2024-05-28T06:12:31.794016+0000","last_unstale":"2024-05-28T06:13:37.558623+0000","last_undegraded":"2024-05-28T06:13:37.558623+0000","last_fullsized":"2024-05-28T06:13:37.558623+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:35:46.267952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":68,"num_read_kb":266243,"num_write":79,"num_write_kb":307202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"62'66","reported_seq":144,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.394733+0000","last_change":"2024-05-28T06:12:31.788822+0000","last_active":"2024-05-28T06:13:37.394733+0000","last_peered":"2024-05-28T06:13:37.394733+0000","last_clean":"2024-05-28T06:13:37.394733+0000","last_became_active":"2024-05-28T06:12:31.788550+0000","last_became_peered":"2024-05-28T06:12:31.788550+0000","last_unstale":"2024-05-28T06:13:37.394733+0000","last_undegraded":"2024-05-28T06:13:37.394733+0000","last_fullsized":"2024-05-28T06:13:37.394733+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:55:16.457872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":66,"num_read_kb":270336,"num_write":65,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"62'82","reported_seq":160,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.317767+0000","last_change":"2024-05-28T06:12:31.793103+0000","last_active":"2024-05-28T06:13:37.317767+0000","last_peered":"2024-05-28T06:13:37.317767+0000","last_clean":"2024-05-28T06:13:37.317767+0000","last_became_active":"2024-05-28T06:12:31.792595+0000","last_became_peered":"2024-05-28T06:12:31.792595+0000","last_unstale":"2024-05-28T06:13:37.317767+0000","last_undegraded":"2024-05-28T06:13:37.317767+0000","last_fullsized":"2024-05-28T06:13:37.317767+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:30:32.490570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343932928,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":66,"num_read_kb":270336,"num_write":82,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"62'82","reported_seq":128,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.630699+0000","last_change":"2024-05-28T06:12:31.800295+0000","last_active":"2024-05-28T06:13:37.630699+0000","last_peered":"2024-05-28T06:13:37.630699+0000","last_clean":"2024-05-28T06:13:37.630699+0000","last_became_active":"2024-05-28T06:12:31.800042+0000","last_became_peered":"2024-05-28T06:12:31.800042+0000","last_unstale":"2024-05-28T06:13:37.630699+0000","last_undegraded":"2024-05-28T06:13:37.630699+0000","last_fullsized":"2024-05-28T06:13:37.630699+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:30:39.340469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327155712,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":34,"num_read_kb":131074,"num_write":82,"num_write_kb":319490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"62'85","reported_seq":168,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.421829+0000","last_change":"2024-05-28T06:12:31.798980+0000","last_active":"2024-05-28T06:13:37.421829+0000","last_peered":"2024-05-28T06:13:37.421829+0000","last_clean":"2024-05-28T06:13:37.421829+0000","last_became_active":"2024-05-28T06:12:31.798695+0000","last_became_peered":"2024-05-28T06:12:31.798695+0000","last_unstale":"2024-05-28T06:13:37.421829+0000","last_undegraded":"2024-05-28T06:13:37.421829+0000","last_fullsized":"2024-05-28T06:13:37.421829+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:40:22.486569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352321668,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":71,"num_read_kb":286721,"num_write":85,"num_write_kb":344065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"62'77","reported_seq":154,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.316493+0000","last_change":"2024-05-28T06:12:31.803916+0000","last_active":"2024-05-28T06:13:37.316493+0000","last_peered":"2024-05-28T06:13:37.316493+0000","last_clean":"2024-05-28T06:13:37.316493+0000","last_became_active":"2024-05-28T06:12:31.803396+0000","last_became_peered":"2024-05-28T06:12:31.803396+0000","last_unstale":"2024-05-28T06:13:37.316493+0000","last_undegraded":"2024-05-28T06:13:37.316493+0000","last_fullsized":"2024-05-28T06:13:37.316493+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:59:14.477995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322961408,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":65,"num_read_kb":266240,"num_write":77,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"62'69","reported_seq":175,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.352635+0000","last_change":"2024-05-28T06:12:31.797444+0000","last_active":"2024-05-28T06:13:37.352635+0000","last_peered":"2024-05-28T06:13:37.352635+0000","last_clean":"2024-05-28T06:13:37.352635+0000","last_became_active":"2024-05-28T06:12:31.797170+0000","last_became_peered":"2024-05-28T06:12:31.797170+0000","last_unstale":"2024-05-28T06:13:37.352635+0000","last_undegraded":"2024-05-28T06:13:37.352635+0000","last_fullsized":"2024-05-28T06:13:37.352635+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:48:34.278938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":94,"num_read_kb":385024,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"62'71","reported_seq":154,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.532423+0000","last_change":"2024-05-28T06:12:31.787961+0000","last_active":"2024-05-28T06:13:36.532423+0000","last_peered":"2024-05-28T06:13:36.532423+0000","last_clean":"2024-05-28T06:13:36.532423+0000","last_became_active":"2024-05-28T06:12:31.787700+0000","last_became_peered":"2024-05-28T06:12:31.787700+0000","last_unstale":"2024-05-28T06:13:36.532423+0000","last_undegraded":"2024-05-28T06:13:36.532423+0000","last_fullsized":"2024-05-28T06:13:36.532423+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:43:33.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":71,"num_read_kb":290816,"num_write":71,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"62'67","reported_seq":121,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.317857+0000","last_change":"2024-05-28T06:12:31.802935+0000","last_active":"2024-05-28T06:13:37.317857+0000","last_peered":"2024-05-28T06:13:37.317857+0000","last_clean":"2024-05-28T06:13:37.317857+0000","last_became_active":"2024-05-28T06:12:31.802678+0000","last_became_peered":"2024-05-28T06:12:31.802678+0000","last_unstale":"2024-05-28T06:13:37.317857+0000","last_undegraded":"2024-05-28T06:13:37.317857+0000","last_fullsized":"2024-05-28T06:13:37.317857+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:08:26.147408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":42,"num_read_kb":172032,"num_write":67,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.799783+0000","last_change":"2024-05-28T06:12:30.791032+0000","last_active":"2024-05-28T06:12:32.799783+0000","last_peered":"2024-05-28T06:12:32.799783+0000","last_clean":"2024-05-28T06:12:32.799783+0000","last_became_active":"2024-05-28T06:12:30.790720+0000","last_became_peered":"2024-05-28T06:12:30.790720+0000","last_unstale":"2024-05-28T06:12:32.799783+0000","last_undegraded":"2024-05-28T06:12:32.799783+0000","last_fullsized":"2024-05-28T06:12:32.799783+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:02:31.893460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"62'75","reported_seq":156,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.146636+0000","last_change":"2024-05-28T06:12:31.801501+0000","last_active":"2024-05-28T06:13:37.146636+0000","last_peered":"2024-05-28T06:13:37.146636+0000","last_clean":"2024-05-28T06:13:37.146636+0000","last_became_active":"2024-05-28T06:12:31.801239+0000","last_became_peered":"2024-05-28T06:12:31.801239+0000","last_unstale":"2024-05-28T06:13:37.146636+0000","last_undegraded":"2024-05-28T06:13:37.146636+0000","last_fullsized":"2024-05-28T06:13:37.146636+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:12:32.364138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301990149,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":69,"num_read_kb":278529,"num_write":75,"num_write_kb":294914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.780843+0000","last_change":"2024-05-28T06:12:30.799690+0000","last_active":"2024-05-28T06:12:32.780843+0000","last_peered":"2024-05-28T06:12:32.780843+0000","last_clean":"2024-05-28T06:12:32.780843+0000","last_became_active":"2024-05-28T06:12:30.799345+0000","last_became_peered":"2024-05-28T06:12:30.799345+0000","last_unstale":"2024-05-28T06:12:32.780843+0000","last_undegraded":"2024-05-28T06:12:32.780843+0000","last_fullsized":"2024-05-28T06:12:32.780843+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:53:56.132162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"62'73","reported_seq":159,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.030308+0000","last_change":"2024-05-28T06:12:31.787304+0000","last_active":"2024-05-28T06:13:37.030308+0000","last_peered":"2024-05-28T06:13:37.030308+0000","last_clean":"2024-05-28T06:13:37.030308+0000","last_became_active":"2024-05-28T06:12:31.786982+0000","last_became_peered":"2024-05-28T06:12:31.786982+0000","last_unstale":"2024-05-28T06:13:37.030308+0000","last_undegraded":"2024-05-28T06:13:37.030308+0000","last_fullsized":"2024-05-28T06:13:37.030308+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:30:34.090290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":74,"num_read_kb":286724,"num_write":73,"num_write_kb":282626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"62'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.799729+0000","last_change":"2024-05-28T06:12:30.784064+0000","last_active":"2024-05-28T06:12:32.799729+0000","last_peered":"2024-05-28T06:12:32.799729+0000","last_clean":"2024-05-28T06:12:32.799729+0000","last_became_active":"2024-05-28T06:12:30.783801+0000","last_became_peered":"2024-05-28T06:12:30.783801+0000","last_unstale":"2024-05-28T06:12:32.799729+0000","last_undegraded":"2024-05-28T06:12:32.799729+0000","last_fullsized":"2024-05-28T06:12:32.799729+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:21:00.162134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"62'85","reported_seq":183,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.591565+0000","last_change":"2024-05-28T06:12:31.799781+0000","last_active":"2024-05-28T06:13:36.591565+0000","last_peered":"2024-05-28T06:13:36.591565+0000","last_clean":"2024-05-28T06:13:36.591565+0000","last_became_active":"2024-05-28T06:12:31.799517+0000","last_became_peered":"2024-05-28T06:12:31.799517+0000","last_unstale":"2024-05-28T06:13:36.591565+0000","last_undegraded":"2024-05-28T06:13:36.591565+0000","last_fullsized":"2024-05-28T06:13:36.591565+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:53:57.139243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356515840,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":86,"num_read_kb":352256,"num_write":85,"num_write_kb":348160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.782540+0000","last_change":"2024-05-28T06:12:30.795765+0000","last_active":"2024-05-28T06:12:32.782540+0000","last_peered":"2024-05-28T06:12:32.782540+0000","last_clean":"2024-05-28T06:12:32.782540+0000","last_became_active":"2024-05-28T06:12:30.795164+0000","last_became_peered":"2024-05-28T06:12:30.795164+0000","last_unstale":"2024-05-28T06:12:32.782540+0000","last_undegraded":"2024-05-28T06:12:32.782540+0000","last_fullsized":"2024-05-28T06:12:32.782540+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:20:40.469531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"62'74","reported_seq":143,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.356354+0000","last_change":"2024-05-28T06:12:31.801832+0000","last_active":"2024-05-28T06:13:37.356354+0000","last_peered":"2024-05-28T06:13:37.356354+0000","last_clean":"2024-05-28T06:13:37.356354+0000","last_became_active":"2024-05-28T06:12:31.795154+0000","last_became_peered":"2024-05-28T06:12:31.795154+0000","last_unstale":"2024-05-28T06:13:37.356354+0000","last_undegraded":"2024-05-28T06:13:37.356354+0000","last_fullsized":"2024-05-28T06:13:37.356354+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:49:40.536846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":57,"num_read_kb":233472,"num_write":74,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.560759+0000","last_change":"2024-05-28T06:12:30.793046+0000","last_active":"2024-05-28T06:12:33.560759+0000","last_peered":"2024-05-28T06:12:33.560759+0000","last_clean":"2024-05-28T06:12:33.560759+0000","last_became_active":"2024-05-28T06:12:30.792752+0000","last_became_peered":"2024-05-28T06:12:30.792752+0000","last_unstale":"2024-05-28T06:12:33.560759+0000","last_undegraded":"2024-05-28T06:12:33.560759+0000","last_fullsized":"2024-05-28T06:12:33.560759+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:03:08.736169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"62'75","reported_seq":181,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.392229+0000","last_change":"2024-05-28T06:12:31.789865+0000","last_active":"2024-05-28T06:13:37.392229+0000","last_peered":"2024-05-28T06:13:37.392229+0000","last_clean":"2024-05-28T06:13:37.392229+0000","last_became_active":"2024-05-28T06:12:31.789614+0000","last_became_peered":"2024-05-28T06:12:31.789614+0000","last_unstale":"2024-05-28T06:13:37.392229+0000","last_undegraded":"2024-05-28T06:13:37.392229+0000","last_fullsized":"2024-05-28T06:13:37.392229+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:06:00.739339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":94,"num_read_kb":385024,"num_write":75,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.798994+0000","last_change":"2024-05-28T06:12:30.790331+0000","last_active":"2024-05-28T06:12:32.798994+0000","last_peered":"2024-05-28T06:12:32.798994+0000","last_clean":"2024-05-28T06:12:32.798994+0000","last_became_active":"2024-05-28T06:12:30.790028+0000","last_became_peered":"2024-05-28T06:12:30.790028+0000","last_unstale":"2024-05-28T06:12:32.798994+0000","last_undegraded":"2024-05-28T06:12:32.798994+0000","last_fullsized":"2024-05-28T06:12:32.798994+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:01:52.086398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"62'77","reported_seq":163,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.256784+0000","last_change":"2024-05-28T06:12:31.798571+0000","last_active":"2024-05-28T06:13:37.256784+0000","last_peered":"2024-05-28T06:13:37.256784+0000","last_clean":"2024-05-28T06:13:37.256784+0000","last_became_active":"2024-05-28T06:12:31.797004+0000","last_became_peered":"2024-05-28T06:12:31.797004+0000","last_unstale":"2024-05-28T06:13:37.256784+0000","last_undegraded":"2024-05-28T06:13:37.256784+0000","last_fullsized":"2024-05-28T06:13:37.256784+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:21:06.719589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":74,"num_read_kb":294914,"num_write":77,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.781942+0000","last_change":"2024-05-28T06:12:30.792493+0000","last_active":"2024-05-28T06:12:32.781942+0000","last_peered":"2024-05-28T06:12:32.781942+0000","last_clean":"2024-05-28T06:12:32.781942+0000","last_became_active":"2024-05-28T06:12:30.791832+0000","last_became_peered":"2024-05-28T06:12:30.791832+0000","last_unstale":"2024-05-28T06:12:32.781942+0000","last_undegraded":"2024-05-28T06:12:32.781942+0000","last_fullsized":"2024-05-28T06:12:32.781942+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:02:31.893460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"62'76","reported_seq":152,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.164180+0000","last_change":"2024-05-28T06:12:31.804063+0000","last_active":"2024-05-28T06:13:37.164180+0000","last_peered":"2024-05-28T06:13:37.164180+0000","last_clean":"2024-05-28T06:13:37.164180+0000","last_became_active":"2024-05-28T06:12:31.803791+0000","last_became_peered":"2024-05-28T06:12:31.803791+0000","last_unstale":"2024-05-28T06:13:37.164180+0000","last_undegraded":"2024-05-28T06:13:37.164180+0000","last_fullsized":"2024-05-28T06:13:37.164180+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:05:13.800609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":64,"num_read_kb":253954,"num_write":76,"num_write_kb":303105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.560668+0000","last_change":"2024-05-28T06:12:30.792385+0000","last_active":"2024-05-28T06:12:33.560668+0000","last_peered":"2024-05-28T06:12:33.560668+0000","last_clean":"2024-05-28T06:12:33.560668+0000","last_became_active":"2024-05-28T06:12:30.789854+0000","last_became_peered":"2024-05-28T06:12:30.789854+0000","last_unstale":"2024-05-28T06:12:33.560668+0000","last_undegraded":"2024-05-28T06:12:33.560668+0000","last_fullsized":"2024-05-28T06:12:33.560668+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:52:08.811888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"62'64","reported_seq":112,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.060841+0000","last_change":"2024-05-28T06:12:31.791507+0000","last_active":"2024-05-28T06:13:37.060841+0000","last_peered":"2024-05-28T06:13:37.060841+0000","last_clean":"2024-05-28T06:13:37.060841+0000","last_became_active":"2024-05-28T06:12:31.788910+0000","last_became_peered":"2024-05-28T06:12:31.788910+0000","last_unstale":"2024-05-28T06:13:37.060841+0000","last_undegraded":"2024-05-28T06:13:37.060841+0000","last_fullsized":"2024-05-28T06:13:37.060841+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:33:08.387840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":36,"num_read_kb":147456,"num_write":64,"num_write_kb":262144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"62'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.561581+0000","last_change":"2024-05-28T06:12:30.796608+0000","last_active":"2024-05-28T06:12:33.561581+0000","last_peered":"2024-05-28T06:12:33.561581+0000","last_clean":"2024-05-28T06:12:33.561581+0000","last_became_active":"2024-05-28T06:12:30.796011+0000","last_became_peered":"2024-05-28T06:12:30.796011+0000","last_unstale":"2024-05-28T06:12:33.561581+0000","last_undegraded":"2024-05-28T06:12:33.561581+0000","last_fullsized":"2024-05-28T06:12:33.561581+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:03:08.736169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"62'71","reported_seq":123,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.804571+0000","last_change":"2024-05-28T06:12:31.807786+0000","last_active":"2024-05-28T06:13:36.804571+0000","last_peered":"2024-05-28T06:13:36.804571+0000","last_clean":"2024-05-28T06:13:36.804571+0000","last_became_active":"2024-05-28T06:12:31.807524+0000","last_became_peered":"2024-05-28T06:12:31.807524+0000","last_unstale":"2024-05-28T06:13:36.804571+0000","last_undegraded":"2024-05-28T06:13:36.804571+0000","last_fullsized":"2024-05-28T06:13:36.804571+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:53:57.139243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":40,"num_read_kb":163840,"num_write":71,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.780950+0000","last_change":"2024-05-28T06:12:30.798374+0000","last_active":"2024-05-28T06:12:32.780950+0000","last_peered":"2024-05-28T06:12:32.780950+0000","last_clean":"2024-05-28T06:12:32.780950+0000","last_became_active":"2024-05-28T06:12:30.798033+0000","last_became_peered":"2024-05-28T06:12:30.798033+0000","last_unstale":"2024-05-28T06:12:32.780950+0000","last_undegraded":"2024-05-28T06:12:32.780950+0000","last_fullsized":"2024-05-28T06:12:32.780950+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:30:33.083208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"62'70","reported_seq":163,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.240601+0000","last_change":"2024-05-28T06:12:31.791600+0000","last_active":"2024-05-28T06:13:37.240601+0000","last_peered":"2024-05-28T06:13:37.240601+0000","last_clean":"2024-05-28T06:13:37.240601+0000","last_became_active":"2024-05-28T06:12:31.789590+0000","last_became_peered":"2024-05-28T06:12:31.789590+0000","last_unstale":"2024-05-28T06:13:37.240601+0000","last_undegraded":"2024-05-28T06:13:37.240601+0000","last_fullsized":"2024-05-28T06:13:37.240601+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:21:06.719589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":81,"num_read_kb":331776,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"62'24","reported_seq":38,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:39.929351+0000","last_change":"2024-05-28T06:12:30.794636+0000","last_active":"2024-05-28T06:13:39.929351+0000","last_peered":"2024-05-28T06:13:39.929351+0000","last_clean":"2024-05-28T06:13:39.929351+0000","last_became_active":"2024-05-28T06:12:30.794322+0000","last_became_peered":"2024-05-28T06:12:30.794322+0000","last_unstale":"2024-05-28T06:13:39.929351+0000","last_undegraded":"2024-05-28T06:13:39.929351+0000","last_fullsized":"2024-05-28T06:13:39.929351+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:21:00.162134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"62'68","reported_seq":141,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.027341+0000","last_change":"2024-05-28T06:12:31.806694+0000","last_active":"2024-05-28T06:13:37.027341+0000","last_peered":"2024-05-28T06:13:37.027341+0000","last_clean":"2024-05-28T06:13:37.027341+0000","last_became_active":"2024-05-28T06:12:31.806339+0000","last_became_peered":"2024-05-28T06:12:31.806339+0000","last_unstale":"2024-05-28T06:13:37.027341+0000","last_undegraded":"2024-05-28T06:13:37.027341+0000","last_fullsized":"2024-05-28T06:13:37.027341+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:30:32.490570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":61,"num_read_kb":245761,"num_write":67,"num_write_kb":266241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"62'423","reported_seq":437,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:55.891712+0000","last_change":"2024-05-28T06:12:30.791461+0000","last_active":"2024-05-28T06:13:55.891712+0000","last_peered":"2024-05-28T06:13:55.891712+0000","last_clean":"2024-05-28T06:13:55.891712+0000","last_became_active":"2024-05-28T06:12:30.791190+0000","last_became_peered":"2024-05-28T06:12:30.791190+0000","last_unstale":"2024-05-28T06:13:55.891712+0000","last_undegraded":"2024-05-28T06:13:55.891712+0000","last_fullsized":"2024-05-28T06:13:55.891712+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:01:52.086398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1666114,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":422,"num_write_kb":1782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"62'75","reported_seq":136,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.086390+0000","last_change":"2024-05-28T06:12:31.796224+0000","last_active":"2024-05-28T06:13:37.086390+0000","last_peered":"2024-05-28T06:13:37.086390+0000","last_clean":"2024-05-28T06:13:37.086390+0000","last_became_active":"2024-05-28T06:12:31.794242+0000","last_became_peered":"2024-05-28T06:12:31.794242+0000","last_unstale":"2024-05-28T06:13:37.086390+0000","last_undegraded":"2024-05-28T06:13:37.086390+0000","last_fullsized":"2024-05-28T06:13:37.086390+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:21:56.535399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":49,"num_read_kb":200704,"num_write":75,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.780490+0000","last_change":"2024-05-28T06:12:30.794765+0000","last_active":"2024-05-28T06:12:32.780490+0000","last_peered":"2024-05-28T06:12:32.780490+0000","last_clean":"2024-05-28T06:12:32.780490+0000","last_became_active":"2024-05-28T06:12:30.794488+0000","last_became_peered":"2024-05-28T06:12:30.794488+0000","last_unstale":"2024-05-28T06:12:32.780490+0000","last_undegraded":"2024-05-28T06:12:32.780490+0000","last_fullsized":"2024-05-28T06:12:32.780490+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:30:31.483489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"62'92","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.393713+0000","last_change":"2024-05-28T06:12:31.803083+0000","last_active":"2024-05-28T06:13:37.393713+0000","last_peered":"2024-05-28T06:13:37.393713+0000","last_clean":"2024-05-28T06:13:37.393713+0000","last_became_active":"2024-05-28T06:12:31.802789+0000","last_became_peered":"2024-05-28T06:12:31.802789+0000","last_unstale":"2024-05-28T06:13:37.393713+0000","last_undegraded":"2024-05-28T06:13:37.393713+0000","last_fullsized":"2024-05-28T06:13:37.393713+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:24:28.859928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369098752,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":53,"num_read_kb":212993,"num_write":92,"num_write_kb":360450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.800554+0000","last_change":"2024-05-28T06:12:30.795959+0000","last_active":"2024-05-28T06:12:32.800554+0000","last_peered":"2024-05-28T06:12:32.800554+0000","last_clean":"2024-05-28T06:12:32.800554+0000","last_became_active":"2024-05-28T06:12:30.795666+0000","last_became_peered":"2024-05-28T06:12:30.795666+0000","last_unstale":"2024-05-28T06:12:32.800554+0000","last_undegraded":"2024-05-28T06:12:32.800554+0000","last_fullsized":"2024-05-28T06:12:32.800554+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:52:42.932309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"62'63","reported_seq":133,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.235936+0000","last_change":"2024-05-28T06:12:31.795558+0000","last_active":"2024-05-28T06:13:37.235936+0000","last_peered":"2024-05-28T06:13:37.235936+0000","last_clean":"2024-05-28T06:13:37.235936+0000","last_became_active":"2024-05-28T06:12:31.795281+0000","last_became_peered":"2024-05-28T06:12:31.795281+0000","last_unstale":"2024-05-28T06:13:37.235936+0000","last_undegraded":"2024-05-28T06:13:37.235936+0000","last_fullsized":"2024-05-28T06:13:37.235936+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:54:31.487426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":58,"num_read_kb":237568,"num_write":63,"num_write_kb":258048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.782127+0000","last_change":"2024-05-28T06:12:30.792703+0000","last_active":"2024-05-28T06:12:32.782127+0000","last_peered":"2024-05-28T06:12:32.782127+0000","last_clean":"2024-05-28T06:12:32.782127+0000","last_became_active":"2024-05-28T06:12:30.792218+0000","last_became_peered":"2024-05-28T06:12:30.792218+0000","last_unstale":"2024-05-28T06:12:32.782127+0000","last_undegraded":"2024-05-28T06:12:32.782127+0000","last_fullsized":"2024-05-28T06:12:32.782127+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:14:39.566092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"62'95","reported_seq":176,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.404448+0000","last_change":"2024-05-28T06:12:31.806242+0000","last_active":"2024-05-28T06:13:37.404448+0000","last_peered":"2024-05-28T06:13:37.404448+0000","last_clean":"2024-05-28T06:13:37.404448+0000","last_became_active":"2024-05-28T06:12:31.805628+0000","last_became_peered":"2024-05-28T06:12:31.805628+0000","last_unstale":"2024-05-28T06:13:37.404448+0000","last_undegraded":"2024-05-28T06:13:37.404448+0000","last_fullsized":"2024-05-28T06:13:37.404448+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:21:56.535399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394264837,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":69,"num_read_kb":282624,"num_write":95,"num_write_kb":385025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.560455+0000","last_change":"2024-05-28T06:12:30.797372+0000","last_active":"2024-05-28T06:12:33.560455+0000","last_peered":"2024-05-28T06:12:33.560455+0000","last_clean":"2024-05-28T06:12:33.560455+0000","last_became_active":"2024-05-28T06:12:30.797105+0000","last_became_peered":"2024-05-28T06:12:30.797105+0000","last_unstale":"2024-05-28T06:12:33.560455+0000","last_undegraded":"2024-05-28T06:12:33.560455+0000","last_fullsized":"2024-05-28T06:12:33.560455+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:01:52.086398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"62'67","reported_seq":104,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.315357+0000","last_change":"2024-05-28T06:12:31.802256+0000","last_active":"2024-05-28T06:13:37.315357+0000","last_peered":"2024-05-28T06:13:37.315357+0000","last_clean":"2024-05-28T06:13:37.315357+0000","last_became_active":"2024-05-28T06:12:31.800610+0000","last_became_peered":"2024-05-28T06:12:31.800610+0000","last_unstale":"2024-05-28T06:13:37.315357+0000","last_undegraded":"2024-05-28T06:13:37.315357+0000","last_fullsized":"2024-05-28T06:13:37.315357+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:22:44.741189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":25,"num_read_kb":102400,"num_write":67,"num_write_kb":266241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.781051+0000","last_change":"2024-05-28T06:12:30.797106+0000","last_active":"2024-05-28T06:12:32.781051+0000","last_peered":"2024-05-28T06:12:32.781051+0000","last_clean":"2024-05-28T06:12:32.781051+0000","last_became_active":"2024-05-28T06:12:30.795350+0000","last_became_peered":"2024-05-28T06:12:30.795350+0000","last_unstale":"2024-05-28T06:12:32.781051+0000","last_undegraded":"2024-05-28T06:12:32.781051+0000","last_fullsized":"2024-05-28T06:12:32.781051+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:24:27.852847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"62'86","reported_seq":179,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.289872+0000","last_change":"2024-05-28T06:12:31.794618+0000","last_active":"2024-05-28T06:13:37.289872+0000","last_peered":"2024-05-28T06:13:37.289872+0000","last_clean":"2024-05-28T06:13:37.289872+0000","last_became_active":"2024-05-28T06:12:31.794358+0000","last_became_peered":"2024-05-28T06:12:31.794358+0000","last_unstale":"2024-05-28T06:13:37.289872+0000","last_undegraded":"2024-05-28T06:13:37.289872+0000","last_fullsized":"2024-05-28T06:13:37.289872+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:30:32.490570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356515972,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":81,"num_read_kb":327681,"num_write":86,"num_write_kb":348161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.799366+0000","last_change":"2024-05-28T06:12:30.793010+0000","last_active":"2024-05-28T06:12:32.799366+0000","last_peered":"2024-05-28T06:12:32.799366+0000","last_clean":"2024-05-28T06:12:32.799366+0000","last_became_active":"2024-05-28T06:12:30.792705+0000","last_became_peered":"2024-05-28T06:12:30.792705+0000","last_unstale":"2024-05-28T06:12:32.799366+0000","last_undegraded":"2024-05-28T06:12:32.799366+0000","last_fullsized":"2024-05-28T06:12:32.799366+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:37:55.600898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"62'65","reported_seq":138,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.196607+0000","last_change":"2024-05-28T06:12:31.790772+0000","last_active":"2024-05-28T06:13:37.196607+0000","last_peered":"2024-05-28T06:13:37.196607+0000","last_clean":"2024-05-28T06:13:37.196607+0000","last_became_active":"2024-05-28T06:12:31.790509+0000","last_became_peered":"2024-05-28T06:12:31.790509+0000","last_unstale":"2024-05-28T06:13:37.196607+0000","last_undegraded":"2024-05-28T06:13:37.196607+0000","last_fullsized":"2024-05-28T06:13:37.196607+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:25:51.424031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658501,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":61,"num_read_kb":233476,"num_write":65,"num_write_kb":245763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.782296+0000","last_change":"2024-05-28T06:12:30.797084+0000","last_active":"2024-05-28T06:12:32.782296+0000","last_peered":"2024-05-28T06:12:32.782296+0000","last_clean":"2024-05-28T06:12:32.782296+0000","last_became_active":"2024-05-28T06:12:30.795903+0000","last_became_peered":"2024-05-28T06:12:30.795903+0000","last_unstale":"2024-05-28T06:12:32.782296+0000","last_undegraded":"2024-05-28T06:12:32.782296+0000","last_fullsized":"2024-05-28T06:12:32.782296+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:54:30.480345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"62'70","reported_seq":161,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.493094+0000","last_change":"2024-05-28T06:12:31.809139+0000","last_active":"2024-05-28T06:13:37.493094+0000","last_peered":"2024-05-28T06:13:37.493094+0000","last_clean":"2024-05-28T06:13:37.493094+0000","last_became_active":"2024-05-28T06:12:31.807373+0000","last_became_peered":"2024-05-28T06:12:31.807373+0000","last_unstale":"2024-05-28T06:13:37.493094+0000","last_undegraded":"2024-05-28T06:13:37.493094+0000","last_fullsized":"2024-05-28T06:13:37.493094+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:30:34.090290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":79,"num_read_kb":323584,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.799295+0000","last_change":"2024-05-28T06:12:30.793875+0000","last_active":"2024-05-28T06:12:32.799295+0000","last_peered":"2024-05-28T06:12:32.799295+0000","last_clean":"2024-05-28T06:12:32.799295+0000","last_became_active":"2024-05-28T06:12:30.793587+0000","last_became_peered":"2024-05-28T06:12:30.793587+0000","last_unstale":"2024-05-28T06:12:32.799295+0000","last_undegraded":"2024-05-28T06:12:32.799295+0000","last_fullsized":"2024-05-28T06:12:32.799295+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:03:08.736169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"62'97","reported_seq":189,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.393853+0000","last_change":"2024-05-28T06:12:31.794925+0000","last_active":"2024-05-28T06:13:37.393853+0000","last_peered":"2024-05-28T06:13:37.393853+0000","last_clean":"2024-05-28T06:13:37.393853+0000","last_became_active":"2024-05-28T06:12:31.793880+0000","last_became_peered":"2024-05-28T06:12:31.793880+0000","last_unstale":"2024-05-28T06:13:37.393853+0000","last_undegraded":"2024-05-28T06:13:37.393853+0000","last_fullsized":"2024-05-28T06:13:37.393853+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:24:28.859928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406847488,"num_objects":97,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":80,"num_read_kb":327680,"num_write":97,"num_write_kb":397312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"62'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.780684+0000","last_change":"2024-05-28T06:12:30.794189+0000","last_active":"2024-05-28T06:12:32.780684+0000","last_peered":"2024-05-28T06:12:32.780684+0000","last_clean":"2024-05-28T06:12:32.780684+0000","last_became_active":"2024-05-28T06:12:30.793922+0000","last_became_peered":"2024-05-28T06:12:30.793922+0000","last_unstale":"2024-05-28T06:12:32.780684+0000","last_undegraded":"2024-05-28T06:12:32.780684+0000","last_fullsized":"2024-05-28T06:12:32.780684+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:08:25.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"62'79","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.489511+0000","last_change":"2024-05-28T06:12:31.797123+0000","last_active":"2024-05-28T06:13:36.489511+0000","last_peered":"2024-05-28T06:13:36.489511+0000","last_clean":"2024-05-28T06:13:36.489511+0000","last_became_active":"2024-05-28T06:12:31.796849+0000","last_became_peered":"2024-05-28T06:12:31.796849+0000","last_unstale":"2024-05-28T06:13:36.489511+0000","last_undegraded":"2024-05-28T06:13:36.489511+0000","last_fullsized":"2024-05-28T06:13:36.489511+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:55:16.457872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":66,"num_read_kb":249861,"num_write":79,"num_write_kb":307202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.561764+0000","last_change":"2024-05-28T06:12:30.796022+0000","last_active":"2024-05-28T06:12:33.561764+0000","last_peered":"2024-05-28T06:12:33.561764+0000","last_clean":"2024-05-28T06:12:33.561764+0000","last_became_active":"2024-05-28T06:12:30.794505+0000","last_became_peered":"2024-05-28T06:12:30.794505+0000","last_unstale":"2024-05-28T06:12:33.561764+0000","last_undegraded":"2024-05-28T06:12:33.561764+0000","last_fullsized":"2024-05-28T06:12:33.561764+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:32:08.488200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"62'69","reported_seq":139,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.116548+0000","last_change":"2024-05-28T06:12:31.802246+0000","last_active":"2024-05-28T06:13:37.116548+0000","last_peered":"2024-05-28T06:13:37.116548+0000","last_clean":"2024-05-28T06:13:37.116548+0000","last_became_active":"2024-05-28T06:12:31.801961+0000","last_became_peered":"2024-05-28T06:12:31.801961+0000","last_unstale":"2024-05-28T06:13:37.116548+0000","last_undegraded":"2024-05-28T06:13:37.116548+0000","last_fullsized":"2024-05-28T06:13:37.116548+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:21:56.535399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":58,"num_read_kb":237568,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.781996+0000","last_change":"2024-05-28T06:12:30.790810+0000","last_active":"2024-05-28T06:12:32.781996+0000","last_peered":"2024-05-28T06:12:32.781996+0000","last_clean":"2024-05-28T06:12:32.781996+0000","last_became_active":"2024-05-28T06:12:30.790513+0000","last_became_peered":"2024-05-28T06:12:30.790513+0000","last_unstale":"2024-05-28T06:12:32.781996+0000","last_undegraded":"2024-05-28T06:12:32.781996+0000","last_fullsized":"2024-05-28T06:12:32.781996+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:31:14.976810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"62'80","reported_seq":130,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.201588+0000","last_change":"2024-05-28T06:12:31.804263+0000","last_active":"2024-05-28T06:13:37.201588+0000","last_peered":"2024-05-28T06:13:37.201588+0000","last_clean":"2024-05-28T06:13:37.201588+0000","last_became_active":"2024-05-28T06:12:31.803936+0000","last_became_peered":"2024-05-28T06:12:31.803936+0000","last_unstale":"2024-05-28T06:13:37.201588+0000","last_undegraded":"2024-05-28T06:13:37.201588+0000","last_fullsized":"2024-05-28T06:13:37.201588+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:30:34.090290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":38,"num_read_kb":155648,"num_write":80,"num_write_kb":327680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.562377+0000","last_change":"2024-05-28T06:12:30.798073+0000","last_active":"2024-05-28T06:12:33.562377+0000","last_peered":"2024-05-28T06:12:33.562377+0000","last_clean":"2024-05-28T06:12:33.562377+0000","last_became_active":"2024-05-28T06:12:30.797794+0000","last_became_peered":"2024-05-28T06:12:30.797794+0000","last_unstale":"2024-05-28T06:12:33.562377+0000","last_undegraded":"2024-05-28T06:12:33.562377+0000","last_fullsized":"2024-05-28T06:12:33.562377+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:05:17.937721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"62'86","reported_seq":178,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.316401+0000","last_change":"2024-05-28T06:12:31.800014+0000","last_active":"2024-05-28T06:13:37.316401+0000","last_peered":"2024-05-28T06:13:37.316401+0000","last_clean":"2024-05-28T06:13:37.316401+0000","last_became_active":"2024-05-28T06:12:31.799714+0000","last_became_peered":"2024-05-28T06:12:31.799714+0000","last_unstale":"2024-05-28T06:13:37.316401+0000","last_undegraded":"2024-05-28T06:13:37.316401+0000","last_fullsized":"2024-05-28T06:13:37.316401+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:54:23.878943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360710144,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":80,"num_read_kb":327680,"num_write":86,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"62'40","reported_seq":54,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:43.843635+0000","last_change":"2024-05-28T06:12:30.790726+0000","last_active":"2024-05-28T06:13:43.843635+0000","last_peered":"2024-05-28T06:13:43.843635+0000","last_clean":"2024-05-28T06:13:43.843635+0000","last_became_active":"2024-05-28T06:12:30.790486+0000","last_became_peered":"2024-05-28T06:12:30.790486+0000","last_unstale":"2024-05-28T06:13:43.843635+0000","last_undegraded":"2024-05-28T06:13:43.843635+0000","last_fullsized":"2024-05-28T06:13:43.843635+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:31:14.976810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"62'83","reported_seq":190,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.421892+0000","last_change":"2024-05-28T06:12:31.791575+0000","last_active":"2024-05-28T06:13:37.421892+0000","last_peered":"2024-05-28T06:13:37.421892+0000","last_clean":"2024-05-28T06:13:37.421892+0000","last_became_active":"2024-05-28T06:12:31.789316+0000","last_became_peered":"2024-05-28T06:12:31.789316+0000","last_unstale":"2024-05-28T06:13:37.421892+0000","last_undegraded":"2024-05-28T06:13:37.421892+0000","last_fullsized":"2024-05-28T06:13:37.421892+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:56:28.051898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339738624,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":95,"num_read_kb":385025,"num_write":83,"num_write_kb":331777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.800751+0000","last_change":"2024-05-28T06:12:30.791618+0000","last_active":"2024-05-28T06:12:32.800751+0000","last_peered":"2024-05-28T06:12:32.800751+0000","last_clean":"2024-05-28T06:12:32.800751+0000","last_became_active":"2024-05-28T06:12:30.791296+0000","last_became_peered":"2024-05-28T06:12:30.791296+0000","last_unstale":"2024-05-28T06:12:32.800751+0000","last_undegraded":"2024-05-28T06:12:32.800751+0000","last_fullsized":"2024-05-28T06:12:32.800751+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:32:08.488200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"62'90","reported_seq":150,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.548239+0000","last_change":"2024-05-28T06:12:31.799676+0000","last_active":"2024-05-28T06:13:37.548239+0000","last_peered":"2024-05-28T06:13:37.548239+0000","last_clean":"2024-05-28T06:13:37.548239+0000","last_became_active":"2024-05-28T06:12:31.799396+0000","last_became_peered":"2024-05-28T06:12:31.799396+0000","last_unstale":"2024-05-28T06:13:37.548239+0000","last_undegraded":"2024-05-28T06:13:37.548239+0000","last_fullsized":"2024-05-28T06:13:37.548239+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:54:23.878943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356516084,"num_objects":88,"num_object_clones":1,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":1,"num_read":49,"num_read_kb":200704,"num_write":88,"num_write_kb":348162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.782544+0000","last_change":"2024-05-28T06:12:30.790898+0000","last_active":"2024-05-28T06:12:32.782544+0000","last_peered":"2024-05-28T06:12:32.782544+0000","last_clean":"2024-05-28T06:12:32.782544+0000","last_became_active":"2024-05-28T06:12:30.790609+0000","last_became_peered":"2024-05-28T06:12:30.790609+0000","last_unstale":"2024-05-28T06:12:32.782544+0000","last_undegraded":"2024-05-28T06:12:32.782544+0000","last_fullsized":"2024-05-28T06:12:32.782544+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:42:43.406276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"62'86","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.545733+0000","last_change":"2024-05-28T06:12:31.793575+0000","last_active":"2024-05-28T06:13:37.545733+0000","last_peered":"2024-05-28T06:13:37.545733+0000","last_clean":"2024-05-28T06:13:37.545733+0000","last_became_active":"2024-05-28T06:12:31.792189+0000","last_became_peered":"2024-05-28T06:12:31.792189+0000","last_unstale":"2024-05-28T06:13:37.545733+0000","last_undegraded":"2024-05-28T06:13:37.545733+0000","last_fullsized":"2024-05-28T06:13:37.545733+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:37:03.595280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360710144,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":59,"num_read_kb":241664,"num_write":86,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.561734+0000","last_change":"2024-05-28T06:12:30.787551+0000","last_active":"2024-05-28T06:12:33.561734+0000","last_peered":"2024-05-28T06:12:33.561734+0000","last_clean":"2024-05-28T06:12:33.561734+0000","last_became_active":"2024-05-28T06:12:30.786731+0000","last_became_peered":"2024-05-28T06:12:30.786731+0000","last_unstale":"2024-05-28T06:12:33.561734+0000","last_undegraded":"2024-05-28T06:12:33.561734+0000","last_fullsized":"2024-05-28T06:12:33.561734+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:57:56.110796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"62'95","reported_seq":193,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.520900+0000","last_change":"2024-05-28T06:12:31.804270+0000","last_active":"2024-05-28T06:13:37.520900+0000","last_peered":"2024-05-28T06:13:37.520900+0000","last_clean":"2024-05-28T06:13:37.520900+0000","last_became_active":"2024-05-28T06:12:31.803980+0000","last_became_peered":"2024-05-28T06:12:31.803980+0000","last_unstale":"2024-05-28T06:13:37.520900+0000","last_undegraded":"2024-05-28T06:13:37.520900+0000","last_fullsized":"2024-05-28T06:13:37.520900+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:08:26.147408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390070272,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":86,"num_read_kb":339971,"num_write":95,"num_write_kb":380929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.560646+0000","last_change":"2024-05-28T06:12:30.790132+0000","last_active":"2024-05-28T06:12:33.560646+0000","last_peered":"2024-05-28T06:12:33.560646+0000","last_clean":"2024-05-28T06:12:33.560646+0000","last_became_active":"2024-05-28T06:12:30.789856+0000","last_became_peered":"2024-05-28T06:12:30.789856+0000","last_unstale":"2024-05-28T06:12:33.560646+0000","last_undegraded":"2024-05-28T06:12:33.560646+0000","last_fullsized":"2024-05-28T06:12:33.560646+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:05:08.097047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"62'94","reported_seq":181,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.051192+0000","last_change":"2024-05-28T06:12:31.801507+0000","last_active":"2024-05-28T06:13:37.051192+0000","last_peered":"2024-05-28T06:13:37.051192+0000","last_clean":"2024-05-28T06:13:37.051192+0000","last_became_active":"2024-05-28T06:12:31.801228+0000","last_became_peered":"2024-05-28T06:12:31.801228+0000","last_unstale":"2024-05-28T06:13:37.051192+0000","last_undegraded":"2024-05-28T06:13:37.051192+0000","last_fullsized":"2024-05-28T06:13:37.051192+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:24:13.601910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394264576,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":75,"num_read_kb":307200,"num_write":94,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"62'31","reported_seq":75,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:42.926546+0000","last_change":"2024-05-28T06:12:30.790873+0000","last_active":"2024-05-28T06:13:42.926546+0000","last_peered":"2024-05-28T06:13:42.926546+0000","last_clean":"2024-05-28T06:13:42.926546+0000","last_became_active":"2024-05-28T06:12:30.790623+0000","last_became_peered":"2024-05-28T06:12:30.790623+0000","last_unstale":"2024-05-28T06:13:42.926546+0000","last_undegraded":"2024-05-28T06:13:42.926546+0000","last_fullsized":"2024-05-28T06:13:42.926546+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:52:42.932309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4250,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":30,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"62'86","reported_seq":176,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:36.744527+0000","last_change":"2024-05-28T06:12:31.803993+0000","last_active":"2024-05-28T06:13:36.744527+0000","last_peered":"2024-05-28T06:13:36.744527+0000","last_clean":"2024-05-28T06:13:36.744527+0000","last_became_active":"2024-05-28T06:12:31.803709+0000","last_became_peered":"2024-05-28T06:12:31.803709+0000","last_unstale":"2024-05-28T06:13:36.744527+0000","last_undegraded":"2024-05-28T06:13:36.744527+0000","last_fullsized":"2024-05-28T06:13:36.744527+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:02:56.823249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360710144,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":78,"num_read_kb":319488,"num_write":86,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.780340+0000","last_change":"2024-05-28T06:12:30.793567+0000","last_active":"2024-05-28T06:12:32.780340+0000","last_peered":"2024-05-28T06:12:32.780340+0000","last_clean":"2024-05-28T06:12:32.780340+0000","last_became_active":"2024-05-28T06:12:30.793086+0000","last_became_peered":"2024-05-28T06:12:30.793086+0000","last_unstale":"2024-05-28T06:12:32.780340+0000","last_undegraded":"2024-05-28T06:12:32.780340+0000","last_fullsized":"2024-05-28T06:12:32.780340+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:55:15.450791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"62'88","reported_seq":146,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:37.479297+0000","last_change":"2024-05-28T06:12:31.789343+0000","last_active":"2024-05-28T06:13:37.479297+0000","last_peered":"2024-05-28T06:13:37.479297+0000","last_clean":"2024-05-28T06:13:37.479297+0000","last_became_active":"2024-05-28T06:12:31.789082+0000","last_became_peered":"2024-05-28T06:12:31.789082+0000","last_unstale":"2024-05-28T06:13:37.479297+0000","last_undegraded":"2024-05-28T06:13:37.479297+0000","last_fullsized":"2024-05-28T06:13:37.479297+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:52:29.999357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356515972,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":46,"num_read_kb":180226,"num_write":88,"num_write_kb":348162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.800527+0000","last_change":"2024-05-28T06:12:30.796037+0000","last_active":"2024-05-28T06:12:32.800527+0000","last_peered":"2024-05-28T06:12:32.800527+0000","last_clean":"2024-05-28T06:12:32.800527+0000","last_became_active":"2024-05-28T06:12:30.795716+0000","last_became_peered":"2024-05-28T06:12:30.795716+0000","last_unstale":"2024-05-28T06:12:32.800527+0000","last_undegraded":"2024-05-28T06:12:32.800527+0000","last_fullsized":"2024-05-28T06:12:32.800527+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:17:05.591509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":248,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.560577+0000","last_change":"2024-05-28T06:05:38.517922+0000","last_active":"2024-05-28T06:12:33.560577+0000","last_peered":"2024-05-28T06:12:33.560577+0000","last_clean":"2024-05-28T06:12:33.560577+0000","last_became_active":"2024-05-28T06:05:38.514745+0000","last_became_peered":"2024-05-28T06:05:38.514745+0000","last_unstale":"2024-05-28T06:12:33.560577+0000","last_undegraded":"2024-05-28T06:12:33.560577+0000","last_fullsized":"2024-05-28T06:12:33.560577+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_clean_scrub_stamp":"2024-05-28T06:05:37.485018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:23:27.978203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":20426262164,"num_objects":4880,"num_object_clones":1,"num_object_copies":9760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4880,"num_whiteouts":1,"num_read":4170,"num_read_kb":16875570,"num_write":4948,"num_write_kb":19947563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40852594688,"data_stored":40852524328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4957,"ondisk_log_size":4957,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1671162,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":605,"num_write_kb":1872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3407872,"data_stored":3342324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":550,"ondisk_log_size":550,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574958,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5940600,"kb_used_data":5891376,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":88431240,"statfs":{"total":96636764160,"available":90553589760,"internally_reserved":0,"allocated":6032769024,"data_stored":6032315492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574958,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3842848,"kb_used_data":3793624,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":90528992,"statfs":{"total":96636764160,"available":92701687808,"internally_reserved":0,"allocated":3884670976,"data_stored":3884240533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574957,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4842296,"kb_used_data":4793072,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":89529544,"statfs":{"total":96636764160,"available":91678253056,"internally_reserved":0,"allocated":4908105728,"data_stored":4907651869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574956,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4073928,"kb_used_data":4020544,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":90297912,"statfs":{"total":96636764160,"available":92465061888,"internally_reserved":0,"allocated":4117037056,"data_stored":4116593628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574959,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6505336,"kb_used_data":6451952,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":87866504,"statfs":{"total":96636764160,"available":89975300096,"internally_reserved":0,"allocated":6606798848,"data_stored":6606344671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574958,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3781416,"kb_used_data":3732192,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":90590424,"statfs":{"total":96636764160,"available":92764594176,"internally_reserved":0,"allocated":3821764608,"data_stored":3821326029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574958,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5935988,"kb_used_data":5882604,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":88435852,"statfs":{"total":96636764160,"available":90558312448,"internally_reserved":0,"allocated":6023786496,"data_stored":6023340306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574957,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5393444,"kb_used_data":5340060,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":88978396,"statfs":{"total":96636764160,"available":91113877504,"internally_reserved":0,"allocated":5468221440,"data_stored":5467755092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1687552,"data_stored":1670946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1675264,"data_stored":1666114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5465194496,"data_stored":5465178749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6023028736,"data_stored":6023020937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3821010944,"data_stored":3821010944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6606045184,"data_stored":6606029586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4114616320,"data_stored":4114612485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4907352064,"data_stored":4907336188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3883925504,"data_stored":3883925504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6031421440,"data_stored":6031409935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-28T06:14:31.243 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-28T06:14:31.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.421+0000 7f9c92000640 1 Processor -- start 2024-05-28T06:14:31.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.421+0000 7f9c92000640 1 -- start start 2024-05-28T06:14:31.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.421+0000 7f9c92000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c8c15ea50 0x7f9c8c15ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:31.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.421+0000 7f9c92000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c8c162510 con 0x7f9c8c15f370 2024-05-28T06:14:31.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.421+0000 7f9c92000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c8c1627f0 con 0x7f9c8c06dab0 2024-05-28T06:14:31.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.421+0000 7f9c92000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9c8c163120 con 0x7f9c8c15ea50 2024-05-28T06:14:31.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.421+0000 7f9c8aa00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f9c8c15f370 0x7f9c8c15f790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:49784/0 (socket says 172.21.15.122:49784) 2024-05-28T06:14:31.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.421+0000 7f9c8aa00640 1 -- 172.21.15.122:0/227654627 learned_addr learned my addr 172.21.15.122:0/227654627 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:14:31.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.421+0000 7f9c8b400640 1 --2- 172.21.15.122:0/227654627 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c8c15ea50 0x7f9c8c15ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:31.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.421+0000 7f9c8a000640 1 -- 172.21.15.122:0/227654627 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1882877079 0 0) 0x7f9c8c162510 con 0x7f9c8c15f370 2024-05-28T06:14:31.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.421+0000 7f9c8a000640 1 -- 172.21.15.122:0/227654627 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c70003530 con 0x7f9c8c15f370 2024-05-28T06:14:31.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.421+0000 7f9c8a000640 1 -- 172.21.15.122:0/227654627 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1020055331 0 0) 0x7f9c8c1627f0 con 0x7f9c8c06dab0 2024-05-28T06:14:31.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.421+0000 7f9c8a000640 1 -- 172.21.15.122:0/227654627 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c8c162510 con 0x7f9c8c06dab0 2024-05-28T06:14:31.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.421+0000 7f9c8b400640 1 -- 172.21.15.122:0/227654627 >> v1:172.21.15.153:6789/0 conn(0x7f9c8c06dab0 legacy=0x7f9c8c0d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:31.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.421+0000 7f9c8b400640 1 -- 172.21.15.122:0/227654627 >> v1:172.21.15.122:6789/0 conn(0x7f9c8c15f370 legacy=0x7f9c8c15f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:31.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.421+0000 7f9c8b400640 1 -- 172.21.15.122:0/227654627 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c8c162ad0 con 0x7f9c8c15ea50 2024-05-28T06:14:31.424 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.425+0000 7f9c8b400640 1 --2- 172.21.15.122:0/227654627 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c8c15ea50 0x7f9c8c15ee30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009dc0 tx=0x7f9c7c01c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53beaef3c8a6cb08 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:31.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.425+0000 7f9c8a000640 1 -- 172.21.15.122:0/227654627 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c0b2070 con 0x7f9c8c15ea50 2024-05-28T06:14:31.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.425+0000 7f9c8a000640 1 -- 172.21.15.122:0/227654627 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c7c0a59c0 con 0x7f9c8c15ea50 2024-05-28T06:14:31.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.425+0000 7f9c8a000640 1 -- 172.21.15.122:0/227654627 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c0a5d90 con 0x7f9c8c15ea50 2024-05-28T06:14:31.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.425+0000 7f9c92000640 1 -- 172.21.15.122:0/227654627 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c8c15ea50 msgr2=0x7f9c8c15ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:31.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.425+0000 7f9c92000640 1 --2- 172.21.15.122:0/227654627 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c8c15ea50 0x7f9c8c15ee30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009dc0 tx=0x7f9c7c01c960 comp rx=0 tx=0).stop 2024-05-28T06:14:31.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.425+0000 7f9c92000640 1 -- 172.21.15.122:0/227654627 shutdown_connections 2024-05-28T06:14:31.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.425+0000 7f9c92000640 1 --2- 172.21.15.122:0/227654627 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c8c15ea50 0x7f9c8c15ee30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:31.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.425+0000 7f9c92000640 1 -- 172.21.15.122:0/227654627 >> 172.21.15.122:0/227654627 conn(0x7f9c8c0b4190 msgr2=0x7f9c8c0b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:31.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.425+0000 7f9c92000640 1 -- 172.21.15.122:0/227654627 shutdown_connections 2024-05-28T06:14:31.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.425+0000 7f9c92000640 1 -- 172.21.15.122:0/227654627 wait complete. 2024-05-28T06:14:31.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c92000640 1 Processor -- start 2024-05-28T06:14:31.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c92000640 1 -- start start 2024-05-28T06:14:31.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c92000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c8c06dab0 0x7f9c8c158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:31.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c92000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c8c15ea50 0x7f9c8c155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:31.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c92000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c8c15f370 0x7f9c8c0b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:31.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c92000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8c0d1b90 con 0x7f9c8c15f370 2024-05-28T06:14:31.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c92000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8c0d1a10 con 0x7f9c8c15ea50 2024-05-28T06:14:31.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c92000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9c8c0d1d10 con 0x7f9c8c06dab0 2024-05-28T06:14:31.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c8be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c8c15f370 0x7f9c8c0b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:31.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c8be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c8c15f370 0x7f9c8c0b1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52170/0 (socket says 172.21.15.122:52170) 2024-05-28T06:14:31.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c8be00640 1 -- 172.21.15.122:0/536641514 learned_addr learned my addr 172.21.15.122:0/536641514 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:31.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c8b400640 1 --2- 172.21.15.122:0/536641514 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c8c06dab0 0x7f9c8c158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:31.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c8aa00640 1 --2- 172.21.15.122:0/536641514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c8c15ea50 0x7f9c8c155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:31.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c8be00640 1 -- 172.21.15.122:0/536641514 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c8c06dab0 msgr2=0x7f9c8c158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:31.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c8be00640 1 --2- 172.21.15.122:0/536641514 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c8c06dab0 0x7f9c8c158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:31.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c8be00640 1 -- 172.21.15.122:0/536641514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c8c15ea50 msgr2=0x7f9c8c155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:31.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c8be00640 1 --2- 172.21.15.122:0/536641514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c8c15ea50 0x7f9c8c155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:31.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c8be00640 1 -- 172.21.15.122:0/536641514 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c8c159570 con 0x7f9c8c15f370 2024-05-28T06:14:31.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c8be00640 1 --2- 172.21.15.122:0/536641514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c8c15f370 0x7f9c8c0b1020 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400c410 tx=0x7f9c8400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:31.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c83400640 1 -- 172.21.15.122:0/536641514 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c84017070 con 0x7f9c8c15f370 2024-05-28T06:14:31.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c83400640 1 -- 172.21.15.122:0/536641514 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c840052d0 con 0x7f9c8c15f370 2024-05-28T06:14:31.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c83400640 1 -- 172.21.15.122:0/536641514 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c840054c0 con 0x7f9c8c15f370 2024-05-28T06:14:31.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c92000640 1 -- 172.21.15.122:0/536641514 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c8c159850 con 0x7f9c8c15f370 2024-05-28T06:14:31.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.429+0000 7f9c92000640 1 -- 172.21.15.122:0/536641514 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c8c159e10 con 0x7f9c8c15f370 2024-05-28T06:14:31.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.433+0000 7f9c92000640 1 -- 172.21.15.122:0/536641514 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c8c068c40 con 0x7f9c8c15f370 2024-05-28T06:14:31.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.433+0000 7f9c83400640 1 -- 172.21.15.122:0/536641514 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 23) ==== 89109+0+0 (secure 0 0 0) 0x7f9c8401a070 con 0x7f9c8c15f370 2024-05-28T06:14:31.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.433+0000 7f9c83400640 1 --2- 172.21.15.122:0/536641514 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9c6c068fe0 0x7f9c6c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:31.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.433+0000 7f9c83400640 1 -- 172.21.15.122:0/536641514 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f9c840876b0 con 0x7f9c8c15f370 2024-05-28T06:14:31.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.433+0000 7f9c8b400640 1 --2- 172.21.15.122:0/536641514 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9c6c068fe0 0x7f9c6c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:31.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.433+0000 7f9c8b400640 1 --2- 172.21.15.122:0/536641514 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9c6c068fe0 0x7f9c6c06b4a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0af000 tx=0x7f9c7c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:31.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.437+0000 7f9c83400640 1 -- 172.21.15.122:0/536641514 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9c84056060 con 0x7f9c8c15f370 2024-05-28T06:14:31.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.597+0000 7f9c92000640 1 -- 172.21.15.122:0/536641514 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c8c15fc80 con 0x7f9c8c15f370 2024-05-28T06:14:31.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.597+0000 7f9c83400640 1 -- 172.21.15.122:0/536641514 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+16708 (secure 0 0 0) 0x7f9c8405a360 con 0x7f9c8c15f370 2024-05-28T06:14:31.597 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:14:31.597 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":62,"fsid":"e63a9349-baf2-4247-95d1-eb8599fad84f","created":"2024-05-28T06:05:24.248951+0000","modified":"2024-05-28T06:12:32.775809+0000","last_up_change":"2024-05-28T06:05:36.482691+0000","last_in_change":"2024-05-28T06:05:26.755091+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-28T06:05:37.269421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-28T06:12:28.875891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-28T06:12:30.137302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8db3ddab-8e60-476f-b178-931092fcb97a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6801","nonce":642574294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6803","nonce":642574294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6807","nonce":642574294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":642574294},{"type":"v1","addr":"172.21.15.122:6805","nonce":642574294}]},"public_addr":"172.21.15.122:6801/642574294","cluster_addr":"172.21.15.122:6803/642574294","heartbeat_back_addr":"172.21.15.122:6807/642574294","heartbeat_front_addr":"172.21.15.122:6805/642574294","state":["exists","up"]},{"osd":1,"uuid":"42751133-d830-4153-835f-0f2df6383268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6809","nonce":1210437339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6811","nonce":1210437339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6815","nonce":1210437339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1210437339},{"type":"v1","addr":"172.21.15.122:6813","nonce":1210437339}]},"public_addr":"172.21.15.122:6809/1210437339","cluster_addr":"172.21.15.122:6811/1210437339","heartbeat_back_addr":"172.21.15.122:6815/1210437339","heartbeat_front_addr":"172.21.15.122:6813/1210437339","state":["exists","up"]},{"osd":2,"uuid":"3a4d62cc-ba0b-401e-8638-24c43b946c0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6817","nonce":791000953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6819","nonce":791000953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6823","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6825","nonce":791000953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":791000953},{"type":"v1","addr":"172.21.15.122:6821","nonce":791000953}]},"public_addr":"172.21.15.122:6817/791000953","cluster_addr":"172.21.15.122:6819/791000953","heartbeat_back_addr":"172.21.15.122:6825/791000953","heartbeat_front_addr":"172.21.15.122:6821/791000953","state":["exists","up"]},{"osd":3,"uuid":"15794de8-a4d1-47fd-bc23-155938919715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6824","nonce":1935505897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6827","nonce":1935505897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6831","nonce":1935505897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":1935505897},{"type":"v1","addr":"172.21.15.122:6829","nonce":1935505897}]},"public_addr":"172.21.15.122:6824/1935505897","cluster_addr":"172.21.15.122:6827/1935505897","heartbeat_back_addr":"172.21.15.122:6831/1935505897","heartbeat_front_addr":"172.21.15.122:6829/1935505897","state":["exists","up"]},{"osd":4,"uuid":"2e017ba9-3ac6-4756-a3bd-0e0d76085bbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6825","nonce":3872438562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6827","nonce":3872438562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6831","nonce":3872438562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3872438562},{"type":"v1","addr":"172.21.15.153:6829","nonce":3872438562}]},"public_addr":"172.21.15.153:6825/3872438562","cluster_addr":"172.21.15.153:6827/3872438562","heartbeat_back_addr":"172.21.15.153:6831/3872438562","heartbeat_front_addr":"172.21.15.153:6829/3872438562","state":["exists","up"]},{"osd":5,"uuid":"81d3617b-2e70-4767-8193-cc5addbb6c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6811","nonce":2459238876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6815","nonce":2459238876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6822","nonce":2459238876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2459238876},{"type":"v1","addr":"172.21.15.153:6818","nonce":2459238876}]},"public_addr":"172.21.15.153:6811/2459238876","cluster_addr":"172.21.15.153:6815/2459238876","heartbeat_back_addr":"172.21.15.153:6822/2459238876","heartbeat_front_addr":"172.21.15.153:6818/2459238876","state":["exists","up"]},{"osd":6,"uuid":"e00767ba-51bb-44c5-bacd-e523c388a32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6810","nonce":194393677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6814","nonce":194393677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6823","nonce":194393677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6817","nonce":194393677},{"type":"v1","addr":"172.21.15.153:6819","nonce":194393677}]},"public_addr":"172.21.15.153:6810/194393677","cluster_addr":"172.21.15.153:6814/194393677","heartbeat_back_addr":"172.21.15.153:6823/194393677","heartbeat_front_addr":"172.21.15.153:6819/194393677","state":["exists","up"]},{"osd":7,"uuid":"f47cf583-8054-4b5a-9e38-b3c3df13fbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6801","nonce":23883170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6803","nonce":23883170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6807","nonce":23883170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":23883170},{"type":"v1","addr":"172.21.15.153:6805","nonce":23883170}]},"public_addr":"172.21.15.153:6801/23883170","cluster_addr":"172.21.15.153:6803/23883170","heartbeat_back_addr":"172.21.15.153:6807/23883170","heartbeat_front_addr":"172.21.15.153:6805/23883170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.443183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.429769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.618041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.541324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.469222+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.561337+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.418091+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-28T06:05:32.537621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-28T06:14:31.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.597+0000 7f9c92000640 1 -- 172.21.15.122:0/536641514 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9c6c068fe0 msgr2=0x7f9c6c06b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:31.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.597+0000 7f9c92000640 1 --2- 172.21.15.122:0/536641514 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9c6c068fe0 0x7f9c6c06b4a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0af000 tx=0x7f9c7c0a7070 comp rx=0 tx=0).stop 2024-05-28T06:14:31.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.597+0000 7f9c92000640 1 -- 172.21.15.122:0/536641514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c8c15f370 msgr2=0x7f9c8c0b1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:31.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.597+0000 7f9c92000640 1 --2- 172.21.15.122:0/536641514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c8c15f370 0x7f9c8c0b1020 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400c410 tx=0x7f9c8400c8d0 comp rx=0 tx=0).stop 2024-05-28T06:14:31.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.601+0000 7f9c92000640 1 -- 172.21.15.122:0/536641514 shutdown_connections 2024-05-28T06:14:31.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.601+0000 7f9c92000640 1 --2- 172.21.15.122:0/536641514 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9c6c068fe0 0x7f9c6c06b4a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:31.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.601+0000 7f9c92000640 1 --2- 172.21.15.122:0/536641514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c8c15f370 0x7f9c8c0b1020 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:31.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.601+0000 7f9c92000640 1 --2- 172.21.15.122:0/536641514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c8c15ea50 0x7f9c8c155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:31.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.601+0000 7f9c92000640 1 --2- 172.21.15.122:0/536641514 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c8c06dab0 0x7f9c8c158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:31.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.601+0000 7f9c92000640 1 -- 172.21.15.122:0/536641514 >> 172.21.15.122:0/536641514 conn(0x7f9c8c0b4190 msgr2=0x7f9c8c0b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:31.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.601+0000 7f9c92000640 1 -- 172.21.15.122:0/536641514 shutdown_connections 2024-05-28T06:14:31.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:31.601+0000 7f9c92000640 1 -- 172.21.15.122:0/536641514 wait complete. 2024-05-28T06:14:32.619 INFO:tasks.ceph:Scrubbing osd.0 2024-05-28T06:14:32.619 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-28T06:14:32.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.765+0000 7f75f8c00640 1 Processor -- start 2024-05-28T06:14:32.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.765+0000 7f75f8c00640 1 -- start start 2024-05-28T06:14:32.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.765+0000 7f75f8c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f75f40d0270 0x7f75f409b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:32.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.765+0000 7f75f8c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75f415dc70 con 0x7f75f415d7e0 2024-05-28T06:14:32.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.765+0000 7f75f8c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75f40d0830 con 0x7f75f40d0c80 2024-05-28T06:14:32.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.765+0000 7f75f8c00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f75f409aa40 con 0x7f75f40d0270 2024-05-28T06:14:32.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.765+0000 7f75f2800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f75f415d7e0 0x7f75f40cd1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:49796/0 (socket says 172.21.15.122:49796) 2024-05-28T06:14:32.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.765+0000 7f75f2800640 1 -- 172.21.15.122:0/1027903922 learned_addr learned my addr 172.21.15.122:0/1027903922 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:14:32.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.765+0000 7f75e9400640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f75f40d0270 0x7f75f409b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:32.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.765+0000 7f75e9400640 1 -- 172.21.15.122:0/1027903922 >> v1:172.21.15.153:6789/0 conn(0x7f75f40d0c80 legacy=0x7f75f40d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:32.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.765+0000 7f75e9400640 1 -- 172.21.15.122:0/1027903922 >> v1:172.21.15.122:6789/0 conn(0x7f75f415d7e0 legacy=0x7f75f40cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:32.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.765+0000 7f75e9400640 1 -- 172.21.15.122:0/1027903922 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f409ad20 con 0x7f75f40d0270 2024-05-28T06:14:32.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.765+0000 7f75f1400640 1 -- 172.21.15.122:0/1027903922 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2362820165 0 0) 0x7f75f415dc70 con 0x7f75f415d7e0 2024-05-28T06:14:32.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.769+0000 7f75e9400640 1 --2- 172.21.15.122:0/1027903922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75f40d0270 0x7f75f409b800 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f75dc0097c0 tx=0x7f75dc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d8b9e505c7a731 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:32.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.769+0000 7f75f1400640 1 -- 172.21.15.122:0/1027903922 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75dc0b1070 con 0x7f75f40d0270 2024-05-28T06:14:32.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.769+0000 7f75f1400640 1 -- 172.21.15.122:0/1027903922 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75dc0a8050 con 0x7f75f40d0270 2024-05-28T06:14:32.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.769+0000 7f75f1400640 1 -- 172.21.15.122:0/1027903922 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75dc0ac860 con 0x7f75f40d0270 2024-05-28T06:14:32.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.769+0000 7f75f8c00640 1 -- 172.21.15.122:0/1027903922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75f40d0270 msgr2=0x7f75f409b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:32.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.769+0000 7f75f8c00640 1 --2- 172.21.15.122:0/1027903922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75f40d0270 0x7f75f409b800 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f75dc0097c0 tx=0x7f75dc01c3e0 comp rx=0 tx=0).stop 2024-05-28T06:14:32.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.769+0000 7f75f8c00640 1 -- 172.21.15.122:0/1027903922 shutdown_connections 2024-05-28T06:14:32.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.769+0000 7f75f8c00640 1 --2- 172.21.15.122:0/1027903922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75f40d0270 0x7f75f409b800 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:32.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.769+0000 7f75f8c00640 1 -- 172.21.15.122:0/1027903922 >> 172.21.15.122:0/1027903922 conn(0x7f75f40b4190 msgr2=0x7f75f40b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:32.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.769+0000 7f75f8c00640 1 -- 172.21.15.122:0/1027903922 shutdown_connections 2024-05-28T06:14:32.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.769+0000 7f75f8c00640 1 -- 172.21.15.122:0/1027903922 wait complete. 2024-05-28T06:14:32.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.773+0000 7f75f8c00640 1 Processor -- start 2024-05-28T06:14:32.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.773+0000 7f75f8c00640 1 -- start start 2024-05-28T06:14:32.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.773+0000 7f75f8c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75f40d0270 0x7f75f4167ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:32.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.773+0000 7f75f8c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75f40d0c80 0x7f75f406d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:32.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.773+0000 7f75f8c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75f415d7e0 0x7f75f406da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:32.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.773+0000 7f75f8c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f75f416a7d0 con 0x7f75f40d0270 2024-05-28T06:14:32.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.773+0000 7f75f8c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f75f416a650 con 0x7f75f415d7e0 2024-05-28T06:14:32.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.773+0000 7f75f8c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f75f416a950 con 0x7f75f40d0c80 2024-05-28T06:14:32.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.773+0000 7f75f1e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75f40d0270 0x7f75f4167ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:32.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.773+0000 7f75f1e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75f40d0270 0x7f75f4167ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52188/0 (socket says 172.21.15.122:52188) 2024-05-28T06:14:32.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.773+0000 7f75f1e00640 1 -- 172.21.15.122:0/741910759 learned_addr learned my addr 172.21.15.122:0/741910759 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:32.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.773+0000 7f75f1e00640 1 -- 172.21.15.122:0/741910759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75f40d0c80 msgr2=0x7f75f406d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:32.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.773+0000 7f75f1e00640 1 --2- 172.21.15.122:0/741910759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75f40d0c80 0x7f75f406d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:32.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.773+0000 7f75f1e00640 1 -- 172.21.15.122:0/741910759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75f415d7e0 msgr2=0x7f75f406da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:32.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.773+0000 7f75f1e00640 1 --2- 172.21.15.122:0/741910759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75f415d7e0 0x7f75f406da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:32.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.773+0000 7f75f1e00640 1 -- 172.21.15.122:0/741910759 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f4168410 con 0x7f75f40d0270 2024-05-28T06:14:32.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.773+0000 7f75f1e00640 1 --2- 172.21.15.122:0/741910759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75f40d0270 0x7f75f4167ed0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f75e400c3f0 tx=0x7f75e400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:32.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.773+0000 7f75eaa00640 1 -- 172.21.15.122:0/741910759 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e4017070 con 0x7f75f40d0270 2024-05-28T06:14:32.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.773+0000 7f75eaa00640 1 -- 172.21.15.122:0/741910759 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e40052d0 con 0x7f75f40d0270 2024-05-28T06:14:32.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.773+0000 7f75f8c00640 1 -- 172.21.15.122:0/741910759 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f4157cb0 con 0x7f75f40d0270 2024-05-28T06:14:32.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.773+0000 7f75eaa00640 1 -- 172.21.15.122:0/741910759 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e4003840 con 0x7f75f40d0270 2024-05-28T06:14:32.777 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.773+0000 7f75f8c00640 1 -- 172.21.15.122:0/741910759 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f4158270 con 0x7f75f40d0270 2024-05-28T06:14:32.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.777+0000 7f75f8c00640 1 -- 172.21.15.122:0/741910759 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f75f4157a60 con 0x7f75f40d0270 2024-05-28T06:14:32.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.777+0000 7f75eaa00640 1 -- 172.21.15.122:0/741910759 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 89007+0+0 (secure 0 0 0) 0x7f75e401a070 con 0x7f75f40d0270 2024-05-28T06:14:32.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.777+0000 7f75eaa00640 1 --2- 172.21.15.122:0/741910759 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f75d0068ec0 0x7f75d006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:32.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.777+0000 7f75eaa00640 1 -- 172.21.15.122:0/741910759 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f75e4084940 con 0x7f75f40d0270 2024-05-28T06:14:32.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.777+0000 7f75e9400640 1 --2- 172.21.15.122:0/741910759 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f75d0068ec0 0x7f75d006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:32.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.777+0000 7f75eaa00640 1 --2- 172.21.15.122:0/741910759 >> [v2:172.21.15.122:6800/642574294,v1:172.21.15.122:6801/642574294] conn(0x7f75d00710c0 0x7f75d00734e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:32.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.777+0000 7f75eaa00640 1 -- 172.21.15.122:0/741910759 --> [v2:172.21.15.122:6800/642574294,v1:172.21.15.122:6801/642574294] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f75e4016ec0 con 0x7f75d00710c0 2024-05-28T06:14:32.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.777+0000 7f75eaa00640 1 -- 172.21.15.122:0/741910759 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f75e408e050 con 0x7f75f40d0270 2024-05-28T06:14:32.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.777+0000 7f75f2800640 1 --2- 172.21.15.122:0/741910759 >> [v2:172.21.15.122:6800/642574294,v1:172.21.15.122:6801/642574294] conn(0x7f75d00710c0 0x7f75d00734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:32.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.777+0000 7f75e9400640 1 --2- 172.21.15.122:0/741910759 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f75d0068ec0 0x7f75d006b380 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f75dc0ae000 tx=0x7f75dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:32.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.777+0000 7f75f2800640 1 --2- 172.21.15.122:0/741910759 >> [v2:172.21.15.122:6800/642574294,v1:172.21.15.122:6801/642574294] conn(0x7f75d00710c0 0x7f75d00734e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:32.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.777+0000 7f75eaa00640 1 -- 172.21.15.122:0/741910759 <== osd.0 v2:172.21.15.122:6800/642574294 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f75e4016ec0 con 0x7f75d00710c0 2024-05-28T06:14:32.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.793+0000 7f75f8c00640 1 -- 172.21.15.122:0/741910759 --> [v2:172.21.15.122:6800/642574294,v1:172.21.15.122:6801/642574294] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f75f4076020 con 0x7f75d00710c0 2024-05-28T06:14:32.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.793+0000 7f75eaa00640 1 -- 172.21.15.122:0/741910759 <== osd.0 v2:172.21.15.122:6800/642574294 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f75ec004b70 con 0x7f75d00710c0 2024-05-28T06:14:32.792 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:14:32.792 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-28T06:14:32.792 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:14:32.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.793+0000 7f75f8c00640 1 -- 172.21.15.122:0/741910759 >> [v2:172.21.15.122:6800/642574294,v1:172.21.15.122:6801/642574294] conn(0x7f75d00710c0 msgr2=0x7f75d00734e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:32.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.793+0000 7f75f8c00640 1 --2- 172.21.15.122:0/741910759 >> [v2:172.21.15.122:6800/642574294,v1:172.21.15.122:6801/642574294] conn(0x7f75d00710c0 0x7f75d00734e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:32.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.793+0000 7f75f8c00640 1 -- 172.21.15.122:0/741910759 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f75d0068ec0 msgr2=0x7f75d006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:32.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.793+0000 7f75f8c00640 1 --2- 172.21.15.122:0/741910759 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f75d0068ec0 0x7f75d006b380 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f75dc0ae000 tx=0x7f75dc008040 comp rx=0 tx=0).stop 2024-05-28T06:14:32.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.793+0000 7f75f8c00640 1 -- 172.21.15.122:0/741910759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75f40d0270 msgr2=0x7f75f4167ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:32.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.793+0000 7f75f8c00640 1 --2- 172.21.15.122:0/741910759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75f40d0270 0x7f75f4167ed0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f75e400c3f0 tx=0x7f75e400c8b0 comp rx=0 tx=0).stop 2024-05-28T06:14:32.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.793+0000 7f75f2800640 1 -- 172.21.15.122:0/741910759 reap_dead start 2024-05-28T06:14:32.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.793+0000 7f75f8c00640 1 -- 172.21.15.122:0/741910759 shutdown_connections 2024-05-28T06:14:32.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.793+0000 7f75f8c00640 1 -- 172.21.15.122:0/741910759 >> 172.21.15.122:0/741910759 conn(0x7f75f40b4190 msgr2=0x7f75f4071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:32.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.793+0000 7f75f8c00640 1 -- 172.21.15.122:0/741910759 shutdown_connections 2024-05-28T06:14:32.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.793+0000 7f75f8c00640 1 -- 172.21.15.122:0/741910759 wait complete. 2024-05-28T06:14:32.811 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-28T06:14:32.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.949+0000 7fe6c3e00640 1 Processor -- start 2024-05-28T06:14:32.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.949+0000 7fe6c3e00640 1 -- start start 2024-05-28T06:14:32.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.949+0000 7fe6c3e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6c415c740 0x7fe6c409b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:32.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.949+0000 7fe6c3e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe6c415cb30 0x7fe6c415cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:32.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.949+0000 7fe6c3e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6c415d4f0 con 0x7fe6c41600a0 2024-05-28T06:14:32.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.949+0000 7fe6c3e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe6c40cd330 con 0x7fe6c415cb30 2024-05-28T06:14:32.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.949+0000 7fe6c3e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe6c40cd610 con 0x7fe6c415c740 2024-05-28T06:14:32.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.949+0000 7fe6ba000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe6c415cb30 0x7fe6c415cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:32.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.949+0000 7fe6c2a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6c415c740 0x7fe6c409b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:32.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.949+0000 7fe6ba000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe6c415cb30 0x7fe6c415cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:47932/0 (socket says 172.21.15.122:47932) 2024-05-28T06:14:32.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.949+0000 7fe6c2a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6c415c740 0x7fe6c409b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:60346/0 (socket says 172.21.15.122:60346) 2024-05-28T06:14:32.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.949+0000 7fe6ba000640 1 -- 172.21.15.122:0/612553930 learned_addr learned my addr 172.21.15.122:0/612553930 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:32.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.949+0000 7fe6ba000640 1 -- 172.21.15.122:0/612553930 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6c415c740 msgr2=0x7fe6c409b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:32.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.949+0000 7fe6ba000640 1 --2- 172.21.15.122:0/612553930 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6c415c740 0x7fe6c409b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:32.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.949+0000 7fe6ba000640 1 -- 172.21.15.122:0/612553930 >> v1:172.21.15.153:6789/0 conn(0x7fe6c41600a0 legacy=0x7fe6c41604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:32.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.949+0000 7fe6ba000640 1 -- 172.21.15.122:0/612553930 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c40cd8f0 con 0x7fe6c415cb30 2024-05-28T06:14:32.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.953+0000 7fe6ba000640 1 --2- 172.21.15.122:0/612553930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6c415cb30 0x7fe6c415cfb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac009870 tx=0x7fe6ac01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9da4a1c2d05ff89d server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:32.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.953+0000 7fe6c2000640 1 -- 172.21.15.122:0/612553930 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac0ab650 con 0x7fe6c415cb30 2024-05-28T06:14:32.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.953+0000 7fe6c2000640 1 -- 172.21.15.122:0/612553930 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ac0b0070 con 0x7fe6c415cb30 2024-05-28T06:14:32.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.953+0000 7fe6c2000640 1 -- 172.21.15.122:0/612553930 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac0aba10 con 0x7fe6c415cb30 2024-05-28T06:14:32.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.953+0000 7fe6c3e00640 1 -- 172.21.15.122:0/612553930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6c415cb30 msgr2=0x7fe6c415cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:32.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.953+0000 7fe6c3e00640 1 --2- 172.21.15.122:0/612553930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6c415cb30 0x7fe6c415cfb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac009870 tx=0x7fe6ac01c560 comp rx=0 tx=0).stop 2024-05-28T06:14:32.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.953+0000 7fe6c3e00640 1 -- 172.21.15.122:0/612553930 shutdown_connections 2024-05-28T06:14:32.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.953+0000 7fe6c3e00640 1 --2- 172.21.15.122:0/612553930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6c415cb30 0x7fe6c415cfb0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:32.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.953+0000 7fe6c3e00640 1 --2- 172.21.15.122:0/612553930 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6c415c740 0x7fe6c409b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:32.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.953+0000 7fe6c3e00640 1 -- 172.21.15.122:0/612553930 >> 172.21.15.122:0/612553930 conn(0x7fe6c40d2440 msgr2=0x7fe6c40d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:32.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.953+0000 7fe6c3e00640 1 -- 172.21.15.122:0/612553930 shutdown_connections 2024-05-28T06:14:32.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.953+0000 7fe6c3e00640 1 -- 172.21.15.122:0/612553930 wait complete. 2024-05-28T06:14:32.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6c3e00640 1 Processor -- start 2024-05-28T06:14:32.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6c3e00640 1 -- start start 2024-05-28T06:14:32.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6c3e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe6c415cb30 0x7fe6c415aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:32.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6c3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6c41600a0 0x7fe6c415b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:32.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6c3e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6c415b5d0 0x7fe6c4070e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:32.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6c3e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c40ccf50 con 0x7fe6c415cb30 2024-05-28T06:14:32.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6c3e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c415d8f0 con 0x7fe6c41600a0 2024-05-28T06:14:32.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6c3e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fe6c40cd0d0 con 0x7fe6c415b5d0 2024-05-28T06:14:32.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6c2a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe6c415cb30 0x7fe6c415aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:32.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6c2a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe6c415cb30 0x7fe6c415aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52192/0 (socket says 172.21.15.122:52192) 2024-05-28T06:14:32.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6c2a00640 1 -- 172.21.15.122:0/703999441 learned_addr learned my addr 172.21.15.122:0/703999441 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:32.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6c3400640 1 --2- 172.21.15.122:0/703999441 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6c415b5d0 0x7fe6c4070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:32.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6ba000640 1 --2- 172.21.15.122:0/703999441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6c41600a0 0x7fe6c415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:32.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6c2a00640 1 -- 172.21.15.122:0/703999441 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6c415b5d0 msgr2=0x7fe6c4070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:32.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6c2a00640 1 --2- 172.21.15.122:0/703999441 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6c415b5d0 0x7fe6c4070e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:32.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6c2a00640 1 -- 172.21.15.122:0/703999441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6c41600a0 msgr2=0x7fe6c415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:32.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6c2a00640 1 --2- 172.21.15.122:0/703999441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6c41600a0 0x7fe6c415b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:32.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6c2a00640 1 -- 172.21.15.122:0/703999441 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c41f79f0 con 0x7fe6c415cb30 2024-05-28T06:14:32.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6c2a00640 1 --2- 172.21.15.122:0/703999441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe6c415cb30 0x7fe6c415aac0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400e870 tx=0x7fe6b400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:32.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6bb400640 1 -- 172.21.15.122:0/703999441 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4017070 con 0x7fe6c415cb30 2024-05-28T06:14:32.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6bb400640 1 -- 172.21.15.122:0/703999441 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b400c940 con 0x7fe6c415cb30 2024-05-28T06:14:32.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6bb400640 1 -- 172.21.15.122:0/703999441 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400ccf0 con 0x7fe6c415cb30 2024-05-28T06:14:32.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6c3e00640 1 -- 172.21.15.122:0/703999441 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6c40b7b80 con 0x7fe6c415cb30 2024-05-28T06:14:32.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.957+0000 7fe6c3e00640 1 -- 172.21.15.122:0/703999441 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6c40ca1c0 con 0x7fe6c415cb30 2024-05-28T06:14:32.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.961+0000 7fe6c3e00640 1 -- 172.21.15.122:0/703999441 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6c4075620 con 0x7fe6c415cb30 2024-05-28T06:14:32.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.961+0000 7fe6bb400640 1 -- 172.21.15.122:0/703999441 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 89007+0+0 (secure 0 0 0) 0x7fe6b401a070 con 0x7fe6c415cb30 2024-05-28T06:14:32.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.961+0000 7fe6bb400640 1 --2- 172.21.15.122:0/703999441 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe6a0068ef0 0x7fe6a006b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:32.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.961+0000 7fe6bb400640 1 -- 172.21.15.122:0/703999441 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7fe6b40857e0 con 0x7fe6c415cb30 2024-05-28T06:14:32.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.961+0000 7fe6ba000640 1 --2- 172.21.15.122:0/703999441 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe6a0068ef0 0x7fe6a006b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:32.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.961+0000 7fe6ba000640 1 --2- 172.21.15.122:0/703999441 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe6a0068ef0 0x7fe6a006b3b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac0af000 tx=0x7fe6ac0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:32.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:32.965+0000 7fe6bb400640 1 -- 172.21.15.122:0/703999441 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe6b40575a0 con 0x7fe6c415cb30 2024-05-28T06:14:33.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.125+0000 7fe6c3e00640 1 -- 172.21.15.122:0/703999441 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fe6c40d32e0 con 0x7fe6a0068ef0 2024-05-28T06:14:33.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.125+0000 7fe6bb400640 1 -- 172.21.15.122:0/703999441 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe6c40d32e0 con 0x7fe6a0068ef0 2024-05-28T06:14:33.126 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 0 to deep-scrub 2024-05-28T06:14:33.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.129+0000 7fe6c3e00640 1 -- 172.21.15.122:0/703999441 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe6a0068ef0 msgr2=0x7fe6a006b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:33.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.129+0000 7fe6c3e00640 1 --2- 172.21.15.122:0/703999441 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe6a0068ef0 0x7fe6a006b3b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac0af000 tx=0x7fe6ac0a7000 comp rx=0 tx=0).stop 2024-05-28T06:14:33.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.129+0000 7fe6c3e00640 1 -- 172.21.15.122:0/703999441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe6c415cb30 msgr2=0x7fe6c415aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:33.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.129+0000 7fe6c3e00640 1 --2- 172.21.15.122:0/703999441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe6c415cb30 0x7fe6c415aac0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400e870 tx=0x7fe6b400ec70 comp rx=0 tx=0).stop 2024-05-28T06:14:33.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.129+0000 7fe6c3e00640 1 -- 172.21.15.122:0/703999441 shutdown_connections 2024-05-28T06:14:33.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.129+0000 7fe6c3e00640 1 --2- 172.21.15.122:0/703999441 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fe6a0068ef0 0x7fe6a006b3b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.129+0000 7fe6c3e00640 1 --2- 172.21.15.122:0/703999441 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6c415b5d0 0x7fe6c4070e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.129+0000 7fe6c3e00640 1 --2- 172.21.15.122:0/703999441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6c41600a0 0x7fe6c415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.129+0000 7fe6c3e00640 1 --2- 172.21.15.122:0/703999441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe6c415cb30 0x7fe6c415aac0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.129+0000 7fe6c3e00640 1 -- 172.21.15.122:0/703999441 >> 172.21.15.122:0/703999441 conn(0x7fe6c40d2440 msgr2=0x7fe6c40afce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:33.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.129+0000 7fe6c3e00640 1 -- 172.21.15.122:0/703999441 shutdown_connections 2024-05-28T06:14:33.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.129+0000 7fe6c3e00640 1 -- 172.21.15.122:0/703999441 wait complete. 2024-05-28T06:14:33.147 INFO:tasks.ceph:Scrubbing osd.1 2024-05-28T06:14:33.147 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-28T06:14:33.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.289+0000 7faf15200640 1 Processor -- start 2024-05-28T06:14:33.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.289+0000 7faf15200640 1 -- start start 2024-05-28T06:14:33.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.289+0000 7faf15200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf100b58d0 0x7faf100b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:33.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.289+0000 7faf15200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faf100ce4f0 0x7faf100ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:33.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.289+0000 7faf15200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf100b61f0 con 0x7faf100722a0 2024-05-28T06:14:33.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.289+0000 7faf15200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7faf1015d970 con 0x7faf100ce4f0 2024-05-28T06:14:33.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.289+0000 7faf15200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7faf1015dc50 con 0x7faf100b58d0 2024-05-28T06:14:33.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.289+0000 7faf0d400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faf100ce4f0 0x7faf100ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:33.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.289+0000 7faf0de00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf100b58d0 0x7faf100b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:33.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.289+0000 7faf0d400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faf100ce4f0 0x7faf100ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:47950/0 (socket says 172.21.15.122:47950) 2024-05-28T06:14:33.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.289+0000 7faf0d400640 1 -- 172.21.15.122:0/1599626781 learned_addr learned my addr 172.21.15.122:0/1599626781 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:33.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.289+0000 7faf0d400640 1 -- 172.21.15.122:0/1599626781 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf100b58d0 msgr2=0x7faf100b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:33.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.289+0000 7faf0d400640 1 --2- 172.21.15.122:0/1599626781 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf100b58d0 0x7faf100b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.289+0000 7faf0d400640 1 -- 172.21.15.122:0/1599626781 >> v1:172.21.15.153:6789/0 conn(0x7faf100722a0 legacy=0x7faf10072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:33.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.289+0000 7faf0d400640 1 -- 172.21.15.122:0/1599626781 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf1015df30 con 0x7faf100ce4f0 2024-05-28T06:14:33.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.293+0000 7faf0d400640 1 --2- 172.21.15.122:0/1599626781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf100ce4f0 0x7faf100ce950 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7faefc009870 tx=0x7faefc01c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11402f7854d8b5ae server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:33.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.293+0000 7faf0ca00640 1 -- 172.21.15.122:0/1599626781 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faefc0aa430 con 0x7faf100ce4f0 2024-05-28T06:14:33.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.293+0000 7faf0ca00640 1 -- 172.21.15.122:0/1599626781 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faefc0af070 con 0x7faf100ce4f0 2024-05-28T06:14:33.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.293+0000 7faf0ca00640 1 -- 172.21.15.122:0/1599626781 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faefc0aa7f0 con 0x7faf100ce4f0 2024-05-28T06:14:33.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.293+0000 7faf15200640 1 -- 172.21.15.122:0/1599626781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf100ce4f0 msgr2=0x7faf100ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:33.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.293+0000 7faf15200640 1 --2- 172.21.15.122:0/1599626781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf100ce4f0 0x7faf100ce950 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7faefc009870 tx=0x7faefc01c530 comp rx=0 tx=0).stop 2024-05-28T06:14:33.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.293+0000 7faf15200640 1 -- 172.21.15.122:0/1599626781 shutdown_connections 2024-05-28T06:14:33.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.293+0000 7faf15200640 1 --2- 172.21.15.122:0/1599626781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf100ce4f0 0x7faf100ce950 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.293+0000 7faf15200640 1 --2- 172.21.15.122:0/1599626781 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf100b58d0 0x7faf100b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.293+0000 7faf15200640 1 -- 172.21.15.122:0/1599626781 >> 172.21.15.122:0/1599626781 conn(0x7faf1006bd90 msgr2=0x7faf1006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:33.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.293+0000 7faf15200640 1 -- 172.21.15.122:0/1599626781 shutdown_connections 2024-05-28T06:14:33.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.293+0000 7faf15200640 1 -- 172.21.15.122:0/1599626781 wait complete. 2024-05-28T06:14:33.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf15200640 1 Processor -- start 2024-05-28T06:14:33.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf15200640 1 -- start start 2024-05-28T06:14:33.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf15200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf100722a0 0x7faf100b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:33.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf15200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf100b58d0 0x7faf1013b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:33.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf15200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf100ce4f0 0x7faf100b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:33.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf15200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7faf100cf010 con 0x7faf100722a0 2024-05-28T06:14:33.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf15200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faf100cee90 con 0x7faf100ce4f0 2024-05-28T06:14:33.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf15200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7faf10169a60 con 0x7faf100b58d0 2024-05-28T06:14:33.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf0de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf100722a0 0x7faf100b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:33.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf0de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf100722a0 0x7faf100b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52204/0 (socket says 172.21.15.122:52204) 2024-05-28T06:14:33.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf0de00640 1 -- 172.21.15.122:0/2015105344 learned_addr learned my addr 172.21.15.122:0/2015105344 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:33.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf0d400640 1 --2- 172.21.15.122:0/2015105344 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf100b58d0 0x7faf1013b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:33.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf0e800640 1 --2- 172.21.15.122:0/2015105344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf100ce4f0 0x7faf100b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:33.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf0de00640 1 -- 172.21.15.122:0/2015105344 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf100b58d0 msgr2=0x7faf1013b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:33.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf0de00640 1 --2- 172.21.15.122:0/2015105344 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf100b58d0 0x7faf1013b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf0de00640 1 -- 172.21.15.122:0/2015105344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf100ce4f0 msgr2=0x7faf100b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:33.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf0de00640 1 --2- 172.21.15.122:0/2015105344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf100ce4f0 0x7faf100b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf0de00640 1 -- 172.21.15.122:0/2015105344 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf100b4160 con 0x7faf100722a0 2024-05-28T06:14:33.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf0d400640 1 --2- 172.21.15.122:0/2015105344 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf100b58d0 0x7faf1013b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:14:33.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf0de00640 1 --2- 172.21.15.122:0/2015105344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf100722a0 0x7faf100b5200 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7faf0000e960 tx=0x7faf0000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:33.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf06000640 1 -- 172.21.15.122:0/2015105344 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf00017070 con 0x7faf100722a0 2024-05-28T06:14:33.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf06000640 1 -- 172.21.15.122:0/2015105344 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf0000ca00 con 0x7faf100722a0 2024-05-28T06:14:33.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf06000640 1 -- 172.21.15.122:0/2015105344 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0000cdb0 con 0x7faf100722a0 2024-05-28T06:14:33.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf15200640 1 -- 172.21.15.122:0/2015105344 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf100b4440 con 0x7faf100722a0 2024-05-28T06:14:33.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf15200640 1 -- 172.21.15.122:0/2015105344 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf100b4a00 con 0x7faf100722a0 2024-05-28T06:14:33.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.297+0000 7faf15200640 1 -- 172.21.15.122:0/2015105344 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faf10076020 con 0x7faf100722a0 2024-05-28T06:14:33.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.301+0000 7faf06000640 1 -- 172.21.15.122:0/2015105344 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 89007+0+0 (secure 0 0 0) 0x7faf0001a070 con 0x7faf100722a0 2024-05-28T06:14:33.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.301+0000 7faf06000640 1 --2- 172.21.15.122:0/2015105344 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7faef0068ec0 0x7faef006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:33.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.301+0000 7faf06000640 1 -- 172.21.15.122:0/2015105344 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7faf000859a0 con 0x7faf100722a0 2024-05-28T06:14:33.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.301+0000 7faf0d400640 1 --2- 172.21.15.122:0/2015105344 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7faef0068ec0 0x7faef006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:33.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.301+0000 7faf06000640 1 --2- 172.21.15.122:0/2015105344 >> [v2:172.21.15.122:6808/1210437339,v1:172.21.15.122:6809/1210437339] conn(0x7faef00710c0 0x7faef00734e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:33.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.301+0000 7faf06000640 1 -- 172.21.15.122:0/2015105344 --> [v2:172.21.15.122:6808/1210437339,v1:172.21.15.122:6809/1210437339] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faef0073bb0 con 0x7faef00710c0 2024-05-28T06:14:33.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.301+0000 7faf06000640 1 -- 172.21.15.122:0/2015105344 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7faf0008f050 con 0x7faf100722a0 2024-05-28T06:14:33.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.301+0000 7faf0e800640 1 --2- 172.21.15.122:0/2015105344 >> [v2:172.21.15.122:6808/1210437339,v1:172.21.15.122:6809/1210437339] conn(0x7faef00710c0 0x7faef00734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:33.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.301+0000 7faf0d400640 1 --2- 172.21.15.122:0/2015105344 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7faef0068ec0 0x7faef006b380 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7faefc0ae000 tx=0x7faefc0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:33.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.301+0000 7faf0e800640 1 --2- 172.21.15.122:0/2015105344 >> [v2:172.21.15.122:6808/1210437339,v1:172.21.15.122:6809/1210437339] conn(0x7faef00710c0 0x7faef00734e0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:33.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.301+0000 7faf06000640 1 -- 172.21.15.122:0/2015105344 <== osd.1 v2:172.21.15.122:6808/1210437339 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faef0073bb0 con 0x7faef00710c0 2024-05-28T06:14:33.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.317+0000 7faf15200640 1 -- 172.21.15.122:0/2015105344 --> [v2:172.21.15.122:6808/1210437339,v1:172.21.15.122:6809/1210437339] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7faf10068c40 con 0x7faef00710c0 2024-05-28T06:14:33.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.317+0000 7faf06000640 1 -- 172.21.15.122:0/2015105344 <== osd.1 v2:172.21.15.122:6808/1210437339 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7faf10068c40 con 0x7faef00710c0 2024-05-28T06:14:33.316 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:14:33.316 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-28T06:14:33.316 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:14:33.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.317+0000 7faf15200640 1 -- 172.21.15.122:0/2015105344 >> [v2:172.21.15.122:6808/1210437339,v1:172.21.15.122:6809/1210437339] conn(0x7faef00710c0 msgr2=0x7faef00734e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:33.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.317+0000 7faf15200640 1 --2- 172.21.15.122:0/2015105344 >> [v2:172.21.15.122:6808/1210437339,v1:172.21.15.122:6809/1210437339] conn(0x7faef00710c0 0x7faef00734e0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.317+0000 7faf15200640 1 -- 172.21.15.122:0/2015105344 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7faef0068ec0 msgr2=0x7faef006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:33.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.317+0000 7faf15200640 1 --2- 172.21.15.122:0/2015105344 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7faef0068ec0 0x7faef006b380 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7faefc0ae000 tx=0x7faefc0a7000 comp rx=0 tx=0).stop 2024-05-28T06:14:33.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.317+0000 7faf15200640 1 -- 172.21.15.122:0/2015105344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf100722a0 msgr2=0x7faf100b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:33.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.317+0000 7faf15200640 1 --2- 172.21.15.122:0/2015105344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf100722a0 0x7faf100b5200 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7faf0000e960 tx=0x7faf0000ee20 comp rx=0 tx=0).stop 2024-05-28T06:14:33.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.317+0000 7faf0e800640 1 -- 172.21.15.122:0/2015105344 reap_dead start 2024-05-28T06:14:33.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.317+0000 7faf15200640 1 -- 172.21.15.122:0/2015105344 shutdown_connections 2024-05-28T06:14:33.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.317+0000 7faf15200640 1 -- 172.21.15.122:0/2015105344 >> 172.21.15.122:0/2015105344 conn(0x7faf1006bd90 msgr2=0x7faf100b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:33.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.317+0000 7faf15200640 1 -- 172.21.15.122:0/2015105344 shutdown_connections 2024-05-28T06:14:33.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.317+0000 7faf15200640 1 -- 172.21.15.122:0/2015105344 wait complete. 2024-05-28T06:14:33.334 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-28T06:14:33.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.473+0000 7f60f8800640 1 Processor -- start 2024-05-28T06:14:33.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.473+0000 7f60f8800640 1 -- start start 2024-05-28T06:14:33.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.473+0000 7f60f8800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f60f015e8e0 0x7f60f00b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:33.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.473+0000 7f60f8800640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60f0071af0 con 0x7f60f00d2d20 2024-05-28T06:14:33.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.473+0000 7f60f8800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60f0071dd0 con 0x7f60f00b6620 2024-05-28T06:14:33.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.473+0000 7f60f8800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f60f00720b0 con 0x7f60f015e8e0 2024-05-28T06:14:33.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.473+0000 7f60f6800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f60f00d2d20 0x7f60f006d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:49810/0 (socket says 172.21.15.122:49810) 2024-05-28T06:14:33.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.473+0000 7f60f6800640 1 -- 172.21.15.122:0/1399366533 learned_addr learned my addr 172.21.15.122:0/1399366533 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:14:33.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.477+0000 7f60f5e00640 1 --2- 172.21.15.122:0/1399366533 >> v2:172.21.15.153:3300/0 conn(0x7f60f015e8e0 0x7f60f00b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:33.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.477+0000 7f60f4a00640 1 -- 172.21.15.122:0/1399366533 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1145628813 0 0) 0x7f60f0071af0 con 0x7f60f00d2d20 2024-05-28T06:14:33.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.477+0000 7f60f4a00640 1 -- 172.21.15.122:0/1399366533 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60d8003530 con 0x7f60f00d2d20 2024-05-28T06:14:33.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.477+0000 7f60f5e00640 1 -- 172.21.15.122:0/1399366533 >> v1:172.21.15.153:6789/0 conn(0x7f60f00b6620 legacy=0x7f60f00d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:33.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.477+0000 7f60f5e00640 1 -- 172.21.15.122:0/1399366533 >> v1:172.21.15.122:6789/0 conn(0x7f60f00d2d20 legacy=0x7f60f006d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:33.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.477+0000 7f60f4a00640 1 -- 172.21.15.122:0/1399366533 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 174707551 0 0) 0x7f60d8003530 con 0x7f60f00d2d20 2024-05-28T06:14:33.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.477+0000 7f60f5e00640 1 -- 172.21.15.122:0/1399366533 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f0072390 con 0x7f60f015e8e0 2024-05-28T06:14:33.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.477+0000 7f60f5e00640 1 --2- 172.21.15.122:0/1399366533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60f015e8e0 0x7f60f00b60e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f60e40097c0 tx=0x7f60e401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71a83d83f21e10fc server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:33.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.481+0000 7f60f4a00640 1 -- 172.21.15.122:0/1399366533 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e40b0070 con 0x7f60f015e8e0 2024-05-28T06:14:33.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.481+0000 7f60f4a00640 1 -- 172.21.15.122:0/1399366533 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60e40ab400 con 0x7f60f015e8e0 2024-05-28T06:14:33.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.481+0000 7f60f4a00640 1 -- 172.21.15.122:0/1399366533 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ec001a00 con 0x7f60f015e8e0 2024-05-28T06:14:33.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.481+0000 7f60f8800640 1 -- 172.21.15.122:0/1399366533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60f015e8e0 msgr2=0x7f60f00b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:33.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.481+0000 7f60f8800640 1 --2- 172.21.15.122:0/1399366533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60f015e8e0 0x7f60f00b60e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f60e40097c0 tx=0x7f60e401c3c0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.481+0000 7f60f8800640 1 -- 172.21.15.122:0/1399366533 shutdown_connections 2024-05-28T06:14:33.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.481+0000 7f60f8800640 1 --2- 172.21.15.122:0/1399366533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60f015e8e0 0x7f60f00b60e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.481+0000 7f60f8800640 1 -- 172.21.15.122:0/1399366533 >> 172.21.15.122:0/1399366533 conn(0x7f60f00702f0 msgr2=0x7f60f0070700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:33.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.481+0000 7f60f8800640 1 -- 172.21.15.122:0/1399366533 shutdown_connections 2024-05-28T06:14:33.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.481+0000 7f60f8800640 1 -- 172.21.15.122:0/1399366533 wait complete. 2024-05-28T06:14:33.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.481+0000 7f60f8800640 1 Processor -- start 2024-05-28T06:14:33.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.481+0000 7f60f8800640 1 -- start start 2024-05-28T06:14:33.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.481+0000 7f60f8800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60f00b6620 0x7f60f014c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:33.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.481+0000 7f60f8800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60f00d2d20 0x7f60f00cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:33.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.481+0000 7f60f8800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60f015e8e0 0x7f60f00cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:33.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.481+0000 7f60f8800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f60f016c9f0 con 0x7f60f00b6620 2024-05-28T06:14:33.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.481+0000 7f60f8800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f60f016c870 con 0x7f60f00d2d20 2024-05-28T06:14:33.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.481+0000 7f60f8800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f60f016cb70 con 0x7f60f015e8e0 2024-05-28T06:14:33.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.481+0000 7f60f5e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60f00b6620 0x7f60f014c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:33.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.481+0000 7f60f5e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60f00b6620 0x7f60f014c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52218/0 (socket says 172.21.15.122:52218) 2024-05-28T06:14:33.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.481+0000 7f60f5e00640 1 -- 172.21.15.122:0/983412414 learned_addr learned my addr 172.21.15.122:0/983412414 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:33.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.481+0000 7f60f6800640 1 --2- 172.21.15.122:0/983412414 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60f015e8e0 0x7f60f00cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:33.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.481+0000 7f60f5400640 1 --2- 172.21.15.122:0/983412414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60f00d2d20 0x7f60f00cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:33.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.485+0000 7f60f5e00640 1 -- 172.21.15.122:0/983412414 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60f015e8e0 msgr2=0x7f60f00cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:33.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.485+0000 7f60f5e00640 1 --2- 172.21.15.122:0/983412414 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60f015e8e0 0x7f60f00cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.485+0000 7f60f5e00640 1 -- 172.21.15.122:0/983412414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60f00d2d20 msgr2=0x7f60f00cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:33.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.485+0000 7f60f5e00640 1 --2- 172.21.15.122:0/983412414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60f00d2d20 0x7f60f00cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.485+0000 7f60f5e00640 1 -- 172.21.15.122:0/983412414 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f00b2f50 con 0x7f60f00b6620 2024-05-28T06:14:33.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.485+0000 7f60f5e00640 1 --2- 172.21.15.122:0/983412414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60f00b6620 0x7f60f014c150 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f60e40097c0 tx=0x7f60e401ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:33.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.485+0000 7f60ea000640 1 -- 172.21.15.122:0/983412414 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e40bb020 con 0x7f60f00b6620 2024-05-28T06:14:33.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.485+0000 7f60ea000640 1 -- 172.21.15.122:0/983412414 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60e40b1040 con 0x7f60f00b6620 2024-05-28T06:14:33.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.485+0000 7f60ea000640 1 -- 172.21.15.122:0/983412414 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e40b0050 con 0x7f60f00b6620 2024-05-28T06:14:33.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.485+0000 7f60f8800640 1 -- 172.21.15.122:0/983412414 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60f00b3230 con 0x7f60f00b6620 2024-05-28T06:14:33.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.485+0000 7f60f8800640 1 -- 172.21.15.122:0/983412414 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60f00b37f0 con 0x7f60f00b6620 2024-05-28T06:14:33.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.485+0000 7f60f8800640 1 -- 172.21.15.122:0/983412414 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60f006ec30 con 0x7f60f00b6620 2024-05-28T06:14:33.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.485+0000 7f60ea000640 1 -- 172.21.15.122:0/983412414 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 89007+0+0 (secure 0 0 0) 0x7f60e40be070 con 0x7f60f00b6620 2024-05-28T06:14:33.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.485+0000 7f60ea000640 1 --2- 172.21.15.122:0/983412414 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f60d4068ef0 0x7f60d406b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:33.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.485+0000 7f60ea000640 1 -- 172.21.15.122:0/983412414 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f60e411ea40 con 0x7f60f00b6620 2024-05-28T06:14:33.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.485+0000 7f60f5400640 1 --2- 172.21.15.122:0/983412414 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f60d4068ef0 0x7f60d406b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:33.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.489+0000 7f60f5400640 1 --2- 172.21.15.122:0/983412414 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f60d4068ef0 0x7f60d406b3b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f60f00b4ef0 tx=0x7f60e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:33.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.489+0000 7f60ea000640 1 -- 172.21.15.122:0/983412414 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f60e4015fb0 con 0x7f60f00b6620 2024-05-28T06:14:33.650 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.649+0000 7f60f8800640 1 -- 172.21.15.122:0/983412414 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f60f006caa0 con 0x7f60d4068ef0 2024-05-28T06:14:33.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.653+0000 7f60ea000640 1 -- 172.21.15.122:0/983412414 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f60f006caa0 con 0x7f60d4068ef0 2024-05-28T06:14:33.651 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 1 to deep-scrub 2024-05-28T06:14:33.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.653+0000 7f60f8800640 1 -- 172.21.15.122:0/983412414 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f60d4068ef0 msgr2=0x7f60d406b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:33.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.653+0000 7f60f8800640 1 --2- 172.21.15.122:0/983412414 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f60d4068ef0 0x7f60d406b3b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f60f00b4ef0 tx=0x7f60e0009040 comp rx=0 tx=0).stop 2024-05-28T06:14:33.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.653+0000 7f60f8800640 1 -- 172.21.15.122:0/983412414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60f00b6620 msgr2=0x7f60f014c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:33.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.653+0000 7f60f8800640 1 --2- 172.21.15.122:0/983412414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60f00b6620 0x7f60f014c150 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f60e40097c0 tx=0x7f60e401ac00 comp rx=0 tx=0).stop 2024-05-28T06:14:33.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.653+0000 7f60f8800640 1 -- 172.21.15.122:0/983412414 shutdown_connections 2024-05-28T06:14:33.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.653+0000 7f60f8800640 1 --2- 172.21.15.122:0/983412414 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f60d4068ef0 0x7f60d406b3b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.653+0000 7f60f8800640 1 --2- 172.21.15.122:0/983412414 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60f015e8e0 0x7f60f00cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.653+0000 7f60f8800640 1 --2- 172.21.15.122:0/983412414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60f00d2d20 0x7f60f00cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.653+0000 7f60f8800640 1 --2- 172.21.15.122:0/983412414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60f00b6620 0x7f60f014c150 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.653+0000 7f60f8800640 1 -- 172.21.15.122:0/983412414 >> 172.21.15.122:0/983412414 conn(0x7f60f00702f0 msgr2=0x7f60f015fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:33.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.653+0000 7f60f8800640 1 -- 172.21.15.122:0/983412414 shutdown_connections 2024-05-28T06:14:33.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.653+0000 7f60f8800640 1 -- 172.21.15.122:0/983412414 wait complete. 2024-05-28T06:14:33.672 INFO:tasks.ceph:Scrubbing osd.2 2024-05-28T06:14:33.672 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-28T06:14:33.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.813+0000 7fb32ea00640 1 Processor -- start 2024-05-28T06:14:33.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.813+0000 7fb32ea00640 1 -- start start 2024-05-28T06:14:33.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.817+0000 7fb32ea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3280b58d0 0x7fb3280b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:33.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.817+0000 7fb32ea00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb3280ce4f0 0x7fb3280ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:33.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.817+0000 7fb32ea00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3280b61f0 con 0x7fb3280722a0 2024-05-28T06:14:33.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.817+0000 7fb32ea00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb32815d970 con 0x7fb3280ce4f0 2024-05-28T06:14:33.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.817+0000 7fb32ea00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb32815dc50 con 0x7fb3280b58d0 2024-05-28T06:14:33.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.817+0000 7fb327400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb3280ce4f0 0x7fb3280ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:33.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.817+0000 7fb327e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3280b58d0 0x7fb3280b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:33.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.817+0000 7fb327400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb3280ce4f0 0x7fb3280ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:47974/0 (socket says 172.21.15.122:47974) 2024-05-28T06:14:33.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.817+0000 7fb327400640 1 -- 172.21.15.122:0/928014278 learned_addr learned my addr 172.21.15.122:0/928014278 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:33.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.817+0000 7fb327400640 1 -- 172.21.15.122:0/928014278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3280b58d0 msgr2=0x7fb3280b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:33.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.817+0000 7fb327400640 1 --2- 172.21.15.122:0/928014278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3280b58d0 0x7fb3280b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.817+0000 7fb327400640 1 -- 172.21.15.122:0/928014278 >> v1:172.21.15.153:6789/0 conn(0x7fb3280722a0 legacy=0x7fb328072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:33.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.817+0000 7fb327400640 1 -- 172.21.15.122:0/928014278 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32815df30 con 0x7fb3280ce4f0 2024-05-28T06:14:33.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.821+0000 7fb327400640 1 --2- 172.21.15.122:0/928014278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3280ce4f0 0x7fb3280ce950 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb314009870 tx=0x7fb31401c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a74595d5f5cc8aa1 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:33.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.821+0000 7fb326a00640 1 -- 172.21.15.122:0/928014278 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3140aa430 con 0x7fb3280ce4f0 2024-05-28T06:14:33.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.821+0000 7fb326a00640 1 -- 172.21.15.122:0/928014278 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3140af070 con 0x7fb3280ce4f0 2024-05-28T06:14:33.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.821+0000 7fb326a00640 1 -- 172.21.15.122:0/928014278 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3140aa7f0 con 0x7fb3280ce4f0 2024-05-28T06:14:33.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.821+0000 7fb32ea00640 1 -- 172.21.15.122:0/928014278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3280ce4f0 msgr2=0x7fb3280ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:33.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.821+0000 7fb32ea00640 1 --2- 172.21.15.122:0/928014278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3280ce4f0 0x7fb3280ce950 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb314009870 tx=0x7fb31401c530 comp rx=0 tx=0).stop 2024-05-28T06:14:33.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.821+0000 7fb32ea00640 1 -- 172.21.15.122:0/928014278 shutdown_connections 2024-05-28T06:14:33.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.821+0000 7fb32ea00640 1 --2- 172.21.15.122:0/928014278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3280ce4f0 0x7fb3280ce950 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.821+0000 7fb32ea00640 1 --2- 172.21.15.122:0/928014278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3280b58d0 0x7fb3280b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.821+0000 7fb32ea00640 1 -- 172.21.15.122:0/928014278 >> 172.21.15.122:0/928014278 conn(0x7fb32806bd90 msgr2=0x7fb32806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:33.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.821+0000 7fb32ea00640 1 -- 172.21.15.122:0/928014278 shutdown_connections 2024-05-28T06:14:33.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.821+0000 7fb32ea00640 1 -- 172.21.15.122:0/928014278 wait complete. 2024-05-28T06:14:33.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.821+0000 7fb32ea00640 1 Processor -- start 2024-05-28T06:14:33.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.821+0000 7fb32ea00640 1 -- start start 2024-05-28T06:14:33.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb32ea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3280722a0 0x7fb3280afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:33.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb32ea00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3280b58d0 0x7fb32813df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:33.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb32ea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3280ce4f0 0x7fb328160b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:33.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb32ea00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb3280cf010 con 0x7fb3280b58d0 2024-05-28T06:14:33.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb32ea00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb3280cee90 con 0x7fb3280722a0 2024-05-28T06:14:33.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb32ea00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fb328169a60 con 0x7fb3280ce4f0 2024-05-28T06:14:33.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb327400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3280b58d0 0x7fb32813df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:33.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb327400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3280b58d0 0x7fb32813df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52234/0 (socket says 172.21.15.122:52234) 2024-05-28T06:14:33.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb327400640 1 -- 172.21.15.122:0/2091064786 learned_addr learned my addr 172.21.15.122:0/2091064786 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:33.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb327e00640 1 --2- 172.21.15.122:0/2091064786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3280722a0 0x7fb3280afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:33.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb32ca00640 1 --2- 172.21.15.122:0/2091064786 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3280ce4f0 0x7fb328160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:33.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb327400640 1 -- 172.21.15.122:0/2091064786 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3280ce4f0 msgr2=0x7fb328160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:33.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb327400640 1 --2- 172.21.15.122:0/2091064786 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3280ce4f0 0x7fb328160b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb327400640 1 -- 172.21.15.122:0/2091064786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3280722a0 msgr2=0x7fb3280afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:33.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb327400640 1 --2- 172.21.15.122:0/2091064786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3280722a0 0x7fb3280afb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb327400640 1 -- 172.21.15.122:0/2091064786 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3280b4fb0 con 0x7fb3280b58d0 2024-05-28T06:14:33.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb32ca00640 1 --2- 172.21.15.122:0/2091064786 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3280ce4f0 0x7fb328160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:14:33.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb327400640 1 --2- 172.21.15.122:0/2091064786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3280b58d0 0x7fb32813df50 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb31401a160 tx=0x7fb31401ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:33.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb31fe00640 1 -- 172.21.15.122:0/2091064786 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3140bd5f0 con 0x7fb3280b58d0 2024-05-28T06:14:33.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb31fe00640 1 -- 172.21.15.122:0/2091064786 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3140bd790 con 0x7fb3280b58d0 2024-05-28T06:14:33.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb32ea00640 1 -- 172.21.15.122:0/2091064786 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3280b5290 con 0x7fb3280b58d0 2024-05-28T06:14:33.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb31fe00640 1 -- 172.21.15.122:0/2091064786 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3140bdb80 con 0x7fb3280b58d0 2024-05-28T06:14:33.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb32ea00640 1 -- 172.21.15.122:0/2091064786 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3280af620 con 0x7fb3280b58d0 2024-05-28T06:14:33.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb32ea00640 1 -- 172.21.15.122:0/2091064786 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb328076020 con 0x7fb3280b58d0 2024-05-28T06:14:33.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.825+0000 7fb31fe00640 1 -- 172.21.15.122:0/2091064786 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 89007+0+0 (secure 0 0 0) 0x7fb3140b33f0 con 0x7fb3280b58d0 2024-05-28T06:14:33.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.829+0000 7fb31fe00640 1 --2- 172.21.15.122:0/2091064786 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb308068ec0 0x7fb30806b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:33.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.829+0000 7fb31fe00640 1 -- 172.21.15.122:0/2091064786 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7fb3141226c0 con 0x7fb3280b58d0 2024-05-28T06:14:33.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.829+0000 7fb327e00640 1 --2- 172.21.15.122:0/2091064786 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb308068ec0 0x7fb30806b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:33.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.829+0000 7fb31fe00640 1 --2- 172.21.15.122:0/2091064786 >> [v2:172.21.15.122:6816/791000953,v1:172.21.15.122:6817/791000953] conn(0x7fb3080710c0 0x7fb3080734e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:33.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.829+0000 7fb31fe00640 1 -- 172.21.15.122:0/2091064786 --> [v2:172.21.15.122:6816/791000953,v1:172.21.15.122:6817/791000953] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb308073bb0 con 0x7fb3080710c0 2024-05-28T06:14:33.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.829+0000 7fb31fe00640 1 -- 172.21.15.122:0/2091064786 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fb3141228c0 con 0x7fb3280b58d0 2024-05-28T06:14:33.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.829+0000 7fb32ca00640 1 --2- 172.21.15.122:0/2091064786 >> [v2:172.21.15.122:6816/791000953,v1:172.21.15.122:6817/791000953] conn(0x7fb3080710c0 0x7fb3080734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:33.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.829+0000 7fb327e00640 1 --2- 172.21.15.122:0/2091064786 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb308068ec0 0x7fb30806b380 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb318009af0 tx=0x7fb318008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:33.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.829+0000 7fb32ca00640 1 --2- 172.21.15.122:0/2091064786 >> [v2:172.21.15.122:6816/791000953,v1:172.21.15.122:6817/791000953] conn(0x7fb3080710c0 0x7fb3080734e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:33.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.829+0000 7fb31fe00640 1 -- 172.21.15.122:0/2091064786 <== osd.2 v2:172.21.15.122:6816/791000953 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb308073bb0 con 0x7fb3080710c0 2024-05-28T06:14:33.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.841+0000 7fb32ea00640 1 -- 172.21.15.122:0/2091064786 --> [v2:172.21.15.122:6816/791000953,v1:172.21.15.122:6817/791000953] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb328068c40 con 0x7fb3080710c0 2024-05-28T06:14:33.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.841+0000 7fb31fe00640 1 -- 172.21.15.122:0/2091064786 <== osd.2 v2:172.21.15.122:6816/791000953 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb328068c40 con 0x7fb3080710c0 2024-05-28T06:14:33.842 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:14:33.842 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-28T06:14:33.843 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:14:33.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.841+0000 7fb32ea00640 1 -- 172.21.15.122:0/2091064786 >> [v2:172.21.15.122:6816/791000953,v1:172.21.15.122:6817/791000953] conn(0x7fb3080710c0 msgr2=0x7fb3080734e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:33.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.841+0000 7fb32ea00640 1 --2- 172.21.15.122:0/2091064786 >> [v2:172.21.15.122:6816/791000953,v1:172.21.15.122:6817/791000953] conn(0x7fb3080710c0 0x7fb3080734e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:33.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.841+0000 7fb32ea00640 1 -- 172.21.15.122:0/2091064786 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb308068ec0 msgr2=0x7fb30806b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:33.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.841+0000 7fb32ea00640 1 --2- 172.21.15.122:0/2091064786 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fb308068ec0 0x7fb30806b380 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb318009af0 tx=0x7fb318008040 comp rx=0 tx=0).stop 2024-05-28T06:14:33.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.845+0000 7fb32ea00640 1 -- 172.21.15.122:0/2091064786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3280b58d0 msgr2=0x7fb32813df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:33.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.845+0000 7fb32ea00640 1 --2- 172.21.15.122:0/2091064786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3280b58d0 0x7fb32813df50 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb31401a160 tx=0x7fb31401ad70 comp rx=0 tx=0).stop 2024-05-28T06:14:33.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.845+0000 7fb32ca00640 1 -- 172.21.15.122:0/2091064786 reap_dead start 2024-05-28T06:14:33.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.845+0000 7fb32ea00640 1 -- 172.21.15.122:0/2091064786 shutdown_connections 2024-05-28T06:14:33.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.845+0000 7fb32ea00640 1 -- 172.21.15.122:0/2091064786 >> 172.21.15.122:0/2091064786 conn(0x7fb32806bd90 msgr2=0x7fb32806c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:33.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.845+0000 7fb32ea00640 1 -- 172.21.15.122:0/2091064786 shutdown_connections 2024-05-28T06:14:33.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.845+0000 7fb32ea00640 1 -- 172.21.15.122:0/2091064786 wait complete. 2024-05-28T06:14:33.861 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-28T06:14:33.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.997+0000 7f0b04e00640 1 Processor -- start 2024-05-28T06:14:33.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:33.997+0000 7f0b04e00640 1 -- start start 2024-05-28T06:14:33.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.001+0000 7f0b04e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b00147960 0x7f0b00070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.001+0000 7f0b04e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0b0006fbe0 0x7f0b0006b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.001+0000 7f0b04e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b001482d0 con 0x7f0b00070020 2024-05-28T06:14:34.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.001+0000 7f0b04e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f0b0006f750 con 0x7f0b0006fbe0 2024-05-28T06:14:34.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.001+0000 7f0b04e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0b000b4a10 con 0x7f0b00147960 2024-05-28T06:14:34.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.001+0000 7f0aff400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b00147960 0x7f0b00070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.001+0000 7f0aff400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b00147960 0x7f0b00070a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:60410/0 (socket says 172.21.15.122:60410) 2024-05-28T06:14:34.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.001+0000 7f0af6a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0b0006fbe0 0x7f0b0006b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.001+0000 7f0aff400640 1 -- 172.21.15.122:0/975609748 learned_addr learned my addr 172.21.15.122:0/975609748 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:34.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.001+0000 7f0aff400640 1 -- 172.21.15.122:0/975609748 >> v2:172.21.15.153:3300/0 conn(0x7f0b0006fbe0 msgr2=0x7f0b0006b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:34.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.001+0000 7f0aff400640 1 --2- 172.21.15.122:0/975609748 >> v2:172.21.15.153:3300/0 conn(0x7f0b0006fbe0 0x7f0b0006b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.001+0000 7f0aff400640 1 -- 172.21.15.122:0/975609748 >> v1:172.21.15.153:6789/0 conn(0x7f0b00070020 legacy=0x7f0b000ae310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.001+0000 7f0aff400640 1 -- 172.21.15.122:0/975609748 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b00070f70 con 0x7f0b00147960 2024-05-28T06:14:34.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.005+0000 7f0aff400640 1 --2- 172.21.15.122:0/975609748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b00147960 0x7f0b00070a30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009870 tx=0x7f0af001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5ed5659a9ce1de2 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:34.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.005+0000 7f0afea00640 1 -- 172.21.15.122:0/975609748 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af00a9640 con 0x7f0b00147960 2024-05-28T06:14:34.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.005+0000 7f0afea00640 1 -- 172.21.15.122:0/975609748 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af00a97e0 con 0x7f0b00147960 2024-05-28T06:14:34.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.005+0000 7f0afea00640 1 -- 172.21.15.122:0/975609748 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af00a9bb0 con 0x7f0b00147960 2024-05-28T06:14:34.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.005+0000 7f0b04e00640 1 -- 172.21.15.122:0/975609748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b00147960 msgr2=0x7f0b00070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.005+0000 7f0b04e00640 1 --2- 172.21.15.122:0/975609748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b00147960 0x7f0b00070a30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009870 tx=0x7f0af001c560 comp rx=0 tx=0).stop 2024-05-28T06:14:34.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.005+0000 7f0b04e00640 1 -- 172.21.15.122:0/975609748 shutdown_connections 2024-05-28T06:14:34.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.005+0000 7f0b04e00640 1 --2- 172.21.15.122:0/975609748 >> v2:172.21.15.153:3300/0 conn(0x7f0b0006fbe0 0x7f0b0006b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.005+0000 7f0b04e00640 1 --2- 172.21.15.122:0/975609748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b00147960 0x7f0b00070a30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.005+0000 7f0b04e00640 1 -- 172.21.15.122:0/975609748 >> 172.21.15.122:0/975609748 conn(0x7f0b000b6a70 msgr2=0x7f0b0009aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:34.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.005+0000 7f0b04e00640 1 -- 172.21.15.122:0/975609748 shutdown_connections 2024-05-28T06:14:34.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.005+0000 7f0b04e00640 1 -- 172.21.15.122:0/975609748 wait complete. 2024-05-28T06:14:34.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.005+0000 7f0b04e00640 1 Processor -- start 2024-05-28T06:14:34.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.005+0000 7f0b04e00640 1 -- start start 2024-05-28T06:14:34.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0b04e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b0006fbe0 0x7f0b001f7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0b04e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b00070020 0x7f0b0015dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0b04e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b00147960 0x7f0b001465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0b04e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0006f3e0 con 0x7f0b00070020 2024-05-28T06:14:34.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0b04e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0006c2e0 con 0x7f0b00147960 2024-05-28T06:14:34.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0b04e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f0b000b4330 con 0x7f0b0006fbe0 2024-05-28T06:14:34.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0af6a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b00070020 0x7f0b0015dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0af6a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b00070020 0x7f0b0015dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52250/0 (socket says 172.21.15.122:52250) 2024-05-28T06:14:34.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0af6a00640 1 -- 172.21.15.122:0/2509996315 learned_addr learned my addr 172.21.15.122:0/2509996315 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:34.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0aff400640 1 --2- 172.21.15.122:0/2509996315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b0006fbe0 0x7f0b001f7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0affe00640 1 --2- 172.21.15.122:0/2509996315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b00147960 0x7f0b001465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0af6a00640 1 -- 172.21.15.122:0/2509996315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b0006fbe0 msgr2=0x7f0b001f7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0af6a00640 1 --2- 172.21.15.122:0/2509996315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b0006fbe0 0x7f0b001f7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0af6a00640 1 -- 172.21.15.122:0/2509996315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b00147960 msgr2=0x7f0b001465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0af6a00640 1 --2- 172.21.15.122:0/2509996315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b00147960 0x7f0b001465f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0af6a00640 1 -- 172.21.15.122:0/2509996315 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b0009c2a0 con 0x7f0b00070020 2024-05-28T06:14:34.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0af6a00640 1 --2- 172.21.15.122:0/2509996315 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b00070020 0x7f0b0015dbc0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800e930 tx=0x7f0ae800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:34.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0af7e00640 1 -- 172.21.15.122:0/2509996315 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8017070 con 0x7f0b00070020 2024-05-28T06:14:34.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0af7e00640 1 -- 172.21.15.122:0/2509996315 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ae800ca00 con 0x7f0b00070020 2024-05-28T06:14:34.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0af7e00640 1 -- 172.21.15.122:0/2509996315 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae800cdb0 con 0x7f0b00070020 2024-05-28T06:14:34.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0b04e00640 1 -- 172.21.15.122:0/2509996315 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b0009c580 con 0x7f0b00070020 2024-05-28T06:14:34.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0b04e00640 1 -- 172.21.15.122:0/2509996315 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b0009cb40 con 0x7f0b00070020 2024-05-28T06:14:34.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0b04e00640 1 -- 172.21.15.122:0/2509996315 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b0015fd10 con 0x7f0b00070020 2024-05-28T06:14:34.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.009+0000 7f0af7e00640 1 -- 172.21.15.122:0/2509996315 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 89007+0+0 (secure 0 0 0) 0x7f0ae801a070 con 0x7f0b00070020 2024-05-28T06:14:34.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.013+0000 7f0af7e00640 1 --2- 172.21.15.122:0/2509996315 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0adc068ef0 0x7f0adc06b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.013+0000 7f0af7e00640 1 -- 172.21.15.122:0/2509996315 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f0ae80858e0 con 0x7f0b00070020 2024-05-28T06:14:34.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.013+0000 7f0aff400640 1 --2- 172.21.15.122:0/2509996315 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0adc068ef0 0x7f0adc06b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.013+0000 7f0aff400640 1 --2- 172.21.15.122:0/2509996315 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0adc068ef0 0x7f0adc06b3b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0af00ae000 tx=0x7f0af00a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:34.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.017+0000 7f0af7e00640 1 -- 172.21.15.122:0/2509996315 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0ae8057080 con 0x7f0b00070020 2024-05-28T06:14:34.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.173+0000 7f0b04e00640 1 -- 172.21.15.122:0/2509996315 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f0b000ae4b0 con 0x7f0adc068ef0 2024-05-28T06:14:34.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.173+0000 7f0af7e00640 1 -- 172.21.15.122:0/2509996315 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0b000ae4b0 con 0x7f0adc068ef0 2024-05-28T06:14:34.172 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 2 to deep-scrub 2024-05-28T06:14:34.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.173+0000 7f0b04e00640 1 -- 172.21.15.122:0/2509996315 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0adc068ef0 msgr2=0x7f0adc06b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.173+0000 7f0b04e00640 1 --2- 172.21.15.122:0/2509996315 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0adc068ef0 0x7f0adc06b3b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0af00ae000 tx=0x7f0af00a7000 comp rx=0 tx=0).stop 2024-05-28T06:14:34.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.173+0000 7f0b04e00640 1 -- 172.21.15.122:0/2509996315 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b00070020 msgr2=0x7f0b0015dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.173+0000 7f0b04e00640 1 --2- 172.21.15.122:0/2509996315 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b00070020 0x7f0b0015dbc0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800e930 tx=0x7f0ae800edf0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.173+0000 7f0b04e00640 1 -- 172.21.15.122:0/2509996315 shutdown_connections 2024-05-28T06:14:34.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.173+0000 7f0b04e00640 1 --2- 172.21.15.122:0/2509996315 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f0adc068ef0 0x7f0adc06b3b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.173+0000 7f0b04e00640 1 --2- 172.21.15.122:0/2509996315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b00147960 0x7f0b001465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.173+0000 7f0b04e00640 1 --2- 172.21.15.122:0/2509996315 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b00070020 0x7f0b0015dbc0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.173+0000 7f0b04e00640 1 --2- 172.21.15.122:0/2509996315 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b0006fbe0 0x7f0b001f7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.173+0000 7f0b04e00640 1 -- 172.21.15.122:0/2509996315 >> 172.21.15.122:0/2509996315 conn(0x7f0b000b6a70 msgr2=0x7f0b000b5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:34.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.173+0000 7f0b04e00640 1 -- 172.21.15.122:0/2509996315 shutdown_connections 2024-05-28T06:14:34.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.173+0000 7f0b04e00640 1 -- 172.21.15.122:0/2509996315 wait complete. 2024-05-28T06:14:34.193 INFO:tasks.ceph:Scrubbing osd.3 2024-05-28T06:14:34.194 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-28T06:14:34.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.337+0000 7fd305200640 1 Processor -- start 2024-05-28T06:14:34.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.337+0000 7fd305200640 1 -- start start 2024-05-28T06:14:34.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.337+0000 7fd305200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3000cff30 0x7fd30006f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.337+0000 7fd305200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd3000cdb00 0x7fd3000b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.337+0000 7fd305200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3000d0310 con 0x7fd30006f6c0 2024-05-28T06:14:34.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.337+0000 7fd305200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd30006fb00 con 0x7fd3000cdb00 2024-05-28T06:14:34.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.337+0000 7fd305200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd3000cdf30 con 0x7fd3000cff30 2024-05-28T06:14:34.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.337+0000 7fd2fe800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd3000cdb00 0x7fd3000b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.337+0000 7fd2fde00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3000cff30 0x7fd30006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.337+0000 7fd2fde00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3000cff30 0x7fd30006f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:60422/0 (socket says 172.21.15.122:60422) 2024-05-28T06:14:34.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.337+0000 7fd2fde00640 1 -- 172.21.15.122:0/3970152563 learned_addr learned my addr 172.21.15.122:0/3970152563 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:34.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.337+0000 7fd2fe800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd3000cdb00 0x7fd3000b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:48002/0 (socket says 172.21.15.122:48002) 2024-05-28T06:14:34.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.337+0000 7fd2fde00640 1 -- 172.21.15.122:0/3970152563 >> v2:172.21.15.153:3300/0 conn(0x7fd3000cdb00 msgr2=0x7fd3000b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:34.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.337+0000 7fd2fde00640 1 --2- 172.21.15.122:0/3970152563 >> v2:172.21.15.153:3300/0 conn(0x7fd3000cdb00 0x7fd3000b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.337+0000 7fd2fde00640 1 -- 172.21.15.122:0/3970152563 >> v1:172.21.15.153:6789/0 conn(0x7fd30006f6c0 legacy=0x7fd3000cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.337+0000 7fd2fde00640 1 -- 172.21.15.122:0/3970152563 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30015be20 con 0x7fd3000cff30 2024-05-28T06:14:34.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.341+0000 7fd2fde00640 1 --2- 172.21.15.122:0/3970152563 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3000cff30 0x7fd30006f180 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009870 tx=0x7fd2f001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=867e49be80402211 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:34.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.341+0000 7fd2fca00640 1 -- 172.21.15.122:0/3970152563 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f00a95f0 con 0x7fd3000cff30 2024-05-28T06:14:34.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.341+0000 7fd2fca00640 1 -- 172.21.15.122:0/3970152563 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2f00a9790 con 0x7fd3000cff30 2024-05-28T06:14:34.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.341+0000 7fd2fca00640 1 -- 172.21.15.122:0/3970152563 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f00a9b60 con 0x7fd3000cff30 2024-05-28T06:14:34.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.341+0000 7fd305200640 1 -- 172.21.15.122:0/3970152563 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3000cff30 msgr2=0x7fd30006f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.341+0000 7fd305200640 1 --2- 172.21.15.122:0/3970152563 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3000cff30 0x7fd30006f180 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009870 tx=0x7fd2f001c530 comp rx=0 tx=0).stop 2024-05-28T06:14:34.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.341+0000 7fd305200640 1 -- 172.21.15.122:0/3970152563 shutdown_connections 2024-05-28T06:14:34.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.341+0000 7fd305200640 1 --2- 172.21.15.122:0/3970152563 >> v2:172.21.15.153:3300/0 conn(0x7fd3000cdb00 0x7fd3000b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.341+0000 7fd305200640 1 --2- 172.21.15.122:0/3970152563 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3000cff30 0x7fd30006f180 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.341+0000 7fd305200640 1 -- 172.21.15.122:0/3970152563 >> 172.21.15.122:0/3970152563 conn(0x7fd30006bd90 msgr2=0x7fd30006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:34.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.341+0000 7fd305200640 1 -- 172.21.15.122:0/3970152563 shutdown_connections 2024-05-28T06:14:34.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.341+0000 7fd305200640 1 -- 172.21.15.122:0/3970152563 wait complete. 2024-05-28T06:14:34.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd305200640 1 Processor -- start 2024-05-28T06:14:34.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd305200640 1 -- start start 2024-05-28T06:14:34.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd305200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd30006f6c0 0x7fd300147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd305200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3000cdb00 0x7fd300151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd305200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3000cff30 0x7fd30014dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd305200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd3000b5700 con 0x7fd3000cdb00 2024-05-28T06:14:34.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd305200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd30015baf0 con 0x7fd3000cff30 2024-05-28T06:14:34.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd305200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7fd3000b5880 con 0x7fd30006f6c0 2024-05-28T06:14:34.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd2fd400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3000cdb00 0x7fd300151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd2fd400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3000cdb00 0x7fd300151740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52262/0 (socket says 172.21.15.122:52262) 2024-05-28T06:14:34.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd2fde00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd30006f6c0 0x7fd300147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd2fd400640 1 -- 172.21.15.122:0/943533016 learned_addr learned my addr 172.21.15.122:0/943533016 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:34.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd2fe800640 1 --2- 172.21.15.122:0/943533016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3000cff30 0x7fd30014dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd2fd400640 1 -- 172.21.15.122:0/943533016 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd30006f6c0 msgr2=0x7fd300147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd2fd400640 1 --2- 172.21.15.122:0/943533016 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd30006f6c0 0x7fd300147ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd2fd400640 1 -- 172.21.15.122:0/943533016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3000cff30 msgr2=0x7fd30014dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd2fd400640 1 --2- 172.21.15.122:0/943533016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3000cff30 0x7fd30014dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd2fd400640 1 -- 172.21.15.122:0/943533016 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd300151c80 con 0x7fd3000cdb00 2024-05-28T06:14:34.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd2fd400640 1 --2- 172.21.15.122:0/943533016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3000cdb00 0x7fd300151740 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec00c400 tx=0x7fd2ec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:34.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd2f6000640 1 -- 172.21.15.122:0/943533016 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec017070 con 0x7fd3000cdb00 2024-05-28T06:14:34.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd2f6000640 1 -- 172.21.15.122:0/943533016 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2ec005310 con 0x7fd3000cdb00 2024-05-28T06:14:34.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd2f6000640 1 -- 172.21.15.122:0/943533016 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec0054c0 con 0x7fd3000cdb00 2024-05-28T06:14:34.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd305200640 1 -- 172.21.15.122:0/943533016 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd30014d300 con 0x7fd3000cdb00 2024-05-28T06:14:34.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.345+0000 7fd305200640 1 -- 172.21.15.122:0/943533016 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd30014d8c0 con 0x7fd3000cdb00 2024-05-28T06:14:34.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.349+0000 7fd305200640 1 -- 172.21.15.122:0/943533016 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd3001480e0 con 0x7fd3000cdb00 2024-05-28T06:14:34.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.349+0000 7fd2f6000640 1 -- 172.21.15.122:0/943533016 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 89007+0+0 (secure 0 0 0) 0x7fd2ec01a070 con 0x7fd3000cdb00 2024-05-28T06:14:34.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.349+0000 7fd2f6000640 1 --2- 172.21.15.122:0/943533016 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd2e0068ec0 0x7fd2e006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.349+0000 7fd2f6000640 1 -- 172.21.15.122:0/943533016 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7fd2ec085310 con 0x7fd3000cdb00 2024-05-28T06:14:34.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.349+0000 7fd2fde00640 1 --2- 172.21.15.122:0/943533016 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd2e0068ec0 0x7fd2e006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.349+0000 7fd2f6000640 1 --2- 172.21.15.122:0/943533016 >> [v2:172.21.15.122:6822/1935505897,v1:172.21.15.122:6824/1935505897] conn(0x7fd2e00710c0 0x7fd2e00734e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.349+0000 7fd2f6000640 1 -- 172.21.15.122:0/943533016 --> [v2:172.21.15.122:6822/1935505897,v1:172.21.15.122:6824/1935505897] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd2ec024ea0 con 0x7fd2e00710c0 2024-05-28T06:14:34.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.349+0000 7fd2f6000640 1 -- 172.21.15.122:0/943533016 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fd2ec0881b0 con 0x7fd3000cdb00 2024-05-28T06:14:34.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.349+0000 7fd2fe800640 1 --2- 172.21.15.122:0/943533016 >> [v2:172.21.15.122:6822/1935505897,v1:172.21.15.122:6824/1935505897] conn(0x7fd2e00710c0 0x7fd2e00734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.349+0000 7fd2fde00640 1 --2- 172.21.15.122:0/943533016 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd2e0068ec0 0x7fd2e006b380 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00ae000 tx=0x7fd2f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:34.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.349+0000 7fd2fe800640 1 --2- 172.21.15.122:0/943533016 >> [v2:172.21.15.122:6822/1935505897,v1:172.21.15.122:6824/1935505897] conn(0x7fd2e00710c0 0x7fd2e00734e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:34.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.353+0000 7fd2f6000640 1 -- 172.21.15.122:0/943533016 <== osd.3 v2:172.21.15.122:6822/1935505897 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd2ec024ea0 con 0x7fd2e00710c0 2024-05-28T06:14:34.363 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.365+0000 7fd305200640 1 -- 172.21.15.122:0/943533016 --> [v2:172.21.15.122:6822/1935505897,v1:172.21.15.122:6824/1935505897] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd30014e450 con 0x7fd2e00710c0 2024-05-28T06:14:34.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.365+0000 7fd2f6000640 1 -- 172.21.15.122:0/943533016 <== osd.3 v2:172.21.15.122:6822/1935505897 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd30014e450 con 0x7fd2e00710c0 2024-05-28T06:14:34.364 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:14:34.364 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-28T06:14:34.365 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:14:34.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.365+0000 7fd305200640 1 -- 172.21.15.122:0/943533016 >> [v2:172.21.15.122:6822/1935505897,v1:172.21.15.122:6824/1935505897] conn(0x7fd2e00710c0 msgr2=0x7fd2e00734e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.365+0000 7fd305200640 1 --2- 172.21.15.122:0/943533016 >> [v2:172.21.15.122:6822/1935505897,v1:172.21.15.122:6824/1935505897] conn(0x7fd2e00710c0 0x7fd2e00734e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.365+0000 7fd305200640 1 -- 172.21.15.122:0/943533016 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd2e0068ec0 msgr2=0x7fd2e006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.365+0000 7fd305200640 1 --2- 172.21.15.122:0/943533016 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7fd2e0068ec0 0x7fd2e006b380 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00ae000 tx=0x7fd2f0009040 comp rx=0 tx=0).stop 2024-05-28T06:14:34.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.365+0000 7fd305200640 1 -- 172.21.15.122:0/943533016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3000cdb00 msgr2=0x7fd300151740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.365+0000 7fd305200640 1 --2- 172.21.15.122:0/943533016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3000cdb00 0x7fd300151740 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec00c400 tx=0x7fd2ec00c8c0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.365+0000 7fd2fe800640 1 -- 172.21.15.122:0/943533016 reap_dead start 2024-05-28T06:14:34.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.365+0000 7fd305200640 1 -- 172.21.15.122:0/943533016 shutdown_connections 2024-05-28T06:14:34.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.365+0000 7fd305200640 1 -- 172.21.15.122:0/943533016 >> 172.21.15.122:0/943533016 conn(0x7fd30006bd90 msgr2=0x7fd30006e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:34.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.365+0000 7fd305200640 1 -- 172.21.15.122:0/943533016 shutdown_connections 2024-05-28T06:14:34.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.365+0000 7fd305200640 1 -- 172.21.15.122:0/943533016 wait complete. 2024-05-28T06:14:34.382 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-28T06:14:34.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.525+0000 7f06e7600640 1 Processor -- start 2024-05-28T06:14:34.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.525+0000 7f06e7600640 1 -- start start 2024-05-28T06:14:34.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.525+0000 7f06e7600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06e015c170 0x7f06e006df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.525+0000 7f06e7600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f06e015b590 0x7f06e00cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.525+0000 7f06e7600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06e00b4790 con 0x7f06e0071f30 2024-05-28T06:14:34.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.525+0000 7f06e7600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f06e00cf5c0 con 0x7f06e015b590 2024-05-28T06:14:34.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.525+0000 7f06e7600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f06e00cf8a0 con 0x7f06e015c170 2024-05-28T06:14:34.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.525+0000 7f06e5600640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f06e0071f30 0x7f06e0072340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:49816/0 (socket says 172.21.15.122:49816) 2024-05-28T06:14:34.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.525+0000 7f06e5600640 1 -- 172.21.15.122:0/3508252090 learned_addr learned my addr 172.21.15.122:0/3508252090 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:14:34.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.529+0000 7f06dfe00640 1 --2- 172.21.15.122:0/3508252090 >> v2:172.21.15.153:3300/0 conn(0x7f06e015b590 0x7f06e00cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.529+0000 7f06e4c00640 1 --2- 172.21.15.122:0/3508252090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06e015c170 0x7f06e006df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.529+0000 7f06df400640 1 -- 172.21.15.122:0/3508252090 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2400370089 0 0) 0x7f06e00b4790 con 0x7f06e0071f30 2024-05-28T06:14:34.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.529+0000 7f06df400640 1 -- 172.21.15.122:0/3508252090 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06c8003530 con 0x7f06e0071f30 2024-05-28T06:14:34.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.529+0000 7f06dfe00640 1 -- 172.21.15.122:0/3508252090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06e015c170 msgr2=0x7f06e006df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:34.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.529+0000 7f06dfe00640 1 --2- 172.21.15.122:0/3508252090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06e015c170 0x7f06e006df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.529+0000 7f06dfe00640 1 -- 172.21.15.122:0/3508252090 >> v1:172.21.15.122:6789/0 conn(0x7f06e0071f30 legacy=0x7f06e0072340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.529+0000 7f06dfe00640 1 -- 172.21.15.122:0/3508252090 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e006e4d0 con 0x7f06e015b590 2024-05-28T06:14:34.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.529+0000 7f06e4c00640 1 --2- 172.21.15.122:0/3508252090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06e015c170 0x7f06e006df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:14:34.530 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.533+0000 7f06dfe00640 1 --2- 172.21.15.122:0/3508252090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e015b590 0x7f06e00cec70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0097c0 tx=0x7f06cc01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc709d2058f87f80 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:34.531 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.533+0000 7f06df400640 1 -- 172.21.15.122:0/3508252090 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0b0070 con 0x7f06e015b590 2024-05-28T06:14:34.531 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.533+0000 7f06df400640 1 -- 172.21.15.122:0/3508252090 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06cc0ab600 con 0x7f06e015b590 2024-05-28T06:14:34.531 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.533+0000 7f06df400640 1 -- 172.21.15.122:0/3508252090 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0ab9d0 con 0x7f06e015b590 2024-05-28T06:14:34.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.533+0000 7f06e7600640 1 -- 172.21.15.122:0/3508252090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e015b590 msgr2=0x7f06e00cec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.533+0000 7f06e7600640 1 --2- 172.21.15.122:0/3508252090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e015b590 0x7f06e00cec70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0097c0 tx=0x7f06cc01c410 comp rx=0 tx=0).stop 2024-05-28T06:14:34.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.533+0000 7f06e7600640 1 -- 172.21.15.122:0/3508252090 shutdown_connections 2024-05-28T06:14:34.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.533+0000 7f06e7600640 1 --2- 172.21.15.122:0/3508252090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e015b590 0x7f06e00cec70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.533+0000 7f06e7600640 1 --2- 172.21.15.122:0/3508252090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06e015c170 0x7f06e006df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.533 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.533+0000 7f06e7600640 1 -- 172.21.15.122:0/3508252090 >> 172.21.15.122:0/3508252090 conn(0x7f06e0062a40 msgr2=0x7f06e006b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:34.533 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.533+0000 7f06e7600640 1 -- 172.21.15.122:0/3508252090 shutdown_connections 2024-05-28T06:14:34.533 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.533+0000 7f06e7600640 1 -- 172.21.15.122:0/3508252090 wait complete. 2024-05-28T06:14:34.533 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.533+0000 7f06e7600640 1 Processor -- start 2024-05-28T06:14:34.534 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.533+0000 7f06e7600640 1 -- start start 2024-05-28T06:14:34.535 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.537+0000 7f06e7600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e0071f30 0x7f06e01695f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.535 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.537+0000 7f06e7600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06e015b590 0x7f06e014cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.536 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.537+0000 7f06e7600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06e015c170 0x7f06e01598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.536 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.537+0000 7f06e7600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f06e00b52c0 con 0x7f06e015b590 2024-05-28T06:14:34.536 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.537+0000 7f06e7600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f06e00b5140 con 0x7f06e0071f30 2024-05-28T06:14:34.536 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.537+0000 7f06e7600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f06e00b5440 con 0x7f06e015c170 2024-05-28T06:14:34.536 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.537+0000 7f06dfe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06e015b590 0x7f06e014cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.536 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.537+0000 7f06dfe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06e015b590 0x7f06e014cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52274/0 (socket says 172.21.15.122:52274) 2024-05-28T06:14:34.536 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.537+0000 7f06dfe00640 1 -- 172.21.15.122:0/1109414649 learned_addr learned my addr 172.21.15.122:0/1109414649 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:34.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.537+0000 7f06e4c00640 1 --2- 172.21.15.122:0/1109414649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e0071f30 0x7f06e01695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.537+0000 7f06e5600640 1 --2- 172.21.15.122:0/1109414649 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06e015c170 0x7f06e01598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.537+0000 7f06dfe00640 1 -- 172.21.15.122:0/1109414649 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06e015c170 msgr2=0x7f06e01598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.537+0000 7f06dfe00640 1 --2- 172.21.15.122:0/1109414649 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06e015c170 0x7f06e01598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.537+0000 7f06dfe00640 1 -- 172.21.15.122:0/1109414649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e0071f30 msgr2=0x7f06e01695f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.537+0000 7f06dfe00640 1 --2- 172.21.15.122:0/1109414649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e0071f30 0x7f06e01695f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.537+0000 7f06dfe00640 1 -- 172.21.15.122:0/1109414649 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e015e3d0 con 0x7f06e015b590 2024-05-28T06:14:34.539 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.537+0000 7f06dfe00640 1 --2- 172.21.15.122:0/1109414649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06e015b590 0x7f06e014cdb0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f06cc01a040 tx=0x7f06cc0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:34.539 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.537+0000 7f06dcc00640 1 -- 172.21.15.122:0/1109414649 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0b0040 con 0x7f06e015b590 2024-05-28T06:14:34.539 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.537+0000 7f06dcc00640 1 -- 172.21.15.122:0/1109414649 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06cc0b9070 con 0x7f06e015b590 2024-05-28T06:14:34.539 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.537+0000 7f06dcc00640 1 -- 172.21.15.122:0/1109414649 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0b4650 con 0x7f06e015b590 2024-05-28T06:14:34.539 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.537+0000 7f06e7600640 1 -- 172.21.15.122:0/1109414649 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e015de10 con 0x7f06e015b590 2024-05-28T06:14:34.539 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.537+0000 7f06e7600640 1 -- 172.21.15.122:0/1109414649 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e00b2ec0 con 0x7f06e015b590 2024-05-28T06:14:34.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.537+0000 7f06d2000640 1 -- 172.21.15.122:0/1109414649 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e0068bd0 con 0x7f06e015b590 2024-05-28T06:14:34.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.541+0000 7f06dcc00640 1 -- 172.21.15.122:0/1109414649 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 89007+0+0 (secure 0 0 0) 0x7f06cc0b47f0 con 0x7f06e015b590 2024-05-28T06:14:34.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.541+0000 7f06dcc00640 1 --2- 172.21.15.122:0/1109414649 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f06c0068ec0 0x7f06c006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.541 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.541+0000 7f06dcc00640 1 -- 172.21.15.122:0/1109414649 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f06cc11f020 con 0x7f06e015b590 2024-05-28T06:14:34.541 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.541+0000 7f06e4c00640 1 --2- 172.21.15.122:0/1109414649 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f06c0068ec0 0x7f06c006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.541 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.541+0000 7f06e4c00640 1 --2- 172.21.15.122:0/1109414649 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f06c0068ec0 0x7f06c006b380 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009580 tx=0x7f06d4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:34.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.545+0000 7f06dcc00640 1 -- 172.21.15.122:0/1109414649 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f06cc0a4e20 con 0x7f06e015b590 2024-05-28T06:14:34.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.741+0000 7f06d2000640 1 -- 172.21.15.122:0/1109414649 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f06e0159270 con 0x7f06c0068ec0 2024-05-28T06:14:34.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.741+0000 7f06dcc00640 1 -- 172.21.15.122:0/1109414649 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f06e0159270 con 0x7f06c0068ec0 2024-05-28T06:14:34.741 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 3 to deep-scrub 2024-05-28T06:14:34.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.745+0000 7f06d2000640 1 -- 172.21.15.122:0/1109414649 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f06c0068ec0 msgr2=0x7f06c006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.745+0000 7f06d2000640 1 --2- 172.21.15.122:0/1109414649 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f06c0068ec0 0x7f06c006b380 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009580 tx=0x7f06d4009190 comp rx=0 tx=0).stop 2024-05-28T06:14:34.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.745+0000 7f06d2000640 1 -- 172.21.15.122:0/1109414649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06e015b590 msgr2=0x7f06e014cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.745+0000 7f06d2000640 1 --2- 172.21.15.122:0/1109414649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06e015b590 0x7f06e014cdb0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f06cc01a040 tx=0x7f06cc0191b0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.745+0000 7f06d2000640 1 -- 172.21.15.122:0/1109414649 shutdown_connections 2024-05-28T06:14:34.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.745+0000 7f06d2000640 1 --2- 172.21.15.122:0/1109414649 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f06c0068ec0 0x7f06c006b380 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.745+0000 7f06d2000640 1 --2- 172.21.15.122:0/1109414649 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f06e015c170 0x7f06e01598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.745+0000 7f06d2000640 1 --2- 172.21.15.122:0/1109414649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06e015b590 0x7f06e014cdb0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.745+0000 7f06d2000640 1 --2- 172.21.15.122:0/1109414649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06e0071f30 0x7f06e01695f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.745+0000 7f06d2000640 1 -- 172.21.15.122:0/1109414649 >> 172.21.15.122:0/1109414649 conn(0x7f06e0062a40 msgr2=0x7f06e006f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:34.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.745+0000 7f06d2000640 1 -- 172.21.15.122:0/1109414649 shutdown_connections 2024-05-28T06:14:34.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.745+0000 7f06d2000640 1 -- 172.21.15.122:0/1109414649 wait complete. 2024-05-28T06:14:34.765 INFO:tasks.ceph:Scrubbing osd.4 2024-05-28T06:14:34.766 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-28T06:14:34.929 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.929+0000 7f7cffe00640 1 Processor -- start 2024-05-28T06:14:34.929 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.929+0000 7f7cffe00640 1 -- start start 2024-05-28T06:14:34.930 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.929+0000 7f7cffe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d000d1240 0x7f7d000d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.929+0000 7f7cffe00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d000d0e60 con 0x7f7d0015c840 2024-05-28T06:14:34.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.929+0000 7f7cffe00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d000b5570 con 0x7f7d000d0a30 2024-05-28T06:14:34.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.929+0000 7f7cffe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7d0015cc20 con 0x7f7d000d1240 2024-05-28T06:14:34.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.933+0000 7f7cfea00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f7d0015c840 0x7f7d000cda80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:49830/0 (socket says 172.21.15.122:49830) 2024-05-28T06:14:34.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.933+0000 7f7cfea00640 1 -- 172.21.15.122:0/1733784860 learned_addr learned my addr 172.21.15.122:0/1733784860 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:14:34.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.933+0000 7f7cf7e00640 1 --2- 172.21.15.122:0/1733784860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d000d1240 0x7f7d000d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.933+0000 7f7cfe000640 1 -- 172.21.15.122:0/1733784860 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 821601104 0 0) 0x7f7d000d0e60 con 0x7f7d0015c840 2024-05-28T06:14:34.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.933+0000 7f7cfe000640 1 -- 172.21.15.122:0/1733784860 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ce4003530 con 0x7f7d0015c840 2024-05-28T06:14:34.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.933+0000 7f7cfe000640 1 -- 172.21.15.122:0/1733784860 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 882269275 0 0) 0x7f7d000b5570 con 0x7f7d000d0a30 2024-05-28T06:14:34.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.933+0000 7f7cfe000640 1 -- 172.21.15.122:0/1733784860 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d000d0e60 con 0x7f7d000d0a30 2024-05-28T06:14:34.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.933+0000 7f7cf7e00640 1 -- 172.21.15.122:0/1733784860 >> v1:172.21.15.153:6789/0 conn(0x7f7d000d0a30 legacy=0x7f7d001662f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.933+0000 7f7cf7e00640 1 -- 172.21.15.122:0/1733784860 >> v1:172.21.15.122:6789/0 conn(0x7f7d0015c840 legacy=0x7f7d000cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.933+0000 7f7cf7e00640 1 -- 172.21.15.122:0/1733784860 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d000b5850 con 0x7f7d000d1240 2024-05-28T06:14:34.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.937+0000 7f7cf7e00640 1 --2- 172.21.15.122:0/1733784860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d000d1240 0x7f7d000d04f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80097f0 tx=0x7f7ce801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6824c996f11ff server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:34.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.937+0000 7f7cfe000640 1 -- 172.21.15.122:0/1733784860 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce80b1070 con 0x7f7d000d1240 2024-05-28T06:14:34.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.937+0000 7f7cfe000640 1 -- 172.21.15.122:0/1733784860 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce80ac630 con 0x7f7d000d1240 2024-05-28T06:14:34.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.937+0000 7f7cfe000640 1 -- 172.21.15.122:0/1733784860 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce80a8050 con 0x7f7d000d1240 2024-05-28T06:14:34.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.937+0000 7f7cffe00640 1 -- 172.21.15.122:0/1733784860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d000d1240 msgr2=0x7f7d000d04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.937+0000 7f7cffe00640 1 --2- 172.21.15.122:0/1733784860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d000d1240 0x7f7d000d04f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80097f0 tx=0x7f7ce801c4e0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.937+0000 7f7cffe00640 1 -- 172.21.15.122:0/1733784860 shutdown_connections 2024-05-28T06:14:34.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.937+0000 7f7cffe00640 1 --2- 172.21.15.122:0/1733784860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d000d1240 0x7f7d000d04f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.937+0000 7f7cffe00640 1 -- 172.21.15.122:0/1733784860 >> 172.21.15.122:0/1733784860 conn(0x7f7d000b3fc0 msgr2=0x7f7d000b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:34.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.937+0000 7f7cffe00640 1 -- 172.21.15.122:0/1733784860 shutdown_connections 2024-05-28T06:14:34.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.937+0000 7f7cffe00640 1 -- 172.21.15.122:0/1733784860 wait complete. 2024-05-28T06:14:34.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.937+0000 7f7cffe00640 1 Processor -- start 2024-05-28T06:14:34.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.937+0000 7f7cffe00640 1 -- start start 2024-05-28T06:14:34.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.941+0000 7f7cffe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d000d0a30 0x7f7d000cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.941+0000 7f7cffe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d0015c840 0x7f7d0015ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.941+0000 7f7cffe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d00156d50 0x7f7d0015b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.941+0000 7f7cffe00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0016a640 con 0x7f7d00156d50 2024-05-28T06:14:34.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.941+0000 7f7cffe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7d000ce190 con 0x7f7d0015c840 2024-05-28T06:14:34.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.941+0000 7f7cffe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7d0016a7c0 con 0x7f7d000d0a30 2024-05-28T06:14:34.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.941+0000 7f7cff400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d00156d50 0x7f7d0015b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.941+0000 7f7cff400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d00156d50 0x7f7d0015b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52284/0 (socket says 172.21.15.122:52284) 2024-05-28T06:14:34.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.941+0000 7f7cff400640 1 -- 172.21.15.122:0/3056064114 learned_addr learned my addr 172.21.15.122:0/3056064114 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:34.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.941+0000 7f7cf7e00640 1 --2- 172.21.15.122:0/3056064114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d0015c840 0x7f7d0015ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.941+0000 7f7cfea00640 1 --2- 172.21.15.122:0/3056064114 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d000d0a30 0x7f7d000cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.941+0000 7f7cff400640 1 -- 172.21.15.122:0/3056064114 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d000d0a30 msgr2=0x7f7d000cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.941+0000 7f7cff400640 1 --2- 172.21.15.122:0/3056064114 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d000d0a30 0x7f7d000cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.941+0000 7f7cff400640 1 -- 172.21.15.122:0/3056064114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d0015c840 msgr2=0x7f7d0015ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.941+0000 7f7cff400640 1 --2- 172.21.15.122:0/3056064114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d0015c840 0x7f7d0015ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.941+0000 7f7cff400640 1 -- 172.21.15.122:0/3056064114 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d000c9720 con 0x7f7d00156d50 2024-05-28T06:14:34.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.941+0000 7f7cff400640 1 --2- 172.21.15.122:0/3056064114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d00156d50 0x7f7d0015b380 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800c760 tx=0x7f7cf800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:34.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.941+0000 7f7cf7400640 1 -- 172.21.15.122:0/3056064114 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8003b80 con 0x7f7d00156d50 2024-05-28T06:14:34.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.941+0000 7f7cf7400640 1 -- 172.21.15.122:0/3056064114 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf8003d20 con 0x7f7d00156d50 2024-05-28T06:14:34.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.941+0000 7f7cf7400640 1 -- 172.21.15.122:0/3056064114 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf800aa90 con 0x7f7d00156d50 2024-05-28T06:14:34.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.941+0000 7f7cffe00640 1 -- 172.21.15.122:0/3056064114 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d000c9a00 con 0x7f7d00156d50 2024-05-28T06:14:34.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.941+0000 7f7cffe00640 1 -- 172.21.15.122:0/3056064114 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d000c9fc0 con 0x7f7d00156d50 2024-05-28T06:14:34.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.941+0000 7f7cffe00640 1 -- 172.21.15.122:0/3056064114 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7d00075620 con 0x7f7d00156d50 2024-05-28T06:14:34.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.945+0000 7f7cf7400640 1 -- 172.21.15.122:0/3056064114 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 89007+0+0 (secure 0 0 0) 0x7f7cf800ac30 con 0x7f7d00156d50 2024-05-28T06:14:34.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.945+0000 7f7cf7400640 1 --2- 172.21.15.122:0/3056064114 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7cdc068ec0 0x7f7cdc06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.945+0000 7f7cf7400640 1 -- 172.21.15.122:0/3056064114 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f7cf80852c0 con 0x7f7d00156d50 2024-05-28T06:14:34.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.945+0000 7f7cf7400640 1 --2- 172.21.15.122:0/3056064114 >> [v2:172.21.15.153:6824/3872438562,v1:172.21.15.153:6825/3872438562] conn(0x7f7cdc0710c0 0x7f7cdc0734e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:34.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.945+0000 7f7cfea00640 1 --2- 172.21.15.122:0/3056064114 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7cdc068ec0 0x7f7cdc06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.945+0000 7f7cf7400640 1 -- 172.21.15.122:0/3056064114 --> [v2:172.21.15.153:6824/3872438562,v1:172.21.15.153:6825/3872438562] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7cdc073bb0 con 0x7f7cdc0710c0 2024-05-28T06:14:34.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.945+0000 7f7cf7400640 1 -- 172.21.15.122:0/3056064114 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f7cf808c030 con 0x7f7d00156d50 2024-05-28T06:14:34.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.945+0000 7f7cf7e00640 1 --2- 172.21.15.122:0/3056064114 >> [v2:172.21.15.153:6824/3872438562,v1:172.21.15.153:6825/3872438562] conn(0x7f7cdc0710c0 0x7f7cdc0734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:34.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.945+0000 7f7cfea00640 1 --2- 172.21.15.122:0/3056064114 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7cdc068ec0 0x7f7cdc06b380 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00011f0 tx=0x7f7cf0007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:34.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.945+0000 7f7cf7e00640 1 --2- 172.21.15.122:0/3056064114 >> [v2:172.21.15.153:6824/3872438562,v1:172.21.15.153:6825/3872438562] conn(0x7f7cdc0710c0 0x7f7cdc0734e0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:34.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.945+0000 7f7cf7400640 1 -- 172.21.15.122:0/3056064114 <== osd.4 v2:172.21.15.153:6824/3872438562 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7cdc073bb0 con 0x7f7cdc0710c0 2024-05-28T06:14:34.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.961+0000 7f7cffe00640 1 -- 172.21.15.122:0/3056064114 --> [v2:172.21.15.153:6824/3872438562,v1:172.21.15.153:6825/3872438562] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7d00160020 con 0x7f7cdc0710c0 2024-05-28T06:14:34.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.965+0000 7f7cf7400640 1 -- 172.21.15.122:0/3056064114 <== osd.4 v2:172.21.15.153:6824/3872438562 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7d00160020 con 0x7f7cdc0710c0 2024-05-28T06:14:34.963 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:14:34.963 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-28T06:14:34.963 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:14:34.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.965+0000 7f7cffe00640 1 -- 172.21.15.122:0/3056064114 >> [v2:172.21.15.153:6824/3872438562,v1:172.21.15.153:6825/3872438562] conn(0x7f7cdc0710c0 msgr2=0x7f7cdc0734e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.965+0000 7f7cffe00640 1 --2- 172.21.15.122:0/3056064114 >> [v2:172.21.15.153:6824/3872438562,v1:172.21.15.153:6825/3872438562] conn(0x7f7cdc0710c0 0x7f7cdc0734e0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:34.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.965+0000 7f7cffe00640 1 -- 172.21.15.122:0/3056064114 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7cdc068ec0 msgr2=0x7f7cdc06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.965+0000 7f7cffe00640 1 --2- 172.21.15.122:0/3056064114 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7cdc068ec0 0x7f7cdc06b380 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00011f0 tx=0x7f7cf0007d40 comp rx=0 tx=0).stop 2024-05-28T06:14:34.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.965+0000 7f7cffe00640 1 -- 172.21.15.122:0/3056064114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d00156d50 msgr2=0x7f7d0015b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:34.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.965+0000 7f7cffe00640 1 --2- 172.21.15.122:0/3056064114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d00156d50 0x7f7d0015b380 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800c760 tx=0x7f7cf800cc20 comp rx=0 tx=0).stop 2024-05-28T06:14:34.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.965+0000 7f7cff400640 1 -- 172.21.15.122:0/3056064114 reap_dead start 2024-05-28T06:14:34.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.965+0000 7f7cffe00640 1 -- 172.21.15.122:0/3056064114 shutdown_connections 2024-05-28T06:14:34.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.965+0000 7f7cffe00640 1 -- 172.21.15.122:0/3056064114 >> 172.21.15.122:0/3056064114 conn(0x7f7d000b3fc0 msgr2=0x7f7d000c8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:34.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.965+0000 7f7cffe00640 1 -- 172.21.15.122:0/3056064114 shutdown_connections 2024-05-28T06:14:34.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:34.965+0000 7f7cffe00640 1 -- 172.21.15.122:0/3056064114 wait complete. 2024-05-28T06:14:34.985 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-28T06:14:35.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f4671600640 1 Processor -- start 2024-05-28T06:14:35.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f4671600640 1 -- start start 2024-05-28T06:14:35.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f4671600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f466c15e990 0x7f466c0b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:35.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f4671600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f466c162e60 con 0x7f466c09b150 2024-05-28T06:14:35.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f4671600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f466c163140 con 0x7f466c15f900 2024-05-28T06:14:35.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f4671600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f466c15f100 con 0x7f466c15e990 2024-05-28T06:14:35.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f4670c00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f466c09b150 0x7f466c0d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:49842/0 (socket says 172.21.15.122:49842) 2024-05-28T06:14:35.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f4670c00640 1 -- 172.21.15.122:0/1587436766 learned_addr learned my addr 172.21.15.122:0/1587436766 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:14:35.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f466be00640 1 --2- 172.21.15.122:0/1587436766 >> v2:172.21.15.153:3300/0 conn(0x7f466c15e990 0x7f466c0b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:35.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f466aa00640 1 -- 172.21.15.122:0/1587436766 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4239199420 0 0) 0x7f466c162e60 con 0x7f466c09b150 2024-05-28T06:14:35.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f466aa00640 1 -- 172.21.15.122:0/1587436766 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4650003530 con 0x7f466c09b150 2024-05-28T06:14:35.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f466aa00640 1 -- 172.21.15.122:0/1587436766 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2911187915 0 0) 0x7f4650003530 con 0x7f466c09b150 2024-05-28T06:14:35.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f466aa00640 1 -- 172.21.15.122:0/1587436766 >> v2:172.21.15.153:3300/0 conn(0x7f466c15e990 msgr2=0x7f466c0b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:35.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f466aa00640 1 --2- 172.21.15.122:0/1587436766 >> v2:172.21.15.153:3300/0 conn(0x7f466c15e990 0x7f466c0b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f466aa00640 1 -- 172.21.15.122:0/1587436766 >> v1:172.21.15.153:6789/0 conn(0x7f466c15f900 legacy=0x7f466c09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:35.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f466aa00640 1 -- 172.21.15.122:0/1587436766 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466c15f3e0 con 0x7f466c09b150 2024-05-28T06:14:35.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f466aa00640 1 -- 172.21.15.122:0/1587436766 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f4664001a00 con 0x7f466c09b150 2024-05-28T06:14:35.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f466aa00640 1 -- 172.21.15.122:0/1587436766 >> v1:172.21.15.122:6789/0 conn(0x7f466c09b150 legacy=0x7f466c0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:35.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f466aa00640 1 --2- 172.21.15.122:0/1587436766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46500039c0 0x7f4650003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:35.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f466aa00640 1 --2- 172.21.15.122:0/1587436766 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4650004810 0x7f4650004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:35.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f466aa00640 1 --2- 172.21.15.122:0/1587436766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46500051d0 0x7f465000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:35.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f466aa00640 1 -- 172.21.15.122:0/1587436766 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f466c15f100 con 0x7f46500051d0 2024-05-28T06:14:35.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f466aa00640 1 -- 172.21.15.122:0/1587436766 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f465000c170 con 0x7f46500039c0 2024-05-28T06:14:35.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f466aa00640 1 -- 172.21.15.122:0/1587436766 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f465000c370 con 0x7f4650004810 2024-05-28T06:14:35.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f4670c00640 1 --2- 172.21.15.122:0/1587436766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46500051d0 0x7f465000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:35.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f466be00640 1 --2- 172.21.15.122:0/1587436766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46500039c0 0x7f4650003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:35.157 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f466b400640 1 --2- 172.21.15.122:0/1587436766 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4650004810 0x7f4650004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:35.157 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f4670c00640 1 -- 172.21.15.122:0/1587436766 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4650004810 msgr2=0x7f4650004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:35.157 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f4670c00640 1 --2- 172.21.15.122:0/1587436766 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4650004810 0x7f4650004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.157 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f4670c00640 1 -- 172.21.15.122:0/1587436766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46500039c0 msgr2=0x7f4650003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:35.157 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f4670c00640 1 --2- 172.21.15.122:0/1587436766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46500039c0 0x7f4650003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.157 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.153+0000 7f4670c00640 1 -- 172.21.15.122:0/1587436766 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4650003530 con 0x7f46500051d0 2024-05-28T06:14:35.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.157+0000 7f4670c00640 1 -- 172.21.15.122:0/1587436766 reap_dead start 2024-05-28T06:14:35.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.157+0000 7f4670c00640 1 --2- 172.21.15.122:0/1587436766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46500051d0 0x7f465000b9d0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f466c0721f0 tx=0x7f466401fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c03d08a3cd137f70 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:35.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.157+0000 7f466aa00640 1 -- 172.21.15.122:0/1587436766 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466400a4a0 con 0x7f46500051d0 2024-05-28T06:14:35.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.157+0000 7f466aa00640 1 -- 172.21.15.122:0/1587436766 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46640aa4f0 con 0x7f46500051d0 2024-05-28T06:14:35.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.157+0000 7f466aa00640 1 -- 172.21.15.122:0/1587436766 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46640aa8c0 con 0x7f46500051d0 2024-05-28T06:14:35.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.157+0000 7f4671600640 1 -- 172.21.15.122:0/1587436766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46500051d0 msgr2=0x7f465000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:35.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.157+0000 7f4671600640 1 --2- 172.21.15.122:0/1587436766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46500051d0 0x7f465000b9d0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f466c0721f0 tx=0x7f466401fac0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.157+0000 7f4671600640 1 -- 172.21.15.122:0/1587436766 shutdown_connections 2024-05-28T06:14:35.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.157+0000 7f4671600640 1 --2- 172.21.15.122:0/1587436766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46500051d0 0x7f465000b9d0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.157+0000 7f4671600640 1 -- 172.21.15.122:0/1587436766 >> 172.21.15.122:0/1587436766 conn(0x7f466c0d2440 msgr2=0x7f466c0d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:35.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.157+0000 7f4671600640 1 -- 172.21.15.122:0/1587436766 shutdown_connections 2024-05-28T06:14:35.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.157+0000 7f4671600640 1 -- 172.21.15.122:0/1587436766 wait complete. 2024-05-28T06:14:35.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f4671600640 1 Processor -- start 2024-05-28T06:14:35.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f4671600640 1 -- start start 2024-05-28T06:14:35.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f4671600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46500051d0 0x7f466c14f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:35.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f4671600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f466c14faf0 0x7f466c1f7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:35.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f4671600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f466c1f8100 0x7f466c1f85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:35.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f4671600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f466c0b1a20 con 0x7f466c14faf0 2024-05-28T06:14:35.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f4671600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f466c0b18a0 con 0x7f466c1f8100 2024-05-28T06:14:35.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f4671600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f466c0b1ba0 con 0x7f46500051d0 2024-05-28T06:14:35.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f466b400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f466c14faf0 0x7f466c1f7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:35.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f466b400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f466c14faf0 0x7f466c1f7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52312/0 (socket says 172.21.15.122:52312) 2024-05-28T06:14:35.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f466b400640 1 -- 172.21.15.122:0/1510951746 learned_addr learned my addr 172.21.15.122:0/1510951746 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:35.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f466be00640 1 --2- 172.21.15.122:0/1510951746 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46500051d0 0x7f466c14f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:35.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f4670c00640 1 --2- 172.21.15.122:0/1510951746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f466c1f8100 0x7f466c1f85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:35.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f466b400640 1 -- 172.21.15.122:0/1510951746 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46500051d0 msgr2=0x7f466c14f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:35.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f466b400640 1 --2- 172.21.15.122:0/1510951746 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46500051d0 0x7f466c14f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f466b400640 1 -- 172.21.15.122:0/1510951746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f466c1f8100 msgr2=0x7f466c1f85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:35.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f466b400640 1 --2- 172.21.15.122:0/1510951746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f466c1f8100 0x7f466c1f85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f466b400640 1 -- 172.21.15.122:0/1510951746 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466c15d960 con 0x7f466c14faf0 2024-05-28T06:14:35.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f466be00640 1 --2- 172.21.15.122:0/1510951746 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46500051d0 0x7f466c14f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:14:35.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f4670c00640 1 --2- 172.21.15.122:0/1510951746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f466c1f8100 0x7f466c1f85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:14:35.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f466b400640 1 --2- 172.21.15.122:0/1510951746 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f466c14faf0 0x7f466c1f7bc0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f465800f620 tx=0x7f465800fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:35.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f4663e00640 1 -- 172.21.15.122:0/1510951746 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46580052e0 con 0x7f466c14faf0 2024-05-28T06:14:35.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f4663e00640 1 -- 172.21.15.122:0/1510951746 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4658018070 con 0x7f466c14faf0 2024-05-28T06:14:35.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f4671600640 1 -- 172.21.15.122:0/1510951746 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f466c0b7660 con 0x7f466c14faf0 2024-05-28T06:14:35.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f4663e00640 1 -- 172.21.15.122:0/1510951746 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4658003820 con 0x7f466c14faf0 2024-05-28T06:14:35.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.161+0000 7f4671600640 1 -- 172.21.15.122:0/1510951746 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f466c0b7c20 con 0x7f466c14faf0 2024-05-28T06:14:35.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.165+0000 7f4671600640 1 -- 172.21.15.122:0/1510951746 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f466c075620 con 0x7f466c14faf0 2024-05-28T06:14:35.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.165+0000 7f4663e00640 1 -- 172.21.15.122:0/1510951746 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 89007+0+0 (secure 0 0 0) 0x7f46580039c0 con 0x7f466c14faf0 2024-05-28T06:14:35.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.165+0000 7f4663e00640 1 --2- 172.21.15.122:0/1510951746 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f464c068ef0 0x7f464c06b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:35.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.165+0000 7f4663e00640 1 -- 172.21.15.122:0/1510951746 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f4658085090 con 0x7f466c14faf0 2024-05-28T06:14:35.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.165+0000 7f466be00640 1 --2- 172.21.15.122:0/1510951746 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f464c068ef0 0x7f464c06b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:35.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.165+0000 7f466be00640 1 --2- 172.21.15.122:0/1510951746 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f464c068ef0 0x7f464c06b3b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f465c009b60 tx=0x7f465c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:35.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.169+0000 7f4663e00640 1 -- 172.21.15.122:0/1510951746 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f466c15d960 con 0x7f466c14faf0 2024-05-28T06:14:35.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.329+0000 7f4671600640 1 -- 172.21.15.122:0/1510951746 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f466c14ff70 con 0x7f464c068ef0 2024-05-28T06:14:35.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.329+0000 7f4663e00640 1 -- 172.21.15.122:0/1510951746 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f466c14ff70 con 0x7f464c068ef0 2024-05-28T06:14:35.328 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 4 to deep-scrub 2024-05-28T06:14:35.330 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.329+0000 7f4671600640 1 -- 172.21.15.122:0/1510951746 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f464c068ef0 msgr2=0x7f464c06b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:35.330 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.329+0000 7f4671600640 1 --2- 172.21.15.122:0/1510951746 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f464c068ef0 0x7f464c06b3b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f465c009b60 tx=0x7f465c008040 comp rx=0 tx=0).stop 2024-05-28T06:14:35.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.329+0000 7f4671600640 1 -- 172.21.15.122:0/1510951746 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f466c14faf0 msgr2=0x7f466c1f7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:35.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.329+0000 7f4671600640 1 --2- 172.21.15.122:0/1510951746 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f466c14faf0 0x7f466c1f7bc0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f465800f620 tx=0x7f465800fae0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.329+0000 7f4671600640 1 -- 172.21.15.122:0/1510951746 shutdown_connections 2024-05-28T06:14:35.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.329+0000 7f4671600640 1 --2- 172.21.15.122:0/1510951746 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f464c068ef0 0x7f464c06b3b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.329+0000 7f4671600640 1 --2- 172.21.15.122:0/1510951746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f466c1f8100 0x7f466c1f85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.329+0000 7f4671600640 1 --2- 172.21.15.122:0/1510951746 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f466c14faf0 0x7f466c1f7bc0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.329+0000 7f4671600640 1 --2- 172.21.15.122:0/1510951746 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46500051d0 0x7f466c14f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.329+0000 7f4671600640 1 -- 172.21.15.122:0/1510951746 >> 172.21.15.122:0/1510951746 conn(0x7f466c0d2440 msgr2=0x7f466c0d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:35.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.329+0000 7f4671600640 1 -- 172.21.15.122:0/1510951746 shutdown_connections 2024-05-28T06:14:35.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.329+0000 7f4671600640 1 -- 172.21.15.122:0/1510951746 wait complete. 2024-05-28T06:14:35.349 INFO:tasks.ceph:Scrubbing osd.5 2024-05-28T06:14:35.350 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-28T06:14:35.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.493+0000 7f7f68a00640 1 Processor -- start 2024-05-28T06:14:35.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.493+0000 7f7f68a00640 1 -- start start 2024-05-28T06:14:35.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.493+0000 7f7f68a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f6406f890 0x7f7f640cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:35.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.493+0000 7f7f68a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7f640cd930 0x7f7f640b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:35.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.493+0000 7f7f68a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f640d0310 con 0x7f7f640cff30 2024-05-28T06:14:35.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.493+0000 7f7f68a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7f6415be20 con 0x7f7f640cd930 2024-05-28T06:14:35.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.493+0000 7f7f68a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7f6415c100 con 0x7f7f6406f890 2024-05-28T06:14:35.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.493+0000 7f7f62800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7f640cd930 0x7f7f640b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:35.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.493+0000 7f7f61400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f6406f890 0x7f7f640cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:35.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.493+0000 7f7f62800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7f640cd930 0x7f7f640b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:48576/0 (socket says 172.21.15.122:48576) 2024-05-28T06:14:35.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.493+0000 7f7f62800640 1 -- 172.21.15.122:0/3949143853 learned_addr learned my addr 172.21.15.122:0/3949143853 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:35.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.493+0000 7f7f61400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f6406f890 0x7f7f640cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:50840/0 (socket says 172.21.15.122:50840) 2024-05-28T06:14:35.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.493+0000 7f7f62800640 1 -- 172.21.15.122:0/3949143853 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f6406f890 msgr2=0x7f7f640cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:35.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.493+0000 7f7f62800640 1 --2- 172.21.15.122:0/3949143853 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f6406f890 0x7f7f640cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.493+0000 7f7f62800640 1 -- 172.21.15.122:0/3949143853 >> v1:172.21.15.153:6789/0 conn(0x7f7f640cff30 legacy=0x7f7f6406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:35.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.493+0000 7f7f62800640 1 -- 172.21.15.122:0/3949143853 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f6415c3e0 con 0x7f7f640cd930 2024-05-28T06:14:35.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.497+0000 7f7f62800640 1 --2- 172.21.15.122:0/3949143853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f640cd930 0x7f7f640b49b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009e50 tx=0x7f7f5c01ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fdac51328165477 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:35.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.497+0000 7f7f60a00640 1 -- 172.21.15.122:0/3949143853 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c0a5870 con 0x7f7f640cd930 2024-05-28T06:14:35.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.497+0000 7f7f60a00640 1 -- 172.21.15.122:0/3949143853 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f5c0a5a10 con 0x7f7f640cd930 2024-05-28T06:14:35.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.497+0000 7f7f60a00640 1 -- 172.21.15.122:0/3949143853 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c0a5de0 con 0x7f7f640cd930 2024-05-28T06:14:35.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.497+0000 7f7f68a00640 1 -- 172.21.15.122:0/3949143853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f640cd930 msgr2=0x7f7f640b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:35.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.497+0000 7f7f68a00640 1 --2- 172.21.15.122:0/3949143853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f640cd930 0x7f7f640b49b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009e50 tx=0x7f7f5c01ca00 comp rx=0 tx=0).stop 2024-05-28T06:14:35.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.497+0000 7f7f68a00640 1 -- 172.21.15.122:0/3949143853 shutdown_connections 2024-05-28T06:14:35.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.497+0000 7f7f68a00640 1 --2- 172.21.15.122:0/3949143853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f640cd930 0x7f7f640b49b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.497+0000 7f7f68a00640 1 --2- 172.21.15.122:0/3949143853 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f6406f890 0x7f7f640cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.497+0000 7f7f68a00640 1 -- 172.21.15.122:0/3949143853 >> 172.21.15.122:0/3949143853 conn(0x7f7f6406bd90 msgr2=0x7f7f6406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:35.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.497+0000 7f7f68a00640 1 -- 172.21.15.122:0/3949143853 shutdown_connections 2024-05-28T06:14:35.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.497+0000 7f7f68a00640 1 -- 172.21.15.122:0/3949143853 wait complete. 2024-05-28T06:14:35.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f68a00640 1 Processor -- start 2024-05-28T06:14:35.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f68a00640 1 -- start start 2024-05-28T06:14:35.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f68a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f6406f890 0x7f7f640b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:35.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f68a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f640cd930 0x7f7f6413a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:35.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f68a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f640cff30 0x7f7f64141d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:35.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f68a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7f640b5880 con 0x7f7f640cff30 2024-05-28T06:14:35.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f68a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7f640b5700 con 0x7f7f640cd930 2024-05-28T06:14:35.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f68a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f7f640b5a00 con 0x7f7f6406f890 2024-05-28T06:14:35.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f62800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f640cff30 0x7f7f64141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:35.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f62800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f640cff30 0x7f7f64141d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:53706/0 (socket says 172.21.15.122:53706) 2024-05-28T06:14:35.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f62800640 1 -- 172.21.15.122:0/2376233830 learned_addr learned my addr 172.21.15.122:0/2376233830 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:35.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f61400640 1 --2- 172.21.15.122:0/2376233830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f640cd930 0x7f7f6413a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:35.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f61e00640 1 --2- 172.21.15.122:0/2376233830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f6406f890 0x7f7f640b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:35.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f62800640 1 -- 172.21.15.122:0/2376233830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f6406f890 msgr2=0x7f7f640b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:35.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f62800640 1 --2- 172.21.15.122:0/2376233830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f6406f890 0x7f7f640b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f62800640 1 -- 172.21.15.122:0/2376233830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f640cd930 msgr2=0x7f7f6413a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:35.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f62800640 1 --2- 172.21.15.122:0/2376233830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f640cd930 0x7f7f6413a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f62800640 1 -- 172.21.15.122:0/2376233830 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f64140860 con 0x7f7f640cff30 2024-05-28T06:14:35.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f62800640 1 --2- 172.21.15.122:0/2376233830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f640cff30 0x7f7f64141d80 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c01a630 tx=0x7f7f5c0197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:35.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f5a000640 1 -- 172.21.15.122:0/2376233830 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c0bc020 con 0x7f7f640cff30 2024-05-28T06:14:35.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f5a000640 1 -- 172.21.15.122:0/2376233830 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f5c0b8670 con 0x7f7f640cff30 2024-05-28T06:14:35.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f68a00640 1 -- 172.21.15.122:0/2376233830 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f6413fce0 con 0x7f7f640cff30 2024-05-28T06:14:35.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f5a000640 1 -- 172.21.15.122:0/2376233830 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c0b8a40 con 0x7f7f640cff30 2024-05-28T06:14:35.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.501+0000 7f7f68a00640 1 -- 172.21.15.122:0/2376233830 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f641402a0 con 0x7f7f640cff30 2024-05-28T06:14:35.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.505+0000 7f7f68a00640 1 -- 172.21.15.122:0/2376233830 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7f64076020 con 0x7f7f640cff30 2024-05-28T06:14:35.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.505+0000 7f7f5a000640 1 -- 172.21.15.122:0/2376233830 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 89007+0+0 (secure 0 0 0) 0x7f7f5c0bf020 con 0x7f7f640cff30 2024-05-28T06:14:35.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.505+0000 7f7f5a000640 1 --2- 172.21.15.122:0/2376233830 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7f40068ef0 0x7f7f4006b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:35.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.505+0000 7f7f5a000640 1 -- 172.21.15.122:0/2376233830 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f7f5c120810 con 0x7f7f640cff30 2024-05-28T06:14:35.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.505+0000 7f7f61e00640 1 --2- 172.21.15.122:0/2376233830 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7f40068ef0 0x7f7f4006b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:35.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.505+0000 7f7f5a000640 1 --2- 172.21.15.122:0/2376233830 >> [v2:172.21.15.153:6809/2459238876,v1:172.21.15.153:6811/2459238876] conn(0x7f7f40071150 0x7f7f40073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:35.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.505+0000 7f7f5a000640 1 -- 172.21.15.122:0/2376233830 --> [v2:172.21.15.153:6809/2459238876,v1:172.21.15.153:6811/2459238876] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7f5c0a5a10 con 0x7f7f40071150 2024-05-28T06:14:35.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.505+0000 7f7f5a000640 1 -- 172.21.15.122:0/2376233830 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f7f5c1231a0 con 0x7f7f640cff30 2024-05-28T06:14:35.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.505+0000 7f7f61400640 1 --2- 172.21.15.122:0/2376233830 >> [v2:172.21.15.153:6809/2459238876,v1:172.21.15.153:6811/2459238876] conn(0x7f7f40071150 0x7f7f40073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:35.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.505+0000 7f7f61e00640 1 --2- 172.21.15.122:0/2376233830 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7f40068ef0 0x7f7f4006b3b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c007fd0 tx=0x7f7f4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:35.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.505+0000 7f7f61400640 1 --2- 172.21.15.122:0/2376233830 >> [v2:172.21.15.153:6809/2459238876,v1:172.21.15.153:6811/2459238876] conn(0x7f7f40071150 0x7f7f40073570 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:35.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.509+0000 7f7f5a000640 1 -- 172.21.15.122:0/2376233830 <== osd.5 v2:172.21.15.153:6809/2459238876 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7f5c0a5a10 con 0x7f7f40071150 2024-05-28T06:14:35.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.521+0000 7f7f68a00640 1 -- 172.21.15.122:0/2376233830 --> [v2:172.21.15.153:6809/2459238876,v1:172.21.15.153:6811/2459238876] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7f64068c40 con 0x7f7f40071150 2024-05-28T06:14:35.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.521+0000 7f7f5a000640 1 -- 172.21.15.122:0/2376233830 <== osd.5 v2:172.21.15.153:6809/2459238876 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7f64068c40 con 0x7f7f40071150 2024-05-28T06:14:35.521 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:14:35.522 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-28T06:14:35.522 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:14:35.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.521+0000 7f7f68a00640 1 -- 172.21.15.122:0/2376233830 >> [v2:172.21.15.153:6809/2459238876,v1:172.21.15.153:6811/2459238876] conn(0x7f7f40071150 msgr2=0x7f7f40073570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:35.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.521+0000 7f7f68a00640 1 --2- 172.21.15.122:0/2376233830 >> [v2:172.21.15.153:6809/2459238876,v1:172.21.15.153:6811/2459238876] conn(0x7f7f40071150 0x7f7f40073570 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.521+0000 7f7f68a00640 1 -- 172.21.15.122:0/2376233830 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7f40068ef0 msgr2=0x7f7f4006b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:35.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.521+0000 7f7f68a00640 1 --2- 172.21.15.122:0/2376233830 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f7f40068ef0 0x7f7f4006b3b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c007fd0 tx=0x7f7f4c009040 comp rx=0 tx=0).stop 2024-05-28T06:14:35.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.521+0000 7f7f68a00640 1 -- 172.21.15.122:0/2376233830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f640cff30 msgr2=0x7f7f64141d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:35.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.521+0000 7f7f68a00640 1 --2- 172.21.15.122:0/2376233830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f640cff30 0x7f7f64141d80 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c01a630 tx=0x7f7f5c0197a0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.521+0000 7f7f62800640 1 -- 172.21.15.122:0/2376233830 reap_dead start 2024-05-28T06:14:35.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.525+0000 7f7f68a00640 1 -- 172.21.15.122:0/2376233830 shutdown_connections 2024-05-28T06:14:35.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.525+0000 7f7f68a00640 1 -- 172.21.15.122:0/2376233830 >> 172.21.15.122:0/2376233830 conn(0x7f7f6406bd90 msgr2=0x7f7f6414d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:35.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.525+0000 7f7f68a00640 1 -- 172.21.15.122:0/2376233830 shutdown_connections 2024-05-28T06:14:35.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.525+0000 7f7f68a00640 1 -- 172.21.15.122:0/2376233830 wait complete. 2024-05-28T06:14:35.547 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-28T06:14:35.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.729+0000 7f8920600640 1 Processor -- start 2024-05-28T06:14:35.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.729+0000 7f8920600640 1 -- start start 2024-05-28T06:14:35.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.729+0000 7f8920600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f89180737b0 0x7f89180d0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:35.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.729+0000 7f8920600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f891806f0c0 0x7f891806f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:35.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.729+0000 7f8920600640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89180cf4c0 con 0x7f891815b810 2024-05-28T06:14:35.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.729+0000 7f8920600640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f89180cf290 con 0x7f89180737b0 2024-05-28T06:14:35.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.729+0000 7f8920600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f891806fa50 con 0x7f891806f0c0 2024-05-28T06:14:35.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.729+0000 7f891e600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f891806f0c0 0x7f891806f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:35.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.729+0000 7f891dc00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f891815b810 0x7f89180b6250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:60038/0 (socket says 172.21.15.122:60038) 2024-05-28T06:14:35.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.729+0000 7f891dc00640 1 -- 172.21.15.122:0/731606252 learned_addr learned my addr 172.21.15.122:0/731606252 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:14:35.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.729+0000 7f891d200640 1 --2- 172.21.15.122:0/731606252 >> v2:172.21.15.122:3300/0 conn(0x7f89180737b0 0x7f89180d0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:35.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.729+0000 7f891e600640 1 -- 172.21.15.122:0/731606252 >> v2:172.21.15.122:3300/0 conn(0x7f89180737b0 msgr2=0x7f89180d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:35.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.729+0000 7f891e600640 1 --2- 172.21.15.122:0/731606252 >> v2:172.21.15.122:3300/0 conn(0x7f89180737b0 0x7f89180d0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.729+0000 7f891e600640 1 -- 172.21.15.122:0/731606252 >> v1:172.21.15.122:6789/0 conn(0x7f891815b810 legacy=0x7f89180b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:35.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.729+0000 7f891e600640 1 -- 172.21.15.122:0/731606252 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89180cf7a0 con 0x7f891806f0c0 2024-05-28T06:14:35.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.737+0000 7f891e600640 1 --2- 172.21.15.122:0/731606252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f891806f0c0 0x7f891806f510 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f891806fc60 tx=0x7f891001e930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5208dcbe3f86a550 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:35.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.737+0000 7f8917e00640 1 -- 172.21.15.122:0/731606252 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891000b2d0 con 0x7f891806f0c0 2024-05-28T06:14:35.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.737+0000 7f8917e00640 1 -- 172.21.15.122:0/731606252 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89100a7580 con 0x7f891806f0c0 2024-05-28T06:14:35.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.737+0000 7f8917e00640 1 -- 172.21.15.122:0/731606252 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89100a7950 con 0x7f891806f0c0 2024-05-28T06:14:35.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.737+0000 7f8920600640 1 -- 172.21.15.122:0/731606252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f891806f0c0 msgr2=0x7f891806f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:35.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.737+0000 7f8920600640 1 --2- 172.21.15.122:0/731606252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f891806f0c0 0x7f891806f510 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f891806fc60 tx=0x7f891001e930 comp rx=0 tx=0).stop 2024-05-28T06:14:35.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.737+0000 7f8920600640 1 -- 172.21.15.122:0/731606252 shutdown_connections 2024-05-28T06:14:35.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.737+0000 7f8920600640 1 --2- 172.21.15.122:0/731606252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f891806f0c0 0x7f891806f510 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.737+0000 7f8920600640 1 --2- 172.21.15.122:0/731606252 >> v2:172.21.15.122:3300/0 conn(0x7f89180737b0 0x7f89180d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.737+0000 7f8920600640 1 -- 172.21.15.122:0/731606252 >> 172.21.15.122:0/731606252 conn(0x7f89180b6c10 msgr2=0x7f89180b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:35.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.741+0000 7f8920600640 1 -- 172.21.15.122:0/731606252 shutdown_connections 2024-05-28T06:14:35.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.741+0000 7f8920600640 1 -- 172.21.15.122:0/731606252 wait complete. 2024-05-28T06:14:35.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.741+0000 7f8920600640 1 Processor -- start 2024-05-28T06:14:35.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.741+0000 7f8920600640 1 -- start start 2024-05-28T06:14:35.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.745+0000 7f8920600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f891806f0c0 0x7f891814d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:35.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.745+0000 7f8920600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89180737b0 0x7f89181596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:35.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.745+0000 7f8920600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f891815da50 0x7f8918156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:35.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.745+0000 7f8920600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f89180d17f0 con 0x7f891806f0c0 2024-05-28T06:14:35.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.745+0000 7f8920600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f89180d1670 con 0x7f891815da50 2024-05-28T06:14:35.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.745+0000 7f8920600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f891806b990 con 0x7f89180737b0 2024-05-28T06:14:35.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.745+0000 7f891dc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f891806f0c0 0x7f891814d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:35.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.745+0000 7f891dc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f891806f0c0 0x7f891814d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:53724/0 (socket says 172.21.15.122:53724) 2024-05-28T06:14:35.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.745+0000 7f891dc00640 1 -- 172.21.15.122:0/394892540 learned_addr learned my addr 172.21.15.122:0/394892540 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:35.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.745+0000 7f891d200640 1 --2- 172.21.15.122:0/394892540 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89180737b0 0x7f89181596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:35.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.745+0000 7f891e600640 1 --2- 172.21.15.122:0/394892540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f891815da50 0x7f8918156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:35.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.745+0000 7f891dc00640 1 -- 172.21.15.122:0/394892540 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89180737b0 msgr2=0x7f89181596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:35.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.745+0000 7f891dc00640 1 --2- 172.21.15.122:0/394892540 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89180737b0 0x7f89181596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.745+0000 7f891dc00640 1 -- 172.21.15.122:0/394892540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f891815da50 msgr2=0x7f8918156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:35.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.745+0000 7f891dc00640 1 --2- 172.21.15.122:0/394892540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f891815da50 0x7f8918156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.745+0000 7f891dc00640 1 -- 172.21.15.122:0/394892540 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8918159be0 con 0x7f891806f0c0 2024-05-28T06:14:35.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.745+0000 7f891dc00640 1 --2- 172.21.15.122:0/394892540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f891806f0c0 0x7f891814d0d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f890c00c780 tx=0x7f890c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:35.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.745+0000 7f8915600640 1 -- 172.21.15.122:0/394892540 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c018070 con 0x7f891806f0c0 2024-05-28T06:14:35.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.745+0000 7f8915600640 1 -- 172.21.15.122:0/394892540 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f890c0072d0 con 0x7f891806f0c0 2024-05-28T06:14:35.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.745+0000 7f8920600640 1 -- 172.21.15.122:0/394892540 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f891815e010 con 0x7f891806f0c0 2024-05-28T06:14:35.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.745+0000 7f8915600640 1 -- 172.21.15.122:0/394892540 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c0047f0 con 0x7f891806f0c0 2024-05-28T06:14:35.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.745+0000 7f8920600640 1 -- 172.21.15.122:0/394892540 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8918153e10 con 0x7f891806f0c0 2024-05-28T06:14:35.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.749+0000 7f8920600640 1 -- 172.21.15.122:0/394892540 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8918153950 con 0x7f891806f0c0 2024-05-28T06:14:35.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.749+0000 7f8915600640 1 -- 172.21.15.122:0/394892540 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 89007+0+0 (secure 0 0 0) 0x7f890c01b070 con 0x7f891806f0c0 2024-05-28T06:14:35.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.749+0000 7f8915600640 1 --2- 172.21.15.122:0/394892540 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f88f8068f10 0x7f88f806b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:35.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.749+0000 7f8915600640 1 -- 172.21.15.122:0/394892540 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f890c0849e0 con 0x7f891806f0c0 2024-05-28T06:14:35.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.749+0000 7f891d200640 1 --2- 172.21.15.122:0/394892540 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f88f8068f10 0x7f88f806b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:35.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.753+0000 7f891d200640 1 --2- 172.21.15.122:0/394892540 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f88f8068f10 0x7f88f806b3d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f891815d300 tx=0x7f8904008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:35.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.757+0000 7f8915600640 1 -- 172.21.15.122:0/394892540 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8918153950 con 0x7f891806f0c0 2024-05-28T06:14:35.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.969+0000 7f8920600640 1 -- 172.21.15.122:0/394892540 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f89181519d0 con 0x7f88f8068f10 2024-05-28T06:14:35.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.969+0000 7f8915600640 1 -- 172.21.15.122:0/394892540 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f89181519d0 con 0x7f88f8068f10 2024-05-28T06:14:35.970 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 5 to deep-scrub 2024-05-28T06:14:35.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.973+0000 7f8920600640 1 -- 172.21.15.122:0/394892540 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f88f8068f10 msgr2=0x7f88f806b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:35.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.973+0000 7f8920600640 1 --2- 172.21.15.122:0/394892540 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f88f8068f10 0x7f88f806b3d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f891815d300 tx=0x7f8904008040 comp rx=0 tx=0).stop 2024-05-28T06:14:35.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.973+0000 7f8920600640 1 -- 172.21.15.122:0/394892540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f891806f0c0 msgr2=0x7f891814d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:35.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.973+0000 7f8920600640 1 --2- 172.21.15.122:0/394892540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f891806f0c0 0x7f891814d0d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f890c00c780 tx=0x7f890c00cc40 comp rx=0 tx=0).stop 2024-05-28T06:14:35.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.973+0000 7f8920600640 1 -- 172.21.15.122:0/394892540 shutdown_connections 2024-05-28T06:14:35.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.973+0000 7f8920600640 1 --2- 172.21.15.122:0/394892540 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f88f8068f10 0x7f88f806b3d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.973+0000 7f8920600640 1 --2- 172.21.15.122:0/394892540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f891815da50 0x7f8918156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.973+0000 7f8920600640 1 --2- 172.21.15.122:0/394892540 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89180737b0 0x7f89181596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.973+0000 7f8920600640 1 --2- 172.21.15.122:0/394892540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f891806f0c0 0x7f891814d0d0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:35.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.973+0000 7f8920600640 1 -- 172.21.15.122:0/394892540 >> 172.21.15.122:0/394892540 conn(0x7f89180b6c10 msgr2=0x7f89180b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:35.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.973+0000 7f8920600640 1 -- 172.21.15.122:0/394892540 shutdown_connections 2024-05-28T06:14:35.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:35.973+0000 7f8920600640 1 -- 172.21.15.122:0/394892540 wait complete. 2024-05-28T06:14:36.000 INFO:tasks.ceph:Scrubbing osd.6 2024-05-28T06:14:36.001 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-28T06:14:36.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.185+0000 7f49b5000640 1 Processor -- start 2024-05-28T06:14:36.184 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.185+0000 7f49b5000640 1 -- start start 2024-05-28T06:14:36.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.185+0000 7f49b5000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49b00b0e40 0x7f49b006f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:36.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.185+0000 7f49b5000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f49b0073cf0 0x7f49b006fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:36.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.185+0000 7f49b5000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49b015f170 con 0x7f49b00b0a60 2024-05-28T06:14:36.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.185+0000 7f49b5000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f49b0155f20 con 0x7f49b0073cf0 2024-05-28T06:14:36.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.185+0000 7f49b5000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f49b015f450 con 0x7f49b00b0e40 2024-05-28T06:14:36.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.185+0000 7f49ade00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f49b00b0a60 0x7f49b0072f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:60054/0 (socket says 172.21.15.122:60054) 2024-05-28T06:14:36.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.185+0000 7f49ade00640 1 -- 172.21.15.122:0/1022754389 learned_addr learned my addr 172.21.15.122:0/1022754389 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:14:36.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.185+0000 7f49ae800640 1 --2- 172.21.15.122:0/1022754389 >> v2:172.21.15.122:3300/0 conn(0x7f49b0073cf0 0x7f49b006fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:36.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.185+0000 7f49ad400640 1 --2- 172.21.15.122:0/1022754389 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49b00b0e40 0x7f49b006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:36.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.185+0000 7f49aca00640 1 -- 172.21.15.122:0/1022754389 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1931921250 0 0) 0x7f49b015f170 con 0x7f49b00b0a60 2024-05-28T06:14:36.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.185+0000 7f49aca00640 1 -- 172.21.15.122:0/1022754389 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4994003530 con 0x7f49b00b0a60 2024-05-28T06:14:36.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.185+0000 7f49ae800640 1 -- 172.21.15.122:0/1022754389 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49b00b0e40 msgr2=0x7f49b006f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:36.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.185+0000 7f49ae800640 1 --2- 172.21.15.122:0/1022754389 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49b00b0e40 0x7f49b006f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:36.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.185+0000 7f49ae800640 1 -- 172.21.15.122:0/1022754389 >> v1:172.21.15.122:6789/0 conn(0x7f49b00b0a60 legacy=0x7f49b0072f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:36.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.185+0000 7f49ae800640 1 -- 172.21.15.122:0/1022754389 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b015f730 con 0x7f49b0073cf0 2024-05-28T06:14:36.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.189+0000 7f49ae800640 1 --2- 172.21.15.122:0/1022754389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49b0073cf0 0x7f49b006fac0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f49a8009d90 tx=0x7f49a801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da92a56db90e8c7d server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:36.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.189+0000 7f49aca00640 1 -- 172.21.15.122:0/1022754389 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a80b2070 con 0x7f49b0073cf0 2024-05-28T06:14:36.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.189+0000 7f49aca00640 1 -- 172.21.15.122:0/1022754389 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49a80a57a0 con 0x7f49b0073cf0 2024-05-28T06:14:36.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.189+0000 7f49aca00640 1 -- 172.21.15.122:0/1022754389 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a80a5b70 con 0x7f49b0073cf0 2024-05-28T06:14:36.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.189+0000 7f49b5000640 1 -- 172.21.15.122:0/1022754389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49b0073cf0 msgr2=0x7f49b006fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:36.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.189+0000 7f49b5000640 1 --2- 172.21.15.122:0/1022754389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49b0073cf0 0x7f49b006fac0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f49a8009d90 tx=0x7f49a801c8e0 comp rx=0 tx=0).stop 2024-05-28T06:14:36.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.189+0000 7f49b5000640 1 -- 172.21.15.122:0/1022754389 shutdown_connections 2024-05-28T06:14:36.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.189+0000 7f49b5000640 1 --2- 172.21.15.122:0/1022754389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49b0073cf0 0x7f49b006fac0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:36.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.189+0000 7f49b5000640 1 --2- 172.21.15.122:0/1022754389 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49b00b0e40 0x7f49b006f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:36.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.189+0000 7f49b5000640 1 -- 172.21.15.122:0/1022754389 >> 172.21.15.122:0/1022754389 conn(0x7f49b00b6d30 msgr2=0x7f49b00b7140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:36.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.193+0000 7f49b5000640 1 -- 172.21.15.122:0/1022754389 shutdown_connections 2024-05-28T06:14:36.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.193+0000 7f49b5000640 1 -- 172.21.15.122:0/1022754389 wait complete. 2024-05-28T06:14:36.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.193+0000 7f49b5000640 1 Processor -- start 2024-05-28T06:14:36.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.193+0000 7f49b5000640 1 -- start start 2024-05-28T06:14:36.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.193+0000 7f49b5000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49b0073cf0 0x7f49b01fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:36.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.193+0000 7f49b5000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49b00b0a60 0x7f49b01fe6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:36.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.197+0000 7f49b5000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49b00b0e40 0x7f49b0158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:36.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.197+0000 7f49b5000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f49b00d23f0 con 0x7f49b00b0a60 2024-05-28T06:14:36.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.197+0000 7f49b5000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f49b00d2270 con 0x7f49b0073cf0 2024-05-28T06:14:36.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.197+0000 7f49b5000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f49b00d2570 con 0x7f49b00b0e40 2024-05-28T06:14:36.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.197+0000 7f49ade00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49b0073cf0 0x7f49b01fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:36.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.197+0000 7f49ae800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49b00b0e40 0x7f49b0158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:36.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.197+0000 7f49ade00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49b0073cf0 0x7f49b01fb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.122:48606/0 (socket says 172.21.15.122:48606) 2024-05-28T06:14:36.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.197+0000 7f49ade00640 1 -- 172.21.15.122:0/199925179 learned_addr learned my addr 172.21.15.122:0/199925179 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:36.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.197+0000 7f49ad400640 1 --2- 172.21.15.122:0/199925179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49b00b0a60 0x7f49b01fe6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:36.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.197+0000 7f49ade00640 1 -- 172.21.15.122:0/199925179 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49b00b0e40 msgr2=0x7f49b0158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:36.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.197+0000 7f49ade00640 1 --2- 172.21.15.122:0/199925179 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49b00b0e40 0x7f49b0158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:36.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.197+0000 7f49ade00640 1 -- 172.21.15.122:0/199925179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49b00b0a60 msgr2=0x7f49b01fe6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:36.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.197+0000 7f49ade00640 1 --2- 172.21.15.122:0/199925179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49b00b0a60 0x7f49b01fe6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:36.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.197+0000 7f49ade00640 1 -- 172.21.15.122:0/199925179 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b015a7c0 con 0x7f49b0073cf0 2024-05-28T06:14:36.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.197+0000 7f49ad400640 1 --2- 172.21.15.122:0/199925179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49b00b0a60 0x7f49b01fe6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:14:36.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.197+0000 7f49ade00640 1 --2- 172.21.15.122:0/199925179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49b0073cf0 0x7f49b01fb990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f49a000c3c0 tx=0x7f49a000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:36.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.197+0000 7f49a6000640 1 -- 172.21.15.122:0/199925179 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a0017070 con 0x7f49b0073cf0 2024-05-28T06:14:36.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.197+0000 7f49a6000640 1 -- 172.21.15.122:0/199925179 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49a0005cf0 con 0x7f49b0073cf0 2024-05-28T06:14:36.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.197+0000 7f49b5000640 1 -- 172.21.15.122:0/199925179 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49b015aaa0 con 0x7f49b0073cf0 2024-05-28T06:14:36.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.197+0000 7f49a6000640 1 -- 172.21.15.122:0/199925179 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a00072f0 con 0x7f49b0073cf0 2024-05-28T06:14:36.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.197+0000 7f49b5000640 1 -- 172.21.15.122:0/199925179 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49b015b060 con 0x7f49b0073cf0 2024-05-28T06:14:36.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.197+0000 7f49b5000640 1 -- 172.21.15.122:0/199925179 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f49b0076020 con 0x7f49b0073cf0 2024-05-28T06:14:36.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.201+0000 7f49a6000640 1 -- 172.21.15.122:0/199925179 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 89007+0+0 (secure 0 0 0) 0x7f49a001a070 con 0x7f49b0073cf0 2024-05-28T06:14:36.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.201+0000 7f49a6000640 1 --2- 172.21.15.122:0/199925179 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4990068f10 0x7f499006b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:36.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.201+0000 7f49a6000640 1 -- 172.21.15.122:0/199925179 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f49a0085050 con 0x7f49b0073cf0 2024-05-28T06:14:36.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.201+0000 7f49ad400640 1 --2- 172.21.15.122:0/199925179 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4990068f10 0x7f499006b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:36.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.201+0000 7f49a6000640 1 --2- 172.21.15.122:0/199925179 >> [v2:172.21.15.153:6808/194393677,v1:172.21.15.153:6810/194393677] conn(0x7f4990071190 0x7f49900735b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:36.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.201+0000 7f49a6000640 1 -- 172.21.15.122:0/199925179 --> [v2:172.21.15.153:6808/194393677,v1:172.21.15.153:6810/194393677] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f49a001be50 con 0x7f4990071190 2024-05-28T06:14:36.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.201+0000 7f49a6000640 1 -- 172.21.15.122:0/199925179 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f49a0087e70 con 0x7f49b0073cf0 2024-05-28T06:14:36.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.201+0000 7f49ae800640 1 --2- 172.21.15.122:0/199925179 >> [v2:172.21.15.153:6808/194393677,v1:172.21.15.153:6810/194393677] conn(0x7f4990071190 0x7f49900735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:36.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.201+0000 7f49ad400640 1 --2- 172.21.15.122:0/199925179 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4990068f10 0x7f499006b3d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f49b015a520 tx=0x7f499c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:36.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.205+0000 7f49ae800640 1 --2- 172.21.15.122:0/199925179 >> [v2:172.21.15.153:6808/194393677,v1:172.21.15.153:6810/194393677] conn(0x7f4990071190 0x7f49900735b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:36.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.205+0000 7f49a6000640 1 -- 172.21.15.122:0/199925179 <== osd.6 v2:172.21.15.153:6808/194393677 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f49a001be50 con 0x7f4990071190 2024-05-28T06:14:36.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.217+0000 7f49b5000640 1 -- 172.21.15.122:0/199925179 --> [v2:172.21.15.153:6808/194393677,v1:172.21.15.153:6810/194393677] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f49b0068c40 con 0x7f4990071190 2024-05-28T06:14:36.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.217+0000 7f49a6000640 1 -- 172.21.15.122:0/199925179 <== osd.6 v2:172.21.15.153:6808/194393677 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f49b0068c40 con 0x7f4990071190 2024-05-28T06:14:36.217 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:14:36.218 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-28T06:14:36.218 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:14:36.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.217+0000 7f49b5000640 1 -- 172.21.15.122:0/199925179 >> [v2:172.21.15.153:6808/194393677,v1:172.21.15.153:6810/194393677] conn(0x7f4990071190 msgr2=0x7f49900735b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:36.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.217+0000 7f49b5000640 1 --2- 172.21.15.122:0/199925179 >> [v2:172.21.15.153:6808/194393677,v1:172.21.15.153:6810/194393677] conn(0x7f4990071190 0x7f49900735b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:36.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.217+0000 7f49b5000640 1 -- 172.21.15.122:0/199925179 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4990068f10 msgr2=0x7f499006b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:36.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.217+0000 7f49b5000640 1 --2- 172.21.15.122:0/199925179 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4990068f10 0x7f499006b3d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f49b015a520 tx=0x7f499c008040 comp rx=0 tx=0).stop 2024-05-28T06:14:36.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.217+0000 7f49b5000640 1 -- 172.21.15.122:0/199925179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49b0073cf0 msgr2=0x7f49b01fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:36.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.217+0000 7f49b5000640 1 --2- 172.21.15.122:0/199925179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49b0073cf0 0x7f49b01fb990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f49a000c3c0 tx=0x7f49a000c880 comp rx=0 tx=0).stop 2024-05-28T06:14:36.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.217+0000 7f49ae800640 1 -- 172.21.15.122:0/199925179 reap_dead start 2024-05-28T06:14:36.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.217+0000 7f49b5000640 1 -- 172.21.15.122:0/199925179 shutdown_connections 2024-05-28T06:14:36.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.217+0000 7f49b5000640 1 -- 172.21.15.122:0/199925179 >> 172.21.15.122:0/199925179 conn(0x7f49b00b6d30 msgr2=0x7f49b0161600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:36.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.217+0000 7f49b5000640 1 -- 172.21.15.122:0/199925179 shutdown_connections 2024-05-28T06:14:36.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.217+0000 7f49b5000640 1 -- 172.21.15.122:0/199925179 wait complete. 2024-05-28T06:14:36.236 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-28T06:14:36.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.373+0000 7f3d36c00640 1 Processor -- start 2024-05-28T06:14:36.373 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.373+0000 7f3d36c00640 1 -- start start 2024-05-28T06:14:36.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.373+0000 7f3d36c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d300ce1a0 0x7f3d300b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:36.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.373+0000 7f3d36c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d300ce910 con 0x7f3d30144350 2024-05-28T06:14:36.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.373+0000 7f3d36c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d300cebf0 con 0x7f3d300b4c80 2024-05-28T06:14:36.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.373+0000 7f3d36c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3d300b50f0 con 0x7f3d300ce1a0 2024-05-28T06:14:36.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.373+0000 7f3d35800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f3d30144350 0x7f3d30144730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:60070/0 (socket says 172.21.15.122:60070) 2024-05-28T06:14:36.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.373+0000 7f3d35800640 1 -- 172.21.15.122:0/1718998620 learned_addr learned my addr 172.21.15.122:0/1718998620 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:14:36.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.377+0000 7f3d34e00640 1 --2- 172.21.15.122:0/1718998620 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d300ce1a0 0x7f3d300b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:36.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.377+0000 7f3d2fe00640 1 -- 172.21.15.122:0/1718998620 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 151553334 0 0) 0x7f3d300ce910 con 0x7f3d30144350 2024-05-28T06:14:36.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.377+0000 7f3d2fe00640 1 -- 172.21.15.122:0/1718998620 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d18005740 con 0x7f3d30144350 2024-05-28T06:14:36.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.377+0000 7f3d2fe00640 1 -- 172.21.15.122:0/1718998620 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2655077562 0 0) 0x7f3d18005740 con 0x7f3d30144350 2024-05-28T06:14:36.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.377+0000 7f3d34e00640 1 -- 172.21.15.122:0/1718998620 >> v1:172.21.15.153:6789/0 conn(0x7f3d300b4c80 legacy=0x7f3d3015b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:36.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.377+0000 7f3d34e00640 1 -- 172.21.15.122:0/1718998620 >> v1:172.21.15.122:6789/0 conn(0x7f3d30144350 legacy=0x7f3d30144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:36.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.377+0000 7f3d34e00640 1 -- 172.21.15.122:0/1718998620 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d300ceed0 con 0x7f3d300ce1a0 2024-05-28T06:14:36.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.377+0000 7f3d34e00640 1 --2- 172.21.15.122:0/1718998620 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d300ce1a0 0x7f3d300b4740 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c0097f0 tx=0x7f3d1c01c220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a282af86d99b4443 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:36.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.377+0000 7f3d2fe00640 1 -- 172.21.15.122:0/1718998620 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c0b0070 con 0x7f3d300ce1a0 2024-05-28T06:14:36.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.377+0000 7f3d2fe00640 1 -- 172.21.15.122:0/1718998620 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d1c0ab400 con 0x7f3d300ce1a0 2024-05-28T06:14:36.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.377+0000 7f3d2fe00640 1 -- 172.21.15.122:0/1718998620 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d24001680 con 0x7f3d300ce1a0 2024-05-28T06:14:36.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d36c00640 1 -- 172.21.15.122:0/1718998620 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d300ce1a0 msgr2=0x7f3d300b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:36.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d36c00640 1 --2- 172.21.15.122:0/1718998620 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d300ce1a0 0x7f3d300b4740 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c0097f0 tx=0x7f3d1c01c220 comp rx=0 tx=0).stop 2024-05-28T06:14:36.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d36c00640 1 -- 172.21.15.122:0/1718998620 shutdown_connections 2024-05-28T06:14:36.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d36c00640 1 --2- 172.21.15.122:0/1718998620 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d300ce1a0 0x7f3d300b4740 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:36.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d36c00640 1 -- 172.21.15.122:0/1718998620 >> 172.21.15.122:0/1718998620 conn(0x7f3d30062840 msgr2=0x7f3d3006b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:36.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d36c00640 1 -- 172.21.15.122:0/1718998620 shutdown_connections 2024-05-28T06:14:36.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d36c00640 1 -- 172.21.15.122:0/1718998620 wait complete. 2024-05-28T06:14:36.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d36c00640 1 Processor -- start 2024-05-28T06:14:36.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d36c00640 1 -- start start 2024-05-28T06:14:36.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d36c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d300b4c80 0x7f3d30137cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:36.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d36c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d300ce1a0 0x7f3d30156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:36.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d36c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d30144350 0x7f3d3015aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:36.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d36c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3015cc70 con 0x7f3d300b4c80 2024-05-28T06:14:36.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d36c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3015caf0 con 0x7f3d300ce1a0 2024-05-28T06:14:36.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d36c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f3d300b3630 con 0x7f3d30144350 2024-05-28T06:14:36.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d35800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d300b4c80 0x7f3d30137cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:36.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d35800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d300b4c80 0x7f3d30137cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:53736/0 (socket says 172.21.15.122:53736) 2024-05-28T06:14:36.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d35800640 1 -- 172.21.15.122:0/3360938377 learned_addr learned my addr 172.21.15.122:0/3360938377 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:36.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d34e00640 1 --2- 172.21.15.122:0/3360938377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d300ce1a0 0x7f3d30156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:36.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d36200640 1 --2- 172.21.15.122:0/3360938377 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d30144350 0x7f3d3015aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:36.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d35800640 1 -- 172.21.15.122:0/3360938377 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d30144350 msgr2=0x7f3d3015aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:36.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d35800640 1 --2- 172.21.15.122:0/3360938377 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d30144350 0x7f3d3015aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:36.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d35800640 1 -- 172.21.15.122:0/3360938377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d300ce1a0 msgr2=0x7f3d30156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:36.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d35800640 1 --2- 172.21.15.122:0/3360938377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d300ce1a0 0x7f3d30156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:36.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.381+0000 7f3d35800640 1 -- 172.21.15.122:0/3360938377 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d30155c90 con 0x7f3d300b4c80 2024-05-28T06:14:36.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.385+0000 7f3d35800640 1 --2- 172.21.15.122:0/3360938377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d300b4c80 0x7f3d30137cd0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f3d2400c460 tx=0x7f3d2400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:36.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.385+0000 7f3d2d600640 1 -- 172.21.15.122:0/3360938377 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d240074e0 con 0x7f3d300b4c80 2024-05-28T06:14:36.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.385+0000 7f3d2d600640 1 -- 172.21.15.122:0/3360938377 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d240047f0 con 0x7f3d300b4c80 2024-05-28T06:14:36.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.385+0000 7f3d2d600640 1 -- 172.21.15.122:0/3360938377 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d24004be0 con 0x7f3d300b4c80 2024-05-28T06:14:36.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.385+0000 7f3d36c00640 1 -- 172.21.15.122:0/3360938377 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d30155f70 con 0x7f3d300b4c80 2024-05-28T06:14:36.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.385+0000 7f3d36c00640 1 -- 172.21.15.122:0/3360938377 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d30156530 con 0x7f3d300b4c80 2024-05-28T06:14:36.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.385+0000 7f3d36c00640 1 -- 172.21.15.122:0/3360938377 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d30075620 con 0x7f3d300b4c80 2024-05-28T06:14:36.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.385+0000 7f3d2d600640 1 -- 172.21.15.122:0/3360938377 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 89007+0+0 (secure 0 0 0) 0x7f3d24011070 con 0x7f3d300b4c80 2024-05-28T06:14:36.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.385+0000 7f3d2d600640 1 --2- 172.21.15.122:0/3360938377 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3d10068ef0 0x7f3d1006b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:36.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.385+0000 7f3d2d600640 1 -- 172.21.15.122:0/3360938377 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f3d24085100 con 0x7f3d300b4c80 2024-05-28T06:14:36.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.385+0000 7f3d34e00640 1 --2- 172.21.15.122:0/3360938377 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3d10068ef0 0x7f3d1006b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:36.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.389+0000 7f3d34e00640 1 --2- 172.21.15.122:0/3360938377 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3d10068ef0 0x7f3d1006b3b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c0ad000 tx=0x7f3d1c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:36.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.389+0000 7f3d2d600640 1 -- 172.21.15.122:0/3360938377 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3d24056870 con 0x7f3d300b4c80 2024-05-28T06:14:36.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.573+0000 7f3d36c00640 1 -- 172.21.15.122:0/3360938377 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f3d300b5850 con 0x7f3d10068ef0 2024-05-28T06:14:36.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.573+0000 7f3d2d600640 1 -- 172.21.15.122:0/3360938377 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3d300b5850 con 0x7f3d10068ef0 2024-05-28T06:14:36.573 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 6 to deep-scrub 2024-05-28T06:14:36.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.577+0000 7f3d36c00640 1 -- 172.21.15.122:0/3360938377 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3d10068ef0 msgr2=0x7f3d1006b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:36.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.577+0000 7f3d36c00640 1 --2- 172.21.15.122:0/3360938377 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3d10068ef0 0x7f3d1006b3b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c0ad000 tx=0x7f3d1c0a6000 comp rx=0 tx=0).stop 2024-05-28T06:14:36.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.577+0000 7f3d36c00640 1 -- 172.21.15.122:0/3360938377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d300b4c80 msgr2=0x7f3d30137cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:36.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.577+0000 7f3d36c00640 1 --2- 172.21.15.122:0/3360938377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d300b4c80 0x7f3d30137cd0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f3d2400c460 tx=0x7f3d2400c920 comp rx=0 tx=0).stop 2024-05-28T06:14:36.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.577+0000 7f3d36c00640 1 -- 172.21.15.122:0/3360938377 shutdown_connections 2024-05-28T06:14:36.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.577+0000 7f3d36c00640 1 --2- 172.21.15.122:0/3360938377 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f3d10068ef0 0x7f3d1006b3b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:36.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.577+0000 7f3d36c00640 1 --2- 172.21.15.122:0/3360938377 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d30144350 0x7f3d3015aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:36.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.577+0000 7f3d36c00640 1 --2- 172.21.15.122:0/3360938377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d300ce1a0 0x7f3d30156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:36.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.577+0000 7f3d36c00640 1 --2- 172.21.15.122:0/3360938377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d300b4c80 0x7f3d30137cd0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:36.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.577+0000 7f3d36c00640 1 -- 172.21.15.122:0/3360938377 >> 172.21.15.122:0/3360938377 conn(0x7f3d30062840 msgr2=0x7f3d300c54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:36.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.577+0000 7f3d36c00640 1 -- 172.21.15.122:0/3360938377 shutdown_connections 2024-05-28T06:14:36.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.577+0000 7f3d36c00640 1 -- 172.21.15.122:0/3360938377 wait complete. 2024-05-28T06:14:36.599 INFO:tasks.ceph:Scrubbing osd.7 2024-05-28T06:14:36.600 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-28T06:14:36.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.781+0000 7f8184400640 1 Processor -- start 2024-05-28T06:14:36.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.781+0000 7f8184400640 1 -- start start 2024-05-28T06:14:36.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.781+0000 7f8184400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f817c0b59c0 0x7f817c0cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:36.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.781+0000 7f8184400640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f817c0d0310 con 0x7f817c06f890 2024-05-28T06:14:36.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.781+0000 7f8184400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f817c15be20 con 0x7f817c0cff30 2024-05-28T06:14:36.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.781+0000 7f8184400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f817c15c100 con 0x7f817c0b59c0 2024-05-28T06:14:36.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.781+0000 7f8181000640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f817c06f890 0x7f817c0cd3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:60082/0 (socket says 172.21.15.122:60082) 2024-05-28T06:14:36.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.781+0000 7f8181000640 1 -- 172.21.15.122:0/405522595 learned_addr learned my addr 172.21.15.122:0/405522595 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:14:36.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.781+0000 7f8182400640 1 --2- 172.21.15.122:0/405522595 >> v2:172.21.15.153:3300/0 conn(0x7f817c0b59c0 0x7f817c0cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:36.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.781+0000 7f8182400640 1 -- 172.21.15.122:0/405522595 >> v1:172.21.15.153:6789/0 conn(0x7f817c0cff30 legacy=0x7f817c06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:36.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.781+0000 7f817be00640 1 -- 172.21.15.122:0/405522595 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1311326521 0 0) 0x7f817c15be20 con 0x7f817c0cff30 2024-05-28T06:14:36.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.781+0000 7f8182400640 1 -- 172.21.15.122:0/405522595 >> v1:172.21.15.122:6789/0 conn(0x7f817c06f890 legacy=0x7f817c0cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:36.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.781+0000 7f8182400640 1 -- 172.21.15.122:0/405522595 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f817c15c3e0 con 0x7f817c0b59c0 2024-05-28T06:14:36.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.785+0000 7f8182400640 1 --2- 172.21.15.122:0/405522595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f817c0b59c0 0x7f817c0cdb00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8174009d90 tx=0x7f817401ea10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33df3f22bbd7e1a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:36.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.785+0000 7f817be00640 1 -- 172.21.15.122:0/405522595 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81740b4070 con 0x7f817c0b59c0 2024-05-28T06:14:36.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.785+0000 7f817be00640 1 -- 172.21.15.122:0/405522595 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81740a7a80 con 0x7f817c0b59c0 2024-05-28T06:14:36.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.785+0000 7f817be00640 1 -- 172.21.15.122:0/405522595 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81740a7e50 con 0x7f817c0b59c0 2024-05-28T06:14:36.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.785+0000 7f8184400640 1 -- 172.21.15.122:0/405522595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f817c0b59c0 msgr2=0x7f817c0cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:36.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.785+0000 7f8184400640 1 --2- 172.21.15.122:0/405522595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f817c0b59c0 0x7f817c0cdb00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8174009d90 tx=0x7f817401ea10 comp rx=0 tx=0).stop 2024-05-28T06:14:36.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.785+0000 7f8184400640 1 -- 172.21.15.122:0/405522595 shutdown_connections 2024-05-28T06:14:36.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.785+0000 7f8184400640 1 --2- 172.21.15.122:0/405522595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f817c0b59c0 0x7f817c0cdb00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:36.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.785+0000 7f8184400640 1 -- 172.21.15.122:0/405522595 >> 172.21.15.122:0/405522595 conn(0x7f817c06bd90 msgr2=0x7f817c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:36.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.785+0000 7f8184400640 1 -- 172.21.15.122:0/405522595 shutdown_connections 2024-05-28T06:14:36.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.785+0000 7f8184400640 1 -- 172.21.15.122:0/405522595 wait complete. 2024-05-28T06:14:36.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.789+0000 7f8184400640 1 Processor -- start 2024-05-28T06:14:36.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.789+0000 7f8184400640 1 -- start start 2024-05-28T06:14:36.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.789+0000 7f8184400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f817c06f890 0x7f817c158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:36.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.789+0000 7f8184400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f817c0b59c0 0x7f817c1f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:36.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.789+0000 7f8184400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f817c0cff30 0x7f817c1f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:36.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.789+0000 7f8184400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f817c06e070 con 0x7f817c0cff30 2024-05-28T06:14:36.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.789+0000 7f8184400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f817c15baf0 con 0x7f817c0b59c0 2024-05-28T06:14:36.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.789+0000 7f8184400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f817c06e1f0 con 0x7f817c06f890 2024-05-28T06:14:36.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.789+0000 7f8181a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f817c06f890 0x7f817c158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:36.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.789+0000 7f8181a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f817c06f890 0x7f817c158660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.122:50890/0 (socket says 172.21.15.122:50890) 2024-05-28T06:14:36.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.789+0000 7f8181a00640 1 -- 172.21.15.122:0/1065769838 learned_addr learned my addr 172.21.15.122:0/1065769838 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:36.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.789+0000 7f8182400640 1 --2- 172.21.15.122:0/1065769838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f817c0cff30 0x7f817c1f4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:36.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.789+0000 7f8181000640 1 --2- 172.21.15.122:0/1065769838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f817c0b59c0 0x7f817c1f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:36.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.789+0000 7f8181a00640 1 -- 172.21.15.122:0/1065769838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f817c0b59c0 msgr2=0x7f817c1f49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:36.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.789+0000 7f8181a00640 1 --2- 172.21.15.122:0/1065769838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f817c0b59c0 0x7f817c1f49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:36.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.789+0000 7f8181a00640 1 -- 172.21.15.122:0/1065769838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f817c0cff30 msgr2=0x7f817c1f4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:36.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.789+0000 7f8181a00640 1 --2- 172.21.15.122:0/1065769838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f817c0cff30 0x7f817c1f4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:36.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.789+0000 7f8181a00640 1 -- 172.21.15.122:0/1065769838 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f817c14e8e0 con 0x7f817c06f890 2024-05-28T06:14:36.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.789+0000 7f8181a00640 1 --2- 172.21.15.122:0/1065769838 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f817c06f890 0x7f817c158660 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f817000c440 tx=0x7f817000c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:36.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.793+0000 7f8179600640 1 -- 172.21.15.122:0/1065769838 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8170005480 con 0x7f817c06f890 2024-05-28T06:14:36.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.793+0000 7f8179600640 1 -- 172.21.15.122:0/1065769838 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8170003600 con 0x7f817c06f890 2024-05-28T06:14:36.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.793+0000 7f8184400640 1 -- 172.21.15.122:0/1065769838 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f817c1f5620 con 0x7f817c06f890 2024-05-28T06:14:36.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.793+0000 7f8179600640 1 -- 172.21.15.122:0/1065769838 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81700039f0 con 0x7f817c06f890 2024-05-28T06:14:36.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.793+0000 7f8184400640 1 -- 172.21.15.122:0/1065769838 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f817c1f83d0 con 0x7f817c06f890 2024-05-28T06:14:36.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.793+0000 7f8184400640 1 -- 172.21.15.122:0/1065769838 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f817c076020 con 0x7f817c06f890 2024-05-28T06:14:36.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.793+0000 7f8179600640 1 -- 172.21.15.122:0/1065769838 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 24) ==== 89007+0+0 (secure 0 0 0) 0x7f8170003b90 con 0x7f817c06f890 2024-05-28T06:14:36.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.793+0000 7f8179600640 1 --2- 172.21.15.122:0/1065769838 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f815c068ec0 0x7f815c06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:36.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.793+0000 7f8179600640 1 -- 172.21.15.122:0/1065769838 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f8170084f90 con 0x7f817c06f890 2024-05-28T06:14:36.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.793+0000 7f8181000640 1 --2- 172.21.15.122:0/1065769838 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f815c068ec0 0x7f815c06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:36.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.797+0000 7f8179600640 1 --2- 172.21.15.122:0/1065769838 >> [v2:172.21.15.153:6800/23883170,v1:172.21.15.153:6801/23883170] conn(0x7f815c0710c0 0x7f815c0734e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:36.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.797+0000 7f8179600640 1 -- 172.21.15.122:0/1065769838 --> [v2:172.21.15.153:6800/23883170,v1:172.21.15.153:6801/23883170] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8170020e50 con 0x7f815c0710c0 2024-05-28T06:14:36.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.797+0000 7f8179600640 1 -- 172.21.15.122:0/1065769838 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f817008c2a0 con 0x7f817c06f890 2024-05-28T06:14:36.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.797+0000 7f8182400640 1 --2- 172.21.15.122:0/1065769838 >> [v2:172.21.15.153:6800/23883170,v1:172.21.15.153:6801/23883170] conn(0x7f815c0710c0 0x7f815c0734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:36.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.797+0000 7f8181000640 1 --2- 172.21.15.122:0/1065769838 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f815c068ec0 0x7f815c06b380 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f817c14c9a0 tx=0x7f816800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:36.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.797+0000 7f8182400640 1 --2- 172.21.15.122:0/1065769838 >> [v2:172.21.15.153:6800/23883170,v1:172.21.15.153:6801/23883170] conn(0x7f815c0710c0 0x7f815c0734e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:36.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.797+0000 7f8179600640 1 -- 172.21.15.122:0/1065769838 <== osd.7 v2:172.21.15.153:6800/23883170 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8170020e50 con 0x7f815c0710c0 2024-05-28T06:14:36.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.813+0000 7f8184400640 1 -- 172.21.15.122:0/1065769838 --> [v2:172.21.15.153:6800/23883170,v1:172.21.15.153:6801/23883170] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f817c068c40 con 0x7f815c0710c0 2024-05-28T06:14:36.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.813+0000 7f8179600640 1 -- 172.21.15.122:0/1065769838 <== osd.7 v2:172.21.15.153:6800/23883170 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f817c068c40 con 0x7f815c0710c0 2024-05-28T06:14:36.813 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-05-28T06:14:36.814 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-28T06:14:36.814 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-05-28T06:14:36.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.813+0000 7f8184400640 1 -- 172.21.15.122:0/1065769838 >> [v2:172.21.15.153:6800/23883170,v1:172.21.15.153:6801/23883170] conn(0x7f815c0710c0 msgr2=0x7f815c0734e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:36.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.813+0000 7f8184400640 1 --2- 172.21.15.122:0/1065769838 >> [v2:172.21.15.153:6800/23883170,v1:172.21.15.153:6801/23883170] conn(0x7f815c0710c0 0x7f815c0734e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:36.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.813+0000 7f8184400640 1 -- 172.21.15.122:0/1065769838 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f815c068ec0 msgr2=0x7f815c06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:36.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.813+0000 7f8184400640 1 --2- 172.21.15.122:0/1065769838 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f815c068ec0 0x7f815c06b380 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f817c14c9a0 tx=0x7f816800b040 comp rx=0 tx=0).stop 2024-05-28T06:14:36.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.813+0000 7f8184400640 1 -- 172.21.15.122:0/1065769838 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f817c06f890 msgr2=0x7f817c158660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:36.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.813+0000 7f8184400640 1 --2- 172.21.15.122:0/1065769838 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f817c06f890 0x7f817c158660 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f817000c440 tx=0x7f817000c900 comp rx=0 tx=0).stop 2024-05-28T06:14:36.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.813+0000 7f8182400640 1 -- 172.21.15.122:0/1065769838 reap_dead start 2024-05-28T06:14:36.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.813+0000 7f8184400640 1 -- 172.21.15.122:0/1065769838 shutdown_connections 2024-05-28T06:14:36.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.813+0000 7f8184400640 1 -- 172.21.15.122:0/1065769838 >> 172.21.15.122:0/1065769838 conn(0x7f817c06bd90 msgr2=0x7f817c14d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:36.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.813+0000 7f8184400640 1 -- 172.21.15.122:0/1065769838 shutdown_connections 2024-05-28T06:14:36.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:36.813+0000 7f8184400640 1 -- 172.21.15.122:0/1065769838 wait complete. 2024-05-28T06:14:36.837 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-28T06:14:37.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.009+0000 7f8ee0c00640 1 Processor -- start 2024-05-28T06:14:37.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.009+0000 7f8ee0c00640 1 -- start start 2024-05-28T06:14:37.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.013+0000 7f8ee0c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8edc09aca0 0x7f8edc0d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:37.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.013+0000 7f8ee0c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8edc0706a0 con 0x7f8edc0cea40 2024-05-28T06:14:37.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.013+0000 7f8ee0c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8edc070980 con 0x7f8edc070130 2024-05-28T06:14:37.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.013+0000 7f8ee0c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8edc070c60 con 0x7f8edc09aca0 2024-05-28T06:14:37.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.013+0000 7f8edbe00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f8edc0cea40 0x7f8edc0ccee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:60094/0 (socket says 172.21.15.122:60094) 2024-05-28T06:14:37.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.013+0000 7f8edbe00640 1 -- 172.21.15.122:0/3406581249 learned_addr learned my addr 172.21.15.122:0/3406581249 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:14:37.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.013+0000 7f8edb400640 1 --2- 172.21.15.122:0/3406581249 >> v2:172.21.15.153:3300/0 conn(0x7f8edc09aca0 0x7f8edc0d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:37.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.013+0000 7f8edb400640 1 -- 172.21.15.122:0/3406581249 >> v1:172.21.15.153:6789/0 conn(0x7f8edc070130 legacy=0x7f8edc0ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:37.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.013+0000 7f8edb400640 1 -- 172.21.15.122:0/3406581249 >> v1:172.21.15.122:6789/0 conn(0x7f8edc0cea40 legacy=0x7f8edc0ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:37.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.013+0000 7f8edb400640 1 -- 172.21.15.122:0/3406581249 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8edc070f40 con 0x7f8edc09aca0 2024-05-28T06:14:37.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.013+0000 7f8eda000640 1 -- 172.21.15.122:0/3406581249 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 107857703 0 0) 0x7f8edc0706a0 con 0x7f8edc0cea40 2024-05-28T06:14:37.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.017+0000 7f8edb400640 1 --2- 172.21.15.122:0/3406581249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8edc09aca0 0x7f8edc0d0fc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc0097c0 tx=0x7f8ecc01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=120d13dae8f12279 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:37.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.017+0000 7f8eda000640 1 -- 172.21.15.122:0/3406581249 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc0b2070 con 0x7f8edc09aca0 2024-05-28T06:14:37.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.017+0000 7f8eda000640 1 -- 172.21.15.122:0/3406581249 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ecc0ad680 con 0x7f8edc09aca0 2024-05-28T06:14:37.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.017+0000 7f8eda000640 1 -- 172.21.15.122:0/3406581249 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc0ada50 con 0x7f8edc09aca0 2024-05-28T06:14:37.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.017+0000 7f8ee0c00640 1 -- 172.21.15.122:0/3406581249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8edc09aca0 msgr2=0x7f8edc0d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:37.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.017+0000 7f8ee0c00640 1 --2- 172.21.15.122:0/3406581249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8edc09aca0 0x7f8edc0d0fc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc0097c0 tx=0x7f8ecc01c470 comp rx=0 tx=0).stop 2024-05-28T06:14:37.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.017+0000 7f8ee0c00640 1 -- 172.21.15.122:0/3406581249 shutdown_connections 2024-05-28T06:14:37.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.017+0000 7f8ee0c00640 1 --2- 172.21.15.122:0/3406581249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8edc09aca0 0x7f8edc0d0fc0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:37.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.017+0000 7f8ee0c00640 1 -- 172.21.15.122:0/3406581249 >> 172.21.15.122:0/3406581249 conn(0x7f8edc0d24b0 msgr2=0x7f8edc0d28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:37.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.017+0000 7f8ee0c00640 1 -- 172.21.15.122:0/3406581249 shutdown_connections 2024-05-28T06:14:37.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.017+0000 7f8ee0c00640 1 -- 172.21.15.122:0/3406581249 wait complete. 2024-05-28T06:14:37.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.017+0000 7f8ee0c00640 1 Processor -- start 2024-05-28T06:14:37.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.017+0000 7f8ee0c00640 1 -- start start 2024-05-28T06:14:37.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.021+0000 7f8ee0c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8edc070130 0x7f8edc0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:37.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.021+0000 7f8ee0c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8edc09aca0 0x7f8edc15b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:37.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.021+0000 7f8ee0c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8edc0cea40 0x7f8edc0b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:37.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.021+0000 7f8ee0c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc16aaa0 con 0x7f8edc070130 2024-05-28T06:14:37.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.021+0000 7f8ee0c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc16a920 con 0x7f8edc0cea40 2024-05-28T06:14:37.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.021+0000 7f8ee0c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f8edc16ac20 con 0x7f8edc09aca0 2024-05-28T06:14:37.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.021+0000 7f8edb400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8edc070130 0x7f8edc0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:37.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.021+0000 7f8edb400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8edc070130 0x7f8edc0b5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:53758/0 (socket says 172.21.15.122:53758) 2024-05-28T06:14:37.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.021+0000 7f8edb400640 1 -- 172.21.15.122:0/2457834892 learned_addr learned my addr 172.21.15.122:0/2457834892 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:37.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.021+0000 7f8edaa00640 1 --2- 172.21.15.122:0/2457834892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8edc09aca0 0x7f8edc15b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:37.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.021+0000 7f8edbe00640 1 --2- 172.21.15.122:0/2457834892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8edc0cea40 0x7f8edc0b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:37.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.021+0000 7f8edbe00640 1 -- 172.21.15.122:0/2457834892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8edc09aca0 msgr2=0x7f8edc15b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:37.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.021+0000 7f8edbe00640 1 --2- 172.21.15.122:0/2457834892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8edc09aca0 0x7f8edc15b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:37.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.021+0000 7f8edbe00640 1 -- 172.21.15.122:0/2457834892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8edc070130 msgr2=0x7f8edc0b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:37.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.021+0000 7f8edbe00640 1 --2- 172.21.15.122:0/2457834892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8edc070130 0x7f8edc0b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:37.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.021+0000 7f8edbe00640 1 -- 172.21.15.122:0/2457834892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8edc15a760 con 0x7f8edc0cea40 2024-05-28T06:14:37.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.021+0000 7f8edbe00640 1 --2- 172.21.15.122:0/2457834892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8edc0cea40 0x7f8edc0b77c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400c750 tx=0x7f8ed400cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:37.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.021+0000 7f8ed3400640 1 -- 172.21.15.122:0/2457834892 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4018070 con 0x7f8edc0cea40 2024-05-28T06:14:37.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.021+0000 7f8ed3400640 1 -- 172.21.15.122:0/2457834892 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ed4004d80 con 0x7f8edc0cea40 2024-05-28T06:14:37.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.021+0000 7f8ed3400640 1 -- 172.21.15.122:0/2457834892 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed400a880 con 0x7f8edc0cea40 2024-05-28T06:14:37.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.021+0000 7f8ee0c00640 1 -- 172.21.15.122:0/2457834892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8edc15aa40 con 0x7f8edc0cea40 2024-05-28T06:14:37.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.021+0000 7f8ee0c00640 1 -- 172.21.15.122:0/2457834892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8edc15b000 con 0x7f8edc0cea40 2024-05-28T06:14:37.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.021+0000 7f8ee0c00640 1 -- 172.21.15.122:0/2457834892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8edc075620 con 0x7f8edc0cea40 2024-05-28T06:14:37.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.025+0000 7f8ed3400640 1 -- 172.21.15.122:0/2457834892 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 89007+0+0 (secure 0 0 0) 0x7f8ed401b070 con 0x7f8edc0cea40 2024-05-28T06:14:37.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.025+0000 7f8ed3400640 1 --2- 172.21.15.122:0/2457834892 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8ebc068f10 0x7f8ebc06b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:37.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.025+0000 7f8ed3400640 1 -- 172.21.15.122:0/2457834892 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f8ed4084b60 con 0x7f8edc0cea40 2024-05-28T06:14:37.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.025+0000 7f8edb400640 1 --2- 172.21.15.122:0/2457834892 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8ebc068f10 0x7f8ebc06b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:37.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.025+0000 7f8edb400640 1 --2- 172.21.15.122:0/2457834892 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8ebc068f10 0x7f8ebc06b3d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc01c4b0 tx=0x7f8ecc0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:37.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.029+0000 7f8ed3400640 1 -- 172.21.15.122:0/2457834892 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8ed4056310 con 0x7f8edc0cea40 2024-05-28T06:14:37.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.189+0000 7f8ee0c00640 1 -- 172.21.15.122:0/2457834892 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f8edc0d32e0 con 0x7f8ebc068f10 2024-05-28T06:14:37.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.189+0000 7f8ed3400640 1 -- 172.21.15.122:0/2457834892 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8edc0d32e0 con 0x7f8ebc068f10 2024-05-28T06:14:37.188 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 7 to deep-scrub 2024-05-28T06:14:37.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.189+0000 7f8ee0c00640 1 -- 172.21.15.122:0/2457834892 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8ebc068f10 msgr2=0x7f8ebc06b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:37.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.189+0000 7f8ee0c00640 1 --2- 172.21.15.122:0/2457834892 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8ebc068f10 0x7f8ebc06b3d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc01c4b0 tx=0x7f8ecc0a7000 comp rx=0 tx=0).stop 2024-05-28T06:14:37.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.189+0000 7f8ee0c00640 1 -- 172.21.15.122:0/2457834892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8edc0cea40 msgr2=0x7f8edc0b77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:37.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.189+0000 7f8ee0c00640 1 --2- 172.21.15.122:0/2457834892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8edc0cea40 0x7f8edc0b77c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400c750 tx=0x7f8ed400cc10 comp rx=0 tx=0).stop 2024-05-28T06:14:37.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.189+0000 7f8ee0c00640 1 -- 172.21.15.122:0/2457834892 shutdown_connections 2024-05-28T06:14:37.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.189+0000 7f8ee0c00640 1 --2- 172.21.15.122:0/2457834892 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8ebc068f10 0x7f8ebc06b3d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:37.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.189+0000 7f8ee0c00640 1 --2- 172.21.15.122:0/2457834892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8edc0cea40 0x7f8edc0b77c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:37.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.189+0000 7f8ee0c00640 1 --2- 172.21.15.122:0/2457834892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8edc09aca0 0x7f8edc15b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:37.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.189+0000 7f8ee0c00640 1 --2- 172.21.15.122:0/2457834892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8edc070130 0x7f8edc0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:37.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.189+0000 7f8ee0c00640 1 -- 172.21.15.122:0/2457834892 >> 172.21.15.122:0/2457834892 conn(0x7f8edc0d24b0 msgr2=0x7f8edc0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:37.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.189+0000 7f8ee0c00640 1 -- 172.21.15.122:0/2457834892 shutdown_connections 2024-05-28T06:14:37.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.189+0000 7f8ee0c00640 1 -- 172.21.15.122:0/2457834892 wait complete. 2024-05-28T06:14:37.209 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-28T06:14:37.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.345+0000 7ff778000640 1 Processor -- start 2024-05-28T06:14:37.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.345+0000 7ff778000640 1 -- start start 2024-05-28T06:14:37.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.349+0000 7ff778000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff7700cff30 0x7ff77006f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:37.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.349+0000 7ff778000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7700cdb00 0x7ff7700b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:37.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.349+0000 7ff778000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7700cdf00 con 0x7ff77006f6c0 2024-05-28T06:14:37.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.349+0000 7ff778000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7ff77006fb30 con 0x7ff7700cff30 2024-05-28T06:14:37.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.349+0000 7ff778000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff7700d0310 con 0x7ff7700cdb00 2024-05-28T06:14:37.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.349+0000 7ff775600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff7700cff30 0x7ff77006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:37.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.349+0000 7ff774c00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7ff77006f6c0 0x7ff7700cd3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:60108/0 (socket says 172.21.15.122:60108) 2024-05-28T06:14:37.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.349+0000 7ff774c00640 1 -- 172.21.15.122:0/2197089615 learned_addr learned my addr 172.21.15.122:0/2197089615 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:14:37.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.349+0000 7ff776000640 1 --2- 172.21.15.122:0/2197089615 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7700cdb00 0x7ff7700b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:37.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.349+0000 7ff775600640 1 -- 172.21.15.122:0/2197089615 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7700cdb00 msgr2=0x7ff7700b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:37.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.349+0000 7ff775600640 1 --2- 172.21.15.122:0/2197089615 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7700cdb00 0x7ff7700b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:37.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.349+0000 7ff775600640 1 -- 172.21.15.122:0/2197089615 >> v1:172.21.15.122:6789/0 conn(0x7ff77006f6c0 legacy=0x7ff7700cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:37.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.349+0000 7ff775600640 1 -- 172.21.15.122:0/2197089615 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77015be20 con 0x7ff7700cff30 2024-05-28T06:14:37.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.349+0000 7ff76fe00640 1 -- 172.21.15.122:0/2197089615 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4118351110 0 0) 0x7ff75c001120 con 0x7ff77006f6c0 2024-05-28T06:14:37.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.353+0000 7ff775600640 1 --2- 172.21.15.122:0/2197089615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7700cff30 0x7ff77006f180 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7ff7640097c0 tx=0x7ff76401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88452bad495a7e54 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:37.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.353+0000 7ff76fe00640 1 -- 172.21.15.122:0/2197089615 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7640a7070 con 0x7ff7700cff30 2024-05-28T06:14:37.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.353+0000 7ff76fe00640 1 -- 172.21.15.122:0/2197089615 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7640b0070 con 0x7ff7700cff30 2024-05-28T06:14:37.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.353+0000 7ff76fe00640 1 -- 172.21.15.122:0/2197089615 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7640ab890 con 0x7ff7700cff30 2024-05-28T06:14:37.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.353+0000 7ff778000640 1 -- 172.21.15.122:0/2197089615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7700cff30 msgr2=0x7ff77006f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:37.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.353+0000 7ff778000640 1 --2- 172.21.15.122:0/2197089615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7700cff30 0x7ff77006f180 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7ff7640097c0 tx=0x7ff76401c470 comp rx=0 tx=0).stop 2024-05-28T06:14:37.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.353+0000 7ff778000640 1 -- 172.21.15.122:0/2197089615 shutdown_connections 2024-05-28T06:14:37.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.353+0000 7ff778000640 1 --2- 172.21.15.122:0/2197089615 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7700cdb00 0x7ff7700b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:37.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.353+0000 7ff778000640 1 --2- 172.21.15.122:0/2197089615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7700cff30 0x7ff77006f180 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:37.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.353+0000 7ff778000640 1 -- 172.21.15.122:0/2197089615 >> 172.21.15.122:0/2197089615 conn(0x7ff77006bd90 msgr2=0x7ff77006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:37.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.353+0000 7ff778000640 1 -- 172.21.15.122:0/2197089615 shutdown_connections 2024-05-28T06:14:37.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.353+0000 7ff778000640 1 -- 172.21.15.122:0/2197089615 wait complete. 2024-05-28T06:14:37.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.353+0000 7ff778000640 1 Processor -- start 2024-05-28T06:14:37.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.353+0000 7ff778000640 1 -- start start 2024-05-28T06:14:37.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff778000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff77006f6c0 0x7ff77014cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:37.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff778000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7700cdb00 0x7ff7700b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:37.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff778000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7700cff30 0x7ff770157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:37.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff778000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff7700b5700 con 0x7ff77006f6c0 2024-05-28T06:14:37.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff778000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff77015baf0 con 0x7ff7700cff30 2024-05-28T06:14:37.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff778000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7ff7700b5880 con 0x7ff7700cdb00 2024-05-28T06:14:37.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff775600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff77006f6c0 0x7ff77014cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:37.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff775600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff77006f6c0 0x7ff77014cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:53788/0 (socket says 172.21.15.122:53788) 2024-05-28T06:14:37.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff775600640 1 -- 172.21.15.122:0/3983500567 learned_addr learned my addr 172.21.15.122:0/3983500567 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:37.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff776000640 1 --2- 172.21.15.122:0/3983500567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7700cff30 0x7ff770157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:37.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff774c00640 1 --2- 172.21.15.122:0/3983500567 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7700cdb00 0x7ff7700b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:37.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff775600640 1 -- 172.21.15.122:0/3983500567 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7700cdb00 msgr2=0x7ff7700b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:37.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff775600640 1 --2- 172.21.15.122:0/3983500567 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7700cdb00 0x7ff7700b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:37.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff775600640 1 -- 172.21.15.122:0/3983500567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7700cff30 msgr2=0x7ff770157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:37.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff775600640 1 --2- 172.21.15.122:0/3983500567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7700cff30 0x7ff770157030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:37.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff775600640 1 -- 172.21.15.122:0/3983500567 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77006f410 con 0x7ff77006f6c0 2024-05-28T06:14:37.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff775600640 1 --2- 172.21.15.122:0/3983500567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff77006f6c0 0x7ff77014cc80 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7ff7640ad040 tx=0x7ff76401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:37.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff76d600640 1 -- 172.21.15.122:0/3983500567 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764006e20 con 0x7ff77006f6c0 2024-05-28T06:14:37.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff76d600640 1 -- 172.21.15.122:0/3983500567 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff764004230 con 0x7ff77006f6c0 2024-05-28T06:14:37.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff76d600640 1 -- 172.21.15.122:0/3983500567 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764003620 con 0x7ff77006f6c0 2024-05-28T06:14:37.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff778000640 1 -- 172.21.15.122:0/3983500567 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7700b1020 con 0x7ff77006f6c0 2024-05-28T06:14:37.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff778000640 1 -- 172.21.15.122:0/3983500567 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7700b15e0 con 0x7ff77006f6c0 2024-05-28T06:14:37.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff778000640 1 -- 172.21.15.122:0/3983500567 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff770068c40 con 0x7ff77006f6c0 2024-05-28T06:14:37.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.357+0000 7ff76d600640 1 -- 172.21.15.122:0/3983500567 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 89007+0+0 (secure 0 0 0) 0x7ff7640037c0 con 0x7ff77006f6c0 2024-05-28T06:14:37.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.361+0000 7ff76d600640 1 --2- 172.21.15.122:0/3983500567 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff750068ec0 0x7ff75006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:37.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.361+0000 7ff76d600640 1 -- 172.21.15.122:0/3983500567 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7ff76411fa70 con 0x7ff77006f6c0 2024-05-28T06:14:37.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.361+0000 7ff774c00640 1 --2- 172.21.15.122:0/3983500567 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff750068ec0 0x7ff75006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:37.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.361+0000 7ff774c00640 1 --2- 172.21.15.122:0/3983500567 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff750068ec0 0x7ff75006b380 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff75c007fd0 tx=0x7ff75c007980 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:37.363 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.365+0000 7ff76d600640 1 -- 172.21.15.122:0/3983500567 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff7640c6030 con 0x7ff77006f6c0 2024-05-28T06:14:37.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.525+0000 7ff778000640 1 -- 172.21.15.122:0/3983500567 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff770076020 con 0x7ff750068ec0 2024-05-28T06:14:37.535 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.537+0000 7ff76d600640 1 -- 172.21.15.122:0/3983500567 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254360 (secure 0 0 0) 0x7ff75c001490 con 0x7ff750068ec0 2024-05-28T06:14:37.537 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:14:37.539 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-05-28T06:14:37.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.541+0000 7ff778000640 1 -- 172.21.15.122:0/3983500567 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff750068ec0 msgr2=0x7ff75006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:37.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.541+0000 7ff778000640 1 --2- 172.21.15.122:0/3983500567 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff750068ec0 0x7ff75006b380 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff75c007fd0 tx=0x7ff75c007980 comp rx=0 tx=0).stop 2024-05-28T06:14:37.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.541+0000 7ff778000640 1 -- 172.21.15.122:0/3983500567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff77006f6c0 msgr2=0x7ff77014cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:37.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.541+0000 7ff778000640 1 --2- 172.21.15.122:0/3983500567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff77006f6c0 0x7ff77014cc80 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7ff7640ad040 tx=0x7ff76401acb0 comp rx=0 tx=0).stop 2024-05-28T06:14:37.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.541+0000 7ff778000640 1 -- 172.21.15.122:0/3983500567 shutdown_connections 2024-05-28T06:14:37.541 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.541+0000 7ff778000640 1 --2- 172.21.15.122:0/3983500567 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7ff750068ec0 0x7ff75006b380 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:37.541 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.541+0000 7ff778000640 1 --2- 172.21.15.122:0/3983500567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7700cff30 0x7ff770157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:37.541 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.541+0000 7ff778000640 1 --2- 172.21.15.122:0/3983500567 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7700cdb00 0x7ff7700b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:37.541 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.541+0000 7ff778000640 1 --2- 172.21.15.122:0/3983500567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff77006f6c0 0x7ff77014cc80 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:37.541 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.541+0000 7ff778000640 1 -- 172.21.15.122:0/3983500567 >> 172.21.15.122:0/3983500567 conn(0x7ff77006bd90 msgr2=0x7ff770158380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:37.541 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.541+0000 7ff778000640 1 -- 172.21.15.122:0/3983500567 shutdown_connections 2024-05-28T06:14:37.541 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:37.541+0000 7ff778000640 1 -- 172.21.15.122:0/3983500567 wait complete. 2024-05-28T06:14:37.565 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":325,"stamp":"2024-05-28T06:14:37.390454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":20428524441,"num_objects":4905,"num_object_clones":1,"num_object_copies":9810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4905,"num_whiteouts":1,"num_read":4316,"num_read_kb":16875700,"num_write":5719,"num_write_kb":19951858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7131,"ondisk_log_size":7131,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":40315856,"kb_used_data":39905424,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":714658864,"statfs":{"total":773094113280,"available":731810676736,"internally_reserved":0,"allocated":40863154176,"data_stored":40859569114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":420204081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4,11,6,8,8],"upper_bound":64},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":747,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002241"},"pg_stats":[{"pgid":"9.3f","version":"62'94","reported_seq":180,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.044595+0000","last_change":"2024-05-28T06:12:31.797507+0000","last_active":"2024-05-28T06:14:31.044595+0000","last_peered":"2024-05-28T06:14:31.044595+0000","last_clean":"2024-05-28T06:14:31.044595+0000","last_became_active":"2024-05-28T06:12:31.793751+0000","last_became_peered":"2024-05-28T06:12:31.793751+0000","last_unstale":"2024-05-28T06:14:31.044595+0000","last_undegraded":"2024-05-28T06:14:31.044595+0000","last_fullsized":"2024-05-28T06:14:31.044595+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:49:14.729612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":74,"num_read_kb":303104,"num_write":66,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"62'100","reported_seq":184,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.032573+0000","last_change":"2024-05-28T06:12:31.799024+0000","last_active":"2024-05-28T06:14:31.032573+0000","last_peered":"2024-05-28T06:14:31.032573+0000","last_clean":"2024-05-28T06:14:31.032573+0000","last_became_active":"2024-05-28T06:12:31.798788+0000","last_became_peered":"2024-05-28T06:12:31.798788+0000","last_unstale":"2024-05-28T06:14:31.032573+0000","last_undegraded":"2024-05-28T06:14:31.032573+0000","last_fullsized":"2024-05-28T06:14:31.032573+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:59:06.307827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":72,"num_read_kb":294912,"num_write":79,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"62'96","reported_seq":176,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.021516+0000","last_change":"2024-05-28T06:12:31.802734+0000","last_active":"2024-05-28T06:14:31.021516+0000","last_peered":"2024-05-28T06:14:31.021516+0000","last_clean":"2024-05-28T06:14:31.021516+0000","last_became_active":"2024-05-28T06:12:31.802019+0000","last_became_peered":"2024-05-28T06:12:31.802019+0000","last_unstale":"2024-05-28T06:14:31.021516+0000","last_undegraded":"2024-05-28T06:14:31.021516+0000","last_fullsized":"2024-05-28T06:14:31.021516+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:55:16.457872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":68,"num_read_kb":270338,"num_write":75,"num_write_kb":282627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"62'98","reported_seq":155,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.032248+0000","last_change":"2024-05-28T06:12:31.802404+0000","last_active":"2024-05-28T06:14:31.032248+0000","last_peered":"2024-05-28T06:14:31.032248+0000","last_clean":"2024-05-28T06:14:31.032248+0000","last_became_active":"2024-05-28T06:12:31.801804+0000","last_became_peered":"2024-05-28T06:12:31.801804+0000","last_unstale":"2024-05-28T06:14:31.032248+0000","last_undegraded":"2024-05-28T06:14:31.032248+0000","last_fullsized":"2024-05-28T06:14:31.032248+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:08:26.147408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322961408,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":44,"num_read_kb":180224,"num_write":77,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"62'74","reported_seq":126,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.018234+0000","last_change":"2024-05-28T06:12:31.798616+0000","last_active":"2024-05-28T06:14:31.018234+0000","last_peered":"2024-05-28T06:14:31.018234+0000","last_clean":"2024-05-28T06:14:31.018234+0000","last_became_active":"2024-05-28T06:12:31.798238+0000","last_became_peered":"2024-05-28T06:12:31.798238+0000","last_unstale":"2024-05-28T06:14:31.018234+0000","last_undegraded":"2024-05-28T06:14:31.018234+0000","last_fullsized":"2024-05-28T06:14:31.018234+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T18:11:53.921729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":40,"num_read_kb":163840,"num_write":58,"num_write_kb":237568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"62'110","reported_seq":213,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.037699+0000","last_change":"2024-05-28T06:12:31.791032+0000","last_active":"2024-05-28T06:14:31.037699+0000","last_peered":"2024-05-28T06:14:31.037699+0000","last_clean":"2024-05-28T06:14:31.037699+0000","last_became_active":"2024-05-28T06:12:31.790779+0000","last_became_peered":"2024-05-28T06:12:31.790779+0000","last_unstale":"2024-05-28T06:14:31.037699+0000","last_undegraded":"2024-05-28T06:14:31.037699+0000","last_fullsized":"2024-05-28T06:14:31.037699+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:24:28.859928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352321536,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":91,"num_read_kb":364546,"num_write":88,"num_write_kb":344066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"62'93","reported_seq":153,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.018339+0000","last_change":"2024-05-28T06:12:31.786902+0000","last_active":"2024-05-28T06:14:31.018339+0000","last_peered":"2024-05-28T06:14:31.018339+0000","last_clean":"2024-05-28T06:14:31.018339+0000","last_became_active":"2024-05-28T06:12:31.786592+0000","last_became_peered":"2024-05-28T06:12:31.786592+0000","last_unstale":"2024-05-28T06:14:31.018339+0000","last_undegraded":"2024-05-28T06:14:31.018339+0000","last_fullsized":"2024-05-28T06:14:31.018339+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:13:29.656977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":48,"num_read_kb":196608,"num_write":63,"num_write_kb":258048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"62'96","reported_seq":159,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.024075+0000","last_change":"2024-05-28T06:12:31.788445+0000","last_active":"2024-05-28T06:14:31.024075+0000","last_peered":"2024-05-28T06:14:31.024075+0000","last_clean":"2024-05-28T06:14:31.024075+0000","last_became_active":"2024-05-28T06:12:31.788168+0000","last_became_peered":"2024-05-28T06:12:31.788168+0000","last_unstale":"2024-05-28T06:14:31.024075+0000","last_undegraded":"2024-05-28T06:14:31.024075+0000","last_fullsized":"2024-05-28T06:14:31.024075+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:04:14.908029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":51,"num_read_kb":208896,"num_write":75,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"62'107","reported_seq":174,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.017587+0000","last_change":"2024-05-28T06:12:31.783886+0000","last_active":"2024-05-28T06:14:31.017587+0000","last_peered":"2024-05-28T06:14:31.017587+0000","last_clean":"2024-05-28T06:14:31.017587+0000","last_became_active":"2024-05-28T06:12:31.783599+0000","last_became_peered":"2024-05-28T06:12:31.783599+0000","last_unstale":"2024-05-28T06:14:31.017587+0000","last_undegraded":"2024-05-28T06:14:31.017587+0000","last_fullsized":"2024-05-28T06:14:31.017587+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:42:44.413357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":55,"num_read_kb":221185,"num_write":82,"num_write_kb":327681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"62'95","reported_seq":170,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.024310+0000","last_change":"2024-05-28T06:12:31.797210+0000","last_active":"2024-05-28T06:14:31.024310+0000","last_peered":"2024-05-28T06:14:31.024310+0000","last_clean":"2024-05-28T06:14:31.024310+0000","last_became_active":"2024-05-28T06:12:31.793687+0000","last_became_peered":"2024-05-28T06:12:31.793687+0000","last_unstale":"2024-05-28T06:14:31.024310+0000","last_undegraded":"2024-05-28T06:14:31.024310+0000","last_fullsized":"2024-05-28T06:14:31.024310+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:58:28.495952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":63,"num_read_kb":258048,"num_write":62,"num_write_kb":253952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"62'111","reported_seq":224,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.035640+0000","last_change":"2024-05-28T06:12:31.789629+0000","last_active":"2024-05-28T06:14:31.035640+0000","last_peered":"2024-05-28T06:14:31.035640+0000","last_clean":"2024-05-28T06:14:31.035640+0000","last_became_active":"2024-05-28T06:12:31.789337+0000","last_became_peered":"2024-05-28T06:12:31.789337+0000","last_unstale":"2024-05-28T06:14:31.035640+0000","last_undegraded":"2024-05-28T06:14:31.035640+0000","last_fullsized":"2024-05-28T06:14:31.035640+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:11:11.445809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381681664,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":101,"num_read_kb":413696,"num_write":91,"num_write_kb":372736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"62'91","reported_seq":202,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.010870+0000","last_change":"2024-05-28T06:12:31.796464+0000","last_active":"2024-05-28T06:14:31.010870+0000","last_peered":"2024-05-28T06:14:31.010870+0000","last_clean":"2024-05-28T06:14:31.010870+0000","last_became_active":"2024-05-28T06:12:31.796167+0000","last_became_peered":"2024-05-28T06:12:31.796167+0000","last_unstale":"2024-05-28T06:14:31.010870+0000","last_undegraded":"2024-05-28T06:14:31.010870+0000","last_fullsized":"2024-05-28T06:14:31.010870+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:53:57.139243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":99,"num_read_kb":389124,"num_write":76,"num_write_kb":303105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"62'107","reported_seq":202,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.027323+0000","last_change":"2024-05-28T06:12:31.799523+0000","last_active":"2024-05-28T06:14:31.027323+0000","last_peered":"2024-05-28T06:14:31.027323+0000","last_clean":"2024-05-28T06:14:31.027323+0000","last_became_active":"2024-05-28T06:12:31.799169+0000","last_became_peered":"2024-05-28T06:12:31.799169+0000","last_unstale":"2024-05-28T06:14:31.027323+0000","last_undegraded":"2024-05-28T06:14:31.027323+0000","last_fullsized":"2024-05-28T06:14:31.027323+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:24:13.601910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343932928,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":83,"num_read_kb":339968,"num_write":82,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"62'114","reported_seq":190,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.032203+0000","last_change":"2024-05-28T06:12:31.790257+0000","last_active":"2024-05-28T06:14:31.032203+0000","last_peered":"2024-05-28T06:14:31.032203+0000","last_clean":"2024-05-28T06:14:31.032203+0000","last_became_active":"2024-05-28T06:12:31.789907+0000","last_became_peered":"2024-05-28T06:12:31.789907+0000","last_unstale":"2024-05-28T06:14:31.032203+0000","last_undegraded":"2024-05-28T06:14:31.032203+0000","last_fullsized":"2024-05-28T06:14:31.032203+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:22:57.588310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364904448,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":64,"num_read_kb":262144,"num_write":87,"num_write_kb":356352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"62'88","reported_seq":131,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.030886+0000","last_change":"2024-05-28T06:12:31.788326+0000","last_active":"2024-05-28T06:14:31.030886+0000","last_peered":"2024-05-28T06:14:31.030886+0000","last_clean":"2024-05-28T06:14:31.030886+0000","last_became_active":"2024-05-28T06:12:31.788073+0000","last_became_peered":"2024-05-28T06:12:31.788073+0000","last_unstale":"2024-05-28T06:14:31.030886+0000","last_undegraded":"2024-05-28T06:14:31.030886+0000","last_fullsized":"2024-05-28T06:14:31.030886+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:39:57.840865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":31,"num_read_kb":126976,"num_write":63,"num_write_kb":258048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"62'91","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.040046+0000","last_change":"2024-05-28T06:12:31.802252+0000","last_active":"2024-05-28T06:14:31.040046+0000","last_peered":"2024-05-28T06:14:31.040046+0000","last_clean":"2024-05-28T06:14:31.040046+0000","last_became_active":"2024-05-28T06:12:31.800507+0000","last_became_peered":"2024-05-28T06:12:31.800507+0000","last_unstale":"2024-05-28T06:14:31.040046+0000","last_undegraded":"2024-05-28T06:14:31.040046+0000","last_fullsized":"2024-05-28T06:14:31.040046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:27:01.826955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":54,"num_read_kb":221184,"num_write":64,"num_write_kb":262144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"62'93","reported_seq":147,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.024674+0000","last_change":"2024-05-28T06:12:31.798684+0000","last_active":"2024-05-28T06:14:31.024674+0000","last_peered":"2024-05-28T06:14:31.024674+0000","last_clean":"2024-05-28T06:14:31.024674+0000","last_became_active":"2024-05-28T06:12:31.798292+0000","last_became_peered":"2024-05-28T06:12:31.798292+0000","last_unstale":"2024-05-28T06:14:31.024674+0000","last_undegraded":"2024-05-28T06:14:31.024674+0000","last_fullsized":"2024-05-28T06:14:31.024674+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:52:20.582079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":42,"num_read_kb":172032,"num_write":67,"num_write_kb":266241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"62'112","reported_seq":218,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.035156+0000","last_change":"2024-05-28T06:12:31.805307+0000","last_active":"2024-05-28T06:14:31.035156+0000","last_peered":"2024-05-28T06:14:31.035156+0000","last_clean":"2024-05-28T06:14:31.035156+0000","last_became_active":"2024-05-28T06:12:31.805031+0000","last_became_peered":"2024-05-28T06:12:31.805031+0000","last_unstale":"2024-05-28T06:14:31.035156+0000","last_undegraded":"2024-05-28T06:14:31.035156+0000","last_fullsized":"2024-05-28T06:14:31.035156+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:54:23.878943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544581,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":94,"num_read_kb":372739,"num_write":85,"num_write_kb":327683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"62'114","reported_seq":193,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.043535+0000","last_change":"2024-05-28T06:12:31.792875+0000","last_active":"2024-05-28T06:14:31.043535+0000","last_peered":"2024-05-28T06:14:31.043535+0000","last_clean":"2024-05-28T06:14:31.043535+0000","last_became_active":"2024-05-28T06:12:31.792620+0000","last_became_peered":"2024-05-28T06:12:31.792620+0000","last_unstale":"2024-05-28T06:14:31.043535+0000","last_undegraded":"2024-05-28T06:14:31.043535+0000","last_fullsized":"2024-05-28T06:14:31.043535+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:22:45.579115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369098752,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":67,"num_read_kb":274432,"num_write":90,"num_write_kb":360449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"62'99","reported_seq":173,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.044108+0000","last_change":"2024-05-28T06:12:31.790299+0000","last_active":"2024-05-28T06:14:31.044108+0000","last_peered":"2024-05-28T06:14:31.044108+0000","last_clean":"2024-05-28T06:14:31.044108+0000","last_became_active":"2024-05-28T06:12:31.790044+0000","last_became_peered":"2024-05-28T06:12:31.790044+0000","last_unstale":"2024-05-28T06:14:31.044108+0000","last_undegraded":"2024-05-28T06:14:31.044108+0000","last_fullsized":"2024-05-28T06:14:31.044108+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:33:57.828699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":62,"num_read_kb":253952,"num_write":71,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"62'108","reported_seq":215,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.014539+0000","last_change":"2024-05-28T06:12:31.799285+0000","last_active":"2024-05-28T06:14:31.014539+0000","last_peered":"2024-05-28T06:14:31.014539+0000","last_clean":"2024-05-28T06:14:31.014539+0000","last_became_active":"2024-05-28T06:12:31.798652+0000","last_became_peered":"2024-05-28T06:12:31.798652+0000","last_unstale":"2024-05-28T06:14:31.014539+0000","last_undegraded":"2024-05-28T06:14:31.014539+0000","last_fullsized":"2024-05-28T06:14:31.014539+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:27:01.826955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327155712,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":95,"num_read_kb":376835,"num_write":82,"num_write_kb":319490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"62'106","reported_seq":179,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.043218+0000","last_change":"2024-05-28T06:12:31.802895+0000","last_active":"2024-05-28T06:14:31.043218+0000","last_peered":"2024-05-28T06:14:31.043218+0000","last_clean":"2024-05-28T06:14:31.043218+0000","last_became_active":"2024-05-28T06:12:31.795520+0000","last_became_peered":"2024-05-28T06:12:31.795520+0000","last_unstale":"2024-05-28T06:14:31.043218+0000","last_undegraded":"2024-05-28T06:14:31.043218+0000","last_fullsized":"2024-05-28T06:14:31.043218+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:06:30.752272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":61,"num_read_kb":241666,"num_write":77,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"62'102","reported_seq":171,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.015501+0000","last_change":"2024-05-28T06:12:31.806502+0000","last_active":"2024-05-28T06:14:31.015501+0000","last_peered":"2024-05-28T06:14:31.015501+0000","last_clean":"2024-05-28T06:14:31.015501+0000","last_became_active":"2024-05-28T06:12:31.805993+0000","last_became_peered":"2024-05-28T06:12:31.805993+0000","last_unstale":"2024-05-28T06:14:31.015501+0000","last_undegraded":"2024-05-28T06:14:31.015501+0000","last_fullsized":"2024-05-28T06:14:31.015501+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:43:33.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":348127232,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":57,"num_read_kb":233472,"num_write":83,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"62'101","reported_seq":169,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.026873+0000","last_change":"2024-05-28T06:12:31.801483+0000","last_active":"2024-05-28T06:14:31.026873+0000","last_peered":"2024-05-28T06:14:31.026873+0000","last_clean":"2024-05-28T06:14:31.026873+0000","last_became_active":"2024-05-28T06:12:31.801026+0000","last_became_peered":"2024-05-28T06:12:31.801026+0000","last_unstale":"2024-05-28T06:14:31.026873+0000","last_undegraded":"2024-05-28T06:14:31.026873+0000","last_fullsized":"2024-05-28T06:14:31.026873+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:09:57.797411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":56,"num_read_kb":229376,"num_write":79,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"62'104","reported_seq":184,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.032937+0000","last_change":"2024-05-28T06:12:31.798043+0000","last_active":"2024-05-28T06:14:31.032937+0000","last_peered":"2024-05-28T06:14:31.032937+0000","last_clean":"2024-05-28T06:14:31.032937+0000","last_became_active":"2024-05-28T06:12:31.794016+0000","last_became_peered":"2024-05-28T06:12:31.794016+0000","last_unstale":"2024-05-28T06:14:31.032937+0000","last_undegraded":"2024-05-28T06:14:31.032937+0000","last_fullsized":"2024-05-28T06:14:31.032937+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:35:46.267952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":68,"num_read_kb":266243,"num_write":79,"num_write_kb":307202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"62'100","reported_seq":178,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.017532+0000","last_change":"2024-05-28T06:12:31.788822+0000","last_active":"2024-05-28T06:14:31.017532+0000","last_peered":"2024-05-28T06:14:31.017532+0000","last_clean":"2024-05-28T06:14:31.017532+0000","last_became_active":"2024-05-28T06:12:31.788550+0000","last_became_peered":"2024-05-28T06:12:31.788550+0000","last_unstale":"2024-05-28T06:14:31.017532+0000","last_undegraded":"2024-05-28T06:14:31.017532+0000","last_fullsized":"2024-05-28T06:14:31.017532+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:55:16.457872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":66,"num_read_kb":270336,"num_write":65,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"62'105","reported_seq":183,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.038306+0000","last_change":"2024-05-28T06:12:31.793103+0000","last_active":"2024-05-28T06:14:31.038306+0000","last_peered":"2024-05-28T06:14:31.038306+0000","last_clean":"2024-05-28T06:14:31.038306+0000","last_became_active":"2024-05-28T06:12:31.792595+0000","last_became_peered":"2024-05-28T06:12:31.792595+0000","last_unstale":"2024-05-28T06:14:31.038306+0000","last_undegraded":"2024-05-28T06:14:31.038306+0000","last_fullsized":"2024-05-28T06:14:31.038306+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:30:32.490570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343932928,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":66,"num_read_kb":270336,"num_write":82,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"62'99","reported_seq":145,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.033342+0000","last_change":"2024-05-28T06:12:31.800295+0000","last_active":"2024-05-28T06:14:31.033342+0000","last_peered":"2024-05-28T06:14:31.033342+0000","last_clean":"2024-05-28T06:14:31.033342+0000","last_became_active":"2024-05-28T06:12:31.800042+0000","last_became_peered":"2024-05-28T06:12:31.800042+0000","last_unstale":"2024-05-28T06:14:31.033342+0000","last_undegraded":"2024-05-28T06:14:31.033342+0000","last_fullsized":"2024-05-28T06:14:31.033342+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:30:39.340469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327155712,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":34,"num_read_kb":131074,"num_write":82,"num_write_kb":319490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"62'108","reported_seq":191,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.028921+0000","last_change":"2024-05-28T06:12:31.798980+0000","last_active":"2024-05-28T06:14:31.028921+0000","last_peered":"2024-05-28T06:14:31.028921+0000","last_clean":"2024-05-28T06:14:31.028921+0000","last_became_active":"2024-05-28T06:12:31.798695+0000","last_became_peered":"2024-05-28T06:12:31.798695+0000","last_unstale":"2024-05-28T06:14:31.028921+0000","last_undegraded":"2024-05-28T06:14:31.028921+0000","last_fullsized":"2024-05-28T06:14:31.028921+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:40:22.486569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352321668,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":71,"num_read_kb":286721,"num_write":85,"num_write_kb":344065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"62'105","reported_seq":182,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.019760+0000","last_change":"2024-05-28T06:12:31.803916+0000","last_active":"2024-05-28T06:14:31.019760+0000","last_peered":"2024-05-28T06:14:31.019760+0000","last_clean":"2024-05-28T06:14:31.019760+0000","last_became_active":"2024-05-28T06:12:31.803396+0000","last_became_peered":"2024-05-28T06:12:31.803396+0000","last_unstale":"2024-05-28T06:14:31.019760+0000","last_undegraded":"2024-05-28T06:14:31.019760+0000","last_fullsized":"2024-05-28T06:14:31.019760+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:59:14.477995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322961408,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":65,"num_read_kb":266240,"num_write":77,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"62'102","reported_seq":208,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.037139+0000","last_change":"2024-05-28T06:12:31.797444+0000","last_active":"2024-05-28T06:14:31.037139+0000","last_peered":"2024-05-28T06:14:31.037139+0000","last_clean":"2024-05-28T06:14:31.037139+0000","last_became_active":"2024-05-28T06:12:31.797170+0000","last_became_peered":"2024-05-28T06:12:31.797170+0000","last_unstale":"2024-05-28T06:14:31.037139+0000","last_undegraded":"2024-05-28T06:14:31.037139+0000","last_fullsized":"2024-05-28T06:14:31.037139+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:48:34.278938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":94,"num_read_kb":385024,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"62'101","reported_seq":184,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.045800+0000","last_change":"2024-05-28T06:12:31.787961+0000","last_active":"2024-05-28T06:14:31.045800+0000","last_peered":"2024-05-28T06:14:31.045800+0000","last_clean":"2024-05-28T06:14:31.045800+0000","last_became_active":"2024-05-28T06:12:31.787700+0000","last_became_peered":"2024-05-28T06:12:31.787700+0000","last_unstale":"2024-05-28T06:14:31.045800+0000","last_undegraded":"2024-05-28T06:14:31.045800+0000","last_fullsized":"2024-05-28T06:14:31.045800+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:43:33.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":71,"num_read_kb":290816,"num_write":71,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"62'84","reported_seq":139,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.040030+0000","last_change":"2024-05-28T06:12:31.802935+0000","last_active":"2024-05-28T06:14:31.040030+0000","last_peered":"2024-05-28T06:14:31.040030+0000","last_clean":"2024-05-28T06:14:31.040030+0000","last_became_active":"2024-05-28T06:12:31.802678+0000","last_became_peered":"2024-05-28T06:12:31.802678+0000","last_unstale":"2024-05-28T06:14:31.040030+0000","last_undegraded":"2024-05-28T06:14:31.040030+0000","last_fullsized":"2024-05-28T06:14:31.040030+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:08:26.147408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":42,"num_read_kb":172032,"num_write":67,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.799783+0000","last_change":"2024-05-28T06:12:30.791032+0000","last_active":"2024-05-28T06:12:32.799783+0000","last_peered":"2024-05-28T06:12:32.799783+0000","last_clean":"2024-05-28T06:12:32.799783+0000","last_became_active":"2024-05-28T06:12:30.790720+0000","last_became_peered":"2024-05-28T06:12:30.790720+0000","last_unstale":"2024-05-28T06:12:32.799783+0000","last_undegraded":"2024-05-28T06:12:32.799783+0000","last_fullsized":"2024-05-28T06:12:32.799783+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:02:31.893460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"62'92","reported_seq":173,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.013388+0000","last_change":"2024-05-28T06:12:31.801501+0000","last_active":"2024-05-28T06:14:31.013388+0000","last_peered":"2024-05-28T06:14:31.013388+0000","last_clean":"2024-05-28T06:14:31.013388+0000","last_became_active":"2024-05-28T06:12:31.801239+0000","last_became_peered":"2024-05-28T06:12:31.801239+0000","last_unstale":"2024-05-28T06:14:31.013388+0000","last_undegraded":"2024-05-28T06:14:31.013388+0000","last_fullsized":"2024-05-28T06:14:31.013388+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:12:32.364138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301990149,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":69,"num_read_kb":278529,"num_write":75,"num_write_kb":294914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.780891+0000","last_change":"2024-05-28T06:12:30.799690+0000","last_active":"2024-05-28T06:12:32.780891+0000","last_peered":"2024-05-28T06:12:32.780891+0000","last_clean":"2024-05-28T06:12:32.780891+0000","last_became_active":"2024-05-28T06:12:30.799345+0000","last_became_peered":"2024-05-28T06:12:30.799345+0000","last_unstale":"2024-05-28T06:12:32.780891+0000","last_undegraded":"2024-05-28T06:12:32.780891+0000","last_fullsized":"2024-05-28T06:12:32.780891+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:53:56.132162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"62'92","reported_seq":178,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.040974+0000","last_change":"2024-05-28T06:12:31.787304+0000","last_active":"2024-05-28T06:14:31.040974+0000","last_peered":"2024-05-28T06:14:31.040974+0000","last_clean":"2024-05-28T06:14:31.040974+0000","last_became_active":"2024-05-28T06:12:31.786982+0000","last_became_peered":"2024-05-28T06:12:31.786982+0000","last_unstale":"2024-05-28T06:14:31.040974+0000","last_undegraded":"2024-05-28T06:14:31.040974+0000","last_fullsized":"2024-05-28T06:14:31.040974+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:30:34.090290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":74,"num_read_kb":286724,"num_write":73,"num_write_kb":282626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"62'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.799729+0000","last_change":"2024-05-28T06:12:30.784064+0000","last_active":"2024-05-28T06:12:32.799729+0000","last_peered":"2024-05-28T06:12:32.799729+0000","last_clean":"2024-05-28T06:12:32.799729+0000","last_became_active":"2024-05-28T06:12:30.783801+0000","last_became_peered":"2024-05-28T06:12:30.783801+0000","last_unstale":"2024-05-28T06:12:32.799729+0000","last_undegraded":"2024-05-28T06:12:32.799729+0000","last_fullsized":"2024-05-28T06:12:32.799729+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:21:00.162134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"62'119","reported_seq":217,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.039615+0000","last_change":"2024-05-28T06:12:31.799781+0000","last_active":"2024-05-28T06:14:31.039615+0000","last_peered":"2024-05-28T06:14:31.039615+0000","last_clean":"2024-05-28T06:14:31.039615+0000","last_became_active":"2024-05-28T06:12:31.799517+0000","last_became_peered":"2024-05-28T06:12:31.799517+0000","last_unstale":"2024-05-28T06:14:31.039615+0000","last_undegraded":"2024-05-28T06:14:31.039615+0000","last_fullsized":"2024-05-28T06:14:31.039615+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:53:57.139243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356515840,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":86,"num_read_kb":352256,"num_write":85,"num_write_kb":348160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.782540+0000","last_change":"2024-05-28T06:12:30.795765+0000","last_active":"2024-05-28T06:12:32.782540+0000","last_peered":"2024-05-28T06:12:32.782540+0000","last_clean":"2024-05-28T06:12:32.782540+0000","last_became_active":"2024-05-28T06:12:30.795164+0000","last_became_peered":"2024-05-28T06:12:30.795164+0000","last_unstale":"2024-05-28T06:12:32.782540+0000","last_undegraded":"2024-05-28T06:12:32.782540+0000","last_fullsized":"2024-05-28T06:12:32.782540+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:20:40.469531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"62'96","reported_seq":165,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.043022+0000","last_change":"2024-05-28T06:12:31.801832+0000","last_active":"2024-05-28T06:14:31.043022+0000","last_peered":"2024-05-28T06:14:31.043022+0000","last_clean":"2024-05-28T06:14:31.043022+0000","last_became_active":"2024-05-28T06:12:31.795154+0000","last_became_peered":"2024-05-28T06:12:31.795154+0000","last_unstale":"2024-05-28T06:14:31.043022+0000","last_undegraded":"2024-05-28T06:14:31.043022+0000","last_fullsized":"2024-05-28T06:14:31.043022+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:49:40.536846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":57,"num_read_kb":233472,"num_write":74,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.560759+0000","last_change":"2024-05-28T06:12:30.793046+0000","last_active":"2024-05-28T06:12:33.560759+0000","last_peered":"2024-05-28T06:12:33.560759+0000","last_clean":"2024-05-28T06:12:33.560759+0000","last_became_active":"2024-05-28T06:12:30.792752+0000","last_became_peered":"2024-05-28T06:12:30.792752+0000","last_unstale":"2024-05-28T06:12:33.560759+0000","last_undegraded":"2024-05-28T06:12:33.560759+0000","last_fullsized":"2024-05-28T06:12:33.560759+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:03:08.736169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"62'101","reported_seq":207,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.044223+0000","last_change":"2024-05-28T06:12:31.789865+0000","last_active":"2024-05-28T06:14:31.044223+0000","last_peered":"2024-05-28T06:14:31.044223+0000","last_clean":"2024-05-28T06:14:31.044223+0000","last_became_active":"2024-05-28T06:12:31.789614+0000","last_became_peered":"2024-05-28T06:12:31.789614+0000","last_unstale":"2024-05-28T06:14:31.044223+0000","last_undegraded":"2024-05-28T06:14:31.044223+0000","last_fullsized":"2024-05-28T06:14:31.044223+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:06:00.739339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":94,"num_read_kb":385024,"num_write":75,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.798994+0000","last_change":"2024-05-28T06:12:30.790331+0000","last_active":"2024-05-28T06:12:32.798994+0000","last_peered":"2024-05-28T06:12:32.798994+0000","last_clean":"2024-05-28T06:12:32.798994+0000","last_became_active":"2024-05-28T06:12:30.790028+0000","last_became_peered":"2024-05-28T06:12:30.790028+0000","last_unstale":"2024-05-28T06:12:32.798994+0000","last_undegraded":"2024-05-28T06:12:32.798994+0000","last_fullsized":"2024-05-28T06:12:32.798994+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:01:52.086398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"62'99","reported_seq":185,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.012869+0000","last_change":"2024-05-28T06:12:31.798571+0000","last_active":"2024-05-28T06:14:31.012869+0000","last_peered":"2024-05-28T06:14:31.012869+0000","last_clean":"2024-05-28T06:14:31.012869+0000","last_became_active":"2024-05-28T06:12:31.797004+0000","last_became_peered":"2024-05-28T06:12:31.797004+0000","last_unstale":"2024-05-28T06:14:31.012869+0000","last_undegraded":"2024-05-28T06:14:31.012869+0000","last_fullsized":"2024-05-28T06:14:31.012869+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:21:06.719589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":74,"num_read_kb":294914,"num_write":77,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.781942+0000","last_change":"2024-05-28T06:12:30.792493+0000","last_active":"2024-05-28T06:12:32.781942+0000","last_peered":"2024-05-28T06:12:32.781942+0000","last_clean":"2024-05-28T06:12:32.781942+0000","last_became_active":"2024-05-28T06:12:30.791832+0000","last_became_peered":"2024-05-28T06:12:30.791832+0000","last_unstale":"2024-05-28T06:12:32.781942+0000","last_undegraded":"2024-05-28T06:12:32.781942+0000","last_fullsized":"2024-05-28T06:12:32.781942+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:02:31.893460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"62'103","reported_seq":179,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.026352+0000","last_change":"2024-05-28T06:12:31.804063+0000","last_active":"2024-05-28T06:14:31.026352+0000","last_peered":"2024-05-28T06:14:31.026352+0000","last_clean":"2024-05-28T06:14:31.026352+0000","last_became_active":"2024-05-28T06:12:31.803791+0000","last_became_peered":"2024-05-28T06:12:31.803791+0000","last_unstale":"2024-05-28T06:14:31.026352+0000","last_undegraded":"2024-05-28T06:14:31.026352+0000","last_fullsized":"2024-05-28T06:14:31.026352+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:05:13.800609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":64,"num_read_kb":253954,"num_write":76,"num_write_kb":303105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.560668+0000","last_change":"2024-05-28T06:12:30.792385+0000","last_active":"2024-05-28T06:12:33.560668+0000","last_peered":"2024-05-28T06:12:33.560668+0000","last_clean":"2024-05-28T06:12:33.560668+0000","last_became_active":"2024-05-28T06:12:30.789854+0000","last_became_peered":"2024-05-28T06:12:30.789854+0000","last_unstale":"2024-05-28T06:12:33.560668+0000","last_undegraded":"2024-05-28T06:12:33.560668+0000","last_fullsized":"2024-05-28T06:12:33.560668+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:52:08.811888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"62'92","reported_seq":140,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.030922+0000","last_change":"2024-05-28T06:12:31.791507+0000","last_active":"2024-05-28T06:14:31.030922+0000","last_peered":"2024-05-28T06:14:31.030922+0000","last_clean":"2024-05-28T06:14:31.030922+0000","last_became_active":"2024-05-28T06:12:31.788910+0000","last_became_peered":"2024-05-28T06:12:31.788910+0000","last_unstale":"2024-05-28T06:14:31.030922+0000","last_undegraded":"2024-05-28T06:14:31.030922+0000","last_fullsized":"2024-05-28T06:14:31.030922+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:33:08.387840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":36,"num_read_kb":147456,"num_write":64,"num_write_kb":262144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"62'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.561581+0000","last_change":"2024-05-28T06:12:30.796608+0000","last_active":"2024-05-28T06:12:33.561581+0000","last_peered":"2024-05-28T06:12:33.561581+0000","last_clean":"2024-05-28T06:12:33.561581+0000","last_became_active":"2024-05-28T06:12:30.796011+0000","last_became_peered":"2024-05-28T06:12:30.796011+0000","last_unstale":"2024-05-28T06:12:33.561581+0000","last_undegraded":"2024-05-28T06:12:33.561581+0000","last_fullsized":"2024-05-28T06:12:33.561581+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:03:08.736169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"62'90","reported_seq":142,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.026689+0000","last_change":"2024-05-28T06:12:31.807786+0000","last_active":"2024-05-28T06:14:31.026689+0000","last_peered":"2024-05-28T06:14:31.026689+0000","last_clean":"2024-05-28T06:14:31.026689+0000","last_became_active":"2024-05-28T06:12:31.807524+0000","last_became_peered":"2024-05-28T06:12:31.807524+0000","last_unstale":"2024-05-28T06:14:31.026689+0000","last_undegraded":"2024-05-28T06:14:31.026689+0000","last_fullsized":"2024-05-28T06:14:31.026689+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:53:57.139243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":40,"num_read_kb":163840,"num_write":71,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.780950+0000","last_change":"2024-05-28T06:12:30.798374+0000","last_active":"2024-05-28T06:12:32.780950+0000","last_peered":"2024-05-28T06:12:32.780950+0000","last_clean":"2024-05-28T06:12:32.780950+0000","last_became_active":"2024-05-28T06:12:30.798033+0000","last_became_peered":"2024-05-28T06:12:30.798033+0000","last_unstale":"2024-05-28T06:12:32.780950+0000","last_undegraded":"2024-05-28T06:12:32.780950+0000","last_fullsized":"2024-05-28T06:12:32.780950+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:30:33.083208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"62'92","reported_seq":185,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.032225+0000","last_change":"2024-05-28T06:12:31.791600+0000","last_active":"2024-05-28T06:14:31.032225+0000","last_peered":"2024-05-28T06:14:31.032225+0000","last_clean":"2024-05-28T06:14:31.032225+0000","last_became_active":"2024-05-28T06:12:31.789590+0000","last_became_peered":"2024-05-28T06:12:31.789590+0000","last_unstale":"2024-05-28T06:14:31.032225+0000","last_undegraded":"2024-05-28T06:14:31.032225+0000","last_fullsized":"2024-05-28T06:14:31.032225+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:21:06.719589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":81,"num_read_kb":331776,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"62'24","reported_seq":38,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:39.929351+0000","last_change":"2024-05-28T06:12:30.794636+0000","last_active":"2024-05-28T06:13:39.929351+0000","last_peered":"2024-05-28T06:13:39.929351+0000","last_clean":"2024-05-28T06:13:39.929351+0000","last_became_active":"2024-05-28T06:12:30.794322+0000","last_became_peered":"2024-05-28T06:12:30.794322+0000","last_unstale":"2024-05-28T06:13:39.929351+0000","last_undegraded":"2024-05-28T06:13:39.929351+0000","last_fullsized":"2024-05-28T06:13:39.929351+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:21:00.162134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"62'89","reported_seq":162,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.029040+0000","last_change":"2024-05-28T06:12:31.806694+0000","last_active":"2024-05-28T06:14:31.029040+0000","last_peered":"2024-05-28T06:14:31.029040+0000","last_clean":"2024-05-28T06:14:31.029040+0000","last_became_active":"2024-05-28T06:12:31.806339+0000","last_became_peered":"2024-05-28T06:12:31.806339+0000","last_unstale":"2024-05-28T06:14:31.029040+0000","last_undegraded":"2024-05-28T06:14:31.029040+0000","last_fullsized":"2024-05-28T06:14:31.029040+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:30:32.490570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":61,"num_read_kb":245761,"num_write":67,"num_write_kb":266241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"62'430","reported_seq":444,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:30.984262+0000","last_change":"2024-05-28T06:12:30.791461+0000","last_active":"2024-05-28T06:14:30.984262+0000","last_peered":"2024-05-28T06:14:30.984262+0000","last_clean":"2024-05-28T06:14:30.984262+0000","last_became_active":"2024-05-28T06:12:30.791190+0000","last_became_peered":"2024-05-28T06:12:30.791190+0000","last_unstale":"2024-05-28T06:14:30.984262+0000","last_undegraded":"2024-05-28T06:14:30.984262+0000","last_fullsized":"2024-05-28T06:14:30.984262+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:01:52.086398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1666861,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":1789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"62'97","reported_seq":158,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.034335+0000","last_change":"2024-05-28T06:12:31.796224+0000","last_active":"2024-05-28T06:14:31.034335+0000","last_peered":"2024-05-28T06:14:31.034335+0000","last_clean":"2024-05-28T06:14:31.034335+0000","last_became_active":"2024-05-28T06:12:31.794242+0000","last_became_peered":"2024-05-28T06:12:31.794242+0000","last_unstale":"2024-05-28T06:14:31.034335+0000","last_undegraded":"2024-05-28T06:14:31.034335+0000","last_fullsized":"2024-05-28T06:14:31.034335+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:21:56.535399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":49,"num_read_kb":200704,"num_write":75,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.780490+0000","last_change":"2024-05-28T06:12:30.794765+0000","last_active":"2024-05-28T06:12:32.780490+0000","last_peered":"2024-05-28T06:12:32.780490+0000","last_clean":"2024-05-28T06:12:32.780490+0000","last_became_active":"2024-05-28T06:12:30.794488+0000","last_became_peered":"2024-05-28T06:12:30.794488+0000","last_unstale":"2024-05-28T06:12:32.780490+0000","last_undegraded":"2024-05-28T06:12:32.780490+0000","last_fullsized":"2024-05-28T06:12:32.780490+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:30:31.483489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"62'119","reported_seq":184,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.020099+0000","last_change":"2024-05-28T06:12:31.803083+0000","last_active":"2024-05-28T06:14:31.020099+0000","last_peered":"2024-05-28T06:14:31.020099+0000","last_clean":"2024-05-28T06:14:31.020099+0000","last_became_active":"2024-05-28T06:12:31.802789+0000","last_became_peered":"2024-05-28T06:12:31.802789+0000","last_unstale":"2024-05-28T06:14:31.020099+0000","last_undegraded":"2024-05-28T06:14:31.020099+0000","last_fullsized":"2024-05-28T06:14:31.020099+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:24:28.859928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369098752,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":53,"num_read_kb":212993,"num_write":92,"num_write_kb":360450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.800554+0000","last_change":"2024-05-28T06:12:30.795959+0000","last_active":"2024-05-28T06:12:32.800554+0000","last_peered":"2024-05-28T06:12:32.800554+0000","last_clean":"2024-05-28T06:12:32.800554+0000","last_became_active":"2024-05-28T06:12:30.795666+0000","last_became_peered":"2024-05-28T06:12:30.795666+0000","last_unstale":"2024-05-28T06:12:32.800554+0000","last_undegraded":"2024-05-28T06:12:32.800554+0000","last_fullsized":"2024-05-28T06:12:32.800554+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:52:42.932309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"62'85","reported_seq":155,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.021237+0000","last_change":"2024-05-28T06:12:31.795558+0000","last_active":"2024-05-28T06:14:31.021237+0000","last_peered":"2024-05-28T06:14:31.021237+0000","last_clean":"2024-05-28T06:14:31.021237+0000","last_became_active":"2024-05-28T06:12:31.795281+0000","last_became_peered":"2024-05-28T06:12:31.795281+0000","last_unstale":"2024-05-28T06:14:31.021237+0000","last_undegraded":"2024-05-28T06:14:31.021237+0000","last_fullsized":"2024-05-28T06:14:31.021237+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:54:31.487426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":58,"num_read_kb":237568,"num_write":63,"num_write_kb":258048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.782127+0000","last_change":"2024-05-28T06:12:30.792703+0000","last_active":"2024-05-28T06:12:32.782127+0000","last_peered":"2024-05-28T06:12:32.782127+0000","last_clean":"2024-05-28T06:12:32.782127+0000","last_became_active":"2024-05-28T06:12:30.792218+0000","last_became_peered":"2024-05-28T06:12:30.792218+0000","last_unstale":"2024-05-28T06:12:32.782127+0000","last_undegraded":"2024-05-28T06:12:32.782127+0000","last_fullsized":"2024-05-28T06:12:32.782127+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:14:39.566092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"62'114","reported_seq":195,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.025905+0000","last_change":"2024-05-28T06:12:31.806242+0000","last_active":"2024-05-28T06:14:31.025905+0000","last_peered":"2024-05-28T06:14:31.025905+0000","last_clean":"2024-05-28T06:14:31.025905+0000","last_became_active":"2024-05-28T06:12:31.805628+0000","last_became_peered":"2024-05-28T06:12:31.805628+0000","last_unstale":"2024-05-28T06:14:31.025905+0000","last_undegraded":"2024-05-28T06:14:31.025905+0000","last_fullsized":"2024-05-28T06:14:31.025905+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:21:56.535399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394264837,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":69,"num_read_kb":282624,"num_write":95,"num_write_kb":385025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.560455+0000","last_change":"2024-05-28T06:12:30.797372+0000","last_active":"2024-05-28T06:12:33.560455+0000","last_peered":"2024-05-28T06:12:33.560455+0000","last_clean":"2024-05-28T06:12:33.560455+0000","last_became_active":"2024-05-28T06:12:30.797105+0000","last_became_peered":"2024-05-28T06:12:30.797105+0000","last_unstale":"2024-05-28T06:12:33.560455+0000","last_undegraded":"2024-05-28T06:12:33.560455+0000","last_fullsized":"2024-05-28T06:12:33.560455+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:01:52.086398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"62'88","reported_seq":125,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.022994+0000","last_change":"2024-05-28T06:12:31.802256+0000","last_active":"2024-05-28T06:14:31.022994+0000","last_peered":"2024-05-28T06:14:31.022994+0000","last_clean":"2024-05-28T06:14:31.022994+0000","last_became_active":"2024-05-28T06:12:31.800610+0000","last_became_peered":"2024-05-28T06:12:31.800610+0000","last_unstale":"2024-05-28T06:14:31.022994+0000","last_undegraded":"2024-05-28T06:14:31.022994+0000","last_fullsized":"2024-05-28T06:14:31.022994+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:22:44.741189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":25,"num_read_kb":102400,"num_write":67,"num_write_kb":266241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.781051+0000","last_change":"2024-05-28T06:12:30.797106+0000","last_active":"2024-05-28T06:12:32.781051+0000","last_peered":"2024-05-28T06:12:32.781051+0000","last_clean":"2024-05-28T06:12:32.781051+0000","last_became_active":"2024-05-28T06:12:30.795350+0000","last_became_peered":"2024-05-28T06:12:30.795350+0000","last_unstale":"2024-05-28T06:12:32.781051+0000","last_undegraded":"2024-05-28T06:12:32.781051+0000","last_fullsized":"2024-05-28T06:12:32.781051+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:24:27.852847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"62'110","reported_seq":203,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.029231+0000","last_change":"2024-05-28T06:12:31.794618+0000","last_active":"2024-05-28T06:14:31.029231+0000","last_peered":"2024-05-28T06:14:31.029231+0000","last_clean":"2024-05-28T06:14:31.029231+0000","last_became_active":"2024-05-28T06:12:31.794358+0000","last_became_peered":"2024-05-28T06:12:31.794358+0000","last_unstale":"2024-05-28T06:14:31.029231+0000","last_undegraded":"2024-05-28T06:14:31.029231+0000","last_fullsized":"2024-05-28T06:14:31.029231+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:30:32.490570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356515972,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":81,"num_read_kb":327681,"num_write":86,"num_write_kb":348161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.799366+0000","last_change":"2024-05-28T06:12:30.793010+0000","last_active":"2024-05-28T06:12:32.799366+0000","last_peered":"2024-05-28T06:12:32.799366+0000","last_clean":"2024-05-28T06:12:32.799366+0000","last_became_active":"2024-05-28T06:12:30.792705+0000","last_became_peered":"2024-05-28T06:12:30.792705+0000","last_unstale":"2024-05-28T06:12:32.799366+0000","last_undegraded":"2024-05-28T06:12:32.799366+0000","last_fullsized":"2024-05-28T06:12:32.799366+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:37:55.600898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"62'89","reported_seq":162,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.014830+0000","last_change":"2024-05-28T06:12:31.790772+0000","last_active":"2024-05-28T06:14:31.014830+0000","last_peered":"2024-05-28T06:14:31.014830+0000","last_clean":"2024-05-28T06:14:31.014830+0000","last_became_active":"2024-05-28T06:12:31.790509+0000","last_became_peered":"2024-05-28T06:12:31.790509+0000","last_unstale":"2024-05-28T06:14:31.014830+0000","last_undegraded":"2024-05-28T06:14:31.014830+0000","last_fullsized":"2024-05-28T06:14:31.014830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:25:51.424031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658501,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":61,"num_read_kb":233476,"num_write":65,"num_write_kb":245763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.782296+0000","last_change":"2024-05-28T06:12:30.797084+0000","last_active":"2024-05-28T06:12:32.782296+0000","last_peered":"2024-05-28T06:12:32.782296+0000","last_clean":"2024-05-28T06:12:32.782296+0000","last_became_active":"2024-05-28T06:12:30.795903+0000","last_became_peered":"2024-05-28T06:12:30.795903+0000","last_unstale":"2024-05-28T06:12:32.782296+0000","last_undegraded":"2024-05-28T06:12:32.782296+0000","last_fullsized":"2024-05-28T06:12:32.782296+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:54:30.480345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"62'90","reported_seq":181,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.029164+0000","last_change":"2024-05-28T06:12:31.809139+0000","last_active":"2024-05-28T06:14:31.029164+0000","last_peered":"2024-05-28T06:14:31.029164+0000","last_clean":"2024-05-28T06:14:31.029164+0000","last_became_active":"2024-05-28T06:12:31.807373+0000","last_became_peered":"2024-05-28T06:12:31.807373+0000","last_unstale":"2024-05-28T06:14:31.029164+0000","last_undegraded":"2024-05-28T06:14:31.029164+0000","last_fullsized":"2024-05-28T06:14:31.029164+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:30:34.090290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":79,"num_read_kb":323584,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.799295+0000","last_change":"2024-05-28T06:12:30.793875+0000","last_active":"2024-05-28T06:12:32.799295+0000","last_peered":"2024-05-28T06:12:32.799295+0000","last_clean":"2024-05-28T06:12:32.799295+0000","last_became_active":"2024-05-28T06:12:30.793587+0000","last_became_peered":"2024-05-28T06:12:30.793587+0000","last_unstale":"2024-05-28T06:12:32.799295+0000","last_undegraded":"2024-05-28T06:12:32.799295+0000","last_fullsized":"2024-05-28T06:12:32.799295+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:03:08.736169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"62'115","reported_seq":207,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.034628+0000","last_change":"2024-05-28T06:12:31.794925+0000","last_active":"2024-05-28T06:14:31.034628+0000","last_peered":"2024-05-28T06:14:31.034628+0000","last_clean":"2024-05-28T06:14:31.034628+0000","last_became_active":"2024-05-28T06:12:31.793880+0000","last_became_peered":"2024-05-28T06:12:31.793880+0000","last_unstale":"2024-05-28T06:14:31.034628+0000","last_undegraded":"2024-05-28T06:14:31.034628+0000","last_fullsized":"2024-05-28T06:14:31.034628+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:24:28.859928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406847488,"num_objects":97,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":80,"num_read_kb":327680,"num_write":97,"num_write_kb":397312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"62'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.780684+0000","last_change":"2024-05-28T06:12:30.794189+0000","last_active":"2024-05-28T06:12:32.780684+0000","last_peered":"2024-05-28T06:12:32.780684+0000","last_clean":"2024-05-28T06:12:32.780684+0000","last_became_active":"2024-05-28T06:12:30.793922+0000","last_became_peered":"2024-05-28T06:12:30.793922+0000","last_unstale":"2024-05-28T06:12:32.780684+0000","last_undegraded":"2024-05-28T06:12:32.780684+0000","last_fullsized":"2024-05-28T06:12:32.780684+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:08:25.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"62'104","reported_seq":182,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.040664+0000","last_change":"2024-05-28T06:12:31.797123+0000","last_active":"2024-05-28T06:14:31.040664+0000","last_peered":"2024-05-28T06:14:31.040664+0000","last_clean":"2024-05-28T06:14:31.040664+0000","last_became_active":"2024-05-28T06:12:31.796849+0000","last_became_peered":"2024-05-28T06:12:31.796849+0000","last_unstale":"2024-05-28T06:14:31.040664+0000","last_undegraded":"2024-05-28T06:14:31.040664+0000","last_fullsized":"2024-05-28T06:14:31.040664+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:55:16.457872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":66,"num_read_kb":249861,"num_write":79,"num_write_kb":307202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.561764+0000","last_change":"2024-05-28T06:12:30.796022+0000","last_active":"2024-05-28T06:12:33.561764+0000","last_peered":"2024-05-28T06:12:33.561764+0000","last_clean":"2024-05-28T06:12:33.561764+0000","last_became_active":"2024-05-28T06:12:30.794505+0000","last_became_peered":"2024-05-28T06:12:30.794505+0000","last_unstale":"2024-05-28T06:12:33.561764+0000","last_undegraded":"2024-05-28T06:12:33.561764+0000","last_fullsized":"2024-05-28T06:12:33.561764+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:32:08.488200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"62'92","reported_seq":162,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.039762+0000","last_change":"2024-05-28T06:12:31.802246+0000","last_active":"2024-05-28T06:14:31.039762+0000","last_peered":"2024-05-28T06:14:31.039762+0000","last_clean":"2024-05-28T06:14:31.039762+0000","last_became_active":"2024-05-28T06:12:31.801961+0000","last_became_peered":"2024-05-28T06:12:31.801961+0000","last_unstale":"2024-05-28T06:14:31.039762+0000","last_undegraded":"2024-05-28T06:14:31.039762+0000","last_fullsized":"2024-05-28T06:14:31.039762+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:21:56.535399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":58,"num_read_kb":237568,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.781996+0000","last_change":"2024-05-28T06:12:30.790810+0000","last_active":"2024-05-28T06:12:32.781996+0000","last_peered":"2024-05-28T06:12:32.781996+0000","last_clean":"2024-05-28T06:12:32.781996+0000","last_became_active":"2024-05-28T06:12:30.790513+0000","last_became_peered":"2024-05-28T06:12:30.790513+0000","last_unstale":"2024-05-28T06:12:32.781996+0000","last_undegraded":"2024-05-28T06:12:32.781996+0000","last_fullsized":"2024-05-28T06:12:32.781996+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:31:14.976810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"62'104","reported_seq":154,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.032223+0000","last_change":"2024-05-28T06:12:31.804263+0000","last_active":"2024-05-28T06:14:31.032223+0000","last_peered":"2024-05-28T06:14:31.032223+0000","last_clean":"2024-05-28T06:14:31.032223+0000","last_became_active":"2024-05-28T06:12:31.803936+0000","last_became_peered":"2024-05-28T06:12:31.803936+0000","last_unstale":"2024-05-28T06:14:31.032223+0000","last_undegraded":"2024-05-28T06:14:31.032223+0000","last_fullsized":"2024-05-28T06:14:31.032223+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:30:34.090290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":38,"num_read_kb":155648,"num_write":80,"num_write_kb":327680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.562377+0000","last_change":"2024-05-28T06:12:30.798073+0000","last_active":"2024-05-28T06:12:33.562377+0000","last_peered":"2024-05-28T06:12:33.562377+0000","last_clean":"2024-05-28T06:12:33.562377+0000","last_became_active":"2024-05-28T06:12:30.797794+0000","last_became_peered":"2024-05-28T06:12:30.797794+0000","last_unstale":"2024-05-28T06:12:33.562377+0000","last_undegraded":"2024-05-28T06:12:33.562377+0000","last_fullsized":"2024-05-28T06:12:33.562377+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:05:17.937721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"62'105","reported_seq":197,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.007517+0000","last_change":"2024-05-28T06:12:31.800014+0000","last_active":"2024-05-28T06:14:31.007517+0000","last_peered":"2024-05-28T06:14:31.007517+0000","last_clean":"2024-05-28T06:14:31.007517+0000","last_became_active":"2024-05-28T06:12:31.799714+0000","last_became_peered":"2024-05-28T06:12:31.799714+0000","last_unstale":"2024-05-28T06:14:31.007517+0000","last_undegraded":"2024-05-28T06:14:31.007517+0000","last_fullsized":"2024-05-28T06:14:31.007517+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:54:23.878943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360710144,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":80,"num_read_kb":327680,"num_write":86,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"62'40","reported_seq":54,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:43.843635+0000","last_change":"2024-05-28T06:12:30.790726+0000","last_active":"2024-05-28T06:13:43.843635+0000","last_peered":"2024-05-28T06:13:43.843635+0000","last_clean":"2024-05-28T06:13:43.843635+0000","last_became_active":"2024-05-28T06:12:30.790486+0000","last_became_peered":"2024-05-28T06:12:30.790486+0000","last_unstale":"2024-05-28T06:13:43.843635+0000","last_undegraded":"2024-05-28T06:13:43.843635+0000","last_fullsized":"2024-05-28T06:13:43.843635+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:31:14.976810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"62'103","reported_seq":210,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.031897+0000","last_change":"2024-05-28T06:12:31.791575+0000","last_active":"2024-05-28T06:14:31.031897+0000","last_peered":"2024-05-28T06:14:31.031897+0000","last_clean":"2024-05-28T06:14:31.031897+0000","last_became_active":"2024-05-28T06:12:31.789316+0000","last_became_peered":"2024-05-28T06:12:31.789316+0000","last_unstale":"2024-05-28T06:14:31.031897+0000","last_undegraded":"2024-05-28T06:14:31.031897+0000","last_fullsized":"2024-05-28T06:14:31.031897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:56:28.051898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339738624,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":95,"num_read_kb":385025,"num_write":83,"num_write_kb":331777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.800751+0000","last_change":"2024-05-28T06:12:30.791618+0000","last_active":"2024-05-28T06:12:32.800751+0000","last_peered":"2024-05-28T06:12:32.800751+0000","last_clean":"2024-05-28T06:12:32.800751+0000","last_became_active":"2024-05-28T06:12:30.791296+0000","last_became_peered":"2024-05-28T06:12:30.791296+0000","last_unstale":"2024-05-28T06:12:32.800751+0000","last_undegraded":"2024-05-28T06:12:32.800751+0000","last_fullsized":"2024-05-28T06:12:32.800751+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:32:08.488200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"62'107","reported_seq":167,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.039139+0000","last_change":"2024-05-28T06:12:31.799676+0000","last_active":"2024-05-28T06:14:31.039139+0000","last_peered":"2024-05-28T06:14:31.039139+0000","last_clean":"2024-05-28T06:14:31.039139+0000","last_became_active":"2024-05-28T06:12:31.799396+0000","last_became_peered":"2024-05-28T06:12:31.799396+0000","last_unstale":"2024-05-28T06:14:31.039139+0000","last_undegraded":"2024-05-28T06:14:31.039139+0000","last_fullsized":"2024-05-28T06:14:31.039139+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T17:54:23.878943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356516084,"num_objects":88,"num_object_clones":1,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":1,"num_read":49,"num_read_kb":200704,"num_write":88,"num_write_kb":348162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.782544+0000","last_change":"2024-05-28T06:12:30.790898+0000","last_active":"2024-05-28T06:12:32.782544+0000","last_peered":"2024-05-28T06:12:32.782544+0000","last_clean":"2024-05-28T06:12:32.782544+0000","last_became_active":"2024-05-28T06:12:30.790609+0000","last_became_peered":"2024-05-28T06:12:30.790609+0000","last_unstale":"2024-05-28T06:12:32.782544+0000","last_undegraded":"2024-05-28T06:12:32.782544+0000","last_fullsized":"2024-05-28T06:12:32.782544+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:42:43.406276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"62'113","reported_seq":184,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.038140+0000","last_change":"2024-05-28T06:12:31.793575+0000","last_active":"2024-05-28T06:14:31.038140+0000","last_peered":"2024-05-28T06:14:31.038140+0000","last_clean":"2024-05-28T06:14:31.038140+0000","last_became_active":"2024-05-28T06:12:31.792189+0000","last_became_peered":"2024-05-28T06:12:31.792189+0000","last_unstale":"2024-05-28T06:14:31.038140+0000","last_undegraded":"2024-05-28T06:14:31.038140+0000","last_fullsized":"2024-05-28T06:14:31.038140+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:37:03.595280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360710144,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":59,"num_read_kb":241664,"num_write":86,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.561734+0000","last_change":"2024-05-28T06:12:30.787551+0000","last_active":"2024-05-28T06:12:33.561734+0000","last_peered":"2024-05-28T06:12:33.561734+0000","last_clean":"2024-05-28T06:12:33.561734+0000","last_became_active":"2024-05-28T06:12:30.786731+0000","last_became_peered":"2024-05-28T06:12:30.786731+0000","last_unstale":"2024-05-28T06:12:33.561734+0000","last_undegraded":"2024-05-28T06:12:33.561734+0000","last_fullsized":"2024-05-28T06:12:33.561734+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:57:56.110796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"62'116","reported_seq":214,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.022416+0000","last_change":"2024-05-28T06:12:31.804270+0000","last_active":"2024-05-28T06:14:31.022416+0000","last_peered":"2024-05-28T06:14:31.022416+0000","last_clean":"2024-05-28T06:14:31.022416+0000","last_became_active":"2024-05-28T06:12:31.803980+0000","last_became_peered":"2024-05-28T06:12:31.803980+0000","last_unstale":"2024-05-28T06:14:31.022416+0000","last_undegraded":"2024-05-28T06:14:31.022416+0000","last_fullsized":"2024-05-28T06:14:31.022416+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:08:26.147408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390070272,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":86,"num_read_kb":339971,"num_write":95,"num_write_kb":380929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.560646+0000","last_change":"2024-05-28T06:12:30.790132+0000","last_active":"2024-05-28T06:12:33.560646+0000","last_peered":"2024-05-28T06:12:33.560646+0000","last_clean":"2024-05-28T06:12:33.560646+0000","last_became_active":"2024-05-28T06:12:30.789856+0000","last_became_peered":"2024-05-28T06:12:30.789856+0000","last_unstale":"2024-05-28T06:12:33.560646+0000","last_undegraded":"2024-05-28T06:12:33.560646+0000","last_fullsized":"2024-05-28T06:12:33.560646+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:05:08.097047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"62'111","reported_seq":199,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.022197+0000","last_change":"2024-05-28T06:12:31.801507+0000","last_active":"2024-05-28T06:14:31.022197+0000","last_peered":"2024-05-28T06:14:31.022197+0000","last_clean":"2024-05-28T06:14:31.022197+0000","last_became_active":"2024-05-28T06:12:31.801228+0000","last_became_peered":"2024-05-28T06:12:31.801228+0000","last_unstale":"2024-05-28T06:14:31.022197+0000","last_undegraded":"2024-05-28T06:14:31.022197+0000","last_fullsized":"2024-05-28T06:14:31.022197+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:24:13.601910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394264576,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":75,"num_read_kb":307200,"num_write":94,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"62'31","reported_seq":75,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:13:42.926546+0000","last_change":"2024-05-28T06:12:30.790873+0000","last_active":"2024-05-28T06:13:42.926546+0000","last_peered":"2024-05-28T06:13:42.926546+0000","last_clean":"2024-05-28T06:13:42.926546+0000","last_became_active":"2024-05-28T06:12:30.790623+0000","last_became_peered":"2024-05-28T06:12:30.790623+0000","last_unstale":"2024-05-28T06:13:42.926546+0000","last_undegraded":"2024-05-28T06:13:42.926546+0000","last_fullsized":"2024-05-28T06:13:42.926546+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:52:42.932309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4250,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":30,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"62'101","reported_seq":191,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.012413+0000","last_change":"2024-05-28T06:12:31.803993+0000","last_active":"2024-05-28T06:14:31.012413+0000","last_peered":"2024-05-28T06:14:31.012413+0000","last_clean":"2024-05-28T06:14:31.012413+0000","last_became_active":"2024-05-28T06:12:31.803709+0000","last_became_peered":"2024-05-28T06:12:31.803709+0000","last_unstale":"2024-05-28T06:14:31.012413+0000","last_undegraded":"2024-05-28T06:14:31.012413+0000","last_fullsized":"2024-05-28T06:14:31.012413+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:02:56.823249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360710144,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":78,"num_read_kb":319488,"num_write":86,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.780393+0000","last_change":"2024-05-28T06:12:30.793567+0000","last_active":"2024-05-28T06:12:32.780393+0000","last_peered":"2024-05-28T06:12:32.780393+0000","last_clean":"2024-05-28T06:12:32.780393+0000","last_became_active":"2024-05-28T06:12:30.793086+0000","last_became_peered":"2024-05-28T06:12:30.793086+0000","last_unstale":"2024-05-28T06:12:32.780393+0000","last_undegraded":"2024-05-28T06:12:32.780393+0000","last_fullsized":"2024-05-28T06:12:32.780393+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:55:15.450791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"62'121","reported_seq":179,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.045566+0000","last_change":"2024-05-28T06:12:31.789343+0000","last_active":"2024-05-28T06:14:31.045566+0000","last_peered":"2024-05-28T06:14:31.045566+0000","last_clean":"2024-05-28T06:14:31.045566+0000","last_became_active":"2024-05-28T06:12:31.789082+0000","last_became_peered":"2024-05-28T06:12:31.789082+0000","last_unstale":"2024-05-28T06:14:31.045566+0000","last_undegraded":"2024-05-28T06:14:31.045566+0000","last_fullsized":"2024-05-28T06:14:31.045566+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:52:29.999357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356515972,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":46,"num_read_kb":180226,"num_write":88,"num_write_kb":348162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:32.800527+0000","last_change":"2024-05-28T06:12:30.796037+0000","last_active":"2024-05-28T06:12:32.800527+0000","last_peered":"2024-05-28T06:12:32.800527+0000","last_clean":"2024-05-28T06:12:32.800527+0000","last_became_active":"2024-05-28T06:12:30.795716+0000","last_became_peered":"2024-05-28T06:12:30.795716+0000","last_unstale":"2024-05-28T06:12:32.800527+0000","last_undegraded":"2024-05-28T06:12:32.800527+0000","last_fullsized":"2024-05-28T06:12:32.800527+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:29.757337+0000","last_clean_scrub_stamp":"2024-05-28T06:12:29.757337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:17:05.591509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":248,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:12:33.560577+0000","last_change":"2024-05-28T06:05:38.517922+0000","last_active":"2024-05-28T06:12:33.560577+0000","last_peered":"2024-05-28T06:12:33.560577+0000","last_clean":"2024-05-28T06:12:33.560577+0000","last_became_active":"2024-05-28T06:05:38.514745+0000","last_became_peered":"2024-05-28T06:05:38.514745+0000","last_unstale":"2024-05-28T06:12:33.560577+0000","last_undegraded":"2024-05-28T06:12:33.560577+0000","last_fullsized":"2024-05-28T06:12:33.560577+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:05:37.485018+0000","last_clean_scrub_stamp":"2024-05-28T06:05:37.485018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:23:27.978203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":20426262164,"num_objects":4880,"num_object_clones":1,"num_object_copies":9760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4880,"num_whiteouts":1,"num_read":4170,"num_read_kb":16875570,"num_write":4948,"num_write_kb":19947563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40852594688,"data_stored":40852524328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6457,"ondisk_log_size":6457,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1671909,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":612,"num_write_kb":1879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3407872,"data_stored":3343818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":557,"ondisk_log_size":557,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574959,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5940600,"kb_used_data":5891376,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":88431240,"statfs":{"total":96636764160,"available":90553589760,"internally_reserved":0,"allocated":6032769024,"data_stored":6032315492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574959,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3842848,"kb_used_data":3793624,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":90528992,"statfs":{"total":96636764160,"available":92701687808,"internally_reserved":0,"allocated":3884670976,"data_stored":3884240533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574958,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4842296,"kb_used_data":4793072,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":89529544,"statfs":{"total":96636764160,"available":91678253056,"internally_reserved":0,"allocated":4908105728,"data_stored":4907651869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574957,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4073928,"kb_used_data":4020544,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":90297912,"statfs":{"total":96636764160,"available":92465061888,"internally_reserved":0,"allocated":4117037056,"data_stored":4116594375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6505336,"kb_used_data":6451952,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":87866504,"statfs":{"total":96636764160,"available":89975300096,"internally_reserved":0,"allocated":6606798848,"data_stored":6606344671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574959,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3781416,"kb_used_data":3732192,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":90590424,"statfs":{"total":96636764160,"available":92764594176,"internally_reserved":0,"allocated":3821764608,"data_stored":3821326029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574959,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5935988,"kb_used_data":5882604,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":88435852,"statfs":{"total":96636764160,"available":90558312448,"internally_reserved":0,"allocated":6023786496,"data_stored":6023340306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4,11,6,8,8],"upper_bound":64},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574958,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5393444,"kb_used_data":5340060,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":88978396,"statfs":{"total":96636764160,"available":91113877504,"internally_reserved":0,"allocated":5468221440,"data_stored":5467755839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1687552,"data_stored":1671693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1675264,"data_stored":1666861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5465194496,"data_stored":5465178749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6023028736,"data_stored":6023020937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3821010944,"data_stored":3821010944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6606045184,"data_stored":6606029586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4114616320,"data_stored":4114612485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4907352064,"data_stored":4907336188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3883925504,"data_stored":3883925504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6031421440,"data_stored":6031409935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-28T06:14:37.571 INFO:tasks.ceph:pgid 9.3f last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.572 INFO:tasks.ceph:pgid 9.3e last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.572 INFO:tasks.ceph:pgid 9.3d last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.572 INFO:tasks.ceph:pgid 9.3c last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.572 INFO:tasks.ceph:pgid 9.3b last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.572 INFO:tasks.ceph:pgid 9.3a last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.573 INFO:tasks.ceph:pgid 9.39 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.573 INFO:tasks.ceph:pgid 9.38 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.573 INFO:tasks.ceph:pgid 9.37 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.573 INFO:tasks.ceph:pgid 9.36 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.573 INFO:tasks.ceph:pgid 9.35 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.573 INFO:tasks.ceph:pgid 9.34 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.573 INFO:tasks.ceph:pgid 9.33 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.574 INFO:tasks.ceph:pgid 9.32 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.574 INFO:tasks.ceph:pgid 9.31 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.574 INFO:tasks.ceph:pgid 9.30 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.574 INFO:tasks.ceph:pgid 9.2f last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.574 INFO:tasks.ceph:pgid 9.2e last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.575 INFO:tasks.ceph:pgid 9.2d last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.575 INFO:tasks.ceph:pgid 9.2c last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.575 INFO:tasks.ceph:pgid 9.2b last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.575 INFO:tasks.ceph:pgid 9.2a last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.575 INFO:tasks.ceph:pgid 9.29 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.575 INFO:tasks.ceph:pgid 9.28 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.575 INFO:tasks.ceph:pgid 9.27 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.576 INFO:tasks.ceph:pgid 9.26 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.576 INFO:tasks.ceph:pgid 9.25 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.576 INFO:tasks.ceph:pgid 9.24 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.576 INFO:tasks.ceph:pgid 9.23 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.576 INFO:tasks.ceph:pgid 9.22 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.576 INFO:tasks.ceph:pgid 9.21 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.577 INFO:tasks.ceph:pgid 9.20 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.577 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.577 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.577 INFO:tasks.ceph:pgid 9.1f last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.577 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.577 INFO:tasks.ceph:pgid 9.1c last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.578 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.578 INFO:tasks.ceph:pgid 9.1d last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.578 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.578 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.578 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.578 INFO:tasks.ceph:pgid 9.1b last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.579 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.579 INFO:tasks.ceph:pgid 9.18 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.579 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.579 INFO:tasks.ceph:pgid 9.19 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.579 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.579 INFO:tasks.ceph:pgid 9.16 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.579 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.580 INFO:tasks.ceph:pgid 9.17 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.580 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.580 INFO:tasks.ceph:pgid 9.14 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.580 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.580 INFO:tasks.ceph:pgid 9.15 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.580 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.581 INFO:tasks.ceph:pgid 9.12 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.581 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.581 INFO:tasks.ceph:pgid 9.13 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.581 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.581 INFO:tasks.ceph:pgid 9.10 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.581 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.581 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.582 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.582 INFO:tasks.ceph:pgid 9.e last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.582 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.582 INFO:tasks.ceph:pgid 9.f last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.582 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.582 INFO:tasks.ceph:pgid 9.c last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.583 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.583 INFO:tasks.ceph:pgid 9.d last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.583 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.583 INFO:tasks.ceph:pgid 9.a last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.583 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.583 INFO:tasks.ceph:pgid 9.b last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.584 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.584 INFO:tasks.ceph:pgid 9.9 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.584 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.584 INFO:tasks.ceph:pgid 9.6 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.584 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.584 INFO:tasks.ceph:pgid 9.7 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.584 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.585 INFO:tasks.ceph:pgid 9.4 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.585 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.585 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.585 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.585 INFO:tasks.ceph:pgid 9.2 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.585 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.585 INFO:tasks.ceph:pgid 9.3 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.586 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.586 INFO:tasks.ceph:pgid 9.0 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.586 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.586 INFO:tasks.ceph:pgid 9.1 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.586 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.586 INFO:tasks.ceph:pgid 9.8 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.587 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-28T06:12:29.757337+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=29, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.587 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-28T06:05:37.485018+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=5, tm_sec=37, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:37.587 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-28T06:14:48.675 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:14:48.678 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:14:57.588 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-28T06:14:57.735 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.737+0000 7f9b45200640 1 Processor -- start 2024-05-28T06:14:57.735 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.737+0000 7f9b45200640 1 -- start start 2024-05-28T06:14:57.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.737+0000 7f9b45200640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9b40147410 0x7f9b400afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:57.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.737+0000 7f9b45200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9b400adac0 0x7f9b4006e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:57.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.737+0000 7f9b45200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b400adf20 con 0x7f9b400722a0 2024-05-28T06:14:57.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.737+0000 7f9b45200640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f9b400b5310 con 0x7f9b40147410 2024-05-28T06:14:57.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.737+0000 7f9b45200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9b4006e5b0 con 0x7f9b400adac0 2024-05-28T06:14:57.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.737+0000 7f9b3de00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9b40147410 0x7f9b400afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:57.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.737+0000 7f9b3e800640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f9b400722a0 0x7f9b400b5a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:47974/0 (socket says 172.21.15.122:47974) 2024-05-28T06:14:57.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.737+0000 7f9b3e800640 1 -- 172.21.15.122:0/757372353 learned_addr learned my addr 172.21.15.122:0/757372353 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:14:57.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.737+0000 7f9b3d400640 1 --2- 172.21.15.122:0/757372353 >> v2:172.21.15.153:3300/0 conn(0x7f9b400adac0 0x7f9b4006e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:57.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.737+0000 7f9b3de00640 1 -- 172.21.15.122:0/757372353 >> v2:172.21.15.153:3300/0 conn(0x7f9b400adac0 msgr2=0x7f9b4006e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:14:57.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.737+0000 7f9b3de00640 1 --2- 172.21.15.122:0/757372353 >> v2:172.21.15.153:3300/0 conn(0x7f9b400adac0 0x7f9b4006e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:57.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.737+0000 7f9b3de00640 1 -- 172.21.15.122:0/757372353 >> v1:172.21.15.122:6789/0 conn(0x7f9b400722a0 legacy=0x7f9b400b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:57.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.737+0000 7f9b3de00640 1 -- 172.21.15.122:0/757372353 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4006e7f0 con 0x7f9b40147410 2024-05-28T06:14:57.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.737+0000 7f9b3ca00640 1 -- 172.21.15.122:0/757372353 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1483825707 0 0) 0x7f9b2c001120 con 0x7f9b400722a0 2024-05-28T06:14:57.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.741+0000 7f9b3de00640 1 --2- 172.21.15.122:0/757372353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b40147410 0x7f9b400afd30 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f9b401634c0 tx=0x7f9b3801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff241741b85956ed server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:57.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.741+0000 7f9b3ca00640 1 -- 172.21.15.122:0/757372353 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b380b2070 con 0x7f9b40147410 2024-05-28T06:14:57.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.741+0000 7f9b3ca00640 1 -- 172.21.15.122:0/757372353 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b380a57f0 con 0x7f9b40147410 2024-05-28T06:14:57.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.741+0000 7f9b3ca00640 1 -- 172.21.15.122:0/757372353 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b380a5bc0 con 0x7f9b40147410 2024-05-28T06:14:57.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.741+0000 7f9b45200640 1 -- 172.21.15.122:0/757372353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b40147410 msgr2=0x7f9b400afd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:57.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.741+0000 7f9b45200640 1 --2- 172.21.15.122:0/757372353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b40147410 0x7f9b400afd30 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f9b401634c0 tx=0x7f9b3801c930 comp rx=0 tx=0).stop 2024-05-28T06:14:57.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.741+0000 7f9b45200640 1 -- 172.21.15.122:0/757372353 shutdown_connections 2024-05-28T06:14:57.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.741+0000 7f9b45200640 1 --2- 172.21.15.122:0/757372353 >> v2:172.21.15.153:3300/0 conn(0x7f9b400adac0 0x7f9b4006e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:57.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.741+0000 7f9b45200640 1 --2- 172.21.15.122:0/757372353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b40147410 0x7f9b400afd30 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:57.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.741+0000 7f9b45200640 1 -- 172.21.15.122:0/757372353 >> 172.21.15.122:0/757372353 conn(0x7f9b4006bd90 msgr2=0x7f9b4006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:57.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.741+0000 7f9b45200640 1 -- 172.21.15.122:0/757372353 shutdown_connections 2024-05-28T06:14:57.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.741+0000 7f9b45200640 1 -- 172.21.15.122:0/757372353 wait complete. 2024-05-28T06:14:57.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.745+0000 7f9b45200640 1 Processor -- start 2024-05-28T06:14:57.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.745+0000 7f9b45200640 1 -- start start 2024-05-28T06:14:57.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.745+0000 7f9b45200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b400722a0 0x7f9b4015f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:57.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.745+0000 7f9b45200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b400adac0 0x7f9b4015c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:57.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.745+0000 7f9b45200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b40147410 0x7f9b4015c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:57.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.745+0000 7f9b45200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9b40147970 con 0x7f9b400722a0 2024-05-28T06:14:57.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.745+0000 7f9b45200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9b401477f0 con 0x7f9b40147410 2024-05-28T06:14:57.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.745+0000 7f9b45200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f9b40072ac0 con 0x7f9b400adac0 2024-05-28T06:14:57.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.745+0000 7f9b3de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b400722a0 0x7f9b4015f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:57.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.745+0000 7f9b3de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b400722a0 0x7f9b4015f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:55906/0 (socket says 172.21.15.122:55906) 2024-05-28T06:14:57.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.745+0000 7f9b3de00640 1 -- 172.21.15.122:0/2741356321 learned_addr learned my addr 172.21.15.122:0/2741356321 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:14:57.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.745+0000 7f9b3de00640 1 -- 172.21.15.122:0/2741356321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b400adac0 msgr2=0x7f9b4015c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:57.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.745+0000 7f9b3de00640 1 --2- 172.21.15.122:0/2741356321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b400adac0 0x7f9b4015c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:57.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.745+0000 7f9b3de00640 1 -- 172.21.15.122:0/2741356321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b40147410 msgr2=0x7f9b4015c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:57.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.745+0000 7f9b3de00640 1 --2- 172.21.15.122:0/2741356321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b40147410 0x7f9b4015c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:57.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.745+0000 7f9b3de00640 1 -- 172.21.15.122:0/2741356321 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4015d100 con 0x7f9b400722a0 2024-05-28T06:14:57.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.745+0000 7f9b3de00640 1 --2- 172.21.15.122:0/2741356321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b400722a0 0x7f9b4015f640 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f9b380b0040 tx=0x7f9b380196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:57.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.745+0000 7f9b36000640 1 -- 172.21.15.122:0/2741356321 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b380bd030 con 0x7f9b400722a0 2024-05-28T06:14:57.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.745+0000 7f9b36000640 1 -- 172.21.15.122:0/2741356321 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b380039a0 con 0x7f9b400722a0 2024-05-28T06:14:57.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.745+0000 7f9b45200640 1 -- 172.21.15.122:0/2741356321 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b4015d3e0 con 0x7f9b400722a0 2024-05-28T06:14:57.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.745+0000 7f9b36000640 1 -- 172.21.15.122:0/2741356321 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b380b2040 con 0x7f9b400722a0 2024-05-28T06:14:57.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.745+0000 7f9b45200640 1 -- 172.21.15.122:0/2741356321 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b4015d9a0 con 0x7f9b400722a0 2024-05-28T06:14:57.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.745+0000 7f9b45200640 1 -- 172.21.15.122:0/2741356321 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b40068c40 con 0x7f9b400722a0 2024-05-28T06:14:57.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.749+0000 7f9b36000640 1 -- 172.21.15.122:0/2741356321 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 89007+0+0 (secure 0 0 0) 0x7f9b38004020 con 0x7f9b400722a0 2024-05-28T06:14:57.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.749+0000 7f9b36000640 1 --2- 172.21.15.122:0/2741356321 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9b20068ec0 0x7f9b2006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:14:57.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.749+0000 7f9b36000640 1 -- 172.21.15.122:0/2741356321 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f9b3811ff70 con 0x7f9b400722a0 2024-05-28T06:14:57.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.749+0000 7f9b3d400640 1 --2- 172.21.15.122:0/2741356321 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9b20068ec0 0x7f9b2006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:14:57.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.749+0000 7f9b3d400640 1 --2- 172.21.15.122:0/2741356321 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9b20068ec0 0x7f9b2006b380 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9b40161e80 tx=0x7f9b30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:14:57.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.753+0000 7f9b36000640 1 -- 172.21.15.122:0/2741356321 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9b380c7020 con 0x7f9b400722a0 2024-05-28T06:14:57.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.909+0000 7f9b45200640 1 -- 172.21.15.122:0/2741356321 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9b4015cea0 con 0x7f9b20068ec0 2024-05-28T06:14:57.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.913+0000 7f9b36000640 1 -- 172.21.15.122:0/2741356321 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254878 (secure 0 0 0) 0x7f9b30009e40 con 0x7f9b20068ec0 2024-05-28T06:14:57.916 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:14:57.918 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-05-28T06:14:57.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.917+0000 7f9b45200640 1 -- 172.21.15.122:0/2741356321 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9b20068ec0 msgr2=0x7f9b2006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:57.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.917+0000 7f9b45200640 1 --2- 172.21.15.122:0/2741356321 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9b20068ec0 0x7f9b2006b380 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9b40161e80 tx=0x7f9b30008040 comp rx=0 tx=0).stop 2024-05-28T06:14:57.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.917+0000 7f9b45200640 1 -- 172.21.15.122:0/2741356321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b400722a0 msgr2=0x7f9b4015f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:14:57.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.917+0000 7f9b45200640 1 --2- 172.21.15.122:0/2741356321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b400722a0 0x7f9b4015f640 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f9b380b0040 tx=0x7f9b380196d0 comp rx=0 tx=0).stop 2024-05-28T06:14:57.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.917+0000 7f9b45200640 1 -- 172.21.15.122:0/2741356321 shutdown_connections 2024-05-28T06:14:57.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.917+0000 7f9b45200640 1 --2- 172.21.15.122:0/2741356321 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f9b20068ec0 0x7f9b2006b380 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:57.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.917+0000 7f9b45200640 1 --2- 172.21.15.122:0/2741356321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b40147410 0x7f9b4015c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:57.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.917+0000 7f9b45200640 1 --2- 172.21.15.122:0/2741356321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b400adac0 0x7f9b4015c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:57.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.917+0000 7f9b45200640 1 --2- 172.21.15.122:0/2741356321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b400722a0 0x7f9b4015f640 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:14:57.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.917+0000 7f9b45200640 1 -- 172.21.15.122:0/2741356321 >> 172.21.15.122:0/2741356321 conn(0x7f9b4006bd90 msgr2=0x7f9b4013d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:14:57.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.917+0000 7f9b45200640 1 -- 172.21.15.122:0/2741356321 shutdown_connections 2024-05-28T06:14:57.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:14:57.917+0000 7f9b45200640 1 -- 172.21.15.122:0/2741356321 wait complete. 2024-05-28T06:14:57.936 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2024-05-28T06:14:57.395100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":20428524441,"num_objects":4905,"num_object_clones":1,"num_object_copies":9810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4905,"num_whiteouts":1,"num_read":4316,"num_read_kb":16875700,"num_write":5719,"num_write_kb":19951858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6176,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11805,"ondisk_log_size":11805,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":40332496,"kb_used_data":39905424,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":714642224,"statfs":{"total":773094113280,"available":731793637376,"internally_reserved":0,"allocated":40863154176,"data_stored":40859569114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":437243441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002880"},"pg_stats":[{"pgid":"9.3f","version":"62'160","reported_seq":258,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:37.031589+0000","last_change":"2024-05-28T06:14:37.031589+0000","last_active":"2024-05-28T06:14:37.031589+0000","last_peered":"2024-05-28T06:14:37.031589+0000","last_clean":"2024-05-28T06:14:37.031589+0000","last_became_active":"2024-05-28T06:12:31.793751+0000","last_became_peered":"2024-05-28T06:12:31.793751+0000","last_unstale":"2024-05-28T06:14:37.031589+0000","last_undegraded":"2024-05-28T06:14:37.031589+0000","last_fullsized":"2024-05-28T06:14:37.031589+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'160","last_scrub_stamp":"2024-05-28T06:14:37.031417+0000","last_deep_scrub":"62'160","last_deep_scrub_stamp":"2024-05-28T06:14:37.031417+0000","last_clean_scrub_stamp":"2024-05-28T06:14:37.031417+0000","objects_scrubbed":66,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:32:40.357289+0000","scrub_duration":555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":74,"num_read_kb":303104,"num_write":66,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"62'179","reported_seq":276,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:50.331639+0000","last_change":"2024-05-28T06:14:50.331671+0000","last_active":"2024-05-28T06:14:50.331639+0000","last_peered":"2024-05-28T06:14:50.331639+0000","last_clean":"2024-05-28T06:14:50.331639+0000","last_became_active":"2024-05-28T06:12:31.798788+0000","last_became_peered":"2024-05-28T06:12:31.798788+0000","last_unstale":"2024-05-28T06:14:50.331639+0000","last_undegraded":"2024-05-28T06:14:50.331639+0000","last_fullsized":"2024-05-28T06:14:50.331639+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'179","last_scrub_stamp":"2024-05-28T06:14:50.331549+0000","last_deep_scrub":"62'179","last_deep_scrub_stamp":"2024-05-28T06:14:50.331549+0000","last_clean_scrub_stamp":"2024-05-28T06:14:50.331549+0000","objects_scrubbed":79,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:56:11.148345+0000","scrub_duration":639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":72,"num_read_kb":294912,"num_write":79,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"62'165","reported_seq":257,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:43.599146+0000","last_change":"2024-05-28T06:14:43.599237+0000","last_active":"2024-05-28T06:14:43.599146+0000","last_peered":"2024-05-28T06:14:43.599146+0000","last_clean":"2024-05-28T06:14:43.599146+0000","last_became_active":"2024-05-28T06:12:31.802019+0000","last_became_peered":"2024-05-28T06:12:31.802019+0000","last_unstale":"2024-05-28T06:14:43.599146+0000","last_undegraded":"2024-05-28T06:14:43.599146+0000","last_fullsized":"2024-05-28T06:14:43.599146+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'165","last_scrub_stamp":"2024-05-28T06:14:43.599058+0000","last_deep_scrub":"62'165","last_deep_scrub_stamp":"2024-05-28T06:14:43.599058+0000","last_clean_scrub_stamp":"2024-05-28T06:14:43.599058+0000","objects_scrubbed":69,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:41:22.758324+0000","scrub_duration":695,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":68,"num_read_kb":270338,"num_write":75,"num_write_kb":282627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"62'175","reported_seq":244,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:48.675967+0000","last_change":"2024-05-28T06:14:48.675994+0000","last_active":"2024-05-28T06:14:48.675967+0000","last_peered":"2024-05-28T06:14:48.675967+0000","last_clean":"2024-05-28T06:14:48.675967+0000","last_became_active":"2024-05-28T06:12:31.801804+0000","last_became_peered":"2024-05-28T06:12:31.801804+0000","last_unstale":"2024-05-28T06:14:48.675967+0000","last_undegraded":"2024-05-28T06:14:48.675967+0000","last_fullsized":"2024-05-28T06:14:48.675967+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'175","last_scrub_stamp":"2024-05-28T06:14:48.675900+0000","last_deep_scrub":"62'175","last_deep_scrub_stamp":"2024-05-28T06:14:48.675900+0000","last_clean_scrub_stamp":"2024-05-28T06:14:48.675900+0000","objects_scrubbed":77,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:26:28.370714+0000","scrub_duration":547,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322961408,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":44,"num_read_kb":180224,"num_write":77,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"62'132","reported_seq":195,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:39.024889+0000","last_change":"2024-05-28T06:14:39.024922+0000","last_active":"2024-05-28T06:14:39.024889+0000","last_peered":"2024-05-28T06:14:39.024889+0000","last_clean":"2024-05-28T06:14:39.024889+0000","last_became_active":"2024-05-28T06:12:31.798238+0000","last_became_peered":"2024-05-28T06:12:31.798238+0000","last_unstale":"2024-05-28T06:14:39.024889+0000","last_undegraded":"2024-05-28T06:14:39.024889+0000","last_fullsized":"2024-05-28T06:14:39.024889+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'132","last_scrub_stamp":"2024-05-28T06:14:39.024814+0000","last_deep_scrub":"62'132","last_deep_scrub_stamp":"2024-05-28T06:14:39.024814+0000","last_clean_scrub_stamp":"2024-05-28T06:14:39.024814+0000","objects_scrubbed":58,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:17:31.341316+0000","scrub_duration":463,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":40,"num_read_kb":163840,"num_write":58,"num_write_kb":237568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"62'194","reported_seq":309,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:42.450616+0000","last_change":"2024-05-28T06:14:42.450655+0000","last_active":"2024-05-28T06:14:42.450616+0000","last_peered":"2024-05-28T06:14:42.450616+0000","last_clean":"2024-05-28T06:14:42.450616+0000","last_became_active":"2024-05-28T06:12:31.790779+0000","last_became_peered":"2024-05-28T06:12:31.790779+0000","last_unstale":"2024-05-28T06:14:42.450616+0000","last_undegraded":"2024-05-28T06:14:42.450616+0000","last_fullsized":"2024-05-28T06:14:42.450616+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'194","last_scrub_stamp":"2024-05-28T06:14:42.450540+0000","last_deep_scrub":"62'194","last_deep_scrub_stamp":"2024-05-28T06:14:42.450540+0000","last_clean_scrub_stamp":"2024-05-28T06:14:42.450540+0000","objects_scrubbed":84,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:27.546492+0000","scrub_duration":691,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352321536,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":91,"num_read_kb":364546,"num_write":88,"num_write_kb":344066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"62'156","reported_seq":227,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:41.766873+0000","last_change":"2024-05-28T06:14:41.766964+0000","last_active":"2024-05-28T06:14:41.766873+0000","last_peered":"2024-05-28T06:14:41.766873+0000","last_clean":"2024-05-28T06:14:41.766873+0000","last_became_active":"2024-05-28T06:12:31.786592+0000","last_became_peered":"2024-05-28T06:12:31.786592+0000","last_unstale":"2024-05-28T06:14:41.766873+0000","last_undegraded":"2024-05-28T06:14:41.766873+0000","last_fullsized":"2024-05-28T06:14:41.766873+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'156","last_scrub_stamp":"2024-05-28T06:14:41.766741+0000","last_deep_scrub":"62'156","last_deep_scrub_stamp":"2024-05-28T06:14:41.766741+0000","last_clean_scrub_stamp":"2024-05-28T06:14:41.766741+0000","objects_scrubbed":63,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:14:53.397564+0000","scrub_duration":503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":48,"num_read_kb":196608,"num_write":63,"num_write_kb":258048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"62'171","reported_seq":246,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:45.431488+0000","last_change":"2024-05-28T06:14:45.431513+0000","last_active":"2024-05-28T06:14:45.431488+0000","last_peered":"2024-05-28T06:14:45.431488+0000","last_clean":"2024-05-28T06:14:45.431488+0000","last_became_active":"2024-05-28T06:12:31.788168+0000","last_became_peered":"2024-05-28T06:12:31.788168+0000","last_unstale":"2024-05-28T06:14:45.431488+0000","last_undegraded":"2024-05-28T06:14:45.431488+0000","last_fullsized":"2024-05-28T06:14:45.431488+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'171","last_scrub_stamp":"2024-05-28T06:14:45.431416+0000","last_deep_scrub":"62'171","last_deep_scrub_stamp":"2024-05-28T06:14:45.431416+0000","last_clean_scrub_stamp":"2024-05-28T06:14:45.431416+0000","objects_scrubbed":75,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:51:03.094030+0000","scrub_duration":863,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":51,"num_read_kb":208896,"num_write":75,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"62'187","reported_seq":266,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:40.914439+0000","last_change":"2024-05-28T06:14:40.914472+0000","last_active":"2024-05-28T06:14:40.914439+0000","last_peered":"2024-05-28T06:14:40.914439+0000","last_clean":"2024-05-28T06:14:40.914439+0000","last_became_active":"2024-05-28T06:12:31.783599+0000","last_became_peered":"2024-05-28T06:12:31.783599+0000","last_unstale":"2024-05-28T06:14:40.914439+0000","last_undegraded":"2024-05-28T06:14:40.914439+0000","last_fullsized":"2024-05-28T06:14:40.914439+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'187","last_scrub_stamp":"2024-05-28T06:14:40.914368+0000","last_deep_scrub":"62'187","last_deep_scrub_stamp":"2024-05-28T06:14:40.914368+0000","last_clean_scrub_stamp":"2024-05-28T06:14:40.914368+0000","objects_scrubbed":80,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:10:03.402056+0000","scrub_duration":655,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":55,"num_read_kb":221185,"num_write":82,"num_write_kb":327681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"62'157","reported_seq":243,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:42.046810+0000","last_change":"2024-05-28T06:14:42.046858+0000","last_active":"2024-05-28T06:14:42.046810+0000","last_peered":"2024-05-28T06:14:42.046810+0000","last_clean":"2024-05-28T06:14:42.046810+0000","last_became_active":"2024-05-28T06:12:31.793687+0000","last_became_peered":"2024-05-28T06:12:31.793687+0000","last_unstale":"2024-05-28T06:14:42.046810+0000","last_undegraded":"2024-05-28T06:14:42.046810+0000","last_fullsized":"2024-05-28T06:14:42.046810+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'157","last_scrub_stamp":"2024-05-28T06:14:42.046724+0000","last_deep_scrub":"62'157","last_deep_scrub_stamp":"2024-05-28T06:14:42.046724+0000","last_clean_scrub_stamp":"2024-05-28T06:14:42.046724+0000","objects_scrubbed":62,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:22:00.571020+0000","scrub_duration":551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":63,"num_read_kb":258048,"num_write":62,"num_write_kb":253952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"62'202","reported_seq":327,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:39.235408+0000","last_change":"2024-05-28T06:14:39.235458+0000","last_active":"2024-05-28T06:14:39.235408+0000","last_peered":"2024-05-28T06:14:39.235408+0000","last_clean":"2024-05-28T06:14:39.235408+0000","last_became_active":"2024-05-28T06:12:31.789337+0000","last_became_peered":"2024-05-28T06:12:31.789337+0000","last_unstale":"2024-05-28T06:14:39.235408+0000","last_undegraded":"2024-05-28T06:14:39.235408+0000","last_fullsized":"2024-05-28T06:14:39.235408+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'202","last_scrub_stamp":"2024-05-28T06:14:39.235335+0000","last_deep_scrub":"62'202","last_deep_scrub_stamp":"2024-05-28T06:14:39.235335+0000","last_clean_scrub_stamp":"2024-05-28T06:14:39.235335+0000","objects_scrubbed":91,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:05:05.294166+0000","scrub_duration":719,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381681664,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":101,"num_read_kb":413696,"num_write":91,"num_write_kb":372736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"62'165","reported_seq":287,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:46.807947+0000","last_change":"2024-05-28T06:14:46.808016+0000","last_active":"2024-05-28T06:14:46.807947+0000","last_peered":"2024-05-28T06:14:46.807947+0000","last_clean":"2024-05-28T06:14:46.807947+0000","last_became_active":"2024-05-28T06:12:31.796167+0000","last_became_peered":"2024-05-28T06:12:31.796167+0000","last_unstale":"2024-05-28T06:14:46.807947+0000","last_undegraded":"2024-05-28T06:14:46.807947+0000","last_fullsized":"2024-05-28T06:14:46.807947+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'165","last_scrub_stamp":"2024-05-28T06:14:46.807865+0000","last_deep_scrub":"62'165","last_deep_scrub_stamp":"2024-05-28T06:14:46.807865+0000","last_clean_scrub_stamp":"2024-05-28T06:14:46.807865+0000","objects_scrubbed":74,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:52:35.622047+0000","scrub_duration":663,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":99,"num_read_kb":389124,"num_write":76,"num_write_kb":303105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"62'189","reported_seq":296,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:41.244754+0000","last_change":"2024-05-28T06:14:41.244807+0000","last_active":"2024-05-28T06:14:41.244754+0000","last_peered":"2024-05-28T06:14:41.244754+0000","last_clean":"2024-05-28T06:14:41.244754+0000","last_became_active":"2024-05-28T06:12:31.799169+0000","last_became_peered":"2024-05-28T06:12:31.799169+0000","last_unstale":"2024-05-28T06:14:41.244754+0000","last_undegraded":"2024-05-28T06:14:41.244754+0000","last_fullsized":"2024-05-28T06:14:41.244754+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'189","last_scrub_stamp":"2024-05-28T06:14:41.244658+0000","last_deep_scrub":"62'189","last_deep_scrub_stamp":"2024-05-28T06:14:41.244658+0000","last_clean_scrub_stamp":"2024-05-28T06:14:41.244658+0000","objects_scrubbed":82,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:08:41.232512+0000","scrub_duration":747,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343932928,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":83,"num_read_kb":339968,"num_write":82,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"62'201","reported_seq":290,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:44.139020+0000","last_change":"2024-05-28T06:14:44.139020+0000","last_active":"2024-05-28T06:14:44.139020+0000","last_peered":"2024-05-28T06:14:44.139020+0000","last_clean":"2024-05-28T06:14:44.139020+0000","last_became_active":"2024-05-28T06:12:31.789907+0000","last_became_peered":"2024-05-28T06:12:31.789907+0000","last_unstale":"2024-05-28T06:14:44.139020+0000","last_undegraded":"2024-05-28T06:14:44.139020+0000","last_fullsized":"2024-05-28T06:14:44.139020+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'201","last_scrub_stamp":"2024-05-28T06:14:44.138823+0000","last_deep_scrub":"62'201","last_deep_scrub_stamp":"2024-05-28T06:14:44.138823+0000","last_clean_scrub_stamp":"2024-05-28T06:14:44.138823+0000","objects_scrubbed":87,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:45:24.201560+0000","scrub_duration":867,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364904448,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":64,"num_read_kb":262144,"num_write":87,"num_write_kb":356352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"62'151","reported_seq":206,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:42.955824+0000","last_change":"2024-05-28T06:14:42.955884+0000","last_active":"2024-05-28T06:14:42.955824+0000","last_peered":"2024-05-28T06:14:42.955824+0000","last_clean":"2024-05-28T06:14:42.955824+0000","last_became_active":"2024-05-28T06:12:31.788073+0000","last_became_peered":"2024-05-28T06:12:31.788073+0000","last_unstale":"2024-05-28T06:14:42.955824+0000","last_undegraded":"2024-05-28T06:14:42.955824+0000","last_fullsized":"2024-05-28T06:14:42.955824+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'151","last_scrub_stamp":"2024-05-28T06:14:42.955738+0000","last_deep_scrub":"62'151","last_deep_scrub_stamp":"2024-05-28T06:14:42.955738+0000","last_clean_scrub_stamp":"2024-05-28T06:14:42.955738+0000","objects_scrubbed":63,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:32:25.087967+0000","scrub_duration":659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":31,"num_read_kb":126976,"num_write":63,"num_write_kb":258048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"62'155","reported_seq":233,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:47.243770+0000","last_change":"2024-05-28T06:14:47.243770+0000","last_active":"2024-05-28T06:14:47.243770+0000","last_peered":"2024-05-28T06:14:47.243770+0000","last_clean":"2024-05-28T06:14:47.243770+0000","last_became_active":"2024-05-28T06:12:31.800507+0000","last_became_peered":"2024-05-28T06:12:31.800507+0000","last_unstale":"2024-05-28T06:14:47.243770+0000","last_undegraded":"2024-05-28T06:14:47.243770+0000","last_fullsized":"2024-05-28T06:14:47.243770+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'155","last_scrub_stamp":"2024-05-28T06:14:47.243584+0000","last_deep_scrub":"62'155","last_deep_scrub_stamp":"2024-05-28T06:14:47.243584+0000","last_clean_scrub_stamp":"2024-05-28T06:14:47.243584+0000","objects_scrubbed":64,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:58:15.213046+0000","scrub_duration":563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":54,"num_read_kb":221184,"num_write":64,"num_write_kb":262144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"62'158","reported_seq":224,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:48.171963+0000","last_change":"2024-05-28T06:14:48.172042+0000","last_active":"2024-05-28T06:14:48.171963+0000","last_peered":"2024-05-28T06:14:48.171963+0000","last_clean":"2024-05-28T06:14:48.171963+0000","last_became_active":"2024-05-28T06:12:31.798292+0000","last_became_peered":"2024-05-28T06:12:31.798292+0000","last_unstale":"2024-05-28T06:14:48.171963+0000","last_undegraded":"2024-05-28T06:14:48.171963+0000","last_fullsized":"2024-05-28T06:14:48.171963+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'158","last_scrub_stamp":"2024-05-28T06:14:48.171857+0000","last_deep_scrub":"62'158","last_deep_scrub_stamp":"2024-05-28T06:14:48.171857+0000","last_clean_scrub_stamp":"2024-05-28T06:14:48.171857+0000","objects_scrubbed":65,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:37:08.338903+0000","scrub_duration":555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":42,"num_read_kb":172032,"num_write":67,"num_write_kb":266241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"62'193","reported_seq":312,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:48.471082+0000","last_change":"2024-05-28T06:14:48.471082+0000","last_active":"2024-05-28T06:14:48.471082+0000","last_peered":"2024-05-28T06:14:48.471082+0000","last_clean":"2024-05-28T06:14:48.471082+0000","last_became_active":"2024-05-28T06:12:31.805031+0000","last_became_peered":"2024-05-28T06:12:31.805031+0000","last_unstale":"2024-05-28T06:14:48.471082+0000","last_undegraded":"2024-05-28T06:14:48.471082+0000","last_fullsized":"2024-05-28T06:14:48.471082+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'193","last_scrub_stamp":"2024-05-28T06:14:48.470977+0000","last_deep_scrub":"62'193","last_deep_scrub_stamp":"2024-05-28T06:14:48.470977+0000","last_clean_scrub_stamp":"2024-05-28T06:14:48.470977+0000","objects_scrubbed":81,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:52:37.285159+0000","scrub_duration":651,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544581,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":94,"num_read_kb":372739,"num_write":85,"num_write_kb":327683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"62'202","reported_seq":294,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:35.146431+0000","last_change":"2024-05-28T06:14:35.146431+0000","last_active":"2024-05-28T06:14:35.146431+0000","last_peered":"2024-05-28T06:14:35.146431+0000","last_clean":"2024-05-28T06:14:35.146431+0000","last_became_active":"2024-05-28T06:12:31.792620+0000","last_became_peered":"2024-05-28T06:12:31.792620+0000","last_unstale":"2024-05-28T06:14:35.146431+0000","last_undegraded":"2024-05-28T06:14:35.146431+0000","last_fullsized":"2024-05-28T06:14:35.146431+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'202","last_scrub_stamp":"2024-05-28T06:14:35.146304+0000","last_deep_scrub":"62'202","last_deep_scrub_stamp":"2024-05-28T06:14:35.146304+0000","last_clean_scrub_stamp":"2024-05-28T06:14:35.146304+0000","objects_scrubbed":88,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:57:20.839758+0000","scrub_duration":643,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369098752,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":67,"num_read_kb":274432,"num_write":90,"num_write_kb":360449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"62'170","reported_seq":256,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:36.205009+0000","last_change":"2024-05-28T06:14:36.205009+0000","last_active":"2024-05-28T06:14:36.205009+0000","last_peered":"2024-05-28T06:14:36.205009+0000","last_clean":"2024-05-28T06:14:36.205009+0000","last_became_active":"2024-05-28T06:12:31.790044+0000","last_became_peered":"2024-05-28T06:12:31.790044+0000","last_unstale":"2024-05-28T06:14:36.205009+0000","last_undegraded":"2024-05-28T06:14:36.205009+0000","last_fullsized":"2024-05-28T06:14:36.205009+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'170","last_scrub_stamp":"2024-05-28T06:14:36.204854+0000","last_deep_scrub":"62'170","last_deep_scrub_stamp":"2024-05-28T06:14:36.204854+0000","last_clean_scrub_stamp":"2024-05-28T06:14:36.204854+0000","objects_scrubbed":71,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:58:04.174316+0000","scrub_duration":679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":62,"num_read_kb":253952,"num_write":71,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"62'186","reported_seq":306,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:42.730326+0000","last_change":"2024-05-28T06:14:42.730375+0000","last_active":"2024-05-28T06:14:42.730326+0000","last_peered":"2024-05-28T06:14:42.730326+0000","last_clean":"2024-05-28T06:14:42.730326+0000","last_became_active":"2024-05-28T06:12:31.798652+0000","last_became_peered":"2024-05-28T06:12:31.798652+0000","last_unstale":"2024-05-28T06:14:42.730326+0000","last_undegraded":"2024-05-28T06:14:42.730326+0000","last_fullsized":"2024-05-28T06:14:42.730326+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'186","last_scrub_stamp":"2024-05-28T06:14:42.730267+0000","last_deep_scrub":"62'186","last_deep_scrub_stamp":"2024-05-28T06:14:42.730267+0000","last_clean_scrub_stamp":"2024-05-28T06:14:42.730267+0000","objects_scrubbed":78,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:55:05.240860+0000","scrub_duration":779,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327155712,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":95,"num_read_kb":376835,"num_write":82,"num_write_kb":319490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"62'181","reported_seq":267,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:52.375429+0000","last_change":"2024-05-28T06:14:52.375453+0000","last_active":"2024-05-28T06:14:52.375429+0000","last_peered":"2024-05-28T06:14:52.375429+0000","last_clean":"2024-05-28T06:14:52.375429+0000","last_became_active":"2024-05-28T06:12:31.795520+0000","last_became_peered":"2024-05-28T06:12:31.795520+0000","last_unstale":"2024-05-28T06:14:52.375429+0000","last_undegraded":"2024-05-28T06:14:52.375429+0000","last_fullsized":"2024-05-28T06:14:52.375429+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'181","last_scrub_stamp":"2024-05-28T06:14:52.375368+0000","last_deep_scrub":"62'181","last_deep_scrub_stamp":"2024-05-28T06:14:52.375368+0000","last_clean_scrub_stamp":"2024-05-28T06:14:52.375368+0000","objects_scrubbed":75,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:56:10.251433+0000","scrub_duration":611,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":61,"num_read_kb":241666,"num_write":77,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"62'185","reported_seq":267,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:50.444874+0000","last_change":"2024-05-28T06:14:50.444905+0000","last_active":"2024-05-28T06:14:50.444874+0000","last_peered":"2024-05-28T06:14:50.444874+0000","last_clean":"2024-05-28T06:14:50.444874+0000","last_became_active":"2024-05-28T06:12:31.805993+0000","last_became_peered":"2024-05-28T06:12:31.805993+0000","last_unstale":"2024-05-28T06:14:50.444874+0000","last_undegraded":"2024-05-28T06:14:50.444874+0000","last_fullsized":"2024-05-28T06:14:50.444874+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'185","last_scrub_stamp":"2024-05-28T06:14:50.444806+0000","last_deep_scrub":"62'185","last_deep_scrub_stamp":"2024-05-28T06:14:50.444806+0000","last_clean_scrub_stamp":"2024-05-28T06:14:50.444806+0000","objects_scrubbed":83,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:02:55.926600+0000","scrub_duration":639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":348127232,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":57,"num_read_kb":233472,"num_write":83,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"62'180","reported_seq":261,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:42.184151+0000","last_change":"2024-05-28T06:14:42.184151+0000","last_active":"2024-05-28T06:14:42.184151+0000","last_peered":"2024-05-28T06:14:42.184151+0000","last_clean":"2024-05-28T06:14:42.184151+0000","last_became_active":"2024-05-28T06:12:31.801026+0000","last_became_peered":"2024-05-28T06:12:31.801026+0000","last_unstale":"2024-05-28T06:14:42.184151+0000","last_undegraded":"2024-05-28T06:14:42.184151+0000","last_fullsized":"2024-05-28T06:14:42.184151+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'180","last_scrub_stamp":"2024-05-28T06:14:42.183972+0000","last_deep_scrub":"62'180","last_deep_scrub_stamp":"2024-05-28T06:14:42.183972+0000","last_clean_scrub_stamp":"2024-05-28T06:14:42.183972+0000","objects_scrubbed":79,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:07:25.220163+0000","scrub_duration":691,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":56,"num_read_kb":229376,"num_write":79,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"62'179","reported_seq":272,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:38.218596+0000","last_change":"2024-05-28T06:14:38.218596+0000","last_active":"2024-05-28T06:14:38.218596+0000","last_peered":"2024-05-28T06:14:38.218596+0000","last_clean":"2024-05-28T06:14:38.218596+0000","last_became_active":"2024-05-28T06:12:31.794016+0000","last_became_peered":"2024-05-28T06:12:31.794016+0000","last_unstale":"2024-05-28T06:14:38.218596+0000","last_undegraded":"2024-05-28T06:14:38.218596+0000","last_fullsized":"2024-05-28T06:14:38.218596+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'179","last_scrub_stamp":"2024-05-28T06:14:38.218433+0000","last_deep_scrub":"62'179","last_deep_scrub_stamp":"2024-05-28T06:14:38.218433+0000","last_clean_scrub_stamp":"2024-05-28T06:14:38.218433+0000","objects_scrubbed":75,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:19:42.804476+0000","scrub_duration":695,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":68,"num_read_kb":266243,"num_write":79,"num_write_kb":307202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"62'165","reported_seq":255,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:42.856351+0000","last_change":"2024-05-28T06:14:42.856445+0000","last_active":"2024-05-28T06:14:42.856351+0000","last_peered":"2024-05-28T06:14:42.856351+0000","last_clean":"2024-05-28T06:14:42.856351+0000","last_became_active":"2024-05-28T06:12:31.788550+0000","last_became_peered":"2024-05-28T06:12:31.788550+0000","last_unstale":"2024-05-28T06:14:42.856351+0000","last_undegraded":"2024-05-28T06:14:42.856351+0000","last_fullsized":"2024-05-28T06:14:42.856351+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'165","last_scrub_stamp":"2024-05-28T06:14:42.856244+0000","last_deep_scrub":"62'165","last_deep_scrub_stamp":"2024-05-28T06:14:42.856244+0000","last_clean_scrub_stamp":"2024-05-28T06:14:42.856244+0000","objects_scrubbed":65,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:19:18.336936+0000","scrub_duration":699,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":66,"num_read_kb":270336,"num_write":65,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"62'187","reported_seq":278,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:43.557468+0000","last_change":"2024-05-28T06:14:43.557512+0000","last_active":"2024-05-28T06:14:43.557468+0000","last_peered":"2024-05-28T06:14:43.557468+0000","last_clean":"2024-05-28T06:14:43.557468+0000","last_became_active":"2024-05-28T06:12:31.792595+0000","last_became_peered":"2024-05-28T06:12:31.792595+0000","last_unstale":"2024-05-28T06:14:43.557468+0000","last_undegraded":"2024-05-28T06:14:43.557468+0000","last_fullsized":"2024-05-28T06:14:43.557468+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'187","last_scrub_stamp":"2024-05-28T06:14:43.557396+0000","last_deep_scrub":"62'187","last_deep_scrub_stamp":"2024-05-28T06:14:43.557396+0000","last_clean_scrub_stamp":"2024-05-28T06:14:43.557396+0000","objects_scrubbed":82,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:01:58.970922+0000","scrub_duration":815,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343932928,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":66,"num_read_kb":270336,"num_write":82,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"62'177","reported_seq":236,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:40.268116+0000","last_change":"2024-05-28T06:14:40.268116+0000","last_active":"2024-05-28T06:14:40.268116+0000","last_peered":"2024-05-28T06:14:40.268116+0000","last_clean":"2024-05-28T06:14:40.268116+0000","last_became_active":"2024-05-28T06:12:31.800042+0000","last_became_peered":"2024-05-28T06:12:31.800042+0000","last_unstale":"2024-05-28T06:14:40.268116+0000","last_undegraded":"2024-05-28T06:14:40.268116+0000","last_fullsized":"2024-05-28T06:14:40.268116+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'177","last_scrub_stamp":"2024-05-28T06:14:40.268011+0000","last_deep_scrub":"62'177","last_deep_scrub_stamp":"2024-05-28T06:14:40.268011+0000","last_clean_scrub_stamp":"2024-05-28T06:14:40.268011+0000","objects_scrubbed":78,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:56:50.201713+0000","scrub_duration":747,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327155712,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":34,"num_read_kb":131074,"num_write":82,"num_write_kb":319490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"62'193","reported_seq":289,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:49.332130+0000","last_change":"2024-05-28T06:14:49.332174+0000","last_active":"2024-05-28T06:14:49.332130+0000","last_peered":"2024-05-28T06:14:49.332130+0000","last_clean":"2024-05-28T06:14:49.332130+0000","last_became_active":"2024-05-28T06:12:31.798695+0000","last_became_peered":"2024-05-28T06:12:31.798695+0000","last_unstale":"2024-05-28T06:14:49.332130+0000","last_undegraded":"2024-05-28T06:14:49.332130+0000","last_fullsized":"2024-05-28T06:14:49.332130+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'193","last_scrub_stamp":"2024-05-28T06:14:49.332047+0000","last_deep_scrub":"62'193","last_deep_scrub_stamp":"2024-05-28T06:14:49.332047+0000","last_clean_scrub_stamp":"2024-05-28T06:14:49.332047+0000","objects_scrubbed":85,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:48:49.193887+0000","scrub_duration":671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352321668,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":71,"num_read_kb":286721,"num_write":85,"num_write_kb":344065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"62'182","reported_seq":272,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:45.787271+0000","last_change":"2024-05-28T06:14:45.787300+0000","last_active":"2024-05-28T06:14:45.787271+0000","last_peered":"2024-05-28T06:14:45.787271+0000","last_clean":"2024-05-28T06:14:45.787271+0000","last_became_active":"2024-05-28T06:12:31.803396+0000","last_became_peered":"2024-05-28T06:12:31.803396+0000","last_unstale":"2024-05-28T06:14:45.787271+0000","last_undegraded":"2024-05-28T06:14:45.787271+0000","last_fullsized":"2024-05-28T06:14:45.787271+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'182","last_scrub_stamp":"2024-05-28T06:14:45.787190+0000","last_deep_scrub":"62'182","last_deep_scrub_stamp":"2024-05-28T06:14:45.787190+0000","last_clean_scrub_stamp":"2024-05-28T06:14:45.787190+0000","objects_scrubbed":77,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:59:11.085544+0000","scrub_duration":903,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322961408,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":65,"num_read_kb":266240,"num_write":77,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"62'171","reported_seq":289,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:36.182190+0000","last_change":"2024-05-28T06:14:36.182190+0000","last_active":"2024-05-28T06:14:36.182190+0000","last_peered":"2024-05-28T06:14:36.182190+0000","last_clean":"2024-05-28T06:14:36.182190+0000","last_became_active":"2024-05-28T06:12:31.797170+0000","last_became_peered":"2024-05-28T06:12:31.797170+0000","last_unstale":"2024-05-28T06:14:36.182190+0000","last_undegraded":"2024-05-28T06:14:36.182190+0000","last_fullsized":"2024-05-28T06:14:36.182190+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'171","last_scrub_stamp":"2024-05-28T06:14:36.181948+0000","last_deep_scrub":"62'171","last_deep_scrub_stamp":"2024-05-28T06:14:36.181948+0000","last_clean_scrub_stamp":"2024-05-28T06:14:36.181948+0000","objects_scrubbed":69,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:10:31.564938+0000","scrub_duration":659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":94,"num_read_kb":385024,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"62'172","reported_seq":267,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:41.342675+0000","last_change":"2024-05-28T06:14:41.342726+0000","last_active":"2024-05-28T06:14:41.342675+0000","last_peered":"2024-05-28T06:14:41.342675+0000","last_clean":"2024-05-28T06:14:41.342675+0000","last_became_active":"2024-05-28T06:12:31.787700+0000","last_became_peered":"2024-05-28T06:12:31.787700+0000","last_unstale":"2024-05-28T06:14:41.342675+0000","last_undegraded":"2024-05-28T06:14:41.342675+0000","last_fullsized":"2024-05-28T06:14:41.342675+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'172","last_scrub_stamp":"2024-05-28T06:14:41.342605+0000","last_deep_scrub":"62'172","last_deep_scrub_stamp":"2024-05-28T06:14:41.342605+0000","last_clean_scrub_stamp":"2024-05-28T06:14:41.342605+0000","objects_scrubbed":71,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:18:49.168995+0000","scrub_duration":627,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":71,"num_read_kb":290816,"num_write":71,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"62'151","reported_seq":217,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:49.301626+0000","last_change":"2024-05-28T06:14:49.301736+0000","last_active":"2024-05-28T06:14:49.301626+0000","last_peered":"2024-05-28T06:14:49.301626+0000","last_clean":"2024-05-28T06:14:49.301626+0000","last_became_active":"2024-05-28T06:12:31.802678+0000","last_became_peered":"2024-05-28T06:12:31.802678+0000","last_unstale":"2024-05-28T06:14:49.301626+0000","last_undegraded":"2024-05-28T06:14:49.301626+0000","last_fullsized":"2024-05-28T06:14:49.301626+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'151","last_scrub_stamp":"2024-05-28T06:14:49.301537+0000","last_deep_scrub":"62'151","last_deep_scrub_stamp":"2024-05-28T06:14:49.301537+0000","last_clean_scrub_stamp":"2024-05-28T06:14:49.301537+0000","objects_scrubbed":67,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:05:48.736739+0000","scrub_duration":559,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":42,"num_read_kb":172032,"num_write":67,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"62'6","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:36.600122+0000","last_change":"2024-05-28T06:14:36.600122+0000","last_active":"2024-05-28T06:14:36.600122+0000","last_peered":"2024-05-28T06:14:36.600122+0000","last_clean":"2024-05-28T06:14:36.600122+0000","last_became_active":"2024-05-28T06:12:30.790720+0000","last_became_peered":"2024-05-28T06:12:30.790720+0000","last_unstale":"2024-05-28T06:14:36.600122+0000","last_undegraded":"2024-05-28T06:14:36.600122+0000","last_fullsized":"2024-05-28T06:14:36.600122+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'6","last_scrub_stamp":"2024-05-28T06:14:36.599954+0000","last_deep_scrub":"62'6","last_deep_scrub_stamp":"2024-05-28T06:14:36.599954+0000","last_clean_scrub_stamp":"2024-05-28T06:14:36.599954+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:45:16.662691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"62'165","reported_seq":258,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:43.196205+0000","last_change":"2024-05-28T06:14:43.196262+0000","last_active":"2024-05-28T06:14:43.196205+0000","last_peered":"2024-05-28T06:14:43.196205+0000","last_clean":"2024-05-28T06:14:43.196205+0000","last_became_active":"2024-05-28T06:12:31.801239+0000","last_became_peered":"2024-05-28T06:12:31.801239+0000","last_unstale":"2024-05-28T06:14:43.196205+0000","last_undegraded":"2024-05-28T06:14:43.196205+0000","last_fullsized":"2024-05-28T06:14:43.196205+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'165","last_scrub_stamp":"2024-05-28T06:14:43.196114+0000","last_deep_scrub":"62'165","last_deep_scrub_stamp":"2024-05-28T06:14:43.196114+0000","last_clean_scrub_stamp":"2024-05-28T06:14:43.196114+0000","objects_scrubbed":73,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:50:28.396786+0000","scrub_duration":731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301990149,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":69,"num_read_kb":278529,"num_write":75,"num_write_kb":294914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":25,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:43.583540+0000","last_change":"2024-05-28T06:14:43.583581+0000","last_active":"2024-05-28T06:14:43.583540+0000","last_peered":"2024-05-28T06:14:43.583540+0000","last_clean":"2024-05-28T06:14:43.583540+0000","last_became_active":"2024-05-28T06:12:30.799345+0000","last_became_peered":"2024-05-28T06:12:30.799345+0000","last_unstale":"2024-05-28T06:14:43.583540+0000","last_undegraded":"2024-05-28T06:14:43.583540+0000","last_fullsized":"2024-05-28T06:14:43.583540+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2024-05-28T06:14:43.583434+0000","last_deep_scrub":"61'1","last_deep_scrub_stamp":"2024-05-28T06:14:43.583434+0000","last_clean_scrub_stamp":"2024-05-28T06:14:43.583434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:57:42.090381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"62'161","reported_seq":258,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:40.354808+0000","last_change":"2024-05-28T06:14:40.354866+0000","last_active":"2024-05-28T06:14:40.354808+0000","last_peered":"2024-05-28T06:14:40.354808+0000","last_clean":"2024-05-28T06:14:40.354808+0000","last_became_active":"2024-05-28T06:12:31.786982+0000","last_became_peered":"2024-05-28T06:12:31.786982+0000","last_unstale":"2024-05-28T06:14:40.354808+0000","last_undegraded":"2024-05-28T06:14:40.354808+0000","last_fullsized":"2024-05-28T06:14:40.354808+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'161","last_scrub_stamp":"2024-05-28T06:14:40.354731+0000","last_deep_scrub":"62'161","last_deep_scrub_stamp":"2024-05-28T06:14:40.354731+0000","last_clean_scrub_stamp":"2024-05-28T06:14:40.354731+0000","objects_scrubbed":69,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:19:15.835424+0000","scrub_duration":651,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":74,"num_read_kb":286724,"num_write":73,"num_write_kb":282626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"62'4","reported_seq":27,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:33.588461+0000","last_change":"2024-05-28T06:14:33.588514+0000","last_active":"2024-05-28T06:14:33.588461+0000","last_peered":"2024-05-28T06:14:33.588461+0000","last_clean":"2024-05-28T06:14:33.588461+0000","last_became_active":"2024-05-28T06:12:30.783801+0000","last_became_peered":"2024-05-28T06:12:30.783801+0000","last_unstale":"2024-05-28T06:14:33.588461+0000","last_undegraded":"2024-05-28T06:14:33.588461+0000","last_fullsized":"2024-05-28T06:14:33.588461+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-05-28T06:14:33.588381+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-05-28T06:14:33.588381+0000","last_clean_scrub_stamp":"2024-05-28T06:14:33.588381+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:09:56.076069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"62'204","reported_seq":314,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:46.556513+0000","last_change":"2024-05-28T06:14:46.556549+0000","last_active":"2024-05-28T06:14:46.556513+0000","last_peered":"2024-05-28T06:14:46.556513+0000","last_clean":"2024-05-28T06:14:46.556513+0000","last_became_active":"2024-05-28T06:12:31.799517+0000","last_became_peered":"2024-05-28T06:12:31.799517+0000","last_unstale":"2024-05-28T06:14:46.556513+0000","last_undegraded":"2024-05-28T06:14:46.556513+0000","last_fullsized":"2024-05-28T06:14:46.556513+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'204","last_scrub_stamp":"2024-05-28T06:14:46.556445+0000","last_deep_scrub":"62'204","last_deep_scrub_stamp":"2024-05-28T06:14:46.556445+0000","last_clean_scrub_stamp":"2024-05-28T06:14:46.556445+0000","objects_scrubbed":85,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:26:26.251259+0000","scrub_duration":835,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356515840,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":86,"num_read_kb":352256,"num_write":85,"num_write_kb":348160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"62'3","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:40.186619+0000","last_change":"2024-05-28T06:14:40.186662+0000","last_active":"2024-05-28T06:14:40.186619+0000","last_peered":"2024-05-28T06:14:40.186619+0000","last_clean":"2024-05-28T06:14:40.186619+0000","last_became_active":"2024-05-28T06:12:30.795164+0000","last_became_peered":"2024-05-28T06:12:30.795164+0000","last_unstale":"2024-05-28T06:14:40.186619+0000","last_undegraded":"2024-05-28T06:14:40.186619+0000","last_fullsized":"2024-05-28T06:14:40.186619+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'3","last_scrub_stamp":"2024-05-28T06:14:40.186522+0000","last_deep_scrub":"62'3","last_deep_scrub_stamp":"2024-05-28T06:14:40.186522+0000","last_clean_scrub_stamp":"2024-05-28T06:14:40.186522+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:47:49.370867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"62'170","reported_seq":250,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:51.325079+0000","last_change":"2024-05-28T06:14:51.325150+0000","last_active":"2024-05-28T06:14:51.325079+0000","last_peered":"2024-05-28T06:14:51.325079+0000","last_clean":"2024-05-28T06:14:51.325079+0000","last_became_active":"2024-05-28T06:12:31.795154+0000","last_became_peered":"2024-05-28T06:12:31.795154+0000","last_unstale":"2024-05-28T06:14:51.325079+0000","last_undegraded":"2024-05-28T06:14:51.325079+0000","last_fullsized":"2024-05-28T06:14:51.325079+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'170","last_scrub_stamp":"2024-05-28T06:14:51.325006+0000","last_deep_scrub":"62'170","last_deep_scrub_stamp":"2024-05-28T06:14:51.325006+0000","last_clean_scrub_stamp":"2024-05-28T06:14:51.325006+0000","objects_scrubbed":74,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:18:36.030389+0000","scrub_duration":591,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":57,"num_read_kb":233472,"num_write":74,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:39.230883+0000","last_change":"2024-05-28T06:14:39.230903+0000","last_active":"2024-05-28T06:14:39.230883+0000","last_peered":"2024-05-28T06:14:39.230883+0000","last_clean":"2024-05-28T06:14:39.230883+0000","last_became_active":"2024-05-28T06:12:30.792752+0000","last_became_peered":"2024-05-28T06:12:30.792752+0000","last_unstale":"2024-05-28T06:14:39.230883+0000","last_undegraded":"2024-05-28T06:14:39.230883+0000","last_fullsized":"2024-05-28T06:14:39.230883+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2024-05-28T06:14:39.230799+0000","last_deep_scrub":"61'1","last_deep_scrub_stamp":"2024-05-28T06:14:39.230799+0000","last_clean_scrub_stamp":"2024-05-28T06:14:39.230799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:16:30.423174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"62'176","reported_seq":295,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:38.218694+0000","last_change":"2024-05-28T06:14:38.218735+0000","last_active":"2024-05-28T06:14:38.218694+0000","last_peered":"2024-05-28T06:14:38.218694+0000","last_clean":"2024-05-28T06:14:38.218694+0000","last_became_active":"2024-05-28T06:12:31.789614+0000","last_became_peered":"2024-05-28T06:12:31.789614+0000","last_unstale":"2024-05-28T06:14:38.218694+0000","last_undegraded":"2024-05-28T06:14:38.218694+0000","last_fullsized":"2024-05-28T06:14:38.218694+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'176","last_scrub_stamp":"2024-05-28T06:14:38.218612+0000","last_deep_scrub":"62'176","last_deep_scrub_stamp":"2024-05-28T06:14:38.218612+0000","last_clean_scrub_stamp":"2024-05-28T06:14:38.218612+0000","objects_scrubbed":75,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:49:42.913039+0000","scrub_duration":699,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":94,"num_read_kb":385024,"num_write":75,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:34.595565+0000","last_change":"2024-05-28T06:14:34.595589+0000","last_active":"2024-05-28T06:14:34.595565+0000","last_peered":"2024-05-28T06:14:34.595565+0000","last_clean":"2024-05-28T06:14:34.595565+0000","last_became_active":"2024-05-28T06:12:30.790028+0000","last_became_peered":"2024-05-28T06:12:30.790028+0000","last_unstale":"2024-05-28T06:14:34.595565+0000","last_undegraded":"2024-05-28T06:14:34.595565+0000","last_fullsized":"2024-05-28T06:14:34.595565+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2024-05-28T06:14:34.595493+0000","last_deep_scrub":"61'1","last_deep_scrub_stamp":"2024-05-28T06:14:34.595493+0000","last_clean_scrub_stamp":"2024-05-28T06:14:34.595493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:14:46.226315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"62'174","reported_seq":272,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:40.204521+0000","last_change":"2024-05-28T06:14:40.204545+0000","last_active":"2024-05-28T06:14:40.204521+0000","last_peered":"2024-05-28T06:14:40.204521+0000","last_clean":"2024-05-28T06:14:40.204521+0000","last_became_active":"2024-05-28T06:12:31.797004+0000","last_became_peered":"2024-05-28T06:12:31.797004+0000","last_unstale":"2024-05-28T06:14:40.204521+0000","last_undegraded":"2024-05-28T06:14:40.204521+0000","last_fullsized":"2024-05-28T06:14:40.204521+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'174","last_scrub_stamp":"2024-05-28T06:14:40.204448+0000","last_deep_scrub":"62'174","last_deep_scrub_stamp":"2024-05-28T06:14:40.204448+0000","last_clean_scrub_stamp":"2024-05-28T06:14:40.204448+0000","objects_scrubbed":75,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:24:25.790467+0000","scrub_duration":695,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":74,"num_read_kb":294914,"num_write":77,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":23,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:38.110350+0000","last_change":"2024-05-28T06:14:38.110370+0000","last_active":"2024-05-28T06:14:38.110350+0000","last_peered":"2024-05-28T06:14:38.110350+0000","last_clean":"2024-05-28T06:14:38.110350+0000","last_became_active":"2024-05-28T06:12:30.791832+0000","last_became_peered":"2024-05-28T06:12:30.791832+0000","last_unstale":"2024-05-28T06:14:38.110350+0000","last_undegraded":"2024-05-28T06:14:38.110350+0000","last_fullsized":"2024-05-28T06:14:38.110350+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:38.110263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:38.110263+0000","last_clean_scrub_stamp":"2024-05-28T06:14:38.110263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:24:35.327085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"62'103","reported_seq":180,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:31.027232+0000","last_change":"2024-05-28T06:12:31.804063+0000","last_active":"2024-05-28T06:14:31.027232+0000","last_peered":"2024-05-28T06:14:31.027232+0000","last_clean":"2024-05-28T06:14:31.027232+0000","last_became_active":"2024-05-28T06:12:31.803791+0000","last_became_peered":"2024-05-28T06:12:31.803791+0000","last_unstale":"2024-05-28T06:14:31.027232+0000","last_undegraded":"2024-05-28T06:14:31.027232+0000","last_fullsized":"2024-05-28T06:14:31.027232+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":64,"num_read_kb":253954,"num_write":76,"num_write_kb":303105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":23,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:38.195561+0000","last_change":"2024-05-28T06:14:38.195578+0000","last_active":"2024-05-28T06:14:38.195561+0000","last_peered":"2024-05-28T06:14:38.195561+0000","last_clean":"2024-05-28T06:14:38.195561+0000","last_became_active":"2024-05-28T06:12:30.789854+0000","last_became_peered":"2024-05-28T06:12:30.789854+0000","last_unstale":"2024-05-28T06:14:38.195561+0000","last_undegraded":"2024-05-28T06:14:38.195561+0000","last_fullsized":"2024-05-28T06:14:38.195561+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:38.195470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:38.195470+0000","last_clean_scrub_stamp":"2024-05-28T06:14:38.195470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:42:23.376927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"62'156","reported_seq":215,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:44.958320+0000","last_change":"2024-05-28T06:14:44.958370+0000","last_active":"2024-05-28T06:14:44.958320+0000","last_peered":"2024-05-28T06:14:44.958320+0000","last_clean":"2024-05-28T06:14:44.958320+0000","last_became_active":"2024-05-28T06:12:31.788910+0000","last_became_peered":"2024-05-28T06:12:31.788910+0000","last_unstale":"2024-05-28T06:14:44.958320+0000","last_undegraded":"2024-05-28T06:14:44.958320+0000","last_fullsized":"2024-05-28T06:14:44.958320+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'156","last_scrub_stamp":"2024-05-28T06:14:44.958247+0000","last_deep_scrub":"62'156","last_deep_scrub_stamp":"2024-05-28T06:14:44.958247+0000","last_clean_scrub_stamp":"2024-05-28T06:14:44.958247+0000","objects_scrubbed":64,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:04:41.410029+0000","scrub_duration":715,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":36,"num_read_kb":147456,"num_write":64,"num_write_kb":262144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"62'1","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:39.956673+0000","last_change":"2024-05-28T06:14:39.956715+0000","last_active":"2024-05-28T06:14:39.956673+0000","last_peered":"2024-05-28T06:14:39.956673+0000","last_clean":"2024-05-28T06:14:39.956673+0000","last_became_active":"2024-05-28T06:12:30.796011+0000","last_became_peered":"2024-05-28T06:12:30.796011+0000","last_unstale":"2024-05-28T06:14:39.956673+0000","last_undegraded":"2024-05-28T06:14:39.956673+0000","last_fullsized":"2024-05-28T06:14:39.956673+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'1","last_scrub_stamp":"2024-05-28T06:14:39.956605+0000","last_deep_scrub":"62'1","last_deep_scrub_stamp":"2024-05-28T06:14:39.956605+0000","last_clean_scrub_stamp":"2024-05-28T06:14:39.956605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:45:20.019342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"62'161","reported_seq":224,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:52.378566+0000","last_change":"2024-05-28T06:14:52.378620+0000","last_active":"2024-05-28T06:14:52.378566+0000","last_peered":"2024-05-28T06:14:52.378566+0000","last_clean":"2024-05-28T06:14:52.378566+0000","last_became_active":"2024-05-28T06:12:31.807524+0000","last_became_peered":"2024-05-28T06:12:31.807524+0000","last_unstale":"2024-05-28T06:14:52.378566+0000","last_undegraded":"2024-05-28T06:14:52.378566+0000","last_fullsized":"2024-05-28T06:14:52.378566+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'161","last_scrub_stamp":"2024-05-28T06:14:52.378497+0000","last_deep_scrub":"62'161","last_deep_scrub_stamp":"2024-05-28T06:14:52.378497+0000","last_clean_scrub_stamp":"2024-05-28T06:14:52.378497+0000","objects_scrubbed":71,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:55:54.596857+0000","scrub_duration":575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":40,"num_read_kb":163840,"num_write":71,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":23,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:42.554597+0000","last_change":"2024-05-28T06:14:42.554637+0000","last_active":"2024-05-28T06:14:42.554597+0000","last_peered":"2024-05-28T06:14:42.554597+0000","last_clean":"2024-05-28T06:14:42.554597+0000","last_became_active":"2024-05-28T06:12:30.798033+0000","last_became_peered":"2024-05-28T06:12:30.798033+0000","last_unstale":"2024-05-28T06:14:42.554597+0000","last_undegraded":"2024-05-28T06:14:42.554597+0000","last_fullsized":"2024-05-28T06:14:42.554597+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:42.554493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:42.554493+0000","last_clean_scrub_stamp":"2024-05-28T06:14:42.554493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:12:28.843939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"62'161","reported_seq":266,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:41.137799+0000","last_change":"2024-05-28T06:14:41.137799+0000","last_active":"2024-05-28T06:14:41.137799+0000","last_peered":"2024-05-28T06:14:41.137799+0000","last_clean":"2024-05-28T06:14:41.137799+0000","last_became_active":"2024-05-28T06:12:31.789590+0000","last_became_peered":"2024-05-28T06:12:31.789590+0000","last_unstale":"2024-05-28T06:14:41.137799+0000","last_undegraded":"2024-05-28T06:14:41.137799+0000","last_fullsized":"2024-05-28T06:14:41.137799+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'161","last_scrub_stamp":"2024-05-28T06:14:41.137675+0000","last_deep_scrub":"62'161","last_deep_scrub_stamp":"2024-05-28T06:14:41.137675+0000","last_clean_scrub_stamp":"2024-05-28T06:14:41.137675+0000","objects_scrubbed":69,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:39:13.968538+0000","scrub_duration":631,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":81,"num_read_kb":331776,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"62'26","reported_seq":49,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:38.926368+0000","last_change":"2024-05-28T06:14:38.926392+0000","last_active":"2024-05-28T06:14:38.926368+0000","last_peered":"2024-05-28T06:14:38.926368+0000","last_clean":"2024-05-28T06:14:38.926368+0000","last_became_active":"2024-05-28T06:12:30.794322+0000","last_became_peered":"2024-05-28T06:12:30.794322+0000","last_unstale":"2024-05-28T06:14:38.926368+0000","last_undegraded":"2024-05-28T06:14:38.926368+0000","last_fullsized":"2024-05-28T06:14:38.926368+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'26","last_scrub_stamp":"2024-05-28T06:14:38.926281+0000","last_deep_scrub":"62'26","last_deep_scrub_stamp":"2024-05-28T06:14:38.926281+0000","last_clean_scrub_stamp":"2024-05-28T06:14:38.926281+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:53:34.845406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"62'154","reported_seq":238,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:51.362920+0000","last_change":"2024-05-28T06:14:51.362971+0000","last_active":"2024-05-28T06:14:51.362920+0000","last_peered":"2024-05-28T06:14:51.362920+0000","last_clean":"2024-05-28T06:14:51.362920+0000","last_became_active":"2024-05-28T06:12:31.806339+0000","last_became_peered":"2024-05-28T06:12:31.806339+0000","last_unstale":"2024-05-28T06:14:51.362920+0000","last_undegraded":"2024-05-28T06:14:51.362920+0000","last_fullsized":"2024-05-28T06:14:51.362920+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'154","last_scrub_stamp":"2024-05-28T06:14:51.362839+0000","last_deep_scrub":"62'154","last_deep_scrub_stamp":"2024-05-28T06:14:51.362839+0000","last_clean_scrub_stamp":"2024-05-28T06:14:51.362839+0000","objects_scrubbed":65,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:58:19.332301+0000","scrub_duration":539,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":61,"num_read_kb":245761,"num_write":67,"num_write_kb":266241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"62'432","reported_seq":456,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:37.179976+0000","last_change":"2024-05-28T06:14:37.179976+0000","last_active":"2024-05-28T06:14:37.179976+0000","last_peered":"2024-05-28T06:14:37.179976+0000","last_clean":"2024-05-28T06:14:37.179976+0000","last_became_active":"2024-05-28T06:12:30.791190+0000","last_became_peered":"2024-05-28T06:12:30.791190+0000","last_unstale":"2024-05-28T06:14:37.179976+0000","last_undegraded":"2024-05-28T06:14:37.179976+0000","last_fullsized":"2024-05-28T06:14:37.179976+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'432","last_scrub_stamp":"2024-05-28T06:14:37.179883+0000","last_deep_scrub":"62'432","last_deep_scrub_stamp":"2024-05-28T06:14:37.179883+0000","last_clean_scrub_stamp":"2024-05-28T06:14:37.179883+0000","objects_scrubbed":4,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:32:15.495059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1666861,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":1789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"62'172","reported_seq":246,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:46.011756+0000","last_change":"2024-05-28T06:14:46.011756+0000","last_active":"2024-05-28T06:14:46.011756+0000","last_peered":"2024-05-28T06:14:46.011756+0000","last_clean":"2024-05-28T06:14:46.011756+0000","last_became_active":"2024-05-28T06:12:31.794242+0000","last_became_peered":"2024-05-28T06:12:31.794242+0000","last_unstale":"2024-05-28T06:14:46.011756+0000","last_undegraded":"2024-05-28T06:14:46.011756+0000","last_fullsized":"2024-05-28T06:14:46.011756+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'172","last_scrub_stamp":"2024-05-28T06:14:46.011604+0000","last_deep_scrub":"62'172","last_deep_scrub_stamp":"2024-05-28T06:14:46.011604+0000","last_clean_scrub_stamp":"2024-05-28T06:14:46.011604+0000","objects_scrubbed":75,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:02:01.425131+0000","scrub_duration":851,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":49,"num_read_kb":200704,"num_write":75,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"62'4","reported_seq":28,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:40.579440+0000","last_change":"2024-05-28T06:14:40.579440+0000","last_active":"2024-05-28T06:14:40.579440+0000","last_peered":"2024-05-28T06:14:40.579440+0000","last_clean":"2024-05-28T06:14:40.579440+0000","last_became_active":"2024-05-28T06:12:30.794488+0000","last_became_peered":"2024-05-28T06:12:30.794488+0000","last_unstale":"2024-05-28T06:14:40.579440+0000","last_undegraded":"2024-05-28T06:14:40.579440+0000","last_fullsized":"2024-05-28T06:14:40.579440+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-05-28T06:14:40.579319+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-05-28T06:14:40.579319+0000","last_clean_scrub_stamp":"2024-05-28T06:14:40.579319+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:35:58.976875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"62'207","reported_seq":285,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:44.911723+0000","last_change":"2024-05-28T06:14:44.911723+0000","last_active":"2024-05-28T06:14:44.911723+0000","last_peered":"2024-05-28T06:14:44.911723+0000","last_clean":"2024-05-28T06:14:44.911723+0000","last_became_active":"2024-05-28T06:12:31.802789+0000","last_became_peered":"2024-05-28T06:12:31.802789+0000","last_unstale":"2024-05-28T06:14:44.911723+0000","last_undegraded":"2024-05-28T06:14:44.911723+0000","last_fullsized":"2024-05-28T06:14:44.911723+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'207","last_scrub_stamp":"2024-05-28T06:14:44.911566+0000","last_deep_scrub":"62'207","last_deep_scrub_stamp":"2024-05-28T06:14:44.911566+0000","last_clean_scrub_stamp":"2024-05-28T06:14:44.911566+0000","objects_scrubbed":88,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:05:56.901694+0000","scrub_duration":991,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369098752,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":53,"num_read_kb":212993,"num_write":92,"num_write_kb":360450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:37.545678+0000","last_change":"2024-05-28T06:14:37.545678+0000","last_active":"2024-05-28T06:14:37.545678+0000","last_peered":"2024-05-28T06:14:37.545678+0000","last_clean":"2024-05-28T06:14:37.545678+0000","last_became_active":"2024-05-28T06:12:30.795666+0000","last_became_peered":"2024-05-28T06:12:30.795666+0000","last_unstale":"2024-05-28T06:14:37.545678+0000","last_undegraded":"2024-05-28T06:14:37.545678+0000","last_fullsized":"2024-05-28T06:14:37.545678+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:37.545584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:37.545584+0000","last_clean_scrub_stamp":"2024-05-28T06:14:37.545584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:08:08.840898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"62'148","reported_seq":230,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:45.943133+0000","last_change":"2024-05-28T06:14:45.943133+0000","last_active":"2024-05-28T06:14:45.943133+0000","last_peered":"2024-05-28T06:14:45.943133+0000","last_clean":"2024-05-28T06:14:45.943133+0000","last_became_active":"2024-05-28T06:12:31.795281+0000","last_became_peered":"2024-05-28T06:12:31.795281+0000","last_unstale":"2024-05-28T06:14:45.943133+0000","last_undegraded":"2024-05-28T06:14:45.943133+0000","last_fullsized":"2024-05-28T06:14:45.943133+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'148","last_scrub_stamp":"2024-05-28T06:14:45.943005+0000","last_deep_scrub":"62'148","last_deep_scrub_stamp":"2024-05-28T06:14:45.943005+0000","last_clean_scrub_stamp":"2024-05-28T06:14:45.943005+0000","objects_scrubbed":63,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:55:08.453597+0000","scrub_duration":735,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":58,"num_read_kb":237568,"num_write":63,"num_write_kb":258048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:39.153279+0000","last_change":"2024-05-28T06:14:39.153279+0000","last_active":"2024-05-28T06:14:39.153279+0000","last_peered":"2024-05-28T06:14:39.153279+0000","last_clean":"2024-05-28T06:14:39.153279+0000","last_became_active":"2024-05-28T06:12:30.792218+0000","last_became_peered":"2024-05-28T06:12:30.792218+0000","last_unstale":"2024-05-28T06:14:39.153279+0000","last_undegraded":"2024-05-28T06:14:39.153279+0000","last_fullsized":"2024-05-28T06:14:39.153279+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:39.153198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:39.153198+0000","last_clean_scrub_stamp":"2024-05-28T06:14:39.153198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:26:21.273262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"62'209","reported_seq":303,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:49.608055+0000","last_change":"2024-05-28T06:14:49.608055+0000","last_active":"2024-05-28T06:14:49.608055+0000","last_peered":"2024-05-28T06:14:49.608055+0000","last_clean":"2024-05-28T06:14:49.608055+0000","last_became_active":"2024-05-28T06:12:31.805628+0000","last_became_peered":"2024-05-28T06:12:31.805628+0000","last_unstale":"2024-05-28T06:14:49.608055+0000","last_undegraded":"2024-05-28T06:14:49.608055+0000","last_fullsized":"2024-05-28T06:14:49.608055+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'209","last_scrub_stamp":"2024-05-28T06:14:49.607936+0000","last_deep_scrub":"62'209","last_deep_scrub_stamp":"2024-05-28T06:14:49.607936+0000","last_clean_scrub_stamp":"2024-05-28T06:14:49.607936+0000","objects_scrubbed":95,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:14:00.480738+0000","scrub_duration":763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394264837,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":69,"num_read_kb":282624,"num_write":95,"num_write_kb":385025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"62'12","reported_seq":36,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:40.949517+0000","last_change":"2024-05-28T06:14:40.949517+0000","last_active":"2024-05-28T06:14:40.949517+0000","last_peered":"2024-05-28T06:14:40.949517+0000","last_clean":"2024-05-28T06:14:40.949517+0000","last_became_active":"2024-05-28T06:12:30.797105+0000","last_became_peered":"2024-05-28T06:12:30.797105+0000","last_unstale":"2024-05-28T06:14:40.949517+0000","last_undegraded":"2024-05-28T06:14:40.949517+0000","last_fullsized":"2024-05-28T06:14:40.949517+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'12","last_scrub_stamp":"2024-05-28T06:14:40.949427+0000","last_deep_scrub":"62'12","last_deep_scrub_stamp":"2024-05-28T06:14:40.949427+0000","last_clean_scrub_stamp":"2024-05-28T06:14:40.949427+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:04:37.401208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"62'153","reported_seq":202,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:47.446909+0000","last_change":"2024-05-28T06:14:47.446909+0000","last_active":"2024-05-28T06:14:47.446909+0000","last_peered":"2024-05-28T06:14:47.446909+0000","last_clean":"2024-05-28T06:14:47.446909+0000","last_became_active":"2024-05-28T06:12:31.800610+0000","last_became_peered":"2024-05-28T06:12:31.800610+0000","last_unstale":"2024-05-28T06:14:47.446909+0000","last_undegraded":"2024-05-28T06:14:47.446909+0000","last_fullsized":"2024-05-28T06:14:47.446909+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'153","last_scrub_stamp":"2024-05-28T06:14:47.446726+0000","last_deep_scrub":"62'153","last_deep_scrub_stamp":"2024-05-28T06:14:47.446726+0000","last_clean_scrub_stamp":"2024-05-28T06:14:47.446726+0000","objects_scrubbed":65,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:02:02.860252+0000","scrub_duration":591,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":25,"num_read_kb":102400,"num_write":67,"num_write_kb":266241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"62'2","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:41.538008+0000","last_change":"2024-05-28T06:14:41.538008+0000","last_active":"2024-05-28T06:14:41.538008+0000","last_peered":"2024-05-28T06:14:41.538008+0000","last_clean":"2024-05-28T06:14:41.538008+0000","last_became_active":"2024-05-28T06:12:30.795350+0000","last_became_peered":"2024-05-28T06:12:30.795350+0000","last_unstale":"2024-05-28T06:14:41.538008+0000","last_undegraded":"2024-05-28T06:14:41.538008+0000","last_fullsized":"2024-05-28T06:14:41.538008+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-05-28T06:14:41.537890+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-05-28T06:14:41.537890+0000","last_clean_scrub_stamp":"2024-05-28T06:14:41.537890+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:01:16.695972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"62'196","reported_seq":302,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:44.061470+0000","last_change":"2024-05-28T06:14:44.061470+0000","last_active":"2024-05-28T06:14:44.061470+0000","last_peered":"2024-05-28T06:14:44.061470+0000","last_clean":"2024-05-28T06:14:44.061470+0000","last_became_active":"2024-05-28T06:12:31.794358+0000","last_became_peered":"2024-05-28T06:12:31.794358+0000","last_unstale":"2024-05-28T06:14:44.061470+0000","last_undegraded":"2024-05-28T06:14:44.061470+0000","last_fullsized":"2024-05-28T06:14:44.061470+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'196","last_scrub_stamp":"2024-05-28T06:14:44.061262+0000","last_deep_scrub":"62'196","last_deep_scrub_stamp":"2024-05-28T06:14:44.061262+0000","last_clean_scrub_stamp":"2024-05-28T06:14:44.061262+0000","objects_scrubbed":86,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:18:51.887652+0000","scrub_duration":867,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356515972,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":81,"num_read_kb":327681,"num_write":86,"num_write_kb":348161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"62'3","reported_seq":27,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:37.608738+0000","last_change":"2024-05-28T06:14:37.608738+0000","last_active":"2024-05-28T06:14:37.608738+0000","last_peered":"2024-05-28T06:14:37.608738+0000","last_clean":"2024-05-28T06:14:37.608738+0000","last_became_active":"2024-05-28T06:12:30.792705+0000","last_became_peered":"2024-05-28T06:12:30.792705+0000","last_unstale":"2024-05-28T06:14:37.608738+0000","last_undegraded":"2024-05-28T06:14:37.608738+0000","last_fullsized":"2024-05-28T06:14:37.608738+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'3","last_scrub_stamp":"2024-05-28T06:14:37.608622+0000","last_deep_scrub":"62'3","last_deep_scrub_stamp":"2024-05-28T06:14:37.608622+0000","last_clean_scrub_stamp":"2024-05-28T06:14:37.608622+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:47:46.792967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"62'150","reported_seq":235,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:36.996882+0000","last_change":"2024-05-28T06:14:36.996882+0000","last_active":"2024-05-28T06:14:36.996882+0000","last_peered":"2024-05-28T06:14:36.996882+0000","last_clean":"2024-05-28T06:14:36.996882+0000","last_became_active":"2024-05-28T06:12:31.790509+0000","last_became_peered":"2024-05-28T06:12:31.790509+0000","last_unstale":"2024-05-28T06:14:36.996882+0000","last_undegraded":"2024-05-28T06:14:36.996882+0000","last_fullsized":"2024-05-28T06:14:36.996882+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'150","last_scrub_stamp":"2024-05-28T06:14:36.996772+0000","last_deep_scrub":"62'150","last_deep_scrub_stamp":"2024-05-28T06:14:36.996772+0000","last_clean_scrub_stamp":"2024-05-28T06:14:36.996772+0000","objects_scrubbed":61,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:55:39.215132+0000","scrub_duration":519,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658501,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":61,"num_read_kb":233476,"num_write":65,"num_write_kb":245763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"62'2","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:41.154150+0000","last_change":"2024-05-28T06:14:41.154150+0000","last_active":"2024-05-28T06:14:41.154150+0000","last_peered":"2024-05-28T06:14:41.154150+0000","last_clean":"2024-05-28T06:14:41.154150+0000","last_became_active":"2024-05-28T06:12:30.795903+0000","last_became_peered":"2024-05-28T06:12:30.795903+0000","last_unstale":"2024-05-28T06:14:41.154150+0000","last_undegraded":"2024-05-28T06:14:41.154150+0000","last_fullsized":"2024-05-28T06:14:41.154150+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-05-28T06:14:41.154048+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-05-28T06:14:41.154048+0000","last_clean_scrub_stamp":"2024-05-28T06:14:41.154048+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:41:20.313313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"62'90","reported_seq":183,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:37.191426+0000","last_change":"2024-05-28T06:12:31.809139+0000","last_active":"2024-05-28T06:14:37.191426+0000","last_peered":"2024-05-28T06:14:37.191426+0000","last_clean":"2024-05-28T06:14:37.191426+0000","last_became_active":"2024-05-28T06:12:31.807373+0000","last_became_peered":"2024-05-28T06:12:31.807373+0000","last_unstale":"2024-05-28T06:14:37.191426+0000","last_undegraded":"2024-05-28T06:14:37.191426+0000","last_fullsized":"2024-05-28T06:14:37.191426+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":79,"num_read_kb":323584,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:38.652951+0000","last_change":"2024-05-28T06:14:38.652951+0000","last_active":"2024-05-28T06:14:38.652951+0000","last_peered":"2024-05-28T06:14:38.652951+0000","last_clean":"2024-05-28T06:14:38.652951+0000","last_became_active":"2024-05-28T06:12:30.793587+0000","last_became_peered":"2024-05-28T06:12:30.793587+0000","last_unstale":"2024-05-28T06:14:38.652951+0000","last_undegraded":"2024-05-28T06:14:38.652951+0000","last_fullsized":"2024-05-28T06:14:38.652951+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:38.652850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:38.652850+0000","last_clean_scrub_stamp":"2024-05-28T06:14:38.652850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:41:17.812116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"62'212","reported_seq":317,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:45.220550+0000","last_change":"2024-05-28T06:14:45.220618+0000","last_active":"2024-05-28T06:14:45.220550+0000","last_peered":"2024-05-28T06:14:45.220550+0000","last_clean":"2024-05-28T06:14:45.220550+0000","last_became_active":"2024-05-28T06:12:31.793880+0000","last_became_peered":"2024-05-28T06:12:31.793880+0000","last_unstale":"2024-05-28T06:14:45.220550+0000","last_undegraded":"2024-05-28T06:14:45.220550+0000","last_fullsized":"2024-05-28T06:14:45.220550+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'212","last_scrub_stamp":"2024-05-28T06:14:45.220456+0000","last_deep_scrub":"62'212","last_deep_scrub_stamp":"2024-05-28T06:14:45.220456+0000","last_clean_scrub_stamp":"2024-05-28T06:14:45.220456+0000","objects_scrubbed":97,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:34:55.719461+0000","scrub_duration":1067,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406847488,"num_objects":97,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":80,"num_read_kb":327680,"num_write":97,"num_write_kb":397312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"62'4","reported_seq":28,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:39.607163+0000","last_change":"2024-05-28T06:14:39.607163+0000","last_active":"2024-05-28T06:14:39.607163+0000","last_peered":"2024-05-28T06:14:39.607163+0000","last_clean":"2024-05-28T06:14:39.607163+0000","last_became_active":"2024-05-28T06:12:30.793922+0000","last_became_peered":"2024-05-28T06:12:30.793922+0000","last_unstale":"2024-05-28T06:14:39.607163+0000","last_undegraded":"2024-05-28T06:14:39.607163+0000","last_fullsized":"2024-05-28T06:14:39.607163+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-05-28T06:14:39.607013+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-05-28T06:14:39.607013+0000","last_clean_scrub_stamp":"2024-05-28T06:14:39.607013+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:55:35.493977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"62'179","reported_seq":270,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:44.487910+0000","last_change":"2024-05-28T06:14:44.487910+0000","last_active":"2024-05-28T06:14:44.487910+0000","last_peered":"2024-05-28T06:14:44.487910+0000","last_clean":"2024-05-28T06:14:44.487910+0000","last_became_active":"2024-05-28T06:12:31.796849+0000","last_became_peered":"2024-05-28T06:12:31.796849+0000","last_unstale":"2024-05-28T06:14:44.487910+0000","last_undegraded":"2024-05-28T06:14:44.487910+0000","last_fullsized":"2024-05-28T06:14:44.487910+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'179","last_scrub_stamp":"2024-05-28T06:14:44.487805+0000","last_deep_scrub":"62'179","last_deep_scrub_stamp":"2024-05-28T06:14:44.487805+0000","last_clean_scrub_stamp":"2024-05-28T06:14:44.487805+0000","objects_scrubbed":75,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:00:58.777204+0000","scrub_duration":795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":66,"num_read_kb":249861,"num_write":79,"num_write_kb":307202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:36.508873+0000","last_change":"2024-05-28T06:14:36.508873+0000","last_active":"2024-05-28T06:14:36.508873+0000","last_peered":"2024-05-28T06:14:36.508873+0000","last_clean":"2024-05-28T06:14:36.508873+0000","last_became_active":"2024-05-28T06:12:30.794505+0000","last_became_peered":"2024-05-28T06:12:30.794505+0000","last_unstale":"2024-05-28T06:14:36.508873+0000","last_undegraded":"2024-05-28T06:14:36.508873+0000","last_fullsized":"2024-05-28T06:14:36.508873+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:36.508756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:36.508756+0000","last_clean_scrub_stamp":"2024-05-28T06:14:36.508756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:06:20.652368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"62'161","reported_seq":243,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:48.300622+0000","last_change":"2024-05-28T06:14:48.300685+0000","last_active":"2024-05-28T06:14:48.300622+0000","last_peered":"2024-05-28T06:14:48.300622+0000","last_clean":"2024-05-28T06:14:48.300622+0000","last_became_active":"2024-05-28T06:12:31.801961+0000","last_became_peered":"2024-05-28T06:12:31.801961+0000","last_unstale":"2024-05-28T06:14:48.300622+0000","last_undegraded":"2024-05-28T06:14:48.300622+0000","last_fullsized":"2024-05-28T06:14:48.300622+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'161","last_scrub_stamp":"2024-05-28T06:14:48.300504+0000","last_deep_scrub":"62'161","last_deep_scrub_stamp":"2024-05-28T06:14:48.300504+0000","last_clean_scrub_stamp":"2024-05-28T06:14:48.300504+0000","objects_scrubbed":69,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:55:50.518863+0000","scrub_duration":595,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":58,"num_read_kb":237568,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:36.088776+0000","last_change":"2024-05-28T06:14:36.088776+0000","last_active":"2024-05-28T06:14:36.088776+0000","last_peered":"2024-05-28T06:14:36.088776+0000","last_clean":"2024-05-28T06:14:36.088776+0000","last_became_active":"2024-05-28T06:12:30.790513+0000","last_became_peered":"2024-05-28T06:12:30.790513+0000","last_unstale":"2024-05-28T06:14:36.088776+0000","last_undegraded":"2024-05-28T06:14:36.088776+0000","last_fullsized":"2024-05-28T06:14:36.088776+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:36.088624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:36.088624+0000","last_clean_scrub_stamp":"2024-05-28T06:14:36.088624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:09:58.576312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"62'184","reported_seq":247,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:49.794929+0000","last_change":"2024-05-28T06:14:49.794956+0000","last_active":"2024-05-28T06:14:49.794929+0000","last_peered":"2024-05-28T06:14:49.794929+0000","last_clean":"2024-05-28T06:14:49.794929+0000","last_became_active":"2024-05-28T06:12:31.803936+0000","last_became_peered":"2024-05-28T06:12:31.803936+0000","last_unstale":"2024-05-28T06:14:49.794929+0000","last_undegraded":"2024-05-28T06:14:49.794929+0000","last_fullsized":"2024-05-28T06:14:49.794929+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'184","last_scrub_stamp":"2024-05-28T06:14:49.794861+0000","last_deep_scrub":"62'184","last_deep_scrub_stamp":"2024-05-28T06:14:49.794861+0000","last_clean_scrub_stamp":"2024-05-28T06:14:49.794861+0000","objects_scrubbed":80,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:32:12.357079+0000","scrub_duration":631,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":38,"num_read_kb":155648,"num_write":80,"num_write_kb":327680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"62'3","reported_seq":27,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:37.491008+0000","last_change":"2024-05-28T06:14:37.491008+0000","last_active":"2024-05-28T06:14:37.491008+0000","last_peered":"2024-05-28T06:14:37.491008+0000","last_clean":"2024-05-28T06:14:37.491008+0000","last_became_active":"2024-05-28T06:12:30.797794+0000","last_became_peered":"2024-05-28T06:12:30.797794+0000","last_unstale":"2024-05-28T06:14:37.491008+0000","last_undegraded":"2024-05-28T06:14:37.491008+0000","last_fullsized":"2024-05-28T06:14:37.491008+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'3","last_scrub_stamp":"2024-05-28T06:14:37.490911+0000","last_deep_scrub":"62'3","last_deep_scrub_stamp":"2024-05-28T06:14:37.490911+0000","last_clean_scrub_stamp":"2024-05-28T06:14:37.490911+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:07:20.527102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"62'191","reported_seq":296,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:47.855995+0000","last_change":"2024-05-28T06:14:47.856075+0000","last_active":"2024-05-28T06:14:47.855995+0000","last_peered":"2024-05-28T06:14:47.855995+0000","last_clean":"2024-05-28T06:14:47.855995+0000","last_became_active":"2024-05-28T06:12:31.799714+0000","last_became_peered":"2024-05-28T06:12:31.799714+0000","last_unstale":"2024-05-28T06:14:47.855995+0000","last_undegraded":"2024-05-28T06:14:47.855995+0000","last_fullsized":"2024-05-28T06:14:47.855995+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'191","last_scrub_stamp":"2024-05-28T06:14:47.855879+0000","last_deep_scrub":"62'191","last_deep_scrub_stamp":"2024-05-28T06:14:47.855879+0000","last_clean_scrub_stamp":"2024-05-28T06:14:47.855879+0000","objects_scrubbed":86,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:03:02.589898+0000","scrub_duration":747,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360710144,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":80,"num_read_kb":327680,"num_write":86,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"62'41","reported_seq":65,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:35.617884+0000","last_change":"2024-05-28T06:14:35.617884+0000","last_active":"2024-05-28T06:14:35.617884+0000","last_peered":"2024-05-28T06:14:35.617884+0000","last_clean":"2024-05-28T06:14:35.617884+0000","last_became_active":"2024-05-28T06:12:30.790486+0000","last_became_peered":"2024-05-28T06:12:30.790486+0000","last_unstale":"2024-05-28T06:14:35.617884+0000","last_undegraded":"2024-05-28T06:14:35.617884+0000","last_fullsized":"2024-05-28T06:14:35.617884+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'41","last_scrub_stamp":"2024-05-28T06:14:35.617750+0000","last_deep_scrub":"62'41","last_deep_scrub_stamp":"2024-05-28T06:14:35.617750+0000","last_clean_scrub_stamp":"2024-05-28T06:14:35.617750+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:32:17.749980+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1176,"num_omap_keys":20,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"62'184","reported_seq":304,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:40.328476+0000","last_change":"2024-05-28T06:14:40.328532+0000","last_active":"2024-05-28T06:14:40.328476+0000","last_peered":"2024-05-28T06:14:40.328476+0000","last_clean":"2024-05-28T06:14:40.328476+0000","last_became_active":"2024-05-28T06:12:31.789316+0000","last_became_peered":"2024-05-28T06:12:31.789316+0000","last_unstale":"2024-05-28T06:14:40.328476+0000","last_undegraded":"2024-05-28T06:14:40.328476+0000","last_fullsized":"2024-05-28T06:14:40.328476+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'184","last_scrub_stamp":"2024-05-28T06:14:40.328367+0000","last_deep_scrub":"62'184","last_deep_scrub_stamp":"2024-05-28T06:14:40.328367+0000","last_clean_scrub_stamp":"2024-05-28T06:14:40.328367+0000","objects_scrubbed":81,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:08:10.303288+0000","scrub_duration":779,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339738624,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":95,"num_read_kb":385025,"num_write":83,"num_write_kb":331777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:36.592502+0000","last_change":"2024-05-28T06:14:36.592502+0000","last_active":"2024-05-28T06:14:36.592502+0000","last_peered":"2024-05-28T06:14:36.592502+0000","last_clean":"2024-05-28T06:14:36.592502+0000","last_became_active":"2024-05-28T06:12:30.791296+0000","last_became_peered":"2024-05-28T06:12:30.791296+0000","last_unstale":"2024-05-28T06:14:36.592502+0000","last_undegraded":"2024-05-28T06:14:36.592502+0000","last_fullsized":"2024-05-28T06:14:36.592502+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:36.592386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:36.592386+0000","last_clean_scrub_stamp":"2024-05-28T06:14:36.592386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:59:20.232961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"62'195","reported_seq":268,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:45.668842+0000","last_change":"2024-05-28T06:14:45.668884+0000","last_active":"2024-05-28T06:14:45.668842+0000","last_peered":"2024-05-28T06:14:45.668842+0000","last_clean":"2024-05-28T06:14:45.668842+0000","last_became_active":"2024-05-28T06:12:31.799396+0000","last_became_peered":"2024-05-28T06:12:31.799396+0000","last_unstale":"2024-05-28T06:14:45.668842+0000","last_undegraded":"2024-05-28T06:14:45.668842+0000","last_fullsized":"2024-05-28T06:14:45.668842+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'195","last_scrub_stamp":"2024-05-28T06:14:45.668768+0000","last_deep_scrub":"62'195","last_deep_scrub_stamp":"2024-05-28T06:14:45.668768+0000","last_clean_scrub_stamp":"2024-05-28T06:14:45.668768+0000","objects_scrubbed":88,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:03:00.402786+0000","scrub_duration":983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356516084,"num_objects":88,"num_object_clones":1,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":1,"num_read":49,"num_read_kb":200704,"num_write":88,"num_write_kb":348162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:37.092962+0000","last_change":"2024-05-28T06:14:37.092962+0000","last_active":"2024-05-28T06:14:37.092962+0000","last_peered":"2024-05-28T06:14:37.092962+0000","last_clean":"2024-05-28T06:14:37.092962+0000","last_became_active":"2024-05-28T06:12:30.790609+0000","last_became_peered":"2024-05-28T06:12:30.790609+0000","last_unstale":"2024-05-28T06:14:37.092962+0000","last_undegraded":"2024-05-28T06:14:37.092962+0000","last_fullsized":"2024-05-28T06:14:37.092962+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:37.092853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:37.092853+0000","last_clean_scrub_stamp":"2024-05-28T06:14:37.092853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:14:48.723676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"62'199","reported_seq":283,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:47.292001+0000","last_change":"2024-05-28T06:14:47.292037+0000","last_active":"2024-05-28T06:14:47.292001+0000","last_peered":"2024-05-28T06:14:47.292001+0000","last_clean":"2024-05-28T06:14:47.292001+0000","last_became_active":"2024-05-28T06:12:31.792189+0000","last_became_peered":"2024-05-28T06:12:31.792189+0000","last_unstale":"2024-05-28T06:14:47.292001+0000","last_undegraded":"2024-05-28T06:14:47.292001+0000","last_fullsized":"2024-05-28T06:14:47.292001+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'199","last_scrub_stamp":"2024-05-28T06:14:47.291931+0000","last_deep_scrub":"62'199","last_deep_scrub_stamp":"2024-05-28T06:14:47.291931+0000","last_clean_scrub_stamp":"2024-05-28T06:14:47.291931+0000","objects_scrubbed":86,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:54:58.192899+0000","scrub_duration":723,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360710144,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":59,"num_read_kb":241664,"num_write":86,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:34.434393+0000","last_change":"2024-05-28T06:14:34.434393+0000","last_active":"2024-05-28T06:14:34.434393+0000","last_peered":"2024-05-28T06:14:34.434393+0000","last_clean":"2024-05-28T06:14:34.434393+0000","last_became_active":"2024-05-28T06:12:30.786731+0000","last_became_peered":"2024-05-28T06:12:30.786731+0000","last_unstale":"2024-05-28T06:14:34.434393+0000","last_undegraded":"2024-05-28T06:14:34.434393+0000","last_fullsized":"2024-05-28T06:14:34.434393+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:34.434294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:34.434294+0000","last_clean_scrub_stamp":"2024-05-28T06:14:34.434294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T18:07:48.479666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"62'209","reported_seq":320,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:46.748090+0000","last_change":"2024-05-28T06:14:46.748172+0000","last_active":"2024-05-28T06:14:46.748090+0000","last_peered":"2024-05-28T06:14:46.748090+0000","last_clean":"2024-05-28T06:14:46.748090+0000","last_became_active":"2024-05-28T06:12:31.803980+0000","last_became_peered":"2024-05-28T06:12:31.803980+0000","last_unstale":"2024-05-28T06:14:46.748090+0000","last_undegraded":"2024-05-28T06:14:46.748090+0000","last_fullsized":"2024-05-28T06:14:46.748090+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'209","last_scrub_stamp":"2024-05-28T06:14:46.748004+0000","last_deep_scrub":"62'209","last_deep_scrub_stamp":"2024-05-28T06:14:46.748004+0000","last_clean_scrub_stamp":"2024-05-28T06:14:46.748004+0000","objects_scrubbed":93,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:31.843956+0000","scrub_duration":891,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390070272,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":86,"num_read_kb":339971,"num_write":95,"num_write_kb":380929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:36.163583+0000","last_change":"2024-05-28T06:14:36.163583+0000","last_active":"2024-05-28T06:14:36.163583+0000","last_peered":"2024-05-28T06:14:36.163583+0000","last_clean":"2024-05-28T06:14:36.163583+0000","last_became_active":"2024-05-28T06:12:30.789856+0000","last_became_peered":"2024-05-28T06:12:30.789856+0000","last_unstale":"2024-05-28T06:14:36.163583+0000","last_undegraded":"2024-05-28T06:14:36.163583+0000","last_fullsized":"2024-05-28T06:14:36.163583+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:36.163438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:36.163438+0000","last_clean_scrub_stamp":"2024-05-28T06:14:36.163438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:03:21.062560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"62'205","reported_seq":305,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:44.467174+0000","last_change":"2024-05-28T06:14:44.467228+0000","last_active":"2024-05-28T06:14:44.467174+0000","last_peered":"2024-05-28T06:14:44.467174+0000","last_clean":"2024-05-28T06:14:44.467174+0000","last_became_active":"2024-05-28T06:12:31.801228+0000","last_became_peered":"2024-05-28T06:12:31.801228+0000","last_unstale":"2024-05-28T06:14:44.467174+0000","last_undegraded":"2024-05-28T06:14:44.467174+0000","last_fullsized":"2024-05-28T06:14:44.467174+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'205","last_scrub_stamp":"2024-05-28T06:14:44.467096+0000","last_deep_scrub":"62'205","last_deep_scrub_stamp":"2024-05-28T06:14:44.467096+0000","last_clean_scrub_stamp":"2024-05-28T06:14:44.467096+0000","objects_scrubbed":94,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:32:22.782273+0000","scrub_duration":975,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394264576,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":75,"num_read_kb":307200,"num_write":94,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"62'32","reported_seq":86,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:35.471679+0000","last_change":"2024-05-28T06:14:35.471679+0000","last_active":"2024-05-28T06:14:35.471679+0000","last_peered":"2024-05-28T06:14:35.471679+0000","last_clean":"2024-05-28T06:14:35.471679+0000","last_became_active":"2024-05-28T06:12:30.790623+0000","last_became_peered":"2024-05-28T06:12:30.790623+0000","last_unstale":"2024-05-28T06:14:35.471679+0000","last_undegraded":"2024-05-28T06:14:35.471679+0000","last_fullsized":"2024-05-28T06:14:35.471679+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'32","last_scrub_stamp":"2024-05-28T06:14:35.471570+0000","last_deep_scrub":"62'32","last_deep_scrub_stamp":"2024-05-28T06:14:35.471570+0000","last_clean_scrub_stamp":"2024-05-28T06:14:35.471570+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:26:34.736396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4250,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":30,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"62'101","reported_seq":193,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:34.745833+0000","last_change":"2024-05-28T06:12:31.803993+0000","last_active":"2024-05-28T06:14:34.745833+0000","last_peered":"2024-05-28T06:14:34.745833+0000","last_clean":"2024-05-28T06:14:34.745833+0000","last_became_active":"2024-05-28T06:12:31.803709+0000","last_became_peered":"2024-05-28T06:12:31.803709+0000","last_unstale":"2024-05-28T06:14:34.745833+0000","last_undegraded":"2024-05-28T06:14:34.745833+0000","last_fullsized":"2024-05-28T06:14:34.745833+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:12:30.764418+0000","last_clean_scrub_stamp":"2024-05-28T06:12:30.764418+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360710144,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":78,"num_read_kb":319488,"num_write":86,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:38.564811+0000","last_change":"2024-05-28T06:14:38.564829+0000","last_active":"2024-05-28T06:14:38.564811+0000","last_peered":"2024-05-28T06:14:38.564811+0000","last_clean":"2024-05-28T06:14:38.564811+0000","last_became_active":"2024-05-28T06:12:30.793086+0000","last_became_peered":"2024-05-28T06:12:30.793086+0000","last_unstale":"2024-05-28T06:14:38.564811+0000","last_undegraded":"2024-05-28T06:14:38.564811+0000","last_fullsized":"2024-05-28T06:14:38.564811+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:38.564740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:38.564740+0000","last_clean_scrub_stamp":"2024-05-28T06:14:38.564740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:07:42.516064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"62'207","reported_seq":278,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:46.323594+0000","last_change":"2024-05-28T06:14:46.323651+0000","last_active":"2024-05-28T06:14:46.323594+0000","last_peered":"2024-05-28T06:14:46.323594+0000","last_clean":"2024-05-28T06:14:46.323594+0000","last_became_active":"2024-05-28T06:12:31.789082+0000","last_became_peered":"2024-05-28T06:12:31.789082+0000","last_unstale":"2024-05-28T06:14:46.323594+0000","last_undegraded":"2024-05-28T06:14:46.323594+0000","last_fullsized":"2024-05-28T06:14:46.323594+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'207","last_scrub_stamp":"2024-05-28T06:14:46.323526+0000","last_deep_scrub":"62'207","last_deep_scrub_stamp":"2024-05-28T06:14:46.323526+0000","last_clean_scrub_stamp":"2024-05-28T06:14:46.323526+0000","objects_scrubbed":86,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:38:19.399667+0000","scrub_duration":803,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356515972,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":46,"num_read_kb":180226,"num_write":88,"num_write_kb":348162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:38.496998+0000","last_change":"2024-05-28T06:14:38.496998+0000","last_active":"2024-05-28T06:14:38.496998+0000","last_peered":"2024-05-28T06:14:38.496998+0000","last_clean":"2024-05-28T06:14:38.496998+0000","last_became_active":"2024-05-28T06:12:30.795716+0000","last_became_peered":"2024-05-28T06:12:30.795716+0000","last_unstale":"2024-05-28T06:14:38.496998+0000","last_undegraded":"2024-05-28T06:14:38.496998+0000","last_fullsized":"2024-05-28T06:14:38.496998+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:38.496892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:38.496892+0000","last_clean_scrub_stamp":"2024-05-28T06:14:38.496892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:22:14.274156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"62'119","reported_seq":259,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:37.946891+0000","last_change":"2024-05-28T06:14:37.946920+0000","last_active":"2024-05-28T06:14:37.946891+0000","last_peered":"2024-05-28T06:14:37.946891+0000","last_clean":"2024-05-28T06:14:37.946891+0000","last_became_active":"2024-05-28T06:05:38.514745+0000","last_became_peered":"2024-05-28T06:05:38.514745+0000","last_unstale":"2024-05-28T06:14:37.946891+0000","last_undegraded":"2024-05-28T06:14:37.946891+0000","last_fullsized":"2024-05-28T06:14:37.946891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'119","last_scrub_stamp":"2024-05-28T06:14:37.946817+0000","last_deep_scrub":"62'119","last_deep_scrub_stamp":"2024-05-28T06:14:37.946817+0000","last_clean_scrub_stamp":"2024-05-28T06:14:37.946817+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:20:20.814201+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":20426262164,"num_objects":4880,"num_object_clones":1,"num_object_copies":9760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4880,"num_whiteouts":1,"num_read":4170,"num_read_kb":16875570,"num_write":4948,"num_write_kb":19947563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40852594688,"data_stored":40852524328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11108,"ondisk_log_size":11108,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1671909,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":612,"num_write_kb":1879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6176,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3407872,"data_stored":3343818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":578,"ondisk_log_size":578,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574963,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5944760,"kb_used_data":5891376,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":88427080,"statfs":{"total":96636764160,"available":90549329920,"internally_reserved":0,"allocated":6032769024,"data_stored":6032315492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574963,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3847008,"kb_used_data":3793624,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":90524832,"statfs":{"total":96636764160,"available":92697427968,"internally_reserved":0,"allocated":3884670976,"data_stored":3884240533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574962,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4842296,"kb_used_data":4793072,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":89529544,"statfs":{"total":96636764160,"available":91678253056,"internally_reserved":0,"allocated":4908105728,"data_stored":4907651869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574961,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4073928,"kb_used_data":4020544,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":90297912,"statfs":{"total":96636764160,"available":92465061888,"internally_reserved":0,"allocated":4117037056,"data_stored":4116594375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574964,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6509496,"kb_used_data":6451952,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":87862344,"statfs":{"total":96636764160,"available":89971040256,"internally_reserved":0,"allocated":6606798848,"data_stored":6606344671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574963,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3781416,"kb_used_data":3732192,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":90590424,"statfs":{"total":96636764160,"available":92764594176,"internally_reserved":0,"allocated":3821764608,"data_stored":3821326029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574963,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5935988,"kb_used_data":5882604,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":88435852,"statfs":{"total":96636764160,"available":90558312448,"internally_reserved":0,"allocated":6023786496,"data_stored":6023340306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574962,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5397604,"kb_used_data":5340060,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":88974236,"statfs":{"total":96636764160,"available":91109617664,"internally_reserved":0,"allocated":5468221440,"data_stored":5467755839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1687552,"data_stored":1671693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1675264,"data_stored":1666861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5465194496,"data_stored":5465178749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6023028736,"data_stored":6023020937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3821010944,"data_stored":3821010944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6606045184,"data_stored":6606029586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4114616320,"data_stored":4114612485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4907352064,"data_stored":4907336188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3883925504,"data_stored":3883925504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6031421440,"data_stored":6031409935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-28T06:14:57.942 INFO:tasks.ceph:pgid 9.19 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:57.942 INFO:tasks.ceph:pgid 9.d last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:57.942 INFO:tasks.ceph:pgid 9.1 last_scrub_stamp 2024-05-28T06:12:30.764418+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=12, tm_sec=30, tm_wday=1, tm_yday=149, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=28, tm_hour=6, tm_min=14, tm_sec=31, tm_wday=1, tm_yday=149, tm_isdst=0) 2024-05-28T06:14:57.943 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-28T06:15:17.944 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-28T06:15:18.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.092+0000 7f43b8000640 1 Processor -- start 2024-05-28T06:15:18.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.092+0000 7f43b8000640 1 -- start start 2024-05-28T06:15:18.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.092+0000 7f43b8000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f43b01460c0 0x7f43b00ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:15:18.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.092+0000 7f43b8000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43b00ce760 0x7f43b00b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:15:18.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.092+0000 7f43b8000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43b01464a0 con 0x7f43b00b3b30 2024-05-28T06:15:18.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.092+0000 7f43b8000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f43b015cbf0 con 0x7f43b01460c0 2024-05-28T06:15:18.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.092+0000 7f43b8000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f43b00cebe0 con 0x7f43b00ce760 2024-05-28T06:15:18.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.092+0000 7f43b5600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f43b01460c0 0x7f43b00ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:15:18.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.092+0000 7f43b6000640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f43b00b3b30 0x7f43b006b990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:60626/0 (socket says 172.21.15.122:60626) 2024-05-28T06:15:18.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.092+0000 7f43b6000640 1 -- 172.21.15.122:0/323648962 learned_addr learned my addr 172.21.15.122:0/323648962 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:15:18.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.092+0000 7f43b4c00640 1 --2- 172.21.15.122:0/323648962 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43b00ce760 0x7f43b00b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:15:18.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.092+0000 7f43b5600640 1 -- 172.21.15.122:0/323648962 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43b00ce760 msgr2=0x7f43b00b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:15:18.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.092+0000 7f43b5600640 1 --2- 172.21.15.122:0/323648962 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43b00ce760 0x7f43b00b35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.092+0000 7f43b5600640 1 -- 172.21.15.122:0/323648962 >> v1:172.21.15.122:6789/0 conn(0x7f43b00b3b30 legacy=0x7f43b006b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:15:18.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.092+0000 7f43b5600640 1 -- 172.21.15.122:0/323648962 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b00d05c0 con 0x7f43b01460c0 2024-05-28T06:15:18.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.092+0000 7f43afe00640 1 -- 172.21.15.122:0/323648962 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1330421815 0 0) 0x7f43a80014a0 con 0x7f43b00b3b30 2024-05-28T06:15:18.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.092+0000 7f43b4c00640 1 --2- 172.21.15.122:0/323648962 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43b00ce760 0x7f43b00b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-28T06:15:18.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.096+0000 7f43b5600640 1 --2- 172.21.15.122:0/323648962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43b01460c0 0x7f43b00ce220 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f43a00097c0 tx=0x7f43a001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279e466971c902ef server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:15:18.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.096+0000 7f43afe00640 1 -- 172.21.15.122:0/323648962 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a00b0070 con 0x7f43b01460c0 2024-05-28T06:15:18.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.096+0000 7f43afe00640 1 -- 172.21.15.122:0/323648962 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a00a4e50 con 0x7f43b01460c0 2024-05-28T06:15:18.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.096+0000 7f43afe00640 1 -- 172.21.15.122:0/323648962 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a00ab820 con 0x7f43b01460c0 2024-05-28T06:15:18.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.096+0000 7f43b8000640 1 -- 172.21.15.122:0/323648962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43b01460c0 msgr2=0x7f43b00ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:15:18.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.096+0000 7f43b8000640 1 --2- 172.21.15.122:0/323648962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43b01460c0 0x7f43b00ce220 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f43a00097c0 tx=0x7f43a001c4a0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.096+0000 7f43b8000640 1 -- 172.21.15.122:0/323648962 shutdown_connections 2024-05-28T06:15:18.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.096+0000 7f43b8000640 1 --2- 172.21.15.122:0/323648962 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43b00ce760 0x7f43b00b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.096+0000 7f43b8000640 1 --2- 172.21.15.122:0/323648962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43b01460c0 0x7f43b00ce220 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.096+0000 7f43b8000640 1 -- 172.21.15.122:0/323648962 >> 172.21.15.122:0/323648962 conn(0x7f43b00b6c10 msgr2=0x7f43b00b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:15:18.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.096+0000 7f43b8000640 1 -- 172.21.15.122:0/323648962 shutdown_connections 2024-05-28T06:15:18.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.096+0000 7f43b8000640 1 -- 172.21.15.122:0/323648962 wait complete. 2024-05-28T06:15:18.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43b8000640 1 Processor -- start 2024-05-28T06:15:18.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43b8000640 1 -- start start 2024-05-28T06:15:18.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43b8000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43b00b3b30 0x7f43b015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:15:18.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43b8000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43b00ce760 0x7f43b0139c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:15:18.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43b8000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b01460c0 0x7f43b0141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:15:18.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43b8000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f43b00d10a0 con 0x7f43b00b3b30 2024-05-28T06:15:18.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43b8000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f43b00cde50 con 0x7f43b01460c0 2024-05-28T06:15:18.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43b8000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f43b0143bc0 con 0x7f43b00ce760 2024-05-28T06:15:18.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43b5600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43b00b3b30 0x7f43b015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:15:18.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43b5600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43b00b3b30 0x7f43b015a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:42416/0 (socket says 172.21.15.122:42416) 2024-05-28T06:15:18.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43b5600640 1 -- 172.21.15.122:0/3600183616 learned_addr learned my addr 172.21.15.122:0/3600183616 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:15:18.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43b4c00640 1 --2- 172.21.15.122:0/3600183616 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43b00ce760 0x7f43b0139c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:15:18.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43b6000640 1 --2- 172.21.15.122:0/3600183616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b01460c0 0x7f43b0141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:15:18.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43b5600640 1 -- 172.21.15.122:0/3600183616 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43b00ce760 msgr2=0x7f43b0139c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:15:18.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43b5600640 1 --2- 172.21.15.122:0/3600183616 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43b00ce760 0x7f43b0139c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43b5600640 1 -- 172.21.15.122:0/3600183616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b01460c0 msgr2=0x7f43b0141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:15:18.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43b5600640 1 --2- 172.21.15.122:0/3600183616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b01460c0 0x7f43b0141fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43b5600640 1 -- 172.21.15.122:0/3600183616 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b0138da0 con 0x7f43b00b3b30 2024-05-28T06:15:18.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43b6000640 1 --2- 172.21.15.122:0/3600183616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b01460c0 0x7f43b0141fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:15:18.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43b5600640 1 --2- 172.21.15.122:0/3600183616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43b00b3b30 0x7f43b015a2c0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f43a00097c0 tx=0x7f43a001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:15:18.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43ad600640 1 -- 172.21.15.122:0/3600183616 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a00bd070 con 0x7f43b00b3b30 2024-05-28T06:15:18.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43ad600640 1 -- 172.21.15.122:0/3600183616 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a0004030 con 0x7f43b00b3b30 2024-05-28T06:15:18.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43ad600640 1 -- 172.21.15.122:0/3600183616 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a00b0040 con 0x7f43b00b3b30 2024-05-28T06:15:18.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43b8000640 1 -- 172.21.15.122:0/3600183616 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b0139080 con 0x7f43b00b3b30 2024-05-28T06:15:18.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43b8000640 1 -- 172.21.15.122:0/3600183616 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b015a800 con 0x7f43b00b3b30 2024-05-28T06:15:18.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.100+0000 7f43b8000640 1 -- 172.21.15.122:0/3600183616 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43b0068c40 con 0x7f43b00b3b30 2024-05-28T06:15:18.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.104+0000 7f43ad600640 1 -- 172.21.15.122:0/3600183616 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 88752+0+0 (secure 0 0 0) 0x7f43a00c0070 con 0x7f43b00b3b30 2024-05-28T06:15:18.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.104+0000 7f43ad600640 1 --2- 172.21.15.122:0/3600183616 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4394068bf0 0x7f439406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:15:18.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.104+0000 7f43ad600640 1 -- 172.21.15.122:0/3600183616 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f43a01213d0 con 0x7f43b00b3b30 2024-05-28T06:15:18.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.104+0000 7f43b4c00640 1 --2- 172.21.15.122:0/3600183616 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4394068bf0 0x7f439406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:15:18.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.104+0000 7f43b4c00640 1 --2- 172.21.15.122:0/3600183616 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4394068bf0 0x7f439406b0b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f43b0138ac0 tx=0x7f43a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:15:18.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.108+0000 7f43ad600640 1 -- 172.21.15.122:0/3600183616 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f43a0016090 con 0x7f43b00b3b30 2024-05-28T06:15:18.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.260+0000 7f43b8000640 1 -- 172.21.15.122:0/3600183616 --> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f43b0076020 con 0x7f4394068bf0 2024-05-28T06:15:18.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.268+0000 7f43ad600640 1 -- 172.21.15.122:0/3600183616 <== mgr.4104 v2:172.21.15.122:6832/3134913340 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254959 (secure 0 0 0) 0x7f43a4010840 con 0x7f4394068bf0 2024-05-28T06:15:18.270 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:15:18.271 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-05-28T06:15:18.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.272+0000 7f43b8000640 1 -- 172.21.15.122:0/3600183616 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4394068bf0 msgr2=0x7f439406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:15:18.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.272+0000 7f43b8000640 1 --2- 172.21.15.122:0/3600183616 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4394068bf0 0x7f439406b0b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f43b0138ac0 tx=0x7f43a4008040 comp rx=0 tx=0).stop 2024-05-28T06:15:18.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.272+0000 7f43b8000640 1 -- 172.21.15.122:0/3600183616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43b00b3b30 msgr2=0x7f43b015a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:15:18.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.272+0000 7f43b8000640 1 --2- 172.21.15.122:0/3600183616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43b00b3b30 0x7f43b015a2c0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f43a00097c0 tx=0x7f43a001ace0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.272+0000 7f43b8000640 1 -- 172.21.15.122:0/3600183616 shutdown_connections 2024-05-28T06:15:18.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.272+0000 7f43b8000640 1 --2- 172.21.15.122:0/3600183616 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f4394068bf0 0x7f439406b0b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.272+0000 7f43b8000640 1 --2- 172.21.15.122:0/3600183616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b01460c0 0x7f43b0141fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.272+0000 7f43b8000640 1 --2- 172.21.15.122:0/3600183616 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f43b00ce760 0x7f43b0139c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.272+0000 7f43b8000640 1 --2- 172.21.15.122:0/3600183616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43b00b3b30 0x7f43b015a2c0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.272+0000 7f43b8000640 1 -- 172.21.15.122:0/3600183616 >> 172.21.15.122:0/3600183616 conn(0x7f43b00b6c10 msgr2=0x7f43b00b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:15:18.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.272+0000 7f43b8000640 1 -- 172.21.15.122:0/3600183616 shutdown_connections 2024-05-28T06:15:18.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.272+0000 7f43b8000640 1 -- 172.21.15.122:0/3600183616 wait complete. 2024-05-28T06:15:18.290 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2024-05-28T06:15:17.400718+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":20428532383,"num_objects":4905,"num_object_clones":1,"num_object_copies":9810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4905,"num_whiteouts":1,"num_read":4316,"num_read_kb":16875700,"num_write":5733,"num_write_kb":19951874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6176,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14046,"ondisk_log_size":14046,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":40336672,"kb_used_data":39905440,"kb_used_omap":12,"kb_used_meta":431155,"kb_avail":714638048,"statfs":{"total":773094113280,"available":731789361152,"internally_reserved":0,"allocated":40863170560,"data_stored":40859584998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":441503281},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003389"},"pg_stats":[{"pgid":"9.3f","version":"62'194","reported_seq":292,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.599564+0000","last_change":"2024-05-28T06:14:37.031589+0000","last_active":"2024-05-28T06:15:01.599564+0000","last_peered":"2024-05-28T06:15:01.599564+0000","last_clean":"2024-05-28T06:15:01.599564+0000","last_became_active":"2024-05-28T06:12:31.793751+0000","last_became_peered":"2024-05-28T06:12:31.793751+0000","last_unstale":"2024-05-28T06:15:01.599564+0000","last_undegraded":"2024-05-28T06:15:01.599564+0000","last_fullsized":"2024-05-28T06:15:01.599564+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'160","last_scrub_stamp":"2024-05-28T06:14:37.031417+0000","last_deep_scrub":"62'160","last_deep_scrub_stamp":"2024-05-28T06:14:37.031417+0000","last_clean_scrub_stamp":"2024-05-28T06:14:37.031417+0000","objects_scrubbed":66,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:32:40.357289+0000","scrub_duration":555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":74,"num_read_kb":303104,"num_write":66,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"62'211","reported_seq":308,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.596867+0000","last_change":"2024-05-28T06:14:50.331671+0000","last_active":"2024-05-28T06:15:01.596867+0000","last_peered":"2024-05-28T06:15:01.596867+0000","last_clean":"2024-05-28T06:15:01.596867+0000","last_became_active":"2024-05-28T06:12:31.798788+0000","last_became_peered":"2024-05-28T06:12:31.798788+0000","last_unstale":"2024-05-28T06:15:01.596867+0000","last_undegraded":"2024-05-28T06:15:01.596867+0000","last_fullsized":"2024-05-28T06:15:01.596867+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'179","last_scrub_stamp":"2024-05-28T06:14:50.331549+0000","last_deep_scrub":"62'179","last_deep_scrub_stamp":"2024-05-28T06:14:50.331549+0000","last_clean_scrub_stamp":"2024-05-28T06:14:50.331549+0000","objects_scrubbed":79,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:56:11.148345+0000","scrub_duration":639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":72,"num_read_kb":294912,"num_write":79,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"62'195","reported_seq":287,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.578144+0000","last_change":"2024-05-28T06:14:43.599237+0000","last_active":"2024-05-28T06:15:01.578144+0000","last_peered":"2024-05-28T06:15:01.578144+0000","last_clean":"2024-05-28T06:15:01.578144+0000","last_became_active":"2024-05-28T06:12:31.802019+0000","last_became_peered":"2024-05-28T06:12:31.802019+0000","last_unstale":"2024-05-28T06:15:01.578144+0000","last_undegraded":"2024-05-28T06:15:01.578144+0000","last_fullsized":"2024-05-28T06:15:01.578144+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'165","last_scrub_stamp":"2024-05-28T06:14:43.599058+0000","last_deep_scrub":"62'165","last_deep_scrub_stamp":"2024-05-28T06:14:43.599058+0000","last_clean_scrub_stamp":"2024-05-28T06:14:43.599058+0000","objects_scrubbed":69,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:41:22.758324+0000","scrub_duration":695,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":68,"num_read_kb":270338,"num_write":75,"num_write_kb":282627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"62'208","reported_seq":277,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.583352+0000","last_change":"2024-05-28T06:14:48.675994+0000","last_active":"2024-05-28T06:15:01.583352+0000","last_peered":"2024-05-28T06:15:01.583352+0000","last_clean":"2024-05-28T06:15:01.583352+0000","last_became_active":"2024-05-28T06:12:31.801804+0000","last_became_peered":"2024-05-28T06:12:31.801804+0000","last_unstale":"2024-05-28T06:15:01.583352+0000","last_undegraded":"2024-05-28T06:15:01.583352+0000","last_fullsized":"2024-05-28T06:15:01.583352+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'175","last_scrub_stamp":"2024-05-28T06:14:48.675900+0000","last_deep_scrub":"62'175","last_deep_scrub_stamp":"2024-05-28T06:14:48.675900+0000","last_clean_scrub_stamp":"2024-05-28T06:14:48.675900+0000","objects_scrubbed":77,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:26:28.370714+0000","scrub_duration":547,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322961408,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":44,"num_read_kb":180224,"num_write":77,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"62'168","reported_seq":232,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.585957+0000","last_change":"2024-05-28T06:14:39.024922+0000","last_active":"2024-05-28T06:15:01.585957+0000","last_peered":"2024-05-28T06:15:01.585957+0000","last_clean":"2024-05-28T06:15:01.585957+0000","last_became_active":"2024-05-28T06:12:31.798238+0000","last_became_peered":"2024-05-28T06:12:31.798238+0000","last_unstale":"2024-05-28T06:15:01.585957+0000","last_undegraded":"2024-05-28T06:15:01.585957+0000","last_fullsized":"2024-05-28T06:15:01.585957+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'132","last_scrub_stamp":"2024-05-28T06:14:39.024814+0000","last_deep_scrub":"62'132","last_deep_scrub_stamp":"2024-05-28T06:14:39.024814+0000","last_clean_scrub_stamp":"2024-05-28T06:14:39.024814+0000","objects_scrubbed":58,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:17:31.341316+0000","scrub_duration":463,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":40,"num_read_kb":163840,"num_write":58,"num_write_kb":237568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"62'230","reported_seq":346,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.592581+0000","last_change":"2024-05-28T06:14:42.450655+0000","last_active":"2024-05-28T06:15:01.592581+0000","last_peered":"2024-05-28T06:15:01.592581+0000","last_clean":"2024-05-28T06:15:01.592581+0000","last_became_active":"2024-05-28T06:12:31.790779+0000","last_became_peered":"2024-05-28T06:12:31.790779+0000","last_unstale":"2024-05-28T06:15:01.592581+0000","last_undegraded":"2024-05-28T06:15:01.592581+0000","last_fullsized":"2024-05-28T06:15:01.592581+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'194","last_scrub_stamp":"2024-05-28T06:14:42.450540+0000","last_deep_scrub":"62'194","last_deep_scrub_stamp":"2024-05-28T06:14:42.450540+0000","last_clean_scrub_stamp":"2024-05-28T06:14:42.450540+0000","objects_scrubbed":84,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:27.546492+0000","scrub_duration":691,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352321536,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":91,"num_read_kb":364546,"num_write":88,"num_write_kb":344066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"62'194","reported_seq":266,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.576359+0000","last_change":"2024-05-28T06:14:41.766964+0000","last_active":"2024-05-28T06:15:01.576359+0000","last_peered":"2024-05-28T06:15:01.576359+0000","last_clean":"2024-05-28T06:15:01.576359+0000","last_became_active":"2024-05-28T06:12:31.786592+0000","last_became_peered":"2024-05-28T06:12:31.786592+0000","last_unstale":"2024-05-28T06:15:01.576359+0000","last_undegraded":"2024-05-28T06:15:01.576359+0000","last_fullsized":"2024-05-28T06:15:01.576359+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'156","last_scrub_stamp":"2024-05-28T06:14:41.766741+0000","last_deep_scrub":"62'156","last_deep_scrub_stamp":"2024-05-28T06:14:41.766741+0000","last_clean_scrub_stamp":"2024-05-28T06:14:41.766741+0000","objects_scrubbed":63,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:14:53.397564+0000","scrub_duration":503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":48,"num_read_kb":196608,"num_write":63,"num_write_kb":258048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"62'188","reported_seq":264,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.595848+0000","last_change":"2024-05-28T06:14:45.431513+0000","last_active":"2024-05-28T06:15:01.595848+0000","last_peered":"2024-05-28T06:15:01.595848+0000","last_clean":"2024-05-28T06:15:01.595848+0000","last_became_active":"2024-05-28T06:12:31.788168+0000","last_became_peered":"2024-05-28T06:12:31.788168+0000","last_unstale":"2024-05-28T06:15:01.595848+0000","last_undegraded":"2024-05-28T06:15:01.595848+0000","last_fullsized":"2024-05-28T06:15:01.595848+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'171","last_scrub_stamp":"2024-05-28T06:14:45.431416+0000","last_deep_scrub":"62'171","last_deep_scrub_stamp":"2024-05-28T06:14:45.431416+0000","last_clean_scrub_stamp":"2024-05-28T06:14:45.431416+0000","objects_scrubbed":75,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:51:03.094030+0000","scrub_duration":863,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":51,"num_read_kb":208896,"num_write":75,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"62'227","reported_seq":307,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.581483+0000","last_change":"2024-05-28T06:14:40.914472+0000","last_active":"2024-05-28T06:15:01.581483+0000","last_peered":"2024-05-28T06:15:01.581483+0000","last_clean":"2024-05-28T06:15:01.581483+0000","last_became_active":"2024-05-28T06:12:31.783599+0000","last_became_peered":"2024-05-28T06:12:31.783599+0000","last_unstale":"2024-05-28T06:15:01.581483+0000","last_undegraded":"2024-05-28T06:15:01.581483+0000","last_fullsized":"2024-05-28T06:15:01.581483+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'187","last_scrub_stamp":"2024-05-28T06:14:40.914368+0000","last_deep_scrub":"62'187","last_deep_scrub_stamp":"2024-05-28T06:14:40.914368+0000","last_clean_scrub_stamp":"2024-05-28T06:14:40.914368+0000","objects_scrubbed":80,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:10:03.402056+0000","scrub_duration":655,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":55,"num_read_kb":221185,"num_write":82,"num_write_kb":327681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"62'186","reported_seq":273,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.132257+0000","last_change":"2024-05-28T06:14:42.046858+0000","last_active":"2024-05-28T06:15:01.132257+0000","last_peered":"2024-05-28T06:15:01.132257+0000","last_clean":"2024-05-28T06:15:01.132257+0000","last_became_active":"2024-05-28T06:12:31.793687+0000","last_became_peered":"2024-05-28T06:12:31.793687+0000","last_unstale":"2024-05-28T06:15:01.132257+0000","last_undegraded":"2024-05-28T06:15:01.132257+0000","last_fullsized":"2024-05-28T06:15:01.132257+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'157","last_scrub_stamp":"2024-05-28T06:14:42.046724+0000","last_deep_scrub":"62'157","last_deep_scrub_stamp":"2024-05-28T06:14:42.046724+0000","last_clean_scrub_stamp":"2024-05-28T06:14:42.046724+0000","objects_scrubbed":62,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:22:00.571020+0000","scrub_duration":551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":63,"num_read_kb":258048,"num_write":62,"num_write_kb":253952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"62'228","reported_seq":354,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.599841+0000","last_change":"2024-05-28T06:14:39.235458+0000","last_active":"2024-05-28T06:15:01.599841+0000","last_peered":"2024-05-28T06:15:01.599841+0000","last_clean":"2024-05-28T06:15:01.599841+0000","last_became_active":"2024-05-28T06:12:31.789337+0000","last_became_peered":"2024-05-28T06:12:31.789337+0000","last_unstale":"2024-05-28T06:15:01.599841+0000","last_undegraded":"2024-05-28T06:15:01.599841+0000","last_fullsized":"2024-05-28T06:15:01.599841+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'202","last_scrub_stamp":"2024-05-28T06:14:39.235335+0000","last_deep_scrub":"62'202","last_deep_scrub_stamp":"2024-05-28T06:14:39.235335+0000","last_clean_scrub_stamp":"2024-05-28T06:14:39.235335+0000","objects_scrubbed":91,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:05:05.294166+0000","scrub_duration":719,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381681664,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":101,"num_read_kb":413696,"num_write":91,"num_write_kb":372736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"62'194","reported_seq":317,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.567401+0000","last_change":"2024-05-28T06:14:46.808016+0000","last_active":"2024-05-28T06:15:01.567401+0000","last_peered":"2024-05-28T06:15:01.567401+0000","last_clean":"2024-05-28T06:15:01.567401+0000","last_became_active":"2024-05-28T06:12:31.796167+0000","last_became_peered":"2024-05-28T06:12:31.796167+0000","last_unstale":"2024-05-28T06:15:01.567401+0000","last_undegraded":"2024-05-28T06:15:01.567401+0000","last_fullsized":"2024-05-28T06:15:01.567401+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'165","last_scrub_stamp":"2024-05-28T06:14:46.807865+0000","last_deep_scrub":"62'165","last_deep_scrub_stamp":"2024-05-28T06:14:46.807865+0000","last_clean_scrub_stamp":"2024-05-28T06:14:46.807865+0000","objects_scrubbed":74,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:52:35.622047+0000","scrub_duration":663,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":99,"num_read_kb":389124,"num_write":76,"num_write_kb":303105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"62'209","reported_seq":317,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.574468+0000","last_change":"2024-05-28T06:14:41.244807+0000","last_active":"2024-05-28T06:15:01.574468+0000","last_peered":"2024-05-28T06:15:01.574468+0000","last_clean":"2024-05-28T06:15:01.574468+0000","last_became_active":"2024-05-28T06:12:31.799169+0000","last_became_peered":"2024-05-28T06:12:31.799169+0000","last_unstale":"2024-05-28T06:15:01.574468+0000","last_undegraded":"2024-05-28T06:15:01.574468+0000","last_fullsized":"2024-05-28T06:15:01.574468+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'189","last_scrub_stamp":"2024-05-28T06:14:41.244658+0000","last_deep_scrub":"62'189","last_deep_scrub_stamp":"2024-05-28T06:14:41.244658+0000","last_clean_scrub_stamp":"2024-05-28T06:14:41.244658+0000","objects_scrubbed":82,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:08:41.232512+0000","scrub_duration":747,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343932928,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":83,"num_read_kb":339968,"num_write":82,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"62'232","reported_seq":321,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.590830+0000","last_change":"2024-05-28T06:14:44.139020+0000","last_active":"2024-05-28T06:15:01.590830+0000","last_peered":"2024-05-28T06:15:01.590830+0000","last_clean":"2024-05-28T06:15:01.590830+0000","last_became_active":"2024-05-28T06:12:31.789907+0000","last_became_peered":"2024-05-28T06:12:31.789907+0000","last_unstale":"2024-05-28T06:15:01.590830+0000","last_undegraded":"2024-05-28T06:15:01.590830+0000","last_fullsized":"2024-05-28T06:15:01.590830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'201","last_scrub_stamp":"2024-05-28T06:14:44.138823+0000","last_deep_scrub":"62'201","last_deep_scrub_stamp":"2024-05-28T06:14:44.138823+0000","last_clean_scrub_stamp":"2024-05-28T06:14:44.138823+0000","objects_scrubbed":87,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:45:24.201560+0000","scrub_duration":867,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364904448,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":64,"num_read_kb":262144,"num_write":87,"num_write_kb":356352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"62'179","reported_seq":234,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.590223+0000","last_change":"2024-05-28T06:14:42.955884+0000","last_active":"2024-05-28T06:15:01.590223+0000","last_peered":"2024-05-28T06:15:01.590223+0000","last_clean":"2024-05-28T06:15:01.590223+0000","last_became_active":"2024-05-28T06:12:31.788073+0000","last_became_peered":"2024-05-28T06:12:31.788073+0000","last_unstale":"2024-05-28T06:15:01.590223+0000","last_undegraded":"2024-05-28T06:15:01.590223+0000","last_fullsized":"2024-05-28T06:15:01.590223+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'151","last_scrub_stamp":"2024-05-28T06:14:42.955738+0000","last_deep_scrub":"62'151","last_deep_scrub_stamp":"2024-05-28T06:14:42.955738+0000","last_clean_scrub_stamp":"2024-05-28T06:14:42.955738+0000","objects_scrubbed":63,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:32:25.087967+0000","scrub_duration":659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":31,"num_read_kb":126976,"num_write":63,"num_write_kb":258048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"62'187","reported_seq":265,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.576958+0000","last_change":"2024-05-28T06:14:47.243770+0000","last_active":"2024-05-28T06:15:01.576958+0000","last_peered":"2024-05-28T06:15:01.576958+0000","last_clean":"2024-05-28T06:15:01.576958+0000","last_became_active":"2024-05-28T06:12:31.800507+0000","last_became_peered":"2024-05-28T06:12:31.800507+0000","last_unstale":"2024-05-28T06:15:01.576958+0000","last_undegraded":"2024-05-28T06:15:01.576958+0000","last_fullsized":"2024-05-28T06:15:01.576958+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'155","last_scrub_stamp":"2024-05-28T06:14:47.243584+0000","last_deep_scrub":"62'155","last_deep_scrub_stamp":"2024-05-28T06:14:47.243584+0000","last_clean_scrub_stamp":"2024-05-28T06:14:47.243584+0000","objects_scrubbed":64,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:58:15.213046+0000","scrub_duration":563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":54,"num_read_kb":221184,"num_write":64,"num_write_kb":262144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"62'185","reported_seq":251,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.576173+0000","last_change":"2024-05-28T06:14:48.172042+0000","last_active":"2024-05-28T06:15:01.576173+0000","last_peered":"2024-05-28T06:15:01.576173+0000","last_clean":"2024-05-28T06:15:01.576173+0000","last_became_active":"2024-05-28T06:12:31.798292+0000","last_became_peered":"2024-05-28T06:12:31.798292+0000","last_unstale":"2024-05-28T06:15:01.576173+0000","last_undegraded":"2024-05-28T06:15:01.576173+0000","last_fullsized":"2024-05-28T06:15:01.576173+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'158","last_scrub_stamp":"2024-05-28T06:14:48.171857+0000","last_deep_scrub":"62'158","last_deep_scrub_stamp":"2024-05-28T06:14:48.171857+0000","last_clean_scrub_stamp":"2024-05-28T06:14:48.171857+0000","objects_scrubbed":65,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:37:08.338903+0000","scrub_duration":555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":42,"num_read_kb":172032,"num_write":67,"num_write_kb":266241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"62'211","reported_seq":330,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.584059+0000","last_change":"2024-05-28T06:14:48.471082+0000","last_active":"2024-05-28T06:15:01.584059+0000","last_peered":"2024-05-28T06:15:01.584059+0000","last_clean":"2024-05-28T06:15:01.584059+0000","last_became_active":"2024-05-28T06:12:31.805031+0000","last_became_peered":"2024-05-28T06:12:31.805031+0000","last_unstale":"2024-05-28T06:15:01.584059+0000","last_undegraded":"2024-05-28T06:15:01.584059+0000","last_fullsized":"2024-05-28T06:15:01.584059+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'193","last_scrub_stamp":"2024-05-28T06:14:48.470977+0000","last_deep_scrub":"62'193","last_deep_scrub_stamp":"2024-05-28T06:14:48.470977+0000","last_clean_scrub_stamp":"2024-05-28T06:14:48.470977+0000","objects_scrubbed":81,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:52:37.285159+0000","scrub_duration":651,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544581,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":94,"num_read_kb":372739,"num_write":85,"num_write_kb":327683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"62'230","reported_seq":322,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.598716+0000","last_change":"2024-05-28T06:14:35.146431+0000","last_active":"2024-05-28T06:15:01.598716+0000","last_peered":"2024-05-28T06:15:01.598716+0000","last_clean":"2024-05-28T06:15:01.598716+0000","last_became_active":"2024-05-28T06:12:31.792620+0000","last_became_peered":"2024-05-28T06:12:31.792620+0000","last_unstale":"2024-05-28T06:15:01.598716+0000","last_undegraded":"2024-05-28T06:15:01.598716+0000","last_fullsized":"2024-05-28T06:15:01.598716+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'202","last_scrub_stamp":"2024-05-28T06:14:35.146304+0000","last_deep_scrub":"62'202","last_deep_scrub_stamp":"2024-05-28T06:14:35.146304+0000","last_clean_scrub_stamp":"2024-05-28T06:14:35.146304+0000","objects_scrubbed":88,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:57:20.839758+0000","scrub_duration":643,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369098752,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":67,"num_read_kb":274432,"num_write":90,"num_write_kb":360449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"62'208","reported_seq":294,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.597902+0000","last_change":"2024-05-28T06:14:36.205009+0000","last_active":"2024-05-28T06:15:01.597902+0000","last_peered":"2024-05-28T06:15:01.597902+0000","last_clean":"2024-05-28T06:15:01.597902+0000","last_became_active":"2024-05-28T06:12:31.790044+0000","last_became_peered":"2024-05-28T06:12:31.790044+0000","last_unstale":"2024-05-28T06:15:01.597902+0000","last_undegraded":"2024-05-28T06:15:01.597902+0000","last_fullsized":"2024-05-28T06:15:01.597902+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'170","last_scrub_stamp":"2024-05-28T06:14:36.204854+0000","last_deep_scrub":"62'170","last_deep_scrub_stamp":"2024-05-28T06:14:36.204854+0000","last_clean_scrub_stamp":"2024-05-28T06:14:36.204854+0000","objects_scrubbed":71,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:58:04.174316+0000","scrub_duration":679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":62,"num_read_kb":253952,"num_write":71,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"62'212","reported_seq":332,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.580760+0000","last_change":"2024-05-28T06:14:42.730375+0000","last_active":"2024-05-28T06:15:01.580760+0000","last_peered":"2024-05-28T06:15:01.580760+0000","last_clean":"2024-05-28T06:15:01.580760+0000","last_became_active":"2024-05-28T06:12:31.798652+0000","last_became_peered":"2024-05-28T06:12:31.798652+0000","last_unstale":"2024-05-28T06:15:01.580760+0000","last_undegraded":"2024-05-28T06:15:01.580760+0000","last_fullsized":"2024-05-28T06:15:01.580760+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'186","last_scrub_stamp":"2024-05-28T06:14:42.730267+0000","last_deep_scrub":"62'186","last_deep_scrub_stamp":"2024-05-28T06:14:42.730267+0000","last_clean_scrub_stamp":"2024-05-28T06:14:42.730267+0000","objects_scrubbed":78,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:55:05.240860+0000","scrub_duration":779,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327155712,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":95,"num_read_kb":376835,"num_write":82,"num_write_kb":319490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"62'209","reported_seq":295,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.597926+0000","last_change":"2024-05-28T06:14:52.375453+0000","last_active":"2024-05-28T06:15:01.597926+0000","last_peered":"2024-05-28T06:15:01.597926+0000","last_clean":"2024-05-28T06:15:01.597926+0000","last_became_active":"2024-05-28T06:12:31.795520+0000","last_became_peered":"2024-05-28T06:12:31.795520+0000","last_unstale":"2024-05-28T06:15:01.597926+0000","last_undegraded":"2024-05-28T06:15:01.597926+0000","last_fullsized":"2024-05-28T06:15:01.597926+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'181","last_scrub_stamp":"2024-05-28T06:14:52.375368+0000","last_deep_scrub":"62'181","last_deep_scrub_stamp":"2024-05-28T06:14:52.375368+0000","last_clean_scrub_stamp":"2024-05-28T06:14:52.375368+0000","objects_scrubbed":75,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:56:10.251433+0000","scrub_duration":611,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":61,"num_read_kb":241666,"num_write":77,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"62'218","reported_seq":300,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.594427+0000","last_change":"2024-05-28T06:14:50.444905+0000","last_active":"2024-05-28T06:15:01.594427+0000","last_peered":"2024-05-28T06:15:01.594427+0000","last_clean":"2024-05-28T06:15:01.594427+0000","last_became_active":"2024-05-28T06:12:31.805993+0000","last_became_peered":"2024-05-28T06:12:31.805993+0000","last_unstale":"2024-05-28T06:15:01.594427+0000","last_undegraded":"2024-05-28T06:15:01.594427+0000","last_fullsized":"2024-05-28T06:15:01.594427+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'185","last_scrub_stamp":"2024-05-28T06:14:50.444806+0000","last_deep_scrub":"62'185","last_deep_scrub_stamp":"2024-05-28T06:14:50.444806+0000","last_clean_scrub_stamp":"2024-05-28T06:14:50.444806+0000","objects_scrubbed":83,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:02:55.926600+0000","scrub_duration":639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":348127232,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":57,"num_read_kb":233472,"num_write":83,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"62'215","reported_seq":296,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.579127+0000","last_change":"2024-05-28T06:14:42.184151+0000","last_active":"2024-05-28T06:15:01.579127+0000","last_peered":"2024-05-28T06:15:01.579127+0000","last_clean":"2024-05-28T06:15:01.579127+0000","last_became_active":"2024-05-28T06:12:31.801026+0000","last_became_peered":"2024-05-28T06:12:31.801026+0000","last_unstale":"2024-05-28T06:15:01.579127+0000","last_undegraded":"2024-05-28T06:15:01.579127+0000","last_fullsized":"2024-05-28T06:15:01.579127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'180","last_scrub_stamp":"2024-05-28T06:14:42.183972+0000","last_deep_scrub":"62'180","last_deep_scrub_stamp":"2024-05-28T06:14:42.183972+0000","last_clean_scrub_stamp":"2024-05-28T06:14:42.183972+0000","objects_scrubbed":79,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:07:25.220163+0000","scrub_duration":691,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":56,"num_read_kb":229376,"num_write":79,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"62'216","reported_seq":309,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.587413+0000","last_change":"2024-05-28T06:14:38.218596+0000","last_active":"2024-05-28T06:15:01.587413+0000","last_peered":"2024-05-28T06:15:01.587413+0000","last_clean":"2024-05-28T06:15:01.587413+0000","last_became_active":"2024-05-28T06:12:31.794016+0000","last_became_peered":"2024-05-28T06:12:31.794016+0000","last_unstale":"2024-05-28T06:15:01.587413+0000","last_undegraded":"2024-05-28T06:15:01.587413+0000","last_fullsized":"2024-05-28T06:15:01.587413+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'179","last_scrub_stamp":"2024-05-28T06:14:38.218433+0000","last_deep_scrub":"62'179","last_deep_scrub_stamp":"2024-05-28T06:14:38.218433+0000","last_clean_scrub_stamp":"2024-05-28T06:14:38.218433+0000","objects_scrubbed":75,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:19:42.804476+0000","scrub_duration":695,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":68,"num_read_kb":266243,"num_write":79,"num_write_kb":307202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"62'203","reported_seq":293,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.580019+0000","last_change":"2024-05-28T06:14:42.856445+0000","last_active":"2024-05-28T06:15:01.580019+0000","last_peered":"2024-05-28T06:15:01.580019+0000","last_clean":"2024-05-28T06:15:01.580019+0000","last_became_active":"2024-05-28T06:12:31.788550+0000","last_became_peered":"2024-05-28T06:12:31.788550+0000","last_unstale":"2024-05-28T06:15:01.580019+0000","last_undegraded":"2024-05-28T06:15:01.580019+0000","last_fullsized":"2024-05-28T06:15:01.580019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'165","last_scrub_stamp":"2024-05-28T06:14:42.856244+0000","last_deep_scrub":"62'165","last_deep_scrub_stamp":"2024-05-28T06:14:42.856244+0000","last_clean_scrub_stamp":"2024-05-28T06:14:42.856244+0000","objects_scrubbed":65,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:19:18.336936+0000","scrub_duration":699,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":66,"num_read_kb":270336,"num_write":65,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"62'215","reported_seq":306,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.589226+0000","last_change":"2024-05-28T06:14:43.557512+0000","last_active":"2024-05-28T06:15:01.589226+0000","last_peered":"2024-05-28T06:15:01.589226+0000","last_clean":"2024-05-28T06:15:01.589226+0000","last_became_active":"2024-05-28T06:12:31.792595+0000","last_became_peered":"2024-05-28T06:12:31.792595+0000","last_unstale":"2024-05-28T06:15:01.589226+0000","last_undegraded":"2024-05-28T06:15:01.589226+0000","last_fullsized":"2024-05-28T06:15:01.589226+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'187","last_scrub_stamp":"2024-05-28T06:14:43.557396+0000","last_deep_scrub":"62'187","last_deep_scrub_stamp":"2024-05-28T06:14:43.557396+0000","last_clean_scrub_stamp":"2024-05-28T06:14:43.557396+0000","objects_scrubbed":82,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:01:58.970922+0000","scrub_duration":815,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343932928,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":66,"num_read_kb":270336,"num_write":82,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"62'200","reported_seq":259,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.579361+0000","last_change":"2024-05-28T06:14:40.268116+0000","last_active":"2024-05-28T06:15:01.579361+0000","last_peered":"2024-05-28T06:15:01.579361+0000","last_clean":"2024-05-28T06:15:01.579361+0000","last_became_active":"2024-05-28T06:12:31.800042+0000","last_became_peered":"2024-05-28T06:12:31.800042+0000","last_unstale":"2024-05-28T06:15:01.579361+0000","last_undegraded":"2024-05-28T06:15:01.579361+0000","last_fullsized":"2024-05-28T06:15:01.579361+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'177","last_scrub_stamp":"2024-05-28T06:14:40.268011+0000","last_deep_scrub":"62'177","last_deep_scrub_stamp":"2024-05-28T06:14:40.268011+0000","last_clean_scrub_stamp":"2024-05-28T06:14:40.268011+0000","objects_scrubbed":78,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:56:50.201713+0000","scrub_duration":747,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327155712,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":34,"num_read_kb":131074,"num_write":82,"num_write_kb":319490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"62'225","reported_seq":321,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.595753+0000","last_change":"2024-05-28T06:14:49.332174+0000","last_active":"2024-05-28T06:15:01.595753+0000","last_peered":"2024-05-28T06:15:01.595753+0000","last_clean":"2024-05-28T06:15:01.595753+0000","last_became_active":"2024-05-28T06:12:31.798695+0000","last_became_peered":"2024-05-28T06:12:31.798695+0000","last_unstale":"2024-05-28T06:15:01.595753+0000","last_undegraded":"2024-05-28T06:15:01.595753+0000","last_fullsized":"2024-05-28T06:15:01.595753+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'193","last_scrub_stamp":"2024-05-28T06:14:49.332047+0000","last_deep_scrub":"62'193","last_deep_scrub_stamp":"2024-05-28T06:14:49.332047+0000","last_clean_scrub_stamp":"2024-05-28T06:14:49.332047+0000","objects_scrubbed":85,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T06:48:49.193887+0000","scrub_duration":671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352321668,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":71,"num_read_kb":286721,"num_write":85,"num_write_kb":344065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"62'208","reported_seq":298,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.578819+0000","last_change":"2024-05-28T06:14:45.787300+0000","last_active":"2024-05-28T06:15:01.578819+0000","last_peered":"2024-05-28T06:15:01.578819+0000","last_clean":"2024-05-28T06:15:01.578819+0000","last_became_active":"2024-05-28T06:12:31.803396+0000","last_became_peered":"2024-05-28T06:12:31.803396+0000","last_unstale":"2024-05-28T06:15:01.578819+0000","last_undegraded":"2024-05-28T06:15:01.578819+0000","last_fullsized":"2024-05-28T06:15:01.578819+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'182","last_scrub_stamp":"2024-05-28T06:14:45.787190+0000","last_deep_scrub":"62'182","last_deep_scrub_stamp":"2024-05-28T06:14:45.787190+0000","last_clean_scrub_stamp":"2024-05-28T06:14:45.787190+0000","objects_scrubbed":77,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:59:11.085544+0000","scrub_duration":903,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322961408,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":65,"num_read_kb":266240,"num_write":77,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"62'216","reported_seq":334,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.583259+0000","last_change":"2024-05-28T06:14:36.182190+0000","last_active":"2024-05-28T06:15:01.583259+0000","last_peered":"2024-05-28T06:15:01.583259+0000","last_clean":"2024-05-28T06:15:01.583259+0000","last_became_active":"2024-05-28T06:12:31.797170+0000","last_became_peered":"2024-05-28T06:12:31.797170+0000","last_unstale":"2024-05-28T06:15:01.583259+0000","last_undegraded":"2024-05-28T06:15:01.583259+0000","last_fullsized":"2024-05-28T06:15:01.583259+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'171","last_scrub_stamp":"2024-05-28T06:14:36.181948+0000","last_deep_scrub":"62'171","last_deep_scrub_stamp":"2024-05-28T06:14:36.181948+0000","last_clean_scrub_stamp":"2024-05-28T06:14:36.181948+0000","objects_scrubbed":69,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:10:31.564938+0000","scrub_duration":659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":94,"num_read_kb":385024,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"62'205","reported_seq":300,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.598024+0000","last_change":"2024-05-28T06:14:41.342726+0000","last_active":"2024-05-28T06:15:01.598024+0000","last_peered":"2024-05-28T06:15:01.598024+0000","last_clean":"2024-05-28T06:15:01.598024+0000","last_became_active":"2024-05-28T06:12:31.787700+0000","last_became_peered":"2024-05-28T06:12:31.787700+0000","last_unstale":"2024-05-28T06:15:01.598024+0000","last_undegraded":"2024-05-28T06:15:01.598024+0000","last_fullsized":"2024-05-28T06:15:01.598024+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'172","last_scrub_stamp":"2024-05-28T06:14:41.342605+0000","last_deep_scrub":"62'172","last_deep_scrub_stamp":"2024-05-28T06:14:41.342605+0000","last_clean_scrub_stamp":"2024-05-28T06:14:41.342605+0000","objects_scrubbed":71,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:18:49.168995+0000","scrub_duration":627,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":71,"num_read_kb":290816,"num_write":71,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"62'186","reported_seq":252,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.576460+0000","last_change":"2024-05-28T06:14:49.301736+0000","last_active":"2024-05-28T06:15:01.576460+0000","last_peered":"2024-05-28T06:15:01.576460+0000","last_clean":"2024-05-28T06:15:01.576460+0000","last_became_active":"2024-05-28T06:12:31.802678+0000","last_became_peered":"2024-05-28T06:12:31.802678+0000","last_unstale":"2024-05-28T06:15:01.576460+0000","last_undegraded":"2024-05-28T06:15:01.576460+0000","last_fullsized":"2024-05-28T06:15:01.576460+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'151","last_scrub_stamp":"2024-05-28T06:14:49.301537+0000","last_deep_scrub":"62'151","last_deep_scrub_stamp":"2024-05-28T06:14:49.301537+0000","last_clean_scrub_stamp":"2024-05-28T06:14:49.301537+0000","objects_scrubbed":67,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:05:48.736739+0000","scrub_duration":559,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":42,"num_read_kb":172032,"num_write":67,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"62'6","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:36.600122+0000","last_change":"2024-05-28T06:14:36.600122+0000","last_active":"2024-05-28T06:14:36.600122+0000","last_peered":"2024-05-28T06:14:36.600122+0000","last_clean":"2024-05-28T06:14:36.600122+0000","last_became_active":"2024-05-28T06:12:30.790720+0000","last_became_peered":"2024-05-28T06:12:30.790720+0000","last_unstale":"2024-05-28T06:14:36.600122+0000","last_undegraded":"2024-05-28T06:14:36.600122+0000","last_fullsized":"2024-05-28T06:14:36.600122+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'6","last_scrub_stamp":"2024-05-28T06:14:36.599954+0000","last_deep_scrub":"62'6","last_deep_scrub_stamp":"2024-05-28T06:14:36.599954+0000","last_clean_scrub_stamp":"2024-05-28T06:14:36.599954+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:45:16.662691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"62'199","reported_seq":292,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.587676+0000","last_change":"2024-05-28T06:14:43.196262+0000","last_active":"2024-05-28T06:15:01.587676+0000","last_peered":"2024-05-28T06:15:01.587676+0000","last_clean":"2024-05-28T06:15:01.587676+0000","last_became_active":"2024-05-28T06:12:31.801239+0000","last_became_peered":"2024-05-28T06:12:31.801239+0000","last_unstale":"2024-05-28T06:15:01.587676+0000","last_undegraded":"2024-05-28T06:15:01.587676+0000","last_fullsized":"2024-05-28T06:15:01.587676+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'165","last_scrub_stamp":"2024-05-28T06:14:43.196114+0000","last_deep_scrub":"62'165","last_deep_scrub_stamp":"2024-05-28T06:14:43.196114+0000","last_clean_scrub_stamp":"2024-05-28T06:14:43.196114+0000","objects_scrubbed":73,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:50:28.396786+0000","scrub_duration":731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301990149,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":69,"num_read_kb":278529,"num_write":75,"num_write_kb":294914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":25,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:43.583540+0000","last_change":"2024-05-28T06:14:43.583581+0000","last_active":"2024-05-28T06:14:43.583540+0000","last_peered":"2024-05-28T06:14:43.583540+0000","last_clean":"2024-05-28T06:14:43.583540+0000","last_became_active":"2024-05-28T06:12:30.799345+0000","last_became_peered":"2024-05-28T06:12:30.799345+0000","last_unstale":"2024-05-28T06:14:43.583540+0000","last_undegraded":"2024-05-28T06:14:43.583540+0000","last_fullsized":"2024-05-28T06:14:43.583540+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2024-05-28T06:14:43.583434+0000","last_deep_scrub":"61'1","last_deep_scrub_stamp":"2024-05-28T06:14:43.583434+0000","last_clean_scrub_stamp":"2024-05-28T06:14:43.583434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:57:42.090381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"62'196","reported_seq":294,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.587182+0000","last_change":"2024-05-28T06:14:40.354866+0000","last_active":"2024-05-28T06:15:01.587182+0000","last_peered":"2024-05-28T06:15:01.587182+0000","last_clean":"2024-05-28T06:15:01.587182+0000","last_became_active":"2024-05-28T06:12:31.786982+0000","last_became_peered":"2024-05-28T06:12:31.786982+0000","last_unstale":"2024-05-28T06:15:01.587182+0000","last_undegraded":"2024-05-28T06:15:01.587182+0000","last_fullsized":"2024-05-28T06:15:01.587182+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'161","last_scrub_stamp":"2024-05-28T06:14:40.354731+0000","last_deep_scrub":"62'161","last_deep_scrub_stamp":"2024-05-28T06:14:40.354731+0000","last_clean_scrub_stamp":"2024-05-28T06:14:40.354731+0000","objects_scrubbed":69,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:19:15.835424+0000","scrub_duration":651,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":74,"num_read_kb":286724,"num_write":73,"num_write_kb":282626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"62'4","reported_seq":28,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:33.588514+0000","last_change":"2024-05-28T06:14:33.588514+0000","last_active":"2024-05-28T06:14:33.588514+0000","last_peered":"2024-05-28T06:14:33.588514+0000","last_clean":"2024-05-28T06:14:33.588514+0000","last_became_active":"2024-05-28T06:12:30.783801+0000","last_became_peered":"2024-05-28T06:12:30.783801+0000","last_unstale":"2024-05-28T06:14:33.588514+0000","last_undegraded":"2024-05-28T06:14:33.588514+0000","last_fullsized":"2024-05-28T06:14:33.588514+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-05-28T06:14:33.588381+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-05-28T06:14:33.588381+0000","last_clean_scrub_stamp":"2024-05-28T06:14:33.588381+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:09:56.076069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"62'232","reported_seq":343,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.590372+0000","last_change":"2024-05-28T06:14:46.556549+0000","last_active":"2024-05-28T06:15:01.590372+0000","last_peered":"2024-05-28T06:15:01.590372+0000","last_clean":"2024-05-28T06:15:01.590372+0000","last_became_active":"2024-05-28T06:12:31.799517+0000","last_became_peered":"2024-05-28T06:12:31.799517+0000","last_unstale":"2024-05-28T06:15:01.590372+0000","last_undegraded":"2024-05-28T06:15:01.590372+0000","last_fullsized":"2024-05-28T06:15:01.590372+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'204","last_scrub_stamp":"2024-05-28T06:14:46.556445+0000","last_deep_scrub":"62'204","last_deep_scrub_stamp":"2024-05-28T06:14:46.556445+0000","last_clean_scrub_stamp":"2024-05-28T06:14:46.556445+0000","objects_scrubbed":85,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:26:26.251259+0000","scrub_duration":835,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356515840,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":86,"num_read_kb":352256,"num_write":85,"num_write_kb":348160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"62'3","reported_seq":27,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:40.186662+0000","last_change":"2024-05-28T06:14:40.186662+0000","last_active":"2024-05-28T06:14:40.186662+0000","last_peered":"2024-05-28T06:14:40.186662+0000","last_clean":"2024-05-28T06:14:40.186662+0000","last_became_active":"2024-05-28T06:12:30.795164+0000","last_became_peered":"2024-05-28T06:12:30.795164+0000","last_unstale":"2024-05-28T06:14:40.186662+0000","last_undegraded":"2024-05-28T06:14:40.186662+0000","last_fullsized":"2024-05-28T06:14:40.186662+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'3","last_scrub_stamp":"2024-05-28T06:14:40.186522+0000","last_deep_scrub":"62'3","last_deep_scrub_stamp":"2024-05-28T06:14:40.186522+0000","last_clean_scrub_stamp":"2024-05-28T06:14:40.186522+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:47:49.370867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"62'209","reported_seq":290,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.600414+0000","last_change":"2024-05-28T06:14:51.325150+0000","last_active":"2024-05-28T06:15:01.600414+0000","last_peered":"2024-05-28T06:15:01.600414+0000","last_clean":"2024-05-28T06:15:01.600414+0000","last_became_active":"2024-05-28T06:12:31.795154+0000","last_became_peered":"2024-05-28T06:12:31.795154+0000","last_unstale":"2024-05-28T06:15:01.600414+0000","last_undegraded":"2024-05-28T06:15:01.600414+0000","last_fullsized":"2024-05-28T06:15:01.600414+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'170","last_scrub_stamp":"2024-05-28T06:14:51.325006+0000","last_deep_scrub":"62'170","last_deep_scrub_stamp":"2024-05-28T06:14:51.325006+0000","last_clean_scrub_stamp":"2024-05-28T06:14:51.325006+0000","objects_scrubbed":74,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:18:36.030389+0000","scrub_duration":591,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":57,"num_read_kb":233472,"num_write":74,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":25,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:39.230903+0000","last_change":"2024-05-28T06:14:39.230903+0000","last_active":"2024-05-28T06:14:39.230903+0000","last_peered":"2024-05-28T06:14:39.230903+0000","last_clean":"2024-05-28T06:14:39.230903+0000","last_became_active":"2024-05-28T06:12:30.792752+0000","last_became_peered":"2024-05-28T06:12:30.792752+0000","last_unstale":"2024-05-28T06:14:39.230903+0000","last_undegraded":"2024-05-28T06:14:39.230903+0000","last_fullsized":"2024-05-28T06:14:39.230903+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2024-05-28T06:14:39.230799+0000","last_deep_scrub":"61'1","last_deep_scrub_stamp":"2024-05-28T06:14:39.230799+0000","last_clean_scrub_stamp":"2024-05-28T06:14:39.230799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:16:30.423174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"62'204","reported_seq":323,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.598592+0000","last_change":"2024-05-28T06:14:38.218735+0000","last_active":"2024-05-28T06:15:01.598592+0000","last_peered":"2024-05-28T06:15:01.598592+0000","last_clean":"2024-05-28T06:15:01.598592+0000","last_became_active":"2024-05-28T06:12:31.789614+0000","last_became_peered":"2024-05-28T06:12:31.789614+0000","last_unstale":"2024-05-28T06:15:01.598592+0000","last_undegraded":"2024-05-28T06:15:01.598592+0000","last_fullsized":"2024-05-28T06:15:01.598592+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'176","last_scrub_stamp":"2024-05-28T06:14:38.218612+0000","last_deep_scrub":"62'176","last_deep_scrub_stamp":"2024-05-28T06:14:38.218612+0000","last_clean_scrub_stamp":"2024-05-28T06:14:38.218612+0000","objects_scrubbed":75,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:49:42.913039+0000","scrub_duration":699,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":94,"num_read_kb":385024,"num_write":75,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":25,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:34.595589+0000","last_change":"2024-05-28T06:14:34.595589+0000","last_active":"2024-05-28T06:14:34.595589+0000","last_peered":"2024-05-28T06:14:34.595589+0000","last_clean":"2024-05-28T06:14:34.595589+0000","last_became_active":"2024-05-28T06:12:30.790028+0000","last_became_peered":"2024-05-28T06:12:30.790028+0000","last_unstale":"2024-05-28T06:14:34.595589+0000","last_undegraded":"2024-05-28T06:14:34.595589+0000","last_fullsized":"2024-05-28T06:14:34.595589+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2024-05-28T06:14:34.595493+0000","last_deep_scrub":"61'1","last_deep_scrub_stamp":"2024-05-28T06:14:34.595493+0000","last_clean_scrub_stamp":"2024-05-28T06:14:34.595493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:14:46.226315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"62'214","reported_seq":313,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.575154+0000","last_change":"2024-05-28T06:14:40.204545+0000","last_active":"2024-05-28T06:15:01.575154+0000","last_peered":"2024-05-28T06:15:01.575154+0000","last_clean":"2024-05-28T06:15:01.575154+0000","last_became_active":"2024-05-28T06:12:31.797004+0000","last_became_peered":"2024-05-28T06:12:31.797004+0000","last_unstale":"2024-05-28T06:15:01.575154+0000","last_undegraded":"2024-05-28T06:15:01.575154+0000","last_fullsized":"2024-05-28T06:15:01.575154+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'174","last_scrub_stamp":"2024-05-28T06:14:40.204448+0000","last_deep_scrub":"62'174","last_deep_scrub_stamp":"2024-05-28T06:14:40.204448+0000","last_clean_scrub_stamp":"2024-05-28T06:14:40.204448+0000","objects_scrubbed":75,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:24:25.790467+0000","scrub_duration":695,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":74,"num_read_kb":294914,"num_write":77,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:38.110370+0000","last_change":"2024-05-28T06:14:38.110370+0000","last_active":"2024-05-28T06:14:38.110370+0000","last_peered":"2024-05-28T06:14:38.110370+0000","last_clean":"2024-05-28T06:14:38.110370+0000","last_became_active":"2024-05-28T06:12:30.791832+0000","last_became_peered":"2024-05-28T06:12:30.791832+0000","last_unstale":"2024-05-28T06:14:38.110370+0000","last_undegraded":"2024-05-28T06:14:38.110370+0000","last_fullsized":"2024-05-28T06:14:38.110370+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:38.110263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:38.110263+0000","last_clean_scrub_stamp":"2024-05-28T06:14:38.110263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:24:35.327085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"62'211","reported_seq":299,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.597054+0000","last_change":"2024-05-28T06:14:54.176976+0000","last_active":"2024-05-28T06:15:01.597054+0000","last_peered":"2024-05-28T06:15:01.597054+0000","last_clean":"2024-05-28T06:15:01.597054+0000","last_became_active":"2024-05-28T06:12:31.803791+0000","last_became_peered":"2024-05-28T06:12:31.803791+0000","last_unstale":"2024-05-28T06:15:01.597054+0000","last_undegraded":"2024-05-28T06:15:01.597054+0000","last_fullsized":"2024-05-28T06:15:01.597054+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'177","last_scrub_stamp":"2024-05-28T06:14:54.176811+0000","last_deep_scrub":"62'177","last_deep_scrub_stamp":"2024-05-28T06:14:54.176811+0000","last_clean_scrub_stamp":"2024-05-28T06:14:54.176811+0000","objects_scrubbed":74,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T08:48:04.108602+0000","scrub_duration":467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":64,"num_read_kb":253954,"num_write":76,"num_write_kb":303105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:38.195578+0000","last_change":"2024-05-28T06:14:38.195578+0000","last_active":"2024-05-28T06:14:38.195578+0000","last_peered":"2024-05-28T06:14:38.195578+0000","last_clean":"2024-05-28T06:14:38.195578+0000","last_became_active":"2024-05-28T06:12:30.789854+0000","last_became_peered":"2024-05-28T06:12:30.789854+0000","last_unstale":"2024-05-28T06:14:38.195578+0000","last_undegraded":"2024-05-28T06:14:38.195578+0000","last_fullsized":"2024-05-28T06:14:38.195578+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:38.195470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:38.195470+0000","last_clean_scrub_stamp":"2024-05-28T06:14:38.195470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:42:23.376927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"62'190","reported_seq":250,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.590016+0000","last_change":"2024-05-28T06:14:44.958370+0000","last_active":"2024-05-28T06:15:01.590016+0000","last_peered":"2024-05-28T06:15:01.590016+0000","last_clean":"2024-05-28T06:15:01.590016+0000","last_became_active":"2024-05-28T06:12:31.788910+0000","last_became_peered":"2024-05-28T06:12:31.788910+0000","last_unstale":"2024-05-28T06:15:01.590016+0000","last_undegraded":"2024-05-28T06:15:01.590016+0000","last_fullsized":"2024-05-28T06:15:01.590016+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'156","last_scrub_stamp":"2024-05-28T06:14:44.958247+0000","last_deep_scrub":"62'156","last_deep_scrub_stamp":"2024-05-28T06:14:44.958247+0000","last_clean_scrub_stamp":"2024-05-28T06:14:44.958247+0000","objects_scrubbed":64,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:04:41.410029+0000","scrub_duration":715,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":36,"num_read_kb":147456,"num_write":64,"num_write_kb":262144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"62'1","reported_seq":25,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:39.956715+0000","last_change":"2024-05-28T06:14:39.956715+0000","last_active":"2024-05-28T06:14:39.956715+0000","last_peered":"2024-05-28T06:14:39.956715+0000","last_clean":"2024-05-28T06:14:39.956715+0000","last_became_active":"2024-05-28T06:12:30.796011+0000","last_became_peered":"2024-05-28T06:12:30.796011+0000","last_unstale":"2024-05-28T06:14:39.956715+0000","last_undegraded":"2024-05-28T06:14:39.956715+0000","last_fullsized":"2024-05-28T06:14:39.956715+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'1","last_scrub_stamp":"2024-05-28T06:14:39.956605+0000","last_deep_scrub":"62'1","last_deep_scrub_stamp":"2024-05-28T06:14:39.956605+0000","last_clean_scrub_stamp":"2024-05-28T06:14:39.956605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:45:20.019342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"62'193","reported_seq":257,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.586549+0000","last_change":"2024-05-28T06:14:52.378620+0000","last_active":"2024-05-28T06:15:01.586549+0000","last_peered":"2024-05-28T06:15:01.586549+0000","last_clean":"2024-05-28T06:15:01.586549+0000","last_became_active":"2024-05-28T06:12:31.807524+0000","last_became_peered":"2024-05-28T06:12:31.807524+0000","last_unstale":"2024-05-28T06:15:01.586549+0000","last_undegraded":"2024-05-28T06:15:01.586549+0000","last_fullsized":"2024-05-28T06:15:01.586549+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'161","last_scrub_stamp":"2024-05-28T06:14:52.378497+0000","last_deep_scrub":"62'161","last_deep_scrub_stamp":"2024-05-28T06:14:52.378497+0000","last_clean_scrub_stamp":"2024-05-28T06:14:52.378497+0000","objects_scrubbed":71,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:55:54.596857+0000","scrub_duration":575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":40,"num_read_kb":163840,"num_write":71,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:42.554637+0000","last_change":"2024-05-28T06:14:42.554637+0000","last_active":"2024-05-28T06:14:42.554637+0000","last_peered":"2024-05-28T06:14:42.554637+0000","last_clean":"2024-05-28T06:14:42.554637+0000","last_became_active":"2024-05-28T06:12:30.798033+0000","last_became_peered":"2024-05-28T06:12:30.798033+0000","last_unstale":"2024-05-28T06:14:42.554637+0000","last_undegraded":"2024-05-28T06:14:42.554637+0000","last_fullsized":"2024-05-28T06:14:42.554637+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:42.554493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:42.554493+0000","last_clean_scrub_stamp":"2024-05-28T06:14:42.554493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:12:28.843939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"62'186","reported_seq":291,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.593268+0000","last_change":"2024-05-28T06:14:41.137799+0000","last_active":"2024-05-28T06:15:01.593268+0000","last_peered":"2024-05-28T06:15:01.593268+0000","last_clean":"2024-05-28T06:15:01.593268+0000","last_became_active":"2024-05-28T06:12:31.789590+0000","last_became_peered":"2024-05-28T06:12:31.789590+0000","last_unstale":"2024-05-28T06:15:01.593268+0000","last_undegraded":"2024-05-28T06:15:01.593268+0000","last_fullsized":"2024-05-28T06:15:01.593268+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'161","last_scrub_stamp":"2024-05-28T06:14:41.137675+0000","last_deep_scrub":"62'161","last_deep_scrub_stamp":"2024-05-28T06:14:41.137675+0000","last_clean_scrub_stamp":"2024-05-28T06:14:41.137675+0000","objects_scrubbed":69,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:39:13.968538+0000","scrub_duration":631,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":81,"num_read_kb":331776,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"62'26","reported_seq":50,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:38.926392+0000","last_change":"2024-05-28T06:14:38.926392+0000","last_active":"2024-05-28T06:14:38.926392+0000","last_peered":"2024-05-28T06:14:38.926392+0000","last_clean":"2024-05-28T06:14:38.926392+0000","last_became_active":"2024-05-28T06:12:30.794322+0000","last_became_peered":"2024-05-28T06:12:30.794322+0000","last_unstale":"2024-05-28T06:14:38.926392+0000","last_undegraded":"2024-05-28T06:14:38.926392+0000","last_fullsized":"2024-05-28T06:14:38.926392+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'26","last_scrub_stamp":"2024-05-28T06:14:38.926281+0000","last_deep_scrub":"62'26","last_deep_scrub_stamp":"2024-05-28T06:14:38.926281+0000","last_clean_scrub_stamp":"2024-05-28T06:14:38.926281+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:53:34.845406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"62'186","reported_seq":271,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.587039+0000","last_change":"2024-05-28T06:14:51.362971+0000","last_active":"2024-05-28T06:15:01.587039+0000","last_peered":"2024-05-28T06:15:01.587039+0000","last_clean":"2024-05-28T06:15:01.587039+0000","last_became_active":"2024-05-28T06:12:31.806339+0000","last_became_peered":"2024-05-28T06:12:31.806339+0000","last_unstale":"2024-05-28T06:15:01.587039+0000","last_undegraded":"2024-05-28T06:15:01.587039+0000","last_fullsized":"2024-05-28T06:15:01.587039+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'154","last_scrub_stamp":"2024-05-28T06:14:51.362839+0000","last_deep_scrub":"62'154","last_deep_scrub_stamp":"2024-05-28T06:14:51.362839+0000","last_clean_scrub_stamp":"2024-05-28T06:14:51.362839+0000","objects_scrubbed":65,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:58:19.332301+0000","scrub_duration":539,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":61,"num_read_kb":245761,"num_write":67,"num_write_kb":266241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"62'442","reported_seq":466,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.584105+0000","last_change":"2024-05-28T06:14:37.179976+0000","last_active":"2024-05-28T06:15:01.584105+0000","last_peered":"2024-05-28T06:15:01.584105+0000","last_clean":"2024-05-28T06:15:01.584105+0000","last_became_active":"2024-05-28T06:12:30.791190+0000","last_became_peered":"2024-05-28T06:12:30.791190+0000","last_unstale":"2024-05-28T06:15:01.584105+0000","last_undegraded":"2024-05-28T06:15:01.584105+0000","last_fullsized":"2024-05-28T06:15:01.584105+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'432","last_scrub_stamp":"2024-05-28T06:14:37.179883+0000","last_deep_scrub":"62'432","last_deep_scrub_stamp":"2024-05-28T06:14:37.179883+0000","last_clean_scrub_stamp":"2024-05-28T06:14:37.179883+0000","objects_scrubbed":4,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:32:15.495059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1674803,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":439,"num_write_kb":1805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"62'203","reported_seq":277,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.587850+0000","last_change":"2024-05-28T06:14:46.011756+0000","last_active":"2024-05-28T06:15:01.587850+0000","last_peered":"2024-05-28T06:15:01.587850+0000","last_clean":"2024-05-28T06:15:01.587850+0000","last_became_active":"2024-05-28T06:12:31.794242+0000","last_became_peered":"2024-05-28T06:12:31.794242+0000","last_unstale":"2024-05-28T06:15:01.587850+0000","last_undegraded":"2024-05-28T06:15:01.587850+0000","last_fullsized":"2024-05-28T06:15:01.587850+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'172","last_scrub_stamp":"2024-05-28T06:14:46.011604+0000","last_deep_scrub":"62'172","last_deep_scrub_stamp":"2024-05-28T06:14:46.011604+0000","last_clean_scrub_stamp":"2024-05-28T06:14:46.011604+0000","objects_scrubbed":75,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:02:01.425131+0000","scrub_duration":851,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":49,"num_read_kb":200704,"num_write":75,"num_write_kb":307200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"62'4","reported_seq":28,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:40.579440+0000","last_change":"2024-05-28T06:14:40.579440+0000","last_active":"2024-05-28T06:14:40.579440+0000","last_peered":"2024-05-28T06:14:40.579440+0000","last_clean":"2024-05-28T06:14:40.579440+0000","last_became_active":"2024-05-28T06:12:30.794488+0000","last_became_peered":"2024-05-28T06:12:30.794488+0000","last_unstale":"2024-05-28T06:14:40.579440+0000","last_undegraded":"2024-05-28T06:14:40.579440+0000","last_fullsized":"2024-05-28T06:14:40.579440+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-05-28T06:14:40.579319+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-05-28T06:14:40.579319+0000","last_clean_scrub_stamp":"2024-05-28T06:14:40.579319+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:35:58.976875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"62'241","reported_seq":319,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.575348+0000","last_change":"2024-05-28T06:14:44.911723+0000","last_active":"2024-05-28T06:15:01.575348+0000","last_peered":"2024-05-28T06:15:01.575348+0000","last_clean":"2024-05-28T06:15:01.575348+0000","last_became_active":"2024-05-28T06:12:31.802789+0000","last_became_peered":"2024-05-28T06:12:31.802789+0000","last_unstale":"2024-05-28T06:15:01.575348+0000","last_undegraded":"2024-05-28T06:15:01.575348+0000","last_fullsized":"2024-05-28T06:15:01.575348+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'207","last_scrub_stamp":"2024-05-28T06:14:44.911566+0000","last_deep_scrub":"62'207","last_deep_scrub_stamp":"2024-05-28T06:14:44.911566+0000","last_clean_scrub_stamp":"2024-05-28T06:14:44.911566+0000","objects_scrubbed":88,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:05:56.901694+0000","scrub_duration":991,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369098752,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":53,"num_read_kb":212993,"num_write":92,"num_write_kb":360450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:37.545678+0000","last_change":"2024-05-28T06:14:37.545678+0000","last_active":"2024-05-28T06:14:37.545678+0000","last_peered":"2024-05-28T06:14:37.545678+0000","last_clean":"2024-05-28T06:14:37.545678+0000","last_became_active":"2024-05-28T06:12:30.795666+0000","last_became_peered":"2024-05-28T06:12:30.795666+0000","last_unstale":"2024-05-28T06:14:37.545678+0000","last_undegraded":"2024-05-28T06:14:37.545678+0000","last_fullsized":"2024-05-28T06:14:37.545678+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:37.545584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:37.545584+0000","last_clean_scrub_stamp":"2024-05-28T06:14:37.545584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:08:08.840898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"62'176","reported_seq":258,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.580248+0000","last_change":"2024-05-28T06:14:45.943133+0000","last_active":"2024-05-28T06:15:01.580248+0000","last_peered":"2024-05-28T06:15:01.580248+0000","last_clean":"2024-05-28T06:15:01.580248+0000","last_became_active":"2024-05-28T06:12:31.795281+0000","last_became_peered":"2024-05-28T06:12:31.795281+0000","last_unstale":"2024-05-28T06:15:01.580248+0000","last_undegraded":"2024-05-28T06:15:01.580248+0000","last_fullsized":"2024-05-28T06:15:01.580248+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'148","last_scrub_stamp":"2024-05-28T06:14:45.943005+0000","last_deep_scrub":"62'148","last_deep_scrub_stamp":"2024-05-28T06:14:45.943005+0000","last_clean_scrub_stamp":"2024-05-28T06:14:45.943005+0000","objects_scrubbed":63,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:55:08.453597+0000","scrub_duration":735,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":58,"num_read_kb":237568,"num_write":63,"num_write_kb":258048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:39.153279+0000","last_change":"2024-05-28T06:14:39.153279+0000","last_active":"2024-05-28T06:14:39.153279+0000","last_peered":"2024-05-28T06:14:39.153279+0000","last_clean":"2024-05-28T06:14:39.153279+0000","last_became_active":"2024-05-28T06:12:30.792218+0000","last_became_peered":"2024-05-28T06:12:30.792218+0000","last_unstale":"2024-05-28T06:14:39.153279+0000","last_undegraded":"2024-05-28T06:14:39.153279+0000","last_fullsized":"2024-05-28T06:14:39.153279+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:39.153198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:39.153198+0000","last_clean_scrub_stamp":"2024-05-28T06:14:39.153198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:26:21.273262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"62'245","reported_seq":339,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.594384+0000","last_change":"2024-05-28T06:14:49.608055+0000","last_active":"2024-05-28T06:15:01.594384+0000","last_peered":"2024-05-28T06:15:01.594384+0000","last_clean":"2024-05-28T06:15:01.594384+0000","last_became_active":"2024-05-28T06:12:31.805628+0000","last_became_peered":"2024-05-28T06:12:31.805628+0000","last_unstale":"2024-05-28T06:15:01.594384+0000","last_undegraded":"2024-05-28T06:15:01.594384+0000","last_fullsized":"2024-05-28T06:15:01.594384+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'209","last_scrub_stamp":"2024-05-28T06:14:49.607936+0000","last_deep_scrub":"62'209","last_deep_scrub_stamp":"2024-05-28T06:14:49.607936+0000","last_clean_scrub_stamp":"2024-05-28T06:14:49.607936+0000","objects_scrubbed":95,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:14:00.480738+0000","scrub_duration":763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394264837,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":69,"num_read_kb":282624,"num_write":95,"num_write_kb":385025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"62'12","reported_seq":36,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:40.949517+0000","last_change":"2024-05-28T06:14:40.949517+0000","last_active":"2024-05-28T06:14:40.949517+0000","last_peered":"2024-05-28T06:14:40.949517+0000","last_clean":"2024-05-28T06:14:40.949517+0000","last_became_active":"2024-05-28T06:12:30.797105+0000","last_became_peered":"2024-05-28T06:12:30.797105+0000","last_unstale":"2024-05-28T06:14:40.949517+0000","last_undegraded":"2024-05-28T06:14:40.949517+0000","last_fullsized":"2024-05-28T06:14:40.949517+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'12","last_scrub_stamp":"2024-05-28T06:14:40.949427+0000","last_deep_scrub":"62'12","last_deep_scrub_stamp":"2024-05-28T06:14:40.949427+0000","last_clean_scrub_stamp":"2024-05-28T06:14:40.949427+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:04:37.401208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"62'183","reported_seq":232,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.578719+0000","last_change":"2024-05-28T06:14:47.446909+0000","last_active":"2024-05-28T06:15:01.578719+0000","last_peered":"2024-05-28T06:15:01.578719+0000","last_clean":"2024-05-28T06:15:01.578719+0000","last_became_active":"2024-05-28T06:12:31.800610+0000","last_became_peered":"2024-05-28T06:12:31.800610+0000","last_unstale":"2024-05-28T06:15:01.578719+0000","last_undegraded":"2024-05-28T06:15:01.578719+0000","last_fullsized":"2024-05-28T06:15:01.578719+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'153","last_scrub_stamp":"2024-05-28T06:14:47.446726+0000","last_deep_scrub":"62'153","last_deep_scrub_stamp":"2024-05-28T06:14:47.446726+0000","last_clean_scrub_stamp":"2024-05-28T06:14:47.446726+0000","objects_scrubbed":65,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:02:02.860252+0000","scrub_duration":591,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":25,"num_read_kb":102400,"num_write":67,"num_write_kb":266241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"62'2","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:41.538008+0000","last_change":"2024-05-28T06:14:41.538008+0000","last_active":"2024-05-28T06:14:41.538008+0000","last_peered":"2024-05-28T06:14:41.538008+0000","last_clean":"2024-05-28T06:14:41.538008+0000","last_became_active":"2024-05-28T06:12:30.795350+0000","last_became_peered":"2024-05-28T06:12:30.795350+0000","last_unstale":"2024-05-28T06:14:41.538008+0000","last_undegraded":"2024-05-28T06:14:41.538008+0000","last_fullsized":"2024-05-28T06:14:41.538008+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-05-28T06:14:41.537890+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-05-28T06:14:41.537890+0000","last_clean_scrub_stamp":"2024-05-28T06:14:41.537890+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:01:16.695972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"62'223","reported_seq":329,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.572132+0000","last_change":"2024-05-28T06:14:44.061470+0000","last_active":"2024-05-28T06:15:01.572132+0000","last_peered":"2024-05-28T06:15:01.572132+0000","last_clean":"2024-05-28T06:15:01.572132+0000","last_became_active":"2024-05-28T06:12:31.794358+0000","last_became_peered":"2024-05-28T06:12:31.794358+0000","last_unstale":"2024-05-28T06:15:01.572132+0000","last_undegraded":"2024-05-28T06:15:01.572132+0000","last_fullsized":"2024-05-28T06:15:01.572132+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'196","last_scrub_stamp":"2024-05-28T06:14:44.061262+0000","last_deep_scrub":"62'196","last_deep_scrub_stamp":"2024-05-28T06:14:44.061262+0000","last_clean_scrub_stamp":"2024-05-28T06:14:44.061262+0000","objects_scrubbed":86,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:18:51.887652+0000","scrub_duration":867,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356515972,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":81,"num_read_kb":327681,"num_write":86,"num_write_kb":348161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"62'3","reported_seq":27,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:37.608738+0000","last_change":"2024-05-28T06:14:37.608738+0000","last_active":"2024-05-28T06:14:37.608738+0000","last_peered":"2024-05-28T06:14:37.608738+0000","last_clean":"2024-05-28T06:14:37.608738+0000","last_became_active":"2024-05-28T06:12:30.792705+0000","last_became_peered":"2024-05-28T06:12:30.792705+0000","last_unstale":"2024-05-28T06:14:37.608738+0000","last_undegraded":"2024-05-28T06:14:37.608738+0000","last_fullsized":"2024-05-28T06:14:37.608738+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'3","last_scrub_stamp":"2024-05-28T06:14:37.608622+0000","last_deep_scrub":"62'3","last_deep_scrub_stamp":"2024-05-28T06:14:37.608622+0000","last_clean_scrub_stamp":"2024-05-28T06:14:37.608622+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:47:46.792967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"62'185","reported_seq":270,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.596027+0000","last_change":"2024-05-28T06:14:36.996882+0000","last_active":"2024-05-28T06:15:01.596027+0000","last_peered":"2024-05-28T06:15:01.596027+0000","last_clean":"2024-05-28T06:15:01.596027+0000","last_became_active":"2024-05-28T06:12:31.790509+0000","last_became_peered":"2024-05-28T06:12:31.790509+0000","last_unstale":"2024-05-28T06:15:01.596027+0000","last_undegraded":"2024-05-28T06:15:01.596027+0000","last_fullsized":"2024-05-28T06:15:01.596027+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'150","last_scrub_stamp":"2024-05-28T06:14:36.996772+0000","last_deep_scrub":"62'150","last_deep_scrub_stamp":"2024-05-28T06:14:36.996772+0000","last_clean_scrub_stamp":"2024-05-28T06:14:36.996772+0000","objects_scrubbed":61,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:55:39.215132+0000","scrub_duration":519,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658501,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":61,"num_read_kb":233476,"num_write":65,"num_write_kb":245763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"62'2","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:41.154150+0000","last_change":"2024-05-28T06:14:41.154150+0000","last_active":"2024-05-28T06:14:41.154150+0000","last_peered":"2024-05-28T06:14:41.154150+0000","last_clean":"2024-05-28T06:14:41.154150+0000","last_became_active":"2024-05-28T06:12:30.795903+0000","last_became_peered":"2024-05-28T06:12:30.795903+0000","last_unstale":"2024-05-28T06:14:41.154150+0000","last_undegraded":"2024-05-28T06:14:41.154150+0000","last_fullsized":"2024-05-28T06:14:41.154150+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-05-28T06:14:41.154048+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-05-28T06:14:41.154048+0000","last_clean_scrub_stamp":"2024-05-28T06:14:41.154048+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:41:20.313313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"62'191","reported_seq":294,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.587003+0000","last_change":"2024-05-28T06:14:53.324729+0000","last_active":"2024-05-28T06:15:01.587003+0000","last_peered":"2024-05-28T06:15:01.587003+0000","last_clean":"2024-05-28T06:15:01.587003+0000","last_became_active":"2024-05-28T06:12:31.807373+0000","last_became_peered":"2024-05-28T06:12:31.807373+0000","last_unstale":"2024-05-28T06:15:01.587003+0000","last_undegraded":"2024-05-28T06:15:01.587003+0000","last_fullsized":"2024-05-28T06:15:01.587003+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'159","last_scrub_stamp":"2024-05-28T06:14:53.324617+0000","last_deep_scrub":"62'159","last_deep_scrub_stamp":"2024-05-28T06:14:53.324617+0000","last_clean_scrub_stamp":"2024-05-28T06:14:53.324617+0000","objects_scrubbed":69,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:49:58.019044+0000","scrub_duration":507,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":79,"num_read_kb":323584,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:38.652951+0000","last_change":"2024-05-28T06:14:38.652951+0000","last_active":"2024-05-28T06:14:38.652951+0000","last_peered":"2024-05-28T06:14:38.652951+0000","last_clean":"2024-05-28T06:14:38.652951+0000","last_became_active":"2024-05-28T06:12:30.793587+0000","last_became_peered":"2024-05-28T06:12:30.793587+0000","last_unstale":"2024-05-28T06:14:38.652951+0000","last_undegraded":"2024-05-28T06:14:38.652951+0000","last_fullsized":"2024-05-28T06:14:38.652951+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:38.652850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:38.652850+0000","last_clean_scrub_stamp":"2024-05-28T06:14:38.652850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:41:17.812116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"62'245","reported_seq":350,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.587763+0000","last_change":"2024-05-28T06:14:45.220618+0000","last_active":"2024-05-28T06:15:01.587763+0000","last_peered":"2024-05-28T06:15:01.587763+0000","last_clean":"2024-05-28T06:15:01.587763+0000","last_became_active":"2024-05-28T06:12:31.793880+0000","last_became_peered":"2024-05-28T06:12:31.793880+0000","last_unstale":"2024-05-28T06:15:01.587763+0000","last_undegraded":"2024-05-28T06:15:01.587763+0000","last_fullsized":"2024-05-28T06:15:01.587763+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'212","last_scrub_stamp":"2024-05-28T06:14:45.220456+0000","last_deep_scrub":"62'212","last_deep_scrub_stamp":"2024-05-28T06:14:45.220456+0000","last_clean_scrub_stamp":"2024-05-28T06:14:45.220456+0000","objects_scrubbed":97,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:34:55.719461+0000","scrub_duration":1067,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406847488,"num_objects":97,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":80,"num_read_kb":327680,"num_write":97,"num_write_kb":397312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"62'4","reported_seq":28,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:39.607163+0000","last_change":"2024-05-28T06:14:39.607163+0000","last_active":"2024-05-28T06:14:39.607163+0000","last_peered":"2024-05-28T06:14:39.607163+0000","last_clean":"2024-05-28T06:14:39.607163+0000","last_became_active":"2024-05-28T06:12:30.793922+0000","last_became_peered":"2024-05-28T06:12:30.793922+0000","last_unstale":"2024-05-28T06:14:39.607163+0000","last_undegraded":"2024-05-28T06:14:39.607163+0000","last_fullsized":"2024-05-28T06:14:39.607163+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-05-28T06:14:39.607013+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-05-28T06:14:39.607013+0000","last_clean_scrub_stamp":"2024-05-28T06:14:39.607013+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:55:35.493977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"62'209","reported_seq":300,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.574393+0000","last_change":"2024-05-28T06:14:44.487910+0000","last_active":"2024-05-28T06:15:01.574393+0000","last_peered":"2024-05-28T06:15:01.574393+0000","last_clean":"2024-05-28T06:15:01.574393+0000","last_became_active":"2024-05-28T06:12:31.796849+0000","last_became_peered":"2024-05-28T06:12:31.796849+0000","last_unstale":"2024-05-28T06:15:01.574393+0000","last_undegraded":"2024-05-28T06:15:01.574393+0000","last_fullsized":"2024-05-28T06:15:01.574393+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'179","last_scrub_stamp":"2024-05-28T06:14:44.487805+0000","last_deep_scrub":"62'179","last_deep_scrub_stamp":"2024-05-28T06:14:44.487805+0000","last_clean_scrub_stamp":"2024-05-28T06:14:44.487805+0000","objects_scrubbed":75,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:00:58.777204+0000","scrub_duration":795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":66,"num_read_kb":249861,"num_write":79,"num_write_kb":307202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:36.508873+0000","last_change":"2024-05-28T06:14:36.508873+0000","last_active":"2024-05-28T06:14:36.508873+0000","last_peered":"2024-05-28T06:14:36.508873+0000","last_clean":"2024-05-28T06:14:36.508873+0000","last_became_active":"2024-05-28T06:12:30.794505+0000","last_became_peered":"2024-05-28T06:12:30.794505+0000","last_unstale":"2024-05-28T06:14:36.508873+0000","last_undegraded":"2024-05-28T06:14:36.508873+0000","last_fullsized":"2024-05-28T06:14:36.508873+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:36.508756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:36.508756+0000","last_clean_scrub_stamp":"2024-05-28T06:14:36.508756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:06:20.652368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"62'194","reported_seq":276,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.574732+0000","last_change":"2024-05-28T06:14:48.300685+0000","last_active":"2024-05-28T06:15:01.574732+0000","last_peered":"2024-05-28T06:15:01.574732+0000","last_clean":"2024-05-28T06:15:01.574732+0000","last_became_active":"2024-05-28T06:12:31.801961+0000","last_became_peered":"2024-05-28T06:12:31.801961+0000","last_unstale":"2024-05-28T06:15:01.574732+0000","last_undegraded":"2024-05-28T06:15:01.574732+0000","last_fullsized":"2024-05-28T06:15:01.574732+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'161","last_scrub_stamp":"2024-05-28T06:14:48.300504+0000","last_deep_scrub":"62'161","last_deep_scrub_stamp":"2024-05-28T06:14:48.300504+0000","last_clean_scrub_stamp":"2024-05-28T06:14:48.300504+0000","objects_scrubbed":69,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:55:50.518863+0000","scrub_duration":595,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":58,"num_read_kb":237568,"num_write":69,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:36.088776+0000","last_change":"2024-05-28T06:14:36.088776+0000","last_active":"2024-05-28T06:14:36.088776+0000","last_peered":"2024-05-28T06:14:36.088776+0000","last_clean":"2024-05-28T06:14:36.088776+0000","last_became_active":"2024-05-28T06:12:30.790513+0000","last_became_peered":"2024-05-28T06:12:30.790513+0000","last_unstale":"2024-05-28T06:14:36.088776+0000","last_undegraded":"2024-05-28T06:14:36.088776+0000","last_fullsized":"2024-05-28T06:14:36.088776+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:36.088624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:36.088624+0000","last_clean_scrub_stamp":"2024-05-28T06:14:36.088624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:09:58.576312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"62'215","reported_seq":278,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.591872+0000","last_change":"2024-05-28T06:14:49.794956+0000","last_active":"2024-05-28T06:15:01.591872+0000","last_peered":"2024-05-28T06:15:01.591872+0000","last_clean":"2024-05-28T06:15:01.591872+0000","last_became_active":"2024-05-28T06:12:31.803936+0000","last_became_peered":"2024-05-28T06:12:31.803936+0000","last_unstale":"2024-05-28T06:15:01.591872+0000","last_undegraded":"2024-05-28T06:15:01.591872+0000","last_fullsized":"2024-05-28T06:15:01.591872+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'184","last_scrub_stamp":"2024-05-28T06:14:49.794861+0000","last_deep_scrub":"62'184","last_deep_scrub_stamp":"2024-05-28T06:14:49.794861+0000","last_clean_scrub_stamp":"2024-05-28T06:14:49.794861+0000","objects_scrubbed":80,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:32:12.357079+0000","scrub_duration":631,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":38,"num_read_kb":155648,"num_write":80,"num_write_kb":327680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"62'3","reported_seq":27,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:37.491008+0000","last_change":"2024-05-28T06:14:37.491008+0000","last_active":"2024-05-28T06:14:37.491008+0000","last_peered":"2024-05-28T06:14:37.491008+0000","last_clean":"2024-05-28T06:14:37.491008+0000","last_became_active":"2024-05-28T06:12:30.797794+0000","last_became_peered":"2024-05-28T06:12:30.797794+0000","last_unstale":"2024-05-28T06:14:37.491008+0000","last_undegraded":"2024-05-28T06:14:37.491008+0000","last_fullsized":"2024-05-28T06:14:37.491008+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'3","last_scrub_stamp":"2024-05-28T06:14:37.490911+0000","last_deep_scrub":"62'3","last_deep_scrub_stamp":"2024-05-28T06:14:37.490911+0000","last_clean_scrub_stamp":"2024-05-28T06:14:37.490911+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:07:20.527102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"62'222","reported_seq":327,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.574364+0000","last_change":"2024-05-28T06:14:47.856075+0000","last_active":"2024-05-28T06:15:01.574364+0000","last_peered":"2024-05-28T06:15:01.574364+0000","last_clean":"2024-05-28T06:15:01.574364+0000","last_became_active":"2024-05-28T06:12:31.799714+0000","last_became_peered":"2024-05-28T06:12:31.799714+0000","last_unstale":"2024-05-28T06:15:01.574364+0000","last_undegraded":"2024-05-28T06:15:01.574364+0000","last_fullsized":"2024-05-28T06:15:01.574364+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'191","last_scrub_stamp":"2024-05-28T06:14:47.855879+0000","last_deep_scrub":"62'191","last_deep_scrub_stamp":"2024-05-28T06:14:47.855879+0000","last_clean_scrub_stamp":"2024-05-28T06:14:47.855879+0000","objects_scrubbed":86,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:03:02.589898+0000","scrub_duration":747,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360710144,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":80,"num_read_kb":327680,"num_write":86,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"62'43","reported_seq":67,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:00.854192+0000","last_change":"2024-05-28T06:14:35.617884+0000","last_active":"2024-05-28T06:15:00.854192+0000","last_peered":"2024-05-28T06:15:00.854192+0000","last_clean":"2024-05-28T06:15:00.854192+0000","last_became_active":"2024-05-28T06:12:30.790486+0000","last_became_peered":"2024-05-28T06:12:30.790486+0000","last_unstale":"2024-05-28T06:15:00.854192+0000","last_undegraded":"2024-05-28T06:15:00.854192+0000","last_fullsized":"2024-05-28T06:15:00.854192+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'41","last_scrub_stamp":"2024-05-28T06:14:35.617750+0000","last_deep_scrub":"62'41","last_deep_scrub_stamp":"2024-05-28T06:14:35.617750+0000","last_clean_scrub_stamp":"2024-05-28T06:14:35.617750+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:32:17.749980+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1176,"num_omap_keys":20,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"62'216","reported_seq":336,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.594464+0000","last_change":"2024-05-28T06:14:40.328532+0000","last_active":"2024-05-28T06:15:01.594464+0000","last_peered":"2024-05-28T06:15:01.594464+0000","last_clean":"2024-05-28T06:15:01.594464+0000","last_became_active":"2024-05-28T06:12:31.789316+0000","last_became_peered":"2024-05-28T06:12:31.789316+0000","last_unstale":"2024-05-28T06:15:01.594464+0000","last_undegraded":"2024-05-28T06:15:01.594464+0000","last_fullsized":"2024-05-28T06:15:01.594464+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'184","last_scrub_stamp":"2024-05-28T06:14:40.328367+0000","last_deep_scrub":"62'184","last_deep_scrub_stamp":"2024-05-28T06:14:40.328367+0000","last_clean_scrub_stamp":"2024-05-28T06:14:40.328367+0000","objects_scrubbed":81,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:08:10.303288+0000","scrub_duration":779,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339738624,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":95,"num_read_kb":385025,"num_write":83,"num_write_kb":331777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:36.592502+0000","last_change":"2024-05-28T06:14:36.592502+0000","last_active":"2024-05-28T06:14:36.592502+0000","last_peered":"2024-05-28T06:14:36.592502+0000","last_clean":"2024-05-28T06:14:36.592502+0000","last_became_active":"2024-05-28T06:12:30.791296+0000","last_became_peered":"2024-05-28T06:12:30.791296+0000","last_unstale":"2024-05-28T06:14:36.592502+0000","last_undegraded":"2024-05-28T06:14:36.592502+0000","last_fullsized":"2024-05-28T06:14:36.592502+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:36.592386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:36.592386+0000","last_clean_scrub_stamp":"2024-05-28T06:14:36.592386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T12:59:20.232961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"62'224","reported_seq":297,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.589500+0000","last_change":"2024-05-28T06:14:45.668884+0000","last_active":"2024-05-28T06:15:01.589500+0000","last_peered":"2024-05-28T06:15:01.589500+0000","last_clean":"2024-05-28T06:15:01.589500+0000","last_became_active":"2024-05-28T06:12:31.799396+0000","last_became_peered":"2024-05-28T06:12:31.799396+0000","last_unstale":"2024-05-28T06:15:01.589500+0000","last_undegraded":"2024-05-28T06:15:01.589500+0000","last_fullsized":"2024-05-28T06:15:01.589500+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'195","last_scrub_stamp":"2024-05-28T06:14:45.668768+0000","last_deep_scrub":"62'195","last_deep_scrub_stamp":"2024-05-28T06:14:45.668768+0000","last_clean_scrub_stamp":"2024-05-28T06:14:45.668768+0000","objects_scrubbed":88,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:03:00.402786+0000","scrub_duration":983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356516084,"num_objects":88,"num_object_clones":1,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":1,"num_read":49,"num_read_kb":200704,"num_write":88,"num_write_kb":348162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:37.092962+0000","last_change":"2024-05-28T06:14:37.092962+0000","last_active":"2024-05-28T06:14:37.092962+0000","last_peered":"2024-05-28T06:14:37.092962+0000","last_clean":"2024-05-28T06:14:37.092962+0000","last_became_active":"2024-05-28T06:12:30.790609+0000","last_became_peered":"2024-05-28T06:12:30.790609+0000","last_unstale":"2024-05-28T06:14:37.092962+0000","last_undegraded":"2024-05-28T06:14:37.092962+0000","last_fullsized":"2024-05-28T06:14:37.092962+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:37.092853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:37.092853+0000","last_clean_scrub_stamp":"2024-05-28T06:14:37.092853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:14:48.723676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"62'227","reported_seq":311,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.598256+0000","last_change":"2024-05-28T06:14:47.292037+0000","last_active":"2024-05-28T06:15:01.598256+0000","last_peered":"2024-05-28T06:15:01.598256+0000","last_clean":"2024-05-28T06:15:01.598256+0000","last_became_active":"2024-05-28T06:12:31.792189+0000","last_became_peered":"2024-05-28T06:12:31.792189+0000","last_unstale":"2024-05-28T06:15:01.598256+0000","last_undegraded":"2024-05-28T06:15:01.598256+0000","last_fullsized":"2024-05-28T06:15:01.598256+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'199","last_scrub_stamp":"2024-05-28T06:14:47.291931+0000","last_deep_scrub":"62'199","last_deep_scrub_stamp":"2024-05-28T06:14:47.291931+0000","last_clean_scrub_stamp":"2024-05-28T06:14:47.291931+0000","objects_scrubbed":86,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:54:58.192899+0000","scrub_duration":723,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360710144,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":59,"num_read_kb":241664,"num_write":86,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:34.434393+0000","last_change":"2024-05-28T06:14:34.434393+0000","last_active":"2024-05-28T06:14:34.434393+0000","last_peered":"2024-05-28T06:14:34.434393+0000","last_clean":"2024-05-28T06:14:34.434393+0000","last_became_active":"2024-05-28T06:12:30.786731+0000","last_became_peered":"2024-05-28T06:12:30.786731+0000","last_unstale":"2024-05-28T06:14:34.434393+0000","last_undegraded":"2024-05-28T06:14:34.434393+0000","last_fullsized":"2024-05-28T06:14:34.434393+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:34.434294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:34.434294+0000","last_clean_scrub_stamp":"2024-05-28T06:14:34.434294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T18:07:48.479666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"62'246","reported_seq":357,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.591782+0000","last_change":"2024-05-28T06:14:46.748172+0000","last_active":"2024-05-28T06:15:01.591782+0000","last_peered":"2024-05-28T06:15:01.591782+0000","last_clean":"2024-05-28T06:15:01.591782+0000","last_became_active":"2024-05-28T06:12:31.803980+0000","last_became_peered":"2024-05-28T06:12:31.803980+0000","last_unstale":"2024-05-28T06:15:01.591782+0000","last_undegraded":"2024-05-28T06:15:01.591782+0000","last_fullsized":"2024-05-28T06:15:01.591782+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'209","last_scrub_stamp":"2024-05-28T06:14:46.748004+0000","last_deep_scrub":"62'209","last_deep_scrub_stamp":"2024-05-28T06:14:46.748004+0000","last_clean_scrub_stamp":"2024-05-28T06:14:46.748004+0000","objects_scrubbed":93,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:23:31.843956+0000","scrub_duration":891,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390070272,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":86,"num_read_kb":339971,"num_write":95,"num_write_kb":380929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:36.163583+0000","last_change":"2024-05-28T06:14:36.163583+0000","last_active":"2024-05-28T06:14:36.163583+0000","last_peered":"2024-05-28T06:14:36.163583+0000","last_clean":"2024-05-28T06:14:36.163583+0000","last_became_active":"2024-05-28T06:12:30.789856+0000","last_became_peered":"2024-05-28T06:12:30.789856+0000","last_unstale":"2024-05-28T06:14:36.163583+0000","last_undegraded":"2024-05-28T06:14:36.163583+0000","last_fullsized":"2024-05-28T06:14:36.163583+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:36.163438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:36.163438+0000","last_clean_scrub_stamp":"2024-05-28T06:14:36.163438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T14:03:21.062560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"62'236","reported_seq":336,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.588407+0000","last_change":"2024-05-28T06:14:44.467228+0000","last_active":"2024-05-28T06:15:01.588407+0000","last_peered":"2024-05-28T06:15:01.588407+0000","last_clean":"2024-05-28T06:15:01.588407+0000","last_became_active":"2024-05-28T06:12:31.801228+0000","last_became_peered":"2024-05-28T06:12:31.801228+0000","last_unstale":"2024-05-28T06:15:01.588407+0000","last_undegraded":"2024-05-28T06:15:01.588407+0000","last_fullsized":"2024-05-28T06:15:01.588407+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'205","last_scrub_stamp":"2024-05-28T06:14:44.467096+0000","last_deep_scrub":"62'205","last_deep_scrub_stamp":"2024-05-28T06:14:44.467096+0000","last_clean_scrub_stamp":"2024-05-28T06:14:44.467096+0000","objects_scrubbed":94,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T15:32:22.782273+0000","scrub_duration":975,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394264576,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":75,"num_read_kb":307200,"num_write":94,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"62'32","reported_seq":86,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:35.471679+0000","last_change":"2024-05-28T06:14:35.471679+0000","last_active":"2024-05-28T06:14:35.471679+0000","last_peered":"2024-05-28T06:14:35.471679+0000","last_clean":"2024-05-28T06:14:35.471679+0000","last_became_active":"2024-05-28T06:12:30.790623+0000","last_became_peered":"2024-05-28T06:12:30.790623+0000","last_unstale":"2024-05-28T06:14:35.471679+0000","last_undegraded":"2024-05-28T06:14:35.471679+0000","last_fullsized":"2024-05-28T06:14:35.471679+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'32","last_scrub_stamp":"2024-05-28T06:14:35.471570+0000","last_deep_scrub":"62'32","last_deep_scrub_stamp":"2024-05-28T06:14:35.471570+0000","last_clean_scrub_stamp":"2024-05-28T06:14:35.471570+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T07:26:34.736396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4250,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":30,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"62'210","reported_seq":313,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.596630+0000","last_change":"2024-05-28T06:14:53.310194+0000","last_active":"2024-05-28T06:15:01.596630+0000","last_peered":"2024-05-28T06:15:01.596630+0000","last_clean":"2024-05-28T06:15:01.596630+0000","last_became_active":"2024-05-28T06:12:31.803709+0000","last_became_peered":"2024-05-28T06:12:31.803709+0000","last_unstale":"2024-05-28T06:15:01.596630+0000","last_undegraded":"2024-05-28T06:15:01.596630+0000","last_fullsized":"2024-05-28T06:15:01.596630+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'187","last_scrub_stamp":"2024-05-28T06:14:53.310088+0000","last_deep_scrub":"62'187","last_deep_scrub_stamp":"2024-05-28T06:14:53.310088+0000","last_clean_scrub_stamp":"2024-05-28T06:14:53.310088+0000","objects_scrubbed":86,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T09:28:07.243043+0000","scrub_duration":595,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360710144,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":78,"num_read_kb":319488,"num_write":86,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:38.564811+0000","last_change":"2024-05-28T06:14:38.564829+0000","last_active":"2024-05-28T06:14:38.564811+0000","last_peered":"2024-05-28T06:14:38.564811+0000","last_clean":"2024-05-28T06:14:38.564811+0000","last_became_active":"2024-05-28T06:12:30.793086+0000","last_became_peered":"2024-05-28T06:12:30.793086+0000","last_unstale":"2024-05-28T06:14:38.564811+0000","last_undegraded":"2024-05-28T06:14:38.564811+0000","last_fullsized":"2024-05-28T06:14:38.564811+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:38.564740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:38.564740+0000","last_clean_scrub_stamp":"2024-05-28T06:14:38.564740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T16:07:42.516064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"62'234","reported_seq":305,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:15:01.595134+0000","last_change":"2024-05-28T06:14:46.323651+0000","last_active":"2024-05-28T06:15:01.595134+0000","last_peered":"2024-05-28T06:15:01.595134+0000","last_clean":"2024-05-28T06:15:01.595134+0000","last_became_active":"2024-05-28T06:12:31.789082+0000","last_became_peered":"2024-05-28T06:12:31.789082+0000","last_unstale":"2024-05-28T06:15:01.595134+0000","last_undegraded":"2024-05-28T06:15:01.595134+0000","last_fullsized":"2024-05-28T06:15:01.595134+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'207","last_scrub_stamp":"2024-05-28T06:14:46.323526+0000","last_deep_scrub":"62'207","last_deep_scrub_stamp":"2024-05-28T06:14:46.323526+0000","last_clean_scrub_stamp":"2024-05-28T06:14:46.323526+0000","objects_scrubbed":86,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T13:38:19.399667+0000","scrub_duration":803,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356515972,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":46,"num_read_kb":180226,"num_write":88,"num_write_kb":348162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":24,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:38.496998+0000","last_change":"2024-05-28T06:14:38.496998+0000","last_active":"2024-05-28T06:14:38.496998+0000","last_peered":"2024-05-28T06:14:38.496998+0000","last_clean":"2024-05-28T06:14:38.496998+0000","last_became_active":"2024-05-28T06:12:30.795716+0000","last_became_peered":"2024-05-28T06:12:30.795716+0000","last_unstale":"2024-05-28T06:14:38.496998+0000","last_undegraded":"2024-05-28T06:14:38.496998+0000","last_fullsized":"2024-05-28T06:14:38.496998+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-28T06:14:38.496892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-28T06:14:38.496892+0000","last_clean_scrub_stamp":"2024-05-28T06:14:38.496892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T10:22:14.274156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"62'119","reported_seq":259,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-28T06:14:37.946891+0000","last_change":"2024-05-28T06:14:37.946920+0000","last_active":"2024-05-28T06:14:37.946891+0000","last_peered":"2024-05-28T06:14:37.946891+0000","last_clean":"2024-05-28T06:14:37.946891+0000","last_became_active":"2024-05-28T06:05:38.514745+0000","last_became_peered":"2024-05-28T06:05:38.514745+0000","last_unstale":"2024-05-28T06:14:37.946891+0000","last_undegraded":"2024-05-28T06:14:37.946891+0000","last_fullsized":"2024-05-28T06:14:37.946891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'119","last_scrub_stamp":"2024-05-28T06:14:37.946817+0000","last_deep_scrub":"62'119","last_deep_scrub_stamp":"2024-05-28T06:14:37.946817+0000","last_clean_scrub_stamp":"2024-05-28T06:14:37.946817+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T11:20:20.814201+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":20426262164,"num_objects":4880,"num_object_clones":1,"num_object_copies":9760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4880,"num_whiteouts":1,"num_read":4170,"num_read_kb":16875570,"num_write":4948,"num_write_kb":19947563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40852594688,"data_stored":40852524328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13337,"ondisk_log_size":13337,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1679851,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":626,"num_write_kb":1895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6176,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3424256,"data_stored":3359702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":590,"ondisk_log_size":590,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574967,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5944760,"kb_used_data":5891376,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":88427080,"statfs":{"total":96636764160,"available":90549329920,"internally_reserved":0,"allocated":6032769024,"data_stored":6032315492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574967,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3847008,"kb_used_data":3793624,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":90524832,"statfs":{"total":96636764160,"available":92697427968,"internally_reserved":0,"allocated":3884670976,"data_stored":3884240533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574966,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4842296,"kb_used_data":4793072,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":89529544,"statfs":{"total":96636764160,"available":91678253056,"internally_reserved":0,"allocated":4908105728,"data_stored":4907651869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574965,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4078096,"kb_used_data":4020552,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":90293744,"statfs":{"total":96636764160,"available":92460793856,"internally_reserved":0,"allocated":4117045248,"data_stored":4116602317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574968,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6509496,"kb_used_data":6451952,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":87862344,"statfs":{"total":96636764160,"available":89971040256,"internally_reserved":0,"allocated":6606798848,"data_stored":6606344671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574967,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3781416,"kb_used_data":3732192,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":90590424,"statfs":{"total":96636764160,"available":92764594176,"internally_reserved":0,"allocated":3821764608,"data_stored":3821326029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5935988,"kb_used_data":5882604,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":88435852,"statfs":{"total":96636764160,"available":90558312448,"internally_reserved":0,"allocated":6023786496,"data_stored":6023340306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5397612,"kb_used_data":5340068,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":88974228,"statfs":{"total":96636764160,"available":91109609472,"internally_reserved":0,"allocated":5468229632,"data_stored":5467763781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1695744,"data_stored":1679635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1683456,"data_stored":1674803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5465194496,"data_stored":5465178749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6023028736,"data_stored":6023020937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3821010944,"data_stored":3821010944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6606045184,"data_stored":6606029586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4114616320,"data_stored":4114612485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4907352064,"data_stored":4907336188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3883925504,"data_stored":3883925504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6031421440,"data_stored":6031409935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-28T06:15:18.296 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-28T06:15:18.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.472+0000 7f82a1200640 1 Processor -- start 2024-05-28T06:15:18.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.472+0000 7f82a1200640 1 -- start start 2024-05-28T06:15:18.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f82a1200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f829c15f740 0x7f829c167240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:15:18.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f82a1200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f829c15d970 con 0x7f829c0b58d0 2024-05-28T06:15:18.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f82a1200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f829c15dc50 con 0x7f829c0ce4f0 2024-05-28T06:15:18.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f82a1200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f829c15df30 con 0x7f829c15f740 2024-05-28T06:15:18.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8299e00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f829c0b58d0 0x7f829c0b5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:60632/0 (socket says 172.21.15.122:60632) 2024-05-28T06:15:18.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8299e00640 1 -- 172.21.15.122:0/1455894663 learned_addr learned my addr 172.21.15.122:0/1455894663 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-05-28T06:15:18.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f829a800640 1 --2- 172.21.15.122:0/1455894663 >> v2:172.21.15.153:3300/0 conn(0x7f829c15f740 0x7f829c167240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:15:18.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8299400640 1 -- 172.21.15.122:0/1455894663 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3185568357 0 0) 0x7f829c15d970 con 0x7f829c0b58d0 2024-05-28T06:15:18.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8299400640 1 -- 172.21.15.122:0/1455894663 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8280003530 con 0x7f829c0b58d0 2024-05-28T06:15:18.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8299400640 1 -- 172.21.15.122:0/1455894663 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 479574634 0 0) 0x7f8280003530 con 0x7f829c0b58d0 2024-05-28T06:15:18.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8299400640 1 -- 172.21.15.122:0/1455894663 >> v2:172.21.15.153:3300/0 conn(0x7f829c15f740 msgr2=0x7f829c167240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:15:18.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8299400640 1 --2- 172.21.15.122:0/1455894663 >> v2:172.21.15.153:3300/0 conn(0x7f829c15f740 0x7f829c167240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8299400640 1 -- 172.21.15.122:0/1455894663 >> v1:172.21.15.153:6789/0 conn(0x7f829c0ce4f0 legacy=0x7f829c0ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:15:18.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8299400640 1 -- 172.21.15.122:0/1455894663 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829c15e210 con 0x7f829c0b58d0 2024-05-28T06:15:18.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8299400640 1 -- 172.21.15.122:0/1455894663 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1518750773 0 0) 0x7f828c001a00 con 0x7f829c0b58d0 2024-05-28T06:15:18.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f829a800640 1 --2- 172.21.15.122:0/1455894663 >> v2:172.21.15.153:3300/0 conn(0x7f829c15f740 0x7f829c167240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-28T06:15:18.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8299400640 1 -- 172.21.15.122:0/1455894663 >> v1:172.21.15.122:6789/0 conn(0x7f829c0b58d0 legacy=0x7f829c0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:15:18.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8299400640 1 --2- 172.21.15.122:0/1455894663 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82800039c0 0x7f8280003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:15:18.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8299400640 1 --2- 172.21.15.122:0/1455894663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8280004810 0x7f8280004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:15:18.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8299400640 1 --2- 172.21.15.122:0/1455894663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82800051d0 0x7f828000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:15:18.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8299400640 1 -- 172.21.15.122:0/1455894663 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f829c15df30 con 0x7f8280004810 2024-05-28T06:15:18.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8299400640 1 -- 172.21.15.122:0/1455894663 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f828000c070 con 0x7f82800051d0 2024-05-28T06:15:18.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8299400640 1 -- 172.21.15.122:0/1455894663 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f828000c270 con 0x7f82800039c0 2024-05-28T06:15:18.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8291400640 1 --2- 172.21.15.122:0/1455894663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8280004810 0x7f8280004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:15:18.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8299e00640 1 --2- 172.21.15.122:0/1455894663 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82800039c0 0x7f8280003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:15:18.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f829a800640 1 --2- 172.21.15.122:0/1455894663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82800051d0 0x7f828000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:15:18.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8291400640 1 -- 172.21.15.122:0/1455894663 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82800039c0 msgr2=0x7f8280003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:15:18.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8291400640 1 --2- 172.21.15.122:0/1455894663 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82800039c0 0x7f8280003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8291400640 1 -- 172.21.15.122:0/1455894663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82800051d0 msgr2=0x7f828000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:15:18.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8291400640 1 --2- 172.21.15.122:0/1455894663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82800051d0 0x7f828000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f8291400640 1 -- 172.21.15.122:0/1455894663 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8280003530 con 0x7f8280004810 2024-05-28T06:15:18.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.476+0000 7f829a800640 1 -- 172.21.15.122:0/1455894663 reap_dead start 2024-05-28T06:15:18.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.480+0000 7f8291400640 1 --2- 172.21.15.122:0/1455894663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8280004810 0x7f8280004c90 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f8284001360 tx=0x7f8284020810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3c783cbb036e41 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:15:18.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.480+0000 7f8299400640 1 -- 172.21.15.122:0/1455894663 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82840013a0 con 0x7f8280004810 2024-05-28T06:15:18.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.480+0000 7f8299400640 1 -- 172.21.15.122:0/1455894663 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82840052a0 con 0x7f8280004810 2024-05-28T06:15:18.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.480+0000 7f8299400640 1 -- 172.21.15.122:0/1455894663 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284003600 con 0x7f8280004810 2024-05-28T06:15:18.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.480+0000 7f82a1200640 1 -- 172.21.15.122:0/1455894663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8280004810 msgr2=0x7f8280004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:15:18.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.480+0000 7f82a1200640 1 --2- 172.21.15.122:0/1455894663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8280004810 0x7f8280004c90 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f8284001360 tx=0x7f8284020810 comp rx=0 tx=0).stop 2024-05-28T06:15:18.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.480+0000 7f82a1200640 1 -- 172.21.15.122:0/1455894663 shutdown_connections 2024-05-28T06:15:18.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.480+0000 7f82a1200640 1 --2- 172.21.15.122:0/1455894663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8280004810 0x7f8280004c90 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.480+0000 7f82a1200640 1 -- 172.21.15.122:0/1455894663 >> 172.21.15.122:0/1455894663 conn(0x7f829c06bd90 msgr2=0x7f829c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:15:18.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.480+0000 7f82a1200640 1 -- 172.21.15.122:0/1455894663 shutdown_connections 2024-05-28T06:15:18.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.480+0000 7f82a1200640 1 -- 172.21.15.122:0/1455894663 wait complete. 2024-05-28T06:15:18.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.480+0000 7f82a1200640 1 Processor -- start 2024-05-28T06:15:18.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.480+0000 7f82a1200640 1 -- start start 2024-05-28T06:15:18.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f82a1200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8280004810 0x7f829c0afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:15:18.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f82a1200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f829c13cee0 0x7f829c14ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:15:18.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f82a1200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f829c14d200 0x7f829c14bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:15:18.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f82a1200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f829c146260 con 0x7f829c13cee0 2024-05-28T06:15:18.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f82a1200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f829c0b5cb0 con 0x7f829c14d200 2024-05-28T06:15:18.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f82a1200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f829c14add0 con 0x7f8280004810 2024-05-28T06:15:18.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f8291400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f829c13cee0 0x7f829c14ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:15:18.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f8291400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f829c13cee0 0x7f829c14ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:42444/0 (socket says 172.21.15.122:42444) 2024-05-28T06:15:18.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f8291400640 1 -- 172.21.15.122:0/825734070 learned_addr learned my addr 172.21.15.122:0/825734070 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:15:18.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f829a800640 1 --2- 172.21.15.122:0/825734070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f829c14d200 0x7f829c14bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:15:18.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f8299e00640 1 --2- 172.21.15.122:0/825734070 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8280004810 0x7f829c0afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:15:18.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f8291400640 1 -- 172.21.15.122:0/825734070 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8280004810 msgr2=0x7f829c0afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:15:18.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f8291400640 1 --2- 172.21.15.122:0/825734070 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8280004810 0x7f829c0afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f8291400640 1 -- 172.21.15.122:0/825734070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f829c14d200 msgr2=0x7f829c14bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:15:18.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f8291400640 1 --2- 172.21.15.122:0/825734070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f829c14d200 0x7f829c14bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f8291400640 1 -- 172.21.15.122:0/825734070 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829c14b0b0 con 0x7f829c13cee0 2024-05-28T06:15:18.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f829a800640 1 --2- 172.21.15.122:0/825734070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f829c14d200 0x7f829c14bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:15:18.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f8299e00640 1 --2- 172.21.15.122:0/825734070 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8280004810 0x7f829c0afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-28T06:15:18.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f8291400640 1 --2- 172.21.15.122:0/825734070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f829c13cee0 0x7f829c14ccc0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f828409c120 tx=0x7f8280005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:15:18.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f8292a00640 1 -- 172.21.15.122:0/825734070 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82840bc070 con 0x7f829c13cee0 2024-05-28T06:15:18.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f8292a00640 1 -- 172.21.15.122:0/825734070 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8284007030 con 0x7f829c13cee0 2024-05-28T06:15:18.488 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f82a1200640 1 -- 172.21.15.122:0/825734070 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f829c14b390 con 0x7f829c13cee0 2024-05-28T06:15:18.488 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f8292a00640 1 -- 172.21.15.122:0/825734070 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284007a40 con 0x7f829c13cee0 2024-05-28T06:15:18.488 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f82a1200640 1 -- 172.21.15.122:0/825734070 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f829c15c3b0 con 0x7f829c13cee0 2024-05-28T06:15:18.488 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.484+0000 7f82a1200640 1 -- 172.21.15.122:0/825734070 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f829c068c40 con 0x7f829c13cee0 2024-05-28T06:15:18.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.488+0000 7f8292a00640 1 -- 172.21.15.122:0/825734070 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 88752+0+0 (secure 0 0 0) 0x7f82840bf070 con 0x7f829c13cee0 2024-05-28T06:15:18.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.488+0000 7f8292a00640 1 --2- 172.21.15.122:0/825734070 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8278068c20 0x7f827806b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:15:18.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.488+0000 7f8292a00640 1 -- 172.21.15.122:0/825734070 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f8284124ad0 con 0x7f829c13cee0 2024-05-28T06:15:18.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.488+0000 7f8299e00640 1 --2- 172.21.15.122:0/825734070 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8278068c20 0x7f827806b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:15:18.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.488+0000 7f8299e00640 1 --2- 172.21.15.122:0/825734070 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8278068c20 0x7f827806b0e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f828c001b70 tx=0x7f828c004b90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:15:18.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.492+0000 7f8292a00640 1 -- 172.21.15.122:0/825734070 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f82840b0020 con 0x7f829c13cee0 2024-05-28T06:15:18.650 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.652+0000 7f82a1200640 1 -- 172.21.15.122:0/825734070 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f829c14d5e0 con 0x7f829c13cee0 2024-05-28T06:15:18.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.656+0000 7f8292a00640 1 -- 172.21.15.122:0/825734070 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) ==== 123+0+0 (secure 0 0 0) 0x7f828401a520 con 0x7f829c13cee0 2024-05-28T06:15:18.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.656+0000 7f8292a00640 1 -- 172.21.15.122:0/825734070 <== mon.0 v2:172.21.15.122:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8284001460 con 0x7f829c13cee0 2024-05-28T06:15:18.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.656+0000 7f82a1200640 1 -- 172.21.15.122:0/825734070 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8278068c20 msgr2=0x7f827806b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:15:18.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.656+0000 7f82a1200640 1 --2- 172.21.15.122:0/825734070 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8278068c20 0x7f827806b0e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f828c001b70 tx=0x7f828c004b90 comp rx=0 tx=0).stop 2024-05-28T06:15:18.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.656+0000 7f82a1200640 1 -- 172.21.15.122:0/825734070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f829c13cee0 msgr2=0x7f829c14ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:15:18.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.656+0000 7f82a1200640 1 --2- 172.21.15.122:0/825734070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f829c13cee0 0x7f829c14ccc0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f828409c120 tx=0x7f8280005840 comp rx=0 tx=0).stop 2024-05-28T06:15:18.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.656+0000 7f82a1200640 1 -- 172.21.15.122:0/825734070 shutdown_connections 2024-05-28T06:15:18.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.656+0000 7f82a1200640 1 --2- 172.21.15.122:0/825734070 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f8278068c20 0x7f827806b0e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.656+0000 7f82a1200640 1 --2- 172.21.15.122:0/825734070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f829c14d200 0x7f829c14bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.656+0000 7f82a1200640 1 --2- 172.21.15.122:0/825734070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f829c13cee0 0x7f829c14ccc0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.656+0000 7f82a1200640 1 --2- 172.21.15.122:0/825734070 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8280004810 0x7f829c0afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.656+0000 7f82a1200640 1 -- 172.21.15.122:0/825734070 >> 172.21.15.122:0/825734070 conn(0x7f829c06bd90 msgr2=0x7f829c15ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:15:18.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.656+0000 7f82a1200640 1 -- 172.21.15.122:0/825734070 shutdown_connections 2024-05-28T06:15:18.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.656+0000 7f82a1200640 1 -- 172.21.15.122:0/825734070 wait complete. 2024-05-28T06:15:18.678 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-28T06:15:18.678 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-28T06:15:18.730 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:15:18.733 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:15:18.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.816+0000 7f6666a00640 1 Processor -- start 2024-05-28T06:15:18.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.816+0000 7f6666a00640 1 -- start start 2024-05-28T06:15:18.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.820+0000 7f6666a00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f666015b810 0x7f66600b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:15:18.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.820+0000 7f6666a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66600ccc10 0x7f66600cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:15:18.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.820+0000 7f6666a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f666015bdb0 con 0x7f666015b430 2024-05-28T06:15:18.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.820+0000 7f6666a00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f666015c090 con 0x7f666015b810 2024-05-28T06:15:18.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.820+0000 7f6666a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f666015c370 con 0x7f66600ccc10 2024-05-28T06:15:18.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.820+0000 7f6664c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f666015b810 0x7f66600b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:15:18.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.820+0000 7f6664c00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f666015b810 0x7f66600b31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:42460/0 (socket says 172.21.15.122:42460) 2024-05-28T06:15:18.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.820+0000 7f6664c00640 1 -- 172.21.15.122:0/704196381 learned_addr learned my addr 172.21.15.122:0/704196381 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:15:18.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.820+0000 7f6666000640 1 --2- 172.21.15.122:0/704196381 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66600ccc10 0x7f66600cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:15:18.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.820+0000 7f6664c00640 1 -- 172.21.15.122:0/704196381 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66600ccc10 msgr2=0x7f66600cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-28T06:15:18.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.820+0000 7f6664c00640 1 --2- 172.21.15.122:0/704196381 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66600ccc10 0x7f66600cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.820+0000 7f6664c00640 1 -- 172.21.15.122:0/704196381 >> v1:172.21.15.153:6789/0 conn(0x7f666015b430 legacy=0x7f66600cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:15:18.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.820+0000 7f6664c00640 1 -- 172.21.15.122:0/704196381 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f666015c650 con 0x7f666015b810 2024-05-28T06:15:18.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.824+0000 7f6664c00640 1 --2- 172.21.15.122:0/704196381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f666015b810 0x7f66600b31d0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f664c009870 tx=0x7f664c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50db2725849b88 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:15:18.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.824+0000 7f665fe00640 1 -- 172.21.15.122:0/704196381 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c0b2070 con 0x7f666015b810 2024-05-28T06:15:18.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.824+0000 7f665fe00640 1 -- 172.21.15.122:0/704196381 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f664c0a9070 con 0x7f666015b810 2024-05-28T06:15:18.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.824+0000 7f665fe00640 1 -- 172.21.15.122:0/704196381 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c0ad8a0 con 0x7f666015b810 2024-05-28T06:15:18.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.824+0000 7f6666a00640 1 -- 172.21.15.122:0/704196381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f666015b810 msgr2=0x7f66600b31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:15:18.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.824+0000 7f6666a00640 1 --2- 172.21.15.122:0/704196381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f666015b810 0x7f66600b31d0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f664c009870 tx=0x7f664c01c560 comp rx=0 tx=0).stop 2024-05-28T06:15:18.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.824+0000 7f6666a00640 1 -- 172.21.15.122:0/704196381 shutdown_connections 2024-05-28T06:15:18.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.824+0000 7f6666a00640 1 --2- 172.21.15.122:0/704196381 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66600ccc10 0x7f66600cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.824+0000 7f6666a00640 1 --2- 172.21.15.122:0/704196381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f666015b810 0x7f66600b31d0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.824+0000 7f6666a00640 1 -- 172.21.15.122:0/704196381 >> 172.21.15.122:0/704196381 conn(0x7f66600b20a0 msgr2=0x7f66600b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:15:18.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.824+0000 7f6666a00640 1 -- 172.21.15.122:0/704196381 shutdown_connections 2024-05-28T06:15:18.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.824+0000 7f6666a00640 1 -- 172.21.15.122:0/704196381 wait complete. 2024-05-28T06:15:18.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.824+0000 7f6666a00640 1 Processor -- start 2024-05-28T06:15:18.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.824+0000 7f6666a00640 1 -- start start 2024-05-28T06:15:18.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.824+0000 7f6666a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66600ccc10 0x7f6660155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:15:18.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.824+0000 7f6666a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f666015b430 0x7f66600730c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:15:18.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.824+0000 7f6666a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f666015b810 0x7f6660151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:15:18.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.824+0000 7f6666a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f66601681f0 con 0x7f66600ccc10 2024-05-28T06:15:18.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.824+0000 7f6666a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f66600b3920 con 0x7f666015b430 2024-05-28T06:15:18.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.824+0000 7f6666a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 -- 0x7f6660168370 con 0x7f666015b810 2024-05-28T06:15:18.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.824+0000 7f6665600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66600ccc10 0x7f6660155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:15:18.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.828+0000 7f6665600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66600ccc10 0x7f6660155040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:42464/0 (socket says 172.21.15.122:42464) 2024-05-28T06:15:18.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.828+0000 7f6665600640 1 -- 172.21.15.122:0/1237068188 learned_addr learned my addr 172.21.15.122:0/1237068188 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-05-28T06:15:18.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.828+0000 7f6664c00640 1 --2- 172.21.15.122:0/1237068188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f666015b430 0x7f66600730c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:15:18.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.828+0000 7f6666000640 1 --2- 172.21.15.122:0/1237068188 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f666015b810 0x7f6660151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:15:18.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.828+0000 7f6665600640 1 -- 172.21.15.122:0/1237068188 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f666015b810 msgr2=0x7f6660151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:15:18.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.828+0000 7f6665600640 1 --2- 172.21.15.122:0/1237068188 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f666015b810 0x7f6660151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.828+0000 7f6665600640 1 -- 172.21.15.122:0/1237068188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f666015b430 msgr2=0x7f66600730c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:15:18.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.828+0000 7f6665600640 1 --2- 172.21.15.122:0/1237068188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f666015b430 0x7f66600730c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:18.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.828+0000 7f6665600640 1 -- 172.21.15.122:0/1237068188 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66600737f0 con 0x7f66600ccc10 2024-05-28T06:15:18.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.828+0000 7f6665600640 1 --2- 172.21.15.122:0/1237068188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66600ccc10 0x7f6660155040 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f665400c790 tx=0x7f665400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:15:18.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.828+0000 7f665d600640 1 -- 172.21.15.122:0/1237068188 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6654016020 con 0x7f66600ccc10 2024-05-28T06:15:18.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.828+0000 7f665d600640 1 -- 172.21.15.122:0/1237068188 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6654006d60 con 0x7f66600ccc10 2024-05-28T06:15:18.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.828+0000 7f665d600640 1 -- 172.21.15.122:0/1237068188 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6654003be0 con 0x7f66600ccc10 2024-05-28T06:15:18.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.828+0000 7f6666a00640 1 -- 172.21.15.122:0/1237068188 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6660153610 con 0x7f66600ccc10 2024-05-28T06:15:18.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.828+0000 7f6666a00640 1 -- 172.21.15.122:0/1237068188 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6660153bd0 con 0x7f66600ccc10 2024-05-28T06:15:18.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.828+0000 7f6666a00640 1 -- 172.21.15.122:0/1237068188 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6660075620 con 0x7f66600ccc10 2024-05-28T06:15:18.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.828+0000 7f665d600640 1 -- 172.21.15.122:0/1237068188 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 88752+0+0 (secure 0 0 0) 0x7f665400a850 con 0x7f66600ccc10 2024-05-28T06:15:18.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.828+0000 7f665d600640 1 --2- 172.21.15.122:0/1237068188 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6640068bf0 0x7f664006b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-28T06:15:18.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.832+0000 7f665d600640 1 -- 172.21.15.122:0/1237068188 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5737+0+0 (secure 0 0 0) 0x7f66540876c0 con 0x7f66600ccc10 2024-05-28T06:15:18.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.832+0000 7f6664c00640 1 --2- 172.21.15.122:0/1237068188 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6640068bf0 0x7f664006b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-28T06:15:18.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.832+0000 7f6664c00640 1 --2- 172.21.15.122:0/1237068188 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6640068bf0 0x7f664006b0b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f664c0af000 tx=0x7f664c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-28T06:15:18.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:18.836+0000 7f665d600640 1 -- 172.21.15.122:0/1237068188 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6654020020 con 0x7f66600ccc10 2024-05-28T06:15:19.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:19.024+0000 7f6666a00640 1 -- 172.21.15.122:0/1237068188 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66600cde20 con 0x7f66600ccc10 2024-05-28T06:15:19.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:19.024+0000 7f665d600640 1 -- 172.21.15.122:0/1237068188 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5190 (secure 0 0 0) 0x7f66540567f0 con 0x7f66600ccc10 2024-05-28T06:15:19.024 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-05-28T06:15:19.024 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/726421131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":726421131},{"type":"v1","addr":"172.21.15.153:6834","nonce":726421131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5498,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4109795391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4109795391},{"type":"v1","addr":"172.21.15.153:6835","nonce":4109795391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/3019937124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":3019937124},{"type":"v1","addr":"172.21.15.122:6835","nonce":3019937124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-28T06:12:31.161573+0000","modified":"2024-05-28T06:12:34.187846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6300":{"gid":6300,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/3289678231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3289678231},{"type":"v1","addr":"172.21.15.122:6837","nonce":3289678231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6300,"qdb_cluster":[6300]},"id":4}]} 2024-05-28T06:15:19.024 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 38 2024-05-28T06:15:19.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:19.024+0000 7f6666a00640 1 -- 172.21.15.122:0/1237068188 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6640068bf0 msgr2=0x7f664006b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:15:19.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:19.024+0000 7f6666a00640 1 --2- 172.21.15.122:0/1237068188 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6640068bf0 0x7f664006b0b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f664c0af000 tx=0x7f664c008040 comp rx=0 tx=0).stop 2024-05-28T06:15:19.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:19.024+0000 7f6666a00640 1 -- 172.21.15.122:0/1237068188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66600ccc10 msgr2=0x7f6660155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-28T06:15:19.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:19.024+0000 7f6666a00640 1 --2- 172.21.15.122:0/1237068188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66600ccc10 0x7f6660155040 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f665400c790 tx=0x7f665400cc50 comp rx=0 tx=0).stop 2024-05-28T06:15:19.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:19.028+0000 7f6666a00640 1 -- 172.21.15.122:0/1237068188 shutdown_connections 2024-05-28T06:15:19.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:19.028+0000 7f6666a00640 1 --2- 172.21.15.122:0/1237068188 >> [v2:172.21.15.122:6832/3134913340,v1:172.21.15.122:6833/3134913340] conn(0x7f6640068bf0 0x7f664006b0b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:19.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:19.028+0000 7f6666a00640 1 --2- 172.21.15.122:0/1237068188 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f666015b810 0x7f6660151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:19.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:19.028+0000 7f6666a00640 1 --2- 172.21.15.122:0/1237068188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f666015b430 0x7f66600730c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:19.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:19.028+0000 7f6666a00640 1 --2- 172.21.15.122:0/1237068188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66600ccc10 0x7f6660155040 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-28T06:15:19.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:19.028+0000 7f6666a00640 1 -- 172.21.15.122:0/1237068188 >> 172.21.15.122:0/1237068188 conn(0x7f66600b20a0 msgr2=0x7f666015c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-28T06:15:19.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:19.028+0000 7f6666a00640 1 -- 172.21.15.122:0/1237068188 shutdown_connections 2024-05-28T06:15:19.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-05-28T06:15:19.028+0000 7f6666a00640 1 -- 172.21.15.122:0/1237068188 wait complete. 2024-05-28T06:15:19.044 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-28T06:15:19.045 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-28T06:15:19.045 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-28T06:15:19.045 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:15:19.102 INFO:tasks.ceph.mds.a:Stopped 2024-05-28T06:15:19.102 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-28T06:15:19.102 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:15:19.160 INFO:tasks.ceph.mds.c:Stopped 2024-05-28T06:15:19.160 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-28T06:15:19.160 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:15:19.174 INFO:tasks.ceph.mds.b:Stopped 2024-05-28T06:15:19.174 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-28T06:15:19.174 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:15:19.231 INFO:tasks.ceph.mds.d:Stopped 2024-05-28T06:15:19.231 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-28T06:15:19.231 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-28T06:15:19.231 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:15:19.327 INFO:tasks.ceph.osd.0:Stopped 2024-05-28T06:15:19.327 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-28T06:15:19.327 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:15:25.429 INFO:tasks.ceph.osd.1:Stopped 2024-05-28T06:15:25.429 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-28T06:15:25.429 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:15:25.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-05-28T06:15:25.510 INFO:tasks.ceph.osd.2:Stopped 2024-05-28T06:15:25.510 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-28T06:15:25.510 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:15:31.411 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-05-28T06:15:31.411 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-05-28T06:15:31.612 INFO:tasks.ceph.osd.3:Stopped 2024-05-28T06:15:31.612 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-28T06:15:31.612 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:15:31.701 INFO:tasks.ceph.osd.4:Stopped 2024-05-28T06:15:31.701 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-28T06:15:31.701 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:15:37.117 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-05-28T06:15:37.117 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-05-28T06:15:37.803 INFO:tasks.ceph.osd.5:Stopped 2024-05-28T06:15:37.804 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-28T06:15:37.804 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:15:37.892 INFO:tasks.ceph.osd.6:Stopped 2024-05-28T06:15:37.893 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-28T06:15:37.893 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:15:42.622 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-05-28T06:15:42.622 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-05-28T06:15:43.995 INFO:tasks.ceph.osd.7:Stopped 2024-05-28T06:15:43.995 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-28T06:15:43.996 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-28T06:15:43.996 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:15:48.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-05-28T06:15:48.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-05-28T06:15:48.794 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:15:48.797 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:15:50.098 INFO:tasks.ceph.mgr.y:Stopped 2024-05-28T06:15:50.099 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-28T06:15:50.099 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:15:50.155 INFO:tasks.ceph.mgr.x:Stopped 2024-05-28T06:15:50.155 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-28T06:15:50.155 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-28T06:15:50.155 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:15:50.175 INFO:tasks.ceph.mon.a:Stopped 2024-05-28T06:15:50.176 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-28T06:15:50.176 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:15:50.192 INFO:tasks.ceph.mon.b:Stopped 2024-05-28T06:15:50.193 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-28T06:15:50.193 INFO:teuthology.orchestra.run:waiting for 300 2024-05-28T06:15:50.256 INFO:tasks.ceph.mon.c:Stopped 2024-05-28T06:15:50.256 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-28T06:15:50.256 DEBUG:teuthology.orchestra.run.smithi122:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-05-28T06:15:50.297 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi122.front.sepia.ceph.com 2024-05-28T06:15:50.297 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-28T06:15:50.554 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi122.front.sepia.ceph.com 2024-05-28T06:15:50.554 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-28T06:15:50.740 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi122.front.sepia.ceph.com 2024-05-28T06:15:50.740 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-28T06:15:50.919 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi122.front.sepia.ceph.com 2024-05-28T06:15:50.919 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-28T06:15:51.099 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi153.front.sepia.ceph.com 2024-05-28T06:15:51.099 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-28T06:15:51.296 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi153.front.sepia.ceph.com 2024-05-28T06:15:51.296 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-28T06:15:51.522 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi153.front.sepia.ceph.com 2024-05-28T06:15:51.522 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-28T06:15:51.687 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi153.front.sepia.ceph.com 2024-05-28T06:15:51.688 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-28T06:15:51.864 INFO:tasks.ceph:Archiving mon data... 2024-05-28T06:15:51.866 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-05-28_05:40:25-fs:volumes-rishabh-clone-stats-testing-default-smithi/7729375/data/mon.a.tgz 2024-05-28T06:15:51.866 DEBUG:teuthology.orchestra.run.smithi122:> mktemp 2024-05-28T06:15:51.875 INFO:teuthology.orchestra.run.smithi122.stdout:/tmp/tmp.vT3ZfBLF82 2024-05-28T06:15:51.875 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.vT3ZfBLF82 2024-05-28T06:15:52.095 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0666 /tmp/tmp.vT3ZfBLF82 2024-05-28T06:15:52.168 DEBUG:teuthology.orchestra.remote:smithi122:/tmp/tmp.vT3ZfBLF82 is 1MB 2024-05-28T06:15:52.243 DEBUG:teuthology.orchestra.run.smithi122:> rm -fr /tmp/tmp.vT3ZfBLF82 2024-05-28T06:15:52.252 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-05-28_05:40:25-fs:volumes-rishabh-clone-stats-testing-default-smithi/7729375/data/mon.b.tgz 2024-05-28T06:15:52.252 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-05-28T06:15:52.261 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.VnHzKI1DXm 2024-05-28T06:15:52.261 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.VnHzKI1DXm 2024-05-28T06:15:52.494 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.VnHzKI1DXm 2024-05-28T06:15:52.567 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.VnHzKI1DXm is 1MB 2024-05-28T06:15:52.638 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.VnHzKI1DXm 2024-05-28T06:15:52.647 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-05-28_05:40:25-fs:volumes-rishabh-clone-stats-testing-default-smithi/7729375/data/mon.c.tgz 2024-05-28T06:15:52.647 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-05-28T06:15:52.699 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.CS77YB8RCu 2024-05-28T06:15:52.699 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.CS77YB8RCu 2024-05-28T06:15:52.926 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.CS77YB8RCu 2024-05-28T06:15:53.006 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.CS77YB8RCu is 1MB 2024-05-28T06:15:53.029 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-05-28T06:15:53.082 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.CS77YB8RCu 2024-05-28T06:15:53.090 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-28T06:15:53.091 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-28T06:15:53.094 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-28T06:15:53.168 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-28T06:15:53.199 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-28T06:15:53.199 INFO:tasks.ceph:Archiving crash dumps... 2024-05-28T06:15:53.201 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-05-28_05:40:25-fs:volumes-rishabh-clone-stats-testing-default-smithi/7729375/remote/smithi122/crash 2024-05-28T06:15:53.202 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-28T06:15:53.232 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-05-28_05:40:25-fs:volumes-rishabh-clone-stats-testing-default-smithi/7729375/remote/smithi153/crash 2024-05-28T06:15:53.233 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-28T06:15:53.261 INFO:tasks.ceph:Shutting down logrotate 2024-05-28T06:15:53.261 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:15:53.282 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-28T06:15:53.365 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-28T06:15:53.386 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-28T06:15:53.405 INFO:tasks.ceph:Compressing logs... 2024-05-28T06:15:53.405 DEBUG:teuthology.orchestra.run.smithi122:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-28T06:15:53.430 DEBUG:teuthology.orchestra.run.smithi153:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-28T06:15:53.457 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38577.log 2024-05-28T06:15:53.458 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39009.log 2024-05-28T06:15:53.459 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40530.log 2024-05-28T06:15:53.459 INFO:teuthology.orchestra.run.smithi122.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38577.log.gz 2024-05-28T06:15:53.460 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41323.log 2024-05-28T06:15:53.460 INFO:teuthology.orchestra.run.smithi122.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39009.log.gz 2024-05-28T06:15:53.461 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38339.log 2024-05-28T06:15:53.461 INFO:teuthology.orchestra.run.smithi122.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40530.log.gz 2024-05-28T06:15:53.462 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34180.log 2024-05-28T06:15:53.462 INFO:teuthology.orchestra.run.smithi122.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41323.log.gz 2024-05-28T06:15:53.463 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38663.log 2024-05-28T06:15:53.463 INFO:teuthology.orchestra.run.smithi122.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38339.log.gz 2024-05-28T06:15:53.463 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41291.log 2024-05-28T06:15:53.464 INFO:teuthology.orchestra.run.smithi122.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34180.log.gz 2024-05-28T06:15:53.464 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36661.log 2024-05-28T06:15:53.465 INFO:teuthology.orchestra.run.smithi122.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.38663.log.gz 2024-05-28T06:15:53.466 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37195.log 2024-05-28T06:15:53.466 INFO:teuthology.orchestra.run.smithi122.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41291.log.gz 2024-05-28T06:15:53.466 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34014.log 2024-05-28T06:15:53.466 INFO:teuthology.orchestra.run.smithi122.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36661.log.gz 2024-05-28T06:15:53.467 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39801.log 2024-05-28T06:15:53.468 INFO:teuthology.orchestra.run.smithi122.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37195.log.gz 2024-05-28T06:15:53.468 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40881.log 2024-05-28T06:15:53.468 INFO:teuthology.orchestra.run.smithi122.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34014.log.gz 2024-05-28T06:15:53.470 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40007.log 2024-05-28T06:15:53.470 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39801.log.gz 2024-05-28T06:15:53.470 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40881.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-28T06:15:53.470 INFO:teuthology.orchestra.run.smithi122.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40881.log.gz 2024-05-28T06:15:53.471 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.0.40007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.40007.log.gz 2024-05-28T06:15:53.471 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39184.log 2024-05-28T06:15:53.471 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33565.log 2024-05-28T06:15:53.472 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41239.log 2024-05-28T06:15:53.472 INFO:teuthology.orchestra.run.smithi122.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39184.log.gz 2024-05-28T06:15:53.473 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.33565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34404.log 2024-05-28T06:15:53.473 INFO:teuthology.orchestra.run.smithi122.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33565.log.gz 2024-05-28T06:15:53.473 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39132.log 2024-05-28T06:15:53.474 INFO:teuthology.orchestra.run.smithi122.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41239.log.gz 2024-05-28T06:15:53.474 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39087.log 2024-05-28T06:15:53.475 INFO:teuthology.orchestra.run.smithi122.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34404.log.gz 2024-05-28T06:15:53.475 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36094.log 2024-05-28T06:15:53.476 INFO:teuthology.orchestra.run.smithi122.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39132.log.gz 2024-05-28T06:15:53.476 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34976.log 2024-05-28T06:15:53.477 INFO:teuthology.orchestra.run.smithi122.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39087.log.gz 2024-05-28T06:15:53.477 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34182.log 2024-05-28T06:15:53.477 INFO:teuthology.orchestra.run.smithi122.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36094.log.gz 2024-05-28T06:15:53.478 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35080.log 2024-05-28T06:15:53.478 INFO:teuthology.orchestra.run.smithi122.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34976.log.gz 2024-05-28T06:15:53.479 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38313.log 2024-05-28T06:15:53.479 INFO:teuthology.orchestra.run.smithi122.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34182.log.gz 2024-05-28T06:15:53.480 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44124.log 2024-05-28T06:15:53.480 INFO:teuthology.orchestra.run.smithi122.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.35080.log.gz 2024-05-28T06:15:53.481 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44283.log 2024-05-28T06:15:53.481 INFO:teuthology.orchestra.run.smithi122.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38313.log.gz 2024-05-28T06:15:53.481 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.44124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38957.log 2024-05-28T06:15:53.482 INFO:teuthology.orchestra.run.smithi122.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44124.log.gz 2024-05-28T06:15:53.482 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.44283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38287.log 2024-05-28T06:15:53.483 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44283.log.gz 2024-05-28T06:15:53.483 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35520.log 2024-05-28T06:15:53.483 INFO:teuthology.orchestra.run.smithi122.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38957.log.gz 2024-05-28T06:15:53.484 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33683.log 2024-05-28T06:15:53.485 INFO:teuthology.orchestra.run.smithi122.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38287.log.gz 2024-05-28T06:15:53.485 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35520.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-28T06:15:53.485 INFO:teuthology.orchestra.run.smithi122.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35520.log.gz 2024-05-28T06:15:53.486 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33717.log 2024-05-28T06:15:53.486 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-28T06:15:53.487 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.33683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35491.log 2024-05-28T06:15:53.487 INFO:teuthology.orchestra.run.smithi122.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33683.log.gz 2024-05-28T06:15:53.487 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43890.log 2024-05-28T06:15:53.491 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.2.35491.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.35491.log.gz 2024-05-28T06:15:53.491 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36422.log 2024-05-28T06:15:53.491 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39879.log 2024-05-28T06:15:53.491 INFO:teuthology.orchestra.run.smithi122.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43890.log.gz 2024-05-28T06:15:53.492 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35244.log 2024-05-28T06:15:53.492 INFO:teuthology.orchestra.run.smithi122.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36422.log.gz 2024-05-28T06:15:53.492 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42545.log 2024-05-28T06:15:53.492 INFO:teuthology.orchestra.run.smithi122.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39879.log.gz 2024-05-28T06:15:53.493 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.1.33717.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.1.33717.log.gz 2024-05-28T06:15:53.493 INFO:teuthology.orchestra.run.smithi153.stderr: /var/log/ceph/ceph-osd.6.log 2024-05-28T06:15:53.493 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28132.log 2024-05-28T06:15:53.493 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28252.log 2024-05-28T06:15:53.493 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.28132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28084.log 2024-05-28T06:15:53.494 INFO:teuthology.orchestra.run.smithi153.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28132.log.gz 2024-05-28T06:15:53.494 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.28252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28180.log 2024-05-28T06:15:53.494 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28252.log.gz 2024-05-28T06:15:53.494 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.28084.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.28084.log.gzgzip 2024-05-28T06:15:53.494 INFO:teuthology.orchestra.run.smithi153.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-28T06:15:53.494 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.28180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28228.log 2024-05-28T06:15:53.494 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.28180.log.gz 2024-05-28T06:15:53.495 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28108.log 2024-05-28T06:15:53.498 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.28228.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.28228.log.gz 2024-05-28T06:15:53.499 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33806.log 2024-05-28T06:15:53.499 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.28108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33699.log 2024-05-28T06:15:53.499 INFO:teuthology.orchestra.run.smithi153.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.28108.log.gz 2024-05-28T06:15:53.499 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.3.33806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.33806.log.gz 2024-05-28T06:15:53.499 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33801.log 2024-05-28T06:15:53.499 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28156.log 2024-05-28T06:15:53.500 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.1.33699.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33699.log.gz 2024-05-28T06:15:53.500 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.3.33801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.33801.log.gz 2024-05-28T06:15:53.500 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-28T06:15:53.505 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-28T06:15:53.505 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.28156.log: /var/log/ceph/ceph-mgr.x.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.28156.log.gz 2024-05-28T06:15:53.505 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-28T06:15:53.505 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28204.log 2024-05-28T06:15:53.505 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-28T06:15:53.506 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.28204.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28204.log.gz 2024-05-28T06:15:53.506 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph.audit.log: 92.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-28T06:15:53.509 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-28T06:15:53.509 INFO:teuthology.orchestra.run.smithi153.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-28T06:15:53.509 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-28T06:15:53.509 INFO:teuthology.orchestra.run.smithi153.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-28T06:15:53.511 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43038.log 2024-05-28T06:15:53.511 INFO:teuthology.orchestra.run.smithi122.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35244.log.gz 2024-05-28T06:15:53.512 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35132.log 2024-05-28T06:15:53.512 INFO:teuthology.orchestra.run.smithi122.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42545.log.gz 2024-05-28T06:15:53.512 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36120.log 2024-05-28T06:15:53.512 INFO:teuthology.orchestra.run.smithi122.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43038.log.gz 2024-05-28T06:15:53.512 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35598.log 2024-05-28T06:15:53.512 INFO:teuthology.orchestra.run.smithi122.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35132.log.gz 2024-05-28T06:15:53.512 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34040.log 2024-05-28T06:15:53.512 INFO:teuthology.orchestra.run.smithi122.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36120.log.gz 2024-05-28T06:15:53.512 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40855.log 2024-05-28T06:15:53.513 INFO:teuthology.orchestra.run.smithi122.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35598.log.gz 2024-05-28T06:15:53.513 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40748.log 2024-05-28T06:15:53.513 INFO:teuthology.orchestra.run.smithi122.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34040.log.gz 2024-05-28T06:15:53.513 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38741.log 2024-05-28T06:15:53.513 INFO:teuthology.orchestra.run.smithi122.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.40855.log.gz 2024-05-28T06:15:53.513 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41213.log 2024-05-28T06:15:53.513 INFO:teuthology.orchestra.run.smithi122.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40748.log.gz 2024-05-28T06:15:53.513 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41995.log 2024-05-28T06:15:53.513 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38741.log.gz 2024-05-28T06:15:53.514 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38715.log 2024-05-28T06:15:53.514 INFO:teuthology.orchestra.run.smithi122.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41213.log.gz 2024-05-28T06:15:53.514 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36869.log 2024-05-28T06:15:53.514 INFO:teuthology.orchestra.run.smithi122.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41995.log.gz 2024-05-28T06:15:53.514 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35702.log 2024-05-28T06:15:53.514 INFO:teuthology.orchestra.run.smithi122.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38715.log.gz 2024-05-28T06:15:53.514 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43411.log 2024-05-28T06:15:53.514 INFO:teuthology.orchestra.run.smithi122.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36869.log.gz 2024-05-28T06:15:53.515 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41786.log 2024-05-28T06:15:53.515 INFO:teuthology.orchestra.run.smithi122.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35702.log.gz 2024-05-28T06:15:53.515 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33735.log 2024-05-28T06:15:53.515 INFO:teuthology.orchestra.run.smithi122.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43411.log.gz 2024-05-28T06:15:53.515 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39523.log 2024-05-28T06:15:53.515 INFO:teuthology.orchestra.run.smithi122.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41786.log.gz 2024-05-28T06:15:53.515 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.33735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36042.log 2024-05-28T06:15:53.515 INFO:teuthology.orchestra.run.smithi122.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33735.log.gz 2024-05-28T06:15:53.516 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40022.log 2024-05-28T06:15:53.516 INFO:teuthology.orchestra.run.smithi122.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39523.log.gz 2024-05-28T06:15:53.516 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42700.log 2024-05-28T06:15:53.516 INFO:teuthology.orchestra.run.smithi122.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36042.log.gz 2024-05-28T06:15:53.516 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33656.log 2024-05-28T06:15:53.516 INFO:teuthology.orchestra.run.smithi122.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40022.log.gz 2024-05-28T06:15:53.516 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36341.log 2024-05-28T06:15:53.516 INFO:teuthology.orchestra.run.smithi122.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42700.log.gz 2024-05-28T06:15:53.519 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-28T06:15:53.519 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-28T06:15:53.519 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 92.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-28T06:15:53.519 INFO:teuthology.orchestra.run.smithi153.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-28T06:15:53.523 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.33656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38801.log 2024-05-28T06:15:53.524 INFO:teuthology.orchestra.run.smithi122.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33656.log.gz 2024-05-28T06:15:53.524 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38235.log 2024-05-28T06:15:53.524 INFO:teuthology.orchestra.run.smithi122.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36341.log.gz 2024-05-28T06:15:53.524 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43064.log 2024-05-28T06:15:53.524 INFO:teuthology.orchestra.run.smithi122.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38801.log.gz 2024-05-28T06:15:53.524 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36947.log 2024-05-28T06:15:53.524 INFO:teuthology.orchestra.run.smithi122.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38235.log.gz 2024-05-28T06:15:53.525 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44176.log 2024-05-28T06:15:53.525 INFO:teuthology.orchestra.run.smithi122.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43064.log.gz 2024-05-28T06:15:53.525 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34197.log 2024-05-28T06:15:53.525 INFO:teuthology.orchestra.run.smithi122.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36947.log.gz 2024-05-28T06:15:53.525 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.44176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34794.log 2024-05-28T06:15:53.525 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44176.log.gz 2024-05-28T06:15:53.525 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43385.log 2024-05-28T06:15:53.525 INFO:teuthology.orchestra.run.smithi122.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34197.log.gz 2024-05-28T06:15:53.525 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33988.log 2024-05-28T06:15:53.526 INFO:teuthology.orchestra.run.smithi122.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34794.log.gz 2024-05-28T06:15:53.526 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39158.log 2024-05-28T06:15:53.526 INFO:teuthology.orchestra.run.smithi122.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43385.log.gz 2024-05-28T06:15:53.526 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.33988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42047.log 2024-05-28T06:15:53.526 INFO:teuthology.orchestra.run.smithi122.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33988.log.gz 2024-05-28T06:15:53.526 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39158.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-28T06:15:53.526 INFO:teuthology.orchestra.run.smithi122.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39158.log.gz 2024-05-28T06:15:53.526 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37857.log 2024-05-28T06:15:53.527 INFO:teuthology.orchestra.run.smithi122.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42047.log.gz 2024-05-28T06:15:53.528 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34611.log 2024-05-28T06:15:53.528 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.0.37857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.37857.log.gz 2024-05-28T06:15:53.528 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38525.log 2024-05-28T06:15:53.529 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.34611.log: /var/log/ceph/ceph-client.admin.41453.log 2024-05-28T06:15:53.529 INFO:teuthology.orchestra.run.smithi122.stderr: 88.7%/var/log/ceph/ceph-client.admin.38525.log: -- replaced with /var/log/ceph/ceph-client.admin.34611.log.gz 2024-05-28T06:15:53.529 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33532.log 2024-05-28T06:15:53.529 INFO:teuthology.orchestra.run.smithi122.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38525.log.gz 2024-05-28T06:15:53.531 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38689.log 2024-05-28T06:15:53.531 INFO:teuthology.orchestra.run.smithi122.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41453.log.gz 2024-05-28T06:15:53.531 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.33532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35886.log 2024-05-28T06:15:53.531 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38689.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33532.log.gz 2024-05-28T06:15:53.531 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38689.log.gz 2024-05-28T06:15:53.531 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36180.log 2024-05-28T06:15:53.532 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36367.log 2024-05-28T06:15:53.532 INFO:teuthology.orchestra.run.smithi122.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35886.log.gz 2024-05-28T06:15:53.532 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41838.log 2024-05-28T06:15:53.533 INFO:teuthology.orchestra.run.smithi122.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36180.log.gz 2024-05-28T06:15:53.534 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43464.log 2024-05-28T06:15:53.534 INFO:teuthology.orchestra.run.smithi122.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36367.log.gz 2024-05-28T06:15:53.535 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36016.log 2024-05-28T06:15:53.535 INFO:teuthology.orchestra.run.smithi122.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41838.log.gz 2024-05-28T06:15:53.536 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38827.log 2024-05-28T06:15:53.537 INFO:teuthology.orchestra.run.smithi122.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43464.log.gz 2024-05-28T06:15:53.537 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36016.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-28T06:15:53.537 INFO:teuthology.orchestra.run.smithi122.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36016.log.gz 2024-05-28T06:15:53.538 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38827.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.23123.log 2024-05-28T06:15:53.538 INFO:teuthology.orchestra.run.smithi122.stderr: 87.8%/var/log/ceph/ceph-mon.a.log: -- replaced with /var/log/ceph/ceph-client.admin.38827.log.gz 2024-05-28T06:15:53.539 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44363.log 2024-05-28T06:15:53.540 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph.tmp-client.admin.23123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44072.log 2024-05-28T06:15:53.540 INFO:teuthology.orchestra.run.smithi122.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.23123.log.gz 2024-05-28T06:15:53.541 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.44363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38419.log 2024-05-28T06:15:53.542 INFO:teuthology.orchestra.run.smithi122.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44363.log.gz 2024-05-28T06:15:53.542 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.44072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43437.log 2024-05-28T06:15:53.543 INFO:teuthology.orchestra.run.smithi122.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44072.log.gz 2024-05-28T06:15:53.544 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39748.log 2024-05-28T06:15:53.544 INFO:teuthology.orchestra.run.smithi122.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38419.log.gz 2024-05-28T06:15:53.544 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42376.log 2024-05-28T06:15:53.545 INFO:teuthology.orchestra.run.smithi122.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43437.log.gz 2024-05-28T06:15:53.545 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40907.log 2024-05-28T06:15:53.546 INFO:teuthology.orchestra.run.smithi122.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39748.log.gz 2024-05-28T06:15:53.547 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38767.log 2024-05-28T06:15:53.547 INFO:teuthology.orchestra.run.smithi122.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42376.log.gz 2024-05-28T06:15:53.548 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35405.log 2024-05-28T06:15:53.549 INFO:teuthology.orchestra.run.smithi122.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40907.log.gz 2024-05-28T06:15:53.550 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36687.log 2024-05-28T06:15:53.550 INFO:teuthology.orchestra.run.smithi122.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38767.log.gz 2024-05-28T06:15:53.551 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42101.log 2024-05-28T06:15:53.551 INFO:teuthology.orchestra.run.smithi122.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35405.log.gz 2024-05-28T06:15:53.553 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36526.log 2024-05-28T06:15:53.553 INFO:teuthology.orchestra.run.smithi122.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36687.log.gz 2024-05-28T06:15:53.553 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39853.log 2024-05-28T06:15:53.554 INFO:teuthology.orchestra.run.smithi122.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42101.log.gz 2024-05-28T06:15:53.556 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34188.log 2024-05-28T06:15:53.556 INFO:teuthology.orchestra.run.smithi122.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36526.log.gz 2024-05-28T06:15:53.556 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37403.log 2024-05-28T06:15:53.557 INFO:teuthology.orchestra.run.smithi122.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39853.log.gz 2024-05-28T06:15:53.557 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42021.log 2024-05-28T06:15:53.559 INFO:teuthology.orchestra.run.smithi122.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34188.log.gz 2024-05-28T06:15:53.559 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37578.log 2024-05-28T06:15:53.559 INFO:teuthology.orchestra.run.smithi122.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37403.log.gz 2024-05-28T06:15:53.560 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43942.log 2024-05-28T06:15:53.560 INFO:teuthology.orchestra.run.smithi122.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42021.log.gz 2024-05-28T06:15:53.562 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41656.log 2024-05-28T06:15:53.563 INFO:teuthology.orchestra.run.smithi122.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37578.log.gz 2024-05-28T06:15:53.563 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34118.log 2024-05-28T06:15:53.563 INFO:teuthology.orchestra.run.smithi122.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43942.log.gz 2024-05-28T06:15:53.563 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40959.log 2024-05-28T06:15:53.564 INFO:teuthology.orchestra.run.smithi122.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41656.log.gz 2024-05-28T06:15:53.564 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40048.log 2024-05-28T06:15:53.567 INFO:teuthology.orchestra.run.smithi122.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34118.log.gz 2024-05-28T06:15:53.567 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41349.log 2024-05-28T06:15:53.567 INFO:teuthology.orchestra.run.smithi122.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40959.log.gz 2024-05-28T06:15:53.568 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44098.log 2024-05-28T06:15:53.568 INFO:teuthology.orchestra.run.smithi122.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40048.log.gz 2024-05-28T06:15:53.568 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39827.log 2024-05-28T06:15:53.568 INFO:teuthology.orchestra.run.smithi122.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41349.log.gz 2024-05-28T06:15:53.572 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.44098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33880.log 2024-05-28T06:15:53.572 INFO:teuthology.orchestra.run.smithi122.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44098.log.gz 2024-05-28T06:15:53.572 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35728.log 2024-05-28T06:15:53.573 INFO:teuthology.orchestra.run.smithi122.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39827.log.gz 2024-05-28T06:15:53.573 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.33880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40274.log 2024-05-28T06:15:53.573 INFO:teuthology.orchestra.run.smithi122.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33880.log.gz 2024-05-28T06:15:53.574 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36557.log 2024-05-28T06:15:53.574 INFO:teuthology.orchestra.run.smithi122.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35728.log.gz 2024-05-28T06:15:53.574 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38551.log 2024-05-28T06:15:53.574 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40274.log.gz 2024-05-28T06:15:53.577 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34614.log 2024-05-28T06:15:53.577 INFO:teuthology.orchestra.run.smithi122.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36557.log.gz 2024-05-28T06:15:53.577 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38551.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38551.log.gz 2024-05-28T06:15:53.577 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35184.log 2024-05-28T06:15:53.577 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34614.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34614.log.gz 2024-05-28T06:15:53.578 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37630.log 2024-05-28T06:15:53.578 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43252.log 2024-05-28T06:15:53.579 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37630.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.35184.log.gz 2024-05-28T06:15:53.579 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34193.log 2024-05-28T06:15:53.579 INFO:teuthology.orchestra.run.smithi122.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37630.log.gz 2024-05-28T06:15:53.579 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38931.log 2024-05-28T06:15:53.579 INFO:teuthology.orchestra.run.smithi122.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43252.log.gz 2024-05-28T06:15:53.580 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43574.log 2024-05-28T06:15:53.580 INFO:teuthology.orchestra.run.smithi122.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34193.log.gz 2024-05-28T06:15:53.581 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41505.log 2024-05-28T06:15:53.581 INFO:teuthology.orchestra.run.smithi122.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38931.log.gz 2024-05-28T06:15:53.582 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42246.log 2024-05-28T06:15:53.583 INFO:teuthology.orchestra.run.smithi122.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43574.log.gz 2024-05-28T06:15:53.583 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36500.log 2024-05-28T06:15:53.584 INFO:teuthology.orchestra.run.smithi122.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41505.log.gz 2024-05-28T06:15:53.584 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43994.log 2024-05-28T06:15:53.585 INFO:teuthology.orchestra.run.smithi122.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42246.log.gz 2024-05-28T06:15:53.585 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43968.log 2024-05-28T06:15:53.586 INFO:teuthology.orchestra.run.smithi122.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36500.log.gz 2024-05-28T06:15:53.586 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40722.log 2024-05-28T06:15:53.587 INFO:teuthology.orchestra.run.smithi122.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43994.log.gz 2024-05-28T06:15:53.588 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37169.log 2024-05-28T06:15:53.588 INFO:teuthology.orchestra.run.smithi122.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43968.log.gz 2024-05-28T06:15:53.589 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33761.log 2024-05-28T06:15:53.589 INFO:teuthology.orchestra.run.smithi122.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40722.log.gz 2024-05-28T06:15:53.590 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42190.log 2024-05-28T06:15:53.590 INFO:teuthology.orchestra.run.smithi122.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37169.log.gz 2024-05-28T06:15:53.591 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.33761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41531.log 2024-05-28T06:15:53.592 INFO:teuthology.orchestra.run.smithi122.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33761.log.gz 2024-05-28T06:15:53.592 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40669.log 2024-05-28T06:15:53.593 INFO:teuthology.orchestra.run.smithi122.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42190.log.gz 2024-05-28T06:15:53.593 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35650.log 2024-05-28T06:15:53.594 INFO:teuthology.orchestra.run.smithi122.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41531.log.gz 2024-05-28T06:15:53.595 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39061.log 2024-05-28T06:15:53.595 INFO:teuthology.orchestra.run.smithi122.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40669.log.gz 2024-05-28T06:15:53.595 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35381.log 2024-05-28T06:15:53.596 INFO:teuthology.orchestra.run.smithi122.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35650.log.gz 2024-05-28T06:15:53.596 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42478.log 2024-05-28T06:15:53.597 INFO:teuthology.orchestra.run.smithi122.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39061.log.gz 2024-05-28T06:15:53.598 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.0.35381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34406.log 2024-05-28T06:15:53.598 INFO:teuthology.orchestra.run.smithi122.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35381.log.gz 2024-05-28T06:15:53.599 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43838.log 2024-05-28T06:15:53.599 INFO:teuthology.orchestra.run.smithi122.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42478.log.gz 2024-05-28T06:15:53.600 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37018.log 2024-05-28T06:15:53.601 INFO:teuthology.orchestra.run.smithi122.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34406.log.gz 2024-05-28T06:15:53.601 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38393.log 2024-05-28T06:15:53.601 INFO:teuthology.orchestra.run.smithi122.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43838.log.gz 2024-05-28T06:15:53.602 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37018.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-28T06:15:53.602 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37018.log.gz 2024-05-28T06:15:53.603 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36232.log 2024-05-28T06:15:53.603 INFO:teuthology.orchestra.run.smithi122.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38393.log.gz 2024-05-28T06:15:53.604 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36474.log 2024-05-28T06:15:53.605 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39236.log 2024-05-28T06:15:53.606 INFO:teuthology.orchestra.run.smithi122.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36232.log.gz 2024-05-28T06:15:53.607 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38100.log 2024-05-28T06:15:53.607 INFO:teuthology.orchestra.run.smithi122.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36474.log.gz 2024-05-28T06:15:53.608 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42662.log 2024-05-28T06:15:53.608 INFO:teuthology.orchestra.run.smithi122.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39236.log.gz 2024-05-28T06:15:53.609 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43916.log 2024-05-28T06:15:53.609 INFO:teuthology.orchestra.run.smithi122.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38100.log.gz 2024-05-28T06:15:53.610 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37760.log 2024-05-28T06:15:53.611 INFO:teuthology.orchestra.run.smithi122.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42662.log.gz 2024-05-28T06:15:53.612 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43185.log 2024-05-28T06:15:53.612 INFO:teuthology.orchestra.run.smithi122.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43916.log.gz 2024-05-28T06:15:53.614 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43652.log 2024-05-28T06:15:53.614 INFO:teuthology.orchestra.run.smithi122.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.37760.log.gz 2024-05-28T06:15:53.614 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34092.log 2024-05-28T06:15:53.614 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43185.log.gz 2024-05-28T06:15:53.616 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34194.log 2024-05-28T06:15:53.616 INFO:teuthology.orchestra.run.smithi122.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43652.log.gz 2024-05-28T06:15:53.617 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35990.log 2024-05-28T06:15:53.617 INFO:teuthology.orchestra.run.smithi122.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34092.log.gz 2024-05-28T06:15:53.618 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43626.log 2024-05-28T06:15:53.618 INFO:teuthology.orchestra.run.smithi122.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34194.log.gz 2024-05-28T06:15:53.619 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33787.log 2024-05-28T06:15:53.620 INFO:teuthology.orchestra.run.smithi122.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35990.log.gz 2024-05-28T06:15:53.620 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38499.log 2024-05-28T06:15:53.620 INFO:teuthology.orchestra.run.smithi122.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43626.log.gz 2024-05-28T06:15:53.622 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.33787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40100.log 2024-05-28T06:15:53.622 INFO:teuthology.orchestra.run.smithi122.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33787.log.gz 2024-05-28T06:15:53.623 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37862.log 2024-05-28T06:15:53.623 INFO:teuthology.orchestra.run.smithi122.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38499.log.gz 2024-05-28T06:15:53.624 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42958.log 2024-05-28T06:15:53.624 INFO:teuthology.orchestra.run.smithi122.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40100.log.gz 2024-05-28T06:15:53.625 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.0.37862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.37862.log.gz 2024-05-28T06:15:53.625 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37548.log 2024-05-28T06:15:53.626 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41187.log 2024-05-28T06:15:53.627 INFO:teuthology.orchestra.run.smithi122.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42958.log.gz 2024-05-28T06:15:53.628 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33932.log 2024-05-28T06:15:53.628 INFO:teuthology.orchestra.run.smithi122.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37548.log.gz 2024-05-28T06:15:53.629 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41187.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41187.log.gz 2024-05-28T06:15:53.630 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.33932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38261.log 2024-05-28T06:15:53.630 INFO:teuthology.orchestra.run.smithi122.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33932.log.gz 2024-05-28T06:15:53.631 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41871.log 2024-05-28T06:15:53.632 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38131.log 2024-05-28T06:15:53.633 INFO:teuthology.orchestra.run.smithi122.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38261.log.gz 2024-05-28T06:15:53.633 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41871.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41871.log.gz 2024-05-28T06:15:53.634 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44020.log 2024-05-28T06:15:53.634 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38131.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38131.log.gz 2024-05-28T06:15:53.635 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37299.log 2024-05-28T06:15:53.636 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.44020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41611.log 2024-05-28T06:15:53.636 INFO:teuthology.orchestra.run.smithi122.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44020.log.gz 2024-05-28T06:15:53.637 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43128.log 2024-05-28T06:15:53.637 INFO:teuthology.orchestra.run.smithi122.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37299.log.gz 2024-05-28T06:15:53.638 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41611.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41611.log.gz 2024-05-28T06:15:53.639 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-28T06:15:53.640 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42844.log 2024-05-28T06:15:53.640 INFO:teuthology.orchestra.run.smithi122.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43128.log.gz 2024-05-28T06:15:53.641 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42793.log 2024-05-28T06:15:53.643 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42844.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42844.log.gz 2024-05-28T06:15:53.643 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42793.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42793.log.gz 2024-05-28T06:15:53.644 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34820.log 2024-05-28T06:15:53.645 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36448.log 2024-05-28T06:15:53.647 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34820.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34820.log.gz 2024-05-28T06:15:53.647 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36448.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36448.log.gz 2024-05-28T06:15:53.648 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36393.log 2024-05-28T06:15:53.649 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33630.log 2024-05-28T06:15:53.651 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36393.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.36393.log.gz 2024-05-28T06:15:53.651 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.33630.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33630.log.gz 2024-05-28T06:15:53.652 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41479.log 2024-05-28T06:15:53.653 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35028.log 2024-05-28T06:15:53.655 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41479.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41479.log.gz 2024-05-28T06:15:53.656 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35028.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35028.log.gz 2024-05-28T06:15:53.656 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44202.log 2024-05-28T06:15:53.657 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36765.log 2024-05-28T06:15:53.659 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.44202.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44202.log.gz 2024-05-28T06:15:53.660 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36765.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36765.log.gz 2024-05-28T06:15:53.660 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37929.log 2024-05-28T06:15:53.661 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33962.log 2024-05-28T06:15:53.663 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37929.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37929.log.gz 2024-05-28T06:15:53.667 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.33962.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33962.log.gz 2024-05-28T06:15:53.667 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35938.log 2024-05-28T06:15:53.668 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34388.log 2024-05-28T06:15:53.668 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35938.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35938.log.gz 2024-05-28T06:15:53.668 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34388.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34388.log.gz 2024-05-28T06:15:53.669 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37496.log 2024-05-28T06:15:53.670 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39549.log 2024-05-28T06:15:53.671 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37496.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37496.log.gz 2024-05-28T06:15:53.672 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39549.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39549.log.gz 2024-05-28T06:15:53.673 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28153.log 2024-05-28T06:15:53.674 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38853.log 2024-05-28T06:15:53.676 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.28153.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.28153.log.gz 2024-05-28T06:15:53.676 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38853.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38853.log.gz 2024-05-28T06:15:53.677 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37461.log 2024-05-28T06:15:53.678 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40590.log 2024-05-28T06:15:53.680 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37461.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37461.log.gz 2024-05-28T06:15:53.680 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40590.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40590.log.gz 2024-05-28T06:15:53.681 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35912.log 2024-05-28T06:15:53.682 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37247.log 2024-05-28T06:15:53.684 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35912.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35912.log.gz 2024-05-28T06:15:53.684 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37247.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37247.log.gz 2024-05-28T06:15:53.685 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43812.log 2024-05-28T06:15:53.686 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36289.log 2024-05-28T06:15:53.688 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43812.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43812.log.gz 2024-05-28T06:15:53.688 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34846.log 2024-05-28T06:15:53.689 INFO:teuthology.orchestra.run.smithi122.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36289.log.gz 2024-05-28T06:15:53.690 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39722.log 2024-05-28T06:15:53.691 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34846.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34846.log.gz 2024-05-28T06:15:53.692 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39722.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39722.log.gz 2024-05-28T06:15:53.692 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37708.log 2024-05-28T06:15:53.694 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44046.log 2024-05-28T06:15:53.695 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37708.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37708.log.gz 2024-05-28T06:15:53.696 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.44046.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44046.log.gz 2024-05-28T06:15:53.697 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34600.log 2024-05-28T06:15:53.698 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35496.log 2024-05-28T06:15:53.699 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34600.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34600.log.gz 2024-05-28T06:15:53.700 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.2.35496.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.35496.log.gz 2024-05-28T06:15:53.701 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37433.log 2024-05-28T06:15:53.702 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35158.log 2024-05-28T06:15:53.703 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37433.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37433.log.gz 2024-05-28T06:15:53.704 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35158.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35158.log.gz 2024-05-28T06:15:53.704 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41113.log 2024-05-28T06:15:53.706 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43012.log 2024-05-28T06:15:53.707 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41113.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41113.log.gz 2024-05-28T06:15:53.708 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43012.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43012.log.gz 2024-05-28T06:15:53.709 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38473.log 2024-05-28T06:15:53.710 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42350.log 2024-05-28T06:15:53.711 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38473.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38473.log.gz 2024-05-28T06:15:53.712 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42350.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42350.log.gz 2024-05-28T06:15:53.713 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41903.log 2024-05-28T06:15:53.714 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42932.log 2024-05-28T06:15:53.715 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41903.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41903.log.gz 2024-05-28T06:15:53.716 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42932.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42932.log.gz 2024-05-28T06:15:53.717 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34924.log 2024-05-28T06:15:53.718 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35964.log 2024-05-28T06:15:53.719 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34924.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34924.log.gz 2024-05-28T06:15:53.720 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35964.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-28T06:15:53.721 INFO:teuthology.orchestra.run.smithi122.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35964.log.gz 2024-05-28T06:15:53.722 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36973.log 2024-05-28T06:15:53.725 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.36973.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36973.log.gz 2024-05-28T06:15:53.725 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42073.log 2024-05-28T06:15:53.725 INFO:teuthology.orchestra.run.smithi122.stderr: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-28T06:15:53.727 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42073.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42073.log.gz 2024-05-28T06:15:53.727 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35363.log 2024-05-28T06:15:53.729 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39496.log 2024-05-28T06:15:53.730 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.0.35363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35363.log.gz 2024-05-28T06:15:53.731 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39496.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39496.log.gz 2024-05-28T06:15:53.731 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34383.log 2024-05-28T06:15:53.733 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39288.log 2024-05-28T06:15:53.735 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34383.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34383.log.gz 2024-05-28T06:15:53.735 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39288.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39288.log.gz 2024-05-28T06:15:53.736 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35054.log 2024-05-28T06:15:53.737 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43492.log 2024-05-28T06:15:53.738 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35054.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35054.log.gz 2024-05-28T06:15:53.739 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43492.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43492.log.gz 2024-05-28T06:15:53.740 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41265.log 2024-05-28T06:15:53.741 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44337.log 2024-05-28T06:15:53.741 INFO:teuthology.orchestra.run.smithi153.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-28T06:15:53.743 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41265.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41265.log.gz 2024-05-28T06:15:53.743 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.44337.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44337.log.gz 2024-05-28T06:15:53.744 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37325.log 2024-05-28T06:15:53.745 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36258.log 2024-05-28T06:15:53.746 INFO:teuthology.orchestra.run.smithi153.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-28T06:15:53.747 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37325.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37325.log.gz 2024-05-28T06:15:53.747 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36258.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36258.log.gz 2024-05-28T06:15:53.748 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34602.log 2024-05-28T06:15:53.749 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39640.log 2024-05-28T06:15:53.751 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34602.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.34602.log.gz 2024-05-28T06:15:53.751 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39640.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39640.log.gz 2024-05-28T06:15:53.752 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33906.log 2024-05-28T06:15:53.753 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40801.log 2024-05-28T06:15:53.755 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.33906.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33906.log.gz 2024-05-28T06:15:53.756 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40801.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40801.log.gz 2024-05-28T06:15:53.756 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36843.log 2024-05-28T06:15:53.758 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42402.log 2024-05-28T06:15:53.759 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36843.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36843.log.gz 2024-05-28T06:15:53.760 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42402.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42402.log.gz 2024-05-28T06:15:53.760 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42525.log 2024-05-28T06:15:53.762 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35572.log 2024-05-28T06:15:53.763 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.0.42525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42525.log.gz 2024-05-28T06:15:53.764 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35572.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35572.log.gz 2024-05-28T06:15:53.764 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34198.log 2024-05-28T06:15:53.766 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37044.log 2024-05-28T06:15:53.767 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34198.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34198.log.gz 2024-05-28T06:15:53.768 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37044.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37044.log.gz 2024-05-28T06:15:53.768 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40933.log 2024-05-28T06:15:53.770 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35106.log 2024-05-28T06:15:53.771 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40933.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40933.log.gz 2024-05-28T06:15:53.772 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41969.log 2024-05-28T06:15:53.773 INFO:teuthology.orchestra.run.smithi122.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35106.log.gz 2024-05-28T06:15:53.774 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37143.log 2024-05-28T06:15:53.775 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41969.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41969.log.gz 2024-05-28T06:15:53.776 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37143.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37143.log.gz 2024-05-28T06:15:53.776 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43678.log 2024-05-28T06:15:53.778 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43304.log 2024-05-28T06:15:53.779 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43678.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43678.log.gz 2024-05-28T06:15:53.780 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43304.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43304.log.gz 2024-05-28T06:15:53.781 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41760.log 2024-05-28T06:15:53.782 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41009.log 2024-05-28T06:15:53.783 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41760.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41760.log.gz 2024-05-28T06:15:53.784 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41009.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41009.log.gz 2024-05-28T06:15:53.784 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36921.log 2024-05-28T06:15:53.786 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27934.log 2024-05-28T06:15:53.787 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36921.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36921.log.gz 2024-05-28T06:15:53.788 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.27934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41061.log 2024-05-28T06:15:53.789 INFO:teuthology.orchestra.run.smithi122.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.27934.log.gz 2024-05-28T06:15:53.789 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37273.log 2024-05-28T06:15:53.791 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41061.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41061.log.gz 2024-05-28T06:15:53.792 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37273.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37273.log.gz 2024-05-28T06:15:53.792 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34598.log 2024-05-28T06:15:53.793 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38182.log 2024-05-28T06:15:53.795 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34598.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34598.log.gz 2024-05-28T06:15:53.796 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38182.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38182.log.gz 2024-05-28T06:15:53.796 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42216.log 2024-05-28T06:15:53.798 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39470.log 2024-05-28T06:15:53.799 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42216.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42216.log.gz 2024-05-28T06:15:53.800 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39470.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39470.log.gz 2024-05-28T06:15:53.801 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37997.log 2024-05-28T06:15:53.802 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40375.log 2024-05-28T06:15:53.803 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37997.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37997.log.gz 2024-05-28T06:15:53.804 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39605.log 2024-05-28T06:15:53.805 INFO:teuthology.orchestra.run.smithi122.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40375.log.gz 2024-05-28T06:15:53.806 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34950.log 2024-05-28T06:15:53.807 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39605.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39605.log.gz 2024-05-28T06:15:53.808 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34950.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34950.log.gz 2024-05-28T06:15:53.808 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39666.log 2024-05-28T06:15:53.810 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38879.log 2024-05-28T06:15:53.811 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39666.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39666.log.gz 2024-05-28T06:15:53.812 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38879.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38879.log.gz 2024-05-28T06:15:53.812 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40829.log 2024-05-28T06:15:53.814 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42986.log 2024-05-28T06:15:53.815 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40829.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40829.log.gz 2024-05-28T06:15:53.816 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42986.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42986.log.gz 2024-05-28T06:15:53.816 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43331.log 2024-05-28T06:15:53.818 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37351.log 2024-05-28T06:15:53.819 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43331.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43331.log.gz 2024-05-28T06:15:53.820 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37351.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37351.log.gz 2024-05-28T06:15:53.821 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34066.log 2024-05-28T06:15:53.822 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44254.log 2024-05-28T06:15:53.823 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34066.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34066.log.gz 2024-05-28T06:15:53.824 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.44254.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44254.log.gz 2024-05-28T06:15:53.825 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34596.log 2024-05-28T06:15:53.826 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39379.log 2024-05-28T06:15:53.827 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34596.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34596.log.gz 2024-05-28T06:15:53.828 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37810.log 2024-05-28T06:15:53.829 INFO:teuthology.orchestra.run.smithi122.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39379.log.gz 2024-05-28T06:15:53.830 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34196.log 2024-05-28T06:15:53.831 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37810.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37810.log.gz 2024-05-28T06:15:53.832 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34196.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34196.log.gz 2024-05-28T06:15:53.832 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42894.log 2024-05-28T06:15:53.834 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40002.log 2024-05-28T06:15:53.836 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42894.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42894.log.gz 2024-05-28T06:15:53.836 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.0.40002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.40002.log.gz 2024-05-28T06:15:53.836 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34401.log 2024-05-28T06:15:53.838 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35780.log 2024-05-28T06:15:53.839 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34401.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34401.log.gz 2024-05-28T06:15:53.840 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35780.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35780.log.gz 2024-05-28T06:15:53.840 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38983.log 2024-05-28T06:15:53.842 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-28T06:15:53.843 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38983.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38983.log.gz 2024-05-28T06:15:53.846 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph.audit.log: 89.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-28T06:15:53.846 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-28T06:15:53.848 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34389.log 2024-05-28T06:15:53.851 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.34389.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34389.log.gz 2024-05-28T06:15:53.851 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38905.log 2024-05-28T06:15:53.853 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37221.log 2024-05-28T06:15:53.854 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38905.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38905.log.gz 2024-05-28T06:15:53.857 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43153.log 2024-05-28T06:15:53.857 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37221.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37221.log.gz 2024-05-28T06:15:53.860 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43153.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43153.log.gz 2024-05-28T06:15:53.860 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-28T06:15:53.864 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36206.log 2024-05-28T06:15:53.869 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37656.log 2024-05-28T06:15:53.871 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36206.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36206.log.gz 2024-05-28T06:15:53.874 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37656.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37656.log.gz 2024-05-28T06:15:53.875 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37903.log 2024-05-28T06:15:53.877 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36791.log 2024-05-28T06:15:53.878 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37903.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37903.log.gz 2024-05-28T06:15:53.879 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36791.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36791.log.gz 2024-05-28T06:15:53.884 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41375.log 2024-05-28T06:15:53.890 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41375.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41375.log.gz 2024-05-28T06:15:53.891 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43278.log 2024-05-28T06:15:53.893 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37682.log 2024-05-28T06:15:53.894 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37877.log 2024-05-28T06:15:53.894 INFO:teuthology.orchestra.run.smithi122.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43278.log.gz 2024-05-28T06:15:53.896 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37682.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37682.log.gz 2024-05-28T06:15:53.897 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34390.log 2024-05-28T06:15:53.901 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37877.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35624.log 2024-05-28T06:15:53.902 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34390.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34390.log.gz 2024-05-28T06:15:53.904 INFO:teuthology.orchestra.run.smithi122.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37877.log.gz 2024-05-28T06:15:53.906 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35624.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35624.log.gz 2024-05-28T06:15:53.908 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42164.log 2024-05-28T06:15:53.913 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41401.log 2024-05-28T06:15:53.914 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42164.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42164.log.gz 2024-05-28T06:15:53.917 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36315.log 2024-05-28T06:15:53.918 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41401.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41401.log.gz 2024-05-28T06:15:53.921 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42763.log 2024-05-28T06:15:53.922 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36315.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36315.log.gz 2024-05-28T06:15:53.925 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36739.log 2024-05-28T06:15:53.926 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42763.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42763.log.gz 2024-05-28T06:15:53.927 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40325.log 2024-05-28T06:15:53.929 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36895.log 2024-05-28T06:15:53.929 INFO:teuthology.orchestra.run.smithi122.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36739.log.gz 2024-05-28T06:15:53.930 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40325.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40325.log.gz 2024-05-28T06:15:53.934 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36895.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36895.log.gz 2024-05-28T06:15:53.936 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35858.log 2024-05-28T06:15:53.941 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41585.log 2024-05-28T06:15:53.942 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35858.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35858.log.gz 2024-05-28T06:15:53.945 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37734.log 2024-05-28T06:15:53.946 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41585.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41585.log.gz 2024-05-28T06:15:53.949 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34613.log 2024-05-28T06:15:53.950 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37734.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37734.log.gz 2024-05-28T06:15:53.953 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34586.log 2024-05-28T06:15:53.954 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34613.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34613.log.gz 2024-05-28T06:15:53.957 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41682.log 2024-05-28T06:15:53.958 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34586.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34586.log.gz 2024-05-28T06:15:53.961 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39262.log 2024-05-28T06:15:53.962 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41682.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41682.log.gz 2024-05-28T06:15:53.965 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33817.log 2024-05-28T06:15:53.966 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39262.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39262.log.gz 2024-05-28T06:15:53.970 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.33817.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33817.log.gz 2024-05-28T06:15:53.972 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40636.log 2024-05-28T06:15:53.977 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39210.log 2024-05-28T06:15:53.978 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40636.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40636.log.gz 2024-05-28T06:15:53.981 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36713.log 2024-05-28T06:15:53.982 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39210.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39210.log.gz 2024-05-28T06:15:53.985 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36068.log 2024-05-28T06:15:53.987 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39314.log 2024-05-28T06:15:53.987 INFO:teuthology.orchestra.run.smithi122.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36713.log.gz 2024-05-28T06:15:53.991 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39314.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39314.log.gz 2024-05-28T06:15:53.991 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41557.log 2024-05-28T06:15:53.996 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35676.log 2024-05-28T06:15:53.996 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36068.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36068.log.gz 2024-05-28T06:15:53.996 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41557.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41557.log.gz 2024-05-28T06:15:54.001 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38208.log 2024-05-28T06:15:54.003 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35676.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35676.log.gz 2024-05-28T06:15:54.006 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38208.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38208.log.gz 2024-05-28T06:15:54.008 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39955.log 2024-05-28T06:15:54.013 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43760.log 2024-05-28T06:15:54.014 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39955.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39955.log.gz 2024-05-28T06:15:54.017 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41035.log 2024-05-28T06:15:54.018 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43760.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43760.log.gz 2024-05-28T06:15:54.021 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43600.log 2024-05-28T06:15:54.022 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41035.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41035.log.gz 2024-05-28T06:15:54.026 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36635.log 2024-05-28T06:15:54.026 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43600.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43600.log.gz 2024-05-28T06:15:54.029 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5/var/log/ceph/ceph-client.admin.36635.log: --verbose -- /var/log/ceph/ceph-client.admin.34898.log 2024-05-28T06:15:54.029 INFO:teuthology.orchestra.run.smithi122.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36635.log.gz 2024-05-28T06:15:54.032 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5/var/log/ceph/ceph-client.admin.34898.log: --verbose -- /var/log/ceph/ceph-client.admin.41734.log 2024-05-28T06:15:54.037 INFO:teuthology.orchestra.run.smithi122.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34898.log.gz 2024-05-28T06:15:54.037 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44228.log 2024-05-28T06:15:54.038 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41734.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41734.log.gz 2024-05-28T06:15:54.040 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41812.log 2024-05-28T06:15:54.045 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.44228.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44228.log.gz 2024-05-28T06:15:54.045 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43359.log 2024-05-28T06:15:54.047 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41812.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41812.log.gz 2024-05-28T06:15:54.054 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43359.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43359.log.gz 2024-05-28T06:15:54.056 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35754.log 2024-05-28T06:15:54.061 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39577.log 2024-05-28T06:15:54.062 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35754.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35754.log.gz 2024-05-28T06:15:54.065 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42598.log 2024-05-28T06:15:54.067 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39577.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39577.log.gz 2024-05-28T06:15:54.069 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33709.log 2024-05-28T06:15:54.070 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42598.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42598.log.gz 2024-05-28T06:15:54.074 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.33709.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33709.log.gz 2024-05-28T06:15:54.076 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37522.log 2024-05-28T06:15:54.081 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44313.log 2024-05-28T06:15:54.083 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37522.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37522.log.gz 2024-05-28T06:15:54.085 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39692.log 2024-05-28T06:15:54.087 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.44313.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44313.log.gz 2024-05-28T06:15:54.089 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42737.log 2024-05-28T06:15:54.091 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39692.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39692.log.gz 2024-05-28T06:15:54.093 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41087.log 2024-05-28T06:15:54.095 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42737.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42737.log.gz 2024-05-28T06:15:54.098 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41087.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41087.log.gz 2024-05-28T06:15:54.100 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40074.log 2024-05-28T06:15:54.105 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40138.log 2024-05-28T06:15:54.106 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40074.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40074.log.gz 2024-05-28T06:15:54.109 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40413.log 2024-05-28T06:15:54.110 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40138.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40138.log.gz 2024-05-28T06:15:54.112 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39774.log 2024-05-28T06:15:54.117 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40413.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40413.log.gz 2024-05-28T06:15:54.117 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40206.log 2024-05-28T06:15:54.119 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39774.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39774.log.gz 2024-05-28T06:15:54.121 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41427.log 2024-05-28T06:15:54.122 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40206.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40206.log.gz 2024-05-28T06:15:54.123 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41427.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41427.log.gz 2024-05-28T06:15:54.124 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40775.log 2024-05-28T06:15:54.129 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35546.log 2024-05-28T06:15:54.130 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40775.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40775.log.gz 2024-05-28T06:15:54.133 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43226.log 2024-05-28T06:15:54.134 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35546.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35546.log.gz 2024-05-28T06:15:54.137 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37377.log 2024-05-28T06:15:54.138 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43226.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43226.log.gz 2024-05-28T06:15:54.141 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37955.log 2024-05-28T06:15:54.142 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37377.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37377.log.gz 2024-05-28T06:15:54.145 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40244.log 2024-05-28T06:15:54.146 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37955.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37955.log.gz 2024-05-28T06:15:54.150 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40244.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40244.log.gz 2024-05-28T06:15:54.152 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34405.log 2024-05-28T06:15:54.157 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42530.log 2024-05-28T06:15:54.158 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34405.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34405.log.gz 2024-05-28T06:15:54.161 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33845.log 2024-05-28T06:15:54.162 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.0.42530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42530.log.gz 2024-05-28T06:15:54.165 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37097.log 2024-05-28T06:15:54.166 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.33845.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33845.log.gz 2024-05-28T06:15:54.168 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42298.log 2024-05-28T06:15:54.172 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37097.log: /var/log/ceph/ceph-client.admin.42298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36583.log 2024-05-28T06:15:54.173 INFO:teuthology.orchestra.run.smithi122.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37097.log.gz 2024-05-28T06:15:54.177 INFO:teuthology.orchestra.run.smithi122.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42298.log.gz 2024-05-28T06:15:54.177 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36609.log 2024-05-28T06:15:54.178 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36583.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36583.log.gz 2024-05-28T06:15:54.181 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39347.log 2024-05-28T06:15:54.183 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36609.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36609.log.gz 2024-05-28T06:15:54.184 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43102.log 2024-05-28T06:15:54.189 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39347.log: gzip -5 --verbose -- 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39347.log.gz 2024-05-28T06:15:54.189 INFO:teuthology.orchestra.run.smithi122.stderr: /var/log/ceph/ceph-client.admin.38367.log 2024-05-28T06:15:54.190 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43102.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.43102.log.gz 2024-05-28T06:15:54.193 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28050.log 2024-05-28T06:15:54.194 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38367.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38367.log.gz 2024-05-28T06:15:54.198 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.28050.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.28050.log.gz 2024-05-28T06:15:54.200 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43520.log 2024-05-28T06:15:54.205 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41151.log 2024-05-28T06:15:54.206 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43520.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43520.log.gz 2024-05-28T06:15:54.209 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42129.log 2024-05-28T06:15:54.210 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41151.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41151.log.gz 2024-05-28T06:15:54.214 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42129.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42129.log.gz 2024-05-28T06:15:54.216 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43864.log 2024-05-28T06:15:54.221 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37604.log 2024-05-28T06:15:54.222 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43864.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43864.log.gz 2024-05-28T06:15:54.225 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36817.log 2024-05-28T06:15:54.226 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37604.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37604.log.gz 2024-05-28T06:15:54.229 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39444.log 2024-05-28T06:15:54.231 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36817.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36817.log.gz 2024-05-28T06:15:54.234 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38445.log 2024-05-28T06:15:54.235 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39444.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39444.log.gz 2024-05-28T06:15:54.235 INFO:teuthology.orchestra.run.smithi122.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-28T06:15:54.236 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43546.log 2024-05-28T06:15:54.239 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38627.log 2024-05-28T06:15:54.240 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43546.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43546.log.gz 2024-05-28T06:15:54.241 INFO:teuthology.orchestra.run.smithi122.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38445.log.gz 2024-05-28T06:15:54.244 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38627.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38627.log.gz 2024-05-28T06:15:54.244 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41708.log 2024-05-28T06:15:54.247 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41708.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41708.log.gz 2024-05-28T06:15:54.248 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40695.log 2024-05-28T06:15:54.250 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40695.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40695.log.gz 2024-05-28T06:15:54.250 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35832.log 2024-05-28T06:15:54.257 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35832.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35832.log.gz 2024-05-28T06:15:54.257 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39035.log 2024-05-28T06:15:54.258 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39035.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39035.log.gz 2024-05-28T06:15:54.258 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43786.log 2024-05-28T06:15:54.261 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43786.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43786.log.gz 2024-05-28T06:15:54.261 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38060.log 2024-05-28T06:15:54.263 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.38060.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38060.log.gz 2024-05-28T06:15:54.263 INFO:teuthology.orchestra.run.smithi122.stderr: -- /var/log/ceph/ceph-client.admin.42624.log 2024-05-28T06:15:54.266 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42624.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42624.log.gz 2024-05-28T06:15:54.266 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42428.log 2024-05-28T06:15:54.272 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42428.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.42428.log.gz 2024-05-28T06:15:54.273 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39905.log 2024-05-28T06:15:54.273 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39905.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.39905.log.gz 2024-05-28T06:15:54.273 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42272.log 2024-05-28T06:15:54.274 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43734.log 2024-05-28T06:15:54.276 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33464.log 2024-05-28T06:15:54.278 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42272.log: /var/log/ceph/ceph-client.admin.33464.log: 87.8% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33464.log.gz 2024-05-28T06:15:54.279 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.43734.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42272.log.gz 2024-05-28T06:15:54.281 INFO:teuthology.orchestra.run.smithi122.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43734.log.gz 2024-05-28T06:15:54.281 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35002.log 2024-05-28T06:15:54.283 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34144.log 2024-05-28T06:15:54.284 INFO:teuthology.orchestra.run.smithi122.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42324.log 2024-05-28T06:15:54.285 INFO:teuthology.orchestra.run.smithi122.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35002.log.gz 2024-05-28T06:15:54.285 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34144.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34144.log.gz 2024-05-28T06:15:54.291 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42324.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42324.log.gz 2024-05-28T06:15:54.292 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36154.log 2024-05-28T06:15:54.292 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36154.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36154.log.gz 2024-05-28T06:15:54.292 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35806.log 2024-05-28T06:15:54.294 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35806.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35806.log.gz 2024-05-28T06:15:54.295 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42572.log 2024-05-28T06:15:54.297 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44150.log 2024-05-28T06:15:54.298 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42572.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42572.log.gz 2024-05-28T06:15:54.300 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.44150.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44150.log.gz 2024-05-28T06:15:54.301 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34872.log 2024-05-28T06:15:54.303 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34872.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34872.log.gz 2024-05-28T06:15:54.993 INFO:teuthology.orchestra.run.smithi122.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-28T06:15:55.133 INFO:teuthology.orchestra.run.smithi153.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-28T06:15:55.185 INFO:teuthology.orchestra.run.smithi122.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-28T06:15:55.297 INFO:teuthology.orchestra.run.smithi153.stderr: 94.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-28T06:15:55.394 INFO:teuthology.orchestra.run.smithi153.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-28T06:15:55.588 INFO:teuthology.orchestra.run.smithi153.stderr: 94.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-28T06:15:55.590 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-05-28T06:15:55.590 INFO:teuthology.orchestra.run.smithi153.stderr:real 0m2.137s 2024-05-28T06:15:55.590 INFO:teuthology.orchestra.run.smithi153.stderr:user 0m7.342s 2024-05-28T06:15:55.590 INFO:teuthology.orchestra.run.smithi153.stderr:sys 0m0.663s 2024-05-28T06:15:55.611 INFO:teuthology.orchestra.run.smithi122.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-28T06:15:55.767 INFO:teuthology.orchestra.run.smithi122.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-28T06:15:55.887 INFO:teuthology.orchestra.run.smithi122.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-28T06:15:56.069 INFO:teuthology.orchestra.run.smithi122.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-28T06:15:56.172 INFO:teuthology.orchestra.run.smithi122.stderr: 94.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-28T06:15:56.174 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-05-28T06:15:56.174 INFO:teuthology.orchestra.run.smithi122.stderr:real 0m2.740s 2024-05-28T06:15:56.174 INFO:teuthology.orchestra.run.smithi122.stderr:user 0m14.128s 2024-05-28T06:15:56.174 INFO:teuthology.orchestra.run.smithi122.stderr:sys 0m1.656s 2024-05-28T06:15:56.175 INFO:tasks.ceph:Archiving logs... 2024-05-28T06:15:56.175 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-05-28_05:40:25-fs:volumes-rishabh-clone-stats-testing-default-smithi/7729375/remote/smithi122/log 2024-05-28T06:15:56.176 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-28T06:15:57.750 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-05-28_05:40:25-fs:volumes-rishabh-clone-stats-testing-default-smithi/7729375/remote/smithi153/log 2024-05-28T06:15:57.751 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-28T06:15:58.566 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-28T06:15:58.576 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-28T06:15:58.576 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-28T06:15:58.580 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-28T06:15:58.666 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-28T06:15:58.675 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-28T06:15:58.676 DEBUG:teuthology.orchestra.run.smithi122:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-28T06:15:58.679 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-28T06:15:58.692 INFO:teuthology.orchestra.run.smithi122.stdout: remote refid st t when poll reach delay offset jitter 2024-05-28T06:15:58.692 INFO:teuthology.orchestra.run.smithi122.stdout:============================================================================== 2024-05-28T06:15:58.692 INFO:teuthology.orchestra.run.smithi122.stdout:*hv01.front.sepi 67.205.162.81 3 u 54 64 377 0.075 -1.590 2.141 2024-05-28T06:15:58.692 INFO:teuthology.orchestra.run.smithi122.stdout:+hv02.front.sepi 63.231.80.2 3 u 57 64 377 0.083 -0.335 2.761 2024-05-28T06:15:58.693 INFO:teuthology.orchestra.run.smithi122.stdout:+hv03.front.sepi 74.6.168.72 3 u 59 64 377 0.085 -2.514 2.319 2024-05-28T06:15:58.693 INFO:teuthology.orchestra.run.smithi122.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-05-28T06:15:58.695 INFO:teuthology.orchestra.run.smithi153.stdout: remote refid st t when poll reach delay offset jitter 2024-05-28T06:15:58.695 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================== 2024-05-28T06:15:58.695 INFO:teuthology.orchestra.run.smithi153.stdout:+hv01.front.sepi 67.205.162.81 3 u 55 64 377 0.094 -0.565 1.571 2024-05-28T06:15:58.695 INFO:teuthology.orchestra.run.smithi153.stdout:*hv02.front.sepi 63.231.80.2 3 u 57 64 377 0.068 -1.233 1.060 2024-05-28T06:15:58.696 INFO:teuthology.orchestra.run.smithi153.stdout:+hv03.front.sepi 74.6.168.72 3 u 64 64 377 0.087 -0.973 2.203 2024-05-28T06:15:58.696 INFO:teuthology.orchestra.run.smithi153.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-05-28T06:15:58.697 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-28T06:15:58.767 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-28T06:15:58.768 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-28T06:15:58.841 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-28T06:15:58.933 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-28T06:15:58.991 INFO:teuthology.task.internal:Duration was 1318.325210 seconds 2024-05-28T06:15:58.992 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-28T06:15:59.013 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-28T06:15:59.013 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-28T06:15:59.017 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-28T06:15:59.125 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-28T06:15:59.125 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi122.front.sepia.ceph.com 2024-05-28T06:15:59.125 DEBUG:teuthology.orchestra.run.smithi122:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-28T06:15:59.146 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2024-05-28T06:15:59.147 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-28T06:15:59.167 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-28T06:15:59.168 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-28T06:15:59.195 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-28T06:15:59.253 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-28T06:15:59.254 DEBUG:teuthology.orchestra.run.smithi122:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-28T06:15:59.283 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-28T06:15:59.373 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-28T06:15:59.385 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-28T06:15:59.385 DEBUG:teuthology.orchestra.run.smithi122:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-28T06:15:59.405 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-28T06:15:59.425 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-28T06:15:59.477 DEBUG:teuthology.orchestra.run.smithi122:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-28T06:15:59.480 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-28T06:15:59.494 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = core 2024-05-28T06:15:59.498 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2024-05-28T06:15:59.516 DEBUG:teuthology.orchestra.run.smithi122:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-28T06:15:59.562 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-28T06:15:59.563 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-28T06:15:59.570 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-28T06:15:59.571 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-28T06:15:59.580 INFO:teuthology.task.internal:Transferring archived files... 2024-05-28T06:15:59.581 DEBUG:teuthology.misc:Transferring archived files from smithi122:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-05-28_05:40:25-fs:volumes-rishabh-clone-stats-testing-default-smithi/7729375/remote/smithi122 2024-05-28T06:15:59.581 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-28T06:15:59.633 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-05-28_05:40:25-fs:volumes-rishabh-clone-stats-testing-default-smithi/7729375/remote/smithi153 2024-05-28T06:15:59.634 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-28T06:15:59.659 INFO:teuthology.task.internal:Removing archive directory... 2024-05-28T06:15:59.659 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-28T06:15:59.679 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-28T06:15:59.707 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-28T06:15:59.719 INFO:teuthology.task.internal:Not uploading archives. 2024-05-28T06:15:59.720 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-28T06:15:59.849 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-28T06:15:59.850 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-28T06:15:59.853 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-28T06:15:59.859 INFO:teuthology.orchestra.run.smithi122.stdout: 658124 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 28 06:15 /home/ubuntu/cephtest 2024-05-28T06:15:59.862 INFO:teuthology.orchestra.run.smithi153.stdout: 658124 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 28 06:15 /home/ubuntu/cephtest 2024-05-28T06:15:59.864 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-28T06:15:59.924 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-28T06:16:00.093 INFO:teuthology.run:Summary data: client.0-kernel-sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 client.1-kernel-sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}} duration: 1318.3252103328705 failure_reason: 'Test failure: test_progress_bars_for_7_clones (tasks.cephfs.test_volumes.TestCloneProgressReporter)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=ee142806619343eeb8f623c67c931144 status: fail success: false 2024-05-28T06:16:00.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-28T06:16:00.160 INFO:teuthology.run:FAIL